New energy digital linkage sand table system based on Internet of Things system

Abstract

The invention relates to the field of digital sand tables, and discloses a new energy digital linkage sand table system based on an internet-of-things system, which comprises a central control module, an internet-of-things module, an interaction module, an audio-visual module and a sand table module, the system is designed to be capable of running and switching in three control modes with different priorities: a preset sequence playing mode for performing programmed and automatic content display according to a preset script; in the manual intervention playing mode, an operator is allowed to send an instruction at any time through a central control system or an operation table so as to interrupt or jump to a preset process; and in the intelligent interactive playing mode, the interactive module analyzes the sight line and the voice of the user and then generates a highest priority instruction, and the system is driven to adaptively respond to the real-time concern of the audience. According to the multi-mode fusion design, the sand table system is improved from single program playing to a comprehensive display platform integrating plannability, control flexibility and intelligent response capability.

Description

Technical Field

[0001] This disclosure relates to the field of digital sand table, and in particular to a new energy digital linkage sand table system based on the Internet of Things. Background Technology

[0002] Sand table models are a tool for intuitive visualization. For new energy systems with complex industrial structures, traditional sand table models are limited to displaying local data. While newer models consider using IoT data to sense and change the display effect, they neglect the user's ability to issue commands to the sand table, and their integration methods have significant technical limitations. On one hand, there is often a weak coupling or separation between real-time data and the visualization of the physical sand table model. Data is often presented only as numbers or charts on a separate screen, while the lighting or other effects on the sand table itself can only perform simple, preset start and stop actions. There is a lack of technical means to map continuously changing numerical data proportionally to multi-dimensional visual effects (such as brightness, color, and dynamic range) on the sand table in real time. This results in an unintuitive interaction between data and the physical model, failing to accurately reflect the dynamic operating status of the new energy system.

[0003] Furthermore, the control and data links of existing systems are typically independent, lacking a unified command and data processing core. User interactions, external IoT data input, and multimedia display outputs (such as video, sand table lighting, and projection) are handled separately by different subsystems. This easily leads to technical problems such as response delays and asynchrony between visuals and physical effects at each output end. Simultaneously, when faced with concurrent commands from both the user and data ends, the system lacks effective command queue management and synchronization mechanisms, which can easily cause operational conflicts or logical confusion, reducing the reliability and consistency of the entire display system. Summary of the Invention

[0004] To address the aforementioned technical problems, this invention provides a new energy digital linkage sand table system based on the Internet of Things (IoT) system.

[0005] To address the aforementioned technical problems, the first aspect of this invention provides a new energy digital linkage sand table system based on an Internet of Things (IoT) system, the system comprising:

[0006] The central control module is used to generate and distribute control commands;

[0007] The IoT module is used to acquire and distribute real-time operational data;

[0008] The audio-visual module has a built-in server computer 1 for processing audio-visual tasks and is connected to a display terminal and an audio terminal.

[0009] The sand table module has a built-in server computer 2 for handling physical effects tasks, and is connected to the sand table's lighting system, VR system, and 3D mapping projection system.

[0010] The interaction module analyzes user intent and generates interaction commands through visual and auditory acquisition devices;

[0011] Its distinguishing feature is that the system is configured to receive and execute instructions in three switchable modes to drive the audiovisual module and the sand table module to display synchronously:

[0012] Preset sequential playback mode: The server computers 1 and 2 automatically and sequentially execute a series of display instructions according to a pre-set programmed script to achieve programmed playback of the content;

[0013] Manual intervention playback mode: The server computers 1 and 2 receive manual operation instructions from the central control module or the control console connected to it, and execute the instructions first, thereby realizing the immediate interruption or selective jump of the preset playback sequence.

[0014] Intelligent interactive playback mode: The server computers 1 and 2 receive interactive instructions generated by the interactive module after analyzing the user's focus, and execute the instructions with the highest priority to realize intelligent, adaptive interruption and response to the currently playing content.

[0015] The central control module includes: a central control host, a network switch, and a portable mobile device connected to the network switch via a network. The central control host is connected to the network switch and is used to generate control commands and distribute the commands to the corresponding modules of the system through the network switch.

[0016] The IoT module includes: a new energy project operation terminal as the data source, a cloud as the data upload carrier, and an extraction and analysis terminal for extracting and analyzing the cloud data and transmitting it to the server computer. The extraction and analysis terminal is used to obtain the operation data from the cloud, preprocess, filter and format the data, and then transmit the processed target data to server computer 1 and server computer 2.

[0017] The audiovisual module includes: a server computer 1 connected to a network switch, an IoT module, and an operating terminal; a human-computer interaction operating terminal for user selection and control of the display; a display terminal for displaying videos and data; and an audio terminal for playing corresponding sound effects. The server computer 1, as the core controller of the audiovisual module, receives and processes instructions and data from the network switch, IoT module, and operating terminal, and generates corresponding visual and audio output signals.

[0018] The sand table module includes: a server computer 2 connected to a network switch, an IoT module, and an operating terminal; a 3D Mapping projection control system for accurately projecting three-dimensional images onto the sand table body; a VR projection system including VR display equipment; a lighting system set up in different new energy sectors; and the sand table body that carries the projection and lighting effects. The server computer 2, as the core controller of the sand table module, receives and processes instructions and data from the network switch, IoT module, and operating terminal, and generates real-time control signals for the 3D Mapping projection control system, VR projection system, and lighting system.

[0019] To handle concurrent commands from the central control module and the operating terminal, server computer 1 and server computer 2 are configured with concurrent command processing logic algorithms. These algorithms involve one or more message queues built into the server computers, and assigning priorities to commands from different sources or of different types. Higher-priority commands are processed and executed first, while lower-priority commands wait in the queue.

[0020] The functions of server computer 1 and server computer 2 are clearly defined:

[0021] The server computer 1 is configured to identify and parse interactive commands from the portable mobile device or the operating terminal, and after combining the operating data provided by the IoT module, perform fusion processing to generate corresponding video, data interface and audio signals, and output the signals to the display terminal and the audio terminal.

[0022] The server computer 2 is configured to identify and parse the sand table linkage command from the portable mobile device or the operating terminal, and after combining it with the operating data provided by the IoT module, generate the corresponding physical device control signal and output the signal to the 3D Mapping projection system, the VR projection system and the lighting system.

[0023] The specific operational data that the IoT module can acquire includes: water content in pumped-storage power generation, temperature of solar thermal power generation tower, electrolyte concentration in vanadium redox flow storage, or pressure of energy storage tank in compressed air storage.

[0024] The server computer 2 in the sand table module maps the acquired numerical operating data into specific visual output parameters through the 3D mapping projection control system. This mapping is achieved through a preset conversion function. Let the real-time acquired operating data value be D, and its effective data range be [D...]. min D max Let the corresponding visual output parameter be V, and its effective parameter range be [V]. min V maxThe visual output parameter V can then be calculated using the following linear mapping function:

[0025]

[0026] In the formula:

[0027] When the operating data is the water content of pumped storage, D is the water content value, and V is the coverage area or brightness value of the blue light and shadow projected onto the high-level reservoir model. When the operating data is the temperature of the solar thermal power generation tower, D is the temperature value, and V is the brightness value or color temperature value of the light projected onto the top of the solar thermal tower model.

[0028] When the operating data is the concentration of the vanadium redox flow electrolyte or the pressure of the compressed air energy storage tank, D is the concentration value or pressure value, and V is the saturation value of a specific color projected onto the energy storage tank model.

[0029] In one specific embodiment, the VR projection system responds to the instructions of the central control module or the operating terminal to load and display preset three-dimensional digital scenes of different new energy business formats; and further, based on the real-time operating data obtained by the IoT module, it dynamically adjusts and transforms the key visual elements in the VR scene through the aforementioned data mapping function to achieve real-time data synchronization between the virtual scene and the physical world.

[0030] In one specific embodiment, an interactive module for identifying user attention points through visual and auditory analysis is also included. The interactive module includes: an infrared camera for identifying the user's gaze, a gaze analyzer connected to the infrared camera, a microphone for acquiring the user's speech, and a speech analyzer connected to the microphone. The gaze analyzer analyzes the user's gaze to determine the business type of the sand table model they are interested in, and the speech analyzer extracts new energy-related vocabulary from the user's language. When the judgment result of the gaze analyzer matches the analysis result of the speech analyzer, the server computer 2 of the sand table module will operate the sand table module to highlight the business type content corresponding to the matching result, and simultaneously, the operating terminal of the audiovisual module will prompt the user to confirm the display of the content. Preferably, the gaze analyzer incorporates a convolutional neural network model trained using occlusion data or multi-frame fusion technology, and the speech analyzer incorporates an automatic speech recognition system.

[0031] The technical solution provided in this disclosure has the following advantages compared with the prior art:

[0032] 1. This invention combines an IoT module with a physical sand table module, particularly through a 3D mapping projection control system, to directly map and convert abstract, real-time operational data obtained from new energy power plants into intuitive visual parameters on the physical sand table model, such as light and shadow range, brightness, and color saturation. This design achieves real-time, dynamic, and visual linkage between the content displayed on the physical sand table and real-world physical quantities, overcoming the shortcomings of traditional static and isolated sand tables, and improving the intuitiveness and accuracy of information transmission.

[0033] 2. This invention employs a distributed processing architecture with server computer 1 and server computer 2, respectively used to drive the visualization and audio output of the audiovisual module, and to control the physical devices such as projection, lighting, and VR system of the sand table module. This architecture separates the processing load of the user interface from the real-time rendering and control load of physical effects, avoiding the problem of user interface response delay caused by complex physical effect calculations, thereby ensuring the overall response speed and operational stability of the system. Server computer 1 and server computer 2 are also configured with logical algorithms for managing and executing concurrent instructions, using a clear three-level priority mechanism to ensure the orderly response of the system: the highest priority response is the user intent instruction identified and confirmed by the interaction module; the next priority is the control instructions from the central control system and the console; and finally, the remaining instructions are processed in timestamp order. This design ensures that the system can still operate logically and with clear priorities even in multi-instruction concurrent scenarios, significantly improving the stability of the system and the reliability of the interaction.

[0034] 3. This invention deeply integrates digital audiovisual modules (display and audio terminals) with physical sand table modules (sand table body and lighting system) and virtual VR projection systems. Each module acquires data from a unified IoT module and responds to linkage commands from the central control module, constructing a multi-dimensional, synchronized display system. This system ensures consistent information sources and logical uniformity across different media, providing users with a complete and coherent understanding of the new energy system's operational status.

[0035] 4. This invention constructs an advanced control architecture comprising three switchable operating modes: a preset sequential playback mode ensuring content integrity; a manually intervened playback mode meeting specific explanation or demonstration needs; and an intelligent interactive playback mode capable of adaptively responding to real-time audience interests. This multi-layered control logic enables the sand table system to readily handle various application scenarios, from unattended automated displays to expert-guided in-depth explanations and free audience exploration. More importantly, regardless of the system's mode, its core dynamic visualization capability—converting real-time data from the IoT module into physical effects (such as light and color) for the sand table—remains consistently present, significantly enhancing user experience and information delivery efficiency. Attached Figure Description

[0036] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0037] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0038] Figure 1 This is a system framework diagram of an embodiment of the present disclosure;

[0039] Figure 2 This is a schematic diagram of the central control module structure according to an embodiment of this disclosure;

[0040] Figure 3 This is a schematic diagram of the IoT module structure described in an embodiment of this disclosure;

[0041] Figure 4 This is a schematic diagram of the audiovisual module structure described in an embodiment of this disclosure;

[0042] Figure 5 This is a schematic diagram of the sand table module structure described in an embodiment of this disclosure;

[0043] Figure 6 This is a schematic diagram of the instruction issuance process described in the embodiments of this disclosure;

[0044] Figure 7 This is a flowchart of the system instruction priority decision-making process described in the embodiments of this disclosure.

[0045] Among them, 10 is the central control module; 20 is the Internet of Things module; 30 is the audio-visual module; and 40 is the sand table module. Detailed Implementation

[0046] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0047] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0048] See attached document Figure 1 , Figure 1This is a structural block diagram of a new energy digital linkage sand table system based on an Internet of Things (IoT) system, according to an embodiment of the present invention. The present invention provides a new energy digital linkage sand table system based on an IoT system, comprising: a central control module 10, an IoT module 20, an audiovisual module 30, and a sand table module 40.

[0049] The central control module 10 is used to control the operating status of the entire system, including system startup, shutdown, and issuing global control commands.

[0050] The IoT module 20 is used to obtain real-time operation data from one or more new energy project operation terminals, and after processing, distribute the data to the audio-visual module 30 and the sand table module 40.

[0051] The audiovisual module 30 is electrically connected to the central control module 10 and the IoT module 20. This module is used to receive and execute instructions from the central control module 10, and combine them with data from the IoT module 20 to provide digital information display through its subordinate display and audio devices.

[0052] The sand table module 40 is electrically connected to the central control module 10 and the IoT module 20. This module is used to receive and execute instructions from the central control module 10, and combine them with data from the IoT module 20 to drive and control the physical devices on the sand table body under its jurisdiction, providing physical special effects displays.

[0053] The overall workflow of this invention embodiment is as follows: The IoT module 20 acquires real-time operating data from the new energy power station; simultaneously, the user can issue display commands through the central control module 10. The commands and the data are transmitted in parallel to the audiovisual module 30 and the sand table module 40. The audiovisual module 30 and the sand table module 40 parse and fuse the received commands and data, and respectively drive their subordinate output devices, thereby realizing the synchronous linkage between digital information display and physical sand table special effects display.

[0054] In this embodiment, the sand table module 40 converts the numerical operating data obtained from the IoT module 20 into specific visual output parameters. This conversion is achieved through a preset data mapping function. This function maps dynamically changing operating data values ​​into control values ​​for visual parameters.

[0055] The data mapping function is a linear mapping function, and its specific form is as follows:

[0056]

[0057] The definitions of each symbol are as follows:

[0058] D represents the value of the real-time operating data obtained by the IoT module 20. min D represents the minimum value of the preset valid range for this type of runtime data. max V represents the maximum value of the preset valid range for this type of runtime data, and V represents the target control value of the visual parameters output to the physical effects equipment after function calculation. min V represents the minimum value of the effective range of this visual parameter. max This indicates the maximum value of the valid range of the visual parameter.

[0059] The system also includes an interaction module, which contains an infrared camera for identifying the user's gaze. The infrared camera is connected to a gaze analyzer to analyze the user's perspective and determine the business model the user is viewing. It also includes a microphone to capture the user's spoken words. The microphone is connected to a speech analyzer to extract and analyze new energy-related vocabulary from the user's speech. This module uses both visual and auditory analysis to determine the business model the user is interested in. When the visual and auditory judgments are consistent, the server computer 2 operates the sandbox module to highlight that business model content, and the user terminal prompts whether to display the content.

[0060] Server computer 1 and server computer 2 are configured with logical algorithms for managing and executing concurrent instructions, including priority sorting 1 based on user needs identified and confirmed by the interaction module, priority sorting 2 based on instructions received from the central control system and the operator console, and timestamp sorting based on a preset order.

[0061] In a preferred approach, the visual analyzer incorporates a deep learning model such as a CNN. To avoid occlusions such as glasses, occlusion data is added during model training, or multi-frame fusion is used.

[0062] In a preferred embodiment, the speech analyzer incorporates an ASR speech recognition system.

[0063] To effectively manage and schedule control commands from three different sources—preset programs, manual operation, and intelligent interaction—and avoid command conflicts while ensuring the rationality and efficiency of system responses, this invention incorporates a sophisticated priority mechanism in its core logic algorithm. This mechanism does not simply queue all commands uniformly; instead, it establishes a clear, hierarchical structure with progressively clear judgments. Its working logic can be decomposed as follows:

[0064] Absolute Priority: Response to Intelligent Interaction Commands. At all times, the system will continuously detect whether there are user intent commands analyzed and confirmed by the interaction module (this is a priority 1 command), which reflects the highest respect for the audience's real-time intentions. Once such a command is captured, such as when an audience stares at a specific business model for a long time, the command will be given the highest priority, thereby preempting processing resources and immediately interrupting any ongoing display tasks to ensure that the system can respond to the audience's interests as soon as possible.

[0065] Intervention Execution Right: Insertion of Manual Control Commands. The arbitration mechanism will only proceed to determine if a manual command (priority 2 command) has been issued by the central control module or operator console when there are no pending intelligent interactive commands in the system. In practical applications, this design empowers on-site guides or operators to intervene and lead the presentation process at any time. They can interrupt the automatically played preset flow at any time, according to the pace of the presentation, to execute a specific, immediate presentation command, thereby achieving precise control over the sand table content.

[0066] Baseline execution rights: The flow of instructions in a preset order. In scenarios without any of the aforementioned high-priority instructions, the system operates in its default automated state. At this time, the arbitration mechanism handles the programmatic instructions in the preset order mode. These instructions have the lowest priority, and their processing logic reverts to the most basic timestamp sorting, strictly adhering to the time order set in the script or the timestamp of the instruction entering the processing queue, executing a first-come, first-served principle. This ensures that the sandbox content can be displayed completely and coherently automatically without human intervention.

[0067] In summary, this hierarchical design, which deeply binds instruction sources to priority levels and uses timestamps for peer sorting, constitutes the core of the operating mode switching mechanism of this invention. It transforms abstract control logic into concrete and reliable execution steps, ensuring that the system can always make the most reasonable and timely response when faced with automated, manual, and intelligent input modes.

[0068] To ensure the system can intelligently and orderly switch between three modes—preset sequence, manual intervention, and intelligent interaction—this invention introduces a precise concurrent instruction processing algorithm. The core of this algorithm is a priority scoring formula, which scores each instruction entering the system, thereby transforming the logical rules of the three operating modes into calculable and comparable values, ensuring that the highest priority instruction always receives the highest priority execution right.

[0069] The logical algorithm for processing concurrent instructions can be implemented using a priority scoring formula, that is, calculating the final priority score S for each instruction c entering the system. c :

[0070] S c =P c M+T c ;

[0071] In the formula:

[0072] P c It is based on a preset integer priority from the source of the instruction (e.g., user intent instructions from the interaction module are 1, instructions from the central control system or console are 2, and other instructions are 3); M is a sufficiently large constant multiplier (e.g., 10). 10 Its function is to ensure priority P c The weight of T is absolutely dominant in the final score; c This is the timestamp of when the instruction was received by the server (e.g., the number of milliseconds since system startup). The server's instruction execution queue will always prioritize processing the calculated S. c The instruction with the lowest score is assigned to the instruction, thus allowing instructions of different priorities to jump the queue, while instructions of the same priority are strictly processed according to the first-come-first-served principle (timestamp sorting).

[0073] The server's instruction execution queue will always prioritize processing the calculated S. c The lowest-scoring instruction. This design ensures that intelligent interactive instructions can always interrupt manual intervention and the execution of preset sequences; manual intervention instructions can interrupt preset sequences; and instructions in the same mode strictly follow the principle of first-come, first-served, ensuring the intelligence, timeliness, and stability of the sandbox system in complex scenarios.

[0074] See attached document Figure 2 , Figure 2 This is a schematic diagram of the structure of a central control module according to an embodiment of the present invention.

[0075] The central control module 10 is used to generate and distribute control commands. The central control module 10 includes: a central control host, a network switch, and one or more portable mobile devices.

[0076] The central control host is an industrial-grade computer, internally equipped with a processor, memory, and operating system, and electrically connected to the network switch via a wired Ethernet interface. The central control host is responsible for the startup and shutdown procedures of the entire system and can independently issue global control and scheduling commands.

[0077] The network switch is an industrial Ethernet switch with multiple network ports for connecting the central control host, the portable mobile device, the server computer 1 in the audiovisual module 30, and the server computer 2 in the sand table module 40, forming the system's local area network. Its function is to forward data frames between ports based on the destination address information of the data packets.

[0078] In this embodiment, the portable mobile device is a tablet computer, which connects to the network switch via Wi-Fi or a wired connection. A dedicated control application is installed and runs on this device, and the user interface of this application features control elements for selecting different display scenarios and adjusting parameters.

[0079] When the central control module 10 performs control operations, its workflow is as follows: First, the user triggers a control element on the user interface of the portable mobile device. Subsequently, the control application on the device generates control instructions containing target module address information and specific operation instructions based on the user's input.

[0080] The control command is encapsulated as a standard data packet (e.g., a TCP / IP data packet). The portable mobile device then sends this data packet to the network switch via its network interface.

[0081] After receiving the data packet, the network switch parses its target MAC address at the data link layer or target IP address at the network layer, and forwards the data packet from the corresponding port according to the address, finally delivering it to the target server computer (server computer 1 or server computer 2), thereby completing the issuance and transmission of a control command.

[0082] See attached document Figure 3 , Figure 3 This is a schematic diagram of the structure of an IoT module according to an embodiment of the present invention.

[0083] The IoT module 20 is used to collect real-time operational data from the physical world and provide it to the processing unit inside the system. Specifically, the IoT module 20 includes: a new energy project operation terminal, a cloud platform, and an extraction and analysis terminal.

[0084] These three parts together constitute a complete data link from the data source to the data application end. The new energy project operation end is a data acquisition unit deployed in the actual new energy power station. In one embodiment, the operation end is a collection of one or more physical sensors or data interfaces, such as a level sensor for measuring the water level of a pumped storage reservoir, a thermocouple for measuring the temperature of a solar thermal tower collector, or a PLC programmable logic controller data interface for directly reading status parameters from the energy storage device controller.

[0085] The physical quantity or state data collected by the operating terminal is first encapsulated into a standardized data structure, such as a JSON (JavaScript Object Notation) format data frame, through its built-in communication module. Subsequently, this data frame is uploaded and stored to the cloud via a preset communication protocol, such as MQTT (Message Queuing Telemetry Transport) or via an HTTP POST request.

[0086] The cloud refers to one or a group of servers deployed in a remote data center, on which a database system, such as a time-series database, runs to store and manage timestamped runtime data uploaded from one or more runtimes.

[0087] The extraction and analysis terminal is a standalone software service or a dedicated server. It initiates data query requests to the cloud database at a preset frequency by calling the API (Application Programming Interface) provided by the cloud to obtain the latest operational data within a specified time range.

[0088] After acquiring the raw data, the extraction and analysis end performs a series of preprocessing operations on the data. These operations include: data cleaning, to identify and filter out invalid or abnormal values ​​caused by sensor failures or transmission errors; data filtering, to extract specific data fields directly related to the sand table display from the complex data structure according to the application requirements of subsequent modules; and data formatting, to convert the data into a unified standardized data structure that can be directly parsed by server computer 1 and server computer 2.

[0089] The target data generated after the above processing is finally transmitted by the extraction and analysis terminal to the server computer 1 in the audiovisual module 30 and the server computer 2 in the sand table module 40 through the local area network, respectively, for subsequent fusion processing and visualization display.

[0090] See attached document Figure 4 , Figure 4 This is a schematic diagram of the structure of an audiovisual module according to an embodiment of the present invention.

[0091] The audiovisual module 30 is used to provide users with digital information display and human-computer interaction functions. The audiovisual module 30 specifically includes: a server computer 1, an operation terminal, a display terminal, and an audio terminal.

[0092] The server computer 1 is a high-performance computer, which is electrically connected to the network switch in the central control module 10 via a network interface to receive commands and data. The server computer 1 also has multiple external interfaces, including a video output interface (e.g., one or more HDMI interfaces) electrically connected to the display terminal, and an audio output interface electrically connected to the audio terminal.

[0093] In this embodiment, the operating terminal is a touch screen, which is connected to the server computer 1 via a USB (Universal Serial Bus) interface or a serial port. This operating terminal is used to receive touch input commands from the user and transmit these commands to the server computer 1.

[0094] In this embodiment, the display end is one or more large-size liquid crystal display screens used to receive and display video signals from the server computer 1. The audio end, in this embodiment, is a set of speakers used to receive and play audio signals from the server computer 1.

[0095] When the audiovisual module 30 performs a display task, its workflow is as follows: The server computer 1 receives control commands from the central control module 10 and processed real-time operating data from the IoT module 20 in parallel through its network interface.

[0096] After receiving the above instructions and data, the application running inside the server computer 1 first parses the control instructions to determine the media resources that need to be called. For example, the instructions may specify the path of the video file to be played and the data visualization interface template to be loaded.

[0097] The application then embeds the received real-time operational data into the selected visualization template. For example, it converts numerical temperature data into character format and overlays it onto a preset position on the video screen.

[0098] Finally, the server computer 1 generates and transmits a video signal, incorporating real-time data, to the display terminal for playback via the video output interface. Simultaneously, according to the instructions, it generates and transmits a corresponding audio signal (e.g., narration or background sound effects synchronized with the video content) to the audio terminal for playback via the audio output interface.

[0099] See attached document Figure 5 , Figure 5 This is a schematic diagram of the structure of a sand table module according to an embodiment of the present invention.

[0100] The sand table module 40 is used to provide physical special effects displays and present real-time operating data in an intuitive visual form. Specifically, the sand table module 40 includes: a server computer 2, the sand table itself, a lighting system, a 3D mapping projection control system, and a VR projection system.

[0101] The server computer 2 is a computer equipped with a high-performance graphics processing unit, which serves as the control core of the sandbox module 40. The server computer 2 is electrically connected to the network switch in the central control module 10 via a network interface to receive instructions and data, and has multiple interfaces for controlling external physical devices.

[0102] The sand table itself is a three-dimensional physical model containing multiple new energy project blocks, created according to predetermined geographical coordinates and scaling ratios. This model serves as the carrier for lighting and projection effects.

[0103] The lighting system consists of several sets of LED (light-emitting diode) light strips or beads, which are pre-installed below or inside designated areas of the sand table body (e.g., areas corresponding to a specific power station). The lighting system is connected to the control port of the server computer 2 via a DMX512 (a digital lighting control protocol) controller or a GPIO (general purpose input / output) expansion board. The server computer 2 controls the switching, brightness, and color of the lights in the designated area by sending specifically coded instructions to the controller.

[0104] The 3D mapping projection control system includes at least one projector and control software running on the server computer 2. The control software pre-stores a high-precision 3D digital model of the sand table. When projection is required, the software executes a UV mapping algorithm to calculate the precise correspondence between the content of the 2D projected image and each point on the surface of the 3D model, and performs distortion correction and edge blending processing on the output image. The processed video signal is sent to the projector through a video output interface, which precisely projects the image onto the corresponding surface of the sand table.

[0105] The VR projection system includes a VR (virtual reality) head-mounted display, which is connected to a dedicated graphics interface of the server computer 2 via a data cable. The server computer 2 runs a virtual reality application that renders a three-dimensional virtual scene in real time based on received instructions and data, and transmits the rendered stereoscopic image to the VR head-mounted display.

[0106] In this embodiment, the server computer 2 converts the numerical operating data obtained from the IoT module 20 into specific visual output parameters to drive the 3D Mapping projection control system to produce dynamic visual effects. This conversion is achieved through a preset data mapping function, such as the linear mapping function described above, which linearly maps real-time operating data values ​​from their preset numerical range to the effective control range of the target visual parameters, thereby calculating specific control values.

[0107] This mapping relationship is applied to the visualization of different types of data. For example:

[0108] When the running data is the water content of pumped storage, this function maps the water content percentage to the coverage area or brightness value of the blue light and shadow projected onto the high-level reservoir model.

[0109] When the running data is the temperature of the solar thermal power generation tower, this function maps the Celsius temperature value to the brightness or color temperature value of the light spot projected onto the top of the solar thermal tower model.

[0110] When the operating data is the concentration of the vanadium redox flow electrolyte or the pressure of the compressed air storage tank, the function maps the concentration or pressure value to the saturation value of a specific color projected onto the storage tank model.

[0111] See attached document Figure 6 , Figure 6 This is a flowchart illustrating the core working method of a system according to an embodiment of the present invention. The complete workflow of the technical solution of the present invention will be described in detail below using a specific new energy scenario as an example.

[0112] In this embodiment, taking a concentrated solar power generation scenario as an example, the specific working steps are as follows:

[0113] Step S1: Command Issuance and Data Reception. The user selects the concentrated solar power (CSP) scenario option on the control application interface of the portable mobile device within the central control module 10. This application generates a scenario display command, which is encapsulated as a data packet and sent in parallel via a network switch to server computer 1 of the audiovisual module 30 and server computer 2 of the sand table module 40. Simultaneously, the extraction and analysis terminal of the IoT module 20 obtains the latest real-time temperature data of the molten salt tower at the CSP plant from the cloud and sends this data in parallel to server computer 1 and server computer 2 as well.

[0114] Step S2: Response processing of the audiovisual module. After receiving the scene display command and temperature data, the server computer 1 completes its response processing in a coordinated manner through the following three methods:

[0115] Command parsing and media location: The application first parses the scene display command and determines the core media resources to be called based on the command content, namely the solar thermal power generation introduction video file pre-stored locally.

[0116] Data processing and video compositing: The application converts the numerical temperature data received from the IoT module into a character format, and according to the preset layout template, overlays the string onto the designated data display area of ​​the video frame located in the previous step in real time, thereby merging the dynamic data and video material into a unified visual stream.

[0117] Signal generation and terminal output: After the synthesis is completed, the server computer 1 finally generates a complete video signal containing dynamic data information, and outputs this signal to the display terminal for playback through the video interface.

[0118] Step S3: Sand Table Module Response Processing. After the server computer 2 receives the scene display command and temperature data in parallel, its internal application performs the following operations: First, it parses the command and sends it to the controller of the lighting system through its control port to illuminate the LED lights in the solar thermal power generation area on the sand table body. Second, it calls the internally preset data mapping function, taking the received temperature data as input, and calculates the control value of the target visual parameter based on the preset valid numerical range for this data type and the preset valid control range for the target visual parameter.

[0119] Step S4: Visual Effects Generation and Output. Server computer 2 sends the control value calculated in step S30 to the 3D Mapping projection control system. This system generates a projected light spot on top of the light and heat tower model of the sand table, with the visual effect corresponding to the control value; for example, the brightness value of the light spot is proportional to the control value. This achieves synchronized display of physical lighting effects and data-driven projection effects on the sand table.

[0120] In the operation of this embodiment, both server computer 1 and server computer 2 are configured with instruction processing queues. When a new control instruction arrives, the instruction is timestamped and enters the queue. The processor processes the instructions in the queue according to the timestamp order or a preset priority rule, thereby ensuring that the system can still execute in an orderly manner even when multiple instructions are executed concurrently.

[0121] The processes described in S1 to S4 above represent a typical working example of the system in manual intervention playback mode. In reality, the execution of this process always operates within a framework that includes priority adjudication for three modes, specifically manifested as follows:

[0122] Basic preset sequential playback mode: Without any external command intervention, the system will automatically run according to the preset script. For example, after playing the solar thermal power generation scene, it will automatically switch to the next scene (such as wind power generation). In this mode, the command has the lowest priority and is executed in chronological order.

[0123] High-priority manual intervention playback mode: When a user issues a clear instruction (such as demonstrating solar thermal power generation) through the central control module or operating console as in step S1, the instruction has a higher priority. The system will immediately interrupt the current preset playback sequence and execute this manual instruction, thus initiating the S1 to S4 process.

[0124] Highest Priority Intelligent Interactive Playback Mode: Imagine steps S2 to S4 are in progress, and the concentrated solar power (CSP) scene is being displayed. The interactive module detects that the user is gazing at the hydropower station model on the sand table for an extended period and verbally asks related questions. At this moment, the interactive module generates a command with the highest priority. Server computers 1 and 2 will immediately interrupt the current CSP display task (regardless of whether it comes from a preset sequence or manual intervention) and prioritize responding to this highest priority interactive command, instead calling upon audiovisual and sand table special effects resources related to the hydropower station for display.

[0125] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A new energy digital linkage sand table system based on the Internet of Things, characterized in that, include: The central control module is used to generate and distribute control commands; The IoT module is used to acquire and distribute real-time operational data; The audio-visual module has a built-in server computer 1 for processing audio-visual tasks and is connected to a display terminal and an audio terminal. The sand table module has a built-in server computer 2 for handling physical effects tasks, and is connected to the sand table's lighting system, VR system, and 3D mapping projection system. The interaction module analyzes user intent and generates interaction commands through visual and auditory acquisition devices; Its distinguishing feature is that the system is configured to receive and execute instructions in three switchable modes to drive the audiovisual module and the sand table module to display synchronously: Preset sequential playback mode: The server computers 1 and 2 automatically and sequentially execute a series of display instructions according to a pre-set programmed script to achieve programmed playback of the content; Manual intervention playback mode: The server computers 1 and 2 receive manual operation instructions from the central control module or the control console connected to it, and execute the instructions first, thereby realizing the immediate interruption or selective jump of the preset playback sequence. Intelligent interactive playback mode: The server computers 1 and 2 receive interactive instructions generated by the interactive module after analyzing the user's focus, and execute the instructions with the highest priority to realize intelligent, adaptive interruption and response to the currently playing content.

2. The new energy digital linkage sand table system based on the Internet of Things system according to claim 1, characterized in that, The central control module includes: a central control host, a network switch, and a portable mobile device connected to the network switch via a network. The central control host is connected to the network switch and is used to generate control commands and distribute the commands to the corresponding modules of the system through the network switch.

3. A new energy digital linkage sand table system based on the Internet of Things system according to claim 2, characterized in that, The IoT module includes: a new energy project operation terminal as the data source, a cloud as the data upload carrier, and an extraction and analysis terminal for extracting and analyzing the cloud data and transmitting it to the server computer. The extraction and analysis terminal is used to obtain the operation data from the cloud, preprocess, filter and format the data, and then transmit the processed target data to server computer 1 and server computer 2.

4. A new energy digital linkage sand table system based on the Internet of Things system according to claim 1, characterized in that, The audiovisual module includes: a server computer 1 connected to a network switch, an IoT module, and an operating terminal; a human-computer interaction operating terminal for user selection and control of the display; a display terminal for displaying videos and data; and an audio terminal for playing corresponding sound effects. The server computer 1, as the core controller of the audiovisual module, receives and processes instructions and data from the network switch, IoT module, and operating terminal, and generates corresponding visual and audio output signals.

5. A new energy digital linkage sand table system based on the Internet of Things system according to claim 1, characterized in that, The sand table module includes: a server computer 2 connected to a network switch, an IoT module, and an operating terminal; a 3D mapping projection control system for precise 3D projection onto the sand table body; a VR projection system including VR display equipment; a lighting system set in different new energy sectors; and the sand table body that carries the projection and lighting effects. The server computer 2, as the core controller of the sand table module, receives and processes instructions and data from the network switch, IoT module, and operating terminal, and generates real-time control signals for the 3D mapping projection control system, VR projection system, and lighting system.

6. A new energy digital linkage sand table system based on the Internet of Things system according to claim 1, characterized in that, The server computer 1 of the audiovisual module and the server computer 2 of the sand table module are configured with logic algorithms for managing and executing concurrent instructions. The logic algorithm is a message queue mechanism that judges the priority and processes the instructions. It receives and executes instructions through three switchable modes to drive the audiovisual module and the sand table module to display synchronously.

7. A new energy digital linkage sand table system based on the Internet of Things system according to claim 4, characterized in that, The server computer 1 is used to identify and parse the interactive commands from the portable mobile device or the operating terminal and the operating data of the IoT module. After fusing the two, it generates corresponding video, data interface and audio signals and outputs them to the display terminal and audio terminal. The server computer 2 is used to identify and parse the sand table linkage commands from the portable mobile device or the operating terminal and the operating data of the IoT module. After fusing the two, it generates corresponding physical control signals and outputs them to the 3D Mapping projection system, VR projection system and lighting system.

8. A new energy digital linkage sand table system based on the Internet of Things system according to claim 1, characterized in that, The specific operational data that the IoT module can acquire includes: water content in pumped-storage power generation, temperature of solar thermal power generation tower, electrolyte concentration in vanadium redox flow storage, or pressure of energy storage tank in compressed air storage.

9. A new energy digital linkage sand table system based on the Internet of Things system according to claim 1, characterized in that, The sand table module maps the acquired operational data into specific visual output parameters through the 3D mapping projection control system. The projection effect is specifically achieved as follows: mapping the water content data of pumped storage to the coverage or brightness of blue light and shadow projected onto the high-level reservoir model; mapping the temperature data of the solar thermal power generation tower to the brightness or color temperature of the light projected onto the top of the solar thermal tower model; or mapping the concentration of the vanadium redox flow storage electrolyte and the pressure data of the compressed air energy storage tank to the saturation of a specific color projected onto the energy storage tank model. The VR projection system responds to the instructions of the central control module or the operating terminal to load and display preset images of different new energy business formats. Furthermore, based on the real-time operating data obtained by the IoT module, the key visual elements in the VR screen are dynamically adjusted and transformed.

10. A new energy digital linkage sand table system based on the Internet of Things system according to claim 1, characterized in that, The interaction module includes: an infrared camera for recognizing the user's gaze, a gaze analyzer connected to the infrared camera, a microphone for acquiring the user's voice, and a voice analyzer connected to the microphone.

Images