Tablet terminal high-speed rail visual interaction system and method based on pixel streaming

Abstract

This invention discloses a high-speed rail visualization and interaction system and method based on pixel streaming on a tablet, belonging to the field of high-speed rail visualization and intelligent interaction technology. The system includes a cloud rendering center, a tablet client, a signaling collaboration server, and a high-speed rail data platform. The high-speed rail data platform is configured with a model storage server, an operation and maintenance data interface module, and a data encryption chip; the tablet client integrates status awareness hardware, touch interaction hardware, a dual-NIC communication module, and an offline caching chip, and deploys touch command mapping software; the signaling collaboration server is configured with an access control chip and a data synchronization transmission module, and runs multi-role collaboration software; the cloud rendering center integrates Unreal Engine rendering nodes, a pixel streaming plugin, and a layered rendering controller, with the layered rendering controller running a layered rendering algorithm. The high-speed rail visualization and interaction system and method based on pixel streaming provided by this invention improves the continuous working time of the tablet client and the efficiency of multi-terminal collaboration, adapting to all application scenarios such as high-speed rail maintenance, design review, and remote technical support.

Description

Technical Field

[0001] This invention belongs to the field of high-speed rail visualization and intelligent interaction technology, and particularly relates to a tablet-based high-speed rail visualization and interaction system and method based on pixel streaming. Background Technology

[0002] High-speed rail visualization technology is a key technology supporting the entire life cycle of high-speed rail design, maintenance, operation and service. Existing high-speed rail visualization technologies mostly rely on high-performance PCs or dedicated fixed equipment, which have many technical defects in actual engineering applications and are difficult to adapt to the needs of on-site mobile operations and cross-regional collaboration.

[0003] On the one hand, existing technologies suffer from poor mobility and insufficient touch compatibility. Maintenance personnel must carry heavy equipment in mobile scenarios such as maintenance sites and station service points, resulting in low operational flexibility. Furthermore, the lack of dedicated optimization for tablet touch characteristics leads to inaccurate mapping between touch operations and 3D models, failing to meet the actual needs of single-handed operation on-site, and compromising both operational smoothness and accuracy. On the other hand, multi-role collaboration is inefficient and rendering strategies are rigid. During cross-regional design reviews and remote fault diagnosis, image transmission suffers from severe compression, high latency in real-time annotation and data synchronization, and the lack of customized rendering strategies for differentiated scenarios such as high-speed rail maintenance, design, and service results in unclear display of key information. Additionally, existing Pixel Streaming solutions do not consider the tablet's battery level and network status; continuous high-load rendering can easily lead to insufficient tablet battery life, and the absence of effective offline caching strategies makes interaction interruptions common when network signals are weak, affecting the continuity of on-site work.

[0004] The aforementioned deficiencies in existing technologies result in severe shortcomings in the capabilities of high-speed rail visualization technology in terms of mobile operation, precise interaction, low-latency collaboration, and continuous operation. There is an urgent need for a tablet-based visualization and interaction system and method that fits the actual application scenarios of high-speed rail, to achieve collaborative linkage between the terminal, cloud, and server, and to solve the technical problems of limited mobile operation, poor touch compatibility, inefficient collaboration, insufficient battery life, and inadequate network adaptability. Summary of the Invention

[0005] In view of the shortcomings of the related technologies, the purpose of this invention is to provide a high-speed rail visualization and interactive system and method based on pixel streaming on a tablet, so as to solve the problems mentioned in the background technology.

[0006] To achieve the above objectives, the present invention provides the following technical solution: A high-speed rail visualization and interactive system based on pixel streaming on a tablet includes a cloud rendering center, a tablet client, a signaling collaboration server, and a high-speed rail data platform. The cloud rendering center, tablet client, signaling collaboration server, and high-speed rail data platform achieve bidirectional data interaction through the network. The high-speed rail data platform is equipped with a model storage server, an operation and maintenance data interface module, and a data encryption chip, which are used to store the three-dimensional model of the entire life cycle of the high-speed rail, collect the operation data of the high-speed rail on-board system in real time, and encrypt the data transmission. The tablet client integrates state-aware hardware, touch interaction hardware, dual network card communication module and offline cache chip, and is equipped with touch command mapping software, which is used to collect the status information of the tablet client, receive cloud-rendered screens, realize touch operation and command conversion, and cache the core model and real-time operation data of high-speed rail when the network / battery is abnormal. The signaling coordination server is equipped with an access control chip and a data synchronization transmission module, and runs multi-role coordination software for user role access verification, establishing communication links, and achieving low-latency synchronization of operation instructions and annotation information from multiple tablet clients. The cloud rendering center integrates Unreal Engine rendering nodes, pixel streaming plugins, and layered rendering controllers. The layered rendering controllers run layered rendering algorithms to dynamically adjust rendering parameters based on the tablet client's status information and the high-speed rail application scenario, and push compressed and encoded rendered images to the tablet client through pixel streaming technology.

[0007] In some embodiments, the tablet client's status awareness hardware includes a power sensor, a network detector, and a GPS positioning module, which are used to collect the tablet client's status information in real time, including remaining battery power, network signal strength, and location information, and upload the status information to the layered rendering controller of the cloud rendering center in real time.

[0008] In some embodiments, the layered rendering algorithm run by the cloud-based layered rendering controller calculates the rendering priority of high-speed rail components using the following formula:

[0009] in, For rendering priority, As scene weights, inspect the scene Design Scenarios Service Scenarios , The importance coefficient of a component is the number of core components. ordinary components , To improve real-time data correlation, link real-time operation and maintenance data. Unrelated .

[0010] In some embodiments, the touch command mapping software converts multi-touch coordinates into Unreal Engine-readable commands; a single-finger swipe corresponds to view angle adjustment, a single-finger swipe along the X-axis corresponds to horizontal rotation of the high-speed rail 3D model, a single-finger swipe along the Y-axis corresponds to vertical flipping of the high-speed rail 3D model, and two-finger zoom corresponds to the scaling ratio of the high-speed rail 3D model, with the scaling ratio determined by a formula. The calculation yielded that, This represents the scaling factor for the high-speed rail 3D model. This represents the change in the distance between the two fingers during the two-finger operation. The initial distance between two fingers. Gain coefficients for adapting touch operation and scaling of high-speed rail 3D models.

[0011] In some embodiments, the tablet client is equipped with low-power triggering logic. When the state-aware hardware detects that the remaining battery power of the tablet client is lower than a preset battery power threshold or the network signal strength is weaker than a preset network signal threshold, the state-aware hardware triggers a low-power signal and uploads it to the cloud rendering center. The Unreal Engine rendering node in the cloud rendering center automatically lowers the rendering resolution and frame rate. At the same time, the offline cache chip synchronously caches the high-speed rail core model and real-time running data.

[0012] A pixel-stream-based high-speed rail visualization interaction method for tablet-based systems, employing the aforementioned pixel-stream-based high-speed rail visualization interaction system, includes the following steps: S1. Data Preparation and Encrypted Transmission The high-speed rail data platform pre-stores the 3D model of the high-speed rail throughout its entire life cycle through the model storage server, and collects the operation data of the high-speed rail on-board system in real time through the operation and maintenance data interface module. After being encrypted by the data encryption chip, the data is transmitted to the cloud rendering center, which associates and binds the 3D model of the high-speed rail with the real-time operation data. S2. Connection Request and Permission Verification The tablet client initiates a connection request to the signaling coordination server through the dual network card communication module. The signaling coordination server verifies the user's role and permissions through the access control chip. After successful verification, the data synchronization and transmission module establishes a two-way communication link between the tablet client and the cloud rendering center. S3, Terminal Status Acquisition and Rendering Parameter Configuration The tablet client collects the tablet client's status information in real time through status-aware hardware and uploads it to the layered rendering controller in the cloud rendering center. The layered rendering controller calculates the rendering priority of components and sends rendering parameter instructions to the Unreal Engine rendering node based on the tablet client's status information and the current high-speed rail application scenario. S4, Layered Rendering and Streaming The Unreal Engine rendering node renders the high-speed rail 3D model in layers according to the rendering parameter instructions. The pixel streaming plugin compresses and encodes the rendered image and pushes it to the touch interaction hardware of the tablet client for visualization. S5, Touch Interaction and Command Feedback Users interact with the high-speed rail 3D model through touch-screen hardware. The touch command mapping software converts the touch operation coordinates into Unreal Engine readable commands, which are then fed back to the signaling coordination server through the dual network card communication module. S6, Multi-device collaboration and data synchronization The signaling collaboration server synchronizes the received operation instructions to the cloud rendering center and other connected tablet clients to achieve consistency in the operation of the high-speed rail 3D model across multiple terminals. It also performs corresponding operation permission control based on the verified user roles and transmits annotation information via the UDP protocol through the multi-role collaboration software to achieve low-latency collaboration among multiple roles.

[0013] In some embodiments, the high-speed rail visualization interaction method based on pixel streaming on a tablet also includes step S7, anomaly detection and low power consumption processing: the tablet client's status sensing hardware detects the tablet client's battery level and network signal status in real time. When it detects that the remaining battery level of the tablet client is lower than a preset battery threshold or the network signal strength is weaker than a preset network signal threshold, a low power consumption signal is triggered and uploaded to the cloud rendering center. The Unreal Engine rendering node in the cloud rendering center automatically lowers the rendering resolution and frame rate. At the same time, the tablet client caches the high-speed rail core model and real-time running data through an offline caching chip to ensure continuous interaction.

[0014] In some embodiments, in step S3, the status information of the tablet client includes remaining battery power, network signal strength, and location information; the high-speed rail application scenarios include maintenance scenarios, design scenarios, and service scenarios; among them, in the maintenance scenario, the bearings and braking systems are rendered with high priority; in the design scenario, all components of the high-speed rail are rendered at high resolution.

[0015] In some embodiments, in step S5, the touch operation includes single-finger swiping, two-finger zooming, and stylus annotation. Single-finger swiping adjusts the view angle of the high-speed rail 3D model, two-finger zooming adjusts the scale of the high-speed rail 3D model, and the annotation information of the stylus annotation is synchronized to other collaborative tablet clients along with the operation command.

[0016] In some embodiments, in step S6, the user roles include designers, maintenance personnel, and passengers. Designers have the authority to modify the parameters of the high-speed rail 3D model, maintenance personnel only have the authority to annotate the model, and passengers only have the authority to view the model and operating data. The signaling coordination server manages the operation behavior of different roles through the permission control chip.

[0017] Compared with the prior art, the beneficial effects of the present invention are: 1. The high-speed rail visualization interaction system and method based on pixel streaming provided by this invention constructs a three-layer linkage architecture of "terminal status - business scenario - cloud rendering". By collecting the terminal running context through the tablet client status perception hardware, the cloud layered rendering controller dynamically adjusts the rendering parameters to realize adaptive streaming of the rendered screen. This solves the core contradiction between terminal battery life and computing power in mobile scenarios, significantly improves the effective continuous working time of the tablet client, and ensures the clear presentation of key operation and maintenance information and design details of high-speed rail under limited bandwidth and computing power.

[0018] 2. The high-speed rail visualization interaction system and method based on pixel streaming provided by this invention has performed end-to-end deep optimization of the touch interaction of the tablet client. By establishing a gesture semantic system that conforms to the intuitive operation of three-dimensional space through touch command mapping software, multi-point touch operation is accurately converted into engine-readable commands, which is adapted to the on-site single-hand operation needs. It breaks through the inherent limitations of traditional visualization systems in mobile touch adaptation and improves the smoothness and accuracy of operation.

[0019] 3. The high-speed rail visualization and interaction system and method based on pixel streaming provided by this invention, through the integration of dual network card communication modules and offline cache chips, combined with intelligent low-power triggering logic, constructs a stable communication and computing guarantee system; dual-link transmission improves the stability and bandwidth of network connection, and the cloud-terminal collaborative caching strategy realizes the local visualization and interaction of core data when the network is interrupted or the power is insufficient, ensuring the continuity of key businesses such as high-speed rail maintenance and fault diagnosis.

[0020] 4. The high-speed rail visualization and interaction system and method based on pixel streaming provided by this invention internalizes multi-role, low-latency collaborative capabilities into the core hardware module and communication protocol of the system. The signaling collaboration server realizes precise control of user permissions and low-latency synchronization of multi-terminal data through the permission control chip and multi-role collaboration software, which significantly reduces the synchronization delay of collaborative work such as cross-regional design review and remote technical support, and greatly improves the efficiency and experience of collaborative work. Attached Figure Description

[0021] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings: Figure 1 This is a flowchart of a method of an embodiment of the high-speed rail visualization and interactive system and method based on pixel streaming of the present invention; Figure 2This is a system architecture diagram of an embodiment of the tablet-based high-speed rail visualization and interaction system and method based on pixel streaming according to the present invention. Figure 3 This is a cloud rendering center architecture diagram of an embodiment of the tablet-based high-speed rail visualization and interaction system and method based on pixel streaming according to the present invention. Figure 4 This is a tablet client architecture diagram of an embodiment of the tablet-based high-speed rail visualization and interaction system and method based on pixel streaming according to the present invention. Figure 5 This is a signaling coordination server architecture diagram of an embodiment of the tablet-based high-speed rail visualization and interaction system and method based on pixel streaming according to the present invention. Figure 6 This is a high-speed rail data platform architecture diagram of an embodiment of the high-speed rail visualization and interaction system and method based on pixel streaming on a tablet.

[0022] In the picture: 1. Cloud Rendering Center; 11. Unreal Engine Rendering Node; 12. Pixel Streaming Plugin; 13. Layered Rendering Controller; 2. Tablet client; 21. Status-aware hardware; 22. Touch interaction hardware; 23. Dual network card communication module; 24. Offline cache chip; 25. Tablet motherboard; 3. Signaling coordination server; 31. Access control chip; 32. Data synchronization transmission module; 33. Server motherboard; 34. Gigabit Ethernet interface; 4. High-speed rail data platform; 41. Model storage server; 42. Operation and maintenance data interface module; 43. Data encryption chip; 44. Storage server motherboard. Detailed Implementation

[0023] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0024] In the description of this invention, it should be understood that the terms "center", "lateral", "longitudinal", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention.

[0025] In the description of this invention, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "joining" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal communication between two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0026] Example 1: See appendix Figures 2 to 6 This paper presents an illustrative embodiment of the tablet-based high-speed rail visualization and interactive system based on pixel streaming proposed in this invention. In this embodiment, "pixel streaming" corresponds to the industry standard technical term PixelStreaming. In this embodiment, the technical name is simplified to Chinese, but its core technical meaning and function remain unchanged.

[0027] This pixel-stream-based tablet-based high-speed rail visualization and interaction system is an integrated system combining hardware and software. Its core consists of four major hardware modules: cloud rendering center 1, tablet client 2, signaling collaboration server 3, and high-speed rail data platform 4. The cloud rendering center 1, tablet client 2, signaling collaboration server 3, and high-speed rail data platform 4 achieve bidirectional data interaction through network communication.

[0028] See appendix Figure 2 The cloud rendering center 1, tablet client 2, signaling collaboration server 3, and high-speed rail data platform 4 achieve bidirectional data interaction through fiber optic networks, WiFi / 5G networks, or industrial Ethernet. Specifically, the cloud rendering center 1 and high-speed rail data platform 4 are connected via high-speed Ethernet, the cloud rendering center 1 and signaling collaboration server 3 are connected via fiber optic networks, and the signaling collaboration server 3 and tablet client 2 are connected via WiFi / 5G networks and RJ45 gigabit Ethernet interfaces, ensuring the efficiency and stability of data transmission between different modules.

[0029] The high-speed rail data platform 4 is equipped with a model storage server 41, an operation and maintenance data interface module 42, and a data encryption chip 43. These are used to store 3D models of the high-speed rail throughout its entire lifecycle, collect real-time operational data from the high-speed rail's onboard systems, and encrypt and transmit the data. (See appendix) Figure 6 Each module is integrated into the storage server motherboard 44. The model storage server 41 is connected to the motherboard via a SATA3.0 interface and is used to store the 3D model of the high-speed rail throughout its entire life cycle (design drawings, component parameters). The operation and maintenance data interface module 42 collects the high-speed rail on-board system operation data (bearing temperature, driving speed) via industrial Ethernet and transmits it to the motherboard. The data encryption chip 43 is soldered to the motherboard PCIe slot and encrypts the operation data before transmitting it to the cloud rendering center 1 to achieve secure and efficient data interaction.

[0030] See appendix Figure 4 The tablet client 2 uses the tablet motherboard 25 as the control core and integrates state sensing hardware 21, touch interaction hardware 22, dual network card communication module 23 and offline cache chip 24. It also deploys touch command mapping software to collect the status information of the tablet client 2, receive cloud-rendered images, realize touch operation and command conversion, and cache the high-speed rail core model and real-time operation data when the network / battery is abnormal.

[0031] Specifically, the status-aware hardware 21 includes a power sensor, a network detector, and a GPS positioning module, which are integrated into the tablet motherboard 25 via a reserved interface on the motherboard. It is used to collect the status information of the tablet client 2 in real time, including the remaining power, network signal strength, and GPS location information, and upload the status information to the layered rendering controller 13 of the cloud rendering center 1 in real time. The touch interaction hardware 22 adopts a touch screen that supports multi-touch and stylus operation. It is connected to the tablet motherboard 25 via a MIPI interface to realize the visualization of the rendered screen and the input of touch commands. The dual network card communication module 23 integrates WiFi and 5G communication units and is connected to the tablet motherboard 25 via a PCIe Mini interface to ensure stable communication in a multi-network environment. The offline cache chip 24 adopts an onboard eMMC chip and is soldered to the tablet motherboard 25. With the touch command mapping software, it not only realizes the conversion of touch coordinates to Unreal Engine readable commands, but also locally caches the high-speed rail core model and real-time operation data when the network is interrupted or the power is insufficient, ensuring the continuity of critical business.

[0032] In this embodiment, the dual-NIC communication module 23 of the tablet client 2 can be replaced with a single 5G NIC. By using network slicing technology, data transmission and signaling interaction can be separated, which is suitable for scenarios with good 5G network coverage.

[0033] See appendix Figure 5 The signaling collaboration server 3 uses the server motherboard 33 as its control core and is equipped with an access control chip 31, a data synchronization transmission module 32, and a gigabit Ethernet interface 34. It runs multi-role collaboration software, which supports simultaneous connections from 3 to 8 tablet clients 2. This software is used for user role and access verification, establishing communication links, and achieving low-latency synchronization of operation commands and annotation information across multiple tablet clients 2. Users operate via a touchscreen display, and the operation commands are fed back to the signaling collaboration server 3 via the dual-NIC communication module 23, synchronizing with the cloud and other collaborative tablets to achieve data consistency across multiple terminals.

[0034] Specifically, the access control chip 31 is integrated into the server motherboard 33 to perform user role authentication and operation permission management on the connected tablet client 2, distinguishing the different operation permissions of designers, maintenance personnel, and passengers; the data synchronization transmission module 32 is integrated into the server motherboard 33, and works with the multi-role collaboration software to establish and maintain the communication link between the tablet client 2 and the cloud rendering center 1, synchronizing operation instructions and annotation information to each collaborative terminal via the UDP protocol, with a synchronization delay of ≤50ms, realizing low-latency multi-terminal collaboration; the gigabit Ethernet interface 34 (RJ45) is connected to the server motherboard 33 through a hardware interface, providing a high-speed and stable network connection for the server and external devices, ensuring the efficiency and reliability of data synchronization transmission.

[0035] See appendix Figure 3 The cloud rendering center 1 integrates Unreal Engine rendering node 11, PixelStreaming plugin 12 and layered rendering controller 13. The layered rendering controller 13 runs a layered rendering algorithm, which is used to send rendering parameter instructions to Unreal Engine rendering node 11 based on the status information of tablet client 2 and high-speed rail application scenario, dynamically adjust rendering parameters, and push compressed and encoded rendering screen to tablet client 2 through pixel streaming technology.

[0036] Specifically, the Unreal Engine rendering node 11 is equipped with a GPU cluster, serving as the core rendering computing unit for layered rendering of the high-speed rail 3D model. The Pixel Streaming plugin 12 is integrated into the Unreal Engine rendering node 11, which compresses and encodes the rendered image and pushes it to the tablet client 2 via the network to achieve real-time image streaming. The layered rendering controller 13 is a dedicated processing chip that connects to the Unreal Engine rendering node 11 via a PCIe 4.0 interface. It runs the layered rendering algorithm and calculates the rendering priority of each component based on the status information such as remaining power and network signal strength uploaded by the tablet client 2, as well as high-speed rail application scenarios such as maintenance, design, and service. It dynamically adjusts the rendering parameters to achieve efficient and energy-saving visualization rendering.

[0037] In this embodiment, the cloud-based layered rendering controller 13 runs a layered rendering algorithm, prioritizing component rendering based on scene type (priority rendering of bearings and braking systems is prioritized in maintenance scenes, while high-resolution rendering of all components is performed in design scenes). The rendering priority of high-speed rail components is calculated using the following algorithm formula:

[0038] in, For rendering priority, As scene weights, inspect the scene Design Scenarios Service Scenarios , The importance coefficient of a component is the number of core components. ordinary components , To improve real-time data correlation, link real-time operation and maintenance data. Unrelated .

[0039] In this embodiment, the layered rendering algorithm can adopt dynamic priority allocation based on deep learning. By training the model, it can automatically identify key components in the current scene without the need for preset weight parameters, and is suitable for general scenarios of multiple high-speed rail models.

[0040] In this embodiment, the touch command mapping software converts multi-touch coordinates into Unreal Engine readable commands; a single-finger swipe corresponds to view angle adjustment, a single-finger swipe along the X-axis corresponds to horizontal rotation of the high-speed rail 3D model, a single-finger swipe along the Y-axis corresponds to vertical flipping of the high-speed rail 3D model, and two-finger zoom corresponds to the scaling ratio of the high-speed rail 3D model, with the scaling ratio determined by the formula... The calculation yielded that, This represents the scaling factor for the high-speed rail 3D model. This represents the change in the distance between the two fingers during the two-finger operation. The initial distance between two fingers. The rate of change of the distance between the two fingers. The adaptation gain coefficients for touch operation and scaling of the high-speed rail 3D model. Adaptation gain coefficients In this embodiment, a fixed value is preset based on the characteristics of tablet touch operation. .

[0041] In this embodiment, the tablet client 2 is equipped with low-power triggering logic. When the status sensing hardware 21 detects that the remaining battery power of the tablet client 2 is lower than a preset battery power threshold or the network signal strength is weaker than a preset network signal strength threshold, the status sensing hardware 21 triggers a low-power signal and uploads it to the cloud rendering center 1. After receiving the signal, the Unreal Engine rendering node 11 of the cloud rendering center 1 automatically lowers the rendering resolution and frame rate. At the same time, the offline cache chip 24 synchronously caches the high-speed rail core model and real-time running data to ensure that the interaction process is not interrupted. In this embodiment, the preset battery power threshold is 25%, and the preset network signal strength threshold is -75dBm.

[0042] In the above illustrative embodiments, the high-speed rail visualization and interaction system based on pixel streaming on a tablet achieves significant technical advantages over existing technologies by constructing an intelligent visualization and interaction paradigm of "scene-driven, state-aware, and cloud-collaborative": Firstly, the system creatively constructs a three-layer linkage architecture of "terminal status - business scenario - cloud rendering". Through the dynamic interaction between the tablet client status perception hardware and the cloud layered rendering controller, adaptive pixel streaming is achieved. This not only solves the core contradiction between terminal battery life and computing power in mobile scenarios, increasing the effective continuous working time of the tablet to more than 7 hours, but also ensures the clear presentation of key operation and maintenance information and design details through precise delivery of rendering resources. Secondly, the system performs end-to-end optimization of the tablet's touch interaction. By establishing a gesture semantic system that conforms to the intuitive operation of three-dimensional space and is adapted to one-handed operation through touch command mapping software, the system enables on-site engineers to hold the tablet with one hand to complete complex model inspection and operation, breaking through the limitations of mobile touch in traditional visualization systems. Third, the system integrates dual network card modules and offline cache chips, and combines them with intelligent low-power triggering logic to build a robust communication and computing guarantee system. It improves network stability through multi-link transmission, and can still cache core data locally when the network is interrupted, realizing "cloud-edge intelligent collaboration" to ensure that critical business is not interrupted. Fourth, the system internalizes multi-role, low-latency collaborative capabilities into core hardware modules and communication protocols. Through the dedicated hardware unit of the signaling collaboration server, it achieves efficient and reliable access control and data synchronization, enabling remote expert teams to collaborate seamlessly in a shared three-dimensional space, significantly improving the efficiency and experience of collaborative work such as design review and fault diagnosis.

[0043] Example 2: See appendix Figures 1 to 6 This paper presents an illustrative embodiment of the high-speed rail visualization and interaction method based on pixel streaming proposed in this invention. Using the pixel streaming-based high-speed rail visualization and interaction system of Embodiment 1, the method includes the following steps: S1. Data Preparation and Encrypted Transmission The high-speed rail data platform 4 pre-stores the high-speed rail full life cycle 3D model through the model storage server 41, and collects the high-speed rail on-board system operation data in real time through the operation and maintenance data interface module 42. After being encrypted by the data encryption chip 43, it is transmitted to the cloud rendering center 1, and the cloud rendering center 1 associates and binds the high-speed rail 3D model with the real-time operation data. S2. Connection Request and Permission Verification The tablet client 2 initiates a connection request to the signaling coordination server 3 through the dual network card communication module 23. The signaling coordination server 3 verifies the user's role and permissions through the permission control chip 31. After successful verification, the data synchronization transmission module 32 establishes a two-way communication link between the tablet client 2 and the cloud rendering center 1. S3, Terminal Status Acquisition and Rendering Parameter Configuration The tablet client 2 collects the status information of the tablet client 2 in real time through the status sensing hardware 21 and uploads it to the layered rendering controller 13 of the cloud rendering center 1. The layered rendering controller 13 calculates the rendering priority of the components and sends rendering parameter instructions to the Unreal Engine rendering node 11 based on the status information of the tablet client 2 and the current high-speed rail application scenario. S4, Layered Rendering and Streaming The Unreal Engine rendering node 11 renders the high-speed rail 3D model in layers according to the rendering parameter instructions. The Pixel Streaming plugin 12 compresses and encodes the rendered image and pushes it to the touch interaction hardware 22 of the tablet client 2 for visualization display via the network. S5, Touch Interaction and Command Feedback Users interact with the high-speed rail 3D model through the touch interaction hardware 22. The touch command mapping software converts the touch operation coordinates into Unreal Engine readable commands, which are then fed back to the signaling coordination server 3 through the dual network card communication module 23. S6, Multi-device collaboration and data synchronization The signaling collaboration server 3 synchronizes the received operation instructions to the cloud rendering center 1 and other connected tablet clients 2 to achieve consistency in the operation of the high-speed rail 3D model across multiple terminals. It also performs corresponding operation permission control based on the verified user roles and transmits annotation information via the UDP protocol through the multi-role collaboration software to achieve low-latency collaboration among multiple roles.

[0044] The tablet-based high-speed rail visualization interaction method based on pixel streaming also includes step S7, anomaly detection and low-power processing: The status sensing hardware 21 of the tablet client 2 detects the battery level and network signal status of the tablet client 2 in real time. When it is detected that the remaining battery level of the tablet client 2 is lower than the preset battery threshold or the network signal strength is weaker than the preset network signal threshold, a low-power signal is triggered and uploaded to the cloud rendering center 1. The Unreal Engine rendering node 11 of the cloud rendering center 1 automatically lowers the rendering resolution and frame rate. At the same time, the tablet client 2 caches the high-speed rail core model and real-time running data through the offline caching chip 24 to ensure continuous interaction.

[0045] In step S3, the status information of the tablet client 2 includes the remaining battery power, network signal strength, and location information; the high-speed rail application scenarios include maintenance scenarios, design scenarios, and service scenarios; among them, in the maintenance scenario, the bearings and braking system are rendered with high priority; in the design scenario, all components of the high-speed rail are rendered at high resolution.

[0046] In step S5, the touch operation includes single-finger swiping, two-finger zooming, and stylus annotation. Single-finger swiping adjusts the view angle of the high-speed rail 3D model, two-finger zooming adjusts the scale of the high-speed rail 3D model, and the annotation information of the stylus annotation is synchronized to other collaborative tablet clients 2 along with the operation command.

[0047] In step S6, the user roles include designers, maintenance personnel, and passengers. Designers have the authority to modify the parameters of the high-speed rail 3D model, maintenance personnel only have the authority to annotate the model, and passengers only have the authority to view the model and operating data. The signaling coordination server 3 manages the operation behavior of different roles through the permission control chip 31.

[0048] In the above illustrative embodiments, the high-speed rail visualization interaction method based on pixel streaming on a tablet, relying on an integrated system combining hardware and software, achieves efficient, stable, and highly adaptable high-speed rail 3D model visualization interaction, and has the following outstanding beneficial effects: First, the method integrates terminal status and business scenarios into rendering decisions through a closed-loop process of "terminal status collection - scene priority calculation - dynamic rendering adjustment", realizing the transformation from fixed bitrate push to adaptive streaming, improving tablet battery life while ensuring the clear presentation of key operation and maintenance and design information. Secondly, the method establishes a three-dimensional gesture semantic system adapted to single-handed operation through optimized touch command mapping logic, enabling on-site personnel to complete model inspection and annotation operations through precise gestures, thus breaking through the operational bottleneck of touch interaction in mobile scenarios. Furthermore, the method employs a low-power triggering and offline caching strategy to automatically reduce cloud rendering parameters and cache core data when the network or power is abnormal, balancing energy saving and interaction continuity, and achieving a reliable guarantee for "cloud-terminal" collaboration. Finally, the method enables users with different roles to collaborate efficiently in a shared three-dimensional space through multi-role permission control and low-latency data synchronization, significantly improving the efficiency and reliability of collaborative work such as cross-regional design review and fault diagnosis.

[0049] Finally, it should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0050] The above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them; although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications can still be made to the specific implementation of the present invention or equivalent substitutions can be made to some technical features without departing from the spirit of the technical solutions of the present invention, and all such modifications and substitutions should be covered within the scope of the technical solutions claimed in the present invention.

Claims

1. A high-speed rail visualization and interactive system based on pixel streaming on a tablet, characterized in that, It includes a cloud rendering center, a tablet client, a signaling collaboration server, and a high-speed rail data platform. The cloud rendering center, tablet client, signaling collaboration server, and high-speed rail data platform achieve bidirectional data interaction through the network. The high-speed rail data platform is equipped with a model storage server, an operation and maintenance data interface module, and a data encryption chip, which are used to store the three-dimensional model of the entire life cycle of the high-speed rail, collect the operation data of the high-speed rail on-board system in real time, and encrypt and transmit the data. The tablet client integrates state-aware hardware, touch interaction hardware, dual network card communication module and offline cache chip, and is deployed with touch command mapping software, which is used to collect the status information of the tablet client, receive cloud-rendered screens, realize touch operation and command conversion, and cache the high-speed rail core model and real-time operation data when the network / battery is abnormal. The signaling collaboration server is equipped with an access control chip and a data synchronization transmission module, and runs multi-role collaboration software for user role access verification, establishing communication links, and achieving low-latency synchronization of operation instructions and annotation information from multiple tablet clients. The cloud rendering center integrates Unreal Engine rendering nodes, pixel streaming plugins, and layered rendering controllers. The layered rendering controllers run layered rendering algorithms to dynamically adjust rendering parameters based on the status information of the tablet client and the high-speed rail application scenario, and push compressed and encoded rendered images to the tablet client through pixel streaming technology.

2. The high-speed rail visualization and interactive system based on pixel streaming on a tablet as described in claim 1, characterized in that, The tablet client's status awareness hardware includes a power sensor, a network detector, and a GPS positioning module, which are used to collect the tablet client's status information in real time, including remaining battery power, network signal strength, and location information, and upload the status information to the layered rendering controller in the cloud rendering center in real time.

3. The high-speed rail visualization and interactive system based on pixel streaming on a tablet as described in claim 1, characterized in that, The layered rendering algorithm running the cloud-based layered rendering controller calculates the rendering priority of high-speed rail components using the following formula: in, For rendering priority, As scene weights, inspect the scene Design Scenarios Service Scenarios , The importance coefficient of a component is the number of core components. ordinary components , To improve real-time data correlation, link real-time operation and maintenance data. Unrelated .

4. The high-speed rail visualization and interactive system based on pixel streaming on a tablet as described in claim 1, characterized in that, The touch command mapping software converts multi-touch coordinates into Unreal Engine readable commands; a single finger swipe corresponds to view angle adjustment, a single finger swipe along the X-axis corresponds to horizontal rotation of the high-speed rail 3D model, a single finger swipe along the Y-axis corresponds to vertical flipping of the high-speed rail 3D model, and two-finger zoom corresponds to the zoom ratio of the high-speed rail 3D model, the zoom ratio being determined by the formula... The calculation yielded that, This represents the scaling factor for the high-speed rail 3D model. This represents the change in the distance between the two fingers during the two-finger operation. The initial distance between two fingers. Gain coefficients for adapting touch operation and scaling of high-speed rail 3D models.

5. The high-speed rail visualization and interactive system based on pixel streaming on a tablet as described in claim 1, characterized in that, The tablet client is equipped with low-power triggering logic. When the status sensing hardware detects that the remaining battery power of the tablet client is lower than a preset battery power threshold or the network signal strength is weaker than a preset network signal strength threshold, the status sensing hardware triggers a low-power signal and uploads it to the cloud rendering center. The Unreal Engine rendering node in the cloud rendering center automatically lowers the rendering resolution and frame rate. At the same time, the offline cache chip synchronously caches the high-speed rail core model and real-time running data.

6. A method for visual interaction of high-speed rail on a tablet based on pixel streaming, characterized in that, The method of the high-speed rail visualization and interactive system based on pixel streaming as described in any one of claims 1-5 includes the following steps: S1. Data Preparation and Encrypted Transmission The high-speed rail data platform pre-stores the 3D model of the high-speed rail throughout its entire life cycle through the model storage server, and collects the operation data of the high-speed rail on-board system in real time through the operation and maintenance data interface module. After being encrypted by the data encryption chip, the data is transmitted to the cloud rendering center, which associates and binds the 3D model of the high-speed rail with the real-time operation data. S2. Connection Request and Permission Verification The tablet client initiates a connection request to the signaling coordination server through the dual network card communication module. The signaling coordination server verifies the user's role and permissions through the access control chip. After successful verification, the data synchronization and transmission module establishes a two-way communication link between the tablet client and the cloud rendering center. S3, Terminal Status Acquisition and Rendering Parameter Configuration The tablet client collects the tablet client's status information in real time through status-aware hardware and uploads it to the layered rendering controller in the cloud rendering center. The layered rendering controller calculates the rendering priority of components and sends rendering parameter instructions to the Unreal Engine rendering node based on the tablet client's status information and the current high-speed rail application scenario. S4, Layered Rendering and Streaming The Unreal Engine rendering node renders the high-speed rail 3D model in layers according to the rendering parameter instructions. The pixel streaming plugin compresses and encodes the rendered image and pushes it to the touch interaction hardware of the tablet client for visualization. S5, Touch Interaction and Command Feedback Users interact with the high-speed rail 3D model through touch-screen hardware. The touch command mapping software converts the touch operation coordinates into Unreal Engine readable commands, which are then fed back to the signaling coordination server through the dual network card communication module. S6, Multi-device collaboration and data synchronization The signaling collaboration server synchronizes the received operation instructions to the cloud rendering center and other connected tablet clients to achieve consistency in the operation of the high-speed rail 3D model across multiple terminals. It also performs corresponding operation permission control based on the verified user roles and transmits annotation information via the UDP protocol through the multi-role collaboration software to achieve low-latency collaboration among multiple roles.

7. The high-speed rail visualization and interaction method based on pixel streaming on a tablet as described in claim 6, characterized in that, It also includes step S7, anomaly detection and low power consumption processing: The tablet client's status sensing hardware detects the tablet client's battery level and network signal status in real time. When it detects that the remaining battery level of the tablet client is lower than the preset battery threshold or the network signal strength is weaker than the preset network signal threshold, it triggers a low power consumption signal and uploads it to the cloud rendering center. The Unreal Engine rendering node in the cloud rendering center automatically lowers the rendering resolution and frame rate. At the same time, the tablet client caches the high-speed rail core model and real-time running data through the offline caching chip to ensure continuous interaction.

8. The high-speed rail visualization and interaction method based on pixel streaming on a tablet as described in claim 6, characterized in that, In step S3, the status information of the tablet client includes remaining battery power, network signal strength, and location information; the high-speed rail application scenarios include maintenance scenarios, design scenarios, and service scenarios; among them, in the maintenance scenario, bearings and braking systems are rendered with high priority; in the design scenario, all components of the high-speed rail are rendered at high resolution.

9. The high-speed rail visualization and interaction method based on pixel streaming on a tablet as described in claim 6, characterized in that, In step S5, the touch operation includes single-finger swiping, two-finger zooming, and stylus annotation. Single-finger swiping adjusts the view angle of the high-speed rail 3D model, two-finger zooming adjusts the scale of the high-speed rail 3D model, and the annotation information of the stylus annotation is synchronized to other collaborative tablet clients along with the operation command.

10. The high-speed rail visualization and interaction method based on pixel streaming on a tablet as described in claim 6, characterized in that, In step S6, the user roles include designers, maintenance personnel, and passengers. Designers have the authority to modify the parameters of the high-speed rail 3D model, maintenance personnel only have the authority to annotate the model, and passengers only have the authority to view the model and operating data. The signaling coordination server manages the operation behavior of different roles through the permission control chip.

Images