Distribution network communication methods, equipment, and storage media based on extended reality acquisition devices
By real-time detection of network status and communication link compatibility in extended reality acquisition devices, the problem of poor data acquisition reliability in existing technologies is solved, and stable communication and accurate data transmission are achieved in complex environments.
Patent Information
- Application Number
- CN202611397028.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-09-09
- Publication Date
- 2026-11-17
AI Technical Summary
The data acquisition reliability of existing distribution network communication methods based on extended reality acquisition devices is poor, especially in complex environments where distribution network disorder and communication link abnormalities are prone to occur.
After establishing a communication link between the head-mounted display device and the peripheral acquisition device, network configuration is performed. After network configuration is completed, the network status and communication link matching are detected in real time. Feedback data is used to continuously verify the network status and task matching, identify and handle abnormal situations, including comparison of device identity and task identifier, judgment of time difference, and hierarchical processing of abnormal information.
It improves the reliability of data acquisition, avoids data errors caused by network drift or task mismatch, ensures the accuracy and integrity of the acquisition process, and enhances the stability and reliability of the communication link.
Smart Images

Figure CN123123990A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of network communication technology, specifically providing a distribution network communication method, device, and storage medium based on extended reality acquisition equipment. Background Technology
[0002] Extended Reality (XR) co-acquisition devices typically consist of a head-mounted display (HMD) and peripheral acquisition devices, and are widely used in field operations such as robot teaching and real-world digitization. The HMD and peripheral acquisition devices need to establish a connection and complete network configuration via a wireless communication link to achieve high-speed data transmission and bidirectional interaction of control commands. The accuracy and stability of the network communication are crucial for the normal operation of XR co-acquisition tasks.
[0003] Currently, network configuration solutions for XR data acquisition devices include establishing a communication connection between the head-mounted display (HMD) and the external acquisition device via Bluetooth, and setting up a communication link based on a two-way communication protocol. The HMD then sends its network account and password to the external acquisition device through this communication link to complete the network configuration. However, existing network configuration technologies typically only perform initial network connection, failing to address the issue of network configuration errors caused by complex network environments during the acquisition process. Furthermore, during the acquisition phase, only the physical connection status of the communication link is monitored. When a link disconnection is detected, a simple automatic reconnection operation is performed to meet basic data interaction requirements, but this approach cannot identify various non-disconnection anomalies.
[0004] In summary, the data acquisition reliability of existing distribution network communication methods based on extended reality acquisition devices is poor.
[0005] Accordingly, there is a need in the field for a new distribution network communication scheme based on extended reality acquisition devices to solve the above problems. Summary of the Invention
[0006] In order to overcome the above-mentioned defects, this application is made to solve or at least partially solve the following technical problem: the data acquisition reliability of the existing distribution network communication method based on extended reality acquisition equipment is poor.
[0007] In a first aspect, this application provides a network distribution communication method based on an extended reality acquisition device, the extended reality acquisition device including a head-mounted display device and an external acquisition device, the network distribution communication method including: Control the head-mounted display device to communicate with the peripheral acquisition device and establish a communication link; Based on the communication link between the head-mounted display device and the peripheral acquisition device, network configuration is performed between the head-mounted display device and the peripheral acquisition device. After network configuration is completed, joint data acquisition is initiated and real-time monitoring is performed throughout the acquisition process. Specifically, this includes: continuously verifying the network status of the connection between the head-mounted display device and the peripheral acquisition device, wherein the network status is used to identify in real time whether the network connection between the head-mounted display device and the peripheral acquisition device is normal throughout the acquisition process; and detecting the matching of the current peripheral acquisition device and the current acquisition task with the communication link based on the feedback data from the peripheral acquisition device, so as to achieve real-time identification of whether the communication link is correctly matched with the current peripheral acquisition device and the current acquisition task throughout the acquisition process.
[0008] Optionally, the feedback data includes a device identity identifier and a collection task identifier; the step of detecting the matching of the current peripheral collection terminal and the current collection task with the communication link based on the feedback data of the peripheral collection terminal includes: obtaining the feedback data reported by the peripheral collection terminal according to a set period; comparing the consistency of the device identity identifier in the feedback data with the device binding information in the distribution network stage, and comparing the consistency of the collection task identifier in the feedback data with the task binding information in the distribution network stage; when all comparison results are consistent, it is determined that the current peripheral collection terminal and the current collection task match the communication link; when any comparison result is inconsistent, it is determined that the communication link is abnormal.
[0009] Optionally, the method for determining communication link anomalies further includes: obtaining the reporting time of each instance of the feedback data; calculating the time difference between the current time and the most recent reporting time of the feedback data; and determining that the communication link is abnormal when the time difference is greater than a preset duration.
[0010] Optionally, the step of configuring the head-mounted display device and the peripheral acquisition device based on the communication link between the head-mounted display device and the peripheral acquisition device includes: controlling the head-mounted display device to send a command to obtain a network identifier to the peripheral acquisition device through the communication link, and receiving a set of network identifiers returned by the peripheral acquisition device; in response to the configuration confirmation operation, constructing configuration information according to the target network, and sending the configuration information to the peripheral acquisition device through the communication link; wherein, the target network is a network identifier in the set of network identifiers determined based on a local database, or a custom network identifier, and the network identifier includes a network name and network credentials.
[0011] Optionally, the method further includes: determining whether the target network is connected and effective based on the feedback data from the peripheral acquisition terminal, and storing the network name and network credentials corresponding to the connected target network into the local database.
[0012] Optionally, controlling the head-mounted display device to communicate with the peripheral acquisition device and establish a communication link includes: controlling the head-mounted display device to communicate with the peripheral acquisition device through any one of Bluetooth, wireless network, and Ethernet connections; and establishing a communication link between the head-mounted display device and the peripheral acquisition device based on the WebSocket protocol.
[0013] Optionally, the method further includes: when the communication link is determined to be abnormal, obtaining the level identifier of the abnormal information in the feedback data; determining whether the abnormal information belongs to a preset high priority level based on the level identifier; when the abnormal information belongs to the preset high priority level, outputting alarm prompt information in a pop-up window and blocking the current joint acquisition process; when the abnormal information does not belong to the preset high priority level, prompting the abnormal information in a non-blocking manner.
[0014] Optionally, the continuous verification of the network status connection between the head-mounted display device and the peripheral acquisition device includes: obtaining the network identifier connected to the head-mounted display device at the start of the joint acquisition and using it as a reference network identifier; continuously obtaining the current network identifier connected to the head-mounted display device and the peripheral acquisition device at preset time intervals during the joint acquisition process; and verifying the consistency between the current network identifier and the reference network identifier.
[0015] In a second aspect, an electronic device is provided, comprising at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program, which, when executed by the at least one processor, implements the method described in any of the above-described technical solutions of the distribution network communication method based on the extended reality acquisition device.
[0016] In a third aspect, a computer-readable storage medium is provided, wherein a plurality of program codes are stored therein, the program codes being adapted to be loaded and run by a processor to perform the method described in any of the above-described technical solutions of the distribution network communication method based on the extended reality acquisition device.
[0017] The above-described technical solutions of this application have at least one or more of the following beneficial effects: In the technical solution of the network configuration communication method based on extended reality acquisition device provided in this application, the communication connection between the head-mounted display device and the peripheral acquisition device is controlled; based on the communication link between the head-mounted display device and the peripheral acquisition device, network configuration is performed between the head-mounted display device and the peripheral acquisition device; after network configuration is completed, joint acquisition is started and the entire acquisition process is monitored in real time, continuously verifying the network status of the connection between the head-mounted display device and the peripheral acquisition device, and detecting the matching between the current peripheral acquisition device and the current acquisition task and the communication link based on the feedback data from the peripheral acquisition device. By continuously verifying the network status of the connection between the head-mounted display device and the peripheral acquisition device throughout the acquisition process, the network status of the head-mounted display device and the peripheral acquisition device can be captured in real time. The network status is used to identify whether the network is normal in real time throughout the acquisition process. For example, when the network switches or drifts, the identifiers or signals in the network status change. By capturing the network status in real time, anomalies can be identified in a timely manner, avoiding network configuration errors. By detecting the matching of the current peripheral acquisition terminal and the current acquisition task with the communication link based on the feedback data of the peripheral acquisition terminal throughout the entire acquisition process, the matching is used to identify in real time whether the communication link is correctly matched with the current peripheral acquisition terminal and the current acquisition task. It can identify mismatch anomalies where the communication link is still connected but the peripheral acquisition terminal or acquisition task has changed, thus avoiding the continued transmission of acquired data in the case of misconnected devices or mismatched tasks. It ensures that the communication link matches the current peripheral acquisition terminal and the current acquisition task, prevents data transmission errors, ensures the accuracy of data and the integrity of tasks in the joint acquisition process, and improves the reliability of data acquisition. Attached Figure Description
[0018] The disclosure of this application will become more readily understood with reference to the accompanying drawings. It will be readily understood by those skilled in the art that these drawings are for illustrative purposes only and are not intended to limit the scope of protection of this application. Wherein: Figure 1 This is a schematic flowchart of the main steps of a distribution network communication method based on an extended reality acquisition device according to an embodiment of this application; Figure 2 This is a distribution network and communication topology diagram according to an embodiment of this application; Figure 3 This is a schematic diagram of an electronic device structure according to an embodiment of this application. Detailed Implementation
[0019] Some embodiments of this application are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are merely illustrative of the technical principles of this application and are not intended to limit the scope of protection of this application.
[0020] In the description of this application, "module" and "processor" can include hardware, software, or a combination of both. A module can include hardware circuitry, various suitable sensors, communication ports, memory, and may also include software components, such as program code, or a combination of software and hardware. A processor can be a central processing unit, microprocessor, image processor, digital signal processor, or any other suitable processor. The processor has data and / or signal processing capabilities. The processor can be implemented in software, in hardware, or a combination of both. Computer-readable storage media includes any suitable medium capable of storing program code, such as magnetic disks, hard disks, optical disks, flash memory, read-only memory, random access memory, etc. The term "A and / or B" means all possible combinations of A and B, such as only A, only B, or A and B. The terms "at least one A or B" or "at least one of A and B" have a similar meaning to "A and / or B" and can include only A, only B, or A and B. The singular terms "a" or "this" can also include plural forms.
[0021] See appendix Figure 1 , Figure 1 This is a schematic flowchart illustrating the main steps of a network distribution communication method based on an extended reality acquisition device according to an embodiment of this application. Figure 1 As shown, the distribution network communication method based on extended reality acquisition device in this application embodiment mainly includes the following steps S1 to S3.
[0022] S1. Control the head-mounted display device to communicate with the peripheral acquisition device and establish a communication link.
[0023] In this embodiment, the head-mounted display (HMD) device and the peripheral acquisition device establish a communication link. The HMD device and the peripheral acquisition device are the main components of the extended reality acquisition device. The HMD device is a device worn on the user's head with display and interaction capabilities. The peripheral acquisition device is a device that works with the HMD device to perform joint acquisition. For example, the peripheral acquisition device includes a development board that can connect to a wrist camera, receive data collected by the wrist camera, and transmit the received data to the HMD device. The peripheral acquisition device can also receive commands sent by the HMD device. The communication link refers to the transmission path carrying business data between the HMD device and the peripheral acquisition device. The communication connection between the HMD device and the peripheral acquisition device is established through a communication transmission medium, and a bidirectional transmission communication protocol is used to establish the communication link, thereby enabling interaction between the control HMD device and the peripheral acquisition device.
[0024] In one embodiment, controlling the head-mounted display device to communicate with the peripheral acquisition device and establish a communication link includes: controlling the head-mounted display device to communicate with the peripheral acquisition device through any one of Bluetooth, wireless network, and Ethernet connections; and establishing a communication link between the head-mounted display device and the peripheral acquisition device based on the WebSocket protocol.
[0025] Bluetooth connectivity refers to a near-field wireless communication connection established between the head-mounted display (HMD) device and the peripheral data acquisition device based on Bluetooth technology, such as Bluetooth Low Energy (BLE). Wireless network connectivity refers to a communication connection established between the HMD device and the peripheral data acquisition device via Wi-Fi or other wireless local area network (WLAN) technologies. Ethernet connectivity refers to a communication connection established between the HMD device and the peripheral data acquisition device via a wired local area network (LAN). WebSocket is a full-duplex long-connection communication protocol. As the underlying transmission standard, WebSocket builds a business data channel on top of the established communication connection.
[0026] The head-mounted display (HMD) device discovers the external acquisition terminal by scanning and selects one of Bluetooth, wireless network, or Ethernet connections to establish a low-level communication link. The HMD device establishes a communication link based on the WebSocket protocol, which includes two transmission modes: Bluetooth and wireless network connections use the normal mode with a WebSocket client; Ethernet connections use a dedicated library to create a WebSocket instance bound to the wired network. Both transmission modes transmit the acquired data to the application within the HMD device for unified processing. If the communication link is lost, a reconnection loop is initiated until a successful connection is established. Before each reconnection, old network connection instances are cleared, asynchronous reconnection tasks are canceled, and the send / receive queue is cleared. When the service stops, a reconnection permission flag is set to ensure that reconnection does not occur after the acquisition task is interrupted or the working mode is switched.
[0027] The device establishes a communication connection with the external acquisition terminal via Bluetooth, wireless network, or Ethernet, and establishes a communication link based on the WebSocket protocol. These three connection methods cover different scenario requirements from near-field network distribution to remote data transmission, and can adapt to various complex network environments in the field. The full-duplex connection feature of the WebSocket protocol ensures the real-time and reliable transmission of business data, and has the ability to clean up old connections and controllable reconnection, avoiding connection leakage and message interference, and ensuring the communication stability between the head-mounted display device and the external acquisition terminal.
[0028] S2. Based on the communication link between the head-mounted display device and the peripheral acquisition device, configure the network for the head-mounted display device and the peripheral acquisition device.
[0029] In this embodiment, network configuration is performed on the head-mounted display device and the peripheral acquisition device based on the communication link between the head-mounted display device and the peripheral acquisition device. Network configuration refers to the process of controlling the head-mounted display device to send network identifiers and network credentials to the peripheral acquisition device according to the established communication link, so that the peripheral acquisition device can access the designated network.
[0030] In one embodiment, network configuration is performed between the head-mounted display device and the peripheral acquisition device based on the communication link between the head-mounted display device and the peripheral acquisition device. This includes: controlling the head-mounted display device to send a command to obtain network identifiers to the peripheral acquisition device via the communication link, and receiving a set of network identifiers returned by the peripheral acquisition device; in response to the network configuration confirmation operation, constructing network configuration information based on the target network, and sending the network configuration information to the peripheral acquisition device via the communication link; wherein, the target network is a network identifier in the set of network identifiers determined based on a local database, or a custom network identifier, and the network identifier includes a network name and network credentials.
[0031] The "Obtain Network Identifier" command is a request command sent from the head-mounted display device (HMD) to the peripheral acquisition device via the communication link. It requests the peripheral acquisition device to scan for available wireless networks in the vicinity and return the results. The network identifier set refers to a collection of one or more wireless network identifiers returned by the peripheral acquisition device in response to the "Obtain Network Identifier" command; this set can be in list form. The "Network Configuration Confirmation" operation refers to an action that can be displayed, such as an action performed by the operator on the HMD's interface to explicitly indicate agreement to send a network configuration command. The target network is the specified wireless network that the peripheral acquisition device is connected to. It can be selected from the network identifier set scanned and reported by the peripheral acquisition device and matched against historical credentials in the local database, or it can be a network identifier entered by the operator. The network name is the publicly available name of the wireless network, used to distinguish different WiFi networks. Network credentials are the authentication information required to connect to the network, usually a password. Network configuration information refers to the actual network configuration data packet sent, containing the target network's network name and network credentials.
[0032] The head-mounted display (HMD) device sends a command to the external acquisition terminal to obtain network identifiers via the established communication link, and receives a set of network identifiers returned by the external acquisition terminal after scanning the surrounding wireless networks. Based on the local database, successfully saved network credentials from the network history are automatically populated. The target network is selected from the network identifier set, or the acquisition operator can manually enter a custom network name and credentials as the target network. After the network configuration confirmation operation, the HMD device constructs network configuration information based on the target network and sends this information to the external acquisition terminal via the aforementioned communication link to complete the network configuration.
[0033] The system retrieves the set of network identifiers actually scanned by the peripheral acquisition terminal via commands. It is compatible with both modes of using scanned network identifiers and custom network identifiers, enabling real-time monitoring of available networks around the peripheral and avoiding blind input. Explicit network configuration is achieved by using a network configuration confirmation operation as the trigger condition for sending network configuration information, avoiding the problem of repeatedly sending incorrect passwords caused by silent network configuration parameter sending.
[0034] In one implementation, after establishing a communication connection based on Bluetooth Low Energy and establishing a communication link between the head-mounted display device and the peripheral acquisition device based on the WebSocket protocol, the Bluetooth status of the head-mounted display device is detected, including uninitialized, scanning, connecting, service discovery, subscription ready, disconnected, and abnormal states. Network configuration can only be performed after subscription is ready. By classifying the communication connection status established based on Bluetooth Low Energy, sending network credentials and instructions when the connection is half-connected or protocol negotiation is incomplete can be avoided, reducing the risk of network configuration failure or instruction loss due to incomplete communication connection readiness. Simultaneously, the refined state classification allows operators to observe the current Bluetooth communication connection status in real time and intuitively, quickly locating the specific link when connection blockage occurs, thus improving the reliability of the network configuration process.
[0035] In one implementation, the system determines whether the target network is connected based on feedback data from the peripheral acquisition terminal, and stores the network name and network credentials corresponding to the connected target network in a local database.
[0036] Feedback data refers to the status data transmitted back to the head-mounted display device through the established communication link after network configuration is completed, including network connection status data. When the network connection status data shows that the connection is effective, the head-mounted display device stores the corresponding network identifier in its local database.
[0037] The system verifies the actual operational status of the network configuration based on feedback data from the peripheral acquisition terminal. It remembers the password for successfully configured networks, preventing the storage of previously entered but failed network credentials in the local database and thus avoiding contamination of the local database with invalid or erroneous network parameters. This allows for automatic and accurate credential filling when selecting the same network identifier subsequently, improving configuration accuracy, reducing the workload of repeatedly entering passwords, and increasing work efficiency.
[0038] S3. After network configuration is completed, start joint data acquisition and perform real-time monitoring throughout the acquisition process. Specifically, this includes: continuously verifying the network status of the connection between the head-mounted display device and the peripheral acquisition device. The network status is used to identify in real time whether the network connection between the head-mounted display device and the peripheral acquisition device is normal throughout the acquisition process; and detecting the matching of the current peripheral acquisition device and the current acquisition task with the communication link based on the feedback data from the peripheral acquisition device, so as to achieve real-time identification of whether the communication link is correctly matched with the current peripheral acquisition device and the current acquisition task throughout the acquisition process.
[0039] In this embodiment, joint acquisition refers to the collaborative work between the head-mounted display device and the peripheral acquisition device to jointly complete the business data acquisition task in the XR scenario. Real-time detection refers to the process of continuously monitoring and verifying key indicators such as network status and communication link compatibility from the start of the joint acquisition task until the end of the acquisition task.
[0040] After network configuration is completed, a joint data acquisition task is initiated, and the entire acquisition process is monitored in real time. On one hand, the network status is continuously verified, comparing the actual network currently connected to the head-mounted display device with the network connection information reported by the peripheral acquisition terminal to identify network anomalies such as network drift and disconnection. On the other hand, based on feedback data from the peripheral acquisition terminal, the relevant parameters of the current communication link are checked, along with the compatibility between the communication link, the current peripheral acquisition terminal, and the current acquisition task. This identifies whether the peripheral acquisition terminal connected to the current communication link is still the one specified for the acquisition task, and whether the acquisition task served by the communication link is still the designated acquisition task.
[0041] By simultaneously performing network status verification and communication link compatibility testing throughout the entire task cycle of joint data collection, it is possible not only to determine whether the link is connected, but also to identify faults such as network disconnection, communication link misconnection, and peripheral device malfunctions. This avoids continuing to execute data collection tasks under network anomalies or communication link service mismatches, reducing the risk of invalid data collection and data corruption, and ensuring the reliability of data collection tasks.
[0042] In one embodiment, continuously verifying the network status of the connection between the head-mounted display device and the peripheral acquisition device includes: obtaining the network identifier of the head-mounted display device at the start of joint acquisition and using it as a reference network identifier; continuously obtaining the current network identifier of the connection between the head-mounted display device and the peripheral acquisition device at preset time intervals during joint acquisition; and verifying the consistency between the current network identifier and the reference network identifier.
[0043] The joint acquisition start time refers to the initial point in time when the head-mounted display (HMD) device and the peripheral acquisition device begin collaboratively conducting acquisition operations. The baseline network identifier refers to the network identifier of the network connected to the HMD device at the joint acquisition start time; this identifier serves as a reference standard for the correctness of network connections throughout the acquisition process. The preset time interval refers to a pre-set time interval for periodically performing network status acquisition operations. The current network identifier refers to the real-time network identifier of the network connected to the HMD device or peripheral acquisition device, obtained through polling at preset time intervals during the joint acquisition process.
[0044] At the start of the joint data acquisition task, the network name connected to the head-mounted display (HMD) device is obtained and recorded as the baseline network identifier. During the ongoing joint data acquisition, the network identifiers currently connected to both the HMD device and the external acquisition device are periodically obtained at preset time intervals. The consistency of each obtained current network identifier is checked against the baseline network identifier at the start time. If they match, the network status is confirmed to be normal and no drift has occurred. If the current network identifier on the HMD device is different from the baseline network identifier, the network status is determined to be abnormal.
[0045] By periodically monitoring network access throughout the entire process of joint data acquisition, abnormal scenarios such as network switching at the head-mounted display device or peripheral acquisition end can be identified in a timely manner, thus avoiding problems such as abnormal collaborative acquisition communication and data corruption caused by changes in the network environment.
[0046] In one implementation, the feedback data includes a device identity identifier and a data collection task identifier. The matching of the current peripheral data collection terminal and the current data collection task with the communication link is detected based on the feedback data from the peripheral data collection terminal. This includes: acquiring feedback data reported by the peripheral data collection terminal according to a set period; comparing the consistency of the device identity identifier in the feedback data with the device binding information during the network distribution phase, and comparing the consistency of the data collection task identifier in the feedback data with the task binding information during the network distribution phase; when all comparison results are consistent, it is determined that the current peripheral data collection terminal and the current data collection task match the communication link; when any comparison result is inconsistent, it is determined that the communication link is abnormal.
[0047] Device identification refers to the unique identifier of the peripheral acquisition terminal, used to distinguish different devices. Acquisition task identifier refers to the unique number or task identifier of the currently executing joint acquisition service, used to distinguish different acquisition tasks. The set period refers to the pre-configured time interval for the peripheral acquisition terminal to report feedback data, i.e., the development board heartbeat reporting period. Device binding information refers to the identification information corresponding to the peripheral acquisition terminal recorded during the network configuration phase, and task binding information refers to the task identifier information corresponding to the acquisition task recorded during the network configuration phase.
[0048] The system receives feedback data reported by the peripheral acquisition terminal according to a set period, extracts the device identity identifier and acquisition task identifier from the feedback data, compares the device identity identifier with the device binding information saved during the distribution network stage, and compares the acquisition task identifier with the task binding information saved during the distribution network stage. If both sets of comparison results are consistent, the system determines that the current peripheral acquisition terminal and the current acquisition task match the communication link. If either set of comparison results is inconsistent, the system determines that the communication link is abnormal.
[0049] Based on the feedback data periodically reported by the peripheral acquisition terminal, the current peripheral acquisition terminal and the current acquisition task are verified. This can accurately identify abnormal situations such as misconnection of devices or mismatch of tasks in the communication link, avoid connecting to the wrong device or executing the wrong task, and improve the accuracy of the acquisition service.
[0050] In one implementation, the method for determining communication link anomalies further includes: obtaining the reporting time of each feedback data transmission; calculating the time difference between the current time and the most recent reporting time of the feedback data; and determining a communication link anomaly when the time difference is greater than a preset duration. Here, the reporting time refers to the sending timestamp carried by the data each time the peripheral acquisition terminal successfully sends feedback data to the head-mounted display device.
[0051] The system acquires the reporting time corresponding to each instance of feedback data, extracts the most recent reporting time, calculates the time difference between the current time and the most recent reporting time, and compares this time difference with a preset duration. If the time difference exceeds the preset duration, a communication link anomaly is determined. By detecting the reporting time of feedback data to determine whether the communication link is abnormal, it can identify disconnection scenarios where the peripheral acquisition end has no feedback reporting, compensating for the inability to detect link disconnections solely based on feedback data verification, and improving the detection coverage of communication link anomalies.
[0052] Based on the above embodiments, the distribution network communication method further includes: when the communication link is determined to be abnormal, obtaining the level identifier of the abnormal information in the feedback data; determining whether the abnormal information belongs to the preset high priority level based on the level identifier; when the abnormal information belongs to the preset high priority level, outputting alarm prompt information in a pop-up window and blocking the current joint collection process; when the abnormal information does not belong to the preset high priority level, prompting the abnormal information in a non-blocking manner.
[0053] Level identifiers refer to pre-assigned level labels for various communication link anomalies, used to distinguish the severity of anomalies. The preset high-priority level refers to the anomaly level standard that seriously impacts joint data acquisition services and requires urgent handling; it serves as the threshold for determining high-risk anomalies.
[0054] Once the communication link is determined to be abnormal, the corresponding abnormality level identifier is extracted from the current abnormality feedback data. This identifier is then compared with the preset high-priority level standard. If the abnormality level is within the preset high-priority level, an alarm message is immediately pushed via a pop-up window, and the ongoing joint data collection is forcibly blocked. If the abnormality level is not within the preset high-priority level, the normal operation of the joint data collection task is not interrupted; only an abnormality notification is provided through logs, notification bars, etc.
[0055] By classifying and handling communication link anomalies in a tiered manner, and implementing differentiated management of anomalies, timely alarms are issued and data collection tasks are blocked for high-priority and severe anomalies. This prevents data distortion caused by serious communication link failures and avoids invalid data collection operations. For ordinary anomalies, the task running status is preserved and silent prompts are provided, which can promptly retain anomaly records for subsequent troubleshooting and repair without interrupting normal data collection operations, thus balancing data collection reliability and operational continuity.
[0056] In one embodiment, the distribution network communication method further includes: transmitting data such as device status and abnormal information from the peripheral acquisition terminal to the cloud via Message Queuing Telemetry Transport (MQTT). At the same time, a security boundary is set for Message Queuing Telemetry Transport. For example, when transmitting logs via MQTT, the network credential field is anonymized, i.e., the network credential is masked to prevent the leakage of sensitive data. Figure 2 This is a distribution network and communication topology diagram according to an embodiment of this application, such as... Figure 2 As shown, the head-mounted display device can connect to the external acquisition terminal via any of the three connection methods: Bluetooth, WiFi, or Ethernet. The WiFi password can be stored in the local database. The external acquisition terminal communicates with the cloud and can transmit data such as device status and abnormal information to the cloud.
[0057] By synchronizing abnormal information to cloud storage, remote traceability and persistence of collected faults are achieved, enabling maintenance personnel to view equipment health, abnormality levels, and historical alarms through the cloud monitoring platform without being on-site, thus improving observability and remote maintenance capabilities.
[0058] In one implementation, communication data between the head-mounted display device, peripheral acquisition device, and cloud is uniformly numbered. This involves writing the communication data into a single communication event table based on a unified time reference. For example, the communication event table includes event type, timestamp, link type, execution result, and error information. By uniformly numbering the communication data, centralized and standardized management of multi-terminal communication data is achieved. This facilitates unified traceability of the entire communication process and rapid location of link faults and anomalies, avoiding the cumbersome troubleshooting and data omissions caused by scattered data from multiple terminals. It also improves the traceability, standardization, and troubleshooting efficiency of communication data.
[0059] In one implementation, when the development board requests an upgrade, the head-mounted display device simultaneously sends its region code and current version. The development board selects an acceleration source for the appropriate region based on the region code and current version, and reports the version via heartbeat after the upgrade. An acceleration source refers to a server node that provides a high-speed download channel for the firmware upgrade package, used to improve the download speed of large files and reduce latency. The region code is carried in commands such as login, development board upgrade, firmware list, and acceleration service, used to identify resources in different regions and avoid incorrect acceleration source selection due to language preferences or region mismatches.
[0060] By continuously verifying the network status of the connection between the head-mounted display (HMD) device and the peripheral acquisition device throughout the entire acquisition process, the network status of both devices can be captured in real time. This network status is used to identify whether the network is functioning normally throughout the acquisition process. For example, if the network switches or drifts, the identifiers or signals in the network status will change. By capturing the network status in real time, anomalies can be identified promptly, avoiding network configuration errors. Throughout the acquisition process, the compatibility of the current peripheral acquisition device, the current acquisition task, and the communication link is detected based on feedback data from the peripheral acquisition device. This compatibility is used to identify in real time whether the communication link is correctly matched with the current peripheral acquisition device and the current acquisition task. It can identify mismatch anomalies where the communication link remains connected but the peripheral acquisition device or acquisition task has changed, preventing data transmission from continuing even when devices are misconnected or tasks are mismatched. This ensures that the communication link matches the current peripheral acquisition device and the current acquisition task, preventing data transmission errors, guaranteeing the accuracy and integrity of data in the joint acquisition process, and improving the reliability of data acquisition.
[0061] It should be noted that although the steps in the above embodiments are described in a specific order, those skilled in the art will understand that in order to achieve the effect of this application, different steps do not necessarily have to be executed in such an order. They can be executed simultaneously (in parallel) or in other orders. These adjusted solutions are equivalent to the technical solutions described in this application and therefore will also fall within the protection scope of this application.
[0062] Those skilled in the art will understand that all or part of the processes in the method of the above-described embodiment can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable file, or some intermediate form. The computer-readable storage medium can include any entity or device capable of carrying the computer program code, a medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory, a random access memory, an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc.
[0063] Another aspect of this application provides a computer-readable storage medium.
[0064] In one embodiment of a computer-readable storage medium according to this application, the computer-readable storage medium can be configured to store a program that executes the network distribution communication method based on an extended reality acquisition device described in the above-described method embodiments. This program can be loaded and run by a processor to implement the network distribution communication method based on an extended reality acquisition device. For ease of explanation, only the parts related to the embodiments of this application are shown; for specific technical details not disclosed, please refer to the method section of the embodiments of this application. The computer-readable storage medium can be a storage device comprising various electronic devices. Optionally, in the embodiments of this application, the computer-readable storage medium is a non-transitory computer-readable storage medium.
[0065] Another aspect of this application provides an electronic device.
[0066] In one embodiment of an electronic device according to this application, the electronic device may include at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program that, when executed by the at least one processor, implements the methods described in any of the above embodiments. See Appendix Figure 3 , Figure 3 The example illustrates a memory and processor connected via a bus communication connection.
[0067] The electronic devices described in this application may include, but are not limited to, mobile phones, tablets, desktop computers, laptops, handheld computers, notebook computers, in-vehicle devices, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), augmented reality (AR) / virtual reality (VR) devices, etc., and the embodiments of this application do not limit them.
[0068] The technical solutions of this application have been described above with reference to the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of this application is obviously not limited to these specific embodiments. Without departing from the principles of this application, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will all fall within the scope of protection of this application.
Claims
1. A distribution network communication method based on an extended reality data acquisition device, characterized in that, The extended reality acquisition device includes a head-mounted display device and an external acquisition device, and the network communication method includes: Control the head-mounted display device to communicate with the peripheral acquisition device and establish a communication link; Based on the communication link between the head-mounted display device and the peripheral acquisition device, network configuration is performed between the head-mounted display device and the peripheral acquisition device. After network configuration is completed, joint data acquisition is initiated and real-time monitoring is performed throughout the acquisition process. Specifically, this includes: continuously verifying the network status of the connection between the head-mounted display device and the peripheral acquisition device, wherein the network status is used to identify in real time whether the network connection between the head-mounted display device and the peripheral acquisition device is normal throughout the acquisition process; and detecting the matching of the current peripheral acquisition device and the current acquisition task with the communication link based on the feedback data from the peripheral acquisition device, so as to achieve real-time identification of whether the communication link is correctly matched with the current peripheral acquisition device and the current acquisition task throughout the acquisition process.
2. The distribution network communication method based on extended reality acquisition equipment according to claim 1, characterized in that, The feedback data includes a device identity identifier and a data acquisition task identifier; the detection of the compatibility between the current peripheral acquisition terminal and the current data acquisition task and the communication link based on the feedback data from the peripheral acquisition terminal includes: Acquire the feedback data reported by the peripheral acquisition terminal according to the set period; Compare the consistency between the device identification in the feedback data and the device binding information in the distribution network stage, and compare the consistency between the collection task identification in the feedback data and the task binding information in the distribution network stage; When all comparison results are consistent, it is determined that the current peripheral acquisition terminal and the current acquisition task match the communication link. When any comparison result is inconsistent, it is determined that the communication link is abnormal.
3. The distribution network communication method based on extended reality acquisition equipment according to claim 2, characterized in that, The method for determining communication link anomalies also includes: Obtain the reporting time of each instance of the feedback data; Calculate the time difference between the current moment and the time of the most recent report of the feedback data; When the time difference is greater than a preset duration, the communication link is determined to be abnormal.
4. The distribution network communication method based on extended reality acquisition equipment according to claim 1, characterized in that, The network configuration between the head-mounted display device and the peripheral acquisition device, based on the communication link between the head-mounted display device and the peripheral acquisition device, includes: The head-mounted display device sends a command to the peripheral acquisition terminal to obtain network identifiers through the communication link, and receives the set of network identifiers returned by the peripheral acquisition terminal. In response to the distribution network confirmation operation, distribution network information is constructed based on the target network, and the distribution network information is sent to the peripheral acquisition terminal through the communication link; wherein, the target network is a network identifier in the network identifier set determined based on the local database, or a custom network identifier, and the network identifier includes a network name and network credentials.
5. The distribution network communication method based on extended reality acquisition equipment according to claim 4, characterized in that, The method further includes: Based on the feedback data from the peripheral acquisition terminal, it is determined whether the target network connection is effective, and the network name and network credentials corresponding to the effective target network are stored in the local database.
6. The distribution network communication method based on extended reality acquisition equipment according to claim 1, characterized in that, The process of controlling the head-mounted display device to communicate with the peripheral acquisition device and establish a communication link includes: The head-mounted display device can communicate with the peripheral acquisition terminal via any one of the following connection methods: Bluetooth connection, wireless network connection, and Ethernet connection. A communication link is established between the head-mounted display device and the peripheral acquisition device based on the WebSocket protocol.
7. The distribution network communication method based on extended reality acquisition equipment according to claim 1, characterized in that, The method further includes: When the communication link is determined to be abnormal, the level identifier of the abnormal information in the feedback data is obtained; Based on the level identifier, determine whether the abnormal information belongs to the preset high priority level; When the abnormal information belongs to the preset high priority level, an alarm message will be output in the form of a pop-up window, and the current joint data collection process will be blocked; When the abnormal information does not belong to the preset high priority level, the abnormal information will be displayed in a non-blocking manner.
8. The distribution network communication method based on extended reality acquisition equipment according to claim 1, characterized in that, The continuous verification of the network status between the head-mounted display device and the external acquisition device includes: Obtain the network identifier connected to the head-mounted display device at the start of the joint acquisition, and use it as the reference network identifier; During the joint data acquisition process, the current network identifier of the connection between the head-mounted display device and the peripheral acquisition device is continuously acquired at preset time intervals. Verify the consistency between the current network identifier and the baseline network identifier.
9. An electronic device, characterized in that, include: At least one processor; And, a memory communicatively connected to the at least one processor; The memory stores a computer program, which, when executed by the at least one processor, implements the distribution network communication method based on the extended reality acquisition device as described in any one of claims 1 to 8.
10. A computer-readable storage medium storing a plurality of program codes, characterized in that, The program code is adapted to be loaded and run by a processor to perform the network communication method based on the extended reality acquisition device as described in any one of claims 1 to 8.
