A VR signal direct connection system and method based on multi-protocol adaptive matching

Abstract

The application discloses a VR signal direct connection system and method based on multi-protocol adaptive matching, wherein the VR signal direct connection system comprises a signal receiving unit used for receiving signals of different frequency bands; a protocol decoding unit used for performing protocol decoding on the transmitted signals; an LSTM protocol prediction model used for generating a protocol priority queue and transmitting the generated protocol priority queue to a dynamic protocol loading unit; the dynamic protocol loading unit is used for judging whether to switch protocols according to signal quality conditions and the generated protocol priority queue, and if yes, transmitting the protocol state after switching to an FPGA dynamic partition; the FPGA dynamic partition is used for receiving the protocol state transmitted by the dynamic protocol loading unit and the protocol data transmitted by the protocol decoding unit; a signal processing module is used for receiving the protocol state and the protocol data transmitted by the FPGA dynamic partition, processing the received data information, and generating the content displayed on a VR device.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of signal processing, and in particular to a VR signal direct connection system and method based on multi-protocol adaptive matching. BACKGROUND

[0002] With the continuous progress of science and technology, virtual reality (VR) technology has been widely applied in many fields, and people have higher requirements for the performance and compatibility of VR devices. However, the existing VR glasses and wireless projection technology have many shortcomings and cannot meet the needs of the current market and users.

[0003] The current VR glasses patents such as CN112235560B and CN113866985B, and wireless projection technologies such as CN110769523B and CN109618220B, etc., mostly only support a single or limited number of protocols. This makes the VR glasses often face the problem of protocol incompatibility when connecting different brands and types of devices, limiting its wide application and interconnection between devices.

[0004] Moreover, the existing technology lacks multi-protocol adaptive matching capability and cannot automatically identify, negotiate and switch multiple signal protocols used by different source devices. This results in the need for manual selection of protocols by users during use, which is tedious and limited by device compatibility, greatly limiting the universality of VR glasses connecting different devices and failing to provide users with some convenient multi-device connection experience.

[0005] In the multi-device or multi-protocol scenario, such as the multi-device access mentioned in CN114157902B, the existing solutions have obvious deficiencies in protocol compatibility processing and potential conflict resolution, making it difficult to ensure the stability and reliability of signal transmission. At the same time, the existing technology does not fully consider the special needs of VR devices, such as low latency, high refresh rate and picture synchronization. Although some projection technologies are aimed at ordinary display devices, they are not optimized for VR glasses; and the existing VR patents lack multi-protocol capability in signal access and cannot fully meet the signal transmission requirements in the VR scenario.

[0006] In summary, the existing VR glasses and wireless projection technology have problems in multi-protocol compatibility, adaptive matching, connection convenience, cost control, device hardware requirements, and optimization for VR special needs, etc.

[0007] Therefore, in view of the above technical problems, the present application provides a VR signal direct connection system and method based on multi-protocol adaptive matching. SUMMARY

[0008] The VR signal direct connection system and method based on multi-protocol adaptive matching can solve the problems of insufficient protocol compatibility, lack of multi-protocol adaptive matching capability, dependence on independent relay equipment, high system complexity and insufficient consideration of protocol compatibility and conflict in the prior art.

[0009] In order to achieve the above object, the present application adopts the following technical scheme:

[0010] A VR signal direct connection system based on multi-protocol adaptive matching, comprising a VR device body, further comprising a protocol identification module, a protocol matching module and a signal processing module arranged in the VR device body.

[0011] The protocol identification module comprises a signal receiving unit and a protocol decoding unit; the protocol matching module comprises an FPGA dynamic partition, an LSTM protocol prediction model and a dynamic protocol loading unit.

[0012] The signal receiving unit is connected with the protocol decoding unit, and is used for receiving signals of different frequency bands and transmitting the received signals to the protocol decoding unit.

[0013] The protocol decoding unit is connected with the FPGA dynamic partition, and is used for decoding the transmitted signals and transmitting the decoded protocol data to the FPGA dynamic partition.

[0014] The LSTM protocol prediction model is connected with the dynamic protocol loading unit, and is used for generating a protocol priority queue and transmitting the generated protocol priority queue to the dynamic protocol loading unit.

[0015] The dynamic protocol loading unit is connected with the FPGA dynamic partition, and is used for judging whether to switch protocols according to the signal quality condition and the generated protocol priority queue, and if yes, transmitting the switched protocol state to the FPGA dynamic partition.

[0016] The FPGA dynamic partition is connected with the signal processing module, and is used for receiving the protocol state transmitted by the dynamic protocol loading unit and the protocol data transmitted by the protocol decoding unit, and transmitting the received protocol state and protocol data to the signal processing module.

[0017] The signal processing module is used for receiving the protocol state and protocol data transmitted by the FPGA dynamic partition, processing the received data information, and generating the content displayed on the VR device.

[0018] Further, the signal receiving unit comprises a millimeter wave phased array antenna and a Sub-6GHz antenna.

[0019] The millimeter wave phased array antenna is used for receiving signals of a 60GHz frequency band.

[0020] Sub-6GHz antenna, used for receiving signals in the 2.4-5.8GHz frequency band.

[0021] Further, the FPGA dynamic partitioning includes a main protocol, a backup area, and a public resource area. The main protocol area is used to load a main protocol stack, the backup area is used to load a backup protocol stack, and the public resource area is used to load shared resources.

[0022] Further, the protocol matching module further includes a spectrum scanner, an interference avoider, and a channel selector.

[0023] The spectrum scanner is connected with the millimeter wave phased array antenna, the Sub-6GHz antenna, the interference avoider, and the channel selector, respectively, and is used to scan the frequency band of the signal and generate a spectrum graph corresponding to the signal frequency band. The spectrum graph is transmitted to the interference avoider and the channel selector, respectively.

[0024] The interference avoider is connected with the channel selector and the FPGA dynamic partitioning, respectively, and is used to detect and avoid interference signals according to the spectrum graph. The interference avoidance instructions are transmitted to the channel selector and the FPGA dynamic partitioning, respectively.

[0025] The channel selector is connected with the FPGA dynamic partitioning, and is used to select an optimal channel according to the spectrum graph and the interference avoidance instructions. The optimal channel instructions are transmitted to the FPGA dynamic partitioning.

[0026] Further, the signal processing module includes a codec unit, a picture synthesis unit, and a rendering unit.

[0027] The codec unit is connected with the FPGA dynamic partitioning and the picture synthesis unit, respectively, and is used to perform encoding processing on the protocol data. The encoded data stream is transmitted to the picture synthesis unit.

[0028] The picture synthesis unit is connected with the rendering unit, receives the encoded data stream, and performs synthesis processing on the received data stream. The synthesized picture data is transmitted to the rendering unit.

[0029] The rendering unit receives the synthesized picture data, performs pre-rendering processing on the picture data, obtains a predicted picture, and displays the obtained picture through a display screen of a VR device.

[0030] Further, the signal processing module further includes an eye movement sensor, a code rate allocator, and an image compression unit.

[0031] The eye movement sensor is connected with the code rate allocator, acquires a line-of-sight direction and a focal point position, and generates gaze area data. The gaze area data is transmitted to the code rate allocator.

[0032] A code rate allocator is connected with the image compression unit, configured to allocate code rates to different regions of the image according to the gaze region data, and generate code rate allocation instructions for the different regions, and deliver the code rate allocation instructions to the image compression unit.

[0033] An image compression unit is configured to compress the images of the different regions according to the instructions from the code rate allocator.

[0034] Further, the system further comprises an intelligent resource management module, which comprises a dynamic bandwidth allocator, a conflict coordinator, and a channel degradation strategy unit.

[0035] The dynamic bandwidth allocator is connected with the FPGA dynamic partitioning unit, configured to allocate channel resources according to real-time requirements, and deliver bandwidth allocation instructions to the FPGA dynamic partitioning unit.

[0036] The conflict coordinator is connected with the dynamic bandwidth allocator, configured to monitor and arbitrate resource conflicts in real time, and feed back the arbitration results to the dynamic bandwidth allocator.

[0037] The channel degradation strategy unit is connected with the dynamic bandwidth allocator and the conflict coordinator, configured to monitor channel quality, and feed back the monitoring results to the conflict coordinator and the dynamic bandwidth allocator.

[0038] Further, the intelligent resource management module further comprises a content detector, a DRM watermark embedder, and a split-screen limiter.

[0039] The content detector is connected with the protocol decoding unit, configured to analyze whether the screen projection content corresponding to the protocol data contains private information.

[0040] The DRM watermark embedder is connected with the content detector, configured to automatically embed digital watermarks when private content is detected.

[0041] The split-screen limiter is connected with the content detector, configured to limit split-screen display when private content is detected.

[0042] Further, the system further comprises a power management module, which comprises a silicon-based millimeter wave radio frequency front end, a dynamic power consumption controller, and a seamless switching power supply unit.

[0043] The silicon-based millimeter wave radio frequency front end is connected with the millimeter wave phased array antenna, configured to provide radio frequency power for the millimeter wave phased array antenna.

[0044] The dynamic power consumption controller is connected with the main power supply and the backup battery of the VR device, configured to deliver power consumption adjustment instructions in real time to control the power consumption of the entire system.

[0045] The seamless switching power supply unit is configured to switch to the backup battery when the main power supply fails.

[0046] Correspondingly, a VR signal direct connection method based on multi-protocol adaptive matching is also provided, comprising:

[0047] S1. The signal receiving unit receives signals of different frequency bands and transmits the received signals to the protocol decoding unit;

[0048] S2. The protocol decoding unit decodes the transmitted signals and transmits the decoded protocol data to the FPGA dynamic partitioning;

[0049] S3. The LSTM protocol prediction model generates a protocol priority queue and transmits the generated protocol priority queue to the dynamic protocol loading unit;

[0050] S4. The dynamic protocol loading unit determines whether to switch protocols according to the signal quality conditions and the generated protocol priority queue, and if so, transmits the switched protocol state to the FPGA dynamic partitioning;

[0051] S5. The FPGA dynamic partitioning receives the protocol state transmitted by the dynamic protocol loading unit and the protocol data transmitted by the protocol decoding unit, and transmits the received protocol state and protocol data to the signal processing module;

[0052] S6. The signal processing module receives the protocol state and protocol data transmitted by the FPGA dynamic partitioning, and processes the received data information to generate the content displayed on the VR device.

[0053] Compared with the prior art, the present application has the following beneficial effects:

[0054] 1. Polynomial intelligent protocol adaptation: through the protocol identification module and the protocol matching module, the signal reception and automatic adaptation of multiple protocols are realized. The system can automatically identify, negotiate and switch multiple signal protocols used by different source devices, avoiding the tedious operation of manually selecting protocols, improving the universality of VR glasses connecting different devices, and solving the problems of insufficient protocol compatibility and lack of multi-protocol adaptive matching capability in the prior art.

[0055] 2. Multi-frequency cooperation: millimeter wave phased array antenna and Sub-6GHz antenna are used to cover multiple frequency bands, ensuring the stability and reliability of signal transmission. The millimeter wave phased array antenna covers the 60GHz frequency band, and the Sub-6GHz antenna covers the 2.4-5.8GHz frequency band, forming multi-frequency cooperation, enhancing the signal coverage range and anti-interference ability, ensuring stable signal transmission, improving the quality and efficiency of VR signal transmission, and improving user experience.

[0056] 3. High-efficiency signal processing: The signal processing module has low-delay encoding and decoding unit, multi-source picture synthesis unit and frame buffer pre-rendering unit functions. The low-delay encoding and decoding unit adopts H.265 hardware decoding technology, the end-to-end delay is ≤5ms, effectively reducing the signal processing time; the multi-source picture synthesis unit supports multiple display modes, the processing delay is ≤1ms, improving the picture synthesis speed and quality; the frame buffer pre-rendering unit predicts the head motion trajectory by Kalman filtering algorithm and performs pre-rendering, the compensation delay is ≤0.2ms, reducing the delay and improving the picture synchronization.

[0057] 4. Intelligent spectrum sensing and channel optimization: The intelligent spectrum sensing unit scans the spectrum in real time, avoids interference signals, and selects the optimal channel. The spectrum scanner generates a spectrum map, the interference avoider detects and avoids interference, and the channel selector selects the optimal channel, significantly improving the stability and anti-interference ability of multi-protocol transmission, and shortening the interference avoidance response time to 10ms, providing better channel resources for signal transmission and ensuring the stability and reliability of transmission.

[0058] 5. Eye tracking focus enhancement: The eye tracking focus enhancement system differentiates the code rate allocation according to the user's gaze area, improves the picture quality of the gaze area, and reduces the code rate of the non-gaze area, reducing the bandwidth demand. The gaze area is allocated 80% of the code rate, and the non-gaze area is allocated 20% of the code rate, with a code rate allocation accuracy of ±5%, effectively improving transmission efficiency, reducing data transmission volume, and optimizing user experience.

[0059] 6. Enhanced privacy protection: The privacy protection unit prevents sensitive information leakage through content detection, DRM watermark embedding, and split-screen restriction. The content detector analyzes the projection content to determine whether it contains private information, the DRM watermark embedder automatically embeds digital watermarks when private content is detected, and the split-screen restrictor restricts split-screen display. The privacy protection response time is shortened to 50ms, effectively protecting user privacy.

[0060] 7. Dynamic resource allocation: The intelligent resource management module dynamically allocates bandwidth and coordinates conflicts based on device type, signal quality, and user preferences, optimizing resource utilization. The dynamic bandwidth allocator allocates channel resources on demand, with the master device exclusively occupying 80%, improving resource utilization; the conflict coordinator arbitrates based on multiple factors, with an arbitration time of ≤100ms, timely resolving transmission conflicts and ensuring efficient signal transmission.

[0061] 8. Channel degradation strategy: The channel degradation strategy unit automatically degrades to the 5GHz frequency band and adjusts the encoding and resolution when the millimeter wave transmission is blocked, ensuring the continuity of signal transmission. With H.264 encoding, the resolution is reduced from 4K@120Hz to 1080P@60Hz, reducing transmission requirements and ensuring the continuity of signal transmission, improving the reliability and stability of the system.

[0062] 9. High-efficiency power management: The power management module realizes high-efficiency power supply and power consumption control through a silicon-based millimeter wave radio frequency front end, a dynamic power consumption controller and a seamless switching power supply unit. The silicon-based millimeter wave radio frequency front end adopts a 28nm process, and the power consumption is ≤0.5W per channel, thereby reducing power consumption; the dynamic power consumption controller adjusts the power consumption according to the mode, and the total power consumption is ≤4W and ≤2.5W, respectively, thereby realizing energy-saving control; and the seamless switching power supply unit switches to a backup battery when the main power supply fails, and the switching time is <5ms, thereby ensuring continuous operation of the system. BRIEF DESCRIPTION OF DRAWINGS

[0063] Figure 1 is a structure diagram of a VR signal direct connection system based on multi-protocol adaptive matching provided by embodiment one;

[0064] Figure 2 is a structure diagram of a protocol identification module provided by embodiment one;

[0065] Figure 3 is a structure diagram of an intelligent spectrum sensing unit provided by embodiment one;

[0066] Figure 4 is a structure diagram of a protocol identification module and a protocol matching module provided by embodiment one;

[0067] Figure 5 is a structure diagram of an eye tracking focus enhancement unit provided by embodiment one;

[0068] Figure 6 is a structure diagram of a signal processing module provided by embodiment one;

[0069] Figure 7 is a structure diagram of a privacy protection unit provided by embodiment one;

[0070] Figure 8 is a structure diagram of an intelligent resource management module provided by embodiment one. DETAILED DESCRIPTION

[0071] The embodiments of the present application will be described in detail below with specific reference to specific examples. Those skilled in the art can easily understand other advantages and effects of the present application from the disclosure of the present specification. The present application can also be implemented or applied by different specific embodiments, and the details in the specification can be modified or changed based on different views and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0072] The purpose of the present application is to provide a VR signal direct connection system and method based on multi-protocol adaptive matching to overcome the defects of the prior art.

[0073] Embodiment one

[0074] This embodiment provides a VR signal direct connection system based on multi-protocol adaptive matching, such as... Figures 1-8 As shown, it includes the VR device body, and the protocol identification module 1, protocol matching module 2, signal processing module 3, intelligent resource management module 4, and power management module 5 set in the VR device body.

[0075] In this embodiment, the VR device itself can be existing VR glasses, which may include a shell, display screen, main control circuit board, main control chip, main power supply, backup battery, etc. It can realize screen projection. This embodiment will not elaborate too much on the VR glasses themselves, but can refer to the existing technology.

[0076] The protocol identification module 1 includes a signal receiving unit and a protocol decoding unit 11; wherein the signal receiving unit includes a millimeter-wave phased array antenna 12 and a Sub-6GHz antenna 13.

[0077] The millimeter-wave phased array antenna 12 is mounted on the top edge of the VR device housing and is electrically connected to the protocol decoding unit 11 on its internal main control circuit board via a cable or PCB trace. The millimeter-wave phased array antenna 12 consists of a 16×16 element array with an element spacing of λ / 2 ± 0.1 mm (λ = 5 mm) and a radiation efficiency ≥ 85%. It provides the foundation for high-speed, high-capacity data transmission, ensuring the VR device can receive high-quality video and audio data. The millimeter-wave phased array antenna 12 receives 60 GHz band signals from external devices and converts these signals into electrical signals, which are then transmitted to the protocol decoding unit.

[0078] The Sub-6GHz antenna 13 is installed on both sides of the VR device housing via interfaces such as USB and HDMI, and is electrically connected to the protocol decoding unit 11 on the main control circuit board via a cable or PCB circuit. The Sub-6GHz antenna 13 adopts a ring layout, covering the 2.4-5.8GHz frequency band, which can provide relatively stable medium-distance transmission capability and ensure signal coverage in different environments. The Sub-6GHz antenna 13 receives 2.4-5.8GHz frequency band signals sent by external devices and converts the frequency band signals into electrical signals and transmits them to the protocol decoding unit 11.

[0079] The protocol decoding unit 11 is installed on the main control circuit board in the VR device, connected with the protocol matching module 2 through a high-speed data bus, and can be a Silicon Labs WF200 or an AM8269D; the protocol decoding unit 11 supports multiple protocol analysis and is a key link of signal processing, receives signals transmitted by the millimeter wave phased array antenna 12 and the Sub-6GHz antenna 13, and performs protocol analysis on the received signals to extract specific protocol data such as HDMI 2.1, DP 2.0, WiGig, Miracast, etc., and provide identifiable data formats for subsequent signal processing modules.

[0080] The protocol decoding unit 11 in the embodiment performs protocol analysis on the received signals as follows:

[0081] When receiving signals, the received signals are first detected and the protocol type corresponding to the signals is identified. For example, the protocol type is determined according to the characteristic frame, data packet format, synchronization signal, etc. of the signals. Then, the data packets in the signals are analyzed according to the specifications of different protocols. For example, for the HDMI protocol, the packaging format of video and audio data, control information, etc. are analyzed; for the WiGig protocol, the signaling and data format in wireless transmission are analyzed. Then, the valid video, audio or control data are extracted from the analyzed data packets, and the extracted payloads are converted into a unified internal data format for subsequent processing modules. Then, the control information in the protocol is processed, such as the EDID information in HDMI and the auxiliary channel data in DP, for configuring and optimizing the transmission and display parameters of the system. Finally, the converted data are transmitted to the protocol matching module through a high-speed data bus for use by subsequent signal processing modules.

[0082] The protocol matching module 2 includes an FPGA dynamic partition 21, an LSTM protocol prediction model 22, a dynamic protocol loading unit 23, and an intelligent spectrum sensing unit 24.

[0083] The LSTM protocol prediction model 22 runs on the main control chip (such as GPU or special AI chip) in the VR device and is connected with the dynamic protocol loading unit 23 and the FPGA dynamic partition 21 through an internal bus; the LSTM protocol prediction model 22 is a machine learning model based on long short-term memory network (LSTM) and is used for predicting and optimizing the selection of wireless communication protocols.

[0084] The LSTM protocol prediction model 22 receives data features from different sources, such as EDID data with signal quality weight ≥ 40%, USB PD messages with device capability weight ≥ 20%, and historical usage records, and outputs a protocol priority queue based on LSTM layers, indicating the ranking of different protocols in the current scenario, and the accuracy of the output priority is ≥ 95%. The generated protocol priority queue is transmitted to the dynamic protocol loading unit 23, providing the basis for protocol selection for the dynamic protocol loading unit 23.

[0085] The EDID (Extended Display Identification Data) data is a data format provided by VR devices, which contains detailed parameters such as display device resolution, refresh rate, manufacturer information, etc. By analyzing EDID data, the LSTM protocol prediction model can understand the display capabilities of the connected device, thereby providing the basis for protocol selection. USB PD (Power Delivery) messages mainly involve information such as the power supply capacity and demand of VR devices. VR devices require stable power supply to support their high-performance operation and display functions during operation. By analyzing USB PD messages, the LSTM protocol prediction model can understand the power supply requirements of VR devices, thereby considering factors such as device power consumption and power supply capacity when selecting protocols, ensuring stable operation of the device under different protocols. Historical usage records include user behavior patterns when using different devices and protocols in the past. For example, users often use a certain protocol to connect to a specific type of device (such as a specific brand of computer, game console, etc.), or prefer a certain protocol in a specific scenario. By analyzing these historical data, the LSTM protocol prediction model can learn the user's usage habits and preferences, and thus more accurately predict the most suitable protocol in the current situation.

[0086] In this embodiment, the implementation of the LSTM protocol prediction model for prediction is as follows: the LSTM model is trained by learning historical wireless communication environment (such as signal, delay, bandwidth) and corresponding protocol performance sequence data. It captures the complex patterns and dependencies of these time series features. When predicting, the model receives the current real-time or upcoming changing wireless environment parameters as input sequences, and then outputs the most likely or optimal communication protocol recommendation based on the learned patterns, to achieve dynamic selection and optimization.

[0087] The dynamic protocol loading unit 23 is installed on the main control circuit board in the VR device, and is electrically connected with the FPGA dynamic partition 21, the LSTM protocol prediction model 22, the millimeter wave phased array antenna 12 and the Sub-6GHz antenna 13 through an internal bus; the dynamic protocol loading unit 23 is used for monitoring the signal quality information (such as RSSI≥-70dBm and signal-to-noise ratio≥20dB) received by the millimeter wave phased array antenna 12 and the Sub-6GHz antenna 13 and the protocol priority queue provided by the LSTM protocol prediction model 22 in real time, and then deciding whether to switch the protocol (such as HDMI 2.1, DP 2.0, WiGig, Miracast and the like, and the switching delay is less than 1ms), and if switching is needed, a new protocol stack is obtained from the protocol stack repository, and the protocol state after switching is transmitted to the FPGA dynamic partition 21.

[0088] In this embodiment, the condition for switching the protocol is that the signal quality meets the standard, the predicted priority is improved, the environment changes, and the switching can be completed within <1ms, so that the system performs protocol switching to ensure the communication quality and experience.

[0089] The FPGA dynamic partition 21 is installed on the main control circuit board in the VR device, and is connected with the protocol decoding unit 11 and the signal processing module 3 through a high-speed data bus; the FPGA dynamic partition 21 is divided into three areas, the main protocol area accounts for 60%, the alternative area accounts for 30%, and the public resource area accounts for 10%; the main protocol area is used for loading the main protocol stack, the alternative area is used for loading the alternative protocol stack, and the public resource area is used for loading the shared resources.

[0090] After receiving the protocol switching instruction sent by the dynamic protocol loading unit 23, the FPGA dynamic partition 21 reads the corresponding protocol stack code from the currently used protocol stack repository, and loads it into the specified partition. During the loading process, the FPGA dynamic partition decodes the code, configures the logic unit and the storage unit, and establishes the corresponding data path and control logic.

[0091] The FPGA dynamic partition 21 receives the protocol data sent by the protocol decoding unit 11, and processes the protocol data according to the loaded protocol stack to parse and convert the data. For example, the data of the HDMI protocol is converted in format so that it can be correctly recognized and processed by the subsequent signal processing module 3.

[0092] The FPGA dynamic partition 21 also feeds back the protocol stack state and resource usage of the current loading to the dynamic protocol loading unit 23, so that the dynamic protocol loading unit 23 makes the next decision according to the system state. At the same time, the FPGA dynamic partition 21 also dynamically updates the configuration of the internal resources according to the real-time demand of the system, such as adjusting the allocation of the storage unit and optimizing the connection of the logic unit.

[0093] The intelligent spectrum sensing unit 24 is installed on the main control circuit board in the VR device, connected with the Sub-6GHz antenna 13, the millimeter wave phased array antenna 12 and the FPGA dynamic partition 21 through the high-frequency signal interface, receives the spectrum data transmitted by the receiving antenna, and transmits the channel selection instruction to the FPGA dynamic partition.

[0094] The intelligent spectrum sensing unit 24 includes a spectrum scanner 241, an interference avoider 242 and a channel selector 243.

[0095] The spectrum scanner 241 is located in the intelligent spectrum sensing unit 24, connected with the millimeter wave phased array antenna 12, the Sub-6GHz antenna 13, the interference avoider 242 and the channel selector 243 through the high-frequency signal interface, and its model can be high pass WCN6850; the spectrum scanner 241 receives the signals transmitted by the millimeter wave phased array antenna 12 and the Sub-6GHz antenna 13, generates a spectrum graph according to the signal scanning of the 2.4GHz, 5GHz and 60GHz frequency bands, and transmits the spectrum data to the interference avoider 242 and the channel selector 243, providing a basis for interference avoidance and channel selection.

[0096] The interference avoider 242 is located in the intelligent spectrum sensing unit 24, connected with the spectrum scanner 241, the channel selector 243 and the FPGA dynamic partition 21 through the control bus, and its model can be Intel Cyclone V / 10 series; the interference avoider 242 receives the spectrum graph transmitted by the spectrum scanner 241, detects the interference signal according to the spectrum graph and avoids it, transmits the interference avoidance instruction to the channel selector 243 and the FPGA dynamic partition 21, and ensures that the signal transmission of the system is not disturbed.

[0097] The channel selector 243 is located in the intelligent spectrum sensing unit 24, connected with the spectrum scanner 241, the interference avoider 242 and the FPGA dynamic partition 21 through the internal bus, and its model can be Skyworks SKY13573-692LF; according to the spectrum graph generated by the spectrum scanner 241 and the avoidance result of the interference avoider 242, the channel selector 243 selects the optimal channel and transmits the channel selection instruction to the FPGA dynamic partition 21, ensuring the signal transmission efficiency of the system. The selection method of the channel with the highest signal is to select the channel with the highest signal-to-noise ratio (SNR) or the lowest interference according to the spectrum state of the channel, the interference level and the system demand.

[0098] In this embodiment, after receiving the interference avoidance instruction transmitted by the interference avoider 242 and the channel selection instruction of the channel selector 243, the FPGA dynamic partition 21 analyzes the received interference avoidance instruction and channel selection instruction, extracts specific interference information, avoidance requirements and parameters of the new channel, etc.

[0099] For channel switching: release the current occupied channel resources, including stopping sending data to the current channel, and notifying the relevant modules (such as low-delay codec) to suspend data processing. According to the channel selection instruction, configure new channel resources. This includes setting new frequency, bandwidth, modulation mode and other parameters to ensure that the FPGA dynamic partition can communicate with the new channel.

[0100] For interference avoidance processing: according to the interference avoidance instruction, select and load the protocol stack suitable for the new channel condition. This may include switching to a more interference-resistant coding scheme or modulation mode. Update the signal processing flow to adapt to the new channel conditions. For example, increase the filter strength, adjust the equalizer parameters, etc. to reduce the impact of interference.

[0101] The signal processing module 3 includes a codec unit 31, a picture synthesis unit 32, a rendering unit 33, and an eye tracking focus enhancement unit 34.

[0102] The codec unit 31 is installed on the main control circuit board inside the VR device, connected with the FPGA dynamic partition 21 and the picture synthesis unit 32 through a high-speed data bus, and can be of the Rockchip RK3568 type. It is used to receive the encoded protocol data transmitted by the FPGA dynamic partition 21, and efficiently decode the received protocol data to restore the original audio and video data for further processing and display by the picture synthesis unit 32. The end-to-end delay of the codec unit 31 in this embodiment is controlled at a very low level, such as when using H.265 hardware decoding technology, the end-to-end delay is ≤5ms. This is crucial for VR application scenarios because users have very high real-time requirements for pictures and sound. High delay can cause motion sickness and a decrease in immersion.

[0103] The picture synthesis unit 32 is installed on the main control circuit board inside the VR device, connected with the codec unit 31 and the rendering unit 33 through a video processing bus, and is used to receive the decoded data transmitted by the low-delay codec unit 31. It processes multiple video layers in parallel and pipeline fashion through its internal dedicated hardware multi-layer synthesizer to achieve picture synthesis (with a processing delay ≤1ms), supports multiple display modes (such as picture-in-picture, split-screen display, etc.), and transmits the synthesized picture data to the rendering unit 33.

[0104] The rendering unit 33 is installed on the main control circuit board inside the VR device, connected with the picture synthesis unit 32 through a video processing bus, and receives the synthesized picture data. It predicts the picture content of the next few frames (such as 3 frames) through Kalman filtering algorithm and performs pre-rendering in advance to compensate for the delay ≤0.2ms, and transmits the pre-rendered picture data to the display screen of the VR device.

[0105] The implementation of pre-rendering in advance is to use sensor motion data to predict future motion trajectory combined with Kalman filter. According to the predicted view angle, the future several frames of images are rendered on the GPU in advance. The deviation between the actual motion and the prediction is continuously fed back to adjust the model parameters to ensure the prediction accuracy. The pre-rendered frames are matched with the actual motion trajectory to achieve a compensation delay of ≤0.2ms.

[0106] The eye tracking focus enhancement unit 34 is installed on the front of the head-mounted display of the VR device, and is used to track the user's gaze area, allocate the code rate and compress the image of the gaze area, and improve the picture quality and transmission efficiency.

[0107] The eye tracking focus enhancement unit 34 includes an eye sensor 341, a code rate allocator 342 and an image compression unit 343.

[0108] The eye sensor 341 is installed on the front of the VR device and is connected to the code rate allocator 342 through a signal interface. The model can be Tobii EyeChip, which is used to detect the user's gaze area, i.e. the part of the picture that the user is currently watching. By capturing the user's eye movement, the eye sensor 341 can accurately determine the user's gaze point, providing a basis for subsequent image optimization. Then the detected gaze area data is transmitted to the code rate allocator 342, and the data of the user's gaze position is provided to the eye tracking focus enhancement system.

[0109] The code rate allocator 342 is installed on the main control circuit board inside the VR device and is connected to the eye sensor 341 and the image compression unit 343 through a video processing bus. It is used to receive the gaze area data transmitted by the eye sensor 341 and allocate the code rate to different gaze areas of the picture to optimize resource use and improve user experience. The gaze area is allocated a higher code rate (e.g. 80%), while the non-gaze area is allocated a lower code rate (e.g. 20%), so as to reduce the overall transmission bandwidth demand while ensuring the picture quality of the key area. Then the code rate allocation instruction is transmitted to the image compression unit, so as to ensure the picture quality of the gaze area and perform high compression rate transmission on the non-gaze area.

[0110] In order to more accurately allocate the code rate, the code rate allocator 342 will further evaluate each grid in the gaze area and the non-gaze area in this embodiment. For the grids in the gaze area, if the image content complexity contained therein is high, such as there are a large number of details, fast motion or high-contrast elements, the code rate allocator will allocate relatively more code rate to the grid; on the contrary, if the image content is simple, a relatively small code rate will be allocated, but overall the code rate of the grids in the gaze area is higher than that in the non-gaze area. For the grids in the non-gaze area, the code rate will also be fine-tuned according to the image complexity, but the overall code rate level is low.

[0111] The image compression unit 343 is installed on the main control circuit board in the VR device, connected with the code rate distributor 342 and the picture synthesis unit 32 through the video processing bus, used to receive the code rate distribution instructions transmitted by the code rate distributor 342, and through the technologies such as region division, parameter adjustment, multi-layer encoding and block level adjustment, different degrees of compression are implemented on the images of different regions, effectively balancing the picture quality and bandwidth utilization, and improving the transmission efficiency of the whole system, wherein the non-gaze area is processed with high compression ratio to reduce the data amount and save the transmission bandwidth, while ensuring that the image quality of the gaze area is not affected, then the compressed picture data is transmitted to the multi-source picture synthesizer, and then the transmission data amount is optimized and the transmission efficiency of the system is improved.

[0112] The intelligent resource management module 4 includes a dynamic bandwidth distributor 41, a conflict coordinator 42, a channel degradation strategy unit 43, and a privacy protection unit 44.

[0113] The conflict coordinator 42 is installed on the main control circuit board in the VR device, connected with the dynamic bandwidth distributor 41 and a plurality of external devices (such as computers, streaming media devices, smart phones, etc.) through the signal transceiver, and the model can be Texas Instruments TSW14J57, used to receive the relevant information of the external devices, and arbitrate based on the device type, signal quality and user preference, the arbitration time ≤100ms, the arbitration result is transmitted to the dynamic bandwidth distributor 41, and then the resource conflict between devices is solved to ensure the stable operation of the system.

[0114] The channel degradation strategy unit 43 is installed on the main control circuit board in the VR device, connected with the dynamic bandwidth distributor 41 and the conflict coordinator 42 through the internal bus, used to automatically degrade the channel to 5GHz frequency band and enable H.264 encoding when the millimeter wave transmission is blocked, and the resolution is reduced from 4K@120Hz to 1080P@60Hz, then the channel degradation state signal is transmitted to the dynamic bandwidth distributor 41 and the conflict coordinator 42, and the encoding method and resolution are adjusted, so that when the channel condition changes, the system can automatically adapt and maintain the stability of the transmission.

[0115] The dynamic bandwidth allocator 41 is installed on the main control circuit board in the VR device, connected with the FPGA dynamic partition 21 and the conflict coordinator 42 through the control bus, used to receive the arbitration result of the conflict coordinator 42, and dynamically allocate bandwidth by using the weighted fair queue (WFQ) algorithm in combination with the arbitration result of the conflict coordinator through real-time monitoring of the channel load state, preferentially guaranteeing 80% of the bandwidth resources of the VR device, and issuing resource division instructions to the FPGA dynamic partition through the control bus to realize the priority scheduling of protocol loading and data flow, and then allocate channel resources on demand to ensure that the VR device obtains 80% of the bandwidth resources in priority, optimize the transmission efficiency of the system, and pass the bandwidth allocation instructions to the FPGA dynamic partition 21, and the FPGA dynamic partition 21 processes the protocol loading and data priority according to the bandwidth allocation instructions.

[0116] The privacy protection unit 44 is installed on the main control circuit board in the VR device, connected with the protocol decoding unit 11 and the picture synthesis unit 32 through the data interface, used to detect whether the screen projection content contains private information, and to embed watermarks and limit split screen for the content containing private information to prevent private information leakage.

[0117] The privacy protection unit 44 includes a content detector 441, a DRM watermark embedder 442, and a split screen limiter 443.

[0118] The content detector 441 is installed on the main control circuit board in the VR device, connected with the protocol decoding unit 11, the DRM watermark embedder 442, and the split screen limiter 443 through the data interface, and the model can be Hi3559AV100, used to receive the screen projection content corresponding to the protocol data transmitted by the protocol decoding unit 11, analyze the screen projection content and judge whether it contains private information, and then provide the content detection result for the privacy protection unit, and then transmit the content detection result to the DRM watermark embedder 442 and the split screen limiter 443.

[0119] The DRM watermark embedder 442 is installed on the main control circuit board in the VR device, connected with the content detector 441 and the picture synthesis unit 32 through the video processing bus, and the model can be Verimatrix VCAS, used to receive the content detection result transmitted by the content detector 441, automatically embed digital watermarks when private content is detected, used to track and protect content, prevent private information leakage, and send the picture data with embedded watermarks to the picture synthesis unit 32.

[0120] The split-screen restrictor 443 is installed on the main control circuit board in the VR device, connected with the content detector 441 and the picture synthesis unit 32 through the video processing bus, can be of the model Nordic Semiconductor nRF52840, receives the content detection result transmitted by the content detector 441, restricts the split-screen display when detecting the private content, ensures that the private content is displayed only on the main screen or a specific area, prevents private information leakage, and sends the split-screen restriction instruction to the multi-source picture synthesizer.

[0121] The power management module 5 is usually installed near the power interface or battery installation area of the VR device to directly manage the distribution and conversion of the power supply. The power management module 5 includes a silicon-based millimeter wave radio frequency front end 51, a dynamic power consumption controller 52, and a seamless switching power supply unit 53.

[0122] The silicon-based millimeter wave radio frequency 51 adopts a 28nm process with a power consumption ≤0.5W / channel. The front end 51 is located inside the VR device and near the millimeter wave phased array antenna 12. It is connected with the millimeter wave phased array antenna 12 through a power supply line and can be of the model Qorvo QPF4008. It provides radio frequency power for the millimeter wave phased array antenna 12 to ensure normal signal transmission and transmission.

[0123] The dynamic power consumption controller 52 is located inside the power management module 5 with a total power consumption ≤4W and ≤2.5W. It is connected with the main power supply and backup battery of the VR device itself through a power management bus and can be of the model TITPS65987. It receives dynamic power consumption adjustment instructions and adjusts the power consumption according to the multi-protocol mode and single-protocol mode. It transmits the power consumption adjustment instructions to the main power supply and backup battery to ensure efficient operation of the system.

[0124] The seamless switching power supply unit 53 is located inside the power management module and is connected with the main power supply and backup battery of the VR device itself through a power supply line and can be of the model Linear Technology LTC4412. It receives power from the main power supply and backup battery and provides stable power supply for the system. When the main power supply fails, it switches to the backup battery with a switching time <5ms to ensure uninterrupted operation of the system and protect the user's experience.

[0125] The operation principle of the VR signal direct connection system based on multi-protocol adaptive matching in this embodiment is as follows:

[0126] The millimeter wave phased array antenna 12 and the Sub-6GHz antenna 13 start to work, covering the 60GHz frequency band and the 2.4-5.8GHz frequency band respectively, receiving the VR signal sent from the external device (computer, mobile phone, etc.). The protocol decoding unit 11 is electrically connected with the two antennas in real time, supports multiple protocol analysis such as HDMI 2.1, DP 2.0, WiGig, Miracast, decodes the signal received from the antenna, and obtains the original data.

[0127] The spectrum scanner 241 scans the 2.4GHz, 5GHz and 60GHz frequency bands to generate a spectrum graph, the interference avoider 242 detects interference signals and avoids according to the spectrum graph, and the channel selector 243 selects the optimal channel according to the spectrum graph and the interference avoidance result, and transmits the channel selection instruction to the FPGA dynamic partition 21, so as to select the best communication channel for subsequent signal transmission.

[0128] The FPGA dynamic partition 21 is divided into a main protocol area, a backup area and a public resource area, and loads the main protocol stack or the backup protocol stack according to the channel selection instruction. The LSTM protocol prediction model 22 generates a protocol priority queue by analyzing EDID data, USB PD messages and historical use records, and provides a reference order for protocol loading. The dynamic protocol loading unit 23 dynamically switches the protocol according to the conditions of RSSI≥-70dBm and signal-to-noise ratio≥20dB, so as to ensure that the protocol suitable for the current signal transmission is matched and loaded quickly and accurately, and the switching delay is controlled to be less than 1ms.

[0129] The codec unit 31 adopts H.265 hard decoding technology, decodes the protocol data transmitted from the protocol matching module 2, and obtains the original data, wherein the end-to-end delay is controlled to be less than or equal to 5ms. The picture synthesis unit 32 supports multiple display modes such as picture-in-picture and split-screen display, and the processing delay is less than or equal to 1ms. The picture data corresponding to different original data is synthesized. The rendering unit 33 predicts the future 3 frame head motion trajectory by using Kalman filtering algorithm and performs pre-rendering, the compensation delay is less than or equal to 0.2ms, the picture frame that may be needed is generated in advance, so as to improve the fluency and synchronization of the picture.

[0130] The eye movement sensor 341 is installed at the front of the VR device, and detects the gaze area of the user in real time. The code rate distributor 342 distributes 80% code rate according to the gaze area, and 20% code rate according to the non-gaze area, so as to realize the differential code rate distribution of different areas of the picture. The image compression unit 343 transmits the non-gaze area at a high compression rate, which effectively reduces the overall transmission bandwidth demand while ensuring the quality of the gaze area, and the code rate distribution accuracy reaches ±5%.

[0131] The dynamic bandwidth allocator 41 allocates channel resources on demand according to factors such as VR device type, signal quality, and user preferences, ensures that the VR device exclusively occupies 80% of the bandwidth, and guarantees the signal transmission quality of the main device. The conflict coordinator 42 arbitrates based on relevant factors, and the arbitration time is less than or equal to 100 ms, coordinating conflicts between different external devices or signals. The channel degradation strategy unit 43 automatically degrades to the 5GHz frequency band and enables H.264 encoding when the millimeter wave transmission is blocked, while reducing the resolution from 4K@120Hz to 1080P@60Hz to adapt to different transmission conditions. The content detector 441 in the privacy protection unit 44 analyzes the screen mirroring content corresponding to the protocol data to determine whether it contains private information. If private content is detected, the DRM watermark embedder 442 automatically embeds digital watermarks, and the split-screen restrictor 443 restricts split-screen display to prevent sensitive information from being leaked, and the privacy protection response time is shortened to 50 ms.

[0132] The silicon-based millimeter wave radio frequency 51 front end provides radio frequency power for the millimeter wave phased array antenna 12 through the power supply circuit. It uses a 28nm process and the power consumption is controlled to be less than or equal to 0.5W per channel. The dynamic power consumption controller 52 adjusts the power consumption according to the multi-protocol mode and the single-protocol mode, and the total power consumption is less than or equal to 4W in the multi-protocol mode and less than or equal to 2.5W in the single-protocol mode. The power consumption adjustment instructions are transmitted to the main power supply and the backup battery through the power management bus. The seamless switching power supply unit 53 quickly switches to the backup battery when the main power supply fails, and the switching time is less than 5ms, ensuring the continuous and stable operation of the whole system and providing continuous power support for each module.

[0133] In this embodiment, the synthesized picture data processed by the picture synthesis unit 32 and the rendering unit 33 is transmitted to the display screen of the VR device through the video output interface, and finally the picture is presented to the user, completing the whole process from receiving data to displaying pictures.

[0134] In this embodiment, signals of different frequency bands and protocols are received by the protocol identification module, and after being parsed by the protocol decoding unit, the protocol matching module performs dynamic loading and switching of the protocol to adapt to different signal sources and quality. The signal processing module encodes and decodes the data with low delay, synthesizes multiple source pictures, and pre-renders the frame buffer, ensuring smooth display of the picture. The intelligent resource management module monitors and manages channel resources and power consumption in real time, ensuring stable operation of the system. The intelligent spectrum sensing module optimizes the frequency spectrum usage, the eye movement tracking focus enhancement system improves user experience, and the privacy protection module prevents information leakage. Each module closely cooperates to achieve efficient and stable transmission and processing of VR signals, while reducing interference and power consumption, providing high-quality visual experience and privacy protection.

[0135] Embodiment Two

[0136] The embodiment provides a VR signal direct connection method based on multi-protocol adaptive matching, which comprises the following steps:

[0137] S1. A signal receiving unit receives signals of different frequency bands and transmits the received signals to a protocol decoding unit;

[0138] S2. The protocol decoding unit decodes the transmitted signals, and transmits the decoded protocol data to an FPGA dynamic partition;

[0139] S3. An LSTM protocol prediction model generates a protocol priority queue, and transmits the generated protocol priority queue to a dynamic protocol loading unit;

[0140] S4. The dynamic protocol loading unit determines whether to switch protocols according to the signal quality condition and the generated protocol priority queue, and if yes, transmits the switched protocol state to the FPGA dynamic partition;

[0141] S5. The FPGA dynamic partition receives the protocol state transmitted by the dynamic protocol loading unit and the protocol data transmitted by the protocol decoding unit, and transmits the received protocol state and protocol data to a signal processing module;

[0142] S6. The signal processing module receives the protocol state and protocol data transmitted by the FPGA dynamic partition, processes the received data information, and generates the content displayed on the VR device.

[0143] It should be noted that the VR signal direct connection method based on multi-protocol adaptive matching provided in the embodiment is similar to the first embodiment, and will not be described in detail.

[0144] Note that the above is only the preferred embodiment of the present application and the technical principle applied. Those skilled in the art will understand that the present application is not limited to the specific embodiments described herein, and those skilled in the art can make various obvious changes, readjustments and substitutions without departing from the scope of the present application. Therefore, although the present application has been described in detail through the above embodiments, the present application is not limited to the above embodiments, and can include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the appended claims.

Claims

1. A VR signal direct connection system based on multi-protocol adaptive matching, comprising a VR device body, characterized in that, It also includes a protocol identification module, a protocol matching module, and a signal processing module that are set in the VR device itself; The protocol identification module includes a signal receiving unit and a protocol decoding unit; the protocol matching module includes an FPGA dynamic partitioning, an LSTM protocol prediction model, and a dynamic protocol loading unit. The signal receiving unit, connected to the protocol decoding unit, is used to receive signals from different frequency bands and transmit the received signals to the protocol decoding unit. The protocol decoding unit, connected to the FPGA dynamic partition, is used to decode the transmitted signals and transmit the decoded protocol data to the FPGA dynamic partition. The LSTM protocol prediction model, connected to the dynamic protocol loading unit, is used to generate a protocol priority queue and pass the generated protocol priority queue to the dynamic protocol loading unit. The LSTM protocol prediction model generates a protocol priority sequence based on EDD data with a signal quality weight of ≥40%, USBPD messages with a device capability weight of ≥20%, and historical usage records. EDID data is a data format provided by VR devices, which includes the resolution, refresh rate, and manufacturer information of the display device. USBPD messages mainly involve the power supply capabilities and requirements of VR devices, and historical usage records include the user's behavior patterns when using different devices and protocols in the past. The dynamic protocol loading unit is connected to the FPGA dynamic partition and is used to determine whether to switch protocols based on signal quality conditions and the generated protocol priority queue. If so, the switched protocol status is passed to the FPGA dynamic partition. The FPGA dynamic partitioning is connected to the signal processing module. It is used to receive the protocol status transmitted by the dynamic protocol loading unit and the protocol data transmitted by the protocol decoding unit, and then transmit the received protocol status and protocol data to the signal processing module. After receiving the protocol switching instruction sent by the dynamic protocol loading unit, the FPGA dynamic partition reads the corresponding protocol code from the currently used protocol stack repository and loads it into the specified partition; the FPGA dynamic partition receives and processes the protocol data sent by the protocol decoding unit, and parses and converts the data according to the loaded protocol stack; The signal processing module is used to receive the protocol status and protocol data transmitted by the FPGA dynamic partition, process the received data information, and generate the content displayed on the VR device.

2. The VR signal direct connection system based on multi-protocol adaptive matching according to claim 1, characterized in that, The signal receiving unit includes a millimeter-wave phased array antenna and a Sub-6GHz antenna; Millimeter-wave phased array antenna, used to receive signals in the 60GHz band; Sub-6GHz antenna, used to receive signals in the 2.4-5.8GHz frequency band.

3. The VR signal direct connection system based on multi-protocol adaptive matching according to claim 1, characterized in that, The FPGA dynamic partitioning includes a main protocol area, a backup area, and a common resource area. The main protocol area is used to load the main protocol stack, the backup area is used to load the backup protocol stack, and the common resource area is used to load shared resources.

4. A VR signal direct connection system based on multi-protocol adaptive matching according to claim 2, characterized in that, The protocol matching module also includes a spectrum scanner, an interference avoidance device, and a channel selector; The spectrum scanner is connected to the millimeter-wave phased array antenna, the Sub-6GHz antenna, the interference avoider, and the channel selector, respectively. It is used to scan the frequency band of the signal and generate the spectrum diagram corresponding to the signal frequency band. The spectrum diagram is then transmitted to the interference avoider and the channel selector, respectively. The interference avoidance device is connected to the channel selector and the FPGA dynamic partition respectively. It is used to detect and avoid interference signals according to the spectrum diagram and transmit the interference avoidance command to the channel selector and the FPGA dynamic partition respectively. The channel selector, connected to the FPGA dynamic partition, is used to select the optimal channel based on the spectrum and interference avoidance instructions, and then transmits the optimal channel instructions to the FPGA dynamic partition.

5. A VR signal direct connection system based on multi-protocol adaptive matching according to claim 1, characterized in that, The signal processing module includes an encoding / decoding unit, an image compositing unit, and a rendering unit; The encoding and decoding unit is connected to the FPGA dynamic partitioning and the image compositing unit, respectively. It is used to encode the protocol data and transmit the encoded data stream to the image compositing unit. The image compositing unit is connected to the rendering unit. It is used to receive the encoded data stream, perform compositing processing on the received data stream, and transmit the composited image data to the rendering unit. The rendering unit receives the composited image data, performs pre-rendering processing on the image data to obtain the predicted image, and displays the obtained image through the display screen of the VR device.

6. A VR signal direct connection system based on multi-protocol adaptive matching according to claim 1, characterized in that, The signal processing module also includes an eye-tracking sensor, a bitrate distributor, and an image compression unit; An eye-tracking sensor, connected to a bitrate allocator, is used to acquire gaze direction and focus position, and generate gaze area data, which is then transmitted to the bitrate allocator. The bitrate allocator, connected to the image compression unit, is used to allocate bitrate to different regions of the image based on the gaze region data, and generate bitrate allocation instructions for different regions, and then pass the bitrate allocation instructions to the image compression unit. The image compression unit is used to compress the image in different areas according to the bitrate allocator instructions.

7. A VR signal direct connection system based on multi-protocol adaptive matching according to claim 1, characterized in that, It also includes an intelligent resource management module, which includes a dynamic bandwidth allocator, a conflict coordinator, and a channel degradation strategy unit. The dynamic bandwidth allocator, connected to the FPGA dynamic partition, is used to allocate channel resources according to real-time needs and transmit bandwidth allocation instructions to the FPGA dynamic partition. The conflict coordinator, linked to the dynamic bandwidth allocator, is used to monitor and arbitrate resource conflicts in real time and feed back the arbitration results to the dynamic bandwidth allocator. The channel degradation strategy unit is connected to the dynamic bandwidth allocator and the conflict coordinator respectively. It is used to monitor the channel quality and feed back the monitoring results to the conflict coordinator and the dynamic bandwidth allocator.

8. A VR signal direct connection system based on multi-protocol adaptive matching according to claim 7, characterized in that, The intelligent resource management module also includes a content detector, a DRM watermark embedder, and a split-screen limiter; The content detector, connected to the protocol decoding unit, is used to analyze whether the screen-casting content corresponding to the protocol data contains privacy information; A DRM watermark embedder connects to a content detector to automatically embed a digital watermark when private content is detected. Split-screen limiter, connected to a content detector, is used to restrict split-screen display when private content is detected.

9. A VR signal direct connection system based on multi-protocol adaptive matching according to claim 2, characterized in that, It also includes a power management module, which includes a silicon-based millimeter-wave RF front-end, a dynamic power consumption controller, and a seamless switching power unit. A silicon-based millimeter-wave radio frequency front-end, connected to a millimeter-wave phased array antenna, is used to provide radio frequency power to the millimeter-wave phased array antenna; The dynamic power consumption controller connects to the main power supply and backup battery of the VR device to transmit power consumption adjustment commands in real time and control the power consumption of the entire system. Seamless switching power unit for switching to backup battery in case of main power failure.

10. A direct connection method for a VR signal direct connection system based on multi-protocol adaptive matching as described in any one of claims 1-9, characterized in that, include: S1. The signal receiving unit receives signals from different frequency bands and transmits the received signals to the protocol decoding unit; S2. The protocol decoding unit decodes the transmitted signal and transmits the decoded protocol data to the FPGA dynamic partition. The S3.LSTM protocol prediction model generates a protocol priority queue and passes the generated protocol priority queue to the dynamic protocol loading unit. S4. Dynamic protocol loading unit: Based on signal quality conditions and the generated protocol priority queue, it determines whether to switch protocols. If so, it passes the switched protocol status to the FPGA dynamic partition. S5.FPGA dynamic partitioning receives the protocol status transmitted by the dynamic protocol loading unit and the protocol data transmitted by the protocol decoding unit, and transmits the received protocol status and protocol data to the signal processing module. S6. The signal processing module receives the protocol status and protocol data transmitted by the FPGA dynamic partition, processes the received data information, and generates the content displayed on the VR device.

Images