An XR anti-spying protection system

Abstract

The application discloses an XR anti-stealing photograph protection method, device and system based on binocular biological feature recognition and multi-sensor fusion. Through binocular living body verification, eye surrounding foreign matter monitoring, system integrity verification, hardware level picture control and cloud authorization supervision, XR device full-scene anti-stealing photograph, anti-leakage and copyright safety protection are realized, and the application can be widely applied to cinema synchronous viewing, immersive tourism, virtual exhibition hall, private display and meta-universe interaction and the like, and provides bottom layer safety protection capability for immersive digital content.

Description

Technical Field

[0001] This invention belongs to the field of XR immersive display, digital content security and privacy protection technology. Specifically, it relates to an XR anti-spy camera protection method, device and system based on binocular biometric recognition and multi-sensor fusion. It is widely applicable to various scenarios that require anti-spy camera, anti-leakage and anti-recording, such as simultaneous movie screenings in theaters, immersive cultural tourism, virtual exhibition halls, private displays, paid content playback, and metaverse interaction. Background Technology

[0002] With the rapid integration of virtual reality (XR) technology with digital cinemas, online streaming, and metaverse-style social viewing scenarios, immersive movie viewing via XR head-mounted displays has gradually become a necessity. Especially in ultra-high-definition 3D, wide depth-of-field, and high-brightness immersive viewing modes, users can experience cross-regional simultaneous viewing and virtual social interaction, greatly expanding the coverage and service formats of traditional cinemas.

[0003] However, at the same time, the issue of copyright protection for digital film content is becoming increasingly prominent. Existing XR viewing systems generally suffer from serious security vulnerabilities, specifically as follows: 1. Traditional XR devices only support simple wear detection and cannot distinguish between real human eyes and shooting devices. This makes them prone to behaviors such as single-eye filming, mobile phone recording, and unauthorized filming by external camera devices, which can lead to the leakage of films released simultaneously with theatrical releases during the public screening window, seriously damaging the interests of producers, distributors, and theaters.

[0004] 2. Existing technology cannot perform binocular biometric verification and cannot identify whether both eyes are watching simultaneously, symmetrically, and legally. Users can bypass playback restrictions by covering one eye or using non-living media to replace the human eye, resulting in the loss of control over copyrighted content.

[0005] 3. Current XR playback systems lack hardware-level real-time image control mechanisms. When behaviors such as unauthorized filming, viewing without the eyes, or playing without wearing the device occur, they cannot achieve millisecond-level black screen or stream interruption. Once copyrighted content is leaked, it is difficult to recover it.

[0006] 4. Existing anti-spy camera solutions mostly rely on software-level restrictions, which are easily cracked, flashed, or tampered with, and cannot meet the security supervision requirements for simultaneous screenings in national cinemas. Summary of the Invention

[0007] The purpose of this invention is to overcome the shortcomings of the prior art and provide a method, device and system for preventing voyeurism during XR movie viewing based on binocular biometric recognition and multi-sensor fusion. This invention solves the problems of existing XR movie viewing devices being unable to effectively identify voyeurism devices, unable to accurately verify live binocular vision, unable to achieve hardware-level screen control, and having easily cracked protection mechanisms. It achieves high-security copyright protection for theatrical releases and immersive digital content.

[0008] To achieve the above objectives, the present invention adopts the following technical solution.

[0009] I. XR Movie Viewing Anti-Spycam Protection Methods A method for preventing unauthorized filming during XR movie viewing, based on binocular biometric recognition and multi-sensor fusion, applied to XR head-mounted display devices, includes the following steps: 1. Before playing protected digital content, perform an integrity check on the device's internal anti-spy camera protection system to determine whether the system has been modified, blocked, removed, or bypassed (e.g., ...). Figure 1 (1) 2. Liveness detection is performed on the user's visual field using a binocular acquisition module to confirm that the current viewer has real human eyes (e.g., ...). Figure 1 (2) 3. The foreign object detection module monitors the area around the user's eyes to identify the presence of a camera device or metallic foreign object (such as...). Figure 1 (3) 4. Upon successful verification, successful liveness detection, and the absence of a recording device or metallic foreign object, a playback authorization request is sent to the cloud server to obtain decrypted data and initiate playback (e.g., ...). Figure 1 (4) 5. During playback, continuous binocular status monitoring, periorbital foreign object monitoring, and system integrity monitoring are performed. If any abnormality occurs in any of these stages, a hardware-level control mechanism, such as interrupting video content output, will be used (e.g., ...). Figure 1 5).

[0010] II. Anti-spy camera protection device for XR movie viewing An XR movie-watching anti-spy camera protection device based on binocular biometric recognition and multi-sensor fusion includes: - Binocular acquisition module, used to acquire data from the user's two eye areas and perform liveness detection; - Foreign object detection module, used to monitor the presence of imaging devices or metallic foreign objects in the area around the eyes; - System integrity verification module, used to verify whether the anti-spy camera protection system is complete; - Hardware-level control module for interrupting video content output in case of abnormalities; - Communication module, used to interact with the cloud server; - A processing module, located inside the XR head-mounted display device, is used to receive data from each module and trigger protection actions; the above modules cooperate with each other to implement the anti-spy camera protection method described above.

[0011] III. XR Movie Viewing Anti-Spycam Protection System An XR movie-watching anti-spy camera protection system based on binocular biometric recognition and multi-sensor fusion includes an XR head-mounted display device and a cloud server; the XR head-mounted display device has the above-mentioned device built-in and integrates a virtual cinema application module; the virtual cinema application module is inseparable from the anti-spy camera protection system and is bound to the device hardware. Beneficial effects

[0012] Compared with the prior art, the beneficial effects of the present invention are as follows: 1. This invention uses binocular liveness detection to accurately determine whether the viewing is done by a real human eye, eliminating bypass methods such as non-living media, monocular obstruction, and empty playback, thus ensuring the legality and validity of the viewing behavior from the source.

[0013] 2. This invention achieves periorbital area monitoring through a foreign object detection module, which can effectively identify pinhole cameras, shooting devices, and metallic foreign objects, eliminating the possibility of physically concealed hidden cameras from a hardware perspective.

[0014] 3. This invention performs a system integrity check before each playback to ensure that the anti-spy camera protection system has not been cracked, tampered with, or blocked. Combined with a hardware-level control mechanism, it achieves real-time response, and software cracking, flashing, blocking, and other methods cannot bypass the protection.

[0015] 4. This invention combines cloud-based device authentication, remote locking, and permission freezing mechanisms to form a complete copyright protection system that includes local hardware protection, hardware-level screen control, and unified cloud-based supervision. The security of this system meets the stringent requirements for theatrical releases and high-value digital content.

[0016] 5. The anti-spy camera protection system of the present invention is deeply integrated with the XR head-mounted display device, does not rely on third-party devices, is not authorized to external parties, and cannot be independently separated, thus possessing strong technological exclusivity. Attached Figure Description

[0017] Figure 1 is a flowchart illustrating the XR movie viewing anti-spy camera protection method of the present invention. Detailed Implementation

[0018] The technical solution, hardware structure, and implementation process of the present invention will be further described in detail below with reference to specific embodiments. It should be noted that this embodiment is only used to explain the present invention and does not constitute a limitation on the scope of protection of the present invention.

[0019] I. Method Implementation Examples This embodiment provides a method for preventing unauthorized filming during XR movie viewing based on binocular biometric recognition and multi-sensor fusion, applied to XR head-mounted display devices. The method includes the following steps: Before playing protected digital content, the system integrity check performs an integrity check on the anti-spy camera protection system inside the XR head-mounted display device. This check determines whether the anti-spy camera protection system has been modified, blocked, removed, or bypassed (as shown in Figure 1, 1). If the check fails, playback is refused and the user is prompted that the device is malfunctioning.

[0020] Binocular liveness detection A binocular acquisition module, preferably an infrared binocular acquisition module, is installed inside the XR head-mounted display device, corresponding to the area around the user's eyes. This module includes, but is not limited to, at least one infrared image sensor such as OV2735, IMX335, or GC2053. The module is installed in the non-display area inside the XR head-mounted display device, located around the lenses, on the nose pad, or at the edge of the frame, without obstructing the display light path. It acquires data from the user's two eyes and performs binocular biometric recognition and liveness detection based on the acquired information, confirming that the current viewer has real human eyes (as shown in Figure 1, point 2). If a non-living medium (such as a photograph, screen, or prosthetic model), monocular obstruction, or no wearing of the device is detected, the liveness detection is deemed unsuccessful.

[0021] Periocular foreign body detection A foreign object detection module is installed inside the XR head-mounted display device, near the eye area. It preferably uses an inductive sensor, a capacitive sensor, a metal proximity sensor, or an electromagnetic induction sensor. Typical models include, but are not limited to, at least one of A3144, CS108, and LDC1314. This module is distributed along the eye area inside the XR head-mounted display device to detect metal components, pinhole cameras, or external shooting devices in the eye area and to identify the presence of shooting devices or metal foreign objects (as shown in Figure 1, 3).

[0022] Playback authorization request When the system integrity check passes, the binocular liveness detection passes, and no filming device or metal foreign object is detected, a playback authorization request is sent to the cloud server. The cloud server verifies the device identity, device legitimacy, and playback permissions. After successful verification, it sends the content decryption data and allows the content playback to begin (as shown in Figure 1, 4).

[0023] Continuous monitoring during playback During content playback, continuous binocular status monitoring, periorbital foreign object monitoring, and system integrity monitoring are performed. Binocular status monitoring confirms that the user is viewing normally with their real eyes throughout the viewing process, preventing the insertion of hidden cameras midway; periorbital foreign object monitoring detects shooting devices that intrude into the periorbital area; and system integrity monitoring ensures that the anti-spy camera protection system remains tamper-proof at all times.

[0024] Abnormal response and protection actions When any of the above monitoring results are abnormal, a protection action is immediately executed through a hardware-level control module. This module directly controls the display driver, video channel, or decryption chip, without relying on software response, ensuring that protection actions are triggered quickly in case of an anomaly. The protection action includes interrupting the output of video content to prevent copyrighted content from being completely recorded.

[0025] Cloud reporting and remote processing When unauthorized filming, device tampering, or other violations are detected, information such as device identification and the time of the anomaly is uploaded to the cloud server. The processing module is located inside the XR head-mounted display device and can use main control chips such as ARM, RK3566, and Allwinner A40 to receive data from various modules and perform logical judgments. When an anomaly is detected, it directly triggers protection actions (such as...). Figure 1 5).

Claims

1. A method for preventing unauthorized filming during XR movie viewing based on binocular biometric recognition and multi-sensor fusion, characterized in that, For application in XR head-mounted display devices, the following steps are included: Perform an integrity check on the anti-spy camera protection system inside the device; The binocular acquisition module performs liveness detection on the user's eye area to confirm that the current viewer has real human eyes. The foreign object detection module monitors the area around the user's eyes to identify whether there is a camera device or a metallic foreign object. If the verification and liveness detection pass and no shooting device or metal foreign object is detected, a playback authorization request is sent to the cloud server to obtain the decrypted data and start playback. During playback, continuous binocular status monitoring, foreign object monitoring, and system integrity monitoring are performed. If any abnormality occurs in any of these aspects, the video content output will be interrupted through a hardware-level control mechanism. When it is determined that there is unauthorized filming, device tampering, or illegal operation, the abnormal information will be uploaded to the cloud server, and the cloud will lock the device or freeze permissions.

2. The method according to claim 1, characterized in that, The binocular acquisition module is installed inside the XR head-mounted display device, corresponding to the non-display area in front of the eyes, and uses at least one of an infrared acquisition unit, a visible light acquisition unit, or a depth acquisition unit.

3. The method according to claim 1, characterized in that, The foreign object detection module is installed inside the XR head-mounted display device, close to the area around the eyes where it fits, and uses at least one of an inductive sensor, a capacitive sensor, a metal proximity sensor, or an electromagnetic induction sensor.

4. The method according to claim 1, characterized in that, The integrity check is used to determine whether the anti-spy camera protection system has been modified, blocked, removed, or bypassed.

5. The method according to claim 1, characterized in that, The cloud server verifies the device's identity, device legitimacy, and playback permissions.

6. A device for preventing unauthorized filming during XR movie viewing based on binocular biometric recognition and multi-sensor fusion, characterized in that, include: The binocular acquisition module is used to acquire data from the user's two eye areas and perform liveness detection. The foreign object detection module is used to monitor the presence of imaging devices or metallic foreign objects in the area around the eyes; The system integrity verification module is used to verify whether the anti-spy camera protection system is complete. A hardware-level control module is used to interrupt video content output in case of abnormalities; The communication module is used to interact with the cloud server; The processing module, located inside the XR head-mounted display device, is used to receive data from various modules and trigger protection actions; The above modules work together to implement the method described in any one of claims 1 to 5.

7. The apparatus according to claim 6, characterized in that, The foreign object detection module is used to detect metal components, pinhole cameras, or external shooting devices in the periorbital area.

8. A hidden camera protection system for XR movie viewing based on binocular biometric recognition and multi-sensor fusion, characterized in that, It includes an XR head-mounted display device and a cloud server; the XR head-mounted display device has the device described in claim 6 or 7 built in, and integrates a virtual cinema application module; the virtual cinema application module is inseparable from the anti-spy camera protection system and is bound to the device hardware.

Images