Environment image correction

The virtual shroud system addresses the inefficiencies of conventional obscuration methods by using user-defined regions or object recognition to securely obscure sensitive areas in real-time video transmissions, ensuring only authorized individuals can view sensitive content.

JP2025536130AActive Publication Date: 2025-10-31BAE SYSTEMS PLC
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2025518280
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-09-28
Filing Date
2023-09-19
Publication Date
2025-10-31
Estimated Expiration
2043-09-19

AI Technical Summary

Technical Problem

Conventional methods for obscuring security-sensitive areas in video recordings are unreliable, inconvenient, and time-consuming, especially in remote work scenarios where unauthorized individuals may view sensitive hardware.

Method used

A virtual shroud system that allows real-time differentiation of obscured or blurred features in video transmissions using user-defined regions or object recognition, ensuring only authorized individuals can view sensitive content.

Benefits of technology

Enables secure, efficient, and cost-effective remote viewing of sensitive environments by obscuring unauthorized areas or objects in real-time, maintaining security and operational efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025536130000001_ABST
    Figure 2025536130000001_ABST
Patent Text Reader

Abstract

A computer-implemented method for modifying an image of an environment for storage or transmission comprises receiving user input (204, 404, 604, 608) defining at least one selected feature of or within the environment. An image of a portion of the environment is captured (212, 410, 614) using an image capture device. The method may identify (216, 414, 618, 622) at least one object and / or at least one region in the image based on the at least one selected feature, and modify (218, 416, 624) the image to include or exclude the at least one identified object and / or at least one identified region. The modified image may be stored or transmitted (220, 418, 420, 626, 628).
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to image processing, and in particular to modifying images of an environment for storage or transmission. [Background technology]

[0002] There is a growing trend to utilize remote work in the context of hardware maintenance and other tasks. This allows for the use of video calls and the like to access the knowledge of experts who may not be able to be physically present where the hardware is located. However, security measures in certain environments or locations where sensitive hardware is located may restrict the use of cameras / video recording devices to prevent unauthorized persons from viewing images of the hardware.

[0003] A known solution to this problem is to take physical measures to obscure security-sensitive areas / objects from being inadvertently captured on camera, for example, by moving the objects from the camera's expected line of sight, or by covering them with a sheet of material, or by some other method, but these conventional methods can be unreliable, inconvenient, and time-consuming.

[0004] SUMMARY OF THE INVENTION Embodiments of the present invention are intended to address at least some of the above technical problems.

[0005] Some embodiments may provide for the integration of a "virtual shroud" that allows camera / video device operators to operate in security-sensitive environments without having to take physical steps to obscure sensitive areas / objects. While camera / video device operators typically have security clearance to view material in the background of the environment, the individual(s) at the other end of the video call (or recipient(s) of the recorded video material) may not have security clearance. Thus, embodiments provide the operational time and cost advantages afforded by remote viewing, allowing for real-time differentiation of what is shown in the transmitted video, for example, by obscuring or blurring features or backgrounds to which security constraints apply. Embodiments may be broadly applicable across a range of product domains.

[0006] Embodiments may provide the camera / video device operator with the ability to present a specific object / environment to the recipient (via a video call or via a previously captured image / video), with the ability to obscure at least a portion of the surrounding environment in real time as the image is captured. A virtual shroud / box may be manually placed by the end user of the camera / video device in the environment before the call is made. Alternatively, the device may use object recognition to understand which object(s) can or cannot be remotely viewed / stored, and then, again, use a pixelated / blur filter to obscure the unrecognized object(s) / portions of the environment before long-term / non-volatile storing for subsequent and / or remote viewing or a video call. The camera / video device operator will still be able to see the environment they were working in without any visual obstruction(s), but the call recipient, captured image, or previously recorded footage will instead see a virtual shroud / box obscuring any content that is not intended to be viewed remotely or at a later time. Summary of the Invention

[0007] According to a first aspect of the present invention, there is provided a computer-implemented method for modifying an image of an environment for storage or transmission, the method comprising: receiving a user input defining at least one selected feature of or within the environment; capturing an image of a portion of an environment using an image capture device; identifying at least one object and / or at least one region in the image based on the at least one selected feature; Modifying the image to include or exclude at least one identified object and / or at least one identified region; storing or transmitting the modified images; Equipped with.

[0008] The selected features may comprise a user-defined region within the environment, and user input may define the boundaries of the user-defined region.

[0009] The step of correcting the image comprises: determining whether the image includes at least a portion of at least one of the boundaries; adding a graphical component, such as a holographic wall, to at least a portion of at least one of the boundaries for the image to obscure features located beyond the boundary (relative to the viewpoint of the image capture device); It may comprise:

[0010] The method is: determining whether the device that captured the image was located within the user-defined region when the image was captured; If the device is not located within a user-defined region, modifying the image to obscure captured features, for example, replacing the image with a blank / plain frame; The device may further include:

[0011] The selected features may comprise an object in the environment selected as the recognized object. The method may comprise accessing data representing a digital twin of the recognized object, the data including data regarding a plurality of components of the recognized object. The data regarding the plurality of components may indicate whether each of the plurality of components is constrained. The digital twin data may be updated, for example, each time a sensor (which may include an image capture device) detects (typically in substantially real time) that one of the plurality of components has been added to or removed from the recognized object.

[0012] The method is: checking (e.g., using digital twin data) whether the image contains one or more of the components of the restricted recognized object; modifying the image to obscure one or more restricted components, e.g., by replacing them with a blank / solid color or blur; The device may further include:

[0013] The method is: obscuring any further region(s) of the image that do not contain the recognized object; The device may further include:

[0014] The method may include streaming the modified image to a second device, for example, using a communications interface or over a video call link. The transmitted modified image may be encrypted and / or compressed.

[0015] The environment may comprise a secure environment containing sensitive hardware, such as a land, water, or air vehicle.

[0016] According to another aspect of the present invention, there is provided an apparatus configured to modify an image of an environment for storage or transmission, the apparatus comprising: an image capture device; a processor; and the processor receiving a user input defining at least one selected feature of or within the environment; capturing an image of a portion of an environment using an image capture device; identifying at least one object and / or at least one region in the image based on the at least one selected feature; Modifying the image to include or exclude at least one identified object and / or at least one identified region; storing or transmitting the modified images; The device is configured to:

[0017] The device may comprise or be located in / on (or may communicate with) a virtual reality or augmented reality headset.

[0018] According to another aspect of the present invention, a first device comprising a device substantially as defined herein; a second device comprising a processor, a communications interface, and a display; A system is provided comprising:

[0019] According to another aspect, there is provided a computer program product comprising instructions which, when executed by a computer, cause the computer to carry out a method substantially as described herein. [Brief explanation of the drawings]

[0020] For a better understanding of the present invention, and to show how embodiments thereof may be carried into effect, reference will now be made, by way of example, to the accompanying schematic drawings in which: FIG. [Figure 1] FIG. 1 is a block diagram of an exemplary system including a transmitting device and a receiving device. [Figure 2]FIG. 2 is a flowchart illustrating exemplary steps performed by the first embodiment. [Figure 3A] FIG. 3A is a plan view of an exemplary environment including a user-defined region processed by a first embodiment. [Figure 3B] FIG. 3B is a partial perspective view of the environment of FIG. 3A. [Figure 4] FIG. 4 is a flow chart illustrating exemplary steps performed by the second embodiment. [Figure 5] FIG. 5 is an example of an image that can be transmitted by the second embodiment. [Figure 6] FIG. 6 is a flowchart illustrating exemplary steps performed by the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0021] 1 is a block diagram of an exemplary system 100. The exemplary system includes a transmitting device 102A and a receiver device 102B. For simplicity, only one transmitting device and one receiver device are shown in the figure, but it will be understood that in alternative embodiments, more than one of either or both devices may be used.

[0022] Generally, the transmitting device 102A comprises a computing device including or associated with at least one processor 104A and an internal memory 106A, such as, for example, a random access memory. The internal memory can store data and instructions for processing by the processor(s). The device can further comprise or be associated with an interface 108A that enables communication with other devices, for example, via any suitable wired / wireless interface and / or communication network. The device can also include or be associated with further conventional features such as a display, non-volatile storage device(s), user interface, etc., which need not be described in detail herein.

[0023] Transmitting device 102A may further include or communicate with image capture device 110A, which may include, for example, a still image or video camera. In some embodiments, the transmitting device includes a virtual reality or augmented reality headset, such as a Microsoft HoloLens 2®. Such a headset includes sensors, such as an accelerometer, for determining a user's location / movement, as well as at least one image capture device. In alternative embodiments, the transmitting device may include VR glasses, or a mobile computing device, such as a smartphone or tablet computer, that include sensors and one or more image capture devices that can be used in VR / AR.

[0024] The receiver device 102B also comprises a computing device that includes or has associated therewith at least one processor 104B and internal memory 106B, as well as a communication interface 108B. Again, the receiver device may include or be associated with further conventional features such as a display, non-volatile storage device(s), a user interface, etc. In some embodiments, the receiver device may comprise a desktop or laptop computer, or may comprise a mobile computing device such as a smartphone or tablet computer.

[0025] In a typical use case, a user of the transmitting device 102A is located in an environment that includes at least one object, e.g., technical equipment, that will be remotely viewed by a user of the receiver device 102B. The environment may also include at least one feature that should not be included in the transmitted image. This may be for various reasons, such as privacy, commercial security, or military security. The at least one feature may comprise at least one area of ​​the environment and / or at least one other object (or portion(s) thereof) within the environment. For example, the restricted object may include any object other than the equipment(s) that is the subject of discussion between the users of the devices.

[0026] In a detailed embodiment described below, a user of the receiver device 102B can view images captured and modified by the transmitting device 102A in substantially real time during communication between the devices, e.g., via a video call, etc. Alternatively or additionally, in other embodiments, a user of the transmitting device can capture and modify images and store them for subsequent transfer to the receiver device in non-real time, it being understood that, for example, data containing the modified images (possibly encrypted and / or compressed) is transferred to the receiver device by file transfer using a removable storage device, secure email, etc. The user of the receiver device can then view them using a gallery or video player application, etc.

[0027] Embodiments provide instructions for execution by transmitting device 102A to modify a captured image to exclude excluded / disallowed feature(s) prior to transmission and / or storage for future remote viewing. Generally speaking, embodiments may accomplish this by receiving user input defining at least one selected feature of or within an environment, capturing an image of a portion of the environment using an image capture device, identifying at least one object and / or at least one region within the image based on the at least one selected feature, modifying the image to include or exclude the at least one identified object and / or at least one identified region, and storing or transmitting the modified image.

[0028] 2 is a flowchart illustrating the steps performed by a first exemplary embodiment, which can place a "virtual box" around selected features / subjects in the environment such that the output / transmitted image / video has a box overlaid on the final transmitted image / footage to obscure unauthorized features.

[0029] The process begins in step 202. This may involve a user of the sending device 102A executing a secure communication application according to one embodiment, or a video calling application that cooperates with an application according to one embodiment.

[0030] In step 204, the application receives user input defining the boundaries of at least one selected region of the environment.

[0031] Referring to FIG. 3A , a plan view of an exemplary environment 300 is shown, comprising an object 302 that is the subject of secure communication between a user of a transmitting device 102A and a user of a receiver device 102B. Embodiments can modify the image to obscure features in the environmental background relative to the object, thereby effectively removing those features from the transmitted / stored image. The terms “environment” and “object” should be interpreted broadly. For example, the environment may comprise any indoor or outdoor space, and in the illustrated example, the object comprises an aircraft 302. However, it will be understood that these are merely examples, and many variations are possible; for example, the object may comprise one or more pieces of any technical equipment / hardware, etc. A transmitting device 102A worn / held by a user is also shown in proximity to the aircraft.

[0032] As described in more detail below, embodiments of the application executed by transmitting device 102A allow a user to define a selected region 303 of environment 300 by selecting coordinates that define the boundaries of the region. In some embodiments, the coordinates are selected by the user placing markers in the environment that represent three-dimensional coordinates, such as the holographic markers provided by Microsoft HoloLens 2™. In such embodiments, the markers are 3D holograms visualized by HoloLens™. ​​The holographic markers are placed by the user grasping and moving them using the HoloLens™ hand tracking system. HoloLens can spatially track the position of the markers relative to itself.

[0033] Returning to Figure 2, in step 206, an embodiment may check whether the minimum number of markers required to define the selected region has been placed by the user. In this example, the minimum number is four, which may define a quadrilateral boundary, as shown by the four walls 304A-304D in Figure 3A. However, it will be appreciated that alternative minimum numbers may be used to allow the selected region to have different (e.g., closed or non-closed) shapes.

[0034] In an exemplary embodiment, the boundary defines a selected region 303 or "box" within the environment 300. Any features within the selected region, e.g., a part of the environment or an object, may be included in the transmitted image, while the region outside the boundary is considered an excluded / not allowed region 305. Any features within the excluded / not allowed region 305 should not be included in the modified image transmitted (and / or stored for future use). In alternative embodiments, the user selection of the selected region may be different. For example, the interior of the boundary may define an excluded region rather than an allowed region. Additionally, the user definition may indicate features to be excluded from the transmitted image in an indirect way (e.g., by selecting only allowed features).

[0035] If the minimum number of markers has been set by the user, control passes to step 208, where embodiments create a "holographic wall" between each of the markers. This can be done on devices that have the ability to import 3D objects into their display, such as the Microsoft HoloLens 2™. For example, the location where the holographic wall is located relative to the camera view is rendered as a solid color or blurred on the video feed. This can be done because the HoloLens 2™ knows spatially where it is relative to the holographic wall.

[0036] The holographic wall may create a quadrilateral selected area defined by a first wall 304A between a first marker 306A and a second marker 306B, a second wall 304B between the second marker 306B and a third marker 306C, a third wall 304C between the third marker 306C and a fourth marker 306D, and a fourth wall 304D between the fourth marker and the first marker. At least a portion of all / some of the holographic walls are included in a modified image generated by an embodiment to obscure features of the environment 300 outside the selected area 303.

[0037] 3B shows how holographic walls 304A-304C can obscure features in a background region 305 of an environment while a user of transmitting device 102A is capturing an image of aircraft 302 within a selected region 303. An additional holographic wall 304D (located behind the field of view of the transmitting device) is not shown for clarity.

[0038] In step 210, a user of the sending device 102A initiates communication with the receiver device 102B. This may involve a secure communication application and / or a video calling application creating a video stream from the sending device to the receiver device, configured with appropriate applications / software for communication. The video stream may be encrypted and / or compressed using any suitable techniques available to the sending and receiver devices. For example, the video call may be set up using Transport Layer Security (TLS), and then image media is transferred via Secure Real-time Transport Protocol (SRTP).

[0039] In step 212, a check is performed to see if a video stream is in progress, e.g., whether the user of one of devices 102A, 102B has ended the call. If a stream is not in progress, operation ends in step 214; otherwise, control passes to step 216.

[0040] In step 216, an embodiment may check whether the transmitting device 102A is located within the selected region 303. This may be done using the device's sensor components that enable it to spatially recognize its environment. For example, in an embodiment using HoloLens 2®, the device's inside-out tracking capability may determine its location in space. If the device is not within the selected region, this means that images captured by the device may include unauthorized features of the environment that should be filtered out from the transmitted image. Therefore, control passes to step 217, where a blank frame is output to the video stream in place of the captured image. In alternative embodiments, different methods of obscuring the unauthorized features may be used, such as blurring or superimposing other graphical elements.

[0041] On the other hand, if the check in step 216 indicates that the transmitting device 102A is located within the selected region 303, which means that at least some features in the image captured by the device can be transmitted, control passes to step 218. In step 218, an image is captured, including the features that are permitted to be included for transmission. In step 220, the image is modified to render some or all of the appropriate holographic wall(s) 304A-304D in relation to the camera view before transmission. The image is then transmitted to the receiver device 102B, and control can loop back to step 212.

[0042] 4 is a flowchart illustrating steps performed by a second exemplary embodiment, which can recognize specific object(s) through the transmitting device's 102A built-in camera and object recognition capabilities, and can use pixilation / blurring / color filters, etc. to obscure other unrecognized objects / features around the object(s).

[0043] The process begins in step 402. Again, this may involve a user of the sending device 102A executing a video calling application that cooperates with a secure communication application according to one embodiment, or a separate application according to one embodiment.

[0044] In step 404, a user of transmitting device 102A selects an object in the environment. In this detailed embodiment, the selected object will be included in the image transmitted by the device, although in alternative embodiments, the selected object(s) may instead be intended to be excluded. The user can do this by moving the device toward the object (such as aircraft 302 in FIG. 3A) and providing user input, such as a gesture or icon selection, to indicate that they are selecting the object.

[0045] In step 406, the application recognizes the location and orientation of the selected object. In some embodiments, this can be done by performing image analysis on the camera feed to see if the selected object is in frame and what its orientation is. Alternatively, a QR code on the object or the like can be used. As another alternative, the user can align a hologram of the object with the real-world object itself.

[0046] An application can reference data representing the recognized object's digital twin, allowing it to know whether a captured image comprises a restricted portion of the object. For example, the object recognition capabilities of transmitting device 102A can recognize that a panel of the object has been removed, i.e., component A (restricted) is now visible. Actions taken on the aircraft, such as the removal of a panel, are recorded in a database. This can be done automatically (e.g., using image recognition or sensors that detect that a component with an RFID tag, etc., has been removed) or can be updated manually. Thus, the database essentially records all components that are and are not on the aircraft / object at a given moment. The database can form part of the digital twin data. Another part of the digital twin is a 3D representation of the aircraft / object showing the location of the components on the aircraft and whether they are restricted. In this way, the application can consume the information and determine whether the restricted components are still on the aircraft and within the camera's FOV.

[0047] Steps 404 and 406 may be repeated if more than one object is selected.

[0048] In step 408, a user of the sending device 102A initiates communication with the receiver device 102B, which may involve a secure communication application and / or a video calling application creating a video stream from the sending device to the receiver device.

[0049] In step 410, a check is performed as to whether a video stream is in progress, e.g., whether the user of one of devices 102A, 102B has ended a call. If a stream is not in progress, operation ends in step 412; otherwise, control passes to step 414.

[0050] In step 414, embodiments may check whether the image captured by the transmitting device 102A includes one or more components of a restricted recognized object, for example, using a digital twin database. If so, control passes to step 416, where any portion of the image including the restricted component of the recognized object is modified to be obscured, for example, replaced with a blank or blurred color. After step 414 or 416, control passes to step 418, where the image is prepared for transmission to the receiver device 102B. Any portion(s) of the image including the restricted component(s) of the recognized object(s) are modified in step 416 to obscure the restricted matter, while any portion(s) of the image including only the unrestricted component(s) of the recognized object(s) are not obscured.

[0051] In step 420, the image may be further modified such that any areas thereof that do not contain the recognized object(s) are obscured, e.g., replaced by a blank / solid color or blurred. For example, in embodiments using HoloLens®, the device knows where it is spatially relative to recognized objects, and therefore any features captured by the camera that are not objects may be rendered as solid colors, blurred, etc.

[0052] The image is transmitted to receiver device 102B and control may then loop back to step 410.

[0053] Figure 5 is an example of an image modified and transmitted by the embodiment of Figure 4. The recognized object comprises all or part of a selected object, e.g., aircraft 302, captured by transmitting device 102A. The figure shows a video feed from the perspective of the user of the transmitting device / headset, with the recognized object 302 shown in white. Any portion of the video that does not comprise the recognized object(s) has pixilation / blur / color filter applied (in the example, solid black 502). In this case, the headset can recognize the selected object(s) and render only the portions of the image that comprise the selected object(s).

[0054] 6 is a flowchart illustrating steps performed by a third exemplary embodiment that combines techniques from the first and second embodiments, at least some of the steps being substantially identical to those disclosed above. The application executed by transmitting device 102A may allow a user to select any of the first through third embodiments, or may include only one of them.

[0055] The process begins in step 602. Again, this may involve a user of the sending device 102A executing a video calling application that cooperates with a secure communication application according to one embodiment, or a separate application according to one embodiment.

[0056] In step 604, the user of the transmitting device 102A selects one or more objects to be included in the image transmitted by the device. The user can do so by moving toward the object and providing user input, such as a gesture or icon selection, to indicate that the object is being selected. In step 606, the application recognizes the object's location and orientation. Steps 604 and 606 may be repeated if more than one object is selected.

[0057] In step 608, the application receives user input defining the boundaries of at least one selected region within the environment. In step 610, the embodiment may check whether the minimum number of markers required to define an excluded region has been placed by the user. If the minimum number of markers has been set by the user, control passes to step 612.

[0058] In step 612, a user of the sending device 102A initiates communication with the receiver device 102B, which may involve a secure communication application and / or a video calling application creating a video stream from the sending device to the receiver device.

[0059] In step 614, a check is performed as to whether a video stream is in progress, e.g., whether the user of one of the devices has ended a call. If a stream is not in progress, operation ends in step 616; otherwise, control passes to step 618.

[0060] In step 618, an embodiment may check whether the transmitting device 102A is located within a selected region. This may be done using the device's sensor component. If the device is not within the selected region, this means that an image captured by the device may have features that should be excluded, and therefore control passes to step 620, where a blank frame is output to the video stream in place of the captured image. On the other hand, if the device is located within the selected region, this means that a feature in the image captured by the device is allowed for transmission, and control passes to step 622.

[0061] In step 622, embodiments may check whether the image captured by the transmitting device 102A includes one or more components of a restricted recognized object. If so, control passes to step 624, where any portion of the image including restricted components of the recognized object is modified to be obscured / excluded, for example, replaced with a blank / solid color or blurred. After step 622 or 624, control passes to step 626, where the image is prepared for transmission to the receiver device 102B. Any portion(s) of the image including restricted component(s) of the recognized object(s) are modified in step 624 to obscure the restricted matter, while any portion(s) of the image including only unrestricted component(s) of the recognized object(s) are not obscured.

[0062] In step 628, the image may be further modified so that any areas thereof that do not contain the recognized object(s) are obscured, e.g., replaced with a blank / solid color or blurred. The image is transmitted to the receiver device 102B, and control may then loop back to step 614.

[0063] Those skilled in the art will understand that the component embodiments described herein may be implemented using any suitable software application, programming language, data editor, etc., and may be represented / stored / processed using any suitable data structures, etc. It will also be understood that steps described herein as part of the detailed embodiments may be reordered, omitted, and / or repeated. Additional steps may also be performed. Some steps may be performed simultaneously rather than sequentially.

[0064] Attention is directed to all articles and documents related to this application that are filed contemporaneously or prior to this specification and that are open to public inspection together with this specification, and the contents of all such articles and documents are incorporated herein by reference.

[0065] All of the features disclosed in this specification (including the accompanying claims, abstract and drawings), and / or all of the steps of any method or process so disclosed, may be combined in any combination, except combinations in which at least some of such features and / or steps are mutually exclusive.

[0066] Each feature disclosed in this specification (including the accompanying claims, abstract, and drawings), unless expressly stated otherwise, may be replaced by alternative features serving the same, equivalent, or similar purpose. Thus, unless expressly stated otherwise, each feature disclosed is only an example of a generic series of equivalent or similar features.

[0067] The invention is not limited to the details of the foregoing embodiment(s). The invention extends to any novel, or any novel combination of, features disclosed in this specification (including the accompanying claims, abstract and drawings), or any novel, or any novel combination of steps of any method or process so disclosed.

Claims

1. 1. A computer-implemented method for modifying an image of an environment for storage or transmission, comprising: Receiving user input (204, 404, 604, 608) defining at least one selected feature of or within the environment; capturing an image of a portion of the environment using an image capture device (212, 410, 614); Identifying (216, 414, 618, 622) at least one object and / or at least one region in the image based on the at least one selected feature; Modifying (218, 416, 624) the image to include or exclude the at least one identified object and / or the at least one identified region; storing or transmitting the modified image (220, 418, 420, 626, 628); A method comprising:

2. The method of claim 1 , wherein the selected feature comprises a user-defined region within the environment.

3. The user input defines a boundary of the user-defined region, and modifying the image includes: determining (216, 622) whether the image includes at least a portion of at least one of the boundaries; adding (220, 628) a graphical component, such as a holographic wall, to at least a portion of at least one of the boundaries for the image to obscure features located beyond the boundary relative to a viewpoint of the image capture device; The method of claim 2 , comprising:

4. determining whether the image capture device was located within the user-defined area when the image was captured (316, 618); modifying (217, 620) the image to obscure captured features if the device is not located within the user-defined region; The method of claim 1 , further comprising:

5. The method of claim 4 , wherein modifying (217, 620) the image to obscure the captured features comprises replacing the captured image with a blank image.

6. The selected features comprise an object in the environment that has been selected (404, 604) by a user as a recognized object, and the method further comprises: accessing data representing a digital twin of the recognized object that includes data regarding a plurality of components of the recognized object, the data regarding the plurality of components indicating whether each of the plurality of components is restricted; The method of claim 1 , further comprising:

7. The digital twin data is updated each time one of the plurality of components is added to or removed from the recognized object, and the method includes: Using the digital twin data, checking whether the image includes one or more of the components of the recognized object that are constrained (414, 622); Modifying the image to obscure the one or more restricted components (416, 624); The method of claim 6 further comprising:

8. obscuring (420) any further region(s) of the image that do not contain the recognized object; The method of claim 7 further comprising:

9. 9. The method of any one of claims 1 to 8, comprising transmitting (220, 418, 420, 626, 628) the modified image to a second device as streamed video or via a video call.

10. The method of claim 9 , wherein the transmitted modified image is encrypted and / or compressed.

11. The method of any one of claims 1 to 10, wherein the environment comprises a secure environment containing hardware including a land, water, or air vehicle.

12. A computer program product comprising instructions which, when the program is executed by a computer, cause the computer to perform the method of any one of claims 1 to 11.

13. 1. A device (102A) configured to modify an image of an environment for storage or transmission, comprising: an image capture device (110A); a communication interface (108B); A processor (102A); wherein the processor: receiving a user input defining at least one selected feature of or within the environment; capturing an image of a portion of the environment using the image capture device; identifying at least one object and / or at least one region in the image based on the at least one selected feature; modifying the image to include or exclude the at least one identified object and / or the at least one identified region; storing or transmitting the modified image; An apparatus (102A) configured to perform the following.

14. The device of claim 12 , wherein the device (102A) comprises a virtual reality or augmented reality headset.

15. 1. A system comprising: A first device (102A) according to claim 13 or 14, a second device (102B) comprising a processor (104B), a communications interface (108B), and a display, the second device configured to receive and display the modified image from the first device; A system comprising:

Citation Information

Patent Citations

  • Video system

    JP2016122892A

  • System and method for remotely supporting it operation work

    JP2018036812A

  • Maintenance assistance system, maintenance assistance method, program, method for generating processed image, and processed image

    WO2020196276A1