Methods and devices for protecting sensitive data

Abstract

A method for protecting sensitive data is disclosed. The method is performed in an extended reality, XR, device comprising at least one camera and a receiver unit. The method comprises receiving, in the receiver unit, information from a sensor device. The information indicates that the at least one camera of the XR device is at risk of capturing sensitive data, and the XR device takes, in response to the indication, at least one action for preventing the capturing. A corresponding XR device, a method in a sensor device and a sensor device, computer programs and computer program products are also disclosed.

Description

[0001] METHODS AND DEVICES FOR PROTECTING SENSITIVE DATA

[0002] Technical field

[0003] The technology disclosed herein relates generally to the field of security, and in particular to methods, devices, computer programs and computer program products for ensuring protection of sensitive data when using a device for extended reality comprising a camera.

[0004] Background

[0005] In an Extended Reality (XR) environment a user views an area around him through XR equipment, such as for instance, Augmented Reality (AR) glasses. The user moves around in the XR environment, e.g., his home environment, and experiences the surroundings as an interactive version thereof through digital visual elements, sounds and possibly also other sensory stimuli of the AR glasses.

[0006] The AR glasses comprise a camera for collecting data on the surroundings and the XR environment is created based on a multitiered client / server architecture. A connection to a remote server or other device that is out of the users’ control is therefore often required. The combination of a camera capturing the home environment and an external device receiving the captured images or film may pose a security risk for the user.

[0007] Summary

[0008] An objective of the present disclosure is to address and improve secrecy of sensitive data of a user while using XR equipment. A particular objective is to ensure that no sensitive data is made available for unauthorized persons or devices. Another particular objective is to ensure secrecy of such sensitive data in a user-friendly way, wherein no input or even awareness is necessarily required from the user. These objectives and others are achieved by the methods, devices, system, computer programs and computer program products according to the appended independent claims, and by the embodiments according to the dependent claims.

[0009] These objectives are, according to a first aspect, achieved by a method for protecting sensitive data. The method is performed in an extended reality, XR, device which comprises at least one camera. The method comprises receiving information on a detected secret device from a sensor device enabled for wireless signaling. The wireless signaling between the XR device, and the sensor device may, for instance, be one of Bluetooth, Wi-Fi or 3GPP sidelink. The method comprises performing, in response to the received information: turning off the at least one camera for the case that the information comprises an instruction to disable one or more cameras, or determining in the XR device, based on the received information, whether or not the at least one camera should be disabled to prevent sensitive data from being captured and acting according to determination.

[0010] These objectives are, according to a second aspect, achieved by an XR device for protecting sensitive data in an extended reality environment. The XR device comprises at least one camera. The XR device is configured to receive information on a detected secret device from a sensor device, and to perform, in response to the received information, one of: turn off the at least one camera for the case that the information comprises an instruction to disable one or more cameras, and determine, based on the received information, whether or not the at least one camera should be disabled to prevent sensitive data from being captured and to act according to determination.

[0011] These objectives are, according to a third aspect, achieved by a method for protecting sensitive data. The method is performed in a sensor device enabled for wireless communication such as, for instance, Near Field Communication. The method comprises probing for secret devices, and upon detecting such secret device performing one of: transmitting a command to an XR device to turn off at least one camera thereof, the at least one camera being at risk of capturing sensitive data of the detected secret device; and transmitting an identification of the detected secret device to the XR device enabling the XR device to determine whether or not to turn off the at least one camera.

[0012] These objectives are, according to a fourth aspect, achieved by a sensor device for protecting sensitive data. The sensor device is enabled for wireless communication and configured to probe for secret devices. Upon detecting such secret device, the sensor device is configured to perform one of: transmit a command to an XR device to turn off at least one camera thereof, the at least one camera being at risk of capturing sensitive data of the detected secret device; and transmit an identification of the detected secret device to the XR device enabling the XR device to determine whether or not to turn off the at least one camera.

[0013] These objectives are, according to a fifth aspect, achieved by a computer program for an extended reality, XR, device. The computer program comprises computer program code, which, when run on processing circuitry in the extended reality, XR, device causes the XR device to perform the method according to the first aspect.

[0014] These objectives are, according to a sixth aspect, achieved by a computer program product comprising a computer program according to the fifth aspect and a computer readable means on which the computer program is stored.

[0015] These objectives are, according to a seventh aspect, achieved by a computer program for a sensor device. The computer program comprises computer program code, which, when run on processing circuitry in the sensor device causes the sensor device to perform the method according to the third aspect.

[0016] These objectives are, according to an eighth aspect, achieved by a computer program product comprising a computer program according to the seventh aspect and a computer readable means on which the computer program is stored.

[0017] These aspects provide a number of advantages. For instance, these aspects ensure that an XR device does not unintentionally capture sensitive or secret data, such as credit card information or door look codes. This alleviates the need for the user of the XR device, occupied with and moving in an extended reality environment, to be alert of such sensitive data and ready to act to prevent it from being recorded by the camera. These various aspects are advantageous also in various other situations, for instance, when entering door-lock passcodes to access home or office, or to disable alarm systems, in secret display sessions on laptops, desktops, smartphones or similar in order to preserve privacy in private or confidential situations, e.g., when typing passwords, reading, or writing confidential or private emails, reading or writing documents that are tagged as strictly confidential, or typing in payment information.

[0018] Further objectives, features, and advantages of the embodiments of the present teachings will become clear upon reading the following description and claims, as well as the accompanying drawings. Brief description of the drawings

[0019] The inventive concept is now described, by way of example, with reference to the accompanying drawings, in which:

[0020] Fig. 1 is a schematic illustration of a system implementing various embodiments.

[0021] Fig. 2 is a flowchart of a method in a sensor device according to embodiments.

[0022] Fig. 3 is a flowchart of a method in an XR device according to various embodiments.

[0023] Fig. 4 is a schematic diagram showing functional units of an XR device according to an embodiment.

[0024] Fig. 5 is a schematic diagram showing functional modules of an XR device according to an embodiment.

[0025] Fig. 6 shows one example of a computer program product comprising computer readable storage medium according to an embodiment.

[0026] Fig. 7 is a flowchart of a method in a sensor device according to embodiments.

[0027] Fig. 8 is a schematic diagram showing functional units of a sensor device according to an embodiment.

[0028] Fig. 9 is a schematic diagram showing functional modules of a sensor device according to an embodiment.

[0029] Fig. io shows one example of a computer program product comprising computer readable storage medium according to an embodiment.

[0030] Detailed description

[0031] In the following description, for purposes of explanation and not limitation, specific details are set forth such as particular architectures, interfaces, techniques, etc. in order to provide a thorough understanding. In other instances, detailed descriptions of well-known devices, circuits, and methods are omitted so as not to obscure the description with unnecessary detail. Same reference numerals refer to same or similar elements throughout the description. FIG. 1 is a schematic illustration of a system 1 implementing various embodiments according to the present teachings. Devices and methods are provided, in various embodiments, for ensuring that a user does not accidentally reveal secrets when wearing an XR device, in the following exemplified by Augmented Reality (AR) glasses 3. The illustrated system 1 comprises such AR glasses 3 and a sensor device 6, which are enabled for wireless communication with each other. The AR glasses 3 comprises a receiver unit 5, which in turn comprises means for implementing any type of short range and / or medium range wireless communication or signalling, such as, for instance, Bluetooth, Wi-Fi, or 3GPP sidelink. The receiver unit 5 may, for instance, comprise a Bluetooth communication protocol, and the AR glasses 3 are thereby provided with means for an exemplary short-range communication.

[0032] The sensor device 6 comprises the same short-range communication technology as the receiver unit 5, e.g., a Bluetooth transmitter and Bluetooth receiver, enabling the sensor device 6 to communicate with the AR glasses 3. The sensor device 6 also comprises, for instance, an NFC receiver and NFC transmitter. NFC devices operate at the same frequency (13.56 MHz) as HF RFID readers and tags. The standards and protocols of the NFC format are based on RFID standards outlined in ISO / IEC 14443, FeliCa, and the basis for parts of ISO / IEC 18092. These standards define the use of RFID in proximity cards. The various embodiments herein may use any such protocol. The sensor device 6 may be arranged in a wearable device, such as, for instance, a ring or a wristwatch that the user wears. It is noted that Bluetooth and NFC are used herein as exemplary technologies and may be replaced with any other communication protocols.

[0033] The AR glasses 3 comprises at least one camera 4, and typically several cameras, pointing in different directions and thereby enabling an improved XR experience. An AR application may receive data from the camera(s) 4 and interpret the real world based on the received data. A user wears the AR glasses 3 and the one or more outwards facing cameras 4 register the environment. In the environment there might be devices that could potentially reveal sensitive information. Such devices may, for example, be a keypad for a door lock or a credit card. When the user is close to such devices, there is a risk that any of the outwards pointing cameras 4 of the AR glasses 3 records the code for the door or the numbers of the credit card. To experience the augmented reality, the AR glasses 3 may need to be connected to an external device 9, e.g., a cloud entity or any device that receives images from the AR glasses 3. For instance, the user may interact with others in an ongoing call; the AR glasses 3 may perform Simultaneous Localization and Mapping (SLAM) services based on networkbased services in order to properly place virtual objects; the AR glasses 3 may perform object detection using a cloud service to identify whether there is any information about the objects that the user should be aware of; the AR glasses 3 may receive ad services, e.g., via Facebook, that use SLAM map or camera-based input to provide ads to the user. There are various other such situations, and all such data exchange may pose a security risk, in that the data that is captured by the camera 4 might be used for malicious ends, or that a hacker gets in control of the video stream, or even computed features from a video stream, and exploit the private data. The present teachings provide efficient means and methods for preventing this.

[0034] The environment in which the user moves may, for instance, be his home environment. There are certain situations when the user might be asked to type in a password on a computer or read a document which is strictly confidential. In current state-of-the-art, the display never shows the typed password in clear text (the textbox is context dependent), which is typically the situation for computers as well as smartphones. However, if the user is wearing AR glasses, the camera(s) might capture the password while it is being typed in. The user may thus enter passwords or operate various devices, such as a computer, computer keyboard or mouse, a laptop, desktop, smartphone, digital door lock, credit card, browsing on pages with sensitive content, such as personal financial information, handling physical credit cards etc., all of which may show sensitive information that is visible and might be recorded by the camera 4. These exemplary devices are provided with one or multiple sensors (placed thereon, therein or otherwise provided e.g., fastenable or built-in sensors), as illustrated in figure 1 at reference numerals 7a, 7b. Each of the sensors 7a, 7b, comprises an NFC transmitter and receiver 2a, 2b, which hereinafter are denoted NFC circuit 2a, 2b. The NFC circuits 2a, 2b may be passive (such as is the case with credit cards) or active. If the sensor 7a, 7b, comprising the NFC circuitry, is active, it has its own power source. This enables it to broadcast with a read range up to 20 cm, and in many use cases less than this is sufficient. If the sensor 7a, 7b instead is passive, it may be powered by electromagnetic energy transmitted from the sensor device 6, and the read range might reach up to 25 meters. The sensor 7a, 7b may be placed on any device that the user wants to keep secret, and which therefore should not be captured by cameras of the XR device. A device comprising the sensor 7a, 7b and being in risk of revealing a secret is hereinafter denoted secret device 8a, 8b.

[0035] Modern digital door locks and credit cards are already provided with such Bluetooth or NFC circuitry. The sensors 7a, 7b comprising the NFC circuits 2a, 2b are hence known as such, and may, for instance, comprise a power unit, a decision-making unit and signal transceiver. The signal conveyance is, according to the present teachings, executed by means of the NFC circuit 2a, 2b.

[0036] The sensor device 6 is, as described earlier, in communication with the AR glasses 3, and in particular with the receiver unit 5 thereof. The sensor device 6 may, as exemplified earlier, be arranged in a ring or wristwatch that the user wears and is able to detect the NFC circuits 2a, 2b placed (or already installed) in the user’s secret devices 8a, 8b. When the AR glasses are in an active state, and the camera(s) 4 thus enabled to record the surroundings, the sensor device 6 may sample its environment continuously or intermittently to detect other NFC devices, and in particular to detect the secret devices 8a, 8b, which are provided with NFC circuits 2a, 2b.

[0037] When the sensor device 6 detects one of the secret devices 8a, 8b, the sensor device 6 signals this to the receiver unit 5 of the AR glasses 3, upon which action may be taken. The communication protocol between the sensor device 6 and the AR glasses 3 may be different than the communication protocol between the sensor device 6 and the secret devices 8a, 8b. In the following the communication between the sensor device 6 and the AR glasses are exemplified by Bluetooth, while the communication between the sensor device 6 and the secret devices 8a, 8b is exemplified by NFC.

[0038] The signalling transmitted to the receiver unit 5 of the AR glasses 3 comprises information based on which the receiver unit 5, or processing circuitry thereof, can determine or assess whether there is any risk of any camera 4 recording and thus revealing any secrets, such as e.g., a code to a safety box. The action may, for instance, be that the AR glasses 3 shuts the camera(s) 4 off and / or that the user is informed on the risk of secret devices 8a, 8b being captured by the camera(s) 4, thereby providing at least awareness to the user on the security risks. Further exemplary action may be to warn the user, turn off (relevant) camera(s), giving a warning when requesting a certain action. The action may be dependent on settings and state of the AR glasses 3. For instance, the resolution of the camera(s) 4 may be reduced or blurred to eliminate risk of revealing e.g., numbers of a code. The AR glasses 3 may be configured to warn the user and then automatically turn off the camera(s) 4.

[0039] An NFC antenna is basically a coil of wire, and this coil requires some space. There are several ways to integrate this coil in the sensor device 6, for instance in the ring or the wristwatch as noted earlier. The coil may be arranged running along the circumference of the ring, while in the wristwatch, the coil may be integrated in a display of the wristwatch or run along the watchstrap thereof. In still other embodiments, the NFC antenna may be attached to the fabric of a sleeve or the like.

[0040] By using a technique similar to what is used for credit cards, it is possible to manufacture passive NFC stickers or NFC surfaces at low cost. These NFC sticker can be attached to, or mounted in, existing objects such as, for instance, door lock keypads and door locks that accept key tags and have built-in NFC circuits.

[0041] In various embodiments, a keyboard, touchscreen, or other secret device 8a, 8b has been provided with the sensor 7a, 7b comprising the NFC circuit 2a, 2b. Further, the user has the sensor device 6, which is able to communicate with the XR device 3 as well as with the secret devices 8a, 8b (specifically with the sensors 7a, 7b thereof).

[0042] The sensor device 6 is able to actively transmit using e.g., a Bluetooth signal to the XR device 3 and e.g., an NFC signal to the secret devices 8a, 8b.

[0043] The sensor device 6 may be worn by the user e.g., on his hand (e.g., mounted in a ring) or wrist (e.g., built into a watch).

[0044] In an exemplary scenario, the keyboard is activated when the user starts typing a password. The NFC circuit 2a, 2b of the secret device 8a, 8b (here the keyboard) is then also activated, and the sensor device 6 detects this activation using its NFC circuit. When detecting the activation, and thus risk of secrets being revealed, the detector device 6 uses a Bluetooth link in order to, for instance, instruct the XR device 3 to turn off relevant camera(s), i.e., at least all cameras pointing in the direction of the keyboard.

[0045] The AR camera(s) 4 of the AR glasses 3 may, for instance, automatically be disabled when the user is within a communication distance to one of the secret devices 8a, 8b provided with the sensors 7a, 7b. This has the advantage that the user does not need to remember that he has an on-going XR session.

[0046] A similar principle may be applied when the user opens a document that is identifiable as strictly confidential and should be available only for authorized persons. The secret device 8a, 8b, e.g., a word editor or other application, provided with an NFC circuit 2a, 2b (e.g., NFC transceiver) may support the document class (“strictly confidential”), and trigger the “privacy mode” upon which the secret device 8a, 8b sending an NFC signal which can be detected by the sensor device 6. In an alternative approach a privacy signal is sent directly to the AR glasses 3, and in particular the receiver 5 thereof. Appropriate action is taken by the AR glasses 3, e.g., shutting off the camera(s) 4. For such embodiments, the AR glasses 3 comprise an NFC transceiver.

[0047] The same principle may be applied when the user opens or writes an email tagged as confidential or private: the AR glasses 3 disable the camera 4 upon receiving a privacy signal from the sensor device 6, or - in other embodiments - directly from the secret device 8a, 8b.

[0048] An alternative to fully disable the camera 4, when only reading on display screens, is to have the AR glasses 3 detect text and automatically obscure the text into something that cannot be read, for example blurred text, redacted text, or the detected text being replaced with random signs which are letter-like but no real letters. For instance, the detected text may be altered by replacing some or each of the letters in a word with a different letter having similar pixel size; or by rotating or mirroring some or each of the letters in a word of the detected text.

[0049] FIG. 2 is a flowchart of embodiments according to the present teachings. In box 11, the sensor device 6 probes for wireless signalling, e.g., NFC signaling responses (in case of a passive device) and continuous NFC signalling (in case of an active device) from the secret devices 8a, 8b, e.g., a computer, provided with NFC circuits 2a, 2b. As noted earlier, the NFC is one possible technique for implementing the wireless communication, and there are various other communication protocols for implementing it. The XR device 3 controls the sensor device 6 and may thus change the settings thereof. The XR device 3 may, for instance, change the settings such as to instruct the sensor device 6 when to perform the probing, e.g., to probe only when the XR device 3 is active and at least one camera thereof is being used.

[0050] The sensor device 6 may be configured to differentiate between different types of detected secret devices 8a, 8b, e.g., credit cards, computer, laptop etc. Based on, for instance, type of secret device 8a, 8b, the XR device 3 may be configured to take different actions. For instance, in case the secret device 8a, 8b is a credit card, then the camera(s) are turned off immediately, whereas the proximity to a keylock which demands an action by the user might involve a warning being given on the display, allowing the user to decide whether the camera should be turned off.

[0051] Flow continues to box 12, wherein it is determined whether a risk of a potential privacy issue has been detected. If not, flow returns to box 11 and the sensor device 6 continues probing for NFC responses from the secret devices 8a, 8b, provided with NFC circuitry. If a need for NFC privacy is detected, flow continues to 13, wherein the privacy mode is entered by turning off cameras of the XR device 3.

[0052] In other embodiments, a geo-location, i.e., a position, of certain secret devices 8a, 8b might be determined and stored. If the user comes close to such geo-location, the XR device 3 may act accordingly e.g., by letting the sensor device 6 probe more frequently or even disregard certain (types of) NFC units being close.

[0053] Flow continues to box 14, wherein it is determined whether the NFC privacy issue has ended; if NO, the sensor device 6 remains in privacy mode, if YES flow continues to box 16, wherein the privacy mode is exited, and the sensor device 6 returns to the probing of NFC responses.

[0054] FIG. 3 is a flowchart of a method according to embodiments. The features of the various embodiments that have been described can be combined in many ways, examples of which are given next. A method 20 for protecting sensitive data is provided. The method 20 is performed in an extended reality, XR, device 3 comprising at least one camera 4. The method 20 comprises receiving 22 information on a detected secret device 8a, 8b from a sensor device 6 enabled for wireless signaling. The information may comprise instructions to turn off all cameras 4 that the XR device 3 comprises, or one particular camera 4 that is at risk of capturing some secret, such as, for instance, a Personal Identification Number (PIN) code. The XR device 3 then performs 24, in response to the received information, one of at least two actions. One of these actions is that the XR device 3 turns off 24a the at least one camera 4 for the case that the information comprises an instruction to disable one or more cameras. In this case, the sensor device 6 has detected a secret device 8a, 8b and therefore signaled instructions to the XR device 3 to turn off at least one camera, because this at least one camera might capture (and potentially reveal) some secret.

[0055] The other action is that the XR device 3 itself determines 24b, based on the received information, whether or not at least one camera 4 should be disabled to prevent sensitive data from being captured. The sensor device 6 has, in this case, sent some data enabling the XR device 3 to decide on appropriate action.

[0056] The XR device 3 then acts according to the determination. In the former case, i.e., when the XR device 3 receives an instruction to turn off cameras, the XR device does not need to include processing means for making the decision itself and may instead comprise a simpler and less expensive device for protecting secrets. In the latter case, wherein the XR device 3 is to take a decision on how to act, such processing means is included in the XR device 3.

[0057] In addition to the information provided by the sensor device 6, the determination may further be based on context, e.g. based on environment or on a situation within which the user is operating, state of the XR device 3 and various other factors. For instance, it might be advantageous for a user to expressly and temporarily overrule the privacy control mechanism, during a given recording. Alternatively, if a user finds himself in a lab environment, different privacy rules might be set, e.g. the action of passing a gate by the user might trigger not only turning off of the camera at the passing, but all the time in the newly entered lab area, until the user passes again on his way out.

[0058] In some particular examples, the XR device 3 may be enabled for the wireless signaling by comprising a receiver and transmitter adapted for one or more of Bluetooth, Wireless Fidelity (Wi-Fi) and a 3GPP sidelink. In one embodiment, the XR device 3 receives information from the sensor device 6 using Bluetooth communication. Many existing XR devices comprise hardware for one or both of Bluetooth and Wi-Fi, and this type of wireless is therefore very suitable for implementing the method according to the various embodiments herein, although various other wireless signaling protocols could also be implemented. In some embodiments, the method 20 comprises providing selectable actions on a graphical user interface of the XR device 3, for instance on pop-up view comprising the graphical user interface. This is particularly applicable to the case, wherein the XR device 3 is to take a decision on how to act, based on the information received from the sensor device 6. The user may then easily and quickly select which action to take. Examples on such action may, for instance, be to shut off particular camera(s) or instead to ignore the information and to consequently override an action corresponding to pre-set rules. In various embodiments, the method 20 comprises determining 26, based on geo-locations obtainable by the XR device 3, that a distance to one or more secret devices 8a, 8b is within a predetermined range, and instructing 28 the sensor device 6 to probe more frequently. This may be advantageous for ensuring that the secret devices 8a, 8b are detected as soon as possible and thus avoiding any secrets being revealed. The geo-locations may for instance be stored in a memory of the XR device 3. As another example, the geo-locations may be obtained by the XR device 3 from, for instance, a database or a cloud service. As another example, the XR device 3 may obtain the geo-locations from virtual reality maps or augmented reality maps, on which the secret devices 8a, 8b are shown. When the XR device 3 later comes further away from the secret devices 8a, 8b, the sensor device 6 may be instructed to probe less frequently again.

[0059] In various embodiments, the method 20 comprises receiving, from the sensor device 6, one or both of type and identity of the secret devices 8a, 8b detected by the sensor device 6. The XR device 3 may comprise processing means for deciding on action based on this information. For instance, the identity of the secret device 8a, 8b may reveal that it is extremely important to quickly shut off cameras in order to not reveal anything.

[0060] In some embodiments, the method 20 comprises detecting that the sensor device 6 has not received input for a predetermined period of time and re-activating the one or more cameras 4. This feature is convenient for the user of the XR device 3 since the cameras 4 are automatically activated again when it is deemed to be safe in view of secret devices 8a, 8b.

[0061] In various embodiments, the sensor device 6 detects type and / or identity of one or more of the secret devices 8a, 8b, and / or corresponding sensing wearable 7a, 7b, and notifies this to the receiver unit 5. Each secret device 8a, 8b may have an identification number, which is typically unique. It may also comprise a broader identification string, specifying type of device. For example, a VISA-card is of type “visacard”, but each VISA card also has a unique identification number. The information that the sensor device 6 receives is conveyed to the receiver unit 5 of the XR device 3, based on which a security decision can be made.

[0062] In various embodiments, the method 20 comprises detecting that the sensor device 6 has not received input for a predetermined period of time and re-activating the one or more cameras 4.

[0063] An extended reality, XR, device 3 is also provided, in which the described method 20 may be implemented. The XR device 3, implementing the method 20, is enabled to prevent sensitive data from being shared when used in an extended reality environment. The XR device 3 comprises at least one camera 4 and a receiver unit 5, and is configured to receive, in the receiver unit 5, a signal from a sensor device 6 enabled for wireless communication, such as for instance Bluetooth and / or Near Field Communication, NFC. The signal comprises information enabling the XR device 3 to assess whether the at least one camera 4 of the XR device 3 is at risk of capturing sensitive data. The XR device 3 is configured to take, in response to the assessment that there is a risk of capturing sensitive data, at least one action for preventing the capturing.

[0064] In an embodiment the XR device 3 is configured to take an action. The XR device 3 is configured to perform one or both of: disable the at least one camera 4 from capturing the sensitive data and inform a user of the device 3 on the risk of the at least one camera 4 capturing sensitive data. For instance, the XR device 3 may be configured to first inform the user of the risk, upon which the user may estimate the risk and ignore the warning or disable at least the camera(s) 4 at risk of capturing the sensitive data. In other embodiments, the XR device 3 informs the user and disables the camera(s) 4.

[0065] In some embodiments, the XR device 3 is configured to provide selectable actions on a slider in a graphical user interface of the XR device 3. Examples of actions has been given earlier. In some embodiments, the XR device 3 is configured to determine, based on geolocations stored in a memory of the XR device 3, that a distance to one or more wireless communication units 2a, 2b is within a predetermined range, and then instruct the sensor device 6 to probe more frequently. Conversely, when the XR device 3 is further away (beyond the predetermined range), the sensor device 6 may be configured to probe less frequently.

[0066] In some embodiments, the XR device 3 is configured to receive, from the sensor device 6, data on type or identity of a wireless communication devices detected by the sensor device 6. This may be beneficial, for instance, in order to select proper action to take, as described earlier. In case the identification reveals a new type of device, the XR device 3 may request input from the user on action to take.

[0067] In various embodiments, the XR device 3 is configured to detect that the sensor device 6 has not received input for a predetermined period of time and is further configured to thereupon re-activate the one or more cameras 4, if it / they have been deactivated during security issues. In other embodiments, the sensor device 6 itself detects that it has not received any input for a predetermined period of time, and therefore informs the XR device 3 on this, and the XR device 3 may then re-activate the camera(s) 4.

[0068] In various embodiments, the sensor device 6 of the XR device 3 is integrated with the XR device 3, e.g., built in at the manufacturing of the XR device 3. In other embodiments sensor device 6 may be a device to be added to the XR device 3, possibly in an easy snap-on, snap-off fashion. In preferred embodiments, the sensor device 6 is, as described earlier, arranged in a ring or wristwatch or other type of wearable worn by the user.

[0069] FIG. 4 schematically illustrates, in terms of a number of functional units, the components of XR device 3 according to an embodiment. Processing circuitry 110 is provided using any combination of one or more of a suitable central processing unit (CPU), multiprocessor, microcontroller, digital signal processor (DSP), etc., capable of executing software instructions stored in a computer program product (as in Fig. 6), e.g., in the form of a storage medium 130. The processing circuitry 110 may further be provided as at least one application specific integrated circuit (ASIC), or field programmable gate array (FPGA). Particularly, the processing circuitry no is configured to cause the XR device 3 to perform a set of operations, or actions, as disclosed above. For example, the storage medium 130 may store the set of operations, and the processing circuitry 110 may be configured to retrieve the set of operations from the storage medium 130 to cause the XR device 3 to perform the set of operations. The set of operations may be provided as a set of executable instructions. The processing circuitry 110 is thereby arranged to execute methods as herein disclosed.

[0070] The storage medium 130 may also comprise persistent storage, which, for example, can be any single one or combination of magnetic memory, optical memory, solid state memory or even remotely mounted memory.

[0071] The XR device 3 may further comprise a communications interface 120 for communications with other entities, functions, nodes, and devices, over the interfaces. As such the communications interface 120 may comprise one or more transmitters and receivers, comprising analogue and digital components.

[0072] The processing circuitry 110 controls the general operation of the XR device 3 e.g., by sending data and control signals to the communications interface 120 and the storage medium 130, by receiving data and reports from the communications interface 120, and by retrieving data and instructions from the storage medium 130. Other components, as well as the related functionality, of the XR device 3 are omitted in order not to obscure the concepts presented herein.

[0073] FIG. 5 schematically illustrates, in terms of a number of functional modules, components of an XR device 3 according to an embodiment. The XR device 3 comprises a number of functional modules; a receive module 210 configured to perform step 22, and two action modules 220a, 220b configured to perform step 24a and 24b, respectively. The first action module 220a is configured to turn off the at least one camera for the case that the information comprises an instruction to disable one or more cameras. The second action module 220b is configured to determine, based on received information, whether or not at least one camera should be disabled. The XR device 3 of Fig. 5 may further comprise a number of optional functional modules implementing the various method steps described herein; optional functional modules may, for instance, comprise a determine module 250 configured to determine that a distance to a secret device is within a predetermined range, and an instruct module 260 configured to instruct the sensor device to probe more frequently. In general terms, each functional module 210, 220, 250, 260 maybe implemented in hardware or in software. Preferably, one or more or all functional modules 210, 220, 250, 260 may be implemented by the processing circuitry 110, possibly in cooperation with the communications interface 120 and the storage medium 130. The processing circuitry 110 may thus be arranged to fetch instructions from the storage medium 130 as provided by a functional module 210, 220, 250, 260 and to execute these instructions, thereby performing any actions of the XR device 3 as disclosed herein.

[0074] FIG. 6 shows one example of a computer program product 320 comprising computer readable storage medium according to an embodiment. On this computer readable means 1300, a computer program 1100 can be stored, which computer program 1100 can cause the processing circuitry 110 and thereto operatively coupled entities and devices, such as the communications interface 120 and the storage medium 130, to execute methods according to embodiments described herein. The computer program 1100 and / or computer program product 320 may thus provide means for performing any actions of the XR device 3 as herein disclosed.

[0075] In the example of Fig. 6, the computer program product 320 is illustrated as an optical disc, such as a CD (compact disc) or a DVD (digital versatile disc) or a Blu-Ray disc. The computer program product 320 could also be embodied as a memory, such as a random-access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read-only memory (EEPROM) and more particularly as a non-volatile storage medium of a device in an external memory such as a USB (Universal Serial Bus) memory or a Flash memory, such as a compact Flash memory. Thus, while the computer program 1100 is here schematically shown as a track on the depicted optical disk, the computer program 1100 can be stored in any way which is suitable for the computer program product 320.

[0076] FIG. 7 is a flowchart of a method in a sensor device according to embodiments. The features of the various embodiments that have been described can be combined in many ways, examples of which are given next. A method 30 for protecting sensitive data is also provided. The method 30 is performed in a sensor device 6 enabled for wireless communication, such as Bluetooth or NFC, and preferably both. The method 30 comprises probing 32 for any secret devices 8a, 8b in an XR environment. Upon detecting such secret device 8a, 8b, comprising NFC circuitry, the sensor device 6 forwards 34 information received during communication with the NFC unit(s) 2a, 2b to a receiver unit 5 of an extended reality, XR, device 3. The receiver unit 5, or processing means of the receiver unit 5, may use the information for assessment of risk of sensitive data being captured by at least one camera 4 of the XR device 3.

[0077] In an embodiment, the method 30 comprises performing the probing 32 more frequently upon receiving instructions from the XR device 3. The user of the XR device 3 may, for instance, be provided with settings by means of which the user may set desired probing frequency. In other embodiments, the method 30 comprises detecting that the XR device 3 does not have any active camera, and the probing 32 for NFC units 2a, 2b is therefore ceased.

[0078] A sensor device 6 for protecting sensitive data is also provided, configured to perform the method 30 that has been described. The sensor device 6 is enabled for Near Field Communication, NFC, as has also been described. The sensor device 6 is configured to probe for any Near Field Communication, NFC, units, and upon detecting such NFC unit 2a, 2b it forwards information received during communication with the NFC unit 2a, 2b to a receiver unit 5 of an extended reality, XR, device 3. The receiver unit 5, e.g., processing means thereof, may thereby make assessment of risk of sensitive data being captured by at least one camera 4 of the XR device 3.

[0079] In an embodiment, the sensor device 6 is configured to detect that the XR device 3 has no active camera, and then stop probing for NFC units.

[0080] In various embodiments, the sensor device 6 is a part of a device to be worn by a user, such as a ring, watch or the like.

[0081] The sensor device 6 is configured to:

[0082] - transmit a command to an XR device 3 to turn off at least one camera 4 thereof, the at least one camera 4 being at risk of capturing sensitive data of the detected secret device 8a, 8b; or - transmit an identification of the detected secret device 8a, 8b to the XR device 3, thereby enabling the XR device 30 to determine whether or not to turn off the at least one camera 4.

[0083] In an embodiment, the sensor device 6 is configured to communicate with the secret device 8a, 8b using Near Field Communication, and communicating with the XR device 3 using Bluetooth.

[0084] FIG. 8 schematically illustrates, in terms of a number of functional units, the components of a sensor device 6 according to an embodiment. Processing circuitry 410 is provided using any combination of one or more of a suitable central processing unit (CPU), multiprocessor, microcontroller, digital signal processor (DSP), etc., capable of executing software instructions stored in a computer program product (as in Fig. 10), e.g., in the form of a storage medium 430. The processing circuitry 410 may further be provided as at least one application specific integrated circuit (ASIC), or field programmable gate array (FPGA).

[0085] Particularly, the processing circuitry 410 is configured to cause the sensor device 6 to perform a set of operations, or actions, as disclosed above. For example, the storage medium 430 may store the set of operations, and the processing circuitry 410 may be configured to retrieve the set of operations from the storage medium 430 to cause the sensor device 6 to perform the set of operations. The set of operations may be provided as a set of executable instructions. The processing circuitry 410 is thereby arranged to execute methods as herein disclosed.

[0086] The storage medium 430 may also comprise persistent storage, which, for example, can be any single one or combination of magnetic memory, optical memory, solid state memory or even remotely mounted memory.

[0087] The sensor device 6 may further comprise a communications interface 420 for communications with other entities, functions, nodes, and devices, over the interfaces. As such the communications interface 420 may comprise one or more transmitters and receivers, comprising analogue and digital components.

[0088] The processing circuitry 410 controls the general operation of the sensor device 6 e.g., by sending data and control signals to the communications interface 420 and the storage medium 430, by receiving data and reports from the communications interface 420, and by retrieving data and instructions from the storage medium 430. Other components, as well as the related functionality, of the sensor device 6 are omitted in order not to obscure the concepts presented herein.

[0089] FIG. 9 schematically illustrates, in terms of a number of functional modules, components of a sensor device 6 according to an embodiment. The sensor device 6 comprises a number of functional modules; a probing module 510 configured to perform step 32, and two action modules 520a, 520b configured to perform steps 34a and 34b. The first action module 520a is configured to transmit a command to an XR device to turn off at least one camera. The second action module 520b is configured to transmit an identification of a detected secret device to an XR device. The sensor device 6 of Fig. 9 may further comprise a number of optional functional modules implementing the various method steps described herein. An optional functional module 510 may, for instance, be configured to detect a camera and a functional module 530 configured to stop probing. In general terms, each functional module 510, 520a, 520b may be implemented in hardware or in software. Preferably, one or more or all functional modules 510, 520a, 520b may be implemented by the processing circuitry 410, possibly in cooperation with the communications interface 420 and the storage medium 430. The processing circuitry 410 may thus be arranged to fetch instructions from the storage medium 430 as provided by a functional module 510, 520a, 520b and to execute these instructions, thereby performing any actions of the sensor device 6 as disclosed herein.

[0090] FIG. 10 shows one example of a computer program product 620 comprising computer readable storage medium according to an embodiment. On this computer readable means 2300, a computer program 2100 can be stored, which computer program 2100 can cause the processing circuitry 410 and thereto operatively coupled entities and devices, such as the communications interface 420 and the storage medium 430, to execute methods according to embodiments described herein. The computer program 2100 and / or computer program product 620 may thus provide means for performing any actions of the sensor device 6 as herein disclosed.

[0091] In the example of Fig. 10, the computer program product 620 is illustrated as an optical disc, such as a CD (compact disc) or a DVD (digital versatile disc) or a Blu-Ray disc. The computer program product 620 could also be embodied as a memory, such as a random-access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read-only memory (EEPROM) and more particularly as a non-volatile storage medium of a device in an external memory such as a USB (Universal Serial Bus) memory or a Flash memory, such as a compact Flash memory. Thus, while the computer program 2100 is here schematically shown as a track on the depicted optical disk, the computer program 2100 can be stored in any way which is suitable for the computer program product 620.

[0092] The invention has mainly been described herein with reference to a few embodiments. However, as is appreciated by a person skilled in the art, other embodiments than the particular ones disclosed herein are equally possible within the scope of the invention, as defined by the appended patent claims.

Claims

Claims1. A method (20) for protecting sensitive data, the method (20) being performed in an extended reality, XR, device (3) comprising at least one camera (4), the method (20) comprising:- receiving (22) information on a detected secret device (8a, 8b) from a sensor device (6) enabled for wireless signaling,- performing (24), in response to the received information, one of: turning off (24a) the at least one camera (4) for the case that the information comprises an instruction to disable one or more cameras (4), or determining (24b), based on the received information, whether or not the at least one camera (4) should be disabled to prevent sensitive data from being captured and acting according to determination.

2. The method (20) as claimed in claim 1, wherein the XR device (3) is enabled for wireless signaling selected among: Bluetooth, Wi-Fi, and a 3GPP sidelink.

3. The method (20) as claimed in claim 1 or 2, wherein the XR device (3) receives information from the sensor device (6) using Bluetooth communication.

4. The method (20) as claimed in any of the preceding claims, comprising providing selectable actions on a graphical user interface of the XR device (3).

5. The method (20) as claimed in any of the preceding claims, comprising:- determining (26), based on geo-locations obtainable by the XR device (3), that distance to one or more secret devices (8a, 8b) is within a predetermined range, and- instructing (28) the sensor device (6) to probe more frequently.

6. The method (20) as claimed in any of the preceding claims, comprising receiving, from the sensor device (6), type or identity of the secret devices (8a, 8b) detected by the sensor device (6).

7. The method (20) as claimed in any of the preceding claims, comprising detecting that the sensor device (6) has not received input for a predetermined period of time and re-activating the one or more cameras (4).

8. An extended reality, XR, device (3) for protecting sensitive data in an extended reality environment, the XR device (3) comprising at least one camera (4) and being configured to:- receive information on a detected secret device (8a, 8b) from a sensor device (6),- perform, in response to the received information, one of: turn off the at least one camera (4) for the case that the information comprises an instruction to disable one or more cameras (4), or determine, based on the received information, whether or not the at least one camera (4) should be disabled to prevent sensitive data from being captured and to act according to determination.

9. The XR device (3) as claimed in claim 8, enabled for wireless signaling by comprising at least one of: a Bluetooth transceiver, a Wi-Fi transceiver, a 3GPP sidelink.

10. The XR device (3) as claimed in claim 8 or 9, configured to receive information from the sensor device (6) using Bluetooth communication.

11. The XR device (3) as claimed in any of the claims 8 - 10, configured to provide selectable actions on a graphical user interface of the XR device (3).

12. The XR device (3) as claimed in any of claims 8 - 11, configured to:- determine, based on geo-locations obtainable by the XR device (3), that distance to one or more secret devices (8a, 8b) is within a predetermined range, and- instruct the sensor device (6) to probe more frequently.

13. The XR device (3) as claimed in any of claims 8 - 12, configured to receive, from the sensor device (6), type or identity of the secret devices (8a, 8b) detected by the sensor device (6).

14. The XR device (3) as claimed in any of claims 8 - 13, configured to detect that the sensor device (6) has not received input for a predetermined period of time and re-activate the one or more cameras (4).

15. A method (30) for protecting sensitive data, the method (30) being performed in sensor device (6) enabled for wireless communication, the method (30) comprising:- probing (32) for secret devices, and upon detecting such secret device (8a, 8b) performing (34) one of:- transmitting a command to an XR device (3) to turn off at least one camera (4) thereof, the at least one camera (4) being at risk of capturing sensitive data of the detected secret device (8a, 8b); or- transmitting an identification of the detected secret device (8a, 8b) to the XR device (30) enabling the XR device (30) to determine whether or not to turn off the at least one camera (4).

16. The method (30) as claimed in claim 15, comprising detecting the secret devices (8a, 8b) using Near Field Communication, and communicating with the XR device (30) using Bluetooth.

17. The method (30) as claimed in claim 15 or 16, comprising performing the probing (32) more frequently upon receiving instructions from the XR device (3).

18. A sensor device (6) for protecting sensitive data, the sensor device (6) being enabled for wireless communication, and configured to:- probe for secret devices (8a, 8b), and upon detecting such secret device (8a, 8b), configured to perform one of:- transmit a command to an XR device (3) to turn off at least one camera (4) thereof, the at least one camera (4) being at risk of capturing sensitive data of the detected secret device (8a, 8b); or- transmit an identification of the detected secret device (8a, 8b) to the XR device (3) enabling the XR device (30) to determine whether or not to turn off the at least one camera(4).

19. The sensor device (6) as claimed in claim 18, configured to communicate with the secret device (8a, 8b) using Near Field Communication, and communicating with the XR device (3) using Bluetooth.

20. The sensor device (6) as claimed in claim 18 or 19, wherein the sensor device (6) is a sensing wearable device.

21. A computer program (1100) for an extended reality, XR, device (3), the computer program (1100) comprising computer program code, which, when run on processing circuitry in the extended reality, XR, device (3) causes the XR device (3) to perform the method (20) according to any of claims 1 - 7.

22. A computer program product (320) comprising a computer program (1100) as claimed in claim 21 and a computer readable means (1300) on which the computer program (320) is stored.

23. A computer program (420) for a sensor device (6), the computer program (420) comprising computer program code, which, when run on processing circuitry in the sensor device (6) causes the sensor device (6) to perform the method (30) according to any of claims 15 - 17.

24. A computer program product (420) comprising a computer program (2100) as claimed in claim 23 and a computer readable means (2300) on which the computer program (420) is stored.

Images