COMPUTER SYSTEM WITH A DISPLAY SCREEN
The computer system uses a time-of-flight sensor to detect individuals behind the user by analyzing distance and mobility, addressing energy consumption and detection limitations of existing methods, ensuring effective privacy protection.
Patent Information
- Application Number
- FR2022003008
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-04-01
- Publication Date
- 2024-12-13
- Estimated Expiration
- 2042-04-01
Smart Images
Figure 00000011_0000 
Figure 00000011_0001 
Figure 00000012_0000
Abstract
Description
Title of the invention: COMPUTER SYSTEM COMPRISING A DISPLAY SCREEN
[0001] Embodiments and implementations relate to computer systems having a display screen, and more particularly to the preservation of privacy regarding the activities of a user of a computer system displayed on his screen.
[0002] Some computer systems, such as desktop or laptop personal computers, tablets, and feature phones ("smartphones"), have a screen. A screen is an output device that displays information in the form of images or text. This information can then be viewed by a human user of the computer system.
[0003] The user of the computer system may wish to preserve his privacy regarding his activities carried out on the computer system, in particular for reasons of confidentiality. The user of the computer system may thus wish to ensure that no other person can view the information displayed on the screen.
[0004] A known solution is to use a privacy filter applied to the screen of the computer system. Such a privacy filter is a protection for restricting the view of information displayed on either side of a line of vision of the user of the computer system. However, such a privacy filter has the disadvantage of not preventing an intruder located behind the user facing the screen from viewing the information displayed on the screen.
[0005] Furthermore, it is possible to equip these computer systems with a camera. This camera is generally used to film the user, particularly in the context of videoconferences. However, the camera can also be used to preserve the user's privacy. Indeed, the computer system can use the camera to detect the presence of an intruder located behind the user in order to alert the user when an intruder is detected. The computer system then implements image processing algorithms to detect the presence of an intruder in the images acquired by the camera. However, these algorithms can be complex and their implementation can lead to high energy consumption. In addition, the camera must be constantly switched on to acquire images continuously.When the computer system is autonomous (laptop, tablet, or multifunction phone), the energy consumption required for the implementation of the algorithm can cause a significant drop in the energy autonomy of the computer system and may even require the computer system to be connected to the mains. Use . of such an algorithm can therefore be restrictive for the user of the computer system. Furthermore, some users may consider continuous use of the camera to be intrusive. As such, some users use mechanical flaps on the camera to prevent unwanted use of the camera by the user. Algorithms for detecting an intruder may rely on face detection. However, such face detection algorithms are not always effective, especially when the face is at least partially hidden, for example by a surgical mask.
[0006] There is therefore a need to propose a solution making it possible to detect individuals located behind the user of a computer system in a simple and non-intrusive manner for the user.
[0007] According to one aspect, there is provided a computer system comprising: - a display screen, - a time-of-flight sensor arranged near the screen and configured to acquire distance information from several areas of a scene located in front of the screen in a field of view of the time-of-flight sensor, - a processing unit configured to determine the presence of a user of the computer system in said scene and to detect a presence of at least one individual other than the user - in particular behind the user -, from the distance information acquired by the time-of-flight sensor, and to inform the user when a presence of at least one individual other than the user - in particular behind the user - is detected.
[0008] Such a computer system has the advantage of using a time-of-flight sensor that consumes little energy compared to a camera to detect individuals other than the user of the computer system. In addition, the use of a time-of-flight sensor makes it possible to preserve the privacy of the user. Such a solution is also not limited to certain lighting conditions compared to a solution using a camera that generally requires a minimum level of lighting. In addition, the time-of-flight sensor makes it possible to detect individuals whose face is at least partially hidden. The use of the time-of-flight sensor makes it possible to detect individuals even if they are not completely in the field of view of the time-of-flight sensor. The time-of-flight sensor also has the advantage of not being placed behind a mechanical flap that can be used on a camera of the computer system.
[0009] In an advantageous embodiment, the processing unit is configured to determine the presence of elements of the scene in the field of view of the time-of-flight sensor from the distance information acquired by the time-of-flight sensor and to determine whether some of these elements correspond to individuals other than the user.
[0010] Advantageously, the processing unit is configured to determine that an element corresponds to an individual other than the user if: - the element is not the closest element to the time-of-flight sensor, and if - the element is mobile between several successive acquisitions of the time-of-flight sensor, and if - the element is located at a distance, relative to the time-of-flight sensor, less than or equal to a maximum distance defined by the user, and if - the element appeared in the scene after the user of the computer system, and if - the element remained in the scene longer than a user-defined duration, or if the item appeared in the scene at a distance, relative to the time-of-flight sensor, close to a distance from a previously detected individual.
[0011] Preferably, the processing unit is configured to filter the detected elements before determining whether the filtered elements correspond to individuals, the filtered elements corresponding to the elements sufficiently separated from the other elements and located at a distance from the time-of-flight sensor less than a given distance.
[0012] In an advantageous embodiment, the time-of-flight sensor comprises a matrix of avalanche diodes triggered by an individual photon.
[0013] According to another aspect, a method is proposed for detecting at least one individual other than a user of a computer system comprising a display screen - in particular behind the user -, the method comprising: - at least one acquisition, by a time-of-flight sensor placed near the screen, of distance information from several areas of a scene located in front of the screen in a field of view of the time-of-flight sensor, - a determination of the presence of a user of the computer system in said scene and a detection of the presence of said at least one individual other than the user - in particular behind the user -, from the distance information acquired by the time-of-flight sensor, - a notification to the user when the presence of at least one individual other than the user - particularly behind the user - is detected.
[0014] In an advantageous embodiment, the method comprises a determination of the presence of elements of the scene in the field of view of the time-of-flight sensor from the distance information acquired by the time-of-flight sensor and a determination whether some of these elements correspond to individuals other than the user.
[0015] Preferably, the presence of an individual other than the user is determined if: - an element is not the element closest to the time-of-flight sensor, and if - this element is mobile between several successive acquisitions of the time-of-flight sensor, and if - this element is located at a distance, relative to the time-of-flight sensor, less than or equal to a maximum distance defined by the user, and if - this element appeared in the scene after the user of the computer system, and if - this element remained in the scene longer than a duration defined by the user, or if an item appeared in the scene at a distance, relative to the time-of-flight sensor, close to a distance from a previously detected individual.
[0016] Advantageously, the method comprises filtering the detected elements before determining whether the filtered elements correspond to individuals, the filtered elements corresponding to the elements sufficiently separated from the other elements and located at a distance from the time-of-flight sensor less than a given distance.
[0017] In an advantageous embodiment, the acquisition of distance information is carried out by a time-of-flight sensor comprising a matrix of avalanche diodes triggered by an individual photon.
[0018] Other advantages and characteristics of the invention will appear on examining the detailed description of embodiments, which are in no way limiting, and the appended drawings in which:
[0019] [Fig.l]
[0020] [Fig.2]
[0021] [Fig.3] illustrate embodiments and implementations of the invention.
[0022] [Fig.l] illustrates an embodiment of a computer system SYS. The SYS computer system can be a laptop, a tablet, a multifunction phone for example.
[0023] The computer system SYS comprises a processing unit UT, a memory and a screen SCR. The processing unit UT can be a processor or a microprocessor for example.
[0024] The SCR screen may be an LCD screen, an OLED screen. The SCR screen is configured to display information that can be viewed by the user.
[0025] The SYS computer system also includes a TOF time-of-flight sensor. The TOF time-of-flight sensor includes an array of avalanche diodes triggered by an individual photon, called SPAD diodes. For example, the TOF time-of-flight sensor may be a VL53L5CX sensor marketed by the company STMicroelectronics.
[0026] The TOF time-of-flight sensor is placed near the SCR screen and is oriented so that it can acquire distance data in a scene located in front of the SCR screen in the field of view of the TOF time-of-flight sensor. For example, the time-of-flight sensor TOF time of flight sensor can be placed on a border of the screen. The TOF time of flight sensor is configured to evaluate distances of elements that may be present in the scene relative to the TOF time of flight sensor. For example, the TOF time of flight sensor is configured to determine a distance between the user of the SYS computer system and the TOF time of flight sensor.
[0027] The TOF time-of-flight sensor is multi-zone. In other words, the TOF time-of-flight sensor is configured to section its field of view of the TOF sensor into several zones. Each zone is therefore delimited horizontally and vertically. For example, the TOF time-of-flight sensor can section its field of view into sixty-four zones (8x8). The TOF time-of-flight sensor is configured to determine a distance for each zone of its field of view. The TOF time-of-flight sensor thus makes it possible to detect the presence of element(s) in the different zones of its field of view.
[0028] The TOF time-of-flight sensor is used to detect the presence of the user in front of the screen. In particular, the processing unit UT is configured to determine that an element present in the scene corresponds to the user from the data generated by the time-of-flight sensor. More particularly, an element can be considered as the user when it meets several criteria. For example, an element can be considered as a user when it is located at a distance within a predefined range relative to the TOF time-of-flight sensor.
[0029] The TOF time-of-flight sensor is also used to detect the presence of individuals behind the user in front of the screen. In particular, the processing unit UT is configured to determine that one or more elements present in the scene correspond to one or more individuals from the data generated by the TOF time-of-flight sensor. More particularly, an element can be considered as an individual behind the user when it meets different criteria.
[0030] A first criterion for considering an element as such an individual is that the element must not be the element closest to the TOF time-of-flight sensor.
[0031] A second possible criterion is that the element must be mobile between several successive acquisitions of the time-of-flight sensor.
[0032] A third possible criterion is that the distance of the element from the TOF time-of-flight sensor must be less than or equal to a maximum distance defined by the user. The user can define different maximum distances for different parts of the scene. For example, the user can define a maximum distance for a left part of the scene and a maximum distance for a right part of the scene. The distance of the element is then compared to the maximum distance defined for the part of the scene in which the element is located.
[0033] A fourth possible criterion is that the element must have appeared in the scene after the user of the SYS computer system.
[0034] A fifth possible criterion is that the element must remain in the scene longer than a duration defined by the user, for example of the order of two seconds.
[0035] It is also possible to determine that an element is an individual behind the user if it has just appeared in the scene and its distance from the TOF time-of-flight sensor is close to the distance of a previously detected individual.
[0036] The processing unit UT can be configured to filter the detected elements before detecting the presence of an individual behind the user among these different elements. To do this, the processing unit is configured to select at most a predefined number of elements. In particular, the processing unit UT is configured to select elements separated from each other, for example by fifty centimeters, and which are closest to the TOF time-of-flight sensor.
[0037] After detecting an individual using the time-of-flight sensor, and if the user allows it, the processing unit can be configured to use a CAM camera of the computer system to acquire images of the scene in front of the screen in order to execute an image processing algorithm, in particular face detection, to verify whether the element detected using the time-of-flight sensor corresponds to an individual having their face directed towards the screen of the computer system. The use of the camera makes it possible to avoid false positives in which the time-of-flight sensor detects an individual who has their back to the screen and who therefore presents no risk for the preservation of the privacy of the user of the computer system.
[0038] The processing unit UT is also configured to signal the user, in particular via the screen SCR, when an individual other than the user is detected in the field of vision of the time-of-flight sensor TOF.
[0039] Such a SYS computer system has the advantage of using a TOF time-of-flight sensor that consumes little energy compared to a camera to detect individuals behind the user of the SYS computer system. In addition, the use of a TOF time-of-flight sensor provides a sense of privacy for the user. Such a solution is also not limited to certain lighting conditions compared to a solution using a camera that generally requires a minimum level of lighting. In addition, the TOF time-of-flight sensor makes it possible to detect individuals whose faces are at least partially hidden. The use of the time-of-flight sensor makes it possible to detect individuals even if they are not completely in the field of view of the TOF time-of-flight sensor. The TOF time-of-flight sensor also has the advantage of not being placed behind a mechanical flap that can be used on a camera of the computer system.
[0040] [Fig. 2] illustrates an embodiment of a method for detecting an individual behind a user of a computer system. This method is implemented in a scene in which the user can position himself, in particular in front of the screen of the computer system. The detection method can be implemented by a computer system as described previously. The method comprises steps that can be repeated so as to allow continuous tracking of individuals that may appear behind the user.
[0041] In particular, the method comprises an acquisition step 20 in which the multi-zone time-of-flight sensor measures distances of the different elements of the scene, then transmits these distance measurements to the processing unit.
[0042] Then, the method comprises a filtration step 21 in which the processing unit filters certain elements of the scene detected by the time-of-flight sensor.
[0043] The method finally comprises a detection step 22 in which the processing unit analyzes the various detected and filtered elements in order to determine whether some of these elements correspond to the user of the computer system or to individuals other than this user. To do this, the processing unit checks the criteria described previously in relation to [Fig.l] in order to evaluate whether an element corresponds to an individual. If the user allows it, the processing unit can use the camera of the computer system to acquire images of the scene in front of the screen before executing an image processing algorithm, in particular face detection, to verify whether the element detected using the time-of-flight sensor corresponds to an individual having their face directed towards the screen of the computer system.The use of the camera makes it possible to avoid false positives in which the time-of-flight sensor would detect an individual whose back is to the screen and who would therefore present no risk to the preservation of the privacy of the user of the computer system.
[0044] If the method detects an individual, the method then comprises a signaling step 23 in which the processing unit can signal to the user the presence of this individual by displaying an alert message on the screen of the computer system for example.
[0045] [Fig. 3] illustrates an example of detection of individuals INT1, INT2 behind a user USR of a computer system SYS equipped with a screen SCR. The individuals INT1, INT2 are detected respectively at positions Pl(xl,yl,zl) and P2(x2, y2, z2) in the field of view of a time-of-flight sensor of the computer system SYS.
Claims
Claims
1. Computer system comprising: - a display screen (SCR), - a time-of-flight sensor (TOF) arranged near the screen (SCR) and configured to acquire distance information from several areas of a scene located in front of the screen in a field of view of the time-of-flight sensor, - a processing unit (UT) configured to determine the presence of a user (USR) of the computer system in said scene and to detect a presence of at least one individual (INT1, INT2) other than the user, from the distance information acquired by the time-of-flight sensor (TOF), and to inform the user (USR) when a presence of at least one individual (INT1, INT2) other than the user (USR) is detected.
2. System according to claim 1, in which the processing unit (UT) is configured to determine the presence of elements of the scene in the field of view of the time-of-flight (TOF) sensor from the distance information acquired by the time-of-flight sensor and to determine whether some of these elements correspond to individuals other than the user.
3. The system of claim 2, wherein the processing unit (UT) is configured to determine that an element corresponds to an individual other than the user if: - the element is not the closest element to the time-of-flight (TOF) sensor, and if - the element is mobile between several successive acquisitions of the time-of-flight (TOF) sensor, and if - the element is located at a distance, relative to the time-of-flight (TOF) sensor, less than or equal to a maximum distance defined by the user, and if - the element appeared in the scene after the user (USR) of the computer system, and if - the element remained in the scene longer than a duration defined by the user (USR), or if the element appeared in the scene at a distance, relative to the time-of-flight (TOF) sensor, close to a distance of a previously detected individual (INT1, INT2).
4. System according to any one of claims 2 or 3, in which the processing unit is configured to filter the detected elements before determining whether the filtered elements correspond to individuals, the filtered elements corresponding to the elements sufficiently separated from the other elements and located at a distance from the time-of-flight (TOF) sensor less than a given distance.
5. System according to one of claims 1 to 4, in which the time-of-flight (TOF) sensor comprises an array of avalanche diodes triggered by an individual photon.
6. Method for detecting at least one individual other than a user of a computer system provided with a display screen (SCR), the method comprising: - at least one acquisition (20), by a time-of-flight sensor (TOF) arranged near the screen, of distance information from several zones of a scene located in front of the screen in a field of view of the time-of-flight sensor, - a determination (22) of the presence of a user (USR) of the computer system in said scene and a detection of a presence of said at least one individual (INT1, INT2) other than the user, from the distance information acquired by the time-of-flight sensor, - a notification (23) to the user (USR) when a presence of at least one individual (INT1, INT2) other than the user (USR) is detected.
7. A method according to claim 6, comprising determining the presence of elements of the scene in the field of view of the time-of-flight (TOF) sensor from the distance information acquired by the time-of-flight sensor and determining whether some of these elements correspond to individuals other than the user.
8. Method according to claim 7, in which the presence of an individual other than the user is determined if: - an element is not the closest element to the time-of-flight (TOF) sensor, and if - this element is mobile between several successive acquisitions of the time-of-flight (TOF) sensor, and if - this element is located at a distance, relative to the time-of-flight (TOF) sensor, less than or equal to a maximum distance defined by the user, and if - this element appeared in the scene after the user (USR) of the computer system, and if - this element remained in the scene longer than a user-defined duration (USR), or if an element appeared in the scene at a distance, relative to the time-of-flight (TOF) sensor, close to a distance of a previously detected individual (INT1, INT2).
9. Method according to any one of claims 7 or 8, comprising filtering the detected elements before determining whether the filtered elements correspond to individuals, the filtered elements corresponding to the elements sufficiently separated from the other elements and located at a distance from the time-of-flight (TOF) sensor less than a given distance.
10. Method according to one of claims 6 to 9, in which the acquisition of the distance information is carried out by a time-of-flight (TOF) sensor comprising a matrix of avalanche diodes triggered by an individual photon.