Remote Presence Detection System

The system addresses varying detection areas and secure access in presence detection by using acoustic and other sensors to track user activity, providing centralized management and secure access for remote users, enhancing communication handling and security in group applications.

JP2024541288APending Publication Date: 2024-11-08ELLIPTIC LAB AS
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2024526774
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-11-05
Filing Date
2022-11-03
Publication Date
2024-11-08

Smart Images

  • Figure 2024541288000001_ABST
    Figure 2024541288000001_ABST
Patent Text Reader

Abstract

The present invention relates to a system and electronic device for detecting and monitoring the presence of a user in the vicinity of the electronic device. The device includes a processor configured to provide an indication signal to a processing and communication unit indicative of the presence or absence of a user in the vicinity of the device based on received sensor inputs to detect the presence of the user. The processing and communication unit is configured to communicate the indication signal to at least one other device in a communication network.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a presence detection system, and more particularly to a presence detection system for detecting potential users of an electronic device or system. [Background technology]

[0002] Modern group applications use the available information to indicate whether a user is active, present or away, blocked or busy, etc., and provide other information about their current status and willingness to communicate directly using voice / video conferencing etc. These indicators are usually linked to actions taken by the user that the user has allowed to be shown to friends and family. Other people can also access the presence information if the user wishes.

[0003] With the advent of presence detection sensors (ToF, UWB, radar, ultrasonic, etc.), the presence state is no longer solely dependent on a specific user action (touching a screen, typing, recording, using an input device, logging in, etc.). A presence detection sensor can indicate that someone is in front of or near a remote device even if they are not logged in. Presence detection sensors have different fields of view, so the detection area will be different for each device. If available, information can be extracted from the presence detection sensor and made available to other parties. WO 2021 / 0219039 describes a system in which users with access to devices in the system can share customizable features in the system.

[0004] For example, U.S. Patent Application No. 2017 / 0139031 and U.S. Patent Application No. 2014 / 0092710 describe sensors and methods for detecting targets in the vicinity of a system, such as for detecting activity, where passive sensors are used to localize acoustic sources. Active presence detection is described in WO 2021 / 045628 and co-filed Norwegian Patent Applications Nos. 20211332 and 20211333, which are incorporated herein by reference. Summary of the Invention [Problem to be solved by the invention]

[0005] The present invention is directed to a system for providing presence detection and for use in a communication system. The presence of a user may be based not only on acoustic measurements but also on other measurements related to the user's activity. This is achieved as defined in the appended claims. [Means for solving the problem]

[0006] In accordance with the present invention, for security reasons, it is possible to use a presence detection sensor for more than just presence detection on a local device (e.g., detecting the presence of a person on a laptop personal computer). It can be used as a presence indicator for group applications such as Microsoft Teams, Cisco WebEx, Messenger, etc., where authorized users can access the presence indicators of remote users. Access to these presence indicators needs to be controlled by the remote user to ensure that the information is not misused.

[0007] Presence detection information is communicated to either a decentralized or centralized entity that tracks the user status of all users managed or known within the group. Every user can subscribe to user status updates from all subscribing users or from a preferred set of users (members of the same organization, contacts, friends, etc.). While there may be direct communication of user status between specific users, the most common setup is one in which a centralized user status controller tracks the user status of all users according to the permissions that the users have individually granted or that the organization has accepted. [Brief description of the drawings]

[0008] The invention will now be described in more detail with reference to the accompanying drawings, which show, by way of example, the invention. [Figure 1] FIG. 1 illustrates an apparatus for implementing presence detection and monitoring according to the present invention. [Diagram 2] 1 illustrates a number of devices in a computer network, where at least one of the devices includes presence detection. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] As shown in FIG. 1, the present invention relates to a device 5 configured to detect and monitor the presence of a user 7. The device 5 may be, for example, a computer, a phone, a game console, or a tablet. Typically, the device includes at least one microphone 1, which is connected via an interface to a processor 9 for detecting sounds and activity in the vicinity of the device. The processor may be configured to recognize specific sounds, for example based on frequency ranges, time, or known user voices. It may also be configured to recognize the location of an acoustic source and its distance from the device using two or more microphones 1. The recognition of signals may also be recognized using machine learning algorithms based on previous user activity in the area associated with the device. Other types of sensors 3 may also be used, such as radar, keyboard operations, cameras, etc., and their combination may increase the certainty of the presence detection.

[0010] The present invention may also include an active acoustic source 13. The acoustic source 13 may be independent of or integrated into a device connected to a speaker or other transducer 2 to transmit an acoustic signal. The acoustic source may be configured to transmit a reference signal 17 to the processor 9 to measure the time or phase difference between the transmitted and received signals. The transmitted signal may be in the ultrasonic and / or audible range.

[0011] Alternatively, the acoustic source may be independent of the device, in which case the device is configured to detect reflections of the transmitted signal via at least two microphones 1 and detect the presence of a user based on amplitude and phase as well as other processing.

[0012] The apparatus also comprises a processing and communication unit 10 having a user interface, storage means for data and user input, as well as known communication means for communicating with a computer network.

[0013] According to the invention, the device is part of a remote control system or network with multiple devices 5a, 5b, 5c connected to a common network 6 as shown in Figure 2. The network 6 may be a decentralized or centralized entity capable of tracking the user status of all users that are controlled or known within the group. The network may include a user database that holds information regarding users' privacy settings and control levels or privileges within the system.

[0014] The presence detection mechanism of a first remote device 5a can track presence activity over a configurable time (e.g., a presence history window) and, if configured to do so, make that information accessible to a user of another device 5b. The presence history can also be used by the remote user. It provides information about users who have been in close proximity to the remote device 5a. This information is available to other devices 5b, 5c owned by the remote user and can be used to better secure the remote devices.

[0015] Remote presence detection can also be used to control how the device 5a handles the remote side call process. A ringtone can be generated if the remote user is away but wants the call to continue, in the hope that he is nearby. The ringtone can also be generated normally, if configured by the user or according to organizational rules. According to the presence detection scheme, if the remote user is present in front of the device, the ringtone can be made optional, or at least subdued so as not to disturb others nearby. In such cases, a visual indicator can be used as a less noisy alternative.

[0016] Access to remote presence detection allows a user to subscribe to changes in the presence detection state of at least one remote user. When at least one or a selected number of the remote devices indicates presence, the first user is notified and all remote users can be contacted simultaneously and communications can commence using a prioritized communications channel.

[0017] If a communication channel should not be initiated until at least one of the required remote users is present, but is unavailable for any communication based on other information, the user may choose to wait until all users are present and available.

[0018] The user may choose to instruct the system to overlook available users depending on the presence detection status if the desired communication is critical. Also, automatic redialing may be set to occur based on an indication from a remote presence detection sensor when all required remote users have entered the presence detection area, respectively. Alternatively, the remote device may display a message indicating the user's intent to make the call. The message may include an element (such as a call back button) that allows the remote user to immediately answer (i.e., accept or reject) the communication request. Depending on the configuration of the group application, or potentially a request from the initiating user, the establishment of the communication channel may be delayed until all required participants are present. Optionally, remote users may be overlooked in this scenario.

[0019] In summary, the present invention relates to an electronic device and a system including the electronic device, the device being adapted to detect and monitor the presence of a user in the vicinity of the device and including a processor configured to detect the presence of a user based on received sensor input, and upon request from an external device or automatically initiated by the device, providing an indication signal indicative of whether a user is present to a processing and communication unit, the processing and communication unit being configured to communicate the indication signal to at least one other device in a communication network.

[0020] The processing and communications unit may include a user interface, such as a screen, keyboard, voice recognition or touch pad, for requesting permission from a user to allow a presence indication to be communicated to a remote unit in the network and storing that permission in a data storage device.

[0021] The processing and communication unit may be configured to communicate with other devices in the network to request or authorize transmission of presence indications within the network, which may be a centralized server or server network including computer storage for controlling access and information related to users and devices.

[0022] The processing and communication unit may be configured to enable remote control of the device via transmission over a network.

[0023] The system according to the invention comprises a number of devices as described above, enables communication between at least two of the processing and communication units of the devices, includes a user presence indication, and enables at least one other computer in the network to receive the information. Preferably, the other computer may be a decentralized or centralized computer entity configured to maintain and control the status of all users that are managed or known in a selected group. Preferably, the entity includes a user database that maintains information regarding users' privacy settings and management levels or privileges in the system.

Claims

1. 1. An electronic device configured to detect and monitor the presence of a user in a vicinity of the electronic device, the electronic device including a processor configured to monitor a vicinity of the electronic device based on received sensor input to detect the presence of the user, and provide an indication signal to a processing and communication unit indicative of whether the user is present, the processing and communication unit configured to communicate the indication signal to at least one other device in a communication network.

2. 2. The electronic device of claim 1, wherein the processing and communication unit includes a user interface, such as a screen, keyboard, voice recognition or touch pad, for requesting permission from the user to allow a presence indication to be communicated to a remote unit in the communication network and for storing the permission in a data storage device.

3. The electronic device of claim 1 , wherein the processing and communication unit is configured to communicate with the other devices in the communication network to request or authorize the transmission of a presence indication in the communication network.

4. 2. The electronic device of claim 1, wherein the processing and communication unit includes means for enabling remote control of the electronic device via transmission over the communication network.

5. 10. The electronic device of claim 1, wherein the other devices in the communications network are a centralized server or network of servers including computer storage for controlling access and information related to the users and the electronic devices.

6. A system comprising at least two electronic devices according to any one of claims 1 to 3, said system enabling communication between processing and communication units of said electronic devices and enabling at least one other computer in the network to receive information including an indication of a user's presence.

7. 7. The system of claim 6, including a distributed or centralized computer entity configured to maintain and control the status of all managed or known users in a selected group.

8. The system of claim 7 , wherein the entity includes a user database that maintains information regarding the users' privacy settings and levels of control or privileges in the system.

Citation Information

Patent Citations

  • State information providing device and method, computer program for the same, recording medium with the program stored, and computer programmed by the program

    JP2005157603A

  • Information communication apparatus, information communication system and information communication method

    JP2009146313A

  • Multimodal Interactive Home Automation System

    JP2020521366A

  • Information processing device, information processing method, and program

    US20210004747A1