Multifunctional assisstance system, in particular for persons living alone

Abstract

Multifunctional assistance system, in particular for persons living alone, comprising a number of sensors which are distributed in a living area of a person using the assistance system for the purpose of monitoring predefined activities and predefined parameters, a control and communication unit that is provided in the living area for the purpose of communicating with the sensors and the person, a database that stores non-sensor-based information relating to the person and at least two different alarm chains, and an evaluation unit for evaluating sensor data transmitted via the control and communication unit, wherein the evaluation unit can access the database and is designed to identify any anomalies in the behaviour and / or condition of the person from the sensor data, to classify the anomalies in at least two categories and to trigger an alarm according to at least one of the at least two alarm chains on the basis of the categorization.

Description

[0001] MULTIFUNCTIONAL ASSISTANCE SYSTEM, ESPECIALLY FOR SINGLE PEOPLE

[0002] TECHNICAL FIELD OF THE INVENTION

[0003] The invention relates to a multifunctional assistance system, in particular for persons living alone, as well as a control and communication unit designed therefor.

[0004] BACKGROUND OF THE INVENTION

[0005] Due to changing lifestyles and increasing life expectancy, the topic of independent living in old age has become increasingly relevant in recent years, both from a technological and economic perspective. Many people, even those who are mentally fit, experience at least certain physical impairments with advancing age. Nevertheless, many people still desire to live in their own apartment or house for as long as possible, especially since both nursing staff and nursing home places are in short supply, and in many societies, it has long been unusual for three or even four generations to live under one roof.

[0006] To make life easier for people with certain physical limitations in their familiar surroundings, a wide variety of technical products are already being offered, mostly under the heading of Ambient Assisted Living (AAL, occasionally also called Active & Assisted Living). For example, Cogvis Software & Consulting GmbH, 1040 Vienna (www.cogvis.ai), offers body-contact fall sensors that can detect a person's movements in the rooms of a home using infrared measurements. Services and systems from this manufacturer offer automatic functions for fall detection and alarm notification when a fall is detected. Similar functions are offered by the body-contact fall sensors from the Israeli company Vayyar (www.vayyar.com).In US 2021 / 0074138 A1, to the disclosure content of which reference is made in particular with regard to the technical implementation of an automated fall detection, as can also be used in the invention described here, a room monitoring system is disclosed which uses infrared and other sensors, such as LIDAR sensors, to detect movements and evaluate them using AI.

[0007] EP 1 566 782 A1 describes a fall detection system in which a home robot travels to a fallen person and communicates with them, for example, to trigger one or more calls for help. The European standard DIN EN 50134-2 (VDE 0830-4-2) specifies requirements for triggering devices of corresponding emergency call systems.

[0008] EP 3 828 854 A1 discloses a concept for personalizing a fall detection algorithm for a specific person. Sensor data, along with feedback information, is transmitted to an external device, which generates update information for the fall detection algorithm. The update information is then used by the fall detector to update and thus personalize the fall detection algorithm.

[0009] In addition, countless "smart home products" are known for an "intelligent" home. These products can typically be operated wirelessly via the internet and / or Wi-Fi and exchange information with other devices, including light switches, heating controls, sensors for monitoring the activation of electrical devices, and plug-in adapters for switching on electrical devices. So-called smart speakers are known for voice control of such products. These allow voice commands to be evaluated using voice commands and converted into corresponding control commands for the products.

[0010] To support the provision of services, functions or applications via the Internet with a portal and / or voice call function, the following technical tools are known in particular:

[0011] Keycloak is an open-source software product published at www.keycloak.org to enable single sign-on with identity and access management for

[0012] To allow applications and services. Apache Kafka is an open-source software product published at kafka.apache.org for processing data streams and providing an interface for loading and exporting data streams to third-party systems.

[0013] Microsoft Azure is a cloud computing platform from Microsoft, available at http: / / azure.microsoft.com, that can be used to deliver applications and services.

[0014] A cloud communications platform is offered at www.twilio.com, specifically with a programming interface for making and receiving voice calls.

[0015] At www.traefik.io / traefik / , software and platform solutions are offered to make services and applications available, particularly from a portal.

[0016] DISCLOSURE OF THE INVENTION

[0017] Although the known products certainly fulfill their respective purposes, there is still a lack of an integrated solution that allows the detection not only of falls but also of other anomalies in a person's daily life, and also bundles various functions of assisted living in such a way that they can be used easily and safely even by non-technical people. Based on this, the invention is based on the technical problem of specifying a corresponding assistance system that can not only bundle various functions but also allow them to interact synergistically, as well as a control and communication unit designed for such a system.

[0018] The object is achieved by a multifunctional assistance system having the features of claim 1 or a control and communication unit having the features of claim 24. Advantageous embodiments and further developments are the subject of the subclaims.

[0019] An assistance system according to the invention comprises a number of sensors distributed throughout the living area of ​​a person using the assistance system to monitor predefined activities and predefined parameters. It is suitable for use both in the person's own premises and in nursing homes, hospitals, and assisted living facilities. Depending on the individual configuration of the system, it can also be advantageously used in hotels, for example. The term "living area" should therefore be interpreted broadly.

[0020] The system further comprises a control and communication unit provided in the living area for communication with the sensors and the person, a database in which non-sensor-based information about the person and at least two different alarm chains are stored, and an evaluation unit for evaluating sensor data transmitted via the control and communication unit, wherein the evaluation unit can access the database and is designed to detect any anomalies in the behavior and / or condition of the person from the sensor data, to classify the anomalies into at least two categories and, based on the categorization, to trigger an alarm according to at least one of the at least two alarm chains.An "alarm chain" is defined as a computer-readable address and / or instruction list stored in the database, which can be used by the evaluation unit to trigger an alarm in such a way that specific persons and / or facilities are informed in a predetermined order. The term "alarm" refers to any form of contact to convey information that an anomaly has occurred. An alarm can therefore, for example, be an automated call to a predetermined person and / or the sending of a text message to that person. If the person does not respond immediately or, depending on the detected anomaly, within a certain time interval, the alarm is triggered for the next person or facility.

[0021] In the case of certain behavioral and / or conditional anomalies, different people and / or institutions can be informed simultaneously and / or regardless of whether the previous "link" in the alert chain has responded or not. For example, if the assistance system detects a potentially life-threatening situation, automated messages can be transmitted simultaneously and independently to the emergency physician, a caretaker, and a relative of the affected person. At least one of the alert chains can be a dynamically updated alert chain, i.e.For example, according to predefined criteria, persons and / or facilities named in an update chain can store and change information on their accessibility and / or it can be provided to locate at least certain persons included in an alarm chain and to update the chain in such a way that the person closest to the living area monitored by the assistance system is informed first.

[0022] The term "database" can be understood as any type of memory accessible by the evaluation unit, which can be physically distributed across different units. The term "non-sensor-based information" refers to all types of data relevant to the respective application that are not derived from the sensors located in the living area, such as the name and age of the person using the assistance system, their medical history, certain current medications, possibly information about the person's hobbies and life history, etc. The term "anomalies in the person's behavior and / or condition" refers to all types of deviations from the person's respective "normal" behavior or condition. An anomaly in this sense could be, for example, a fall, but also unusually high blood pressure, altered toileting behavior, sudden nighttime activity, etc.An anomaly in this sense can also be a call for help from the person, who then activates the assistance system via voice control to trigger an alarm. The term "categorize into at least two categories" here means that the detected anomalies are categorized according to predefined criteria, for example, whether the respective anomaly indicates a potentially life-threatening condition of the person using the assistance system, requiring immediate measures such as alerting an emergency doctor, or whether the anomaly indicates a more gradual deterioration in the person's health, such as the onset of dementia. For such non-immediately life-threatening anomalies, "silent alarms" are triggered, depending on the presets.Inform a doctor or nursing staff caring for the person using the assistance system that changes in the person's behavior indicate a deterioration in their health, so that appropriate measures can be taken if necessary. In this sense, the assistance system can advantageously be understood as a diagnostic tool that enables appropriate specialists to make diagnoses.

[0023] The term "evaluation unit" is not to be understood as a fixed physical unit, e.g., in the form of a dedicated computer, although it can also be implemented as such. Typically, the "evaluation unit" is a software component, preferably a dynamically changing, self-learning artificial intelligence that uses specific hardware to perform the desired evaluation and execute the steps provided in the alarm chain. In this sense, it can be a cloud-based internet platform that, through appropriate configuration, is set up as an evaluation unit according to the invention. The hardware can be a cluster or network of hardware units that may perform specific tasks, such as speech recognition or speech generation, or through which corresponding existing services and modules are accessed.The control and communication unit can be coupled to the evaluation unit in such a way that the evaluation unit also checks the status of the control and communication unit, e.g., the currentness of the software installed there, and initiates automatic updates if necessary. However, it can also be provided that the control and communication unit can carry out such checks itself. The invention advantageously offers an enormous degree of flexibility, so that the assistance system can be easily and cost-effectively adapted to the respective application. If, for example, a person moves into an apartment already equipped with the assistance system, in which a person previously lived who spoke a different language than the person moving in, the assistance system can simply access a different language module. For example,If new sensors are installed in the monitored living area, the control and communication unit can automatically search for the software interfaces / communication protocols required to communicate with the sensors. The evaluation unit collects and stores the data transmitted to it via the control and communication unit, preferably in a protected area, preferably cloud-based and in any case not on-site in the monitored living area, so that a high level of data security can be easily ensured even in the event of a control and communication unit failure. Communication between the evaluation unit and the control and communication unit preferably takes place wirelessly via at least one telecommunications network. Advantageously, the control and communication unit can be equipped with its own communication device, e.g., an LTE device, and does not require a router or local network.

[0024] The multifunctional assistance system is designed specifically for people living alone, but can also be used without restrictions by couples, for example. It is characterized by excellent retrofittability and generally requires no complex modifications or installation measures. It can utilize standard sensors that communicate with the control and communication unit via standardized communication protocols.

[0025] The multifunctional assistance system according to the invention makes it possible to "break down" previous "data silos" (of the individual sensors used, such as fall sensors, and of the individual devices used, such as smart speakers) and to view the data cumulatively, thus gaining new insights. For example, the assistance system according to the invention can be designed to detect that, after a change in the medication of the person using the system, they are no longer eating regularly and / or are staying in bed for a very long time. For this purpose, a refrigerator sensor, a drawer sensor, and a motion sensor that monitors the bed can be evaluated together with a medication plan stored in the database. The assistance system allows for the assessment of so-called "ADLs" (Activities of Daily Living - the standard and measurement system used by the Medical Service to assess a person's condition and whether they are entitled to a care level).

[0026] Further details and advantages of the invention will become apparent from the following purely exemplary and non-limiting description of an embodiment in conjunction with the drawing comprising three drawing figures.

[0027] BRIEF DESCRIPTION OF THE DRAWING Fig. 1 shows schematically an apartment equipped with the assistance system according to the invention.

[0028] Fig. 2 shows schematically a combination of an evaluation unit with a control and communication unit.

[0029] Fig. 3 shows schematically a method according to the invention.

[0030] DESCRIPTION OF PREFERRED EMBODIMENTS

[0031] Figure 1 shows an apartment in which a number of sensors are distributed to monitor predefined activities and predefined parameters, and in which a control and communication unit 10 is provided for communication with the sensors and the person. Not shown are the database and evaluation unit belonging to the assistance system.

[0032] The apartment shown has a hallway 12, a kitchen 14, a living room 16, a bedroom 18, and a bathroom 20. The apartment door 22 has a contact sensor 24. Corresponding contact sensors are also provided on certain cabinets and a refrigerator in the kitchen 14 and a closet in the bedroom 18. These sensors 24 can be used to monitor the opening and closing of the apartment and closet doors. A blood pressure monitor 26 is located in the kitchen 14. The blood pressure monitor 26 can be a mobile device that can be located in any room.

[0033] Motion detectors 28 are provided in all rooms. A fall sensor 30 is provided in at least one room, here the living room 16.

[0034] In the kitchen 14, two current sensors 32 are provided which monitor the switching on of certain electrical appliances, for example a stove and an oven, or certain other kitchen appliances.

[0035] A nightlight 34 is provided in the bedroom 18. A bathroom scale 36 is provided in the bathroom 20. In this exemplary embodiment, devices and sensors 22-36 can be wirelessly coupled to the control and communication unit 10, so that the information they capture can be read out or, in the case of the nightlight 34, the same can be activated by the control and communication unit 10.

[0036] The sensors shown, their positioning, and their distribution across the individual rooms are purely exemplary to facilitate understanding of the invention. Additional and / or different sensors can be provided, and these can be distributed differently across the rooms. With appropriate sensors, an assistance system can be implemented that is designed according to claim 1 and can also optionally have the following features.

[0037] The control and communication unit 10 can be configured to establish a local wireless communication network through which it can communicate with at least some of the sensors. This has the advantage that the sensors can be easily distributed throughout the residential area to be monitored and positioned so that they optimally fulfill their respective tasks. Furthermore, defective sensors can be easily replaced, and new sensors can be easily integrated into the system without the need to lay cables.

[0038] The evaluation unit is preferably designed as a non-local computing unit with which the control and communication unit 10 communicates wirelessly or, in particular, via a wired connection. This has various advantages. For example, the hardware requirements in the residential area to be monitored can be minimized, maintenance and updating of the evaluation unit can be simplified (typically, the unit is formed from components located in a data center), and the data transmitted to the evaluation unit via the control and communication unit can be particularly secured, especially in a so-called "IoT" (Internet of Things) system. The algorithms used by the evaluation unit are typically processed in the cloud. If the control and communication unit in the monitored residential area is defective or accidentally disconnected from the power grid, no data can be lost.In addition, the control and communication unit is preferably designed so that it starts automatically when connected to a power supply, eliminating the need for complex startup procedures. Older people who are not tech-savvy in particular sometimes disconnect the control and communication unit to connect another device, such as a vacuum cleaner, to the corresponding socket, and would be overwhelmed by special startup procedures.

[0039] In a preferred embodiment, the control and communication unit is configured to check whether it is connected to a local power grid and, if not, to trigger an alarm according to a predetermined alarm chain. Since the control and communication unit, as a central element of the on-site system, should always be online, this configuration ensures that interruptions in the activity of the control and communication unit are detected. For this purpose, the control and communication unit can have its own communication module and energy storage device to enable communication with the evaluation unit in the event of a disconnection from the local power grid or a power grid failure.

[0040] Alternatively or additionally, it can be provided that the evaluation unit is designed to permanently or intermittently check the functionality of the control and communication unit and, if a functional anomaly is detected, to trigger an alarm according to a predetermined alarm chain.

[0041] Preferably, the control and communication unit is designed to continuously or intermittently test the functionality of the sensors and, upon detection of a functional anomaly, to trigger an alarm according to a predetermined alarm chain. The sensor testing can be performed by the evaluation unit as part of remote maintenance.

[0042] Preferably, the control and communication unit is configured to communicate with the sensors via various communication protocols, in particular via at least some of the following protocols: Wi-Fi, Bluetooth®, Zigbee®, Z-Wave, 6L0WPAN, RFID, Cellular IoT protocols, NB-IOT, 5G, NFC, LoRaWAN, LTE, protocols from the Infrared Data Association (IrDA), and IR remote control protocols from consumer electronics. These protocols can be stored in the control and communication unit or made available for retrieval in the evaluation unit. Ultimately, the only important thing is that commercially available sensors can be connected to the control and communication unit without major installation effort, so that the data they collect can be forwarded to the evaluation unit.

[0043] The control and communication unit typically includes a microphone, a loudspeaker and a display, preferably a touch display, thus allowing auditory and visual communication with the person using the assistance system.

[0044] The sensors used preferably comprise at least two of the following types of sensors: motion detector, presence sensor, fall sensor, temperature sensor, door opening sensor, window opening sensor, current flow sensor to specific electrical devices, weight sensor, blood pressure sensor, infrared sensor, ultrasonic sensor, LIDAR sensor, blood glucose sensor, medication box sensor, refrigerator sensor, toothbrush sensor, smoke detector, CO2 sensor. It should be noted that in an assistance system according to the invention, "dumb" sensors become "smart" because they suddenly possess a logic. For example, an ammeter on a television can indicate that the person using the system is no longer maintaining their usual rhythm (e.g., newscast at 8:00 p.m.). The ammeter thus indirectly acquires a logic, namely via the evaluation unit, and thus becomes smart.

[0045] The evaluation unit is preferably designed to include non-sensor-based data from the database when determining an anomaly and, upon detection of an anomaly, to output any changes in the non-sensor-based data as the context of the anomaly. For example, information about a current medication can be stored in the database as non-sensor-based data. If an anomaly, such as a change in sleep behavior, is detected, the system can inform the person or unit to be alerted according to the respective alarm chain that the anomaly occurred at the same time as or shortly after a change in medication. The evaluation unit is preferably designed to use self-learning algorithms for evaluation. The system thus develops automatically and also adapts to the new living circumstances of the person using the system.

[0046] In another preferred embodiment, the control and communication unit is designed for coupling with smart home control devices. This advantageously allows the system to perform tasks far beyond anomaly detection, and the person using the system does not need to be familiar with different control units.

[0047] In a further preferred embodiment, the control and the system comprises at least one mobile communication device that can be connected to the evaluation unit and / or the control and communication unit and via which a user of the mobile communication device can be shown released information about the person and / or the living area. The mobile communication device can be part of at least one of the at least two alarm chains. The communication device can be a standard smartphone, and the user can be, for example, a close relative of the person using the system. An adult child can thus check at any time whether, for example, his mother in need of care is doing well. Advantageously, the mobile communication device can also be designed to control the smart home control devices after appropriate release by the person using the assistance system. Said son could therefore, for example,control the heating in the living area when he brings his mother back from a visit, so that the living area has the desired temperature upon arrival.

[0048] Preferably, the control and communication device is designed to communicate with the person according to predefined or variable criteria. The variable criteria can be criteria learned from the person's previous behavior and / or state. If necessary and with approval, communication can be established with the person without the person having to actively request it. In this way, for example, certain emotional anomalies can be prevented or remedied. If it is determined, for example, that the person using the system feels lonely, voice-supported conversations can be automatically initiated, the keeping of a gratitude diary (spoken and, if necessary, automatically converted into writing) can be encouraged, and the person can thus be motivated to remember the good things in life. Filtering in the form of so-called sentiment analysis ensures that only positive thoughts are recorded.Stimulating morning and evening conversations can be conducted with the help of a teacher, and the morning and evening can be made more positive with beautiful sayings. It is also possible to encourage the person to play memory-stimulating games that train the brain.

[0049] Preferably, the control and communication unit is also designed to be used as a telephone and / or video telephone.

[0050] The assistance system is advantageously designed so that the person can communicate with the system in natural language. This can be achieved using appropriately supported chatbots, whereby the assistance system advantageously allows the use of available chatbots without special reprogramming.

[0051] If the assistance system communicates with the person automatically, the communication can specifically address a topic from the following list: queries regarding detected abnormalities, reminders of specific appointments and actions, rehabilitation measures, preventive measures, positive psychological interventions, and errand assignments. However, this list of topics is by no means exhaustive. For example, religious or nutrition-related topics can also be discussed with the help of a child. Reminders regarding appointments or actions, such as eating, drinking, or taking medication, can also be issued verbally and simultaneously appear on the screen of the control and communication unit. The reminder can be marked as completed by acknowledging the reminder.

[0052] Preferably, the evaluation unit is designed to draw conclusions from current and historical sensor data about at least some of the following states and abilities of the person using the assistance system: state of health, emotional state, cognitive abilities, ability to live independently.

[0053] The assistance system according to the invention allows information about the condition and behavior of the person using the system to be evaluated to create an overall picture. This information can be shared with other stakeholders such as relatives, doctors, or caregivers.

[0054] Since conversations are often difficult for people who can no longer hear well, the control and communication unit can be equipped with extra-powerful speakers and display all dialogues in clearly legible text on the screen.

[0055] Through the voice assistant and the internet connection, the resident can easily regain access to so-called "digital participation," even if they are no longer able to use IT. Using generative AI, the control and communication unit can conduct natural language dialogues and thus provide information on topics such as nutrition or other advice. Biographical work based on a medical history form is also possible. The system provides advice on how to behave. Memories can also be processed. There are several modes for communicating with the control and communication unit. The system thus makes a significant contribution to managing everyday life independently and safely despite certain health restrictions, while at the same time quickly contacting relatives, caregivers, etc. in emergency situations.This means fun and interaction don't have to be neglected. Cognitive impairments can be identified through long-term monitoring of the behavior of the person using the system. If a person gets up more and more frequently at night and paces around the apartment, they likely have problems structuring their day, which could indicate possible dementia or Parkinson's disease. An integrative approach is a special feature of the system. It is a holistic solution that combines information on activity and behavior profiles to raise the alarm at the right moment or signal a need for support. For example, there are also prompts or instructions to take medication at the right time, turn off the stove, or drink something. The focus here is on prevention.The system not only allows for acute threat prevention but also for monitoring the behavior and / or condition of a person. Behavioral changes are recorded over time to document the person's status. Based on dialogues recorded with consent, the system allows for long-term observation to determine how language changes. Based on the status analysis, an expert can then assess whether the change requires further specialist review. The system takes a holistic approach and supports the individual in managing everyday life.

[0056] Information about health status can be presented as a dashboard and / or a traffic light system. The person using the system can decide who sees which data. Many people, for example, do not want their children to see their specific activities (e.g., number of toilet visits).

[0057] The assistance system can support both prevention and rehabilitation, e.g. after strokes, with activating games and language exercises.

[0058] Fig. 2 shows a system with one of several possible configurations according to the invention. An evaluation unit 10 is connected via a telecommunications network 20 or WAN (Wide Area Network) to smartphones as alarm receiving devices 30 and body-contactless fall sensors 40 and a control and communication unit 50. In Fig.

[0059] 2, for simplicity, only one of the alarm receiving devices and one of the fall sensors is shown. It is understood that the evaluation unit 10 is designed to interact with a wide variety of control and communication units in different living areas.

[0060] The control and communication unit 50 has an audio input and output device 52 with loudspeaker and microphone, a processor 51 in conjunction with a known memory unit 56 for inputting and reading data and commands, and a touchscreen 54 for further inputs and / or outputs via display.

[0061] The evaluation unit 10 comprises a database 60 in which residential addresses are assigned to the control and communication unit 50 and at least one of the fall sensors 40 for linking each of the fall sensor outputs and the audio outputs and inputs of the control and communication unit to one of the residential addresses, an IoT hub 7 with APIs for the fall sensor outputs 70, only one of which is shown in Fig. 2, a speech processor unit 80 for converting a stored text sequence into the audio output and the audio input into another stored text sequence for voice control, an alarm unit 82 using the APIs for the fall sensor outputs 70 and implementing the following functions:

[0062] Receiving the fall sensor outputs using the fall sensor output APIs 70,

[0063] Initiating a voice dialogue on the control and communication unit 50 according to the alarm chain and, if necessary, sending a call for help with the residential address according to the link, if at least one condition is met, including the condition that a received fall sensor output signals an alarm, in particular a fall alarm,

[0064] Cancel the alarm when a refusal of help is detected, send the call for help to the alarm receiving device 3 according to the scheduling.

[0065] In the illustrated embodiment, the fall sensor 40 is part of a fall detection system configured with the network 20, and the fall sensor outputs are evaluations of, for example, infrared images from a sensor in the apartment. The API 70 is then configured as a gateway for receiving the evaluations from the evaluation unit.

[0066] The evaluation unit 10 also includes a helper database 62, in which a list of helper contacts with ranking and helper availability times is assigned to each residential address. The evaluation unit 10 is configured with a helper database module 94 to allow authorized form-based remote access to the helper database 62 and thus serve as a portal for authorization-dependent access to the helper database 62 for deleting, changing, reading, and / or adding to it. This also allows helper availability periods to be managed, in particular entered.

[0067] The function of sending the call for help is set up to create a selection of the helper contacts in the list, including their assigned helper availability times, to send the call for help and request an acknowledgment to one of the alarm receiving devices 30 corresponding to the highest-ranking helper contact in the selection according to the ranking order, to check the receipt of the acknowledgment and the number of helper contacts in the selection and to update the selection if the number is greater than 1 and if there is no acknowledgment for a predetermined period of time, namely by removing an entry corresponding to the highest-ranking helper contact, to repeat the sending of the call for help and the request for acknowledgment.

[0068] With a wireless connection to the control and communication unit 50, additional sensors 42, 44 are connected to the processor of the control and communication unit for transmitting additional sensor outputs, as are the audio input and audio output device 52. In the database, the link is further a link between the additional sensor outputs and one of the residential addresses. The evaluation unit 10 also includes APIs for the additional sensor outputs 72, only one of which is shown in Fig. 2.

[0069] The evaluation unit 10 also includes an analysis unit 84 implementing the following functions:

[0070] Creating profiles that are specific to addresses under the residential addresses, based on the link and with the other sensor outputs and, if applicable, the fall sensor output, and

[0071] Recording and classifying temporal changes in profiles.

[0072] The other sensors 42, 44 are sensors for monitoring the smearing of doors and / or the switching on of power consumers such as a stove.

[0073] The evaluation unit 10 also includes a classification adaptation module 96 to serve as a portal for authorization-dependent access to the classifications for reading and / or to factors of the classifications for reading, changing, deleting, or supplementing through authorized form-based remote access. The function of triggering a voice dialog and providing a call for help is advantageously a function that requires the condition that the classification signals danger.

[0074] The evaluation unit 10 comprises a machine learning unit 86 implementing the following functions:

[0075] Collecting feedback information by collecting for a set of addresses under the residential addresses of the deletion or supplementing factors of the classifications,

[0076] Updating the classification factors for the set of addresses, repeating the collection of feedback information and updating the classification factors with iteration of the classification factors to minimize an extent of the recorded de-alerting and / or deleting or adding the classification factors.

[0077] The evaluation unit 10 also includes an appointment reminder unit 88 for providing appointment reminders via audio output. The server unit 1 also includes a voice input unit 90 with a function, for example, to supplement the profiles via voice input. The evaluation unit 10 is also configured as a portal for form-based remote settings of queries for voice input in order to supplement the profiles or, via a classification module 96, to be able to adjust classifications, in particular associated factors or weightings, via the portal in a form-based and authorization-dependent manner. The evaluation unit 10, with the appointment reminder unit 88, is also configured as a portal for setting appointment reminders in an authorization-dependent manner. For example, voice queries for blood pressure readings can be configured, or reminders for food and / or fluid intake.

[0078] In the control and communication unit 50, the processor 51 is connected to a memory such as a flash memory 56 containing the required operating system, drivers, and applications. In this exemplary embodiment, the evaluation unit 10 includes a chatbot 92 for interacting with the audio output and input unit 52, particularly for language games.

[0079] The control and communication unit 50 also includes a touchscreen 54 as a display (not shown).

[0080] Fig. 3 is a process diagram consistent with a method according to the invention. Vertical lines divide the process diagram into processes in an apartment (shown on the left), processes of interaction with an assistant outside the apartment (shown in the middle), and processes in the evaluation unit 10 shown in Fig. 1 (shown on the right).

[0081] The method illustrated in Fig. 3 is a method for operating the network of hardware units schematically depicted in Fig. 2, with data connections provided from the fall sensor 40 to the evaluation unit 10, between the control and communication unit 50 and the evaluation unit 10, and from the latter to the alarm receiving device 30. The following steps are performed using the alarm unit 82:

[0082] 51 Receiving fall sensor outputs using the fall sensor output APIs 70,

[0083] 52 Initiating a voice dialogue on the control and communication unit 50 according to the link and terminating a sending of a call for help with indication of one of the residential addresses according to the link, specifically if at least one condition is present, comprising the condition that a received fall sensor output signals a fall,

[0084] 53 Execution of the speech dialogue on the control and communication unit 50 when accessing a speech processor unit 80,

[0085] S13 Cancellation of termination by the voice control when the further text sequence is recognized as a rejection of help,

[0086] S6 Sending the call for assistance to the alarm receiving device 3 according to the scheduling. A fall sensor 40 provides a fall sensor output in step S1, signaling a fall event. A system can also be used for the fall sensor output in which a sensor unit in the apartment is connected to a cloud-based fall sensor platform, which ultimately provides the fall sensor output in step S1.

[0087] To receive the fall sensor output, an API 70 is provided in the evaluation unit, which allows the evaluation unit, based on the fall sensor output, to proceed with the S2 triggering of a voice dialog on the control and communication unit 50 located in the same apartment as the fall sensor 40 or its sensor unit. The database 60 ensures, via linking, that the voice dialog is triggered precisely on this control and communication unit 50 located in this apartment. This occurs under the condition that one of the received fall sensor outputs signals a fall. The voice dialog is then executed in step S3 on this control and communication unit 50. For this purpose, audio streaming is set up between the control and communication unit 50 and the evaluation unit 10. The voice dialog is thus executed in step S3 via the control and communication unit 50 accessing this voice processor unit 80.The speech processor unit 80 can also be one that interacts with a cloud-based speech recognition service. The voice dialogue is executed in step S3 on this control and communication unit 50 in order to be able to provide feedback from a person in the apartment to the evaluation unit 10. Both when a request for help is received as feedback and upon expiration of a predetermined period of time after triggering step S3, an alarm confirmation is received by the evaluation unit 10 in step S4. As described above, the evaluation unit 10 is configured with a helper database 62 in which each residential address is assigned a list of helper contacts with a ranking and helper availability times. When the alarm confirmation is received, a selection of the currently available helper contacts from the list is created in step S4.

[0088] In step S6, the call for help is sent and a confirmation request is made to one of the alarm receiving devices corresponding to the highest-ranking helper contact of the selection according to the ranking order. For this purpose, an email and an SMS are sent to a smartphone of an assistant and received there in step S7. According to the process described above, a call for help is scheduled, specifying one of the residential addresses according to the link, and specifically if at least one condition is met, including the condition that a received fall sensor output signals a fall. Advantageously, scheduling can also be brought forward upon recognition of the further stored text sequence as a request for help.

[0089] Using a browser-based application on the smartphone of an assistant, the assistant sends in step S8 a confirmation triggering step S10 in the evaluation unit 10 or a rejection triggering step S9 in the evaluation unit 10.

[0090] Alternatively, via the process flow from step S7 bypassing step 8, a rejection triggering step S9 in the evaluation unit 1 is automatically carried out after the expiry of a predetermined period of time after step S6 in which step S10 was not carried out.

[0091] Alternatively, executing the voice dialog S3 with voice control allows the cancellation of the scheduling by voice control upon detection of a refusal of assistance. Thus, the scheduling of a call for assistance is canceled by voice control in step S13, if necessary, even after it has been sent. A triggered alarm can be marked as a false alarm or non-critical. Additionally, it is provided that, by entering a value in step S12 on a smartphone, the scheduling of a call for assistance can be canceled in step S13, if necessary, even after it has been sent. Scheduling means specifying that and from what point in time alarm messages are to be sent according to step S6.

[0092] Additionally, it is provided that by input S14 on the touchscreen 54 provided on the control and communication unit 50 or, if appropriate, alternatively, a button provided on the control and communication unit or by voice control in step S15, the scheduling of a call for help can be canceled, if necessary, even after it has been sent. In step S5, a check is made as to whether the scheduling has been canceled. If the scheduling has not been canceled, step S5 checks whether the number of helper contacts in the selection is greater than 1. In step S5, the selection is updated if the number is greater than 1 and if there is no confirmation for a predetermined period of time, as signaled by step S9.The update is performed by removing an entry corresponding to the highest-ranking helper contact, which update is then followed by step S6 to alert the next helper, whereas otherwise, if the number is 1, step S6 is bypassed and the already alerted helper is alerted again.

[0093] Thus, functions or steps are implemented in the evaluation unit to check the receipt of the confirmation and the number of helper contacts in the selection and to update the selection if the number is greater than 1 and if there is no confirmation for a predetermined period of time, namely by removing an entry corresponding to the highest-ranking helper contact, to repeat the sending of the help call and the request for confirmation.

[0094] Confirmation in step S8 also triggers the display S11 of a message on the touchscreen 54 of the control and communication unit 50 regarding the assistance person's confirmation. Step S10 cancels the scheduling of a call for help, and the assistance person is further requested to consult via a message on the smartphone. Because the scheduling of a call for help is canceled, it is ensured that no further alarm can be sent after step S5 with step S6. A function or method part can also be provided so that, after the scheduling of a call for help is canceled, it is ensured that no further alarm can be sent after step S5 with step S6, a message is sent to all assistance persons for whom step S6 was performed and from whom no confirmation was received via step S10.These assistants can then be informed that an alarm has been resolved. Consultation takes place via a voice call between the smartphone and the control and communication unit 50, which is also equipped with a dedicated voice call and telephone function. The assistant then decides and either initiates step S13 with the smartphone or comes into the apartment. After assistance has been provided, input S14 is then made on a touchscreen 54 provided on the control and communication unit or, if necessary, alternatively, a button provided on the terminal device or via voice control, which input in step S15 cancels the scheduling of a call for assistance (possibly even after a call for assistance has been sent).

[0095] The server device, in particular the said portal and / or the relevant form-based inputs via the units or modules 88, 94 may be configured according to one or more of the following features or functions:

[0096] Edit user profile including two-factor authentication, set appointments including voice reminders, set medication including voice reminders, view medication plan, set drinking reminders including voice reminders or drinking sounds, data acquisition and evaluation, particularly of sensor outputs, manage sensors, particularly via classification adaptation module 96, monitor vital signs based on sensor outputs, manage authorizations for relatives and care services, event analysis based on sensor outputs, alarm processing, user management, alarm chain management, device management, remote access to control and communication units, particularly via teleport,

[0097] Remote software updates on control and communication units, data migration. For this purpose, the times recorded for each visible sensor output, especially fall sensor output, can be recorded by the evaluation unit 10, saved, and made available in the portal.

[0098] The following APIs can be set up in the evaluation unit 10 APIs for voice interfaces, especially for voice control, such as

[0099] API Twilio SMS, WhatsApp and phone calls,

[0100] API Vayyar fall sensor,

[0101] API Withings or Nokia.

[0102] The following techniques, features and products can be used to implement the evaluation unit 10:

[0103] Domain Driven Design, distributed streaming solution with Kafka including data replication, data aggregation, partitioning, load balancing and fault tolerance,

[0104] Identity management with Keycloak including 2FA, OpenID Connect, OAuth2, authentication and authorization,

[0105] Microservice architecture with Kubernetes and Docker, secure connection between end device and cloud via Azure IoT Hub, automatic data synchronization between portal and end device, device simulator, data analysis | AEDLs, Quartz system scheduler.

[0106] The step S11 described above preferably shows transparently how an alarm chain is processed and who will take care of this case.

[0107] For sensor outputs, interfaces can be implemented via Bluetooth to a scale, a blood pressure monitor, and a blood glucose monitor. Vital data can be transmitted completely device-independently via the audio input and output device and with the help of the speech processor unit 80. This promotes participation, personal responsibility, and offers the possibility of continuing to use familiar devices. Example texts for the alarms according to step S6 described above are:

[0108] Fall: "Fall alert for Mrs. Maria Mustermann, Exampleweg 14, 12345 Somewhere, Time: 7:20 PM, August 12, 2020, Tel. +49 1234 567891011 or +49 9876 543210. Are you concerned? 1=Yes, 9=No."

[0109] Dangerous situation: "Ms. Maria Mustermann, Exampleweg 14, 12345 Somewhere, Germany, has been noticeably inactive for a long time, 7:20 PM on August 12, 2020. Tel. +49 1234 567891011 or +49 9876 543210. Are you concerned? 1=Yes, 9=No."

[0110] Vital signs: "Unusually high blood pressure 167 / 102 for Ms. Maria Mustermann, Exampleweg 14, 12345 Somewhere, Time: 7:20 PM, August 12, 2020, Tel. +49 1234 567891011 or +49 9876 543210. Are you concerned? 1=Yes, 9=No."

[0111] Advantageously, step S6 can be used to send an alert to another application via API. The German emergency service Malteser uses its own system to manage incoming emergency calls. This system can then be addressed via the configurable API, and an API for reporting the alarms can also be provided.

[0112] In addition to the touchscreen 54, the evaluation unit 10 can advantageously also control outputs to smart home devices such as lighting devices via the control and communication unit 50, also in response to some of the sensor outputs and / or to voice inputs into the audio input and output unit 52 and, if necessary, also according to settings that are offered to the evaluation unit 10 via the portal in a form-based and authorization-dependent manner.

Claims

PATENT CLAIMS 1. Multifunctional assistance system, in particular for persons living alone, comprising a number of sensors distributed in a living area of ​​a person using the assistance system for monitoring predefined activities and predefined parameters, a control and communication unit provided in the living area for communicating with the sensors and the person, a database with non-sensor-based information about the person and at least two different alarm chains, and an evaluation unit for evaluating sensor data transmitted via the control and communication unit, wherein: the evaluation unit can access the database and is designed to detect any anomalies in the behavior and / or condition of the person from the sensor data,to classify the anomalies into at least two categories and, based on the categorization, to trigger an alarm according to at least one of the at least two alarm chains.

2. Assistance system according to claim 1, characterized in that the control and communication unit is designed to establish a local wireless communication network via which it can communicate with at least some of the sensors.

3. Assistance system according to claim 1 or 2, characterized in that the evaluation unit is designed as a non-local computing unit with which the control and communication unit communicates wirelessly or wired.

4. Assistance system according to one of claims 1-3, characterized in that the control and communication unit is designed to check whether it is connected to a local power supply network and, if not, to trigger an alarm according to a predetermined alarm chain.

5. Assistance system according to one of claims 1 - 4, characterized in that the control and communication unit is prepared to communicate with the sensors via various communication protocols, in particular via at least some of the following protocols: Wi-Fi, Bluetooth®, Zigbee®, Z-Wave, 6L0WPAN, RFID, Cellular IoT protocols, NB-IOT, 5G, NFC, LoRaWAN, LTE, protocols from the Infrared Data Association (IrDA), and IR remote control protocols from consumer electronics.

6. Assistance system according to 1 - 5, characterized in that the control and communication unit comprises a microphone, a loudspeaker and a display, preferably a touch display.

7. Assistance system according to one of claims 1 - 6, characterized in that the sensors comprise sensors from at least two of the following types of sensors: motion detector, presence sensor, fall sensor, temperature sensor, door opening sensor, window opening sensor, current flow sensor to certain electrical devices, weight sensor, infrared sensor, ultrasonic sensor, LIDAR sensor, blood pressure sensor, blood sugar sensor, medication box sensor, refrigerator sensor, toothbrush sensor, smoke detector, CO2 sensor.

8. Assistance system according to one of claims 1 - 7, characterized in that the evaluation unit is designed to include non-sensor-based data from the database when determining the anomaly and, upon detection of an anomaly, to output any changes in the non-sensor-based data as the context of the anomaly.

9. Assistance system according to one of claims 1-8, characterized in that the evaluation unit is designed to use self-learning algorithms for evaluation.

10. Assistance system according to one of claims 1 - 9, characterized in that the control and communication unit is designed for coupling with smart home control devices.

11. Assistance system according to one of claims 1-10, characterized in that it comprises at least one mobile communication device that can be connected to the evaluation unit and / or the control and communication unit and via which a user of the mobile communication device can be shown released information about the person and / or the living area.

12. Assistance system according to claim 11, characterized in that the mobile communication device is part of at least one of the at least two alarm chains.

13. Assistance system according to claim 10 and one of claims 11 or 12, characterized in that the mobile communication device is designed to control the smart home control devices after appropriate release by the person using the assistance system.

14. Assistance system according to one of claims 1 - 13, characterized in that the control and communication device is designed to communicate with the person according to predefined or variable criteria.

15. Assistance system according to one of claims 1 - 14, characterized in that the system is designed so that the person can communicate with the system in natural language.

16. Assistance system according to one of claims 14 or 15, characterized in that the communication with the person concerns at least one topic from the following list of topics: queries regarding detected anomalies, reminders of specific appointments and actions, rehabilitation measures, preventive measures, positive psychological intervention, ordering of errands.

17. Assistance system according to one of claims 14 - 16, characterized in that the variable criteria are criteria learned from the previous behavior and / or condition of the person.

18. Assistance system according to one of claims 1-17, characterized in that the control and communication unit has its own communication module and an energy storage device in order to be able to communicate with the evaluation unit in the event of a disconnection from the local power grid or a power grid failure.

19. Assistance system according to one of claims 1-18, characterized in that the evaluation unit is designed to permanently or intermittently check the functionality of the control and communication unit and, upon detection of a functional anomaly, to trigger an alarm according to a predetermined alarm chain.

20. Assistance system according to one of claims 1-19, characterized in that the control and communication unit is designed to check the functionality of the sensors permanently or intermittently and, upon detection of a functional anomaly, to trigger an alarm according to a predetermined alarm chain.

21. Assistance system according to one of claims 1-20, characterized in that the evaluation unit is designed to draw conclusions from current and historical sensor data about at least some of the following states and abilities of the person using the assistance system: state of health, emotional state, cognitive abilities, ability to live independently.

22. Assistance system according to one of claims 1 - 21, characterized in that the control and communication unit is designed to be used as a telephone and / or video telephone.

23. Assistance system according to one of claims 1-22, characterized in that the at least one alarm chain is a continuously updated alarm chain.

24. Control and communication unit for an assistance system according to one of claims 1 - 23.

Images