Interactive device for information management

The interactive device addresses the lack of autonomous operation and security in current systems by using a metahuman interface with local AI for secure and customizable information management, enhancing usability and security for non-technical users across various applications.

WO2024240977A1PCT designated stage expired Publication Date: 2024-11-28VIRTUAL IMMERSIVE SL
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/ES2024/070298
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-25
Filing Date
2024-05-17
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Current interactive information management devices lack autonomous operation and self-learning capabilities, requiring professional programming and lacking sufficient confidentiality and security, especially for non-technical users.

Method used

An interactive device equipped with a display screen, microcontroller, microphone, video camera, and local artificial intelligence engine with natural language processing and self-learning capacity, connected to a database, allowing for autonomous operation and secure information management through a metahuman interface, including voice and facial recognition for user authentication.

Benefits of technology

Facilitates easy information management for non-technical users with minimal learning, ensuring confidentiality and security, offering customization options and secure access through voice and facial recognition, enabling multiple uses from domestic to commercial applications.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure ES2024070298_28112024_PF_FP_ABST
    Figure ES2024070298_28112024_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to an interactive device for information management that is suitable for storing, searching and subsequently retrieving different types of information. Said device can operate autonomously and has a display screen, which is optionally behind a mirror and can display a metahuman that can visually and acoustically interact with a user, simulating human behaviour, using a local artificial intelligence engine by means of which information provided by the user, through a microphone and / or video camera, can be stored in and retrieved from a database. This invention facilitates the use of databases, and information management, for non-technical individuals with a minimal learning curve, through the interactive use of a metahuman, in a way similar to having a conversation with another human being, allowing the device to be fully integrated into home environments with a guarantee of confidentiality and security for the stored data and personal information.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Interactive device for information management

[0002] This specification refers, as its title indicates, to an interactive device for information management, suitable for use in storing, searching and subsequently retrieving various types of information, capable of autonomous operation, equipped with a display screen, optionally behind a mirror, capable of showing a metahuman capable of interacting with the user visually and acoustically, simulating human behavior by means of a local artificial intelligence engine to store and retrieve in a database information supplied by the user through a microphone and / or a video camera.

[0003] Field of the invention

[0004] The invention relates to the field of interactive information management devices equipped with artificial intelligence engines that use realistic image representations of humans as a communication element.

[0005] Current state of the art

[0006] Nowadays, the use of images representing real or imaginary human beings is known and widely used in the information sector, for example as an information kiosk in ES2233127 “Intelligent interactive information system”, as systems for clothing selection and sale in DE19635753A1 “Virtual imaging device for selecting clothing from catalogue” and in US2014108208 “Personalized virtual shopping assitanf', or as virtual assistants through avatars for multiple and generic applications, as in ES2346118 “Multimedia interactive system for E-commerce” EP4080327A1 “Method involving virtual assitanf'.

[0007] Personal information management systems are also well-known, such as W00150387A1 “Personal advice system and method”, although they do not use avatars or human representations as an interface.

[0008] We can also find realizations such as in US2005206610A1 “Computer- reflected (avatar) mirror 1 ', which generates a reflected image in the form of an avatar of the user in real time, or equipment such as those described in KR20190068146A “Smart mirror display device", or KR20200144821 A “Smart mirror 1 ' that uses an avatar and voice to accompany, observe, and protect the elderly and others in need of care, and can provide voice while generating an avatar from photos of a user and family members.

[0009] Some of these devices use a mirror, sometimes called a "smart" mirror, which consists of a semi-transparent mirror placed completely or partially in front of a computer screen to display information, in some cases in the form of an avatar, and which can be used for various purposes. Thus, we find equipment available on the market from the company STUDIO® (LULULEMON®) https: / / www.mirror.co, which presents an interactive mirror for physical exercise and training, or the companies DOKUOS® https: / / www.dokuos.com and LUFTSCREEN® https: / / www.luftscreen.com.mx, which have interactive mirror screens for different applications. Similarly, the companies DIGALIX® https: / / www.digalix.com / es / and ABYSS GLASS® https: / / abyssqlass.com also present interactive mirrors, for use as information or training points.

[0010] However, none of these devices have the ability to self-learn or operate using local AI, nor do they have a database that provides the necessary autonomous operation with sufficient confidentiality and security. Furthermore, since they lack the ability to self-learn from the user, programming the stored data and information can only be performed by a professional technician for that particular device and brand.

[0011] Description of the invention

[0012] To solve the current problems in information management, especially for non-technical people, the interactive device for information management object of the present invention has been devised, which comprises

[0013] - a display screen provided with audio playback means associated with at least one microcontroller, a microphone and a video camera, the microphone and video camera being disconnectable by the microcontroller,

[0014] - connection to an artificial intelligence (AI) engine with natural language processing capabilities and self-learning capabilities (also known as “machine learning”), and

[0015] - connection to at least one database, the display screen being capable of showing a metahuman, a metahuman being understood as a three-dimensional and photorealistic virtual image created by a computer of a person, and being capable of reproducing a synthesized human voice through the audio reproduction means, the local artificial intelligence engine being capable of storing and retrieving in the database information supplied by the user through the microphone and the video camera, and the microcontroller being capable, by means of the local artificial intelligence engine, of interacting with the user through the metahuman and the synthesized human voice through the audio reproduction means.

[0016] The artificial intelligence engine and database can be located locally on the same module as the display screen and microcontroller, forming a standalone device, or they can be located on a remote module or server connected via digital communication media.

[0017] An alternative embodiment of the invention is envisaged in which, through digital communication means, for example any type of internet access, wired connection, Wi-Fi, etc., the microcontroller, and its local artificial intelligence engine, where applicable, are capable of connecting to exchange or obtain information also with auxiliary databases or artificial intelligence engines.

[0018] In an alternative embodiment, the display screen and video camera are located behind a semi-transparent mirror, so that when the device is not active and the metahuman is not being displayed, it can be used as a normal mirror, perfectly integrating into the interior as an additional element. This would be an embodiment specifically designed for domestic use.

[0019] To enable its activation and use, the microcontroller may have voice recognition capabilities via the microphone and facial recognition capabilities via the video camera, such that the device can only be used by authorized users. To this end, the microcontroller will also store security parameters for the user or users authorized for the device's operation in the database. If the device can be used with multiple users, the microcontroller is also expected to store a different metahuman in the database for each user, using the one corresponding to the currently active user at all times.

[0020] Advantages of the invention

[0021] This interactive information management device presented here offers multiple advantages over currently available systems, the most important of which is that it facilitates the use of databases and information management systems for non-technical people with a minimal learning curve, thanks to the use of a metahuman in an interactive manner, similar to a conversation with another human being, which enables its complete integration, especially in domestic environments.

[0022] Another of the most important advantages is that, thanks to the possibility of autonomous operation, in case of domestic and personal use, we have every guarantee of sufficient confidentiality and security of our stored data and personal information.

[0023] Another notable advantage is its great capacity for customization, making it possible to use different metahuman images for each user. This image can be either a generic image, created by artificial intelligence, or an image obtained from the user's own real image or even from another person. It is also possible to even use a more simplified version, or "avatar", comic-style, thus generating a pleasant and familiar environment for the user.

[0024] Another important advantage is that when made with a semi-transparent mirror, it can also be used as a normal mirror, integrating perfectly into the decor as an additional element, allowing for domestic use.

[0025] Another advantage of the present invention is that it has security means both for the use of the device and for access to information, enabling blocking for children or unauthorized persons, through the use of voice recognition and facial recognition combined with security parameters of the user or users authorized for the operation of the device stored in the database. It is also important to highlight the possibility of multiple uses as an information management element, especially thanks to its self-learning capacity, being able to provide it with information, which the microcontroller will store in the database along with a collection of pre-recorded basic data, and which we can search and retrieve later when we need it thanks to the local artificial intelligence engine, through the metahuman in an interactive conversation.This allows for multiple uses at a domestic level, such as a diary, address file, telephone numbers, recipes, etc., as well as at a commercial level, as an information and sales point for products or services, or at an industrial or business level, used as an interactive terminal for an ERP enterprise resource planning software and / or CRM customer relationship management software, enabling and facilitating multiple operations such as consultations on employment agreements, requests for vacations, communication of events or happenings, etc.

[0026] Description of the figures

[0027] In order to better understand the object of the present invention, a preferred practical embodiment of an interactive device for information management is represented in the attached drawing.

[0028] In said drawing, figure -1- shows a simplified generic block diagram of the device, in an embodiment with the artificial intelligence engine and the database located locally in the same autonomous device.

[0029] Figure -2- shows a simplified generic block diagram of the device in an embodiment with the artificial intelligence engine and database located on a remote module or server.

[0030] Figure -3- shows a front and side view of the device, in its version for home use behind a mirror.

[0031] Figure 4 shows a representation of the device, in its embodiment for domestic use behind a mirror, in its deactivated use as a mirror, and in its activated use with the metahuman. Preferred embodiment of the invention

[0032] The constitution and characteristics of the invention may be better understood with the following description made with reference to the attached figures.

[0033] As can be seen in figures 1 and 2, it is illustrated how the interactive device for information management comprises

[0034] - a display screen (1) provided with audio reproduction means (2) associated with at least one microcontroller (3), a microphone (4) and a video camera (5), the microphone (4) and the video camera (5) having means for connection and disconnection from the microcontroller (3),

[0035] - connection to an artificial intelligence engine (6) with natural language processing and self-learning, and

[0036] - connection to at least one database (7), having graphic and computer simulation means to show on the visualization screen (1) a metahuman (8), understanding by metahuman a three-dimensional and photo-realistic virtual image created by computer of a person, and having means of synthesizing human voice through the audio reproduction means (2), the microphone (4) and the video camera (5) being means of obtaining and storing information supplied by the user in the database (7) for the artificial intelligence engine (6), the artificial intelligence engine (6), the metahuman (8) on the visualization screen (1) and the human voice synthesized through the audio reproduction means (2) being means of interacting with the user and of recovering information stored in the database (7).

[0037] The image used for the metahuman (8) may be either a generic image, created by artificial intelligence, or an image obtained from the user's own real image or that of another person. It is also possible that, in an alternative embodiment, the metahuman (8) is a more simplified version, or "avatar."

[0038] In a preferred embodiment of the invention, illustrated in Figure 1 , especially for use in domestic environments, the device is capable of fully autonomous operation, without depending on either databases or external artificial intelligence engines. To this end, the artificial intelligence engine (6) and the database (7) are located locally in the same module as the display screen (1) and the microcontroller (3), forming an autonomous device.

[0039] An alternative embodiment of the invention is also provided, which is illustrated in Figure 2, in which the artificial intelligence engine (6), the database (7), or both, are located in a remote module or server (14) connected by means of digital communication means (9).

[0040] Likewise, it is provided that optionally, through digital communication means (9), for example any type of internet access, wired connection, Wi-Fi, etc., the microcontroller (3), and its local artificial intelligence engine (6) where appropriate, are capable of connecting to exchange or obtain information also with one or several auxiliary artificial intelligence engines (10), with an external server (11) equipped with one or several general databases (12), or with an external server (11) equipped with ERP business resource planning software, CRM customer relationship management software, or both.

[0041] It is also planned that the display screen (1), when operational, shows digital, analog data, or a combination of both, simultaneously with the metahuman (8).

[0042] An alternative embodiment is planned, as illustrated in figures 3 and 4, in which the display screen (1) and the video camera (5) are located behind a semi-transparent mirror (13), such that when the device is not active, and the metahuman (8) is not displayed, it can be used as a normal mirror, being perfectly integrated into the decoration as another element. This would be an embodiment especially designed for domestic use.

[0043] To allow its activation and use, the microcontroller (3) may have voice recognition through the microphone (4), and / or facial recognition through the video camera (5), so that the device can only be used by authorized users. For this purpose, the microcontroller (3) will also store in the database (7) security parameters of the user or users authorized for the operation of the device.

[0044] In the event that the device can be used with several users, it is planned that the microcontroller (2) has stored in the database (7) a different metahuman (8) for each user, using at all times the one corresponding to the current active user.

[0045] This invention enables multiple uses as an information management element, especially thanks to its self-learning capacity, being able to supply it with information, which the microcontroller (3) will store in the database (7) together with a collection of pre-recorded basic data, and which we can search and retrieve later when we need it thanks to the artificial intelligence engine (6), through the metahuman (8) in an interactive conversation. This allows multiple uses at a domestic level, such as a diary, address file, telephone numbers, recipes, etc., such as at a commercial level, as a point of information and sale of products or services, or at an industrial or business level, used as an interactive terminal for an ERP business resource planning software and / or CRM customer relationship management software, enabling and facilitating multiple operations such as consultations on employment agreements, requests for vacations, communication of events or occurrences, etc.

[0046] The person skilled in the art will readily understand that he or she may combine features of different embodiments with features of other possible embodiments, provided that such a combination is technically possible.

[0047] All information relating to examples or embodiments forms part of the description of the invention.

Claims

CLAIMS 1 - Interactive device for information management, characterized in that it comprises - a display screen (1) provided with audio reproduction means (2) associated with at least one microcontroller (3), a microphone (4) and a video camera (5), the microphone (4) and the video camera (5) having means for connection and disconnection from the microcontroller (3), - connection to an artificial intelligence engine (6) with natural language processing and self-learning, and - connection to at least one database (7), having graphic and computer simulation means to display on the visualization screen (1) a metahuman (8), understanding by metahuman a three-dimensional and photo-realistic virtual image created by computer of a person, and having means of synthesizing human voice through the audio reproduction means (2), the microphone (4) and the video camera (5) being means of obtaining and storing information supplied by the user in the database (7) for the artificial intelligence engine (6), the artificial intelligence engine (6), the metahuman (8) on the visualization screen (1) and the synthesized human voice through the audio reproduction means (2) being means of interacting with the user and of recovering information stored in the database (7). 2 - Interactive device for information management, according to claim 1, characterized in that the artificial intelligence engine (6) and the database (7) are located locally in the same module as the display screen (1) and the microcontroller (3), forming an autonomous device. 3 - Interactive device for information management, according to claim 1, characterized in that the artificial intelligence engine (6), the database (7), or both, are located in a remote module or server (14) connected by means of digital communication (9). 4 - Interactive device for information management, according to any of the preceding claims, characterized in that it comprises digital communication means (9) with one or several auxiliary artificial intelligence engines (10). 5 - Interactive device for information management, any of the preceding claims, characterized in that it comprises digital communication means (9) with an external server (11) equipped with one or several general databases (12). 6 - Interactive device for information management, according to any of the previous claims, characterized in that it comprises digital communication media (9) with an external server (11) equipped with ERP business resource planning software, CRM customer relationship management software, or both. 7 - Interactive device for information management, according to any of the previous claims, characterized in that the display screen (1) shows digital, analog data, or a combination of both, simultaneously with the metahuman (8). 8 - Interactive device for information management, according to any of the previous claims, characterized in that the display screen (1) and the video camera (5) are located behind a semi-transparent mirror (13). 9 - Interactive device for information management, according to any of the preceding claims, characterized in that the microcontroller (3) has voice recognition through the microphone (4). 10 - Interactive device for information management, according to any of the preceding claims, characterized in that the microcontroller (3) has facial recognition using the video camera (5). 11 - Interactive device for information management, according to any of the preceding claims, characterized in that the microcontroller (3) stores in the database (7) security parameters of the user or users authorized for the operation of the device. 12 - Interactive device for information management, according to any of the preceding claims, characterized in that the metahuman (8) displayed on the display screen (1) is obtained from the real image of the user. 13 - Interactive device for information management, according to any of the preceding claims, characterized in that the microcontroller (2) has a different metahuman (8) stored in the database (7) for each user, using the one corresponding to the current user at all times.

Citation Information

Patent Citations

  • Intelligent mirror based on sensory identification and information pushing

    CN111861681A

  • SYSTEM AND Electronic Device For Displaying Trademark based on NFT

    KR1020240047244A

  • Smart mirror

    US20180253840A1

  • System and method for artificial intelligence (AI) assisted activity training

    US20220076666A1

  • Method and system of capturing and coordinating physical activities of multiple users

    US20230071274A1