Method to operate an assistance device, computer program product, non-transitory computer-readable storage medium and assistance device

The assistance device with a relational reasoning device using a large language model addresses the challenge of personal data sharing by evaluating relational states to ensure controlled and privacy-respecting data exchange.

GB2640265APending Publication Date: 2025-10-15MERCEDES BENZ GROUP AG
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
GB2024005040
Authority / Receiving Office
GB · GB
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-09
Publication Date
2025-10-15

AI Technical Summary

Technical Problem

Large language models lack the ability to perform relational reasoning for determining appropriate sharing of personal data between individuals in conversational situations.

Method used

An assistance device equipped with a relational reasoning device using a large language model evaluates the relational state between identities to determine the release state of individual-related data based on past interactions and general openness, allowing controlled sharing of data.

Benefits of technology

Automates the verification of personal data sharing, ensuring confidentiality and privacy by determining the extent and anonymization of data sharing based on relational states.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The invention relates to operation of an assistance device such as a virtual assistant. Receiving, by a communication device of the assistance device, a task message associated with a first identity comprising a task to communicate with a module associated with a second identity to achieve a task aim, the task maybe to book an appointment between a first identity and a second identity. Evaluating, by the communication device, individual-related data, related to the first identity necessary to achieve the task aim. Evaluating a release state based on a relational state between the first identity and the second identity. The relation state between the two identities may be based on communication messages between the first identity and the second identity and what individual related data was in the prior communications. Providing, by the communication device at least one communication message to the module associated with the second identity according to the task aim including the individual-related data according to the release state.
Need to check novelty before this filing date? Find Prior Art

Description

FIELD OF THE INVENTION

[0001] The present invention relates to a method to operate an assistance device. Furthermore, the present invention relates to a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as to a corresponding assistance device. BACKGROUND INFORMATION

[0002] Individuals are constantly reasoning about their relationships with other individuals in order to determine what individual-related data they want to share with which other individual. This process is very complex, but also very fundamental to master in conversational situations. The current state of large language models is very promising for solving several problems, but this aspect seems to be unsolved at the moment. If a large language model is to act as my assistant in making restaurant reservations, arranging business appointments, or answering questions from colleagues about my work products, it will need to perform this kind of relational reasoning to learn what information is fine to share with whom. SUMMARY OF THE INVENTION

[0003] It is an object of the invention to provide a method, a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as an appropriate assistance device with which a provision of personal data may be verified.

[0004] This object is solved by a method, a corresponding computer program product, a corresponding non-transitory computer-readable storage medium, as well as a corresponding assistance device according to the independent claims. Advantageous embodiments are presented in the dependent claims.

[0005] One aspect of the invention relates to a method to operate an assistance device. The method comprises the following steps. A task message associated with a first identity comprising a task to communicate with a module associated with a second identity to achieve a task aim is received by a communication device of the assistance device. Individual-related data, related to the first identity, necessary to achieve the task aim are evaluated by the communication device of the assistance device. A request message is provided to a relational reasoning device of the assistance device by the communication device of the assistance device. The request message comprises a request to provide a release state for providing the evaluated individual-related data to the second identity.

[0006] The request message is received by the relational reasoning device. The release state is evaluated by the relational reasoning device based on a relational state between the first identity and the second identity. A response message comprising the release state is provided to the communication device by the relational reasoning device. The response message comprising the release state is received by the communication device. At least one communication message is provided to the module by the communication device. The at least one communication message is associated with the second identity according to the task aim. The at least one communication message comprises the individual-related data according to the release state.

[0007] In other words, the assistance device is configured to provide the individual-related data, related to the first identity to the module related to the second identity. A disclosure of the individual-related data, related to the identity is sensitive and should only take place to a limited extent. Typically, a person will only share the individual-related data with people they know.

[0008] To automatize a release of the individual-related data, the relational reasoning device is provided. When the communication device receives the task message, the communication device determines the individual-related data, related to the identity to achieve the task aim of the task message. The task message may comprise a request to make an appointment between the first identity and the second identity. The communication module may evaluate, that the individual-related data of the first identity to be provided to the second identity to achieve the task aim may comprise a schedule of the first identity.

[0009] Before providing the individual-related data of the first identity comprising the schedule to the second identity, the communication device sends a request message to the relational reasoning device to request a release state of the individual-related data of the first identity comprising the schedule to prove whether the provision of the individual-related data of the first identity is allowed in general and to what extent.

[0010] The release state is evaluated by the relational reasoning device on the basis of a relational state between the first identity and the second identity. The relational state may describe a level of valid exchange of individual-related data between the identities. Based on the requested individual-related data and the relational state, the relational reasoning device evaluates the release state. The release state determines whether the individual-related data associated with the first identity can be made available to the second identity. The release state may also set a quantity of the individual-related data and a level of anonymisation of the individual-related data.

[0011] The release state is transmitted to the communication device in the response message. The communication device sends the at least one communication message to the module, the individual-related data being provided in accordance with the release state. It may be possible, that all of the individual-related data are provided or that none of the individual-related data are provided.

[0012] The invention has the advantage of providing automated checking of the provision of personal data.

[0013] According to an embodiment of the present invention, the evaluation of the relational state between the first identity and the second identity by the relational reasoning device is based on a message database comprising prior communication messages between the first identity and the second identity.

[0014] According to an embodiment of the present invention, the evaluation of the relational state between the first identity and the second identity by the relational reasoning device is based on individual-related data in the prior communication messages.

[0015] According to an embodiment of the present invention, the evaluation of the relational state between the first identity and the second identity by the relational reasoning device is based on transcribed phone calls and / or audio messages between the first identity and the second identity.

[0016] According to an embodiment of the present invention, the evaluation of the relational state between the first identity and the second identity by the relational reasoning device is based on transcribed images related to the second identity.

[0017] According to an embodiment of the present invention, the evaluation of the release state is based on a general release value of the first identity.

[0018] In particular, the method is a computer implemented method. Therefore, another aspect of the invention relates to a computer program product comprising program code means for performing a method according to the preceding aspect.

[0019] A still further aspect of the invention relates to a non-transitory computer-readable storage medium, comprising at least a computer program product according to the preceding aspect.

[0020] Furthermore, the present invention relates to an assistance device. The assistance device comprises a communication device. The communication device is configured to receive a task message associated with a first identity comprising a task to communicate with a module associated with a second identity to achieve a task aim. The communication device is configured to evaluate individual-related data, related to the first identity, necessary to achieve the task aim.

[0021] The communication device is configured to provide a request message to a relational reasoning device of the assistance device. The request message comprises a request to provide a release state for providing the evaluated individual-related data to the second identity.

[0022] The relational reasoning device is configured to receive the request message. The relational reasoning device is configured to evaluate the release state based on a relational state between the first identity and the second identity, and to provide a response message comprising the release state to the communication device.

[0023] The communication device is configured to receive the response message comprising the release state, and to provide at least one communication message to the module associated with the second identity according to the task aim comprising the individual-related data according to the a release state.

[0024] Further advantages, features, and details of the invention derive from the following description of preferred embodiments as well as from the drawing. The features and feature combinations previously mentioned in the description as well as the features and feature combinations mentioned in the following description of the figure and / or shown in the figure alone can be employed not only in the respectively indicated combination but also in any other combination or taken alone without leaving the scope of the invention. BRIEF DESCRIPTION OF THE DRAWING

[0025] The novel features and characteristic of the disclosure are set forth in the appended claims. The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and together with the description, serve to explain the disclosed principles. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same numbers are used throughout the figures to reference like features and components. Some embodiments of system and / or methods in accordance with embodiments of the present subject matter are now described below, by way of example only, and with reference to the accompanying figures.

[0026] The drawing shows in:

[0027] Fig. a schematic flowchart according to an embodiment of the method to operate an assistance device.

[0028] In the figure the same elements or elements having the same function are indicated by the same reference signs. DETAILED DESCRIPTION

[0029] In the present document, the word "exemplary" is used herein to mean "serving as an example, instance, or illustration". Any embodiment or implementation of the present subject matter described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.

[0030] While the disclosure is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawing and will be described in detail below. It should be understood, however, that it is not intended to limit the disclosure to the particular forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternatives falling within the scope of the disclosure.

[0031] The terms “comprises”, “comprising”, or any other variations thereof, are intended to cover a non-exclusive inclusion so that a setup, device or method that comprises a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus preceded by “comprises” or “comprise” does not or do not, without more constraints, preclude the existence of other elements or additional elements in the system or method.

[0032] In the following detailed description of the embodiment of the disclosure, reference is made to the accompanying drawing that forms part hereof, and in which is shown by way of illustration a specific embodiment in which the disclosure may be practiced. This embodiment is described in sufficient detail to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the present disclosure. The following description is, therefore, not to be taken in a limiting sense.

[0033] Fig. shows a schematic flowchart according to an embodiment of the method to operate an assistance device.

[0034] In a first step S1, a communication device 2 of the assistance device 1 may receive a task message 3 associated with a first identity 4 comprising a task to communicate with a module 5 associated with a second identity 6 to achieve a task aim.

[0035] In a step S2 the communication device 2 may evaluate individual-related data, related to the first identity 4, necessary to achieve the task aim. The individual-related data may have to be provided to the second identity 6.

[0036] In a step S3 the communication device 2, may send a request message 7 to a relational reasoning device 9 of the assistance device 1. The request message 7 may comprises a request to provide a release state for providing the evaluated individual-related data to the second identity 6. In other words, the communication device 2 asks the relational reasoning device 9, whether the provision of the evaluated individual-related data to the second identity 6 is allowed.

[0037] In a step S4 the relational reasoning device 9 may receive the request message 7. The reasoning device 9 may evaluate the release state based on a relational state between the first identity 4 and the second identity 6. The relational state may be evaluated based on prior messages between the identities which may be stored in a database 8 of the relational reasoning device 9. The relational reasoning device 9 may provide a response message 10 comprising the release state to the communication device 2.

[0038] In a step S5, the communication device 2 may receive the response message 10 comp

[0039] In a step S6, the communication device 2 may send at least one communication message 11 to the module 5 associated with the second identity 6 according to the task aim comprising the individual-related data according to the release state.

[0040] Due to the nature of language, it is not possible to manually define lists of evaluated individual-related data of a first identity 4 to be shared and evaluated individual-related data not to be shared for each individual second identity 6. Instead, this assistance device 1 comprises a relational reasoning device 9 that uses a large language model to process all verbal conversations, written messages, and any other form of interaction of the first identity 4 with the second identities. Based on all past interactions, the large language model is able to understand the nature of the relationship between the first identity 4 and each second identity 6. The large language model also finds individual-related data that the first identity 4 has shared with the respective second identity 6 in the past. In addition, based on all interactions, the large language model can infer the openness of the first identity 4 to share individual-related data in general, i.e. how openly the first identity 4 talks about herself, and also information-specific, i.e. the first identity 4 avoids talking about her childhood. Based on past interactions with this specific second identity 6, as well as openness, the model can perform relational inference between the first identity 4 and the second identity 6. From the result of the inference, the large language model can infer whether it is allowed to share a particular piece of individual-related data. In this way, the large language model can act as a personal assistant and autonomously conduct conversations on behalf of the first identity 4.

[0041] The assistance device 1 integrates concepts such as confidentiality, privacy and openness into conversations by using a large language model.

[0042] The assistive device uses a separate large language model to perform relational reasoning of a first identity 4 with the second identity 6.

[0043] The relational reasoning device 9 works on existing data, so no manual labelling or similar is required.

[0044] The relational reasoning device 9 takes into account past interactions between the first identity 4 and the second identity 6, as well as the general openness of the first identity 4.

[0045] The relational reasoning device 9 uses the result of the reasoning to decide whether personal data can be shared with the second identity 6. This data-driven approach would build on existing data, and parameters would be learned implicitly from the existing data. Data points about the relationship between the first identity 4 and the second identity 6 are created based on past interactions. For example, if individual-related data containing calendar availability information has been shared with a particular second identity 6 in the past, it is assumed that it is OK to answer another availability request containing calendar availability data. All verbal conversations, written messages and any other mode of interaction between the identities can be stored in a database 8 of the relational reasoning engine. This idea is not limited to the mode of interaction. As long as it can be converted to text form, it can be processed by the large language model. It could even use images that could capture information about the second identity 6. Telephone calls and audio messages could be automatically transcribed by the assistive device and fed into the large language model. In a first-time interaction between the first identity 4 and the second identity 6, the relational reasoning device 9 can't build on existing information, so the relational reasoning device 9 would have to fall back on a conservative prediction. In the case of sharing individual-related data, the relational reasoning device 9 would decide not to share the individual-related data.

[0046] In a first-time interaction between the first identity and the second identity, the relational reasoning device can't build on existing information, so the relational reasoning device would have to fall back on a conservative prediction. In the case of sharing individual-related data, the relational reasoning device would decide not to share the individual-related data.

Claims

1. A method to operate an assistance device (1) comprising following steps:- receiving, by a communication device (2) of the assistance device (1), a task message (3) associated with a first identity (4) comprising a task to communicate with a module (5) associated with a second identity (6) to achieve a task aim;- evaluating, by the communication device (2), individual-related data, related to the first identity (4), necessary to achieve the task aim;- providing, by the communication device (2), a request message (7) to a relational reasoning device (9) of the assistance device (1), wherein the request message (7) comprises a request to provide a release state for providing the evaluated individual-related data to the second identity (6);- receiving, by the relational reasoning device (9), the request message (7), evaluating the release state based on a relational state between the first identity (4) and the second identity (6) and providing a response message (10) comprising the release state to the communication device (2);- receiving, by the communication device (2), the response message (10) comprising the release state;- providing, by the communication device (2), at least one communication message (11) to the module (5) associated with the second identity (6) according to the task aim comprising the individual-related data according to the release state.

2. The method according to claim 1 comprising following step:- evaluating, by the relational reasoning device (9) the relational state between the first identity (4) and the second identity (6) based on a message database (8) comprising prior communication messages (11) between the first identity (4) and the second identity (6).

3. The method according to claim 2 comprising following steps- evaluating, by the relational reasoning device (9) the relational state between the first identity (4) and the second identity (6) based on individual-related data in the prior communication messages (11).

4. The method according to any one of the preceding claims comprising following step: - evaluating, by the relational reasoning device (9) the relational state between the first identity (4) and the second identity (6) based on transcribed phone calls and / or audio messages between the first identity (4) and the second identity (6).

5. The method according to any one of the preceding claims comprising following step: - evaluating, by the relational reasoning device (9) the relational state between the first identity (4) and the second identity (6) based on transcribed images related to the second identity (6).

6. The method according to any one of the preceding claims comprising following step: - evaluating the release state based on a general release value of the first identity (4). general openness of the person7. A computer program product comprising program code means for performing a method according to any one of claims 1 to 6.

8. A non-transitory computer-readable storage medium comprising at least the computer program product according to claim 7.

9. An assistance device (1), wherein the assistance device (1) comprises a communication device (2), configured to:- receive a task message (3) associated with a first identity (4) comprising a task to communicate with a module (5) associated with a second identity (6) to achieve a task aim; and- evaluate individual-related data, related to the first identity (4), necessary to achieve the task aim;characterized in that- the communication device (2) is configured to provide a request message (7) to a relational reasoning device (9) of the assistance device (1), wherein the requestmessage (7) comprises a request to provide a release state for providing the evaluated individual-related data to the second identity (6);- the relational reasoning device (9) is configured to receive the request message (7), to evaluate the release state based on a relational state between the first identity (4) and the second identity (6), and to provide a response message (10) comprising the release state to the communication device (2); and-the communication device (2) is configured to receive the response message (10) comprising the release state, and to provide at least one communication message (11) to the module (5) associated with the second identity (6) according to the task aim comprising the individual-related data according to the release state.Reference signs1234567891011S1-S4assistance device communication device task message first identity module second identity request message databaserelational reasoning device response message communication message steps

Citation Information

Patent Citations

  • Modification of voice commands based on sensitivity

    US20220093091A1

  • Selectively masking query content to provide to a secondary digital assistant

    US20230169963A1

  • Context Carryover Across Tasks for Assistant Systems

    US20230418875A1