62623 results about "Human–computer interaction" patented technology

An example operation may include one or more of receiving a sequence of inputs from a user during a conversation between the user and a chatbot within a chat window of a software application, executing a large language model (LLM) on each input from the user to determine a next prompt to output via the chatbot, respectively, wherein each execution of the LLM includes a new chat input from the user and a most-recent state of the conversation between the user and the chatbot within the chat window, and displaying the next prompt within a chat window on a user device.

The invention relates to the field of data processing, in particular to a memory retrieval method based on a large language model and a related device. The method comprises the following steps: in response to an interaction instruction sent by a target user, performing context analysis processing on the interaction instruction to obtain a real-time interaction intention of the target user; performing memory retrieval on a short-term memory module and a long-term memory module based on the real-time interaction intention to obtain target retrieval information; and in combination with a personalized knowledge base of the target user, carrying out personalized processing on the target retrieval information to obtain response information matched with the use habit of the target user, and using the response information to respond to the interaction instruction. According to the method, the memory capacity of the large language model in the interaction process is improved, the information forgetting rate is reduced, the information retrieval efficiency is improved, effective classification and organization of personalized information are achieved, and the user experience is improved.

The present disclosure relates to computer-implemented methods, software, and systems for transferring contexts from a generic chatbot to a domain-specific chatbot. In one example, a registration at a first conversational interface is received that identifies at least one endpoint associated with a first entity that is separate from the first conversational interface and is associated with a domain-specific conversational interface. The first conversational interface can interact with a user through a natural language search interaction. The interface can identify at least one response associated with one of the at least one endpoints associated with the first entity, and can provide the response and an interactive response associated with initiating a transfer of the interaction from the first conversational interface to a domain-specific conversational interface of the first entity. Once accepted, the interaction is transferred to the first entity and its domain-specific conversational interface.

A system and method for AI based user experience curation across multiple scenarios and finite time horizons of interest. The present invention integrates connectionist and symbolic AI techniques to generate coherent, relevant, and personalized content across various domains. The invention bridges the gap between connectionist AI and symbolic AI, enabling more adaptive, immersive, and engaging user experiences while prioritizing security and traceability and contextualization considerations behind recommendations or content generation. The platform furthers dynamic and tailored user interactions with digital systems across individual interactions, preferences, sequences and ongoing engagements across sessions by leveraging the power of analytics, deep learning, and AI to create truly intelligent, dynamic, and responsive user experiences enhanced with optimization and planning faculties.

An example operation may include one or more of ingesting data from one or more websites via one or more application programming interfaces (APIs) and storing the data within a data store of a host platform, displaying one or more prompts on a user interface of a user profile page within a software application hosted by the host platform, receiving one or more responses to the one or more prompts, generating a travel itinerary based on execution of an artificial intelligence (AI) model on the data from the one or more websites, the one or more prompts, and the one or more responses, and displaying the travel itinerary via the user interface of the user profile page of the software application.

Some examples of the disclosure are directed to systems and methods for displaying and interacting with a representation of a user interface of an electronic device in a three-dimensional environment. While presenting a first user interface, a first electronic device presents a representation of a second user interface of a second electronic device based on display data representing the second user interface. In response to detecting a respective event corresponding to user input, if a gaze of a user of the first electronic device is directed to the representation of the second user interface, the first electronic device causes the second electronic device to perform a first operation directed to the second user interface based on the respective event. Alternatively, if the gaze is directed to the first user interface, the first electronic device performs a second operation directed to the first user interface based on the respective event.

An example operation may include one or more of ingesting profile data from one or more websites via one or more application programming interfaces (APIs) and storing the profile data within a data store, displaying one or more prompts on a user interface of a user profile page within a software application hosted by a host platform, receiving one or more responses to the one or more prompts, determining a goal for a user of the user profile page based on execution of an artificial intelligence (AI) model on the profile data, the one or more prompts, and the one or more responses to the one or more prompts, and displaying an identifier of the goal via the user interface of the user profile page of the software application.

An example operation may include one or more of displaying a report on a user interface of a software application on a user device, listening to a call between a user on the user device and a different user on a second user device that is connected to the user device via a network, executing a generative artificial intelligence (GenAI) model based on content that is heard during the call and content within the report displayed on the user interface to identify content within the displayed report that is discussed during the call, and modifying the displayed report to emphasize the identified content within the displayed report on the user interface.

In some embodiments, a computer system displays a caption for a media item at different depths depending on the depth of the portion of the media item over which the caption is displayed. In some embodiments, a computer system displays a user interface element that includes information associated with the media item at different locations relative to the media item depending on attention of the user. In some embodiments, a computer system displays a user interface element that includes information associated with the media item with different visual appearances depending on visual characteristics of the portion of the media item over which the user interface element is displayed.

A system and method for creating complex, immersive, and interactive digital content is disclosed. The system integrates advanced artificial intelligence, multi-modal input processing, cloud-based shared environments, and immersive hardware to generate, optimize, and deliver rich interactive experiences. The platform supports content mashups, custom scenario generation, and adaptive AI behaviors, enabling the creation of unique and engaging digital environments across various media formats.

An example operation may include one or more of training an artificial intelligence (AI) model to recommend numerical goals based on execution of the AI model on historical profile data and contextual data that is associated with the historical profile data, storing profile data of a user profile within a data store of a software application, receiving a request via a user interface of a user profile page of the software application, wherein the request comprises context of a user of the user profile, determining a numerical goal for the user profile based on execution of the AI model on the profile data of the user profile and the context, and displaying the numerical goal via the user interface of the user profile page within the software application.

An example operation includes one or more of establishing a communication session between a first user device and a second user device from among the plurality of user devices, training an artificial intelligence (AI) model to learn user interface preferences of a plurality of user devices during the communication session, receiving a description associated with the communication session, generating a plurality of windows of content and displaying the plurality of windows of content on a user interface of the first user device during the communication session based on execution of the AI model on the description associated with the communication session, and generating a second plurality of windows of content and displaying the second plurality of windows of content on a user interface of the second user device based on an execution of the AI model on the description associated with the communication session.

In some embodiments, an electronic device facilitates cursor interactions in different regions in a three-dimensional environment. In some embodiments, an electronic device facilitates cursor interactions in content. In some embodiments, an electronic device facilitates cursor movement. In some embodiments, an electronic device facilitates interaction with multiple input devices. In some embodiments, a computer system facilitates cursor movement based on movement of a hand of a user of the computer system and a location of a gaze of the user in the three-dimensional environment. In some embodiments, a computer system facilitates cursor selection and scrolling of content in the three-dimensional environment.

An example operation may include one or more of ingesting data from one or more websites via one or more application programming interfaces (APIs) and storing the data within a data store of a host platform, generating one or more prompts and displaying the one or more prompts on a user interface of a user profile page within a software application hosted by the host platform, receiving one or more responses to the one or more prompts, generating a design of a structure based on execution of an artificial intelligence (AI) model on the data from the one or more websites, the one or more prompts, and the one or more responses, and displaying the design of the structure via the user interface of the user profile page of the software application.

In some embodiments, an electronic device generates virtual lighting effects while presenting a content item. In some embodiments, an electronic device enhances navigation to a respective playback position of a content item. In some embodiments, an electronic device displays media content in a three-dimensional environment. In some embodiments, an electronic device presents media content in different modes of presentation.

An example operation includes one or more of logging user actions with respect to placement of objects of content on a user interface including respective content types of the objects of content, training an artificial intelligence (AI) model to learn location preferences for a content type on the user interface based on the logged user actions including the respective content types, receiving a request to open an object on the user interface with the content type, determining a display location on the user interface for the object based on execution of the AI model on the content type, and displaying the object at the determined display location on the user interface.

An Applicant Assistant System may receive, from a user device, a user input indicating a query or task associated with information displayed in a user interface. The device may determine one or more components associated with the user interface and access component metadata of the determined one or more components, the component metadata for each of the one or more components indicating one or more of a fact, a data link, or an action. A prompt comprising at least some of the component metadata, at least some context information, and an indication of one or more available response elements may be provided to a large language model (LLM). The LLM may response with one or more response elements that may be processed by the System, such as to cause updates to the user interface on the user device.

Provided in the embodiments of the present disclosure are a question answering processing method and system, a device and a storage medium. The method comprises: on the basis of a user question, a first prompt template containing first tool set information, and an LLM, a first agent acquires, successively generated by the LLM, a plurality of pieces of solving task information that are required to be executed by invoking a second agent and summary task information that is required to be executed by the first agent, and successively transmits the plurality of pieces of solving task information to the second agent; on the basis of received current solving task information, a second prompt template containing second tool set information, and the LLM, the second agent acquires task execution information that is generated by the LLM and corresponds to the current solving task information, and accordingly acquires from an application server a task execution result of the current solving task information; and the first agent summarizes the task execution results of the plurality of pieces of solving task information, so as to determine reply information corresponding to the user question. By means of the cooperation of different agents, user questions are gradually and accurately solved.

An online social wager-based gaming system is disclosed, featuring dynamic cross-provider game filtering and persistent cross-provider voice-interactive group play. The system allows for automated multi-seat group game reservations and incorporates a distributed ledger for bet verification. Features include a Group Connect module for dynamic group formation and live audio across various game providers, enabling real-time play. A Professional Companion Connect module facilitates live webcam or microphone gambling sessions with professional companions, under contractual agreements. The User Games module enhances personalization by integrating user-uploaded images into the gaming environment. A cryptocurrency / blockchain-based bet tracking system ensures transparency and security in managing bet transactions through a controlled digital wallet system. This integrated platform aims to provide a cohesive, interactive, and personalized online casino experience, addressing limitations of traditional solitary online gaming by fostering social connections and enhancing user trust and engagement.

The invention provides a lightweight digital human lesson preparation system based on an intelligent agent, and belongs to the field of intelligent teaching. Through collaborative operation of four core modules of knowledge graph construction and reasoning, multi-modal cognitive agent, lightweight digital human generation and intelligent teaching plan assistance, the problems of low efficiency of resource integration, teaching content homogenization, insufficient digital human interaction experience and the like in traditional lesson preparation are solved. The knowledge graph construction and reasoning module is used for constructing a structured knowledge graph and realizing knowledge point association mining and teaching logic reasoning; the multi-modal cognitive agent module is used for generating personalized explanation content according with a teaching target by fusing multi-modal courseware analysis, semantic understanding and lecture style dynamic adaptation functions; the lightweight digital human generation module is combined with model pruning and emotion modeling technologies to synchronously output natural voice and a high-simulation digital human image; the intelligent teaching plan auxiliary module helps the teacher to intelligently generate a teaching plan and a teaching outline according to the courseware content based on the knowledge graph.

An example method can include providing a natural language instruction and user interface image data to a machine-learned sequence processing model that is configured to process image data and generate commands for controlling the target computing device, wherein the machine-learned sequence processing model has parameters learned using an interface recognition objective based on an evaluation of an interface recognition output generated based on processing a rendered training interface from a pre-training dataset and an interface navigation objective based on an evaluation of a user interface command generated based on processing a rendered training interface from a fine-tuning dataset; receiving, from the machine-learned sequence processing model, a command indicating an interaction with the user interface to implement the natural language instruction; and generating, based on the command, a control signal configured to initiate the interaction.

In some embodiments, a computer system performs virtual object manipulation operations using respective portions of the user's body and / or input device(s). In some embodiments, a computer system manipulates a virtual object based on input from a hand of a user and / or a handheld device. In some embodiments, a computer system manipulates a virtual object directly or indirectly.

An example may receive at least one input via at least one device. An example may use the at least one input to determine an entity identity. An example may use the entity identity to create an automated agent and load context data associated with the entity identity into at least one layer of a multi-layer memory of the automated agent. An example may cause the automated agent to machine-learn a supervision level via the context data. The machine-learned supervision level may indicate a level of supervision of the automated agent by an entity associated with the entity identity. An example may configure the automated agent to execute a task on behalf of the entity and in accordance with the machine-learned supervision level.

In some embodiments, a computer system facilitates the update of a spatial arrangement of one or more virtual objects in a three-dimensional environment from the viewpoint of a first user of the computer system while in a real-time communication session that includes a plurality of users. In some embodiments, updating the spatial arrangement of one or more virtual objects includes collectively moving the one or more virtual objects in the three-dimensional environment relative to the viewpoint of the first user.