Note method, device, equipment, medium and product applied to virtual environment

Abstract

This application discloses a note-taking method, apparatus, device, medium, and product applied in a virtual environment, belonging to the field of human-computer interaction. The method includes: displaying a master virtual character located in the virtual environment; responding to an interaction trigger operation on the master virtual character, controlling the master virtual character to interact with at least one virtual object in the virtual environment; responding to a trigger operation on a notepad, displaying a notepad interface; and responding to a trigger operation on the notepad interface, displaying an interaction graph presented in the form of graph data, the interaction graph including at least two nodes, each of the at least two nodes being related to any one of the master virtual character, the at least one virtual object, and the interaction behavior. This method improves the efficiency of users in organizing interaction behaviors by supporting user-generated interaction graphs.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction, and in particular to a note-taking method, apparatus, device, medium and product applied in a virtual environment. Background Technology

[0002] For games, guiding players to explore the plot and game mechanics through various information is one way to increase players' motivation and curiosity.

[0003] For games designed with a grand worldview and a realistic feel, the plot and game mechanics are often quite rich, and there is a lot of information to guide players. Related technologies typically record this information in the form of a log. This information in the log is usually saved by trigger time, that is, it is usually stored linearly according to timeline.

[0004] While linearly stored information allows players to know the trigger time of each piece of information, it makes it difficult to understand the relationships between the pieces of information. Summary of the Invention

[0005] This application provides a note-taking method, apparatus, device, medium, and product applicable to a virtual environment, the technical solution of which is as follows:

[0006] According to one aspect of this application, a note-taking method applied in a virtual environment is provided, the method comprising:

[0007] Displays the main virtual character located in the virtual environment;

[0008] In response to an interaction trigger operation on the main virtual character, control the main virtual character to interact with at least one virtual object in the virtual environment;

[0009] In response to a trigger operation on the notepad, the notepad interface is displayed;

[0010] In response to an editing operation on the notepad interface, an interactive graph is displayed in the form of graph data. The interactive graph includes at least two nodes, each of which is related to any one of the main virtual character, the at least one virtual object, or the interactive behavior.

[0011] According to one aspect of this application, a note-taking device for use in a virtual environment is provided, the device comprising:

[0012] The display module is used to display the main virtual character located in the virtual environment;

[0013] The control module is used to respond to the interactive trigger operation of the main virtual character and control the main virtual character to interact with at least one virtual object in the virtual environment.

[0014] The display module is used to display the notepad interface in response to a trigger operation on the notepad.

[0015] The display module is used to display an interactive graph in the form of graph data in response to an editing operation on the notepad interface. The interactive graph includes at least two nodes, each of which is related to any one of the main virtual character, the at least one virtual object, or the interactive behavior.

[0016] According to one aspect of this application, a computer device is provided, the computer device including a processor and a memory, the memory storing a computer program, the computer program being loaded and executed by the processor to implement a note-taking method applied to a virtual environment.

[0017] According to one aspect of this application, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements a note-taking method applied to a virtual environment.

[0018] According to one aspect of this application, a computer program product is provided, the computer program product comprising a computer program stored in a computer-readable storage medium; the computer program being read from and executed by a processor of a computer device from the computer-readable storage medium, causing the computer device to perform a note-taking method applied to a virtual environment.

[0019] The beneficial effects of the technical solution provided in this application include at least the following:

[0020] This application supports users in recording and organizing interactions related to their main virtual character, enabling systematic organization of fragmented content and supporting further analysis and understanding, thus improving information processing efficiency. Furthermore, the graph-based data presentation allows users to clearly analyze and understand complex game plots and their logical relationships. The visual representation of nodes and edges helps users better grasp the game's storyline and quest clues, optimizing their ability to analyze game content. In addition, by providing intuitive management and viewing tools, users can participate more deeply in the game, enhancing immersion and strategic depth. This structured management approach not only improves the player's gaming experience but also promotes in-depth exploration and participation in game content. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 A schematic diagram of a note-taking method applied to a virtual environment provided in an exemplary embodiment of this application is shown;

[0023] Figure 2 A schematic diagram of a note-taking method applied to a virtual environment provided in an exemplary embodiment of this application is shown;

[0024] Figure 3 A schematic diagram of a note-taking method applied to a virtual environment provided in an exemplary embodiment of this application is shown;

[0025] Figure 4 An architectural diagram of a computer system provided in an exemplary embodiment of this application is shown;

[0026] Figure 5 A flowchart illustrating a note-taking method applied to a virtual environment provided in an exemplary embodiment of this application is shown;

[0027] Figure 6 A schematic diagram of a note-taking method applied to a virtual environment provided in an exemplary embodiment of this application is shown;

[0028] Figure 7 A flowchart illustrating a note-taking method applied to a virtual environment provided in an exemplary embodiment of this application is shown;

[0029] Figure 8 A schematic diagram of a note-taking method applied to a virtual environment provided in an exemplary embodiment of this application is shown;

[0030] Figure 9 A flowchart illustrating an exemplary embodiment of this application provides a note-taking method applied to a virtual environment.

[0031] Figure 10 This illustration shows a structural block diagram of a note-taking device applied to a virtual environment, provided in an exemplary embodiment of this application.

[0032] Figure 11 A schematic diagram of the structure of a computer device provided in an exemplary embodiment of this application is shown. Detailed Implementation

[0033] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0034] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0035] The terminology used in this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The singular forms “a,” “the,” and “the” as used in this disclosure and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

[0036] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions. For example, the settings and operation information involved in this application were obtained with full authorization.

[0037] It should be understood that although the terms first, second, etc., may be used in this disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, a first parameter may also be referred to as a second parameter without departing from the scope of this disclosure, and similarly, a second parameter may also be referred to as a first parameter. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to determination."

[0038] First, let me introduce the relevant terms used in this application:

[0039] Open World: A type of level design in video games. In open world games, players can freely roam in a virtual world and choose when and how to complete game tasks. This type of game is also often called a "free-roaming game".

[0040] Virtual environment: This refers to the virtual environment displayed (or provided) by the client when running on the terminal. This virtual environment can be a simulation of the real world, a semi-simulated / semi-fictional environment, or a purely fictional environment. The virtual environment can be any of a two-dimensional, 2.5-dimensional, or three-dimensional virtual environment; this application does not limit this. The following embodiments illustrate this with a three-dimensional virtual environment. For example, the virtual environment includes the sky, land, and ocean, etc. The land includes environmental elements such as plants and houses, and the user can control the virtual character to move within this virtual environment. Of course, the virtual environment also includes virtual items, which can be interactive, such as virtual beds, virtual chairs, virtual lamps, virtual bathtubs, etc., allowing the user to control the virtual character to lie on the virtual bed or sit on the virtual chair; these virtual items can also be non-interactive, such as virtual trees, virtual stones, virtual house structures (which may include roofs, floors, pillars, doors, windows, etc.). This virtual environment can also be used to simulate real-world environments under different weather conditions, such as sunny days, rainy days, foggy days, or nighttime. A variety of scene elements enhance the diversity and realism of the virtual environment.

[0041] Virtual objects: Objects in a virtual environment. For example, a virtual object can be a virtual character, a virtual item, or a virtual location.

[0042] Virtual Character: An active object in a virtual environment. This active object can be at least one of a virtual person, virtual animal, or anime character. Optionally, when the virtual environment is a three-dimensional virtual environment, the virtual character can be a three-dimensional virtual model. Each virtual character has its own shape and volume in the three-dimensional virtual environment and occupies a portion of the space within the three-dimensional virtual environment. Optionally, the virtual character is a three-dimensional model constructed based on three-dimensional human skeleton technology. This virtual character achieves different external appearances by wearing different skins. In some implementations, the virtual character can also be implemented using a 2.5D or 2D model; this application does not limit this. Optionally, the virtual character is controlled through operation on a client, or through training an artificial intelligence object set in the virtual environment, or through a non-player character (NPC) set in the virtual environment. The main virtual character refers to an active object in the virtual environment controlled by the user.

[0043] Virtual items: In a virtual environment, virtual items are visible, touchable, and interactive. Some virtual items have their own shape and volume in the virtual environment, occupying a portion of the space; these items are generally not stackable. Other virtual items do not occupy space in the virtual environment, existing similarly to air, and can be stacked with non-stackable virtual items. Furthermore, in some applications, all virtual items can be stacked; this application does not limit this.

[0044] Virtual Locations: Areas within a virtual environment. Virtual locations are manually defined by developers or designers. Optionally, virtual locations may be directly connected or disconnected. Connectivity means that when a user controls a virtual character to switch locations, they can directly move from one virtual location to another without teleportation or transition animations; disconnection means that when a user controls a virtual character to switch locations, they need to go through teleportation or transition animations.

[0045] Canvas component: A container for UI (User Interface) elements. Used to display a flat surface containing UI elements within a virtual environment. UI elements can be image elements, text elements, button elements, list elements, and so on.

[0046] In open-world games, users control a virtual character via a terminal to explore a virtual environment, freely deciding which quests to accept, which direction to explore, and so on, according to their preferences. This allows users to create their own stories within the open world; in other words, the core of open-world games is to stimulate users' curiosity and encourage them to experience free gameplay. However, precisely because of this, open worlds often contain a large amount of fragmented information, such as plot content, side quests (optional tasks), and NPC dialogues. Related technologies typically only provide limited quest log functionality, failing to effectively support users in organizing and analyzing this fragmented information. This results in users facing a significant memory burden and analytical pressure when trying to understand the game's world view, character backgrounds, and plot development. Traditional note-taking tools lack the ability for structured management and automated recording, requiring players to spend considerable effort manually organizing clues and experiences within the game.

[0047] In open-world games demonstrated by related technologies, quest logs typically record quest objectives and progress in simple text format, lacking systematic organization of NPC dialogues, side quests, and other fragmented content. These quest logs are usually limited to linear timeline recording, failing to support complex plot deduction and structured analysis by players. Furthermore, these open-world games lack user-editable notepad tools, making it difficult for users to record and organize their thoughts and goals when experiencing complex worlds and numerous quests. This also makes it easy for users to overlook key clues when processing large amounts of information, increasing cognitive burden and information management difficulty in the game.

[0048] For example, such as Figures 1 to 3 As shown.

[0049] (1) Open Notepad / Enter Notepad interface.

[0050] For example, such as Figure 1 As shown, the user controls the main virtual character 10 in the virtual environment through the terminal to interact with at least one virtual object. The at least one virtual object can be a virtual character, a virtual item, a virtual location, etc. For example, the user controls the main virtual character in the virtual environment and the first virtual character 11 located in the virtual environment through the terminal.

[0051] Optionally, the master virtual character 10 is usually a virtual character.

[0052] For example, in the case of interaction between the main virtual character 10 and the virtual character, such as Figure 1 The first virtual character 11 shown in part (1) is an NPC in the virtual environment. The interaction between the main virtual character 10 and the first virtual character 11 can be a dialogue between the user-controlled main virtual character 10 and the NPC (i.e., the first virtual character 11), such as... Figure 1 As shown in section (1), the terminal will also display the dialogue content 12 of the NPC (i.e., the first virtual character 11). Optionally, the terminal can also play the dialogue audio of the NPC (i.e., the first virtual character 11). In addition, the interaction between the main virtual character 10 and the first virtual character 11 can also be that the user controls the main virtual character 10 to accept tasks issued by the NPC (i.e., the first virtual character 11), trade with the NPC (i.e., the first virtual character 11), spar with the NPC (i.e., the first virtual character 11), etc.

[0053] For example, when the main virtual character 10 interacts with a virtual item, the virtual item can be a virtual item located in the virtual environment or a virtual item located in the virtual inventory of the main virtual character 10. The interaction between the main virtual character 10 and the virtual item can be the user controlling the main virtual character 10 to pick up, use, discard, or move the virtual item, etc.

[0054] For example, when the master virtual object 10 interacts with a virtual location, the virtual location refers to a location, city, or region within the virtual environment. The interaction between the master virtual character 10 and the virtual location can be the user controlling the master virtual character 10 to explore the virtual location, arrive at the virtual location, leave the virtual location, and so on.

[0055] In some embodiments, the interaction between the master virtual character 10 and the first virtual character 11 will generate an interaction log, which is used to indicate the interaction behavior between the master virtual character 10 and the first virtual character 11.

[0056] Specifically, the user triggers the display of the menu bar 14 by performing a triggering operation on the menu bar display control 13, such as... Figure 1 As shown in section (2) of the document. The menu bar 14 displays at least one functional control. This at least one functional control includes a log recording control 15. After the user triggers the log recording control 15, a log recording display area 16 is displayed. The log recording display area 16 displays interaction logs related to the main virtual character 10. These interaction logs include, but are not limited to: the interaction behavior between the main virtual character 10 and the first virtual character 11; the dialogue between the main virtual character 10 and the first virtual character 11; changes in the relationship between the main virtual character 10 and the first virtual character 11, etc. The interaction logs related to the main virtual character 10 may also involve multiple virtual objects, which is not limited in this embodiment.

[0057] Optionally, the interaction logs displayed in the log display area 16 are displayed in reverse order of interaction time, that is, the most recently generated interaction logs are displayed at the beginning, and the later generated interaction logs are displayed at the end.

[0058] Optionally, the interaction log displayed in the log recording display area 16 also includes at least two text entities, each of which indicates any one of the following: interaction role, interaction content, interaction location, interaction item, or interaction event. The text entities included in the interaction log are associated with at least one virtual object. Specifically, the text entities in the interaction log are identification information of at least one virtual object (such as the name of a virtual character, the name of a virtual item, the name of a virtual location, etc.), or the text entities in the interaction log are the dialogue content of a virtual character (or at least one virtual object), or the text entities in the interaction log are task information issued by a virtual character (or at least one virtual object). That is, the text entities are used to indicate at least one virtual object, or the text entities are used to indicate information related to at least one virtual object.

[0059] Optionally, text entities in the interaction log are displayed differently than other text; in other words, text entities in the interaction log are highlighted. For example, such as... Figure 1 As shown in section (2), in the interactive log displayed in the log display area 16, the content enclosed in square brackets "[]" is the text entity.

[0060] Optionally, in addition to the interactive log, the log display area 16 also includes a notepad display control 17. In response to a trigger operation on the notepad display control 17, the notepad area 18 is displayed, such as... Figure 1 As shown in section (3), the notepad area 18 is used to display the user-created interaction graph. The interaction graph is a graph structure that represents the interactive behavior of the main virtual character 10. The interaction graph includes at least two nodes and at least one edge.

[0061] (2) Add a node.

[0062] Optionally, when displaying an interaction log, the user adds nodes to the interaction graph by triggering actions on text entities in the interaction log.

[0063] For example, such as Figure 1 As shown in section (3), in response to a trigger operation on a text entity in the log display area 16, a node corresponding to the triggered text entity is added to the notepad area 18. For example, after a user double-clicks the text entity 19 ([Enermy2]) in the log display area, the node 20 corresponding to this text entity 19 ([Enermy2]) is displayed in the notepad area 18. The node 20 also displays the text entity 19, or in other words, the node 20 also displays the identification information of the first virtual character 11.

[0064] Optionally, when the user selects node 20 in notepad area 18, such as Figure 2As shown, the text entity 19 corresponding to node 20 is highlighted in the log display area 16. When the text entity in the log display area 16 is highlighted using square brackets "[]", further highlighting is applied to the text entity corresponding to the selected node, such as changing the display color of the text entity corresponding to the selected node, and / or changing the thickness of the text entity corresponding to the selected node, and / or changing the font of the text entity corresponding to the selected node, and / or changing the font size of the text entity corresponding to the selected node, etc. Figure 2 The example given is changing the thickness of the text entity corresponding to the selected node, but this is not a limitation.

[0065] In some embodiments, a text entity in the interactive log can generate only one node. If a node 1 corresponding to the first text entity already exists in the notepad area 18, in response to a trigger operation on the first text entity, the display area of ​​the notepad area 18 is changed, and node 1 is displayed in the center of the notepad area 18; and a prompt message is displayed to indicate that a node 1 corresponding to the first text entity already exists. Alternatively, a text entity in the interactive log can generate multiple nodes. If a node 1 corresponding to the first text entity already exists in the notepad area 18, in response to a trigger operation on the first text entity, node 2 is added, wherein the information displayed on node 1 and node 2 may be the same or different, such as for the first text entity. Figure 2 The text entity 19 shown in the figure is displayed on both its corresponding node 1 and node 2, which is Enermy2; or, its corresponding node 1 and node 2 display content related to but different from text entity 19, such as 1-Enermy2 displayed on node 1 and 2-Enermy2 displayed on node 2. If there are more nodes corresponding to text entity 19, the text entity is displayed according to a preset format, such as "n-text entity", "text entity n", etc., where n represents the number of the node in the multiple nodes corresponding to the text entity, which is reflected in the time when the node was added.

[0066] (3) Add edges.

[0067] Optionally, when the user triggers the edit control 21 and selects a node, at least one connection point is displayed on that node. This connection point assists the user in generating edges connected to the node. The at least one connection point can be displayed around the node, such as... Figure 3 As shown in section (1), after node 20 is selected, four connection points 22 are displayed around node 20.

[0068] Optionally, in response to a triggering operation on any one of the at least one connection point of node 1, at least one connection point is displayed on other nodes; and an edge originating from node 1 is displayed, the endpoint of which is the mouse cursor or touch point. Displaying at least one connection point on other nodes facilitates the user connecting the edge originating from node 1 to other nodes. In response to a triggering operation on a connection point on other nodes, an edge is added between node 1 and other nodes.

[0069] Optionally, the edge can be a directed edge or an undirected edge. If the edge is a directed edge, it can be a unidirectional edge or a bidirectional edge. This application embodiment uses a unidirectional edge as an example for illustration, and the unidirectional edge points from the node corresponding to the first triggered connection point to the node corresponding to the subsequently triggered connection point, but this application embodiment does not limit this.

[0070] For example, such as Figure 3 As shown in section (2), after the user selects node 20 and clicks or drags the connection point 22 of node 20, at least one corresponding connection point 25 is displayed on other nodes in the notepad area 18, such as node 24. If the user drags the edge 23 originating from node 20 to the connection point 25 of node 24, as shown in section (2), Figure 3 As shown in part (3), edge 26 is generated between node 20 and node 24.

[0071] (4) Change the text / label.

[0072] Optionally, users can change the text displayed on nodes, add text or labels to nodes or edges. The text or labels are used to indicate the logical relationships between nodes or between nodes and edges. These texts or labels can be entered by the user or selected from the interaction log, i.e., the log recording display area 16.

[0073] Optionally, the tags allow users to filter nodes, edges, or interaction graphs. For example, when a user filters for a certain tag, the interaction graphs containing that tag are displayed in the notepad area 18, while other interaction graphs that do not contain that tag are hidden.

[0074] Optionally, such as Figure 3 As shown in section (3), in response to a triggering operation of adding control 27 to the text, a text input box or a voice input box is displayed. In response to an end input operation of the text input box or the voice input box, input information is obtained and displayed.

[0075] Optionally, after the editing control 21 is triggered, at least one of the nodes, edges, and text can also be moved.

[0076] Figure 4A schematic diagram of a computer system provided in an exemplary embodiment of this application is shown. The computer system may include: a terminal 110 and a server 120.

[0077] Terminal 110 can be at least one of the following: smartphone, tablet, e-book reader, MP3 player, MP4 player, laptop, and desktop computer. Optionally, terminal 110 may have a client 130 installed and running that supports a virtual environment. This client 130 can be any of the following: open-world game, role-playing game, simulation game, adventure game, casual competitive game, MMO (Massive Multiplayer Online) game, board game, MOBA (Multiplayer Online Battle Arena) game, SLG (Simulation Game), virtual reality application, 3D map application, FPS (First-Person Shooter) game, multiplayer shooting survival game, casual game, party game, sandbox game, virtual reality (VR) application, and augmented reality (AR) application. In this embodiment, an open-world game is used as an example. Terminal 110 is a terminal used by the user. The user uses terminal 110 to control a master virtual character located in a virtual environment. The master virtual character can be called the user's virtual character, the virtual character controlled by the user, the first virtual character, etc. The activities of the master virtual character include, but are not limited to, at least one of the following: moving, jumping, teleporting, releasing skills, using props, adjusting body posture, crawling, walking, running, riding, flying, jumping, driving, picking up, shooting, attacking, throwing, interacting with virtual items, talking, and accepting tasks.

[0078] Server 120 includes at least one of the following: a single server, multiple servers, a server cluster, a cloud computing platform, and a virtualization center. Server 120 provides backend services to client 130 that supports the virtual environment. Optionally, server 120 undertakes the primary computing task, and the terminal undertakes the secondary computing task; or, server 120 undertakes the secondary computing task, and terminal 110 undertakes the primary computing task; or, server 120 and terminal collaborate on computing using a distributed computing architecture.

[0079] In an illustrative example, server 120 includes a processor, a user account database, and a user-facing input / output interface (I / O interface). The processor loads instructions stored in server 120 and processes data in the user account database. The user account database stores data about the user accounts used by terminal 110, such as user account avatars, nicknames, virtual character appearances, virtual characters held by the user account, and virtual equipment owned by the user account. The user-facing I / O interface is used to establish communication and exchange data with terminal 110 via a wireless or wired network.

[0080] In some embodiments, Figure 4 Only one terminal is shown, but in different embodiments, multiple other terminals can access the server 120. Optionally, one or more terminals may be terminals corresponding to developers, on which a client development and editing platform is installed. Developers can edit and update the client on these terminals and transmit the updated client installation package to the server 120 via wired or wireless network. Terminal 110 can download the client installation package from the server 120 to update the client. Optionally, one or more terminals may be terminals corresponding to other users, on which a client supporting virtual environments is installed. Other users can control the main virtual character or other virtual characters in the virtual environment through these terminals. The activities of other virtual characters include, but are not limited to, at least one of the following: moving, jumping, teleporting, releasing skills, using props, adjusting body posture, crawling, walking, running, riding, flying, jumping, driving, picking up, shooting, attacking, throwing, interacting with virtual items, talking, and accepting tasks.

[0081] Optionally, the controlling virtual character and other virtual characters are in the same virtual environment. Optionally, the controlling virtual character and other virtual characters can belong to the same faction, the same team, the same organization, have a friend relationship, or have temporary communication permissions.

[0082] Optionally, the clients installed on different terminals are the same, or the clients installed on two terminals are the same type of client on different operating system platforms (Android or iOS).

[0083] Terminal 110 and server 120 can communicate with each other via a network. This network can be a wired network or a wireless network.

[0084] It should be noted that in some embodiments, server 120 and terminal 110 are the same device.

[0085] Figure 5A flowchart illustrating a note-taking method applied to a virtual environment, as provided in an exemplary embodiment of this application, is shown. This method is executed by a terminal, which may be one of the methods described above. Figure 4 The terminal shown in the image. The method includes:

[0086] Step 210: Display the master virtual character located in the virtual environment.

[0087] The terminal's display screen shows the main virtual character located in a three-dimensional virtual environment. The terminal's display screen can display images of the virtual environment, which are captured by a camera model. Users can control the camera model to change the display effect of the virtual environment by interacting with the display screen (which is a touch-enabled display screen, also known as a touch screen) or external interactive devices (such as a mouse, keyboard, electronic stylus, gamepad, etc.), that is, changing the image displayed on the terminal's display screen.

[0088] Optionally, the master virtual character is a virtual object controlled by the user through a terminal.

[0089] Step 220: In response to an interaction trigger operation for the master virtual character, control the master virtual character to interact with at least one virtual object in the virtual environment.

[0090] Optionally, at least one virtual object is any one of a virtual character, a virtual item, or a virtual location. Optionally, if at least one virtual object is a virtual character, the virtual character is a virtual character controlled by an AI model; or a virtual character controlled by another user; or a virtual character controlled by a computer program (on a terminal and / or a server).

[0091] Optionally, the interaction between the main virtual character and at least one virtual object depends on the type of the virtual object. When the virtual object is a virtual character, the interaction between the main virtual character and the virtual object includes, but is not limited to: dialogue, task acceptance and delivery, trading virtual items, sparring, etc. When the virtual object is a virtual item, the interaction between the main virtual character and the virtual object includes, but is not limited to: picking up, dropping, moving, touching, crafting, etc. When the virtual object is a virtual location, the interaction between the main virtual character and the virtual object includes, but is not limited to: exploring, arriving at, leaving, etc.

[0092] Optionally, the interactive triggering operations for the main virtual character can be implemented through a display screen (which is a touch-enabled display screen, also known as a touch screen) or an external interactive device (such as a mouse, keyboard, electronic stylus, gamepad, etc.). For example, the user controls the main virtual character to interact with at least one virtual object through gesture operations on the display screen, such as clicking, long pressing, swiping, etc. Alternatively, the user can control the interaction between the main virtual character and at least one virtual object through an external device. For example, the user can move the mouse to control the cursor movement on the screen, and press the mouse button to control the cursor to click on the virtual environment displayed on the screen to move the main virtual character to the clicked position. The user can also click on at least one virtual object to achieve interaction between the main virtual character and at least one virtual object. Alternatively, the user can control the movement of the main virtual character and interaction with at least one virtual object through the physical keys of the keyboard. Alternatively, the user can control the movement of the main virtual character and interaction with at least one virtual object through the joystick or buttons of a gamepad. Specifically, the user can control the position movement of the main virtual character through the left joystick of the gamepad, control the display view of the virtual environment screen through the right joystick, and achieve interaction between the main virtual character and at least one virtual object through various buttons.

[0093] Step 230: In response to a trigger action on Notepad, display the Notepad interface.

[0094] Triggering operations for the Notepad refers to user-initiated opening of the main virtual character's Notepad, and / or user-initiated editing of the main virtual character's Notepad. For example, a Notepad display control is shown on the terminal's screen, and the user triggers the Notepad-specific operation by triggering the Notepad display control; or, a virtual Notepad is displayed in the virtual environment, and in response to the user's operation of controlling the main virtual character to open the virtual Notepad, the Notepad interface is displayed.

[0095] Optionally, the notepad display control is a button; or, the notepad display control is a sound trigger (or voice control); or, the notepad display control is a gesture control. That is, the triggering operations for the notepad display control include, but are not limited to: click operations, long press operations, swipe operations, touch operations, button operations, gesture operations, voice control operations, action control operations, and free combinations of at least two of the above operations.

[0096] Keypad operation refers to triggering the notepad display controls via physical buttons such as keyboards, mice, and gamepads. Gesture operation refers to combinations of actions such as swiping, clicking, and long-pressing with one or more fingers on a touchscreen or touchpad, such as pinching with two fingers or swiping down with three fingers. It should be noted that gesture operation can also be air gestures, where the user's hand movements are captured by the terminal's camera. Voice control operation refers to triggering the notepad display controls via voice commands, such as saying "Open Notepad" or "I want to take notes." Motion control operation refers to triggering the notepad display controls through user actions. This involves capturing or recognizing user actions using the terminal's gyroscope, motion sensors attached to the terminal, or actions detected by the terminal's camera, and then determining whether to display the notepad controls based on the user's actions.

[0097] It should be noted that the notepad display control mentioned above can be a virtual control displayed on the screen or a hidden virtual control. A hidden virtual control can be triggered to appear, or it can remain hidden at all times.

[0098] It should be noted that the triggering operations for other controls are similar to the triggering operations for the Notepad display control described above. The triggering operations for other controls will not be described in detail in this application embodiment, but the protection scope of this application embodiment is not limited thereto.

[0099] Step 240: In response to a trigger action on the Notepad interface, display an interaction graph in the form of graph data. The interaction graph includes at least two nodes, each of which is related to any one of the following: the main virtual character, at least one virtual object, or an interaction behavior.

[0100] The interaction graph includes at least two nodes and at least one edge.

[0101] Optionally, an interaction graph is a graph structure composed of nodes and edges; or, an interaction graph is a graph structure including nodes and edges; or, an interaction graph is a graph structure used to represent the interactive behavior of a controlling virtual character; or, an interaction graph is a graph structure used to organize the interactive behavior of a user in a virtual environment; or, an interaction graph is a graph structure used to record the interactive behavior of a user in a virtual environment; or, an interaction graph is a graph structure edited by the user, wherein the nodes and / or edges of the interaction graph are related to the controlling virtual character, at least one virtual object, and interactive behavior.

[0102] For example, users can generate interactions through editing operations in the Notepad interface. Figure 1 Interaction Figure 1Used to indicate the relationship network of virtual characters who have interacted with the main virtual character, such as Figure 6 As shown in section (1), the user gathers clues based on the dialogue between the main virtual character and other virtual objects, and infers the relationships between the various NPCs based on the user's own inferences, thus drawing the following diagram: Figure 6 In the interaction diagram shown in part (1), NPC1 is the father of NPC2 and NPC3, and NPC2 and NPC3 are brothers. Therefore, the node corresponding to NPC2 is connected to the node of NPC3 through a bidirectional edge (or double arrow). NPC2 and NPC4 are also lovers, etc.; or, the user generates the interaction through editing operations in the notepad interface. Figure 2 Interaction Figure 2 Used to indicate the crafting relationships between different virtual items, such as Figure 6 As shown in section (2), the client supports users in controlling the main virtual character to synthesize different virtual items. Through continuous synthesis and exploration, users obtain items such as... Figure 6 The synthesis path shown in part (2) allows item 3 to be synthesized from items 1 and 2 as raw materials, and item 4 can be obtained after item 3 is placed at address 1 for 10 minutes. That is, the specific meaning indicated by the interaction graph depends on the user's understanding through the combination of nodes and edges. This application embodiment does not limit this, but the protection scope of this application embodiment is not limited thereto.

[0103] In summary, the method provided in this application illustrates a note-taking method applied to a virtual environment, supporting users in recording and organizing interactive behaviors related to the main virtual character. This achieves systematic organization of fragmented content and supports further analysis and understanding by users, improving the efficiency of information organization. On the other hand, the interactive graph presented in graph data form allows users to clearly analyze and understand complex game plots and their logical relationships. The visual representation of nodes and edges helps users better grasp the plot development and task clues in the game, optimizing the ability to analyze game content. Furthermore, by providing intuitive management and viewing tools, users can participate more deeply in the game, enhancing its immersion and strategic depth. This structured management approach not only improves the player's gaming experience but also promotes in-depth exploration and participation in game content.

[0104] The following section will provide a further explanation of the note-taking process.

[0105] Based on Figure 5 In an alternative embodiment, such as Figure 7 As shown, step 240 can be implemented as steps 241 and 242.

[0106] Step 241: In response to the Add Node operation for the Notepad interface, add at least two nodes.

[0107] Optionally, in response to a triggering operation of adding a control to a node in the Notepad interface, at least two nodes are added. For example, in response to a single triggering operation of adding a control to a node in the Notepad interface, one node is added; or, in response to a single triggering operation of adding a control to a node in the Notepad interface, at least two nodes are added.

[0108] Optionally, at least two nodes are associated with at least one virtual object; or, at least two nodes are associated with the interaction behavior of the master virtual character and at least one virtual object; or, at least two nodes are associated with the master virtual character.

[0109] For example, at least two nodes are associated with at least one virtual object, such as at least one virtual object being a virtual character, and at least two nodes being used to indicate the virtual character, the virtual equipment equipped by the virtual character, the virtual items held by the virtual character, the virtual items created by the virtual character, other virtual characters interacting with the virtual character, the virtual character's dialogue, the tasks issued by the virtual character, etc.; or, at least one virtual object being a virtual item, and at least two nodes being used to indicate the virtual item, the raw materials of the virtual item (other virtual items), the evolved form of the virtual item, the creator of the virtual item, the previous holder of the virtual item, etc.; or, at least one virtual object being a virtual location, and at least two nodes being used to indicate the virtual location, the virtual location at the next higher level, the virtual location at the next lower level, the virtual character located in the virtual location, the virtual items produced by the virtual location, etc.

[0110] For example, at least two nodes are related to the controlling virtual character, such as at least two nodes used to indicate virtual items held by the controlling virtual character, virtual characters known to the controlling virtual character, virtual characters known to the controlling virtual character, virtual items known to the controlling virtual character, virtual locations explored by the controlling virtual character, virtual locations known to the controlling virtual character, and so on.

[0111] For example, at least two nodes are related to the interaction between the controlling virtual character and at least one virtual object. These nodes may be used to instruct the controlling virtual character to interact with other virtual characters mentioned in the interaction, virtual items obtained by the controlling virtual character from virtual characters or virtual locations, at least one virtual object known to the controlling virtual character, virtual characters known to the controlling virtual character, virtual items obtained by the controlling virtual character, the previous holder of a virtual item, the creator of a virtual item, and so on. Since at least one virtual object can be any of the aforementioned virtual characters, virtual items, virtual locations, etc., the interaction between the controlling virtual character and at least one virtual object can refer to the series of actions or relationships shown above in the cases of "at least two nodes being related to at least one virtual object" or "at least two nodes being related to the controlling virtual character." These will not be listed individually here, but the scope of protection of this application embodiment is not limited thereto.

[0112] Optionally, the notepad interface displays a notepad area, which is a canvas component, or the notepad area includes a canvas component. The canvas component is used to display and edit interactive diagrams. For example, the canvas component is displayed as a rectangular area in the notepad interface, which supports at least one of scaling, moving, and editing. That is, the display range (or display area) of the canvas component in the notepad interface may differ from or be the same as the actual range (or actual area). Users can change the display range of the canvas component through sliding operations, button operations, voice commands, etc., a process known as scaling; users can also change the display area of ​​the canvas component through sliding operations, button operations, voice commands, etc., a process known as moving; users can also change the display format of the canvas component through clicking operations, button operations, voice commands, etc., such as changing the color and size of the canvas component, a process known as editing.

[0113] Optionally, editing operations on the canvas component include, but are not limited to: adding graphic elements (such as nodes or edges); deleting graphic elements; modifying graphic elements (such as changing shape, color, etc.); adding text elements; deleting text elements; modifying text elements, etc. Graphic elements and text elements are types of UI elements, and both can be implemented using Image controls; text elements can be implemented using Text controls.

[0114] Step 242: Display the interactive graph in graph data form based on at least two nodes.

[0115] Optionally, based on at least two nodes, at least one edge is determined to obtain an interactive graph presented in the form of graph data. The at least one edge is determined based on a user's connection operation on any two of the at least two nodes; or, the at least one edge is automatically generated; or, the at least one edge is pre-designed, and the pre-designed edge between the at least two nodes is displayed in response to the addition of the at least two nodes.

[0116] Optionally, the interaction diagram is displayed in the notepad area; that is, an interaction diagram is generated in the notepad interface or the notepad area based on at least two nodes. Further, based on at least two nodes, the nodes within the at least two nodes are connected in the notepad interface to obtain the interaction diagram.

[0117] For example, in response to the triggering of an interaction graph generation event, an interaction graph is generated based on at least two nodes; or, in response to a connection operation of at least one edge, the nodes in at least two nodes are connected using at least one edge to obtain an interaction graph.

[0118] In summary, the method provided in this application further illustrates a note-taking process applied to a virtual environment. It involves adding at least two nodes to an interaction graph through a node-adding operation in the notepad interface, and determining the interaction graph based on these at least two nodes. This allows users to add at least two visible nodes in a visual notepad interface, thereby generating a user-visible interaction graph. This helps users analyze and understand complex game plots and their logical relationships within the notepad interface, thus helping them better grasp the game's storyline and quest clues. Compared to simply providing linear log information, this optimizes the user's analysis of game content.

[0119] The following section will further introduce the editing of information such as nodes and edges involved in the interaction graph.

[0120] 1. Adding nodes.

[0121] The addition of nodes can be achieved based on interaction logs or directly based on at least one virtual object.

[0122] • Add based on the interaction log.

[0123] In some embodiments, step 241 above includes: displaying an interaction log, the interaction log being used to indicate the interaction behavior between the main virtual character and at least one virtual object, the interaction log including at least two text entities, each of the at least two text entities being used to indicate any one of the interaction character, interaction content, interaction location, interaction item, and interaction event; in response to a trigger operation on at least two text entities in the notepad interface, adding at least two nodes, the at least two text entities corresponding one-to-one with the at least two nodes.

[0124] Optionally, the notepad interface also includes an interaction log display area. This area displays the interaction log, which indicates the interaction behavior between the main virtual character and at least one virtual object. For example, the interaction log describes when, where, and with whom the main virtual character engaged in what activity; or, the interaction log describes when, where, and with whom the main virtual character engaged in what activity; or, the interaction log describes where, where, and with whom the main virtual character engaged in what activity; or, the interaction log describes what happened to the main virtual character. That is, the interaction log will involve at least one of the following: interactive character, interactive content, interactive location, interactive item, and interactive event.

[0125] The interaction categories are as follows: Interaction Role: Indicates the virtual character that interacts with the main virtual character. Interaction Content: Indicates actions during the interaction, such as dialogue, movement, crafting, accepting / submitting quests, attacking, defeating, trading, etc. Interaction Location: Indicates the virtual location where the interaction occurs or is involved in the interaction, such as the interaction occurring in "xx Canyon," or the interaction being a dialogue mentioning the virtual location "xx Canyon." Interaction Item: Indicates virtual items during the interaction or involved in the interaction, such as crafting a virtual item, or the interaction being a dialogue mentioning a virtual item. Interaction Event: Indicates events during the interaction, such as dialogue content, quest content, etc.

[0126] Optionally, "interaction logs include at least two text entities" means that one interaction log includes at least two text entities, or that at least two interaction logs include at least two text entities. Optionally, each interaction log includes at least one interaction entity. In this embodiment, the source of the at least two text entities—whether it is one interaction log or at least two interaction logs—is not limited.

[0127] Optionally, each of the at least two text entities may be used to indicate any one of the following: interactive role, interactive content, interactive location, interactive item, or interactive event. Each of the at least two text entities may be of the same type, such as each of the at least two text entities indicating an interactive role, or each of the at least two text entities indicating an interactive item, and so on. Alternatively, at least two types of text entities may exist among the at least two text entities, such as a first part of the text entities indicating an interactive role, a second part indicating an interactive location, a third part indicating an interactive item, and so on.

[0128] Optionally, at least two text entities are different text entities, and each of the at least two text entities corresponds to at least one node. For example, for a text entity, text entities that may appear repeatedly in the interaction log are considered as the same text entity.

[0129] Optionally, the triggering operation for at least two text entities includes: a triggering operation for each of the at least two text entities, such as double-clicking each of the at least two text entities to add a node corresponding to each text entity; or a triggering operation for adding a control to a node, such as clicking a node to add a control to directly add a node corresponding to at least two text entities. That is, adding at least two nodes in the Notepad interface can be done sequentially after a triggering operation for each of the at least two text entities, or it can be done all at once after a triggering operation for adding a control to a node. When the triggering operation for at least two text entities is a triggering operation for adding a control to a node, the at least two text entities can be all text entities included in the interaction log displayed in the Notepad interface; or, the at least two text entities can be text entities in the interaction log pre-selected by the user. That is, the method further includes: in response to a selection operation for the interaction log, determining that the selected text entities in the interaction log are at least two text entities.

[0130] Optionally, for each text entity, one or at least two nodes can be added to the Notepad interface. This application embodiment uses the example of adding one node to the Notepad interface for each text entity, but the scope of protection of this application embodiment is not limited thereto.

[0131] Optionally, if each text entity corresponds to a node, and node 1 corresponding to the first text entity already exists, then in response to the node addition operation for the first text entity, node 1 is displayed in the Notepad interface, or node 1 is highlighted in the Notepad interface. For example, if node 1 corresponding to the first text entity already exists, and it is detected that the user double-clicks the first text entity or the text element (or text control) corresponding to the first text entity, and it is detected that the first text entity has a corresponding node 1, then node 1 is displayed in the Notepad interface. Specifically, the display area of ​​the canvas component is set to the area where node 1 is located (or the canvas component is moved so that node 1 is displayed in the Notepad interface); or, node 1 is highlighted, such as displaying node 1 at the center of the display area of ​​the canvas component, or setting the display area of ​​the canvas component to the area where node 1 is located and highlighting node 1, or displaying node 1 at the center of the canvas component and selecting node 1 (setting node 1 to a selected state), etc.

[0132] In summary, the method provided in this application adds nodes by displaying an interaction log in a notepad interface, where the log includes text entities that can be triggered to add nodes. On one hand, this method displays the interaction log in the notepad interface, allowing users to directly browse and recall fragmented information such as game plot and progression. This facilitates the user's ability to organize the interaction log into an interaction diagram, improving the efficiency of log analysis and enabling users to easily and quickly summarize the game plot, thus enhancing the user's gaming experience. On the other hand, adding nodes through text entities—entities in the interaction log used to describe interactive behaviors or those involved in those behaviors—and using these entities as nodes in the interaction diagram helps users understand the relationships between various text entities in the log. These text entities are crucial for connecting fragmented information. Organizing the interaction log through text entities allows users to intuitively organize and analyze fragmented information in the game, presenting complex game content more systematically and significantly improving information organization efficiency.

[0133] • Add based on at least one virtual object.

[0134] In some embodiments, step 241 above includes: when a first virtual object is displayed in the notepad interface, in response to a trigger operation on the first virtual object, adding a first node, wherein the first node corresponds to the first virtual object.

[0135] Optionally, if at least one virtual object is displayed in the notepad interface, in response to a trigger operation on at least one virtual object, at least two nodes are added, with each node corresponding to at least one virtual object.

[0136] Optionally, the first virtual object is one of the at least one virtual objects mentioned above. The virtual object can be any one of a virtual character, a virtual item, or a virtual location.

[0137] Optionally, the notepad interface refers to the interface that includes the notepad area. The notepad area can fill the entire notepad interface; or it can be an area that occupies part of the notepad interface. When the notepad interface also displays the first virtual object, the notepad area occupies part of the notepad interface.

[0138] Optionally, the notepad interface displays the first virtual object, or displays the identification information of the first virtual object, or displays the icon of the first virtual object. The identification information includes, for example, the name of a virtual character, the name of a virtual item, the name of a virtual location, etc. The icon of the first virtual object includes, for example, the avatar of a virtual character, the icon (or thumbnail) of a virtual item, the area corresponding to a virtual location displayed on a virtual map, etc. Therefore, the triggering operation for the first virtual object can be a triggering operation for the first virtual object in the virtual environment, a triggering operation for the first virtual object displayed in the virtual environment screen, a triggering operation for the identification information of the first virtual object in the notepad interface, or a triggering operation for the icon of the first virtual object in the notepad interface.

[0139] For example, the triggering operation for the first virtual object could be a click or key operation on the identifier information in the basic information of the first virtual object displayed in the notepad interface after the user controls the main virtual character to communicate with the first virtual object and obtain the basic information of the first virtual object; or it could be an interactive operation on the first virtual object held by the user after the user controls the main virtual character to pick up the first virtual object, such as displaying the node corresponding to the first virtual object to add controls after the main virtual character picks up the first virtual object, etc.

[0140] Optionally, the first node corresponds to the first virtual object. For example, the first node displays the identification information of the first virtual object, or the first node displays the icon of the first virtual object, or the first node displays information related to the first virtual object, such as the source of the first virtual object, the acquisition time, the time of acquaintance, the time of first exploration, the task issued by the first virtual object, the dialogue of the first virtual object, the virtual items held by the first virtual object, etc.

[0141] In some embodiments, the first virtual object is any one of a virtual item, a virtual location, and a virtual character; when the first virtual object is displayed in the Notepad interface, adding a first node in response to a trigger operation on the first virtual object includes: when the first virtual object is a virtual item and the Notepad interface displays a virtual item, adding a first node in response to a trigger operation on the virtual item, the first node corresponding to the virtual item; when the first virtual object is a virtual location and the Notepad interface displays a virtual location, adding a first node in response to a trigger operation on the virtual location, the first node corresponding to the virtual location; when the first virtual object is a virtual character and the Notepad interface displays a virtual character, adding a first node in response to a trigger operation on the virtual character, the first node corresponding to the virtual character.

[0142] For example, if the first virtual object is a virtual item and the notepad interface displays the virtual item, a first node is added in response to a trigger operation on the virtual item. The first node corresponds to the virtual item. For instance, if the first virtual object is a virtual item, the user controls the main virtual character to pick up the virtual item, and a node-adding control for the virtual item is displayed in the notepad interface, a first node corresponding to the virtual item is added in response to a click operation on the node-adding control for the virtual item. As another example, if the first virtual object is a virtual item and the virtual item is located in the main virtual character's virtual backpack, the user can open the virtual backpack and display the virtual item in the main virtual character's virtual backpack as an icon in the notepad interface (which can also be called the backpack interface, but the backpack interface can display the notepad area). In response to a trigger operation on the virtual item's icon, such as right-clicking the virtual item's icon or dragging the virtual item's icon to the notepad area, a first node corresponding to the virtual item is added.

[0143] For example, if the first virtual object is a virtual location and the notepad interface displays a virtual location, a first node is added in response to a trigger operation targeting the virtual location. This first node corresponds to the virtual location. For instance, the first virtual object is a virtual location, and a virtual map is displayed in the notepad interface. This virtual map can be a virtual map held by the controlling virtual character and located in a virtual environment, or it can be a virtual map displayed in the map display area of ​​the notepad interface. The virtual map displays identification information or an icon for the virtual location (such as the area of ​​the virtual location on the virtual map). In response to a trigger operation targeting the identification information or icon of the virtual location, such as dragging the virtual location icon to the notepad area, a first node corresponding to the virtual location is added.

[0144] For example, if the first virtual object is a virtual character and the notepad interface displays the virtual character, a first node is added in response to a trigger operation targeting the virtual character. This first node corresponds to the virtual character. For instance, if the first virtual object is a virtual character and the virtual environment displayed in the notepad interface includes this virtual character, a node for adding controls to the virtual character is displayed in response to a trigger operation targeting this virtual character; and a first node corresponding to the virtual character is added in response to a trigger operation targeting a node for adding controls to the virtual character. As another example, if the first virtual object is a virtual character and the notepad interface displays the virtual character's identification information and / or icon (such as an avatar), and the user can control the opening of a list of virtual characters known to the main virtual character, a first node corresponding to the virtual character is added in response to a trigger operation targeting the identification information and / or icon of the virtual character corresponding to the first virtual object in the virtual character list.

[0145] In summary, the method provided in this application adds a first node corresponding to a first virtual object by triggering an operation on the first virtual object. Compared to adding nodes through text entities in the interaction log, this method allows users to more intuitively understand the first virtual object corresponding to the first node, since the first virtual object is also displayed in the notepad interface. This facilitates user analysis of game content, increases the information richness in the notepad interface, and reduces the difficulty and complexity of generating the interaction graph.

[0146] Furthermore, it demonstrates a method for triggering the first virtual object when the first virtual object is any one of a virtual character, virtual item, or virtual location. This method utilizes the effective information of the first virtual object (identification information, icons, etc.) and provides users with an intuitive visual experience, thereby stimulating users' enthusiasm for participating in the game and enhancing the game's immersion and strategic depth.

[0147] It should be noted that the node addition methods described above, namely "adding based on interaction logs" and "adding based on at least one virtual object," can be implemented as independent embodiments or as combined embodiments. For example, when "adding based on interaction logs" and "adding based on at least one virtual object" are implemented as a combined embodiment, if the user triggers the display of interaction logs in the notepad interface, the node addition method "adding based on interaction logs" is triggered; if the user triggers the display of at least one virtual object, or the identification information of at least one virtual object, or the icon of at least one virtual object, etc., in the notepad interface, the node addition method "adding based on at least one virtual object" is triggered.

[0148] 2. Adding edges.

[0149] In some embodiments, step 242 above includes: in response to a connection operation between each of the at least two nodes, generating at least one edge between each of the at least two nodes to obtain an interaction graph presented in the form of graph data, wherein each edge in the at least one edge is used to indicate the logical relationship between the two nodes connected by each edge.

[0150] Optionally, in response to a connection operation between any two nodes in the at least two nodes, at least one edge connecting any two nodes in the at least two nodes is generated, resulting in an interaction graph. At least one edge is used to connect at least two nodes, and each node in the at least two nodes corresponds to one edge. That is, there are no discrete nodes in the interaction graph; the relationship between the number of at least two nodes and the number of at least one edge satisfies the following: when there are n nodes in the at least two nodes, the number of at least one edge is greater than or equal to n-1.

[0151] It should be noted that in some embodiments, the interaction graph may contain discrete nodes. In this case, the interaction graph is a graph structure that includes at least one node. That is, the interaction graph may not include edges. The embodiments of this application do not limit this, but the protection scope of the embodiments of this application is not limited thereto.

[0152] In some embodiments, generating at least one edge between at least two nodes in response to a connection operation between each of the at least two nodes includes: displaying at least one connection point on the second node in response to a selection operation on the second node, the connection point being a point on the node used to establish the edge; displaying at least one connection point on a third node in response to a trigger operation on a first connection point among the at least one connection point on the second node, the third node being a node other than the second node among the at least two nodes; and generating an edge connecting the second node and the third node in response to a trigger operation on a second connection point among the at least one connection point on the third node.

[0153] In this context, each node's connection point is a point on the node used to establish an edge; or, each node's connection point is a point on the node used to generate an edge; or, each node's connection point is a point on the node used to generate auxiliary edges; or, each node's connection point is a point on the node used to generate edges connected to that node.

[0154] In some embodiments, in response to a selection operation on a second node, at least one connection point is displayed on the second node; or, in response to an edge addition operation on a second node, at least one connection point is displayed on the second node; or, in response to a triggering operation of an edge addition control on a second node, at least one connection point is displayed on the second node; or, in response to both a selection operation on a second node and a triggering operation of an edge addition control, at least one connection point is displayed on the second node.

[0155] In some embodiments, the connection points of the second node are points on the second node used to establish edges; or, the connection points of the second node are points on the node used to generate edges; or, at least one connection point of the second node is used to assist the user in generating edges connected to the second node. At least one connection point may be displayed around the node, such as... Figure 3 As shown in section (1), after node 20 is selected, four connection points 21 are displayed around node 20.

[0156] Optionally, in response to a trigger operation targeting a first connection point among at least one connection point on the second node, at least one connection point is displayed on the third node, which is a node other than the second node among at least two nodes; and an edge originating from the second node is displayed, the endpoint of which is the cursor or touch point. Displaying at least one connection point on the third node facilitates the user connecting the edge originating from the second node to the third node. In response to a trigger operation targeting a second connection point among at least one connection point on the third node, an edge connecting the second node and the third node is generated. Optionally, the edge connecting the second node and the third node can be an edge originating from the position of the first connection point to the second connection point, i.e., an edge connecting the first connection point and the second connection point; or, the edge connecting the second node and the third node can be a line segment from the second node to the third node.

[0157] Optionally, in response to a triggering operation targeting a first connection point among at least one connection point on the second node, at least one connection point is displayed on the third node; and an edge originating from the second node is displayed; and the display of at least one connection point on the second node is canceled.

[0158] Optionally, in response to a triggering operation targeting a second connection point among at least one connection point on the third node, an edge connecting the second node and the third node is generated; and the display of at least one connection point on the third node is cancelled.

[0159] Optionally, the triggering operation for the first connection point among at least one connection point on the second node is a drag operation starting from the position of the first connection point, or a slide operation starting from the position of the first connection point, etc.

[0160] Optionally, the triggering operation for the second connection point among at least one connection point on the third node is a sliding operation that ends at the position of the second connection point.

[0161] In other words, the user operation process for generating the edge between the second node and the third node can be understood as follows: the user selects the second node through the display screen or peripheral device, at least one connection point is displayed on the second node, the user starts to slide from the first connection point among the at least one connection point on the second node through the display screen or peripheral device, after the sliding starts, at least one connection point is displayed on the other nodes among at least two nodes, and when the user slides to the position of the second connection point among the at least one connection point on the third node and ends the sliding operation, the edge connecting the second node and the third node is generated.

[0162] Optionally, the edge can be a directed edge or an undirected edge. If the edge is a directed edge, it can be a unidirectional edge or a bidirectional edge.

[0163] For example, such as Figure 3As shown in section (2), after the user selects node 20 and clicks or drags the connection point 22 of node 20, at least one corresponding connection point 25 is displayed on other nodes in the notepad area 18, such as node 24. If the user drags the edge 23 originating from node 20 to the connection point 25 of node 24, as shown in section (2), Figure 3 As shown in part (3), edge 26 is generated between node 20 and node 24.

[0164] In other embodiments, in response to selection operations on the second and third nodes and a trigger operation on adding an edge control, an edge connecting the second and third nodes is generated. The selection operations on the second and third nodes and the trigger operation on adding an edge control can be executed sequentially or in reverse order; that is, the user can execute the selection operations on the second and third nodes first, and then execute the trigger operation on adding an edge control; or the user can execute the trigger operation on adding an edge control first, and then execute the selection operations on the second and third nodes. For the terminal device, the difference lies in whether it first determines whether the selection operations on the second and third nodes have been triggered, or whether it first determines whether the trigger operation on adding an edge control has been triggered.

[0165] In other embodiments, in response to a selection operation for the second node and the third node, an edge-adding control is displayed; in response to a trigger operation for the edge-adding control, an edge connecting the second node and the third node is generated.

[0166] In other embodiments, in response to a triggering operation that adds a control to an edge, at least two nodes are switched to be displayed as a first selected state; in response to a triggering operation that adds a second node to the first selected state, an edge originating from the second node is displayed; and a third node is switched to be displayed as a second selected state; and in response to a triggering operation that adds a third node to the second selected state, an edge connecting the second node and the third node is generated.

[0167] In summary, the method provided in this application illustrates a way to generate an interaction graph based on at least two nodes. Specifically, it involves connecting the nodes in the at least two nodes, or generating at least one edge connecting the at least two nodes. That is, at least one edge represents the logical relationship between the nodes in the at least two nodes. This connects the information related to at least one virtual object represented by the at least two nodes, or confirms the logical relationship of information related to at least one virtual object, and then presents it visually. This improves the logical consistency of the content displayed in the notepad interface and enhances user operability.

[0168] Furthermore, the method for generating edges connecting two nodes is illustrated. Indicating at least one connection point makes the entire edge generation process clearer. Moreover, the connection method based on at least one connection point improves adaptability and convenience for different peripheral devices, making the operation of controllers, keyboards, etc., more explicit and clear, and enhancing the operability of the interaction graph generation process.

[0169] 3. Editing text or tags.

[0170] • Text editing.

[0171] In some embodiments, it is supported to add text to nodes or edges. The text added to nodes or edges can be understood as being associated with the nodes or edges, specifically, it can move as the nodes or edges are moved and be deleted as the nodes or edges are deleted.

[0172] In some embodiments, in response to a triggering operation on a first edge of at least one edge, first input information for the first edge is obtained; and the first input information is displayed on the first edge.

[0173] For example, in response to a triggering operation on a first side of at least one edge, a text input box and / or a voice input box are displayed; in response to an end-of-input operation on the text input box or the voice input box, first input information for the first side is obtained; and the first input information is displayed on the first side. Specifically, in response to an end-of-input operation on the voice input box, audio information is recognized to obtain the first input information for the first side.

[0174] Optionally, in response to a trigger operation on the first input information displayed on the first side, a text editing control is displayed; in response to an end input operation on the text editing control, new first input information is obtained; and the new first input information is displayed on the first side. The new first input information can be a null value, the same as the first input information, or other information.

[0175] Optionally, in response to a font change operation on the first input information displayed on the first side, the display state of the first input information is changed. The display state of the first input information includes at least one of the following: font size; font; color; whether it is bold; whether it is italic; whether it has an underline; whether it has a strikethrough.

[0176] In some embodiments, in response to a triggering operation on a fourth node of at least two nodes, second input information for the fourth node is obtained; and the second input information is displayed on the fourth node.

[0177] For example, in response to a trigger operation targeting the fourth node of at least two nodes, a text input box and / or a voice input box are displayed; in response to an end-of-input operation targeting the text input box or the voice input box, second input information is obtained for the fourth node; and the input information is displayed on the fourth node. Specifically, in response to an end-of-input operation targeting the voice input box, audio information is recognized to obtain the second input information.

[0178] Optionally, in response to a trigger operation on the second input information displayed on the fourth node, a text editing control is displayed; in response to an end-of-input operation on the text editing control, new second input information is obtained; and the new second input information is displayed on the fourth node. The new second input information can be null, the same as the second input information, or other information.

[0179] Optionally, in response to a font change operation on the second input information displayed on the fourth node, the display state of the second input information is changed. The display state of the second input information includes at least one of the following: font size; font; color; whether it is bold; whether it is italic; whether it has an underline; whether it has a strikethrough.

[0180] In some embodiments, adding text to the Notepad interface is supported. Furthermore, adding text to the Notepad area is also supported. Text added to the Notepad area, unlike text added to nodes or edges, is not associated with any node or edge; that is, it will not move with the node or edge, nor will it be deleted when a node or edge is deleted. However, this text can be moved, edited, deleted, etc., as an independent element or control.

[0181] Optionally, in response to a text addition operation in the Notepad interface, third input information for the Notepad is obtained; and the third input information is displayed in the Notepad interface. Further, adding text to the Notepad area of ​​the Notepad interface, i.e., in response to a text addition operation in the Notepad area, obtaining third input information for the Notepad; and displaying the third input information in the Notepad area. The text addition operation in the Notepad interface or the text addition operation in the Notepad area can refer to the triggering operations for the first or fourth node described above, and will not be repeated here.

[0182] Optionally, the text in the Notepad interface or Notepad area can also have its display status changed, which will not be elaborated on again.

[0183] In summary, the method provided in this application supports adding text to nodes or edges. On one hand, it improves the readability of the interaction graph, or rather, the intuitiveness of the interactive behaviors displayed by the graph. On the other hand, for complex graph structures, such as those with 10 or 20 or more nodes and a large number of edges, it helps users understand the relationships between nodes and edges and their roles in the overall structure. This allows users to clearly analyze and understand complex game plots and their logical relationships by adding text to nodes or edges.

[0184] • Tag editing.

[0185] In some embodiments, in response to a triggering operation on a second side of at least one edge, at least one candidate label is displayed; in response to a selection operation on a first label among the at least one candidate label, a first label is displayed on the second edge.

[0186] Optionally, the candidate tags are pre-set by the developer; and / or, the tags are added by the user. That is, at least some of the candidate tags are pre-set by the developer, while others are added by the user.

[0187] For example, labels are used to classify nodes or edges. Specifically, at least one of the candidate labels includes, but is not limited to, at least one of the following: interpersonal relationships; raw materials; evolutionary materials; factions; hidden locations; location levels, etc. Wherein, when the interpersonal relationship label is added to an edge, it indicates that the edge is used to indicate the interpersonal relationship between the two nodes it connects; when the raw material label is added to an edge, it indicates that one of the two nodes it connects is the raw material for the other node; when the evolutionary material label is added to an edge, it indicates that one of the two nodes it connects is the evolutionary material for the other node, and so on. It should be noted that the content of each label and the meaning indicated by each label can be set and understood by the user, and this embodiment does not limit this.

[0188] Optionally, in response to a trigger event for the second side of at least one edge, a label list component is displayed, in which at least one candidate label is displayed; in response to a selection event for the first label in the label list component, a first label is added to the second side; and the first label is displayed on the second side.

[0189] In some embodiments, in response to a triggering operation on a fifth node of at least two nodes, at least one candidate label is displayed; in response to a selection operation on a second label of the at least one candidate label, the second label is displayed on the fifth node.

[0190] For example, tags are used to classify nodes or edges. Specifically, at least one of the following is included, but is not limited to: interpersonal relationships; raw materials; evolution materials; factions; hidden locations; location levels, etc. Faction tags can include multiple tags, such as one faction tag for faction 1 and another for faction 2. When a faction tag is added to a node, it indicates that the node belongs to the faction corresponding to that tag. When a hidden location tag is added to a node, it indicates that the virtual location corresponding to that node is a hidden location, meaning it will only be displayed or allowed to be entered by the main virtual character after certain triggering conditions are met. Location level tags can include multiple tags, such as one location level tag for level 50, one for level 60, and one for level 70. When a map level tag is added to a node, it indicates the recommended exploration level or minimum entry level for the virtual location corresponding to the node, etc. It should be noted that the content of each tag and the meaning indicated by each tag can be set and understood by the user, and this embodiment does not limit this.

[0191] Optionally, in response to a trigger event for the fifth node of at least two nodes, a tag list component is displayed, in which at least one candidate tag is displayed; in response to a selection event for the first tag in the tag list component, a first tag is added to the fifth node; and the first tag is displayed on the fifth node.

[0192] In addition to adding labels to nodes or edges, labels also support filtering of nodes, edges, or interaction graphs.

[0193] In some embodiments, in response to a triggering operation on a third label, nodes and / or edges associated with the third label are filtered; and nodes and / or edges associated with the third label are displayed.

[0194] Optionally, a node and / or edge associated with a third label can be understood as a node and / or edge that has a third label added. That is, when a node has a third label added, it can be said that the node is associated with a third label; when an edge has a third label added, it can be said that the edge is associated with a third label.

[0195] Optionally, at least one candidate tag can be displayed in the Notepad interface via a tag display control. In other words, in response to a triggering operation on the tag display control in the Notepad interface, a tag list component is displayed, showing at least one candidate tag. This tag list component can be the same as or different from the tag list component used when adding a tag. In response to a triggering operation on a third tag in the tag list component, the node and / or edge associated with the third tag is displayed.

[0196] Optionally, in response to a triggering operation for a third label, the edges connected to the nodes associated with the third label and the nodes connected through those edges are also displayed; or, in response to a triggering operation for a third label, the two nodes connected by the edges associated with the third label are also displayed; or, in response to a triggering operation for a third label, the interaction graph including the nodes associated with the third label and / or the edges in which they are located is also displayed.

[0197] In summary, the method provided in this application supports adding labels to nodes or edges. On one hand, it improves the readability of the interaction graph, or in other words, the intuitiveness of the interactive behaviors displayed by the graph. On the other hand, for complex graph structures, such as those with 10 or 20 or more nodes and a large number of edges, it helps users understand the relationships between nodes and edges and their roles in the overall structure. This allows users to clearly analyze and understand complex game plots and their logical relationships by adding labels to nodes or edges.

[0198] Furthermore, tags also support auxiliary filtering of nodes or edges. This improves the efficiency of data retrieval for users within the interaction graph and reduces their cognitive burden. As a result, after generating the interaction graph, users can directly filter and view interactions related to a specific task, location, item, or faction based on tags, thus reducing the complexity of the graph from which users obtain effective information and improving the efficiency of information retrieval.

[0199] 4. Node editing.

[0200] ·move.

[0201] In some embodiments, in response to a move operation on the sixth node in the interaction graph, the position of the sixth node and / or at least one edge connected to the sixth node in the interaction graph is changed.

[0202] Optionally, when the sixth node is moved, at least one edge connected to it will also move along with the sixth node.

[0203] Optionally, in response to a selection operation on multiple nodes in the interaction graph and a move operation on multiple nodes, the position of multiple nodes and / or at least one edge connected to multiple nodes in the interaction graph is changed.

[0204] • Highlighting of text entities.

[0205] In some embodiments, the interaction log includes text entities; when the interaction log is displayed, in response to a selection operation for the seventh node among at least two nodes, the text entity corresponding to the seventh node in the interaction log is highlighted.

[0206] Optionally, when the user selects node 20 (i.e., the seventh node), such as Figure 2 As shown, the text entity 19 corresponding to node 20 in the highlighted interaction log is highlighted. Highlighting can be achieved by changing the display color of the text entity corresponding to the selected node, and / or changing the weight of the text entity corresponding to the selected node (i.e., making the text entity bold), and / or changing the font of the text entity corresponding to the selected node, and / or changing the font size of the text entity corresponding to the selected node, etc. Figure 2 The example given is changing the thickness of the text entity corresponding to the selected node, but this is not a limitation.

[0207] • Display status.

[0208] In some embodiments, in response to an edit operation on the eighth node in the interaction graph, the display state of the eighth node is changed, and the display state includes at least one of the following: color; shape; size; transparency.

[0209] Optionally, in response to an editing operation on the eighth node in the interactive diagram, an editing toolbar is displayed. The editing toolbar includes, but is not limited to, at least one of the following editing controls: shape control; color control; scaling control; transparency control, etc. In response to a triggering operation on an editing control in the editing toolbar, the display state of the eighth node is changed. Alternatively, an editing toolbar is displayed in the Notepad interface, and in response to a selection operation on the eighth node in the interactive diagram and a triggering operation on an editing control in the editing toolbar, the display state of the eighth node is changed.

[0210] For example, you can change the display state of the eighth node, such as changing its color to red; changing a circular eighth node to a square one; enlarging the eighth node; shrinking the eighth node; adjusting the transparency of the eighth node to 80%, and so on.

[0211] In summary, the method provided in this embodiment supports operations such as moving nodes and modifying their display states, enhancing the interactivity of the interaction graph generation process. It also allows users to design interaction graphs according to their own understanding, increasing the freedom of interaction graph generation and improving the user experience. Furthermore, it supports modifying the display states of nodes, enabling a clearer and more intuitive distinction between different types of nodes, thus improving the readability of the final generated interaction graph and the flexibility of the interaction graph generation process.

[0212] Furthermore, when the notepad interface displays an interaction log, if a text entity in the interaction diagram is selected, the text entity corresponding to that node will be highlighted in the interaction log. This makes it easier for users to view the interaction log related to that node, thereby understanding the entire interaction behavior, task clues, game plot, etc. based on these interaction logs, which significantly improves the efficiency of information organization.

[0213] 5. Editing the edges.

[0214] In some embodiments, in response to an editing operation on a third side in an interactive diagram, the display state of the third side is changed, and the display state includes at least one of the following: thickness; style; orientation.

[0215] Optionally, in response to an editing operation on the third side of the interactive diagram, an editing toolbar is displayed. The editing toolbar includes, but is not limited to, at least one of the following editing controls: thickness adjustment controls; style controls; directional controls, etc. In response to a triggering operation on an editing control in the editing toolbar, the display state of the eighth node is changed. Alternatively, an editing toolbar is displayed in the Notepad interface, and in response to a selection operation on the eighth node in the interactive diagram and a triggering operation on an editing control in the editing toolbar, the display state of the eighth node is changed.

[0216] For example, change the display state of the third side. Change the thickness of the third side, such as changing it from 1 pt to 2 pt. Change the style of the third side, such as changing it from a solid line to a dashed line; or changing it from a solid line to a dotted-dash line. Change the directionality of the third side, such as changing it from an undirected edge connecting nodes 1 and 2 to a unidirectional edge pointing from node 1 to node 2, or a unidirectional edge pointing from node 2 to node 1, or a bidirectional edge pointing to both nodes 1 and 2.

[0217] In summary, the method provided in this embodiment supports operations such as modifying the display state of edges, enhancing the interactivity of the interaction graph generation process. It also allows users to design interaction graphs according to their own understanding, increasing the freedom of interaction graph generation and improving the user experience. Furthermore, it supports modifying the display state of edges, thus enabling a clearer and more intuitive distinction between different types of edges. For example, different types of edges can be used to express different logical relationships between nodes, improving the readability of the final generated interaction graph and the flexibility of the interaction graph generation process.

[0218] 6. Generation of interaction logs.

[0219] In some embodiments, an interaction log is generated in response to the fulfillment of the interaction log generation conditions; wherein the interaction log generation conditions include at least one of the following: the main virtual character performs an interaction behavior against at least one virtual object; the interaction duration reaches a preset threshold, and the interaction duration is the length of time between the current moment and the first time point.

[0220] Optionally, the first time point is the time point when the last interaction log was generated. That is, it can be understood as generating an interaction log every interaction duration.

[0221] Optionally, in response to the main virtual character performing an interactive behavior against at least one virtual object, an interaction log is generated, that is, an interaction log is generated when a specific event is triggered or a key person is encountered.

[0222] In some embodiments, in response to meeting the conditions for generating interaction logs, generating interaction logs includes: in response to meeting the conditions for generating interaction logs, invoking a behavior summary model, the behavior summary model being used to generate interaction logs based on the interaction behavior of the master virtual character; inputting the interaction behavior information of the master virtual character within the interaction duration into the behavior summary model to generate interaction logs.

[0223] Optionally, the user's interactive behavior controlling the main virtual character will be recorded through behavioral information. This behavioral information includes user actions triggered by controls, such as the user clicking on a control at a specific time to open an interface; user actions controlling the movement of the main virtual character, such as the main virtual character arriving at a specific location at a specific time; user actions controlling the interaction between the main virtual character and other virtual characters, such as the main virtual character meeting a specific person, fighting that person at a specific time, and obtaining an item from that person; and user actions controlling the interaction between the main virtual character and virtual items, such as the main virtual character creating an item at a specific time, failing to create an item at a specific time, and losing that item, etc.

[0224] Optionally, in response to meeting the conditions for generating an interaction log, interaction behavior information is acquired; this information is then input into a behavior summary model to generate an interaction log. Specifically, the behavior summary model categorizes the interaction behavior information and extracts key information. The interaction behavior information is categorized according to the different contents shown above, namely, into user-triggered control actions, user-controlled virtual character interactions, user-controlled virtual character interactions with virtual items, and user-controlled virtual character movement. Key information extraction refers to the extraction of timestamps, text entities, etc. This involves using the behavior summary model to analyze and identify the timestamps and text entities in each interaction behavior message. Text entities are used to indicate any one of the following: interaction character, interaction content, interaction location, interaction item, or interaction event.

[0225] Optionally, the behavior summary model may further categorize based on key information, such as grouping interactive behavior information for the same interactive character into one category; grouping interactive behavior information for the same interactive location into one category; grouping interactive behavior information for the same interactive event into one category; grouping interactive behavior information for the same interactive item into one category, and so on. In general, the behavior summary model is used to categorize the interactive behavior information corresponding to multiple interactive behaviors of the main virtual character into a set of interactive behavior information corresponding to each interactive behavior.

[0226] Optionally, after classification, the behavior summarization model summarizes the interaction log for each set of interaction behavior information. The text entities in this interaction log are key information extracted by the behavior summarization model from the interaction behavior information.

[0227] Optionally, the interaction logs generated by the behavior summary model conform to a template. For example, the template is shown below:

[0228] - The player picked up [item name] at [location name].

[0229] - The player interacted with the [NPC name] and obtained [clues / quests].

[0230] - The player engages in battle with the enemy at [location name].

[0231] For example, the behavior summarization model is trained based on interaction behavior information corresponding to multiple interaction behaviors and multiple real interaction logs. Based on the interaction behavior information corresponding to multiple interaction behaviors, the behavior summarization model predicts multiple predicted interaction logs, each of which is a summary of each interaction behavior among the multiple interaction behaviors. The behavior summarization model is trained based on the similarity between the predicted interaction logs and the real interaction logs. In other words, the behavior summarization model not only needs to be able to distinguish the interaction behavior information belonging to each interaction behavior from the interaction behavior information corresponding to multiple interaction behaviors, but also needs to summarize the interaction log corresponding to that interaction behavior based on the classified interaction behavior information.

[0232] In summary, the method provided in this application detects and acquires user interaction behavior in real time and automatically records relevant interaction behavior information, reducing the need for users to manually record and organize it. This automated recording function helps alleviate the cognitive burden on users, allowing them to focus on the game experience without worrying about missing important details. Furthermore, using a behavior summary model to generate interaction logs, rather than directly listing all interaction behavior information to the player, helps users organize different interaction behaviors, reduces information overload, and improves information organization efficiency.

[0233] 7. Automatic generation of interactive diagrams.

[0234] In some embodiments, in response to an interaction graph generation trigger operation for at least one virtual object, an interaction graph corresponding to at least one virtual object is displayed in the form of graph data. The interaction graph includes nodes corresponding to at least one virtual object and nodes corresponding to virtual objects associated with at least one virtual object.

[0235] Optionally, in response to an interaction graph generation trigger operation for at least one virtual object, an interaction log associated with at least one virtual object is obtained; based on the interaction log associated with at least one virtual object, an interaction graph for at least one virtual object is generated, wherein the interaction graph for at least one virtual object includes nodes corresponding to each text entity in the interaction log and edges connected according to the interaction log.

[0236] For example, if at least one virtual object includes Character 1, the interaction log associated with at least one virtual object is an interaction log that includes the identification information of at least one virtual object; or, in other words, an interaction log that includes the text entities corresponding to at least one virtual object. For instance, the obtained interaction log associated with at least one virtual object includes: the controlling virtual character had a conversation with [Character 1] and obtained [Task 1]; the controlling virtual character had a conversation with [Character 1] and learned that [Character 1] has an older brother [Character 2]; the controlling virtual character purchased [Item 1] from [Character 1]; the controlling virtual character had a conversation with [Character 1] and learned that [Character 2] is at [Location 1]. First, the nodes corresponding to the text entities in the interaction log are generated, such as... Figure 8 As shown in part (1), the nodes corresponding to the text entities “Character 1”, “Task 1”, “Character 2”, “Item 1”, and “Location 1” are obtained. Then, according to the type of the interaction log or by performing semantic analysis on the interaction log, the edges connecting each node and the text on the edges are generated. For example, “The main virtual character had a conversation with [Character 1] and obtained [Task 1]” is a task acceptance type, so an edge connecting the nodes corresponding to the two text entities involved in the interaction log is generated, and the text “accept” corresponding to this type of interaction log is added to the edge; “The main virtual character had a conversation with [Character 1] and learned that [Character 1] has an older brother [Character 2]” is an interpersonal relationship type, so an edge connecting the nodes corresponding to the two text entities involved in the interaction log is generated, and the keyword “older brother” is obtained by performing semantic analysis on the interaction log, and the text “brother” is added to the edge; “The main virtual character had a conversation with [Character 1] and learned that [Character 2] is in [Location 1]” is a location discovery type, so an edge connecting the last two text nodes in the interaction log is generated, and so on.

[0237] In other embodiments, in response to an interaction graph generation trigger operation for at least one virtual object, an interaction graph corresponding to at least one virtual object, presented in graph data form, is displayed on the notepad interface. The interaction graph includes nodes corresponding to at least one virtual object and nodes corresponding to virtual objects associated with at least one virtual object. The interaction graph presented in graph data form for the at least one virtual object is pre-set by the developer. Optionally, in response to the interaction graph generation trigger operation for at least one virtual object, it is determined whether the interaction graph display conditions are met; if the interaction graph display conditions are met, the interaction graph presented in graph data form for at least one virtual object is displayed on the notepad interface.

[0238] Optionally, the interaction between the main virtual character and at least one virtual object includes at least one interaction behavior. The at least one interaction behavior is categorized based on at least one of the following: interaction event, interaction character, interaction location, interaction item, and interaction content. Then, in response to the interaction graph generation trigger operation for at least one virtual object, at least one interaction graph is displayed, each interaction graph corresponding to one interaction behavior; or, in response to the interaction graph generation trigger operation for at least one virtual object, interaction graphs presented in graph data form are displayed according to the category of interaction behavior, with different types of interaction behavior corresponding to one interaction graph, and no discrete nodes within the interaction graph.

[0239] For example, the developer sets up a list of text entities related to the first task, which includes at least two text entities. In response to the user's interaction graph generation operation for the first task, an interaction graph presented as graph data is displayed. This interaction graph includes at least two nodes, each corresponding one-to-one with at least two text entities, and these at least two text entities are related to the first task. For example, the at least two text entities might include the virtual character who issued the first task, the virtual item rewarded by the first task, the virtual location where the first task takes place, the virtual character that needs to be defeated in the first task, and so on.

[0240] For example, the developer sets up a list of text entities related to the first virtual location, which includes at least two text entities. In response to an interaction graph generation operation for the first virtual location, an interaction graph presented as graph data is displayed. This interaction graph includes at least two nodes, each corresponding one-to-one with at least two text entities, which are text entities related to the first virtual location. For example, the at least two text entities may include virtual items generated in the first virtual location, virtual characters located in the first virtual location, next-level virtual locations located in the first virtual location, tasks in the first virtual location, rewards in the first virtual location, and so on.

[0241] For example, the developer sets up a list of text entities related to the first virtual character, which includes at least two text entities. In response to an interaction graph generation operation for the first virtual character, an interaction graph presented as graph data is displayed. This interaction graph includes at least two nodes, each corresponding one-to-one with at least two text entities, and the at least two text entities are related to the first virtual character. For example, the at least two text entities may include virtual characters who have met the first virtual character, virtual characters who have a relationship with the first virtual character, and so on.

[0242] That is, in response to the interaction graph generation operation for the first category information, the interaction graph corresponding to the first category information is displayed in the form of graph data. The interaction graph corresponding to the first category information includes at least two nodes, the first category information is related to at least two text entities, and the at least two nodes correspond one-to-one with the at least two text entities. The first category information is information classifying the interaction behavior between the main virtual character and at least one virtual object.

[0243] Optionally, the interactive graph allows users to perform further editing using the methods described above: "1. Adding nodes", "2. Adding edges", "3. Editing text or labels", "4. Editing nodes", and "5. Editing edges".

[0244] In summary, the method provided in this application supports the automatic generation of interaction graphs for users. Compared to the process of users adding nodes and edges one by one, it improves the efficiency of interaction graph generation; moreover, since the interaction graph is generated based on interaction logs, it can also ensure that the interaction graph can express the interactive behavior of the main virtual character in the virtual environment, reducing the difficulty and complexity for users to organize interaction behavior.

[0245] Furthermore, the method demonstrates generating an interactive graph corresponding to the first category information. It supports users selecting a specific category to generate an interactive graph corresponding to that category, such as for a task, virtual location, or virtual character. This enables rapid generation of interactive graphs for a specific category, improving generation efficiency and reducing complexity and difficulty.

[0246] It should be noted that the above-mentioned "1. Adding nodes", "2. Adding edges", "3. Editing text or labels", "4. Editing nodes", "5. Editing edges", "6. Generating interaction logs", and "7. Automatically generating interaction graphs" can be implemented as independent embodiments or as combined embodiments. The combinations will not be listed individually here, but the protection scope of the embodiments in this application is not limited thereto.

[0247] First, the functions supported by the embodiments of this application are shown.

[0248] (1) Automatic behavior summarization

[0249] All player actions in the game are automatically detected in the background by generative AI, triggering a summary every 5 minutes. The client checks the player's current state and, when necessary, extracts the player's interactions with entities (i.e., the text entities shown above), such as picking up items, obtaining clues, engaging in combat, or arriving at specific locations. These summaries are logged in real time, with the client ensuring all relevant information is fully captured. Entities refer to objects with proper nouns in open-world games, including but not limited to NPCs, characters, enemas, items, locations, and events. These entities are core elements of the game's plot, quest clues, and player interactions. In the graphical notebook, they are used as nodes to record and view the player's interactions and relationships with these objects.

[0250] For example, the client will record the player's behavior over the past 5 minutes and perform a behavior summary following these steps:

[0251] ① Check all player interactions during this period, including but not limited to: picking up items, obtaining plot clues, fighting, arriving at locations, etc.

[0252] ② Classify these events and extract key information, such as timestamps, object names, and interaction types.

[0253] ③ Generate a brief summary based on the interaction content. Each summary should not exceed two sentences and should cover the most important events.

[0254] ④ Ensure that the summary has a clear structure and complete information, making it easy to record and retrieve later.

[0255] ⑤ Save the generated summary to the player's log.

[0256] For example, the generated summary is formatted as follows:

[0257] - The player picked up [item name] at [location name].

[0258] - The player interacted with the [NPC name] and obtained [clues / quests].

[0259] - The player engages in battle with the enemy at [location name].

[0260] (2) Bring up the graphical notepad

[0261] Players can access a graphical notepad via the "Record" option in the menu. The client initializes a vectorized canvas interface, allowing players to perform visual operations on the canvas. The interface automatically displays the previously recorded state upon loading, including added nodes and text, ensuring players can begin operations immediately.

[0262] (3) Adding nodes and text

[0263] Players add nodes by double-clicking on entities in the log; added nodes are placed in the center of the canvas by default. Players select the text tool and create text on the canvas by clicking. Each node corresponds to an event, item, character, or location, and the text is used for supplementary explanation. After nodes and text are created, the client allows players to adjust their positions and optimize the layout by dragging and dropping.

[0264] 4. Freely view the use of tools

[0265] The client provides a free viewing tool, allowing players to further move, edit, or adjust nodes and text. During the operation, the client provides real-time feedback on the effects of node and text adjustments, and allows players to flexibly manage the content on the canvas.

[0266] 5. Create directed edges

[0267] After nodes are created and adjusted, players can use the free viewing tool to create directed edges between nodes to represent the logical relationships between events. The client will automatically update the display status of these edges on the canvas to ensure that the directionality of the edges and the logical relationships are accurately reflected.

[0268] 6. Edit Mode

[0269] Players can enter edit mode by double-clicking an edge. The client automatically switches to a text input interface, allowing players to modify the text content of the edge, add comments or tags. After editing, the client automatically saves the changes and updates the content displayed on the canvas.

[0270] Therefore, this application provides a graphical notepad to address this problem. The notepad can be a directed graph structure, allowing users to record game plots, quest clues, monster information, and personal experiences in the form of nodes, edges, and their directions. This structured approach allows users to organize and analyze game content more clearly, helping them better understand the complex plot. Furthermore, the client or server can have built-in generative AI or automatic recording algorithms that can detect player behavior in real time and record it automatically. This automated recording method further reduces the cognitive burden on users, allowing them to focus on the game experience without worrying about missing important information. Through this system, users can more easily manage and detect various types of information in the game, enhancing the game's immersion and strategic depth. This application not only improves users' information management capabilities in the game but also provides them with a new way to share and review their game progress. The advantages of this solution lie in its powerful structured recording capabilities, automated behavior detection function, and deep support for complex game content, enabling users to participate in and enjoy the rich content of open-world games more efficiently.

[0271] Specifically, for the client, in addition to achieving the above functions, the following methods can be used. Figure 9 A flowchart illustrating a note-taking method applied to a virtual environment, provided by an exemplary embodiment of this application, is shown.

[0272] Step 1: Players start the game.

[0273] As players enter the game and begin quests and interactions, the client records all player behavior data in real time.

[0274] Step 2: Determine whether the conditions for automatic summarization are met.

[0275] Every 5 minutes, the client triggers a generative AI (i.e., a behavior summarization model) to summarize the player's behavior. This generative AI analyzes the player's activity data, including quest progress, NPC interactions, and combat logs, to generate a summary of the player's current behavior. Simultaneously, the client also analyzes the player's behavior and status in the game in real time, including whether specific events have been triggered or key game characters have been encountered. When the client detects that the player's behavior meets the automatic summarization criteria, such as completing a specific task, interacting with an important NPC, or reaching a game milestone, the client will also immediately activate the generative AI to summarize the behavior.

[0276] Step 3: Summarize player behavior and record it in the log.

[0277] After the generative AI summarizes the player's behavior, the client extracts the interaction logs between the player and various entities in the game (such as quest objectives, items, enemies, etc.) and records these summaries in the client's log. The log records include detailed event descriptions, timestamps, and behavioral results.

[0278] Step 4: Bring up the menu bar.

[0279] Players can access various game functions through the menu bar provided in the client. When players need to view or manage their records, the record option in the menu bar will be activated, allowing players to perform subsequent actions.

[0280] Step 5: Input to the "View Log" button was detected.

[0281] When a player clicks the "View Log" button in the menu bar, the client will automatically respond and prepare to display the log content. Upon detecting this action, the client will load the relevant log data and provide the player with an interface to view and analyze past behavior summaries.

[0282] Step 6: Open the log.

[0283] The client will display a log interface, which includes automatically generated summaries of player actions. Players can view detailed log content on this interface, including records of various actions, a timeline of events, and related data analysis.

[0284] Step 7: The expanded graphical notepad input was detected.

[0285] When a player selects the graphical notepad option, the client will detect this action and prepare to open the graphical notepad interface. This action triggers the client's graphical notepad function, allowing players to organize and edit game information in a visual environment.

[0286] Step 8: Expand the graphical notepad panel.

[0287] The client initializes a vectorized canvas interface and loads the previously recorded state. This canvas allows players to visually display in-game quest clues, NPC dialogues, and event information in the form of nodes and edges. After the interface loads, players can perform various visual operations on the canvas, such as adding nodes, creating edges, and adjusting the layout, to facilitate the structured organization and analysis of game content.

[0288] Step 9: Edit the content of the graphical notepad.

[0289] Once the graphical notepad panel expands, players can double-click on entities in the log to add them, or use the text tools to edit the content. These tools allow players to add new nodes and text to the canvas, marking and explaining important information in the game. Using the free-viewing tools, players can also adjust and rearrange existing content to optimize information presentation and readability.

[0290] Step 10: Automatically save the Notepad content.

[0291] After a player completes editing in the graphical notepad, the client automatically saves all changes and updates. This auto-save feature ensures that all changes made during the editing process are recorded and saved, preventing data loss and loss of editing progress.

[0292] In summary, this application embodiment demonstrates a graphical notepad client that records and organizes various information in a game based on a directed graph structure, achieving the following effects: 1. Improved information organization efficiency: By recording tasks, clues, NPC dialogues, etc., in the form of nodes and edges, the client allows players to intuitively organize and analyze fragmented information in the game. Compared with traditional log functions, the graphical notepad can present complex game content in a more client-oriented way, significantly improving the efficiency of information organization. 2. Reduced player memory burden: Built-in generative AI or automatic recording algorithms detect player behavior in real time and automatically record relevant information, reducing the need for players to manually record and organize. This automated recording function helps reduce the cognitive burden on players, allowing them to focus on the game experience without worrying about missing important details. 3. Optimized game content analysis: The directed graph structure enables players to clearly analyze and understand complex game plots and their logical relationships. The visual representation of nodes and edges helps players better grasp the plot development and task clues in the game, optimizing the ability to analyze game content. 4. Enhanced immersion and strategy: By providing intuitive management and viewing tools, players can participate more deeply in the game, enhancing the immersion and strategy of the game. This structured management approach not only enhances the player's gaming experience but also promotes deeper exploration and engagement with game content. Fifth, it supports personalized review and sharing: Players can use a graphical notepad client to record their personal experiences and personalize and annotate their content. This feature allows players to review and share their gaming journey outside the game, enhancing the convenience of social interaction and game discussions.

[0293] In addition to the open-world game clients exemplified above, the present invention can also achieve the above effects in other types of games, including but not limited to role-playing games, strategy games, and simulation games.

[0294] Figure 10This illustration shows a structural block diagram of a note-taking device applied to a virtual environment, provided by an exemplary embodiment of this application. The device has the functionality to implement the aforementioned note-taking method example applied to a virtual environment; the functionality can be implemented in hardware or by hardware executing corresponding software. The device can be the client described above, or it can be located within a client. The device includes a display module 310 and a control module 320.

[0295] Display module 310 is used to display the main virtual character located in the virtual environment;

[0296] Control module 320 is used to control the main virtual character to interact with at least one virtual object in the virtual environment in response to an interaction trigger operation on the main virtual character;

[0297] The display module 310 is also used to display the notepad interface in response to a trigger operation on the notepad.

[0298] The display module 310 is also configured to display an interactive graph in the form of graph data in response to a trigger operation on the notepad interface. The interactive graph includes at least two nodes, each of which is related to any one of the main virtual character, the at least one virtual object, or the interactive behavior.

[0299] In some embodiments, the display module 310 includes a node adding submodule and a generation submodule.

[0300] The node adding submodule is used to add at least two nodes in response to the node adding operation on the notepad interface;

[0301] A submodule is generated for displaying the interactive graph in graph data form based on the at least two nodes.

[0302] In some embodiments, the node adding submodule is also used to display an interaction log, which is used to indicate the interaction behavior between the main virtual character and at least one virtual object. The interaction log includes at least two text entities, each of which is used to indicate any one of the following: interaction character, interaction content, interaction location, interaction item, and interaction event. In response to a trigger operation on the at least two text entities in the notepad interface, the at least two nodes are added, and the at least two text entities correspond one-to-one with the at least two nodes.

[0303] In some embodiments, the node adding submodule is further configured to add a first node in response to a triggering operation on the first virtual object when the at least one virtual object is displayed on the notepad interface, wherein the first node corresponds to the first virtual object.

[0304] In some embodiments, the first virtual object is any one of a virtual item, a virtual location, and a virtual character; the node adding submodule is further configured to, when the first virtual object is the virtual item and the notepad interface displays the virtual item, add the first node in response to a trigger operation for the virtual item, the first node corresponding to the virtual item; when the first virtual object is the virtual location and the notepad interface displays the virtual location, add the first node in response to a trigger operation for the virtual location, the first node corresponding to the virtual location; when the first virtual object is the virtual character and the notepad interface displays the virtual character, add the first node in response to a trigger operation for the virtual character, the first node corresponding to the virtual character.

[0305] In some embodiments, the generation submodule is further configured to generate at least one edge between the at least two nodes in response to a connection operation between the nodes of the at least two nodes, thereby obtaining the interaction graph presented in the form of graph data, wherein each edge of the at least one edge is used to indicate the logical relationship between the two nodes connected by each edge.

[0306] In some embodiments, the generation submodule is further configured to, in response to a selection operation on a second node, display at least one connection point on the second node, the connection point being a point on the node used to establish an edge; in response to a trigger operation on a first connection point among the at least one connection point on the second node, display at least one connection point on a third node, the third node being a node other than the second node among the at least two nodes; and in response to a trigger operation on a second connection point among the at least one connection point on the third node, generate an edge connecting the second node and the third node.

[0307] In some embodiments, the display module 310 is further configured to, in response to a triggering operation on a first edge of the at least one edge, acquire first input information for the first edge; and display the first input information on the first edge.

[0308] In some embodiments, the display module 310 is further configured to display at least one candidate label in response to a triggering operation on a second side of the at least one edge; and to display the first label on the second edge in response to a selection operation on a first label of the at least one candidate label.

[0309] In some embodiments, the display module 310 is further configured to, in response to a triggering operation on a fourth node of the at least two nodes, acquire second input information for the fourth node; and display the second input information on the fourth node.

[0310] In some embodiments, the display module 310 is further configured to display at least one candidate label in response to a triggering operation on a fifth node of the at least two nodes; and to display the second label on the fifth node in response to a selection operation on a second label of the at least one candidate label.

[0311] In some embodiments, the display module 310 is further configured to, in response to a triggering operation on a third label, filter nodes and / or edges associated with the third label; and display nodes and / or edges associated with the third label.

[0312] In some embodiments, the display module 310 is further configured to change the position of the sixth node and / or at least one edge connected to the sixth node in the interaction graph in response to a movement operation on the sixth node in the interaction graph.

[0313] In some embodiments, the interaction log includes the text entity; the generation module 320 is further configured to, when the interaction log is displayed, in response to a selection operation for the seventh node among the at least two nodes, highlight the text entity corresponding to the seventh node in the interaction log.

[0314] In some embodiments, the display module 310 is further configured to, in response to an interaction graph generation trigger operation for the at least one virtual object, display an interaction graph corresponding to the at least one virtual object in the form of graph data, wherein the interaction graph includes nodes corresponding to the at least one virtual object and nodes corresponding to virtual objects associated with the at least one virtual object.

[0315] In some embodiments, the display module 310 is further configured to change the display state of the eighth node in response to an editing operation on the eighth node in the interaction graph, the display state including at least one of the following: color; shape; size; transparency.

[0316] In some embodiments, the display module 310 is further configured to change the display state of the third side in response to an editing operation on the third side in the interactive diagram, the display state including at least one of the following: thickness; style; orientation.

[0317] In some embodiments, the display module 310 is further configured to generate the interaction log in response to meeting the interaction log generation conditions; wherein the interaction log generation conditions include at least one of the following: the main control virtual character performs an interaction behavior against the at least one virtual object; the interaction duration reaches a preset threshold, the interaction duration being the time length between the current moment and the first time point.

[0318] In some embodiments, the display module 310 is further configured to, in response to meeting the interaction log generation conditions, invoke a behavior summary model, the behavior summary model being configured to generate an interaction log based on the interaction behavior of the main virtual character; input the interaction behavior information of the main virtual character within the interaction duration into the behavior summary model to generate the interaction log.

[0319] This application also provides a computer device, which includes a processor and a memory. The memory stores at least one computer program, which is loaded and executed by the processor to implement the note-taking method for a virtual environment provided in the above-described method embodiments.

[0320] Figure 11 This illustration shows a structural block diagram of a computer device 800 provided in an exemplary embodiment of this application. The computer device 800 may be a portable mobile terminal, such as a smartphone, tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III), or MP4 player (Moving Picture Experts Group Audio Layer IV). The computer device 800 may also be referred to as a user device, portable terminal, or other names. Typically, the computer device 800 includes a processor 801 and a memory 802.

[0321] Processor 801 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 801 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). Processor 801 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 801 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 801 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0322] The memory 802 may include one or more computer-readable storage media, which may be tangible and non-transitory. The memory 802 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 802 is used to store at least one instruction, which is executed by the processor 801 to implement the note-taking method applied to a virtual environment provided in the embodiments of this application.

[0323] In some embodiments, the computer device 800 may also optionally include a peripheral device interface 803 and at least one peripheral device. The processor 801, memory 802, and peripheral device interface 803 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 803 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 804, a touch display screen 805, a camera assembly 806, an audio circuit 807, and a power supply 808.

[0324] Peripheral device interface 803 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 801 and memory 802. In some embodiments, processor 801, memory 802 and peripheral device interface 803 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 801, memory 802 and peripheral device interface 803 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0325] The radio frequency (RF) circuit 804 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 804 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 804 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 804 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 804 can communicate with other terminals through at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or Wi-Fi (Wireless Fidelity) networks. In some embodiments, the RF circuit 804 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0326] The touch display screen 805 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. The touch display screen 805 also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to the processor 801 for processing. The touch display screen 805 is used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one touch display screen 805, located on the front panel of the computer device 800; in other embodiments, there may be at least two touch display screens, respectively located on different surfaces of the computer device 800 or in a folded design; in some embodiments, the touch display screen 805 may be a flexible display screen, located on a curved or folded surface of the computer device 800. Furthermore, the touch display screen 805 may be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The touch display screen 805 may be made of materials such as LCD (Liquid Crystal Display) or OLED (Organic Light-Emitting Diode).

[0327] The camera assembly 806 is used to acquire images or videos. Optionally, the camera assembly 806 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is used for video calls or selfies, and the rear-facing camera is used for taking photos or videos. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, and a wide-angle camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, and panoramic shooting and VR shooting by fusion of the main camera and the wide-angle camera. In some embodiments, the camera assembly 806 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash is a combination of a warm-light flash and a cool-light flash, which can be used for light compensation at different color temperatures.

[0328] Audio circuitry 807 provides an audio interface between the user and computer device 800. Audio circuitry 807 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to processor 801 for processing, or input to radio frequency circuitry 804 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each located at a different location within computer device 800. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from processor 801 or radio frequency circuitry 804 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, audio circuitry 807 may also include a headphone jack.

[0329] Power supply 808 is used to supply power to various components in computer device 800. Power supply 808 can be alternating current, direct current, a disposable battery, or a rechargeable battery. When power supply 808 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, while a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0330] In some embodiments, the computer device 800 further includes one or more sensors 809. The one or more sensors 809 include, but are not limited to, an accelerometer 810, a gyroscope 811, a pressure sensor 812, an optical sensor 813, and a proximity sensor 814.

[0331] Accelerometer 810 can detect the magnitude of acceleration on the three coordinate axes of a coordinate system established by computer device 800. For example, accelerometer 810 can be used to detect the components of gravitational acceleration on the three coordinate axes. Processor 801 can control touch screen 805 to display the user interface in landscape or portrait view based on the gravitational acceleration signal collected by accelerometer 810. Accelerometer 810 can also be used for games or to collect user motion data. Gyroscope 811 can detect the orientation and rotation angle of computer device 800. Gyroscope 811 can work in conjunction with accelerometer 810 to collect 3D movements of the user on computer device 800. Based on the data collected by gyroscope 811, processor 801 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0332] The pressure sensor 812 can be disposed on the side bezel of the computer device 800 and / or on the lower layer of the touch display screen 805. When the pressure sensor 812 is disposed on the side bezel of the computer device 800, it can detect the user's grip signal on the computer device 800 and perform left / right hand recognition or quick operation based on the grip signal. When the pressure sensor 812 is disposed on the lower layer of the touch display screen 805, it can control operable controls on the UI interface based on the user's pressure operation on the touch display screen 805. Operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0333] An optical sensor 813 is used to collect ambient light intensity. In one embodiment, the processor 801 can control the display brightness of the touch screen 805 based on the ambient light intensity collected by the optical sensor 813. Specifically, when the ambient light intensity is high, the display brightness of the touch screen 805 is increased; when the ambient light intensity is low, the display brightness of the touch screen 805 is decreased. In another embodiment, the processor 801 can also dynamically adjust the shooting parameters of the camera assembly 806 based on the ambient light intensity collected by the optical sensor 813.

[0334] A proximity sensor 814, also known as a distance sensor, is typically located on the front of the computer device 800. The proximity sensor 814 is used to detect the distance between the user and the front of the computer device 800. In one embodiment, when the proximity sensor 814 detects that the distance between the user and the front of the computer device 800 is gradually decreasing, the processor 801 controls the touchscreen display 805 to switch from a screen-on state to a screen-off state; when the proximity sensor 814 detects that the distance between the user and the front of the computer device 800 is gradually increasing, the processor 801 controls the touchscreen display 805 to switch from a screen-off state to a screen-on state.

[0335] Those skilled in the art will understand that the above structure does not constitute a limitation on the computer device 800, and may include more or fewer components than shown in the figure, or combine certain components, or use different component arrangements.

[0336] This application also provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor to implement the note-taking method for a virtual environment provided in the above-described method embodiments.

[0337] This application also provides a computer program product, which includes at least one computer program stored in a computer-readable storage medium; the at least one computer program is read from and executed by a processor of a computer device from the computer-readable storage medium, causing the computer device to perform the note-taking method applied to a virtual environment provided in the above-described method embodiments.

[0338] It should be understood that "multiple" as used herein refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. Furthermore, the step numbers described herein are merely illustrative of one possible execution order. In some other embodiments, the steps may not be executed in numerical order, such as two steps with different numbers being executed simultaneously, or two steps with different numbers being executed in the reverse order of the illustration. This application does not limit this.

[0339] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A note-taking method applied in a virtual environment, characterized in that, The method includes: Displays the main virtual character located in the virtual environment; In response to an interaction trigger operation on the main virtual character, control the main virtual character to interact with at least one virtual object in the virtual environment; In response to a trigger operation on the notepad, the notepad interface is displayed; In response to a trigger operation on the notepad interface, an interaction graph is displayed in the form of graph data. The interaction graph includes at least two nodes, each of which is related to any one of the main virtual character, the at least one virtual object, and the interaction behavior.

2. The method according to claim 1, characterized in that, The step of displaying an interactive graph in the form of graph data in response to an editing operation on the notepad interface includes: In response to the add node operation on the notepad interface, at least two nodes are added; Based on the at least two nodes, the interactive graph is displayed in the form of graph data.

3. The method according to claim 2, characterized in that, The response to the add node operation on the notepad interface, adding at least two nodes, includes: Display an interaction log, which is used to indicate the interaction behavior between the main virtual character and the at least one virtual object. The interaction log includes at least two text entities, and each of the at least two text entities is used to indicate any one of the following: interaction character, interaction content, interaction location, interaction item, and interaction event. In response to a triggered operation on the at least two text entities in the notepad interface, the at least two nodes are added, with each of the at least two text entities corresponding to one of the at least two nodes.

4. The method according to any one of claims 2 to 3, characterized in that, The process of displaying the interactive graph in graph data form based on the at least two nodes includes: In response to a connection operation between each of the at least two nodes, at least one edge between each of the at least two nodes is generated to obtain the interaction graph presented in the form of graph data, wherein each edge in the at least one edge is used to indicate the logical relationship between the two nodes connected by each edge.

5. The method according to claim 4, characterized in that, The step of generating at least one edge between the at least two nodes in response to a connection operation between each of the at least two nodes includes: In response to a selection operation on a second node, at least one connection point is displayed on the second node, the connection point being a point on the node used to establish an edge; In response to a trigger operation targeting a first connection point among at least one connection point on the second node, at least one connection point is displayed on a third node, the third node being a node other than the second node among the at least two nodes; In response to a triggering operation targeting a second connection point among at least one connection point on the third node, an edge connecting the second node and the third node is generated.

6. The method according to claim 4 or 5, characterized in that, The method further includes: In response to a triggering operation on a first edge of the at least one edge, first input information for the first edge is obtained; and the first input information is displayed on the first edge.

7. The method according to any one of claims 4 to 6, characterized in that, The method further includes: In response to a triggering operation targeting the second edge of the at least one edge, at least one candidate label is displayed; In response to the selection operation for a first label among the at least one candidate labels, the first label is displayed on the second side.

8. The method according to any one of claims 1 to 7, characterized in that, The method further includes: In response to a trigger operation targeting the fourth of the at least two nodes, second input information is acquired for the fourth node; and the second input information is displayed on the fourth node.

9. The method according to any one of claims 1 to 8, characterized in that, The method further includes: In response to a trigger operation targeting the fifth node of the at least two nodes, at least one candidate label is displayed; In response to the selection operation for the second label among the at least one candidate labels, the second label is displayed on the fifth node.

10. The method according to claim 7 or 9, characterized in that, The method further includes: In response to a trigger operation on a third label, the nodes and / or edges associated with the third label are filtered; and the nodes and / or edges associated with the third label are displayed.

11. The method according to any one of claims 1 to 10, characterized in that, The method further includes: In response to a move operation on the sixth node in the interaction graph, the position of the sixth node and / or at least one edge connected to the sixth node in the interaction graph is changed.

12. The method according to any one of claims 1 to 11, characterized in that, The interaction log includes the text entity; The method further includes: When the interaction log is displayed, in response to a selection operation for the seventh node among the at least two nodes, the text entity corresponding to the seventh node in the interaction log is highlighted.

13. The method according to any one of claims 1 to 12, characterized in that, The step of displaying an interactive graph in the form of graph data in response to an editing operation on the notepad interface includes: In response to an interaction graph generation trigger operation for the at least one virtual object, the interaction graph corresponding to the at least one virtual object is displayed in the form of graph data, the interaction graph including nodes corresponding to the at least one virtual object and nodes corresponding to virtual objects associated with the at least one virtual object.

14. The method according to any one of claims 1 to 13, characterized in that, The method further includes: In response to the conditions for generating interaction logs being met, an interaction log is generated. The conditions for generating the interaction log include at least one of the following: the main virtual character performs an interaction behavior on the at least one virtual object; the interaction duration reaches a preset threshold, where the interaction duration is the length of time between the current moment and the first time point.

15. The method according to claim 14, characterized in that, The step of generating the interaction log in response to meeting the interaction log generation conditions includes: In response to the fulfillment of the interaction log generation conditions, the behavior summary model is invoked, which is used to generate interaction logs based on the interaction behavior of the main virtual character; The interaction behavior information of the main virtual character within the interaction duration is input into the behavior summary model to generate the interaction log.

16. A note-taking device for use in a virtual environment, characterized in that, The device includes: The display module is used to display the main virtual character located in the virtual environment; The control module is used to respond to the interactive trigger operation of the main virtual character and control the main virtual character to interact with at least one virtual object in the virtual environment. The display module is also used to display the notepad interface in response to a trigger operation on the notepad; The display module is also configured to respond to a trigger operation on the notepad interface by displaying an interactive graph in the form of graph data, the interactive graph including at least two nodes, each of the at least two nodes being related to any one of the main virtual character, the at least one virtual object, and the interactive behavior.

17. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing a computer program that is loaded and executed by the processor to implement the note-taking method for a virtual environment as described in any one of claims 1 to 15.

18. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the note-taking method for a virtual environment as described in any one of claims 1 to 15.

19. A computer program product, characterized in that, The computer program product includes a computer program stored in a computer-readable storage medium; the computer program is read from and executed by a processor of a computer device, causing the computer device to perform a note-taking method applied to a virtual environment as described in any one of claims 1 to 15.

Images