Virtual scene interaction method and device, equipment, storage medium and program product

Abstract

The invention provides a virtual scene interaction method and device, equipment, a storage medium and a program product. The method comprises the steps that a virtual scene is displayed, the virtual scene is obtained by fusing a real world and a virtual world which can interact with each other, the virtual scene is obtained by adding virtual elements which can interact with each other in the real world, and the virtual scene comprises a first virtual object; the first virtual object is a virtual object corresponding to a first real object in the real world, and a first virtual position of the first virtual object in the virtual scene corresponds to a first real position of the first real object in the real scene in the real world; and in response to a trigger operation for the service control, displaying the virtual service in the virtual scene, wherein the distance between the virtual service and the first virtual position is smaller than the distance threshold.

Description

Technical Field

[0001] The present application relates to artificial intelligence technology, and in particular to an interaction method, device, equipment, storage medium and program product for a virtual scene. Background Art

[0002] With the development of computer technology, electronic devices can implement more abundant and vivid virtual scenes. A virtual scene refers to a digital scene outlined by a computer through digital communication technology. Users can obtain a completely virtual experience (such as virtual reality) or a partially virtual experience (such as augmented reality) in terms of vision, hearing, etc. in the virtual scene, and at the same time, can realize diverse interactions between virtual objects controlled by users or artificial intelligence according to actual application requirements.

[0003] In related technologies, all online virtual services are usually displayed in a virtual scene. Due to the display space limitation of the current virtual scene corresponding to the screen, the displayed virtual services are limited, resulting in low efficiency in searching for virtual services. Summary of the Invention

[0004] Embodiments of the present application provide an interaction method, device, equipment, storage medium and program product for a virtual scene, which can improve the efficiency of searching for virtual services.

[0005] The technical solution of the embodiments of the present application is implemented as follows:

[0006] Embodiments of the present application provide an interaction method for a virtual scene, including:

[0007] Display a virtual scene, where the virtual scene is obtained by fusing the real world and the virtual world that can interact with each other. The virtual scene includes a first virtual object, and the first virtual object is a virtual object corresponding to a first real object in the real world. The first virtual position of the first virtual object in the virtual scene corresponds to the first real position of the first real object in the real world;

[0008] In response to a trigger operation on a service control, display virtual services in the virtual scene whose distance from the first virtual position is less than a distance threshold.

[0009] Embodiments of the present application provide an interaction device for a virtual scene, including:

[0010] Embodiments of the present application provide an electronic device, and the electronic device includes:

[0011] A memory for storing computer programs or computer-executable instructions;

[0012] A processor, when executing a computer program or computer-executable instructions stored in the memory, implements the interactive method for a virtual scenario provided in an embodiment of the present application.

[0013] An embodiment of the present application provides a computer-readable storage medium storing a computer program or computer-executable instructions, and when the computer program or computer-executable instructions are executed by a processor, the interactive method for a virtual scenario provided in an embodiment of the present application is implemented.

[0014] An embodiment of the present application provides a computer program product including a computer program or computer-executable instructions, and when the computer program or computer-executable instructions are executed by a processor, the interactive method for a virtual scenario provided in an embodiment of the present application is implemented.

[0015] The embodiments of the present application have the following beneficial effects:

[0016] In response to a trigger operation for a service control, a virtual service with a distance less than a distance threshold from a first virtual position is displayed in a virtual scenario, and the virtual service near the location can be quickly displayed through the trigger operation, that is, the virtual service with a distance less than the distance threshold from the first virtual position. Therefore, the virtual service near the location in the virtual scenario can be quickly found, effectively improving the efficiency of finding the virtual service and saving relevant communication resources and computing resources, which can thus be used as a decision reference for whether to initiate an interaction subsequently; and the first virtual position of the first virtual object in the virtual scenario corresponds to the first real position of the first real object in the real world, so that interaction can be performed in the virtual scenario based on the real position of the first real object, enriching the interaction method and thus improving the user experience. Description of the Drawings

[0017] Figure 1A is a schematic diagram of a first application mode of the interactive method for a virtual scenario provided in an embodiment of the present application;

[0018] Figure 1B is a schematic diagram of a second application mode of the interactive method for a virtual scenario provided in an embodiment of the present application;

[0019] Figure 2 is a schematic diagram of the structure of an electronic device for interaction in a virtual scenario provided in an embodiment of the present application

[0020] Figure 3A is a first flowchart of the interactive method for a virtual scenario provided in an embodiment of the present application;

[0021] Figure 3B is a second flowchart of the interactive method for a virtual scenario provided in an embodiment of the present application;

[0022] Figure 3CIt is the schematic diagram of the third process of the virtual scene interaction method provided by the embodiments of the present application;

[0023] Figure 3D It is the schematic diagram of the fourth process of the virtual scene interaction method provided by the embodiments of the present application;

[0024] Figure 4A It is the schematic diagram of the virtual service identification list provided by the embodiments of the present application;

[0025] Figure 4B It is the schematic diagram of the close-range interaction provided by the embodiments of the present application;

[0026] Figure 4C It is the schematic diagram of the process of the virtual venue provided by the embodiments of the present application;

[0027] Figure 5 It is the schematic diagram of the fifth process of the virtual scene interaction method provided by the embodiments of the present application;

[0028] Figure 6 It is the schematic diagram of the sixth process of the virtual scene interaction method provided by the embodiments of the present application;

[0029] Figure 7 It is the schematic diagram of the process of capturing expressions provided by the embodiments of the present application. Detailed implementation manners

[0030] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be construed as limitations on the present application. All other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of the present application.

[0031] In the following description, the terms "first / second" involved are only used to distinguish similar objects and do not represent a specific order for the objects. It can be understood that "first / second" can be interchanged with a specific order or sequence when permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0032] In the following description, "some embodiments" are involved, which describe a subset of all possible embodiments. However, it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0033] In the embodiments of the present application, the term "module" or "unit" refers to a computer program with a predetermined function or a part of a computer program, which works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as a processing circuit or a memory), or a combination thereof. Similarly, one processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of an overall module or unit that includes the function of that module or unit.

[0034] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0035] Before further elaborating on the embodiments of the present application, the nouns and terms involved in the embodiments of the present application are described. The nouns and terms involved in the embodiments of the present application are subject to the following explanations.

[0036] 1) In response to: used to represent the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more executed operations can be real-time or have a set delay; without special instructions, there is no limit on the execution order of the multiple executed operations.

[0037] 2) Client: An application program running on a terminal for providing various services, such as a video playback client, a game client, etc.

[0038] 3) Virtual scene: The virtual game scene displayed (or provided) when a game program runs on a terminal. The virtual scene can be a simulation environment of the real world, a semi-simulated and semi-fictional virtual environment, or a purely fictional virtual environment. The virtual scene can be any one of a two-dimensional virtual scene, a 2.5D virtual scene, or a three-dimensional virtual scene. The embodiments of the present application do not limit the dimension of the virtual scene. For example, the virtual scene can include the sky, land, ocean, etc. The land can include environmental elements such as deserts and cities. Users can control virtual objects to move in the virtual scene.

[0039] 4) Virtual object: The images of various people and objects that can interact in a virtual space, or movable objects in a virtual space. The movable objects can be virtual characters, virtual animals, anime characters, etc., such as the characters and animals displayed in a virtual space. The virtual object can be a virtual avatar in a virtual space used to represent a user. There can be multiple virtual objects in a virtual space, and each virtual object has its own shape and volume in the virtual space and occupies a part of the space in the virtual space.

[0040] 5) Scenario data: Represents various characteristics exhibited by virtual objects in a virtual scenario during the interaction process. For example, it can include the position of the virtual object in the virtual scenario. Of course, different types of characteristics can be included according to the type of the virtual scenario. For example, in the virtual scenario of a game, the scenario data can include the time to wait when configuring various functions in the virtual scenario (depending on the number of times the same function can be used within a specific time), and can also represent the attribute values of various states of the game character, such as including health points (also known as red bar) and magic points (also known as blue bar), etc.

[0041] 6) User Interface (UI): Refers to the overall design of the human-computer interaction, operation logic, and interface aesthetics of the software. The user interface is the medium for interaction and information exchange between the system and the user, and it realizes the conversion between the internal form of information and the form that humans can accept. The user interface is software designed for interaction and communication between the user and the hardware, aiming to enable the user to conveniently and efficiently operate the hardware to achieve two-way interaction and complete the work expected to be completed by the hardware. The user interface is widely defined and includes human-computer interaction and graphical user interfaces. The user interface exists in all fields involved in the information exchange between humans and machines.

[0042] 7) Virtual Reality (VR): Is a simulation of a computer-generated environment (such as a 3D environment), and users can interact with it in a seemingly real or physical way. It can be a virtual reality system of a single device or a group of devices. For example, the simulation can be generated on a virtual reality headset or some other display device for display to the user. The simulation can include images, sounds, tactile feedback, and other sensations that mimic real or fictional environments.

[0043] 8) Mixed Reality (MR): By introducing real-world scene information into the virtual environment, an information loop for interactive feedback is built between the virtual world, the real world (i.e., the actual world), and the user to enhance the sense of reality of the user experience. From the perspective of device definition, VR headsets with a perspective function and augmented reality (AR) glasses (non-cinema devices) can both be regarded as devices with MR perspective function. MR has the following characteristics: 1) Interactivity, users can interact with virtual objects, and these objects respond as if they actually exist; 2) Real-time, the integration of the virtual world and the real world is carried out in real time without pre-programming; 3) Three-dimensional integration, MR not only integrates with the real world visually but also interacts with it spatially; 4) Context awareness, MR devices can recognize and understand the physical environment they are in and adjust the virtual content accordingly.

[0044] An embodiment of the present application provides an interaction method, device, electronic device, computer-readable storage medium, and computer program product for a virtual scene, which can improve the efficiency of finding virtual services.

[0045] The following describes an exemplary application of the electronic device provided in the embodiments of the present application. The electronic device provided in the embodiments of the present application can be implemented as various types of user terminals such as a laptop computer, a tablet computer, a desktop computer, a set-top box, a mobile device (e.g., a mobile phone, a portable music player, a personal digital assistant, a dedicated messaging device, a portable game device, a vehicle-mounted device), a smart phone, a smart speaker, a smart watch, a smart TV, a vehicle-mounted terminal, etc. Hereinafter, an exemplary application will be described when the electronic device is implemented as a terminal.

[0046] To facilitate a better understanding of the interaction method for a virtual scene provided in the embodiments of the present application, first, an exemplary implementation scenario of the interaction method for a virtual scene provided in the embodiments of the present application will be described. The virtual scene can be completely output based on the terminal, or output based on the cooperation between the terminal and the server.

[0047] In one implementation scenario, referring to Figure 1A , Figure 1A is a schematic diagram of an application mode of the interaction method for a virtual scene provided in the embodiments of the present application, which is applicable to some application modes where the relevant data calculation of the virtual scene 100 can be completed solely relying on the computing power of the terminal 400. The virtual scene is output through terminals 400 such as smart phones, tablet computers, and augmented reality devices.

[0048] When forming the visual perception of the mixed reality virtual scene 100, the terminal 400 calculates the data required for display through the graphics computing hardware, and completes the loading, parsing, and rendering of the display data. A video frame capable of forming a visual perception is output on the graphics output hardware. For example, a video frame implementing a three-dimensional display effect is projected on the lens of the augmented reality glasses; in addition, to enrich the perception effect, the device can also form one or more of auditory perception, tactile perception, motion perception, and taste perception with the help of different hardware.

[0049] As an example, the terminal 400 runs a client 410 with mixed reality functions (e.g., a stand-alone instant messaging application, a game application, etc.). During the operation of the client 410, the virtual scene 100 is output. The virtual scene includes a first virtual object 110, and the first virtual object 110 is a virtual object corresponding to a first real object in the real world. The first virtual position of the first virtual object in the virtual scene corresponds to the first real position of the first real object in the real world. In response to a trigger operation on the service control, a virtual service 120 whose distance from the first virtual position in the virtual scene is less than a distance threshold is displayed in the virtual scene.

[0050] In another implementation scenario, refer to Figure 1B , Figure 1B which is a schematic diagram of the application mode of the interaction method for the virtual scenario provided in the embodiments of the present application, applied to the terminal 400 and the server 200, and suitable for the application mode that relies on the computing power of the server 200 to complete the virtual scenario calculation of mixed reality and output the virtual scenario of mixed reality on the terminal 400.

[0051] Taking the visual perception of forming the virtual scenario 100 of mixed reality as an example, the server 200 calculates the display data related to the virtual scenario of mixed reality and sends it to the terminal 400. The terminal 400 depends on the graphics computing hardware to complete the loading, parsing, and rendering of the calculation display data, and depends on the graphics output hardware to output the virtual scenario to form visual perception, such as projecting a video frame with a three-dimensional display effect on the lens of the augmented reality glasses; for the perception of the form of the virtual scenario of augmented reality, it can be understood that it can be output by the corresponding hardware of the terminal, such as using a microphone to output to form auditory perception, using a vibrator to output to form tactile perception, and so on.

[0052] As an example, the terminal 400 runs the client 410 with the function of mixed reality (such as an online instant messaging application, a game application, etc.), interacts with other users through the server (i.e., the server 200), the terminal 400 outputs the virtual scenario 100 of the client 410, the first virtual object 110 is a virtual object corresponding to the first real object in the real world, the first virtual position where the first virtual object is located in the virtual scenario corresponds to the first real position where the first real object is located in the real world, and in response to the trigger operation for the service control, a virtual service 120 whose distance from the first virtual position in the virtual scenario is less than the distance threshold is displayed in the virtual scenario.

[0053] In some embodiments, the terminal or the server can implement the interaction method for the virtual scenario provided in the embodiments of the present application by running various computer-executable instructions or computer programs. For example, the computer-executable instructions can be commands at the microprogram level, machine instructions, or software instructions. The computer program can be a native program or a software module in the operating system; it can be a local (Native) application (APP, Application), that is, a program that needs to be installed in the operating system to run, such as a game application or an instant messaging application; it can also be a small program embedded in any APP, that is, a program that only needs to be downloaded to the browser environment to run. In short, the above computer-executable instructions can be instructions in any form, and the above computer programs can be applications, modules, or plugins in any form.

[0054] In some embodiments, the server 200 may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, Content Delivery Network (CDN), and big data and artificial intelligence platforms. Among them, the cloud service can be a ** service for the terminal to call.

[0055] In some embodiments, multiple servers can form a blockchain, and the server 200 is a node on the blockchain. There can be an information connection between each node in the blockchain, and information can be transmitted between nodes through the above information connection. Among them, the data related to the interactive method of the virtual scenario provided in the embodiments of the present application (such as the logic of the interaction of the virtual scenario, virtual services) can be saved on the blockchain.

[0056] The following describes the structure of the electronic device provided in the embodiments of the present application for the interaction of the virtual scenario. Refer to Figure 2 , Figure 2 FIG. is a schematic structural diagram of the electronic device 500 provided in the embodiments of the present application for the interaction of the virtual scenario. Taking the electronic device 500 as a terminal as an example for illustration, Figure 2 The illustrated electronic device 500 includes: at least one processor 510, a memory 550, at least one network interface 520, and a user interface 530. Each component in the electronic device 500 is coupled together through a bus system 540. It can be understood that the bus system 540 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, in Figure 2 all kinds of buses are labeled as the bus system 540.

[0057] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a Digital Signal Processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0058] The memory 550 includes volatile memory, non-volatile memory, or both volatile and non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), and the volatile memory can be a random access memory (RAM). The memory 550 described in the embodiments of the present application is intended to include any suitable type of memory. Optionally, the memory 550 includes one or more storage devices that are physically located away from the processor 510.

[0059] In some embodiments, the memory 550 is capable of storing data to support various operations. Examples of such data include programs, modules, and data structures, or subsets or supersets thereof, which are illustrated below.

[0060] The operating system 551 includes system programs for processing various basic system services and performing hardware-related tasks, such as the framework layer, the core library layer, the driver layer, etc., for implementing various basic services and processing hardware-based tasks;

[0061] The network communication module 552 is used to reach other electronic devices via one or more (wired or wireless) network interfaces 520. Exemplary network interfaces 520 include: Bluetooth, Wi-Fi (Wireless Fidelity), and USB (Universal Serial Bus), etc.;

[0062] In some embodiments, the virtual scene interaction device provided by the embodiments of the present application can be implemented in software. The virtual scene interaction device provided by the embodiments of the present application can be provided in various software embodiments, including various forms such as application programs, software, software modules, scripts, or code.

[0063] Figure 2 The virtual scene interaction device 555 stored in the memory 550 is shown. It can be software in the form of programs and plugins, etc., and includes a series of modules, including a display module 5551 and a service module 5552. These modules are logical, so they can be combined or further split arbitrarily according to the functions to be implemented. The functions of each module will be described below.

[0064] As mentioned above, the virtual scene interaction method provided by the embodiments of the present application can be implemented by various types of electronic devices, such as terminals, servers, or a combination of both. Therefore, the execution entities of each step will not be repeated hereinafter. Refer to Figure 3A , Figure 3A is a flowchart of the virtual scene interaction method provided by the embodiments of the present application, which will be described in combination with the steps shown in Figure 3A shown below.

[0065] In step 101, a virtual scene is displayed. The virtual scene is obtained by fusing the real world and the virtual world that can interact with each other. The virtual scene includes a first virtual object. The first virtual object is a virtual object corresponding to a first real object in the real world. The first virtual position of the first virtual object in the virtual scene corresponds to the first real position of the first real object in the real world.

[0066] It should be noted that the interaction method of the virtual scene provided by the embodiments of the present application can be implemented through mixed reality technology. Physical entities in the real world and virtual elements in the virtual world in the virtual scene can interact with each other. For example, if the object entity is a cup and the virtual element is a table, then the cup in the real world can be placed on the table in the virtual world, that is, the cup in the real world and the table in the virtual world can interact with each other. Among them, the virtual scene can be a virtual scene that is completely different from the real world by real-time rendering of the real world on the basis of the real world. For example, the virtual mall in the virtual scene is completely different from the corresponding school in the real world. The virtual scene can be a virtual scene with virtual elements added to the real world. For example, the virtual mall in the virtual scene is completely different from the corresponding school in the real world

[0067] Here, the correspondence between the first virtual position of the first virtual object in the virtual scene and the first real position of the first real object in the real world can be that the first virtual position is exactly the same as the first real position, or the first virtual position is offset relative to the first real position. The correspondence between the first virtual position of the first virtual object in the virtual scene and the first real position of the first real object in the real world indicates that the virtual position of the first virtual object in the virtual scene is based on the real geographical location of the first real object.

[0068] Here, the virtual scene corresponding to mixed reality can be implemented through a VR device. Taking a VR helmet as an example of the VR device, after a player (i.e., the first real object) wears the VR helmet and turns on a social application with a geographical location function, the virtual scene can be displayed. The first virtual object in the virtual scene is based on the real geographical location, that is, the first virtual position of the first virtual object in the virtual scene corresponds to the first real position of the first real object in the real world.

[0069] In step 102, in response to a trigger operation on a service control, virtual services with a distance less than a distance threshold from the first virtual position are displayed in the virtual scene.

[0070] Here, the virtual service is a virtual element with service functions in the virtual scenario, such as nearby virtual characters (i.e., virtual objects whose distance from the first virtual position is less than the distance threshold), nearby virtual activities (i.e., virtual activities whose distance from the first virtual position is less than the distance threshold), and nearby virtual venues (i.e., virtual venues whose distance from the first virtual position is less than the distance threshold). Among them, the service control is a function control in the virtual scenario, which is used to find virtual services whose distance from the first virtual position is less than the distance threshold.

[0071] In some embodiments, the virtual service includes at least one of the following: a second virtual object, a virtual venue, and a virtual activity; the second virtual object is any virtual object other than the first virtual object in the virtual scenario; after displaying the virtual service whose distance from the first virtual position is less than the distance threshold in the virtual scenario, in response to an interaction operation on the virtual service, control the first virtual object to interact with the virtual service.

[0072] In some embodiments, when the virtual service is a second virtual object, in response to an interaction operation on the virtual service, controlling the first virtual object to interact with the virtual service can be achieved by the following methods: in response to a meet invitation operation, send a meet invitation request to the target virtual object, where the target virtual object is the second virtual object invited by the first virtual object through the meet invitation operation, and the meet invitation request is used to instruct the target virtual object to request to interact with the first virtual object in person; in response to the target virtual object accepting the meet invitation request, display the navigation information between the target virtual object and the first virtual object.

[0073] Here, the navigation information can be information such as distance, direction, and route. For example, the first virtual object can initiate a meet invitation in the real world or the virtual scenario, that is, a meet invitation request. After the first virtual object initiates the meet invitation request, send a meet invitation request to the target virtual object. After receiving the meet invitation request, the target virtual object can choose to reject the meet interaction or choose to accept the meet interaction. When the target virtual object (at least one second virtual object) is willing to interact in person, through the meet invitation request, display the navigation information between the target virtual object and the first virtual object in the virtual scenario to instruct the first virtual object to move according to the navigation information to interact with the target virtual object in person. Of course, after the target virtual object accepts the meet invitation request, the navigation information between the target virtual object and the first virtual object can also be sent to the target virtual object to display the navigation information between the target virtual object and the first virtual object on the electronic device controlling the target virtual object, to instruct the target virtual object to move according to the navigation information to interact with the first virtual object in person.

[0074] In some embodiments, step 102 may be implemented in the following manner: in response to a trigger operation on the service control, a virtual service identifier list is displayed in the virtual scene, where the virtual service identifier list includes identifiers of virtual services whose distance from the first virtual location is less than a distance threshold.

[0075] As Figure 4A shown, a virtual service identifier list is displayed in the virtual screen 401 in the virtual scene 400. The identifier of the virtual service may be information such as the name or avatar of the virtual service for identifying the virtual service. When the service control is used to find nearby virtual characters (i.e., virtual objects whose distance from the first virtual location is less than the distance threshold), the virtual service identifier list includes the avatars and virtual nicknames of virtual services whose distance from the first virtual location is less than the distance threshold; when the service control is used to find nearby virtual activities (i.e., virtual activities whose distance from the first virtual location is less than the distance threshold), the virtual service identifier list includes the names of virtual activities whose distance from the first virtual location is less than the distance threshold; when the service control is used to find nearby virtual venues (i.e., virtual venues whose distance from the first virtual location is less than the distance threshold), the virtual service identifier list includes the names of virtual venues whose distance from the first virtual location is less than the distance threshold.

[0076] In some embodiments, referring to Figure 3B , Figure 3B is a schematic flowchart of an interaction method for a virtual scene provided by an embodiment of the present application. When the service control is used to represent viewing virtual objects whose distance from the first virtual location is less than the distance threshold, Figure 3B it shows that step 102 may be implemented through step 1021A: in step 1021A, in response to a trigger operation on the service control, at least one second virtual object whose distance from the first virtual location is less than the distance threshold is displayed in the virtual scene, where the second virtual object is any virtual object other than the first virtual object in the virtual scene.

[0077] Here, at least one second virtual object whose distance from the first virtual location is less than the distance threshold is displayed at a second virtual location in the virtual scene. Among them, the second virtual location is the virtual location where the second virtual object is located in the virtual scene. The location of the second virtual object may be a real geographical location, that is, the second virtual object is a virtual object corresponding to a second real object in the real world, and the second virtual location where the second virtual object is located in the virtual scene corresponds to the second real location where the second real object is located in the real world; the location of the second virtual object may be a real location; the location of the second virtual object may be a false geographical location, that is, the second virtual location where the second virtual object is located in the virtual scene does not correspond to the second real location where the second real object is located in the real world.

[0078] In some embodiments, step 1021A may be implemented in the following manner: highlighting the virtual image of the first target virtual object in the virtual scene, where the first target virtual object is a second virtual object having an association relationship with the first virtual object, and the association relationship includes at least one of the following: social relationship, having the same interest preference, and the interaction frequency with the first virtual object exceeding the interaction frequency threshold.

[0079] Here, in order to facilitate the player to quickly find the virtual character (i.e., virtual object) that they want to interact with among all the displayed nearby virtual characters, since the player may want to interact with the virtual object that has a social relationship with the first virtual object, has the same interests and hobbies, or the interaction frequency with the first virtual object exceeds the interaction frequency threshold, the virtual image of the first target virtual object is highlighted in the virtual scene. Among them, the social relationship can be a friendship relationship, a colleague relationship, etc.

[0080] In some embodiments, the type of the second virtual object includes a controlled object and an autonomous control object. The controlled object is a virtual object controlled by a real object in the real world, and the autonomous control object is a virtual object not controlled by a real object in the real world; step 1021A may be implemented in the following manner: displaying the controlled object in the virtual scene through a first display parameter different from that of the autonomous control object, where the first display parameter includes at least one of the following: color, size, shape, and special effect.

[0081] Here, the virtual position of the controlled object in the virtual scene corresponds to the real position of the real object that controls the controlled object in the real world. In order to facilitate the player to quickly find the controlled object and the autonomous control object that they want to interact with among all the displayed nearby virtual characters, the controlled object is displayed in the virtual scene through a first display parameter different from that of the autonomous control object.

[0082] In some embodiments, after step 1021A, in response to a friend addition operation for the second virtual object, sending a friend verification request to the second target virtual object, where the second target virtual object is the second virtual object selected by the first virtual object through the friend addition operation, and the friend verification request is used to indicate that the first virtual object requests to add the second target virtual object as a friend; in response to the second target virtual object passing the friend verification request, controlling the first virtual object to have a conversation interaction with the second target virtual object.

[0083] Among them, the forms of the conversation interaction include at least one of the following: voice, expression, and action. It should be noted that the conversation interaction can be a face-to-face close-range interaction or a remote interaction, such as a virtual voice call or a virtual video call.

[0084] Taking the conversation interaction as a face-to-face close-range interaction as an example, such as Figure 4BAs shown, the second target virtual object 402 is the second virtual object selected by the first virtual object 403 through a friend addition operation. When the second target virtual object passes the friend verification request, control the second target virtual object 402 to come to the side of the first virtual object 403 and have a face-to-face conversation interaction with the first virtual object 403.

[0085] In some embodiments, before controlling the first virtual object to have a conversation interaction with the second target virtual object, the second target virtual object can be controlled to jump to the first virtual position where the first virtual object is located; or, the first virtual object can be controlled to move to the second virtual position where the second target virtual object is located in the virtual scene.

[0086] Here, when the conversation interaction is a face-to-face close interaction, the second target virtual object can be controlled to jump to the side of the first virtual object, or the first virtual object can be controlled to move to the side of the second target virtual object.

[0087] In some embodiments, before controlling the first virtual object to have a conversation interaction with the second target virtual object, when the second target virtual object is an autonomously controlled object, the second target virtual object is jumped to the first virtual position where the first virtual object is located; when the second target virtual object is a controlled object and the current virtual position where the second target virtual object is located in the virtual scene does not correspond to the current real position where the second target real object is located in the real world, the second target virtual object is jumped to the first virtual position where the first virtual object is located; when the second target virtual object is a controlled object and the current virtual position where the second target virtual object is located in the virtual scene corresponds to the current real position where the second target real object is located in the real world, the first virtual object is controlled to move to the second virtual position where the second target virtual object is located in the virtual scene.

[0088] Here, when the session interaction is a face-to-face close-range interaction, it can be determined whether to control the second target virtual object to jump to the first virtual position where the first virtual object is located or to control the first virtual object to move to the second virtual position where the second target virtual object is located in the virtual scene. Therefore, when the second target virtual object is an autonomous control object, it means that the virtual position of the second target virtual object is not based on the real position. To ensure that the virtual position of the first virtual object is based on the real position and can quickly have a face-to-face session interaction with the second target virtual object, the second target virtual object can be jumped to the first virtual position where the first virtual object is located; when the second target virtual object is a controlled object and the current virtual position where the second target virtual object is located in the virtual scene does not correspond to the current real position where the second target real object is located in the real world, it means that the virtual position of the second target virtual object is not based on the real position. To ensure that the virtual position of the first virtual object is based on the real position and can quickly have a face-to-face session interaction with the second target virtual object, the second target virtual object can be jumped to the first virtual position where the first virtual object is located; when the second target virtual object is a controlled object and the current virtual position where the second target virtual object is located in the virtual scene corresponds to the current real position where the second target real object is located in the real world, control the first virtual object to move to the second virtual position where the second target virtual object is located in the virtual scene, which means that the virtual position of the second target virtual object is based on the real position. To ensure that the virtual position of the first virtual object is based on the real position and can quickly have a face-to-face session interaction with the second target virtual object, the first virtual object can be controlled to move to the second virtual position where the second target virtual object is located in the virtual scene.

[0089] In some embodiments, after step 1021A, in response to an interaction invitation operation for the second virtual object, an interaction invitation request is sent to the third target virtual object, where the third target virtual object is the second virtual object invited by the first virtual object through the interaction invitation operation, and the interaction invitation request is used to indicate that the first virtual object requests to interact with the third target virtual object; in response to the third target virtual object passing the game interaction invitation request, control the first virtual object and the third target virtual object to start interacting.

[0090] Here, the interaction can be a game interaction, such as a team game (i.e., the first virtual object and the third target virtual object form a team for game interaction) or a confrontation game (i.e., the first virtual object and the third target virtual object confront each other for game interaction).

[0091] In some embodiments, refer to Figure 3C , Figure 3CIt is a schematic flowchart of an interaction method for a virtual scene provided by an embodiment of the present application. When the service control is used to represent a virtual venue whose distance from the first virtual location is less than the distance threshold, Figure 3C It shows that step 102 can be implemented through step 1021B: In step 1021B, in response to a trigger operation on the service control, the identifiers of at least one virtual venue are displayed in the virtual scene, and navigation information between the first virtual object and the virtual venue is displayed, where the virtual venue corresponds to a real venue in the real world, and the virtual location of the virtual venue in the virtual scene corresponds to the real location of the real venue in the real world.

[0092] Here, the navigation information can be information such as the distance from the virtual venue to the first virtual object, the direction of the virtual venue relative to the first virtual object, etc.

[0093] Such as Figure 4C As shown, in the virtual scene 400, the identifier "XXX School" of the virtual school and the distance (10 meters) from the virtual school to the first virtual object 403 are displayed, and in the virtual scene 400, the identifier "XX Mall" of the virtual mall and the distance (8 meters) from the virtual mall to the first virtual object 403 are displayed.

[0094] In some embodiments, displaying the identifiers of at least one virtual venue in the virtual scene can be achieved in the following way: highlighting the identifier of the first virtual venue in the virtual scene, where the first virtual venue includes at least one of the following: a virtual venue that houses a virtual object related to the first virtual object, a virtual venue with a popularity greater than the popularity threshold, and a virtual venue with an interest similarity to the first virtual object greater than the similarity threshold.

[0095] Here, in order to facilitate players to quickly find the virtual venue they want to enter among all the displayed nearby virtual venues, since players may want to enter a virtual venue that houses a virtual object related to the first virtual object, a virtual venue with a popularity greater than the popularity threshold, and a virtual venue with an interest similarity to the first virtual object greater than the similarity threshold, the identifier of the first virtual venue is highlighted in the virtual scene.

[0096] Among them, the popularity is positively correlated with the following parameters: the type of positive emotion expressed by the positive feedback for the virtual venue, the number of positive feedbacks for the virtual venue, and the number of virtual objects currently accommodated in the virtual venue. For example, positive feedback is feedback that can reflect positive emotions such as likes and praise comments for the virtual venue. The stronger the positive emotion expressed by the positive feedback for the virtual venue, the higher the popularity; the more the number of positive feedbacks for the virtual venue, the higher the popularity; the more the number of virtual objects currently accommodated in the virtual venue, the higher the popularity.

[0097] In some embodiments, the virtual venues with an interest similarity greater than the similarity threshold to the first virtual object are obtained by the neural network model performing the following processing: Based on the object features of the first virtual object and the venue data of the virtual venues, the neural network model is called for prediction processing to obtain virtual venues with an interest similarity greater than the similarity threshold to the first virtual object; wherein, the neural network model is trained with object feature samples, the venue data of virtual venue samples, and annotation information.

[0098] Among them, the embodiments of the present application are not limited to the model structure of the neural network model. For example, the neural network model can be a convolutional neural network, a deep neural network, etc.

[0099] It should be noted that before applying the neural network model, the initial neural network model needs to be trained, and then the trained neural network model is put into application. By combining artificial intelligence technology with the player's habits and the current virtual scene, virtual venues with an interest similarity greater than the similarity threshold to the first virtual object are predicted. Among them, the neural network model is trained with object feature samples, the venue data of virtual venue samples, and annotation information. Among them, the object feature samples are the object features of virtual object samples, such as the virtual items and virtual costumes held by the virtual object samples. For example, based on the object feature samples and the venue data of the virtual venue samples, the initial neural network model is called for prediction processing to obtain a prediction instruction (including virtual venue samples with an interest similarity greater than the similarity threshold to the virtual object samples). After determining the value of the loss function of the neural network model through the prediction instruction and the annotation information, it can be judged whether the value of the loss function exceeds the preset threshold. When the value of the loss function exceeds the preset threshold, the error signal of the neural network model is determined based on the loss function, and the error information is backpropagated in the neural network model, and the model parameters of each layer are updated during the propagation process. Among them, the embodiments of the present application are not limited to the form of the loss function. For example, it can be a cross-entropy loss function, an L2 loss function, etc.

[0100] Here, the backpropagation is described. The training sample data is input into the input layer of the neural network model, passes through the hidden layer, and finally reaches the output layer to output the result. This is the forward propagation process of the neural network model. Since there is an error between the output result of the neural network model and the actual result, the error between the output result and the actual value is calculated, and this error is propagated backward from the output layer to the hidden layer until it reaches the input layer. During the backpropagation process, the values of the model parameters are adjusted according to the error, that is, a loss function is constructed based on the error between the output result and the actual value, and the partial derivatives of the loss function with respect to the model parameters are calculated layer by layer to generate the gradients of the loss function with respect to the model parameters of each layer. Since the direction of the gradient indicates the direction in which the error expands, the gradient of the model parameters is taken as the opposite, and summed with the original parameters of each layer of the model. The obtained summation result is used as the updated model parameters of each layer, thereby reducing the error caused by the model parameters; the above process is continuously iterated until convergence.

[0101] In some embodiments, after step 1021B, in response to a movement operation, the first virtual object is controlled to move to a second virtual venue, where the second virtual venue is the selected virtual venue.

[0102] Here, the player can perform a movement operation through a mobile terminal device (such as a gamepad), or can also perform a movement operation by the player's movement.

[0103] In some embodiments, before controlling the first virtual object to move to the second virtual venue, when the second virtual scene is within the target area of the first virtual object, a first prompt message is displayed, where the first prompt message is used to indicate the mobile terminal device to control the first virtual object to move to the second virtual venue, and the terminal device is used to control the virtual scene, and the target area is the area including the first virtual object; when the second virtual scene is outside the target area of the first virtual object, a second prompt message is displayed, where the second prompt message is used to indicate the first real object to move to control the first virtual object to move to the second virtual venue. Among them, the target area can be a geometric area centered on the first virtual object. The player can select a suitable movement method according to the first prompt message or the second prompt message. For example, in response to the movement operation of the terminal device, the first virtual object is controlled to synchronize to the second virtual venue according to the movement method of the terminal device; in response to the movement operation of the first real object, the first virtual object is controlled to move to the second virtual venue following the first real object.

[0104] In some embodiments, if virtual goods are displayed in the second virtual venue, then in response to a purchase operation for the virtual item, the virtual goods are taken as the possessions of the first virtual object. For example, displaying the virtual goods in the virtual backpack of the first virtual object indicates that the virtual goods have become the possessions of the first virtual object.

[0105] In some embodiments, when the first virtual object is located within the second virtual venue, in response to an interaction invitation operation for a target virtual object, an interaction invitation request is sent to the target virtual object, where the target virtual object is the virtual object invited by the first virtual object through the interaction invitation operation, and the interaction invitation request is used to indicate that the first virtual object requests to interact with the target virtual object within the second virtual venue; in response to the target virtual object passing the interaction invitation request, the target virtual object is controlled to jump to the target position and interact with the first virtual object, where the target position is the virtual position where the first virtual object is located within the second virtual venue.

[0106] For example, when the first virtual object wants to invite the target virtual object to go shopping and interact, the first virtual object can invite the virtual object, thereby sending an interaction invitation request to the target virtual object, where the interaction invitation request may include the target position. When the target virtual object passes the interaction invitation request, the target virtual object can come to the side of the first virtual object with one key, that is, the target virtual object jumps to the target position to conduct a shopping interaction.

[0107] In some embodiments, refer to Figure 3D , Figure 3D is a schematic flowchart of the interaction method for the virtual scene provided by the embodiments of the present application. When the service control is used to represent a virtual activity where the distance between the viewing activity location and the first virtual position is less than the distance threshold, Figure 3D it shows that step 102 can be implemented through step 1021C: In step 1021C, in response to a trigger operation for the service control, at least one virtual activity identifier and profile information are displayed in the virtual scene, where the profile information includes the virtual venue where the virtual activity is held.

[0108] Here, at least one virtual activity identifier and profile information are displayed in the virtual venue where the virtual activity is held in the virtual scene. The virtual venue where the virtual activity is held corresponds to a real venue in the real world, and the virtual position of the virtual venue in the virtual scene corresponds to the real position of the real venue in the real world.

[0109] It should be noted that the interaction method for virtual activities is similar to the interaction method for virtual venues.

[0110] In some embodiments, the display of at least one virtual activity identifier in the virtual scene can be achieved in the following way: highlighting the identifier of the first virtual activity in the virtual scene, where the first virtual activity includes at least one of the following: a virtual activity participated by a virtual object having an associated relationship with the first virtual object, a virtual activity with a popularity greater than the popularity threshold, and a virtual activity with an interest similarity greater than the similarity threshold with the first virtual object.

[0111] In some embodiments, the heat is positively correlated with the following parameters: the type of positive emotion expressed in the positive feedback for the virtual event, the number of times of positive feedback for the virtual event, and the number of virtual objects currently participating in the virtual event.

[0112] In some embodiments, the virtual event with an interest similarity to the first virtual object greater than the similarity threshold is obtained by the neural network model performing the following processing:

[0113] Based on the object features of the first virtual object and the activity data of the virtual event, the neural network model is called for prediction processing to obtain a virtual event with an interest similarity to the first virtual object greater than the similarity threshold; wherein, the neural network model is trained with object feature samples, activity data of virtual event samples, and annotation information.

[0114] In some embodiments, in response to a movement operation, control the first virtual object to move to the virtual venue where the second virtual event is held, where the second virtual event is the selected virtual event.

[0115] In some embodiments, before controlling the first virtual object to move to the virtual venue where the second virtual event is held, when the virtual venue where the second virtual event is held is within the target area of the first virtual object, display a first prompt message, where the first prompt message is used to instruct the mobile terminal device to control the first virtual object to move to the virtual venue where the second virtual event is held, and the terminal device is used to control the virtual scene, and the target area is the area including the first virtual object; when the virtual venue where the second virtual event is held is outside the target area of the first virtual object, display a second prompt message, where the second prompt message is used to instruct the first real object to move to control the first virtual object to move to the second virtual event. Then, in response to the movement operation, controlling the first virtual object to move to the second virtual event includes: in response to the movement operation of the terminal device, controlling the first virtual object to synchronize to the virtual venue where the second virtual event is held according to the movement mode of the terminal device; in response to the movement operation of the first real object, controlling the first virtual object to move to the virtual venue where the second virtual event is held following the first real object.

[0116] In some embodiments, when the first virtual object is within the virtual venue where the second virtual event is held, in response to an activity invitation operation for the target virtual object, send an activity invitation request to the target virtual object, where the target virtual object is the virtual object invited by the first virtual object through the activity invitation operation, and the activity invitation request is used to instruct the first virtual object to request to interact with the target virtual object within the virtual venue where the second virtual event is held; in response to the target virtual object accepting the activity invitation request, control the target virtual object to jump to the virtual venue where the second virtual event is held and interact with the first virtual object.

[0117] Next, an exemplary application of the embodiments of the present application in an actual application scenario will be described.

[0118] In the related art, there are mainly two categories of social applications. One category is to conduct completely real social interactions (such as instant messaging applications) on electronic devices such as mobile phones, socialize with real users in the real world, and can also conduct interactions based on real geographical locations (abbreviated as real locations); the other category is to conduct completely virtual social interactions in VR devices, socialize with virtual users in the virtual world.

[0119] In this regard, the applicant found that the related technical solutions are either to socialize in a completely real world or in a completely virtual world, without truly integrating the virtual and real worlds, and achieving virtual interactions with a virtual identity based on real geographical locations in the real world. To solve the above problems, the embodiments of the present application provide an interaction method for virtual scenarios, which combines a location management application programming interface (API), integrates a real-world map and a virtual-world map, shapes a second virtual identity for players, and through functions such as finding "people nearby", finding "places nearby", and finding "activities nearby", finds virtual people, virtual places, and virtual activities that the player wants to interact with, enabling the player to socialize and interact with surrounding virtual people, participate in parties, team games, etc. as a virtual person in the real world, thereby realizing that the player can interact with other surrounding virtual characters in the virtual world based on real geographical locations, and providing a new social way in a parallel world.

[0120] Next, the interaction method for virtual scenarios provided by the embodiments of the present application will be described in combination with specific product applications.

[0121] First, the player can wear a VR helmet, turn on the geographical location function, and enter the social application interface.

[0122] Among them, virtual characters (Avatars) can be set in the social application: there are different genders, hair accessories, faces, clothes, etc. for the player to choose from.

[0123] It should be noted that turning on the geographical location function means turning on the MR mode. When the MR mode is in the off state, the surrounding real scene can be seen through the VR helmet (equipped with a camera). After the MR mode is turned on, the surrounding real scene can be rendered into a completely different virtual scene in real time. For example, an office building in the real scene is rendered into a virtual shopping mall in the virtual scene.

[0124] Then, the player can perform a series of virtual social interactions in the virtual scene based on the real geographical location. The virtual social interactions include the following three types of interactions: finding "people nearby" interaction, finding "places nearby" interaction, and finding "activities nearby" interaction.

[0125] 1) "Find people nearby" interaction

[0126] Regarding the "Find people nearby" function: When clicking the function button of "Find people nearby" in the social application, the API in the VR headset will search for virtual characters nearby at the same time based on the player's geographical location, and display the virtual nicknames and virtual avatar information of the virtual characters, presenting them arranged on the virtual screen in the air.

[0127] Chat and interact with "people nearby": After the player selects a virtual character, clicks the add friend button and gets the other party's consent, they can start chatting and interacting with the other party. Without showing the dialogue screen or interface, they can directly communicate face-to-face with the virtual character, such as through expression interaction and voice interaction.

[0128] Team up or play against (PK) with "people nearby": After the player enters a VR game application that supports geographical location, clicks the "Find people nearby to team up / PK" button, searches for virtual characters nearby at the same time, and displays the virtual nicknames and virtual avatar information of the virtual characters, presenting them arranged on the virtual screen in the air. The player can click the "Invite" button to invite the other party, and start the game after the other party agrees.

[0129] 2) "Find places nearby" interaction

[0130] Regarding the "Find places nearby" function: When clicking the function button of "Find places nearby" in the social application, the VR headset will search for nearby virtual places, place names, and the distance information of the virtual places from the player, presenting them on the virtual screen in the air.

[0131] Enter the virtual place: The player can move to the virtual place they want to go (such as a virtual shopping mall, virtual building) by shaking the handle while sitting in place, or directly move to the corresponding virtual place. The geographical location and building floor structure of the virtual place are the same as those of the real place, but the virtual appearance and functionality are different.

[0132] Go shopping: The player can move through the handle or directly enter the virtual place (such as a certain virtual store). Various virtual items such as virtual clothes, virtual figurines, virtual games, music, videos, etc. are displayed in the virtual store, and the player can purchase the displayed virtual items.

[0133] Virtual friend interaction: The player can invite their friends or search for people nearby to add as friends, send their location information to their friends, and after the friends agree, they can come to the player's side with one click to go shopping together.

[0134] 3) "Find activities nearby" interaction

[0135] Regarding the "Find Nearby Events" function: When the function button of "Find Nearby Events" is clicked within the social application, the VR headset will search for event information of nearby virtual events such as parties and concerts, including the event time and address, and present them in an arranged manner on a virtual screen in the air.

[0136] Participating in events: Players can use the controller to move or directly move to the virtual venue of the virtual event they want to attend to participate in the event.

[0137] Virtual friend interaction: Players can invite their friends or search for nearby people to add as friends, send event information and the player's location information to friends, and after the friends agree, they can come to the player's side with one click to participate in the event together.

[0138] See Figure 5 , Figure 5 is a flowchart of the interaction method for the virtual scene provided by the embodiment of this application, and will be described in combination with Figure 5 the steps shown.

[0139] Step 1: The VR device built-in location management API obtains the player's location data.

[0140] For example, in the Android system, the Android location management API can be directly accessed in the VR device, such as Quest.

[0141] As Figure 6 shown, the VR headset worn by the player, as a type of VR device, after the player turns on the geographical location function, the VR device built-in location management API can obtain the player's location data.

[0142] Step 2: The VR terminal captures the player's expression and audio data.

[0143] Here, the VR terminal can be built-in with 2 cameras to capture the mouth movements of the player, judge the expression state according to the mouth movements, and can match expressions such as laughing, smiling, sad, angry, sighing, etc. The VR terminal is built-in with 1 microphone to collect the player's audio data. As Figure 7 shown, after the player wears the VR device 701, the VR device can capture the player's expression and set the captured expression to the corresponding virtual character 702. For example, if the player's smiling expression is captured, the corresponding virtual character of the player is set with a smiling expression.

[0144] As Figure 6 shown, the VR device built-in with cameras and microphones can obtain the player's expression and audio data.

[0145] Step 3: Convert the data format and transmit it to the server.

[0146] Here, after capturing the player's facial expression and audio data, the bias data is removed to record all facial expression and audio data. Then, the recorded facial expression and audio data are converted in format, and the data after format conversion is transmitted to the server.

[0147] As Figure 6 shown, after the VR device obtains the player's facial expression and audio data, it can transmit the player's facial expression and audio data to the server.

[0148] Step 4: The server receives the data for calculation and matching.

[0149] Here, the server is built in the cloud and can perform the following real-time calculations on the data transmitted by the VR device:

[0150] 1) Virtual account identification (ID) storage and call: The server stores the virtual account system for calling and managing virtual social account data, as well as relevant application calculations for "finding nearby people".

[0151] 2) Virtual scene gallery storage and call: The server stores the virtual scene gallery corresponding to the real geographical location for calling and managing virtual scene maps, as well as relevant application calculations for "finding nearby places" and "finding nearby activities".

[0152] Step 5: The server transmits the matching data to the VR device.

[0153] Here, the server can encode the calculated matching data and transmit the encoded matching data to the VR device. As Figure 6 shown, the server transmits the encoded matching data (facial expression, audio, instruction) to the VR device.

[0154] Step 6: The VR device receives and parses the data and presents the corresponding operations.

[0155] Here, the VR device parses the received matching data sent by the server as follows:

[0156] 1) If the matching data is facial expression data, check whether the VR device contains the facial expression information corresponding to the facial expression data (such as facial expressions like laughing, smiling, sad, angry, sighing, etc.). If the facial expression information exists in the VR device, set the facial expression information; otherwise, ignore it.

[0157] 2) If the matching data is audio data, decode the audio data and check whether the VR device contains the audio information corresponding to the audio data (such as the sound of singing). If the audio information exists in the VR device, set the audio information; otherwise, ignore it.

[0158] 3) If the matching data is instruction data in scenarios such as games, then parse the instruction and give corresponding operation feedback.

[0159] In summary, the interaction method for virtual scenarios provided by the embodiments of the present application can implement a brand-new MR social solution based on geographical location, unlock various interactions based on geographical location in VR devices, provide virtual world social interactions based on real geographical locations, enrich the activity scenarios and social content in virtual world social interactions, and expand the interaction methods in virtual world social interactions.

[0160] So far, the interaction method for virtual scenarios provided by the embodiments of the present application has been described in combination with the exemplary applications and implementations of the electronic device provided by the embodiments of the present application. Next, the cooperation of each module in the interaction device 555 for virtual scenarios provided by the embodiments of the present application to implement the interaction solution for virtual scenarios will be described.

[0161] A display module 5551 is configured to display a virtual scenario, where the virtual scenario is obtained by fusing the real world and the virtual world that can interact with each other. The virtual scenario includes a first virtual object, and the first virtual object is a virtual object corresponding to a first real object in the real world. The first virtual position of the first virtual object in the virtual scenario corresponds to the first real position of the first real object in the real world; a service module 5552 is configured to, in response to a trigger operation on a service control, display a virtual service in the virtual scenario whose distance from the first virtual position is less than a distance threshold.

[0162] In some embodiments, the service module 5552 is further configured to display a virtual service identification list in the virtual scenario, where the virtual service identification list includes identifications of virtual services whose distance from the first virtual position is less than a distance threshold.

[0163] In some embodiments, when the service control is used to represent viewing virtual objects whose distance from the first virtual position is less than a distance threshold, the service module 5552 is further configured to display at least one second virtual object in the virtual scenario whose distance from the first virtual position is less than a distance threshold, where the second virtual object is any virtual object other than the first virtual object in the virtual scenario.

[0164] In some embodiments, the service module 5552 is further configured to prominently display the virtual image of a first target virtual object in the virtual scenario, where the first target virtual object is a second virtual object having an association relationship with the first virtual object, and the association relationship includes at least one of the following: a social relationship, having the same interest preference, and an interaction frequency with the first virtual object exceeding an interaction frequency threshold.

[0165] In some embodiments, the types of the second virtual objects include controlled objects and autonomous control objects. The controlled objects are virtual objects controlled by real objects in the real world, and the autonomous control objects are virtual objects not controlled by real objects in the real world. The service module 5552 is further configured to display the controlled objects in the virtual scene by first display parameters different from those of the autonomous control objects, where the first display parameters include at least one of the following: color, size, shape, and special effects.

[0166] In some embodiments, the service module 5552 is further configured to, in response to a friend addition operation for the second virtual object, send a friend verification request to a second target virtual object, where the second target virtual object is the second virtual object selected by the first virtual object through the friend addition operation, and the friend verification request is used to indicate that the first virtual object requests to add the second target virtual object as a friend; in response to the second target virtual object passing the friend verification request, control the first virtual object and the second target virtual object to perform session interaction.

[0167] In some embodiments, before controlling the first virtual object and the second target virtual object to perform session interaction, the service module 5552 is further configured to control the second target virtual object to jump to a first virtual position where the first virtual object is located; or control the first virtual object to move to a second virtual position where the second target virtual object is located in the virtual scene.

[0168] In some embodiments, before controlling the first virtual object and the second target virtual object to perform session interaction, the service module 5552 is further configured to, when the second target virtual object is an autonomous control object, jump the second target virtual object to a first virtual position where the first virtual object is located; when the second target virtual object is a controlled object and the current virtual position where the second target virtual object is located in the virtual scene does not correspond to the current real position where the second target real object is located in the real world, jump the second target virtual object to a first virtual position where the first virtual object is located; when the second target virtual object is a controlled object and the current virtual position where the second target virtual object is located in the virtual scene corresponds to the current real position where the second target real object is located in the real world, control the first virtual object to move to a second virtual position where the second target virtual object is located in the virtual scene.

[0169] In some embodiments, the service module 5552 is further configured to, in response to an interaction invitation operation for the second virtual object, send a game interaction invitation request to a third target virtual object, where the third target virtual object is a second virtual object invited by the first virtual object through the interaction invitation operation, and the interaction invitation request is used to indicate that the first virtual object requests to interact with the third target virtual object; and in response to the third target virtual object accepting the game interaction invitation request, control the first virtual object and the third target virtual object to start the interaction.

[0170] In some embodiments, when the service control is used to represent a virtual venue whose distance from the first virtual location is less than a distance threshold, the service module 5552 is further configured to display, in the virtual scene, an identifier of at least one of the virtual venues, and display navigation information between the first virtual object and the virtual venue, where the virtual venue corresponds to a real venue in the real world, and the virtual location of the virtual venue in the virtual scene corresponds to the real location of the real venue in the real world.

[0171] In some embodiments, the service module 5552 is further configured to prominently display an identifier of a first virtual venue in the virtual scene, where the first virtual venue includes at least one of the following: the virtual venue that houses a virtual object associated with the first virtual object, the virtual venue whose popularity is greater than a popularity threshold, and the virtual venue whose interest similarity with the first virtual object is greater than a similarity threshold.

[0172] In some embodiments, the popularity is positively correlated with the following parameters: the type of positive emotion expressed by positive feedback for the virtual venue, the number of times of positive feedback for the virtual venue, and the number of virtual objects currently housed in the virtual venue.

[0173] In some embodiments, the virtual venue whose interest similarity with the first virtual object is greater than a similarity threshold is obtained by a neural network model performing the following processing: based on the object features of the first virtual object and the venue data of the virtual venue, calling the neural network model for prediction processing to obtain the virtual venue whose interest similarity with the first virtual object is greater than a similarity threshold; where the neural network model is trained by object feature samples, venue data of virtual venue samples, and annotation information.

[0174] In some embodiments, the service module 5552 is further configured to, in response to a movement operation, control the first virtual object to move to a second virtual venue, where the second virtual venue is the selected virtual venue.

[0175] In some embodiments, before controlling the first virtual object to move to the second virtual venue, the service module 5552 is further configured to, when the second virtual scene is within the target area of the first virtual object, display a first prompt message, where the first prompt message is used to instruct the mobile terminal device to control the first virtual object to move to the second virtual venue, the terminal device is used to control the virtual scene, and the target area is the area including the first virtual object; when the second virtual scene is outside the target area of the first virtual object, display a second prompt message, where the second prompt message is used to instruct the first real object to move so as to control the first virtual object to move to the second virtual venue; before controlling the first virtual object to move to the second virtual venue in response to a movement operation, the service module 5552 is further configured to, in response to the movement operation of the terminal device, control the first virtual object to synchronize to the second virtual venue according to the movement mode of the terminal device; in response to the movement operation of the first real object, control the first virtual object to move to the second virtual venue following the first real object.

[0176] In some embodiments, virtual goods are displayed in the second virtual venue, and the service module 5552 is further configured to, in response to a purchase operation on the virtual item, make the virtual goods the possession of the first virtual object.

[0177] In some embodiments, when the first virtual object is within the second virtual venue, the service module 5552 is further configured to, in response to an interaction invitation operation on a target virtual object, send an interaction invitation request to the target virtual object, where the target virtual object is the virtual object invited by the first virtual object through the interaction invitation operation, and the interaction invitation request is used to instruct the first virtual object to request to interact with the target virtual object within the second virtual venue; in response to the target virtual object accepting the interaction invitation request, control the target virtual object to jump to a target position and interact with the first virtual object, where the target position is the virtual position where the first virtual object is located within the second virtual venue.

[0178] In some embodiments, when the service control is used to represent viewing a virtual activity where the distance between the activity location and the first virtual position is less than a distance threshold, the service module 5552 is further configured to display, in the virtual scene, the identifier and profile information of at least one of the virtual activities, where the profile information includes the virtual venue where the virtual activity is held.

[0179] In some embodiments, the virtual service includes at least one of the following: a second virtual object, a virtual venue, a virtual activity; the second virtual object is any virtual object in the virtual scene other than the first virtual object; after displaying the virtual service whose distance from the first virtual location in the virtual scene is less than a distance threshold, the service module 5552 is further configured to, in response to an interaction operation on the virtual service, control the first virtual object to interact with the virtual service.

[0180] In some embodiments, when the virtual service is the second virtual object, the service module 5552 is further configured to, in response to a meet invitation operation, send a meet invitation request to a target virtual object, where the target virtual object is the second virtual object invited by the first virtual object through the meet invitation operation, and the meet invitation request is used to instruct the target virtual object to request to interact with the first virtual object in a face-to-face manner; in response to the target virtual object accepting the meet invitation request, display navigation information between the target virtual object and the first virtual object.

[0181] An embodiment of the present application provides a computer program product, which includes a computer program or computer-executable instructions, and the computer program or computer-executable instructions are stored in a computer-readable storage medium. A processor of an electronic device reads the computer program or computer-executable instructions from the computer-readable storage medium, and the processor executes the computer program or computer-executable instructions, so that the electronic device executes the interaction method of the virtual scene in the embodiment of the present application.

[0182] An embodiment of the present application provides a computer-readable storage medium storing computer-executable instructions, where computer-executable instructions or a computer program are stored, and when the computer-executable instructions or the computer program are executed by a processor, the processor will be caused to execute the interaction method of the virtual scene provided by the embodiment of the present application, for example, Figure 3A the interaction method of the virtual scene shown.

[0183] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disc, or CD-ROM; it may also be various devices including one or any combination of the above memories.

[0184] In some embodiments, the computer-executable instructions may be in the form of a program, software, a software module, a script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including being deployed as a stand-alone program or being deployed as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0185] As an example, the computer-executable instructions may or may not correspond to a file in a file system, may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a HyperText Markup Language (HTML) document, stored in a single file dedicated to the program in question, or, stored in multiple cooperating files (e.g., files that store one or more modules, subroutines, or portions of code).

[0186] As an example, the computer-executable instructions may be deployed to execute on one electronic device, or on multiple electronic devices located at one location, or, on multiple electronic devices distributed across multiple locations and interconnected via a communication network.

[0187] It can be understood that in the embodiments of the present application, when it comes to data such as user information, when the embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use, and processing of the relevant data need to comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0188] As described above, the above are only embodiments of the present application and are not intended to limit the protection scope of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and scope of the present application are all included in the protection scope of the present application.

Claims

1. An interaction method for a virtual scene, characterized in that, The method includes: Displaying a virtual scene, where the virtual scene is obtained by fusing the real world and the virtual world that can interact with each other. The virtual scene includes a first virtual object, and the first virtual object is a virtual object corresponding to a first real object in the real world. The first virtual position where the first virtual object is located in the virtual scene corresponds to the first real position where the first real object is located in the real world; In response to a trigger operation on a service control, displaying a virtual service in the virtual scene whose distance from the first virtual position is less than a distance threshold.

2. The method according to claim 1, characterized in that, The displaying a virtual service in the virtual scene whose distance from the first virtual position is less than a distance threshold includes: Displaying a list of virtual service identifiers in the virtual scene, where the list of virtual service identifiers includes identifiers of virtual services whose distance from the first virtual position is less than a distance threshold.

3. The method according to claim 1, wherein When the service control is used to represent viewing a virtual object whose distance from the first virtual position is less than a distance threshold, the displaying a virtual service in the virtual scene whose distance from the first virtual position is less than a distance threshold includes: Displaying at least one second virtual object in the virtual scene whose distance from the first virtual position is less than a distance threshold, where the second virtual object is any virtual object other than the first virtual object in the virtual scene.

4. The method according to claim 3, wherein The displaying at least one second virtual object in the virtual scene whose distance from the first virtual position is less than a distance threshold includes: Highlighting the virtual image of a first target virtual object in the virtual scene, where the first target virtual object is a second virtual object having an associated relationship with the first virtual object, and the associated relationship includes at least one of the following: a social relationship, having the same interest preference, and the interaction frequency with the first virtual object exceeding an interaction frequency threshold.

5. The method according to claim 3, wherein The types of the second virtual objects include controlled objects and self-controlled objects. The controlled object is a virtual object controlled by a real object in the real world, and the self-controlled object is a virtual object not controlled by a real object in the real world; The displaying at least one second virtual object in the virtual scene whose distance from the first virtual position is less than a distance threshold includes: Displaying the controlled object in the virtual scene through a first display parameter different from that of the self-controlled object, where the first display parameter includes at least one of the following: color, size, shape, and special effects.

6. The method according to claim 3, wherein The method further includes: In response to a friend addition operation on the second virtual object, sending a friend verification request to a second target virtual object, where the second target virtual object is a second virtual object selected by the first virtual object through the friend addition operation, and the friend verification request is used to indicate that the first virtual object requests to add the second target virtual object as a friend; In response to the second target virtual object passing the friend verification request, control the first virtual object to have a session interaction with the second target virtual object.

7. The method according to claim 6, characterized in that, Before controlling the first virtual object to have a session interaction with the second target virtual object, the method further includes: Controlling the second target virtual object to jump to a first virtual location where the first virtual object is located; or, Controlling the first virtual object to move to a second virtual location where the second target virtual object is located in the virtual scene.

8. The method according to claim 6, wherein Before controlling the first virtual object to have a session interaction with the second target virtual object, the method further includes: When the second target virtual object is an autonomously controlled object, jumping the second target virtual object to a first virtual location where the first virtual object is located; When the second target virtual object is a controlled object and the current virtual location where the second target virtual object is located in the virtual scene does not correspond to the current real location where the second target real object is located in the real world, jumping the second target virtual object to a first virtual location where the first virtual object is located; When the second target virtual object is a controlled object and the current virtual location where the second target virtual object is located in the virtual scene corresponds to the current real location where the second target real object is located in the real world, controlling the first virtual object to move to a second virtual location where the second target virtual object is located in the virtual scene.

9. The method according to claim 3, characterized in that, The method further includes: In response to an interaction invitation operation for the second virtual object, send a game interaction invitation request to a third target virtual object, where the third target virtual object is the second virtual object invited by the first virtual object through the interaction invitation operation, and the interaction invitation request is used to indicate that the first virtual object requests to interact with the third target virtual object; In response to the third target virtual object passing the game interaction invitation request, control the first virtual object to start the interaction with the third target virtual object.

10. The method according to claim 1, characterized in that, When the service control is used to represent viewing a virtual venue whose distance from the first virtual location is less than a distance threshold, the displaying, in the virtual scene, a virtual service whose distance from the first virtual location is less than the distance threshold includes: Displaying, in the virtual scene, an identifier of at least one of the virtual venues and displaying navigation information between the first virtual object and the virtual venue, where the virtual venue corresponds to a real venue in the real world, and the virtual location where the virtual venue is located in the virtual scene corresponds to the real location where the real venue is located in the real world.

11. The method according to claim 10, characterized in that, The displaying, in the virtual scene, an identifier of at least one of the virtual venues includes: Highlight the identifier of the first virtual venue in the virtual scene, where the first virtual venue includes at least one of the following: the virtual venue that houses a virtual object associated with the first virtual object, the virtual venue with a popularity greater than a popularity threshold, and the virtual venue with an interest similarity to the first virtual object greater than a similarity threshold.

12. The method according to claim 11, wherein The popularity is positively correlated with the following parameters: the type of positive emotion expressed by the positive feedback for the virtual venue, the number of times of positive feedback for the virtual venue, and the number of virtual objects currently housed in the virtual venue.

13. The method according to claim 11, wherein The virtual venue with an interest similarity to the first virtual object greater than a similarity threshold is obtained by the neural network model performing the following processing: Based on the object features of the first virtual object and the venue data of the virtual venue, call the neural network model to perform a prediction process to obtain the virtual venue with an interest similarity to the first virtual object greater than a similarity threshold; wherein the neural network model is trained by object feature samples, venue data of virtual venue samples, and annotation information.

14. The method according to claim 10, wherein The method further includes: In response to a movement operation, control the first virtual object to move to a second virtual venue, where the second virtual venue is the selected virtual venue.

15. The method according to claim 14, wherein Before controlling the first virtual object to move to the second virtual venue, the method further includes: When the second virtual scene is within the target area of the first virtual object, display a first prompt message, where the first prompt message is used to instruct the mobile terminal device to control the first virtual object to move to the second virtual venue, the terminal device is used to control the virtual scene, and the target area is the area including the first virtual object; When the second virtual scene is outside the target area of the first virtual object, display a second prompt message, where the second prompt message is used to instruct the first real object to move to control the first virtual object to move to the second virtual venue; The controlling the first virtual object to move to the second virtual venue in response to a movement operation includes: In response to the movement operation of the terminal device, control the first virtual object to synchronize to the second virtual venue according to the movement mode of the terminal device; In response to the movement operation of the first real object, control the first virtual object to move to the second virtual venue following the first real object.

16. The method according to claim 14, characterized in that Virtual goods are displayed in the second virtual venue, and the method further includes: In response to a purchase operation for the virtual item, regard the virtual good as the possession of the first virtual object.

17. The method according to claim 14, wherein When the first virtual object is within the second virtual venue, the method further includes: In response to an interaction invitation operation for a target virtual object, send an interaction invitation request to the target virtual object, where the target virtual object is the virtual object invited by the first virtual object through the interaction invitation operation, and the interaction invitation request is used to indicate that the first virtual object requests to interact with the target virtual object in the second virtual venue; In response to the target virtual object through the interaction invitation request, control the target virtual object to jump to a target position and interact with the first virtual object, where the target position is the virtual position where the first virtual object is located in the second virtual venue.

18. The method according to claim 1, wherein When the service control is used to represent a virtual activity where the distance between the viewing activity location and the first virtual position is less than a distance threshold, the displaying of the virtual service with a distance less than the distance threshold from the first virtual position in the virtual scene includes: Display at least one identifier of the virtual activity and profile information in the virtual scene, where the profile information includes the virtual venue where the virtual activity is held.

19. The method according to claim 1, wherein: The virtual service includes at least one of the following: a second virtual object, a virtual venue, a virtual activity; the second virtual object is any virtual object other than the first virtual object in the virtual scene; After displaying the virtual service with a distance less than the distance threshold from the first virtual position in the virtual scene, the method further includes: In response to an interaction operation for the virtual service, control the first virtual object to interact with the virtual service.

20. The method according to claim 19, wherein When the virtual service is the second virtual object, the controlling the first virtual object to interact with the virtual service in response to an interaction operation for the virtual service includes: In response to a meet invitation operation, send a meet invitation request to a target virtual object, where the target virtual object is the second virtual object invited by the first virtual object through the meet invitation operation, and the meet invitation request is used to indicate that the target virtual object requests to have a meet interaction with the first virtual object; In response to the target virtual object through the meet invitation request, display navigation information between the target virtual object and the first virtual object.

21. An interaction device for a virtual scene, characterized in that, The apparatus includes: A display module for displaying a virtual scene, where the virtual scene is obtained by fusing the real world and the virtual world that can interact with each other, the virtual scene includes a first virtual object, the first virtual object is a virtual object corresponding to the first real object in the real world, and the first virtual position where the first virtual object is located in the virtual scene corresponds to the first real position where the first real object is located in the real world; A service module for, in response to a trigger operation for a service control, displaying a virtual service with a distance less than a distance threshold from the first virtual position in the virtual scene.

22. An electronic device, characterized in that, The electronic device includes: A memory for storing a computer program or computer-executable instructions; A processor, when executing a computer program or computer-executable instructions stored in the memory, implements the interactive method of the virtual scenario according to any one of claims 1 to 20.

23. A computer-readable storage medium, characterized in that, A memory stores a computer program or computer-executable instructions, and when the computer program or computer-executable instructions are executed by a processor, the interactive method of the virtual scenario according to any one of claims 1 to 20 is implemented.

24. A computer program product, comprising a computer program or computer-executable instructions, characterized in that When the computer program or computer-executable instructions are executed by a processor, the interactive method of the virtual scenario according to any one of claims 1 to 20 is implemented.

Images