Virtual object display method, device, electronic device and storage medium

Abstract

The present disclosure provides a method, device, electronic device, and storage medium for displaying a virtual object, wherein the method includes: obtaining an image to be identified and extracting a target object identifier from the image to be identified; based on the target object identifier, determining a virtual object that matches the target object identifier, wherein the virtual object is generated by rendering virtual object information running in a 3D rendering environment; the virtual object is driven by control information captured by a motion capture device; determining whether the current activity state of the virtual object meets a preset condition, and if the current activity state of the virtual object meets the preset condition, obtaining the current activity information of the virtual object; and displaying the current activity information of the virtual object in real time. The embodiments of the present disclosure can enhance the user's viewing experience and viewing interest.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a virtual object display method, a virtual object display device, an electronic device, and a computer-readable storage medium. Background Art

[0002] With the development of multimedia technology, the ways of displaying videos have also diversified. In addition to watching live or recorded videos through specific applications, users can also use electronic devices to identify target objects (such as dolls, ornaments, etc.) to watch corresponding video content.

[0003] However, in the related art, if the target object is the same, the video content displayed to the user after the target object is recognized by the electronic device each time is also the same, thereby reducing the user's viewing interest other than the first time. Summary of the Invention

[0004] The embodiments of the present disclosure at least provide a virtual object display method, a virtual object display device, an electronic device, and a computer-readable storage medium.

[0005] The present disclosure provides a method for displaying a virtual object, the method comprising:

[0006] Acquire an image to be identified and extract a target object identifier from the image to be identified;

[0007] Based on the target object identifier, determining a virtual object that matches the target object identifier, the virtual object being generated by rendering virtual object information running in a 3D rendering environment; the virtual object being driven by control information captured by a motion capture device;

[0008] determining whether a current activity state of the virtual object meets a preset condition, and obtaining current activity information of the virtual object if the current activity state of the virtual object meets the preset condition;

[0009] The current activity information of the virtual object is displayed in real time.

[0010] In the embodiment of the present disclosure, an image to be identified is obtained and a target object identifier in the image to be identified is extracted to determine a virtual object that matches the target object identifier. Then, when the current activity state of the virtual object meets the preset conditions, the current activity information of the virtual object is displayed in real time. In this way, each time the user uses an electronic device to identify the target object, the displayed video content is different, that is, each identification will result in a different viewing experience, thereby enhancing the user's viewing experience and viewing interest.

[0011] In a possible implementation, when the current activity state of the virtual object meets the preset condition, obtaining the current activity information of the virtual object includes:

[0012] When the current activity state of the virtual object meets the preset condition, generating a link identifier corresponding to the current activity state;

[0013] In response to a trigger operation on the link identifier, current activity information of the virtual object is obtained.

[0014] In the disclosed embodiment, if the current activity state of the virtual object meets the preset conditions, a link identifier corresponding to the current activity state is generated. In other words, by generating the link identifier, a user is provided with an entryway to view the video content, facilitating user operation. Furthermore, the user can choose whether to view the video content; only after the user triggers the link identifier is the current activity information of the virtual object obtained, thus providing users with more options.

[0015] In a possible implementation, the real-time display of the current activity information of the virtual object includes:

[0016] Acquiring real-scene images captured by electronic devices;

[0017] Based on the real scene image, the current activity information of the virtual object is displayed in real time.

[0018] In the disclosed embodiment, the current activity information of the virtual object is displayed in real time based on the real scene image. In this way, the virtual and the real are combined so that the real scene displayed by the virtual object is different each time, thereby bringing different visual experiences to the user.

[0019] In a possible implementation, the real-time display of current activity information of the virtual object based on the real scene image includes:

[0020] Identifying a target object in the real scene image;

[0021] Determining a relative position relationship of the virtual object with respect to the target object based on the attribute information of the target object;

[0022] Based on the target object and the relative position relationship, current activity information of the virtual object is displayed in real time.

[0023] In the embodiment of the present disclosure, the relative position relationship of the virtual object with respect to the target object is determined based on the attribute information of the target object, and then the current activity information of the virtual object is displayed in real time based on the target object and the relative position relationship. In this way, the virtual object can be adapted to the target object in the real scene, and the virtual object can be better integrated into the real scene, thereby improving the aesthetics of the picture display.

[0024] In one possible implementation, the method further includes:

[0025] When the current activity state of the virtual object does not meet the preset condition, preset content associated with the virtual object is displayed.

[0026] In the embodiment of the present disclosure, when the current activity state of the virtual object does not meet the preset conditions, the preset content associated with the virtual object is displayed. In this way, regardless of the state of the virtual object, the user can see the preset content associated with the virtual object after identifying the target object through the electronic device, thereby improving the user's understanding of the virtual object.

[0027] In a possible implementation, when the target object identifier corresponds to multiple virtual objects, determining whether the current activity state of the virtual object meets a preset condition, and obtaining the current activity information of the virtual object if the current activity state of the virtual object meets the preset condition, includes:

[0028] determining whether the current activity states of the multiple virtual objects are in a live broadcast state of the same scene, and if the current activity states of the multiple virtual objects are in a live broadcast state of the same scene, obtaining current activity information of the multiple virtual objects;

[0029] The real-time display of the current activity information of the virtual object includes:

[0030] The current activity information of the multiple virtual objects is displayed in real time.

[0031] In the embodiment of the present disclosure, if the target object identifier corresponds to multiple virtual objects, it is necessary to determine whether the multiple virtual objects are in the live broadcast state of the same scene. If the multiple virtual objects are in the live broadcast state of the same scene, the current activity information of the multiple virtual objects is displayed in real time. In this way, the current activity information of multiple virtual objects can be displayed at the same time, increasing the interaction between the multiple virtual objects to bring different visual experiences to users.

[0032] In a possible implementation, when the target object identifier corresponds to multiple virtual objects, determining whether the current activity state of the virtual object meets a preset condition, and obtaining the current activity information of the virtual object if the current activity state of the virtual object meets the preset condition, includes:

[0033] Determining whether the current activity state of each virtual object meets the preset condition;

[0034] In the case that the current activity state of any one of the virtual objects does not meet the preset condition, for the virtual objects whose current activity state meets the preset condition, respectively generating link identifiers corresponding to the virtual objects meeting the preset condition;

[0035] In response to a triggering operation on any of the link identifiers, obtaining current activity information of the virtual object corresponding to the triggered link identifier;

[0036] The real-time display of the current activity information of the virtual object includes:

[0037] The current activity information of the virtual object corresponding to the triggered link identifier is displayed in real time.

[0038] In the embodiment of the present disclosure, if the target object identifier corresponds to multiple virtual objects, it is necessary to determine whether each virtual object meets the preset conditions. If any of the virtual objects does not meet the preset conditions, link identifiers can be generated for the virtual objects that meet the preset conditions, and in response to a triggering operation on any link identifier, the current activity information of the virtual object corresponding to the triggered link identifier is displayed. In this way, the corresponding link identifier can be selected according to the user's preference for the virtual object to display the current activity information of the virtual object, thereby enhancing the user's experience.

[0039] The present disclosure also provides a virtual object display device, including:

[0040] An extraction module, configured to obtain an image to be identified and extract a target object identifier from the image to be identified;

[0041] a determination module configured to determine, based on the target object identifier, a virtual object matching the target object identifier, the virtual object being generated by rendering virtual object information running in a 3D rendering environment; the virtual object being driven by control information captured by a motion capture device;

[0042] an acquisition module, configured to determine whether the current activity state of the virtual object meets a preset condition, and acquire current activity information of the virtual object if the current activity state of the virtual object meets the preset condition;

[0043] The display module is used to display the current activity information of the virtual object in real time.

[0044] In a possible implementation, the acquisition module is specifically configured to:

[0045] When the current activity state of the virtual object meets the preset condition, generating a link identifier corresponding to the current activity state;

[0046] In response to a trigger operation on the link identifier, current activity information of the virtual object is obtained.

[0047] In a possible implementation, the display module is specifically used to:

[0048] Acquiring real-scene images captured by electronic devices;

[0049] Based on the real scene image, the current activity information of the virtual object is displayed in real time.

[0050] In a possible implementation, the display module is specifically used to:

[0051] Identifying a target object in the real scene image;

[0052] Determining a relative position relationship of the virtual object with respect to the target object based on the attribute information of the target object;

[0053] Based on the target object and the relative position relationship, current activity information of the virtual object is displayed in real time.

[0054] In a possible implementation, the display module is further configured to display preset content associated with the virtual object when the current activity state of the virtual object does not meet the preset condition.

[0055] In a possible implementation, when the target object identifier corresponds to multiple virtual objects, the acquisition module is specifically configured to:

[0056] determining whether the current activity states of the multiple virtual objects are in a live broadcast state of the same scene, and if the current activity states of the multiple virtual objects are in a live broadcast state of the same scene, obtaining current activity information of the multiple virtual objects;

[0057] The display module is specifically used for:

[0058] The current activity information of the multiple virtual objects is displayed in real time.

[0059] In a possible implementation, when the target object identifier corresponds to multiple virtual objects, the acquisition module is specifically configured to:

[0060] Determining whether the current activity state of each virtual object meets the preset condition;

[0061] In the case that the current activity state of any one of the virtual objects does not meet the preset condition, for the virtual objects whose current activity state meets the preset condition, respectively generating link identifiers corresponding to the virtual objects meeting the preset condition;

[0062] In response to a triggering operation on any of the link identifiers, obtaining current activity information of the virtual object corresponding to the triggered link identifier;

[0063] The display module is specifically used for:

[0064] The current activity information of the virtual object corresponding to the triggered link identifier is displayed in real time.

[0065] An embodiment of the present disclosure also provides an electronic device, including: a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the virtual object display method described in any one of the above possible implementation modes is executed.

[0066] An embodiment of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the virtual object display method described in any one of the possible implementation modes described above is executed.

[0067] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the embodiments. The drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and, together with the specification, are used to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For those of ordinary skill in the art, other relevant drawings can be obtained based on these drawings without inventive effort.

[0069] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the embodiments. The drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and, together with the specification, are used to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For those of ordinary skill in the art, other relevant drawings can be obtained based on these drawings without inventive effort.

[0070] Figure 1 A schematic diagram showing an execution subject of a virtual object display method provided by an embodiment of the present disclosure;

[0071] Figure 2 A flowchart of a first virtual object display method provided by an embodiment of the present disclosure is shown;

[0072] Figure 3 A schematic diagram of an image to be recognized provided by an embodiment of the present disclosure is shown;

[0073] Figure 4 A schematic diagram of an interface for displaying current activity information of a virtual object provided by an embodiment of the present disclosure is shown;

[0074] Figure 5 A flowchart of a method for displaying current activity information of a virtual object in real time based on a real scene image provided by an embodiment of the present disclosure is shown;

[0075] Figure 6 A schematic diagram of an interface for displaying current activity information of a virtual object based on a real scene image provided by an embodiment of the present disclosure is shown;

[0076] Figure 7 A flowchart of a method for displaying current activity information of a virtual object in real time based on relative position relationship provided by an embodiment of the present disclosure is shown;

[0077] Figure 8 A schematic diagram of an interface for displaying current activity information of a virtual object based on a relative position relationship provided by an embodiment of the present disclosure is shown;

[0078] Figure 9 A flowchart of a second virtual object display method provided by an embodiment of the present disclosure is shown;

[0079] Figure 10 A flowchart of a third virtual object display method provided by an embodiment of the present disclosure is shown;

[0080] Figure 11A schematic structural diagram of a virtual object display device provided by an embodiment of the present disclosure is shown;

[0081] Figure 12 A structural schematic diagram of an electronic device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0082] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings herein can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the disclosure for which protection is sought, but merely represents selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present disclosure.

[0083] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings.

[0084] The term "and / or" herein simply describes an association relationship, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, the simultaneous existence of A and B, and the existence of B alone. In addition, the term "at least one" herein refers to any combination of at least two of any one or more of a plurality of items. For example, "at least one of A, B, and C" can represent any one or more elements selected from the set consisting of A, B, and C.

[0085] Users can use electronic devices to identify target objects (such as ornaments, dolls, etc.) to watch corresponding video content. However, the video content displayed in related technologies can be a pre-set special effect or a pre-set performance. If a user identifies the same target object multiple times, the video content displayed each time will be the same, which will ultimately affect the user's viewing interest.

[0086] In response to the above problems, an embodiment of the present disclosure provides a virtual object display method, including: obtaining an image to be identified and extracting a target object identifier in the image to be identified; based on the target object identifier, determining a virtual object that matches the target object identifier, wherein the virtual object is generated by rendering virtual object information running in a 3D rendering environment; the virtual object is driven by control information captured by a motion capture device; determining whether the current activity state of the virtual object meets a preset condition, and if the current activity state of the virtual object meets the preset condition, obtaining the current activity information of the virtual object; and displaying the current activity information of the virtual object in real time.

[0087] In the embodiment of the present disclosure, an image to be identified is obtained and a target object identifier in the image to be identified is extracted to determine a virtual object that matches the target object identifier. Then, when the current activity state of the virtual object meets the preset conditions, the current activity information of the virtual object is displayed in real time. In this way, each time the user uses an electronic device to identify the target object, the displayed video content is different, that is, each identification will result in a different viewing experience, thereby enhancing the user's viewing experience and viewing interest.

[0088] See also Figure 1 , is a schematic diagram of an execution subject of a virtual object display method provided by an embodiment of the present disclosure, wherein the execution subject of the method is an electronic device 100, wherein the electronic device 100 may include a terminal and a server. For example, the method may be applied to a terminal, and the terminal may be Figure 1 The smartphone 10, desktop computer 20, laptop computer 30, etc. shown in FIG can also be Figure 1 The method is not limited to smart speakers, smart watches, tablet computers, etc. not shown in the figure. The method can also be applied to server 40, or can be applied to an implementation environment composed of a terminal and server 40. Server 40 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud storage, big data and artificial intelligence platforms.

[0089] In other embodiments, the electronic device 100 may further include an AR (Augmented Reality) device, a VR (Virtual Reality) device, an MR (Mixed Reality) device, etc. For example, the AR device may be a mobile phone or tablet computer with AR functionality, or may be AR glasses, without limitation herein.

[0090] It should be noted that, in some embodiments, the server 40 can communicate with the smartphone 10, the desktop computer 20, and the laptop computer 30 respectively via a network 50. The network 50 can include various connection types, such as wired or wireless communication links or fiber optic cables.

[0091] See also Figure 2 FIG. 1 is a flowchart of a first virtual object display method provided by an embodiment of the present disclosure, wherein the method includes steps S101 to S104, wherein:

[0092] S101: Acquire an image to be identified and extract a target object identifier from the image to be identified.

[0093] The image to be identified may be an image captured in real time by a user through a terminal, an image stored in the terminal, or an image downloaded directly from a web page, without any specific limitation.

[0094] Specifically, after acquiring the image to be identified, the image can be extracted to obtain the target object identifier within the image. The target object identifier indicates the identity of the target object. For example, the target object identifier can be an image, name, or identification code of the target object. The target object can be any object, such as a doll, ornament, or sculpture.

[0095] For example, see Figure 3 As shown, a schematic diagram of an image to be identified provided in an embodiment of the present disclosure is provided. After obtaining the image to be identified T, the target object identifier 11 (image of the target object), the target object identifier 12 (name of the target object) or the target object identifier 13 (name of the target object combination) in the image to be identified T can be extracted. Of course, in other embodiments, the target object identifier can also be in other forms, such as an identification code consisting of a string of numbers and letters.

[0096] S102, based on the target object identifier, determining a virtual object matching the target object identifier, wherein the virtual object is generated by rendering virtual object information running in a 3D rendering environment; and the virtual object is driven by control information captured by a motion capture device.

[0097] In this step, after extracting the target object identifier from the image to be identified, a virtual object matching the target object identifier can be further determined. The virtual object is generated by rendering virtual object information in a 3D rendering environment. The virtual object is driven by control information captured by a motion capture device, which in turn generates motion information for the virtual object. In other words, control information about the actor's (the person in the character) motion and expression data can be obtained through external hardware devices to drive the virtual object's motion.

[0098] Exemplarily, the motion capture device includes clothes worn on the actor's body and gloves worn on the actor's hands. The clothes are used to capture the actor's body movements, and the gloves are used to capture the actor's hand movements. Specifically, the motion capture device includes multiple feature points to be identified, and the multiple feature points to be identified can correspond to the key points of the actor's skeleton. For example, feature points can be set at the corresponding locations of the motion capture device and the various joints of the actor's skeleton (such as knee joints, elbow joints, and finger joints). The feature points can be made of specific materials (such as nanomaterials), and then the position information of the multiple feature points can be obtained by a camera to obtain control information.

[0099] Accordingly, in order to realize the driving of the virtual object, the virtual object includes controlled feature points that match the multiple feature points to be identified. For example, the feature points to be identified of the actor's elbow joint match the controlled points of the elbow joint of the virtual character, that is, there is a one-to-one correspondence between the skeletal key points of the actor and the skeletal key points of the virtual character. In this way, after obtaining the control information of the feature points to be identified of the actor's elbow joint, the corresponding changes in the elbow joint of the virtual object can be driven, and then the changes in multiple controlled points form the changes in the movement of the virtual object.

[0100] Specifically, the 3D rendering environment can be a 3D engine running in an electronic device, capable of generating image information from one or more perspectives based on the data to be rendered. Virtual object information is a character model stored in the 3D engine, which can generate corresponding virtual objects after rendering. In this embodiment, the virtual object can be a virtual animal image, a virtual cartoon character, or the like. In other embodiments, the virtual object can also be a virtual anchor, etc.

[0101] The virtual object information can be run in a computer CPU (Central Processing Unit), GPU (Graphics Processing Unit) and memory, and includes meshed model information and texture information. Accordingly, as an example, the virtual object information includes but is not limited to meshed model data, voxel data and texture data or a combination thereof. The mesh includes but is not limited to a triangular mesh, a quadrilateral mesh, other polygonal meshes or a combination thereof. In the embodiment of the present disclosure, the mesh is a triangular mesh.

[0102] In some embodiments, a mapping relationship between a target object identifier and a virtual object can be established in advance. As shown in Table 1, the image of virtual object A and the name of virtual object A correspond to virtual object A, the image of virtual object B corresponds to virtual object B, and the name of virtual object combination C corresponds to virtual object combination C. In this way, after extracting the target object identifier, the virtual object corresponding to the target object identifier can be determined based on the target object identifier and the mapping relationship between the target object identifier and the virtual object.

[0103] Table 1

[0104] Target object identifier Virtual Objects Image of A virtual object, name of A virtual object A virtual object B. Image of virtual object B virtual object C virtual object combination name C Virtual Object Composition

[0105] S103 , determining whether the current activity state of the virtual object meets a preset condition, and obtaining current activity information of the virtual object if the current activity state of the virtual object meets the preset condition.

[0106] The current activity state includes the virtual object's active performance state and the virtual object's resting state. The active performance state can be understood as the virtual object being driven and controlled by an actor and performing corresponding actions, while the resting state can be understood as the virtual object being not driven and controlled by an actor and being in a stationary state.

[0107] Exemplarily, if the current activity state of the virtual object is that the virtual object is performing a performance, it is determined that the current activity state of the virtual object meets the preset conditions, and therefore, the current activity information of the virtual object can be obtained; if the current activity state of the virtual object is that the virtual object is resting, it is determined that the current activity state of the virtual object does not meet the preset conditions.

[0108] In other embodiments, when the current activity state of the virtual object is that the virtual object is performing a live video broadcast, it can be determined that the current activity state of the virtual object meets the preset conditions, or when the current activity state of the virtual object is that the virtual object is performing a dance performance, it can be determined that the current activity state of the virtual object meets the preset conditions.

[0109] Specifically, after determining that the current activity state of the virtual object meets the preset conditions, the current activity information of the virtual object can be obtained. The current activity information refers to the content of the virtual object's current activity, such as the content of the virtual object dancing or singing.

[0110] In one possible implementation, when the current activity state of the virtual object meets the preset conditions, a link identifier corresponding to the current activity state is generated; in response to a trigger operation on the link identifier, the current activity information of the virtual object is obtained. Exemplarily, the link identifier may be URL information. In other implementations, the link identifier may be QR code information, barcode information, etc., which are not specifically limited. In this way, by generating a link identifier, an entry channel for viewing video content is provided to the user, which facilitates user operation. In addition, the user can choose whether to watch the video content, and the current activity information of the virtual object is obtained only after the user triggers the link identifier. In this way, more choices can be provided to the user.

[0111] In another possible implementation, if the current activity state of the virtual object does not meet the preset conditions, preset content associated with the virtual object is displayed. The preset content can be a preset video (e.g., video content recorded from a previous live broadcast of the virtual object), a preset image, or a preset article introduction, etc., without limitation. By displaying the preset content associated with the virtual object, the user's understanding of the virtual object can be enhanced.

[0112] For example, similar to the case where the conditions are met, if the current activity state of the virtual object does not meet the preset conditions, multiple link identifiers may be generated for the virtual object. In response to a triggering operation on any link identifier, the preset content corresponding to the triggered link identifier is displayed. Different link identifiers are used to represent different categories of preset content for the virtual object. For example, the first link identifier may be used to describe preset content about the virtual object's character relationships, while the second link identifier may be used to describe content about performances and activities that the virtual object has participated in. This allows users to select a category based on their interests to learn more about the virtual object.

[0113] S104: Display the current activity information of the virtual object in real time.

[0114] For example, one form of virtual objects is to capture the action of the actor (the person in the role) to obtain control information, drive the action of the virtual object in the 3D engine, and at the same time obtain the actor's voice, and fuse the actor's voice with the virtual object image to generate current activity information. Figure 4 As shown, the current activity information of the virtual object can be displayed in real time in the electronic device, for example, the activity information of the virtual object 18 stretching can be displayed in real time.

[0115] In the embodiment of the present disclosure, an image to be identified is obtained and a target object identifier in the image to be identified is extracted to determine a virtual object that matches the target object identifier. Then, when the current activity state of the virtual object meets the preset conditions, the current activity information of the virtual object is displayed in real time. In this way, each time the user uses an electronic device to identify the target object, the displayed video content is different, that is, each identification will result in a different viewing experience, thereby enhancing the user's viewing experience and viewing interest.

[0116] In a possible implementation, for the above step S104, the current activity information of the virtual object can be displayed in real time based on the real scene image. Figure 5 FIG. 1 is a flowchart of a method for displaying current activity information of a virtual object in real time based on a real scene image, provided by an embodiment of the present disclosure, including the following S1041 to S1042:

[0117] S1041, obtaining a real scene image captured by the electronic device.

[0118] For example, the electronic device may have a built-in image acquisition component or an external image acquisition component. After the electronic device enters the working state, the image acquisition component can capture the real scene image in real time. For example, after the electronic device enters the current activity information display page of the virtual object, it automatically calls a camera (such as a rear camera) to capture the current real scene image.

[0119] S1042: Based on the real scene image, display the current activity information of the virtual object in real time.

[0120] For example, see Figure 6 As shown, after acquiring the real scene image, the electronic device can display the current activity information of the virtual object 18 with the real scene image 20 as the background screen. The real scene image 20 can reflect the environmental information of the user's current environment in real time, such as trees on both sides of the road, people walking, etc. In other words, as the position of the electronic device changes, the real scene image will also change.

[0121] In this embodiment, the current activity information of the virtual object is displayed in real time based on the real scene image. In this way, the virtual and the real are combined so that the real scene displayed by the virtual object is different each time, thereby bringing a different visual experience to the user.

[0122] In a possible implementation, for the above step S1042, the current activity information of the virtual object can be displayed in real time based on the attribute information of the target object in the real scene image. Figure 7FIG. 1 is a flowchart of a method for displaying current activity information of a virtual object in real time based on a relative position relationship, provided by an embodiment of the present disclosure, including the following steps S10421 to S10423:

[0123] S10421, identifying the target object in the real scene image.

[0124] After acquiring the real scene image captured by the electronic device, the target object in the real scene image can be identified. The target object can be any object existing in real life, such as a table, a bed, etc.

[0125] S10422: Determine a relative position relationship of the virtual object with respect to the target object based on the attribute information of the target object.

[0126] After identifying the target object in the real scene image, the relative position of the virtual object with respect to the target object can be determined based on the attribute information of the target object. The attribute information of the target object may include the volume of the target object, the height of the target object, the shape of the target object, etc. It should be noted that different attribute information will be provided for different types of objects. In other embodiments, the attribute information of the target object may also include the color of the target object, the purpose of the target object, etc., which are not specifically limited.

[0127] In one possible implementation, if a table is placed in the real scene, the target object in the real scene image is the table. Since the table has a large surface area and a low height, the relative position relationship of the virtual object with respect to the target object can be determined based on the attribute information to be, for example, that the virtual object is standing on the table. Alternatively, since the table has a small surface area and a high height, the relative position relationship of the virtual object with respect to the target object can be determined based on the attribute information to be, for example, that the virtual object is sitting on the table or standing near the table.

[0128] In another possible implementation, if there is a guitar and a chair placed in the real scene, the target object in the real scene image is the chair. Therefore, the relative position relationship of the virtual object with respect to the target object can be determined based on the attribute information of the chair (such as volume). The virtual object can be sitting on the chair or standing near the chair, etc.

[0129] S10423: Based on the target object and the relative position relationship, display the current activity information of the virtual object in real time.

[0130] After determining the relative position relationship of the virtual object with respect to the target object, the current activity information of the virtual object can be displayed in real time according to the target object and the relative position relationship. Figure 8 As shown, if there is a table in the real scene, the target object in the real scene image is the table 21, and the virtual object 18 can stand on the table 21 to dance. If the target object in the real scene image is a chair, the virtual object can also sit on the chair and sing, or stand next to the chair and read aloud the content of the book.

[0131] In this embodiment, the relative position relationship of the virtual object with respect to the target object is determined based on the attribute information of the target object, and then the current activity information of the virtual object is displayed in real time based on the target object and the relative position relationship. In this way, the virtual object can be adapted to the target object in the real scene, and the virtual object can be better integrated into the real scene, thereby improving the aesthetics of the picture display.

[0132] In a possible implementation, if the target object identifier corresponds to multiple virtual objects, it can be determined whether the current activity states of the multiple virtual objects are in a live broadcast state of the same scene. Figure 9 FIG. 2 is a flow chart of a second method for displaying a virtual object provided by an embodiment of the present disclosure, wherein the method includes steps S201 to S206, wherein:

[0133] S201: Acquire an image to be identified and extract a target object identifier from the image to be identified.

[0134] Among them, step S201 is similar to the aforementioned step S101 and will not be repeated here.

[0135] S202: Based on the target object identifier, determine a plurality of virtual objects that match the target object identifier.

[0136] After the target object identifier is extracted from the image to be identified, multiple virtual objects matching the target object can be determined.

[0137] S203, determining whether the current activity state of the multiple virtual objects is a live broadcast state in the same scene; if so, executing step S204; if not, executing step S206.

[0138] After determining multiple virtual objects that match the target object, it is possible to further determine whether the current activity status of the multiple virtual objects is a live broadcast status in the same scene. If the current activity status of the multiple virtual objects is a live broadcast status in the same scene, the current activity information of the multiple virtual objects can be obtained; if the current activity status of the multiple virtual objects is not a live broadcast status in the same scene, the preset content associated with the multiple virtual objects can be displayed.

[0139] S204: Acquire current activity information of the multiple virtual objects.

[0140] When it is determined that the current activity states of the multiple virtual objects are in a live broadcast state of the same scene, current activity information of the multiple virtual objects may be acquired.

[0141] S205: Display current activity information of the multiple virtual objects in real time.

[0142] After obtaining the current activity information of the multiple virtual objects, the current activity information of the multiple virtual objects is displayed in real time.

[0143] In this embodiment, if the target object identifier corresponds to multiple virtual objects, it is necessary to determine whether the multiple virtual objects are in the live broadcast state of the same scene. If the multiple virtual objects are in the live broadcast state of the same scene, the current activity information of the multiple virtual objects is displayed in real time. In this way, the current activity information of multiple virtual objects can be displayed at the same time, increasing the interaction between multiple virtual objects to bring different visual experiences to users.

[0144] S206: Displaying preset content associated with the multiple virtual objects.

[0145] After determining that the current activity states of the multiple virtual objects are not a live broadcast state in the same scene, preset content associated with the multiple virtual objects may be displayed.

[0146] In one possible implementation, preset content associated with multiple virtual objects can be displayed simultaneously. For example, if multiple virtual objects form a group, the preset content can be video content introducing the group, group photos of the group, article introduction to the group, etc.

[0147] In another possible embodiment, preset content individually associated with multiple virtual objects can be displayed. For example, the preset content of any virtual object among the multiple virtual objects can be displayed, or, in response to a triggering operation on any virtual object, the preset content individually associated with the triggered virtual object can be displayed.

[0148] In another possible implementation, if the target object identifier corresponds to multiple virtual objects, it is possible to determine whether the current activity state of each virtual object meets the preset conditions. Figure 10 FIG. 1 is a flowchart of a third virtual object display method provided by an embodiment of the present disclosure, wherein the method includes steps S301 to S307, wherein:

[0149] S301: Acquire an image to be identified and extract a target object identifier from the image to be identified.

[0150] Among them, step S301 is similar to the aforementioned step S101 and will not be repeated here.

[0151] S302: Determine, based on the target object identifier, a plurality of virtual objects that match the target object identifier.

[0152] Among them, step S302 is similar to the aforementioned step S201 and will not be repeated here.

[0153] S303, determining whether the current activity state of each virtual object meets the preset condition; if so, executing step S304; if not, executing step S305.

[0154] After determining a plurality of virtual objects that match the target object identifier, it is necessary to further determine whether the current activity state of each virtual object meets the preset condition.

[0155] Exemplarily, if the current activity state of each virtual object meets the preset conditions, a link identifier corresponding to each virtual object can be generated respectively; if the current activity state of any virtual object does not meet the preset conditions, a link identifier corresponding to the virtual object meeting the preset conditions can be generated respectively for the virtual object whose current activity state meets the preset conditions; if the current activity state of each virtual object does not meet the preset conditions, the preset content associated with the multiple virtual objects can be displayed.

[0156] S304: Generate a link identifier corresponding to each virtual object.

[0157] After confirming that the current activity state of each virtual object meets the preset condition, a link identifier corresponding to each virtual object may be generated respectively.

[0158] For example, if there are five virtual objects that match the target object, and all five virtual objects are broadcasting live video, five link identifiers corresponding to the five virtual objects may be generated for the user to select.

[0159] S305 : For virtual objects whose current activity states meet the preset conditions, respectively generate link identifiers corresponding to the virtual objects meeting the preset conditions.

[0160] After determining that the current activity state of any virtual object does not meet the preset condition, link identifiers corresponding to the virtual objects meeting the preset condition may be generated for the virtual objects whose current activity states meet the preset condition.

[0161] For example, there are three virtual objects that match the target object, namely virtual object 1, virtual object 2 and virtual object 3. If virtual object 1 is not performing live video broadcast, it can be determined that virtual object 2 and virtual object 3 are performing live video broadcast. Therefore, a link identifier of virtual object 2 and a link identifier of virtual object 3 can be generated.

[0162] S306: In response to a triggering operation on any of the link identifiers, obtain current activity information of the virtual object corresponding to the triggered link identifier.

[0163] After generating a link identifier corresponding to a virtual object currently broadcasting a live video, the current activity information of the virtual object corresponding to the triggered link identifier can be obtained in response to a triggering operation on any link identifier. For example, as shown above, if link identifiers for virtual object 2 and virtual object 3 are generated, if the link identifier for virtual object 2 is triggered, the current activity information of virtual object 2 can be obtained.

[0164] S307: Displaying the current activity information of the virtual object corresponding to the triggered link identifier in real time.

[0165] After obtaining the current activity information of the virtual object corresponding to the triggered link identifier, the current activity information of the virtual object corresponding to the triggered link identifier is displayed in real time. For example, as can be seen from the above, the current activity information of virtual object 2 is obtained, so the current activity information of virtual object 2 can be displayed in real time.

[0166] In this embodiment, if the target object identifier corresponds to multiple virtual objects, it is necessary to determine whether each virtual object meets the preset conditions. If any of the virtual objects does not meet the preset conditions, link identifiers can be generated for the virtual objects that meet the preset conditions, and in response to a triggering operation on any link identifier, the current activity information of the virtual object corresponding to the triggered link identifier is displayed. In this way, the corresponding link identifier can be selected according to the user's preference for the virtual object to display the current activity information of the virtual object, thereby enhancing the user's experience.

[0167] In other embodiments, if the target object identifier corresponds to multiple virtual objects, it is possible to first determine whether the current activity states of the multiple virtual objects are in the live broadcast state of the same scene. If the current activity states of the multiple virtual objects are not in the live broadcast state of the same scene, it is possible to further determine whether the current activity state of each virtual object meets the preset conditions. If the current activity state of each virtual object meets the preset conditions, it can be proved that although each virtual object is not broadcasting live in the same scene, it is broadcasting live in different scenes respectively. Therefore, a link identifier corresponding to each virtual object can be generated respectively; if the current activity state of any virtual object does not meet the preset conditions, a link identifier corresponding to the virtual object that meets the preset conditions can be generated respectively for the virtual object whose current activity state meets the preset conditions; if the current activity state of each virtual object does not meet the preset conditions, it can be proved that no virtual object is broadcasting live. Therefore, the preset content associated with the multiple virtual objects can be displayed.

[0168] Those skilled in the art will understand that in the above-mentioned method of the specific implementation method, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0169] Based on the same inventive concept, the embodiment of the present disclosure also provides a virtual object display device corresponding to the virtual object display method. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the above-mentioned virtual object display method in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0170] Reference Figure 11 FIG. 1 is a schematic diagram of a virtual object display device according to an embodiment of the present disclosure. The device 1100 includes:

[0171] Extraction module 1101, used to obtain an image to be identified and extract a target object identifier from the image to be identified;

[0172] A determination module 1102 is configured to determine, based on the target object identifier, a virtual object that matches the target object identifier, wherein the virtual object is generated by rendering virtual object information running in a 3D rendering environment; and the virtual object is driven by control information captured by a motion capture device.

[0173] An acquisition module 1103 is configured to determine whether the current activity state of the virtual object meets a preset condition, and if the current activity state of the virtual object meets the preset condition, acquire current activity information of the virtual object;

[0174] The display module 1104 is configured to display the current activity information of the virtual object in real time.

[0175] In a possible implementation, the acquisition module 1103 is specifically configured to:

[0176] When the current activity state of the virtual object meets the preset condition, generating a link identifier corresponding to the current activity state;

[0177] In response to a trigger operation on the link identifier, current activity information of the virtual object is obtained.

[0178] In a possible implementation, the display module 1104 is specifically configured to:

[0179] Acquiring real-scene images captured by electronic devices;

[0180] Based on the real scene image, the current activity information of the virtual object is displayed in real time.

[0181] In a possible implementation, the display module 1104 is specifically configured to:

[0182] Identifying a target object in the real scene image;

[0183] Determining a relative position relationship of the virtual object with respect to the target object based on the attribute information of the target object;

[0184] Based on the target object and the relative position relationship, current activity information of the virtual object is displayed in real time.

[0185] In a possible implementation, the display module 1104 is further configured to display preset content associated with the virtual object when the current activity state of the virtual object does not meet the preset condition.

[0186] In a possible implementation, when the target object identifier corresponds to multiple virtual objects, the obtaining module 1103 is specifically configured to:

[0187] determining whether the current activity states of the multiple virtual objects are in a live broadcast state of the same scene, and if the current activity states of the multiple virtual objects are in a live broadcast state of the same scene, obtaining current activity information of the multiple virtual objects;

[0188] The display module 1104 is specifically used for:

[0189] The current activity information of the multiple virtual objects is displayed in real time.

[0190] In a possible implementation, when the target object identifier corresponds to multiple virtual objects, the obtaining module 1103 is specifically configured to:

[0191] Determining whether the current activity state of each virtual object meets the preset condition;

[0192] In the case that the current activity state of any one of the virtual objects does not meet the preset condition, for the virtual objects whose current activity state meets the preset condition, respectively generating link identifiers corresponding to the virtual objects meeting the preset condition;

[0193] In response to a triggering operation on any of the link identifiers, obtaining current activity information of the virtual object corresponding to the triggered link identifier;

[0194] The display module 1104 is specifically used for:

[0195] The current activity information of the virtual object corresponding to the triggered link identifier is displayed in real time.

[0196] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference can be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.

[0197] Based on the same technical concept, the embodiment of the present application also provides an electronic device. Figure 12 1 is a schematic diagram of the structure of an electronic device 1200 provided in an embodiment of the present application, including a processor 1201, a memory 1202, and a bus 1203. The memory 1202 is used to store execution instructions and includes a memory 12021 and an external memory 12022. The memory 12021 is also referred to as internal memory and is used to temporarily store calculation data in the processor 1201 and data exchanged with an external memory 12022 such as a hard disk. The processor 1201 exchanges data with the external memory 12022 through the memory 12021.

[0198] In the embodiment of the present application, the memory 1202 is specifically used to store application code for executing the solution of the present application, and the execution is controlled by the processor 1201. That is, when the electronic device 1200 is running, the processor 1201 communicates with the memory 1202 via the bus 1203, so that the processor 1201 executes the application code stored in the memory 1202, thereby performing the method disclosed in any of the aforementioned embodiments.

[0199] Among them, the memory 1202 can be, but is not limited to, random access memory (RAM), read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), etc.

[0200] The processor 1201 may be an integrated circuit chip with signal processing capabilities. The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. It can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. The general-purpose processor may be a microprocessor or any conventional processor.

[0201] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 1200. In other embodiments of the present application, the electronic device 1200 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0202] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon. When executed by a processor, the computer program executes the steps of the virtual object display method described in the above method embodiment. The storage medium may be a volatile or non-volatile computer-readable storage medium.

[0203] The computer program product of the virtual object display method provided in the embodiment of the present disclosure includes a computer-readable storage medium storing program code, and the instructions included in the program code can be used to execute the steps of a virtual object display method in the above method embodiment. For details, please refer to the above method embodiment and will not be repeated here.

[0204] The computer program product may be implemented in hardware, software, or a combination thereof. In one embodiment, the computer program product is implemented as a computer storage medium. In another embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0205] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems and devices described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0206] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0207] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0208] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0209] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The scope of protection of the present disclosure is not limited thereto. Although the present disclosure has been described in detail with reference to the above-described embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-described embodiments within the technical scope disclosed in the present disclosure, or replace some of the technical features therein with equivalents. Such modifications, changes, or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure shall be subject to the scope of protection of the claims.

Claims

1. A virtual object display method, characterized in that: include: Acquire an image to be identified and extract a target object identifier from the image to be identified; Based on the target object identifier, determining a virtual object that matches the target object identifier, the virtual object being generated by rendering virtual object information running in a 3D rendering environment; the virtual object being driven by control information captured by a motion capture device; determining whether the current activity state of the virtual object meets a preset condition, and obtaining current activity information of the virtual object if the current activity state of the virtual object meets the preset condition, wherein the current activity information indicates the content of the activity currently being performed by the virtual object, and the current activity state of the virtual object includes: the virtual object is performing a performance or the virtual object is taking a rest; The current activity information of the virtual object is displayed in real time.

2. The method according to claim 1, characterized in that When the current activity state of the virtual object meets the preset condition, obtaining the current activity information of the virtual object includes: When the current activity state of the virtual object meets the preset condition, generating a link identifier corresponding to the current activity state; In response to a trigger operation on the link identifier, current activity information of the virtual object is obtained.

3. The method according to claim 1, characterized in that The real-time display of the current activity information of the virtual object includes: Acquiring real-scene images captured by electronic devices; Based on the real scene image, the current activity information of the virtual object is displayed in real time.

4. The method according to claim 3, characterized in that The real-time display of the current activity information of the virtual object based on the real scene image includes: Identifying a target object in the real scene image; Determining a relative position relationship of the virtual object with respect to the target object based on the attribute information of the target object; Based on the target object and the relative position relationship, current activity information of the virtual object is displayed in real time.

5. The method according to claim 1, wherein The method further comprises: When the current activity state of the virtual object does not meet the preset condition, preset content associated with the virtual object is displayed.

6. The method according to claim 1, characterized in that In a case where the target object identifier corresponds to a plurality of virtual objects, determining whether the current activity state of the virtual object meets a preset condition, and obtaining the current activity information of the virtual object if the current activity state of the virtual object meets the preset condition, includes: determining whether the current activity states of the multiple virtual objects are in a live broadcast state of the same scene, and if the current activity states of the multiple virtual objects are in a live broadcast state of the same scene, obtaining current activity information of the multiple virtual objects; The real-time display of the current activity information of the virtual object includes: The current activity information of the multiple virtual objects is displayed in real time.

7. The method according to claim 1, characterized in that In a case where the target object identifier corresponds to a plurality of virtual objects, determining whether the current activity state of the virtual object meets a preset condition, and obtaining the current activity information of the virtual object if the current activity state of the virtual object meets the preset condition, includes: Determining whether the current activity state of each virtual object meets the preset condition; In the case that the current activity state of any one of the virtual objects does not meet the preset condition, for the virtual objects whose current activity state meets the preset condition, respectively generating link identifiers corresponding to the virtual objects meeting the preset condition; In response to a triggering operation on any of the link identifiers, obtaining current activity information of the virtual object corresponding to the triggered link identifier; The real-time display of the current activity information of the virtual object includes: The current activity information of the virtual object corresponding to the triggered link identifier is displayed in real time.

8. A virtual object display device, characterized in that: include: An extraction module, configured to obtain an image to be identified and extract a target object identifier from the image to be identified; a determination module configured to determine, based on the target object identifier, a virtual object matching the target object identifier, the virtual object being generated by rendering virtual object information running in a 3D rendering environment; the virtual object being driven by control information captured by a motion capture device; an acquisition module, configured to determine whether the current activity state of the virtual object meets a preset condition, and if the current activity state of the virtual object meets the preset condition, acquire current activity information of the virtual object, wherein the current activity information indicates the content of the activity currently being performed by the virtual object, and the current activity state of the virtual object includes: the virtual object is performing a performance or the virtual object is resting; The display module is used to display the current activity information of the virtual object in real time.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, a virtual object display method as described in any one of claims 1 to 7 is performed.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the virtual object display method according to any one of claims 1 to 7 is executed.

Images