Information display method and device based on three-dimensional scene and medium

Abstract

The embodiment of the invention relates to an information display method and device based on a three-dimensional scene and a medium, and the method comprises the steps: recognizing whether an explanation operation on a target explanation object in a target three-dimensional scene model is obtained or not when the target three-dimensional scene model is displayed; when the explanation operation is obtained, a pre-generated explanation video corresponding to the target explanation object is read, and the explanation video comprises multiple explanation video frames explained by the three-dimensional digital human model on the target explanation object; and playing the explanation video in the target three-dimensional scene model. In the technical scheme, the display of the three-dimensional digital human in the three-dimensional scene is realized based on the two-dimensional video, and the rendering cost of the three-dimensional digital human is reduced.

Description

Technical Field

[0001] This disclosure relates to the field of digital display technology, and in particular to an information display method, device and medium based on a three-dimensional scene. Background Technology

[0002] In the current field of digital display and interaction, the demand for three-dimensional (3D) digital human rendering is becoming increasingly common. For example, in the home decoration field, when displaying a three-dimensional model of the living room, it has become a demand to explain the living room in the form of a 3D digital human.

[0003] In related technologies, rendering a 3D digital human within a 3D model requires constructing and rendering a 3D digital human model within the 3D model. However, the algorithms for constructing and rendering a 3D model within a 3D scene are complex and costly. Summary of the Invention

[0004] In order to solve the above-mentioned technical problems, or at least partially solve the above-mentioned technical problems, this disclosure provides an information display method, device and medium based on a three-dimensional scene.

[0005] This disclosure provides an information display method based on a three-dimensional scene. The method includes: when displaying a target three-dimensional scene model, identifying whether a narration operation for a target narration object in the target three-dimensional scene model is obtained; when the narration operation is obtained, reading a pre-generated narration video corresponding to the target narration object, wherein the narration video includes multiple narration video frames in which a three-dimensional digital human model narrates the target narration object; and playing the narration video in the target three-dimensional scene model.

[0006] This disclosure also provides an information display device based on a three-dimensional scene. The device includes: a recognition module, used to recognize whether a narration operation on a target narration object in the target three-dimensional scene model has been obtained when displaying the target three-dimensional scene model; a reading module, used to read a pre-generated narration video corresponding to the target narration object when the narration operation is obtained, wherein the narration video includes multiple narration video frames of a three-dimensional digital human model narrating the target narration object; and a playback module, used to play the narration video in the target three-dimensional scene model.

[0007] This disclosure also provides an electronic device, the electronic device comprising: a processor; a memory for storing executable instructions of the processor; the processor being configured to read the executable instructions from the memory and execute the instructions to implement the information display method based on a three-dimensional scene as provided in this disclosure.

[0008] This disclosure also provides a computer-readable storage medium storing a computer program for executing the information display method based on a three-dimensional scene as provided in this disclosure.

[0009] The technical solution provided in this disclosure has the following advantages compared with the prior art: The information display scheme based on a 3D scene provided in this disclosure identifies whether a narration operation for a target narration object in the target 3D scene model is obtained when displaying the target 3D scene model. Then, if a narration operation is obtained, a pre-generated narration video corresponding to the target narration object is read. The narration video includes multiple frames of narration video of the 3D digital human model narrating the target narration object, and the narration video is played in the target 3D scene model. In this technical solution, the display of a 3D digital human in a 3D scene is achieved based on 2D video, reducing the rendering cost of the 3D digital human. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0011] Figure 1 A flowchart illustrating an information display method based on a three-dimensional scene provided in this embodiment of the disclosure; Figure 2 A flowchart illustrating another information display method based on a three-dimensional scene provided in this embodiment of the present disclosure; Figure 3 This is a schematic diagram illustrating a scenario for generating an explanatory video, as provided in an embodiment of this disclosure. Figure 4 This is a schematic diagram of the structure of an information display device based on a three-dimensional scene provided in an embodiment of the present disclosure; Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0012] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0013] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0014] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0015] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0016] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0017] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0018] To address the aforementioned issues, this disclosure provides an information display method based on a three-dimensional scene, which will be described below with reference to specific embodiments.

[0019] Figure 1 This is a flowchart illustrating an information display method based on a three-dimensional scene, provided by an embodiment of this disclosure. This method can be executed by an information display device based on a three-dimensional scene, which can be implemented using software and / or hardware, and is generally integrated into an electronic device. Figure 1 As shown, the method includes: Step 101: When displaying the target 3D scene model, identify whether the explanation operation for the target explanation object in the target 3D scene model has been obtained.

[0020] The target 3D scene model can be any scene model within any business service scenario. For example, in a house sales business, the target 3D scene model could be a kitchen model, a living room model, a bedroom model, etc. The target 3D scene model specifically represents any scene within the business service scenario in a 3D form.

[0021] In the embodiments of this disclosure, when displaying the target 3D scene model, it is identified whether a narration operation for the target narration object in the target 3D scene model has been obtained. The target narration object is any object in the target 3D scene model, which is composed of models of a large number of objects. For example, in a living room 3D model, models of objects such as table lamps and sofas are included.

[0022] In different application scenarios, the methods for identifying whether a narration operation has been obtained for the target 3D scene model vary, as shown in the following examples: In some possible embodiments, it is determined whether the user's viewpoint position in the target 3D scene model is on the target object being explained. If the user is on the target object being explained, then the explanation operation for the target object being explained in the target 3D scene model is obtained.

[0023] The viewpoint position indicates the object that the user wants to learn about in the target unit scene. In some possible implementations, when the target 3D scene model also includes a user model representing the user, when the user drags the user model closer to the target object, if the distance between the user model and the target object is less than a preset distance threshold, then the user's viewpoint position is determined to be on the target object.

[0024] In some possible implementations, the display orientation of the target 3D model is limited by the camera model. The camera model is not the actual model being displayed, but rather a set of model display orientation parameters used to determine the display orientation angle of the target unit model. The target 3D model is displayed according to the display orientation parameters, and the target 3D model is essentially displayed facing the camera model. The position corresponding to the center of the target 3D model and the camera is the viewpoint position.

[0025] And / or, In some possible embodiments, it is determined whether a preset explanation control for the target explanation object is triggered. When the preset explanation control is triggered, the explanation operation for the target explanation object in the target 3D scene model is obtained.

[0026] In this embodiment, a preset explanation control is displayed for each explainable object. The preset explanation control can be set on the corresponding explanation object or in a preset control display area in the target 3D scene model.

[0027] Step 102: When the explanation operation is obtained, read the pre-generated explanation video corresponding to the target explanation object. The explanation video includes multiple explanation video frames of the three-dimensional digital human model explaining the target explanation object.

[0028] When a narration operation is requested, a pre-generated narration video corresponding to the target narration object is read. This narration video contains multiple frames of narration video frames in which a 3D digital human model narrates about the target narration object. For example, if the target narration object is a desk lamp, then the narration video is a video of a 3D digital human model narrating about the desk lamp.

[0029] Step 103: Play the explanatory video in the target 3D scene model.

[0030] In the embodiments of this disclosure, an explanatory video is played in the target 3D scene model. Thus, although the explanatory video is 2D, it contains a 3D digital human explanatory model, visually achieving a 3D explanatory effect. The 3D digital human is displayed in a 3D scene based on the 2D video, reducing the rendering cost of the 3D digital human.

[0031] In the embodiments of this disclosure, the current narration video frame corresponding to the current playback time is determined. In the embodiments of this disclosure, a 3D digital human image obtained by cutting out the 3D digital human model in the current narration video frame is also obtained. For example, the 3D digital human image obtained by cutting out the 3D digital human model in the current narration video frame can be obtained by using relevant tools. Then, the 3D digital human image is displayed in the 3D scene model, thereby further improving the 3D spatial sense of the digital human model.

[0032] In one embodiment of this disclosure, to enhance the intuitiveness of the explanation, the current explanation content corresponding to the current playback moment can be determined. This current explanation content is pre-written; for example, the explanation content for a desk lamp might include "This desk lamp has a power of 200W," etc. In this embodiment, explanation subtitles including the current explanation content are also generated. The subtitle style can be pre-defined, including the subtitle shape, font, size, and color of the included explanation content. The explanation subtitles are displayed in a 3D scene model. Thus, the explanation video frames and explanation subtitles are rendered and displayed synchronously, facilitating a more comprehensive understanding of the target explanation object for the user.

[0033] In one embodiment of this disclosure, to further visually display the narration progress, the total duration of the narration video can be determined, and the playback duration of the narration video at the current playback moment corresponding to the current narration content can be determined. A playback progress bar for the narration video is also simultaneously displayed in the 3D scene model to indicate the playback progress. The style of the playback progress bar can be customized and is not limited here.

[0034] In the embodiments of this disclosure, to further enhance interactivity, a user's pause operation on the explanatory video can be detected. This pause operation can be achieved by triggering the area where the 3D digital human model is located, or by triggering a preset pause control, etc. After a pause operation is detected, the explanatory video playback is paused, and the playback progress bar also stops filling. In this embodiment, a user's resume playback operation on the explanatory video can also be detected. This resume playback operation can be achieved by triggering the area where the 3D digital human model is located again, or by triggering a preset playback control, etc. After a resume playback operation is detected, the explanatory video playback resumes, and the playback progress bar also resumes filling.

[0035] In one embodiment of this disclosure, to further enhance the explanation effect, visual display parameters and / or movement parameters of the target explanation object matching the current explanation content can be determined. The display parameters include at least one of: display area, display duration, display frequency, display color, etc., and the movement parameters include at least one of: movement distance, movement trajectory, movement speed, rotation angle, etc. In this embodiment of the disclosure, the method for determining the visual display parameters and / or movement parameters of the target explanation object matching the current explanation content may include: In some possible embodiments, it can be identified whether the current content being explained includes visual display parameters and / or movement parameters. If visual display parameters and / or movement parameters are included, the included visual display parameters and / or movement parameters are used as the visual display parameters and / or movement parameters in this embodiment.

[0036] In some possible embodiments, data points can be embedded in the target video for explanation. When explaining a current video frame, the pre-embedded data points can be triggered to send an instruction containing visual display parameters and / or movement parameters, and the visual display parameters and / or movement parameters in the instruction can be extracted.

[0037] Furthermore, at the current playback time, the target narration object is displayed according to the visual display parameters; and / or, at the current playback time, the target narration object is moved according to the movement parameters.

[0038] For example, when the target of the explanation is a desk lamp, the corresponding visual display parameters include display color and display frequency. When playing the corresponding explanation video, the control lamp is synchronized to display according to the display color, display frequency, etc., which allows users to understand the function of the desk lamp more intuitively.

[0039] In summary, the information display method based on a 3D scene in this embodiment of the present disclosure, when displaying a target 3D scene model, identifies whether a narration operation for a target narration object in the target 3D scene model has been obtained. Then, when a narration operation is obtained, a pre-generated narration video corresponding to the target narration object is read. The narration video includes multiple frames of narration video of the 3D digital human model narrating the target narration object, and the narration video is played in the target 3D scene model. In this technical solution, the display of a 3D digital human in a 3D scene is achieved based on 2D video, reducing the rendering cost of the 3D digital human.

[0040] Based on the above embodiments, before reading the pre-generated explanation video corresponding to the target explanation object, an explanation video for each explanation object is also pre-created. The following description uses the creation process of the explanation video corresponding to the target explanation object as an example.

[0041] In one embodiment of this disclosure, such as Figure 2 As shown, before reading the pre-generated explanatory video corresponding to the target explanatory object, the method also includes: Step 201: Obtain the visual feature parameters of the three-dimensional digital human model, and obtain the three-dimensional digital human model based on the visual feature parameters.

[0042] The visual feature parameters of the human figure are used to indicate the visual appearance of the 3D digital human model. These parameters can be customized by the user and may include factors such as age, gender, hairstyle, skin color, and clothing style. In this embodiment, the 3D digital human model is obtained based on the visual feature parameters. For example, a 3D digital human model can be generated based on the visual feature parameters using a digital human video generation tool.

[0043] Step 202: Obtain multiple explanatory content segments for the target audience, where each explanatory content segment has a different explanatory theme.

[0044] The explanatory content segments are used to indicate specific explanatory texts. They can be pre-written by relevant personnel based on the function of the object being explained and the selling points to be promoted. Each explanatory content segment has a different theme. The theme can include any of the following: the function of the target object (for example, if the object is a kettle, the kettle has various functions, and the theme corresponds to the function of the kettle) or the location of the object (for example, if the object is furniture, the furniture has different usage locations, and the theme corresponds to the location of the furniture).

[0045] Step 203: Determine the first facial expression and the first gesture for each explanatory content segment.

[0046] Among them, the facial expressions and actions of the first speaker can also be customized by relevant personnel.

[0047] Step 204: Using a digital human video generation tool, create corresponding video clips for each segment of the explanation content based on the 3D digital human model, the facial expressions of the first explainer, and the first explainer's actions.

[0048] In this embodiment, a digital human video generation tool can be used to create corresponding explanation video segments for each explanation content segment based on the three-dimensional digital human model, the first explanation facial expression, and the first explanation action.

[0049] In some possible embodiments, to further enhance the realism of the explanation, at least one extended explanation content segment can be obtained for each explanation content segment. The content of each extended explanation content segment is not entirely the same as the corresponding explanation content segment, and the theme of each extended explanation content segment is consistent with the theme of the corresponding explanation content segment. In other words, the extended explanation content segment and the corresponding explanation content segment belong to different explanations of the same theme. For example, when the explanation theme is the eye-protection function of a desk lamp, the explanation content segment could be "This desk lamp has a very good eye-protection effect and can achieve the same light intensity as outdoor light," and the corresponding extended explanation content segment could be "This desk lamp has been tested and can guarantee that users experience less eye fatigue under the same usage time," etc.

[0050] In this embodiment, at least one extended explanation content segment corresponding to the explanation content segment can be obtained based on an artificial intelligence model.

[0051] The second facial expression and second gesture are determined for each extended explanation content segment, and these can be customized. Then, a digital human video generation tool is used to create corresponding explanation video segments for each extended explanation content segment based on the 3D digital human model, the second facial expression, and the second gesture.

[0052] In the embodiments of this disclosure, to enable the digital human to simulate random explanations during the explanation process, increasing the interest and diversity of the explanations and avoiding monotonous fixed-sequence explanations, a configuration file for the target explanation object is generated and stored. This configuration file contains all explanation video clips for the target explanation object, as well as the correspondence between each explanation video clip and the explanation topic. Therefore, in this embodiment, at least one target explanation topic matching the target explanation object is determined. This target explanation topic can be randomly selected or determined based on the user's profile information. A target explanation video clip matching each target explanation topic is randomly selected from the configuration file. The at least one target explanation video clip corresponding to the at least one target explanation topic is combined to obtain the explanation video corresponding to the target explanation object. The combination order of the at least one target explanation video clip can also be randomly determined.

[0053] For example, such as Figure 3 As shown, when the target of the explanation is a sofa, three explanation content segments are pre-generated, each covering three themes: sofa material, sofa function, and sofa cleaning methods. These three segments are A1, B1, and C1. The extended explanation content segments for A1 are A2 and A3, for B1 they are B2, B3, and B4, and for C1 they are C2 and C3. Therefore, after generating the explanation video segments for each content segment and its extended segments, when the sofa explanation operation is first detected, the determined target explanation themes include sofa material, sofa function, and sofa cleaning methods. If the sofa material is identified as A1, the sofa function as B2, and the sofa cleaning method as C1, then the generated explanation video is a combination of A1, B2, and C1. When the sofa explanation operation is detected for the second time, the identified target explanation topics include sofa material, sofa function, and sofa cleaning method. Therefore, the identified target explanation video for sofa material is A2, the identified target explanation video for sofa function is B2, and the identified target explanation video for sofa cleaning method is C2. The generated explanation video is a combination of A2, B2, and C2.

[0054] In summary, the information display method based on a three-dimensional scene in this embodiment can determine the explanation video at the granular level, and the explanation video segments can be randomly selected, ensuring the randomness of the explanation video. This allows the three-dimensional digital human model to simulate random explanation effects during the explanation process, increasing the interest and diversity of the explanation and avoiding monotonous fixed-sequence explanations.

[0055] To achieve the above embodiments, this disclosure also proposes an information display device based on a three-dimensional scene.

[0056] Figure 4 This is a schematic diagram of the structure of an information display device based on a three-dimensional scene, provided in an embodiment of this disclosure. This device can be implemented by software and / or hardware and is generally integrated into an electronic device. Figure 4 As shown, the device includes: an identification module 410, a reading module 420, and a playback module 430, wherein, The recognition module 410 is used to identify whether a narration operation on the target narration object in the target 3D scene model has been obtained when displaying the target 3D scene model; The reading module 420 is used to read the pre-generated explanation video corresponding to the target explanation object when the explanation operation is obtained. The explanation video includes multiple explanation video frames of the three-dimensional digital human model explaining the target explanation object. The playback module 430 is used to play explanatory videos in the target 3D scene model.

[0057] In some implementations, the identification module 410 is used for: Determine whether the user's viewpoint on the target narration object is within the target narration object in the target 3D scene model. If the user is within the target narration object, then perform a narration operation on the target narration object within the target 3D scene model; and / or, Determine whether the preset explanation control for the target explanation object has been triggered. If the preset explanation control has been triggered, then obtain the explanation operation for the target explanation object in the target 3D scene model.

[0058] In some implementations, it further includes: a video generation module, used for: Obtain the visual feature parameters of the 3D digital human model, and then obtain the 3D digital human model based on the visual feature parameters. Obtain multiple explanatory content segments for a target audience, where each segment has a different topic. Determine the first facial expression and the first gesture used during the explanation of each segment of content. Using a digital human video generation tool, corresponding video clips are created for each segment of the explanation content based on a 3D digital human model, the facial expressions of the first speaker, and the first speaker's actions.

[0059] In some implementations, the video generation module is used for: Obtain at least one extended explanation content segment for each explanation content segment, wherein the explanation content of each extended explanation content segment is not completely the same as the corresponding explanation content segment, and the explanation topic of each extended explanation content segment is consistent with the explanation topic of the corresponding explanation content segment. Identify the second facial expressions and second gestures for each extended explanation segment; The digital human video generation tool creates corresponding video clips for each extended explanation content segment based on the 3D digital human model, the second explanation's facial expressions, and the second explanation's actions.

[0060] In some implementations, it also includes: The storage module is used to generate and store the configuration file of the target narration object. The configuration file contains all the narration video clips of the target narration object, as well as the correspondence between each narration video clip and the narration topic. Read module 420, used for: Identify at least one target topic that matches the target audience; In the configuration file, a target explanation video clip that matches the explanation topic of each target is randomly selected; Combine at least one video clip corresponding to at least one target explanation topic to obtain the explanation video corresponding to the target explanation object.

[0061] In some implementations, the playback module 430 is used for: Determine the current narration video frame corresponding to the current playback moment; Obtain a 3D digital human image obtained by cutting out the 3D digital human model from the current explanatory video frame; Display 3D digital human images in a 3D scene model.

[0062] In some implementations, the playback module 430 is also used for: Determine the current narration content corresponding to the current playback moment; Generate captions that include the content being explained; Display explanatory subtitles in the 3D scene model.

[0063] In some implementations, the playback module 430 is also used for: Determine the visual display parameters and / or movement parameters of the target object that matches the current content being explained; The display of the target narration object is controlled according to the visual display parameters at the current playback time; and / or, the movement of the target narration object is controlled according to the movement parameters at the current playback time.

[0064] The information display device based on a three-dimensional scene provided in this disclosure can execute the information display method based on a three-dimensional scene provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects of executing the method.

[0065] To implement the above embodiments, this disclosure also proposes a computer program product, including a computer program / instruction, which, when executed by a processor, implements the information display method based on a three-dimensional scene in the above embodiments.

[0066] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure.

[0067] The following is a detailed reference. Figure 5 The diagram illustrates a structural schematic suitable for implementing the electronic device 500 in the embodiments of this disclosure. The electronic device 500 in the embodiments of this disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 5 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0068] like Figure 5 As shown, electronic device 500 may include a processor (e.g., central processing unit, graphics processor, etc.) 501, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 502 or a program loaded from memory 508 into random access memory (RAM) 503. RAM 503 also stores various programs and data required for the operation of electronic device 500. Processor 501, ROM 502, and RAM 503 are interconnected via bus 504. Input / output (I / O) interface 505 is also connected to bus 504.

[0069] Typically, the following devices can be connected to I / O interface 505: input devices 506 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 507 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; memory devices 508 including, for example, magnetic tapes, hard disks, etc.; and communication devices 509. Communication device 509 allows electronic device 500 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 5 An electronic device 500 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0070] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 509, or installed from a memory 508, or installed from a ROM 502. When the computer program is executed by the processor 501, it performs the functions defined in the information display method based on a three-dimensional scene according to embodiments of this disclosure.

[0071] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0072] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0073] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0074] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the aforementioned information display method based on a three-dimensional scene.

[0075] Electronic devices can be programmed with computer program code in one or more programming languages ​​or combinations thereof to perform the operations of this disclosure. These programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as "C" or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0076] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0077] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0078] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0079] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0080] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0081] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0082] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A method for displaying information based on a three-dimensional scene, characterized in that, include: When displaying the target 3D scene model, identify whether a narration operation for the target narration object in the target 3D scene model has been obtained; When the explanation operation is obtained, a pre-generated explanation video corresponding to the target explanation object is read, wherein the explanation video includes multiple explanation video frames in which the three-dimensional digital human model explains the target explanation object; The explanatory video is played in the target 3D scene model.

2. The method as described in claim 1, characterized in that, The step of identifying whether a narration operation has been obtained for the target narration object in the target 3D scene model includes: Determine whether the user's viewpoint position in the target 3D scene model is on the target narration object; if so, obtain a narration operation for the target narration object in the target 3D scene model; and / or, Determine whether the preset explanation control of the target explanation object is triggered. When the preset explanation control is triggered, obtain the explanation operation of the target explanation object in the target 3D scene model.

3. The method as described in claim 1, characterized in that, Before reading the pre-generated explanatory video corresponding to the target explanatory object, the method further includes: Obtain the visual feature parameters of the three-dimensional digital human model, and obtain the three-dimensional digital human model based on the visual feature parameters; Obtain multiple explanatory content segments for the target object, wherein each of the explanatory content segments has a different explanatory theme; Determine the first facial expression and the first gesture used in each segment of the explanation content; The digital human video generation tool creates corresponding explanation video segments for each of the explanation content segments based on the three-dimensional digital human model, the first explanation facial expression, and the first explanation action.

4. The method as described in claim 3, characterized in that, The method further includes: Obtain at least one extended explanation content segment for each of the explanation content segments, wherein the explanation content of each extended explanation content segment is not completely the same as the corresponding explanation content segment, and the explanation theme of each extended explanation content segment is consistent with the explanation theme of the corresponding explanation content segment. Determine the second facial expression and second gesture for each of the extended explanation content segments; The digital human video generation tool creates corresponding explanation video segments for each of the extended explanation content segments based on the three-dimensional digital human model, the second explanation facial expression, and the second explanation action.

5. The method as described in claim 3 or 4, characterized in that, The method further includes: Generate and store a configuration file for the target explanation object, wherein the configuration file contains all the explanation video clips of the target explanation object, and the correspondence between each explanation video clip and the explanation topic; The step of reading the pre-generated explanation video corresponding to the target explanation object includes: Identify at least one target explanation topic that matches the target explanation object; In the configuration file, a target explanation video clip that matches each of the target explanation topics is randomly selected; Combine at least one target explanation video segment corresponding to the at least one target explanation topic to obtain an explanation video corresponding to the target explanation object.

6. The method as described in claim 1, characterized in that, Playing the explanatory video in the target 3D scene model includes: Determine the current narration video frame corresponding to the current playback moment; Obtain a 3D digital human image obtained by cutting out the 3D digital human model in the current explanatory video frame; The 3D digital human image is displayed in the 3D scene model.

7. The method as described in claim 1 or 6, characterized in that, When playing the explanatory video in the target 3D scene model, the method further includes: Determine the current narration content corresponding to the current playback moment; Generate explanatory subtitles that include the currently explained content; The explanatory subtitles are displayed in the three-dimensional scene model.

8. The method as described in claim 7, characterized in that, The method further includes: Determine the visual display parameters and / or movement parameters of the target object that matches the current content being explained; The target narration object is displayed according to the visual display parameters at the current playback time, and / or the target narration object is moved according to the movement parameters at the current playback time.

9. An electronic device, characterized in that, The electronic device includes: processor; Memory used to store the processor's executable instructions; The processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the information display method based on a three-dimensional scene as described in any one of claims 1-8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program for executing the information display method based on a three-dimensional scene as described in any one of claims 1-8.

Images