VIRTUAL SCENE INFORMATION INTERACTION METHOD, DEVICE, ELECTRONIC DEVICE, STORAGE MEDIUM, AND COMPUTER PROGRAM

Abstract

To provide a virtual scene information interaction method, which is applied to the scene of cloud computing, metaverse and media cloud to enhance the user's experience of engaging with the virtual environment, allowing the user to have immersive data interaction with the virtual environment, and a device, an electronic device, a storage medium, and a computer program.SOLUTION: A method 200 obtains S210 basic data of a first object in response to a virtual scene access request instruction for the first object, and on the basis of the basic data, creates a virtual character of the first object in a virtual scene, obtains a target engagement object corresponding to the first object S220, and broadcasts a target content in the virtual scene S230 in response to the target content broadcasting instruction from the first object.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to the field of artificial intelligence, particularly to the field of computer vision, speech recognition, and virtual reality, and is applied to cloud computing, metaverse, and media cloud scenes. Specifically, the present disclosure relates to a virtual scene information interaction method, device, electronic device, storage medium, and computer program. [Background technology]

[0002] 2. Description of the Related Art With the development of computer technology and Internet technology, many smart products provide the function of data interaction with virtual environments so as to enhance users' usage experience. Summary of the Invention [Problem to be solved by the invention]

[0003] The present disclosure provides a virtual scene information interaction method, device, electronic device, storage medium, and computer program. [Means for solving the problem]

[0004] According to one aspect of the present disclosure, a virtual scene information interaction method is provided, the virtual scene information interaction method including: responding to a virtual scene access request command for a first object to obtain basic data of the first object; creating a virtual character of the first object in the virtual scene based on the basic data and obtaining a target engagement object corresponding to the first object; and responding to a target content broadcast command from the first object to broadcast the target content in the virtual scene.

[0005] According to another aspect of the present disclosure, a virtual scene information interaction device is provided, which includes: a basic data acquisition module that acquires basic data of a first object in response to a virtual scene access request command for the first object; a target engagement object identification module that creates a virtual character of the first object in the virtual scene based on the basic data and acquires a target engagement object corresponding to the first object; and a target content broadcasting module that broadcasts target content in the virtual scene in response to a target content broadcasting command from the first object.

[0006] According to another aspect of the present disclosure, there is provided an electronic device comprising at least one processor and a memory communicatively connected to the at least one processor, the memory storing instructions executable by the at least one processor, the instructions being executed by the at least one processor such that the at least one processor can perform a method of an embodiment of the present disclosure.

[0007] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium having stored thereon computer instructions that cause the computer to perform a method of an embodiment of the present disclosure is provided.

[0008] According to another aspect of the present disclosure, there is provided a computer program that, when executed by a processor, implements a method of an embodiment of the present disclosure.

[0009] The virtual scene information interaction method of the present disclosure can achieve at least one of the following technical effects:

[0010] 1) By creating a virtual character of a first object in a virtual scene and obtaining a target engagement object corresponding to the first object, the virtual character can be made the existence form of the first object in the virtual environment, improving the user's engagement experience in the virtual environment and allowing the user to have more immersive data interaction in the virtual environment.

[0011] 2) By broadcasting target content in the virtual scene, the demand for broadcasting target content in the virtual scene and conducting data interaction can be met, the application coverage of data interaction based on the virtual scene can be expanded, and the user's sense of realism and immersion based on the virtual scene can be improved, and the efficiency of information interaction is higher.

[0012] It should be understood that the contents described in this section are not intended to depict key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood from the following description. [Brief explanation of the drawings]

[0013] Here, the drawings are used to better understand the invention of the present disclosure and are not intended to limit the present disclosure.

[0014] [Figure 1A] FIG. 1A is a schematic diagram illustrating a system architecture of a virtual scene information interaction method and apparatus according to one embodiment of the present disclosure. [Figure 1B] FIG. 1B is a schematic diagram illustrating a system architecture of a virtual scene information interaction method and apparatus according to another embodiment of the present disclosure. [Figure 2] FIG. 2 is a flow chart schematically illustrating a virtual scene information interaction method according to an embodiment of the present disclosure. [Figure 3]FIG. 3 is a schematic diagram illustrating a virtual scene information interaction method according to an embodiment of the present disclosure. [Figure 4] FIG. 4 is a schematic diagram illustrating broadcasting target content in a virtual scene according to one embodiment of the present disclosure. [Figure 5] FIG. 5 is a schematic diagram illustrating a virtual scene information interaction method according to another embodiment of the present disclosure. [Figure 6] FIG. 6 is a schematic diagram illustrating a system architecture corresponding to applying a virtual scene information interaction method to a virtual meeting scene according to an embodiment of the present disclosure. [Figure 7] FIG. 7 is a block diagram illustrating a virtual scene information interaction device according to an embodiment of the present disclosure. [Figure 8] FIG. 8 is a block diagram schematically illustrating an electronic device capable of implementing the virtual scene information interaction method according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, exemplary embodiments of the present disclosure will be described with reference to the drawings. Hereinafter, various details of the embodiments of the present disclosure are included for ease of understanding, and should be considered as examples. Therefore, it should be understood that those skilled in the art can make various changes and modifications to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for clarity and conciseness, the following description will omit descriptions of well-known functions and configurations.

[0016] The terms used herein are for the purpose of describing particular embodiments only and are not intended to limit the present disclosure. As used herein, terms such as "comprises," "including," and the like indicate the presence of said features, operations, operations, and / or components, but do not exclude the presence or addition of one or more other features, operations, operations, or components.

[0017] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art. It should be noted that the terms used herein should not be construed in an idealized or overly rigid manner, but should be construed to have a meaning consistent with the context of this specification.

[0018] When expressions similar to "at least one of A, B, and C, etc." are used, they should generally be interpreted in accordance with the ordinary understanding of the meaning of such expressions by those skilled in the art (e.g., "a system having at least one of A, B, and C" should include, but is not limited to, systems having A alone, having B alone, having C alone, having A and B, having A and C, having B and C, and / or having A, B, and C).

[0019] 2. Description of the Related Art With the development of computer technology and Internet technology, many smart products provide the function of data interaction with virtual environments so as to enhance users' usage experience.

[0020] It should be understood that performing data interaction based on a virtual environment can break through the limitations of physical space, and is applicable when a user has a need for data interaction even when limited by physical space.

[0021] For example, a virtual conferencing application may provide data interaction, and in some embodiments the virtual conferencing application supports voice and video interaction.

[0022] 1A is a schematic diagram illustrating a system architecture of a method and apparatus for interacting with virtual scene information according to one embodiment of the present disclosure. FIG. 1B is a schematic diagram illustrating a system architecture of a method and apparatus for interacting with virtual scene information according to another embodiment of the present disclosure. It should be noted that the illustrations in FIGS. 1A and 1B are merely examples of applicable system architectures of the embodiments of the present disclosure, and are useful for those skilled in the art to understand the technical content of the present disclosure. However, they do not mean that the embodiments of the present disclosure cannot be applied to other devices, systems, environments, or scenes.

[0023] 1A, system architecture 100A according to the embodiment may include client sides 101A, 102A, and 103A, network 104A, and server 105A. Network 104A provides a medium for a communication link between client sides 101A, 102A, and 103A and server 105A. Network 104A may include various connection types, such as wired, wireless communication links, or fiber optic cables.

[0024] A user may use client side 101A, 102A, 103A to interact with server 105A via network 104A to receive or send messages, etc. Client side 101A, 102A, 103A may be implemented with various communication client side applications, such as, for example, a virtual environment-based data interaction application, a shopping application, a web browser application, a search application, a real-time communication tool, a mailbox client, and social platform software (by way of example only).

[0025] The client devices 101A, 102A, and 103A may be various electronic devices equipped with a display screen and supporting web browsing, including, but not limited to, smartphones, tablet computers, laptop computers, and desktop computers. The client devices 101A, 102A, and 103A of the embodiments of the present disclosure may, for example, execute application programs.

[0026] Server 105A may be any type of server that provides any type of service, such as a background management server (for example only) that supports sites browsed by users using clients 101A, 102A, and 103A. The background management server may perform processing such as analyzing data such as received user requests, and feed back the processing results (e.g., web pages, information, or data obtained or generated in response to the user requests) to the client. Server 105A may also be a cloud server, i.e., server 105A has cloud computing capabilities.

[0027] It should be noted that the virtual scene information interaction method provided by the embodiments of the present disclosure may be executed by the server 105A. Conversely, the virtual scene information interaction device provided by the embodiments of the present disclosure may be installed in the server 105A. The virtual scene information interaction method provided by the embodiments of the present disclosure may be executed by a server or server cluster that can communicate with the client side 101A, 102A, 103A and / or the server 105A, different from the server 105A. Conversely, the virtual scene information interaction device provided by the embodiments of the present disclosure may be installed in a server or server cluster that can communicate with the client side 101A, 102A, 103A and / or the server 105A, different from the server 105A.

[0028] In one example, the server 105A receives at least one of a virtual scene access request command, a target content broadcast command, a position adjustment command, and a character adjustment operation command from the client side 101A, 102A, 103A via the network 104A.

[0029] As shown in FIG. 1B, a system architecture 100B according to another embodiment of the present disclosure may include client sides 101B, 102B, 103B, a network 104B, a signaling server 105B, a first media server 106B, a second media server 107B, and a user management server 108B.

[0030] Unlike system architecture 100A, system architecture 100B of an embodiment of the present disclosure has a signaling server 105B that coordinates communication between each client side, a first media server 106B that processes media streams for users of each client side, a second media server 107B that may store and process media files for broadcast, and a user management server 108B that manages user data for each client side.

[0031] It should be understood that the number of client sides, networks and servers in Figures 1A and 1B are merely examples, and any number of client sides, networks and servers may be provided according to actual needs.

[0032] It should be noted that in the invention disclosed herein, the collection, storage, use, processing, transmission, provision, disclosure, and other processing of such user personal information shall all comply with the provisions of relevant laws and regulations and shall not be contrary to public order and morals.

[0033] In the presently disclosed invention, before obtaining or collecting personal information of users, authorization or consent of the users is obtained.

[0034] An embodiment of the present disclosure provides a virtual scene information interaction method. Hereinafter, the virtual scene information interaction method of an exemplary embodiment of the present disclosure will be described with reference to FIGS. 2 to 6 in combination with the system architecture of FIGS. 1A and 1B. The virtual scene information interaction method of an embodiment of the present disclosure is executed, for example, by the server 105A shown in FIG. 1A.

[0035] FIG. 2 is a flow chart schematically illustrating a virtual scene information interaction method according to an embodiment of the present disclosure.

[0036] As shown in FIG. 2, the virtual scene information interaction method 200 of the embodiment of the present disclosure includes, for example, operations S210 to S230.

[0037] In operation S210, a virtual scene access request command for a first object is responded to to obtain basic data of the first object.

[0038] A virtual scene may be understood as a virtual reality of a scene. Virtual reality, i.e., the creation of a simulated virtual scene using a computer, can give a user an immersive feeling in the scene.

[0039] The base data may include data necessary to access the virtual scene and other data related to the function of the virtual scene. For example, the data necessary to access the virtual scene may include sign data of the virtual scene and sign data of a first object. If the virtual scene has a function to display a virtual character, the base data may include virtual character data, and the virtual character data may be used to create a virtual character in the virtual scene.

[0040] In operation S220, a virtual character of a first object is created in a virtual scene based on the basic data, and a target involvement object corresponding to the first object is obtained.

[0041] A target engagement object may be understood to be a first object that engages in a virtual environment and maps onto a virtual character.

[0042] In operation S230, in response to a target content broadcast command from the first subject, the target content is broadcast in the virtual scene.

[0043] When performing data interaction based on a virtual scene, there are cases where some target contents are further involved, for example, the virtual scene is a scene of a virtual conference, the purpose of a virtual conference is to exhibit a certain product to the participants involved in the virtual conference, and the specific form of the exhibition is to broadcast a promotional video for the product, where the promotional video is the target content.

[0044] The virtual scene information interaction method of the embodiment of the present disclosure creates a virtual character of a first object in a virtual scene and obtains a target engagement object corresponding to the first object, thereby making the virtual character the first object's existence form in the virtual environment, improving the user's engagement experience in the virtual environment and allowing the user to engage in more immersive data interaction in the virtual environment.The virtual scene information interaction method of the embodiment of the present disclosure broadcasts target content in the virtual scene, thereby meeting the demand for broadcasting target content in the virtual scene for data interaction, expanding the application coverage of data interaction based on the virtual scene, improving the user's sense of realism and immersion based on the virtual scene, and achieving higher efficiency of information interaction.

[0045] FIG. 3 is a schematic diagram illustrating a virtual scene information interaction method 300 according to another embodiment of the present disclosure.

[0046] As shown in FIG. 3, a virtual scene information interaction method 300 according to an embodiment of the present disclosure may include operations S310 to S330.

[0047] In operation S310, a virtual scene access request command for the first object is responded to to obtain basic data of the first object. For example, the client side C3 may generate a virtual scene access request command for the first object.

[0048] In operation S320, a virtual character of a first object is created in a virtual scene based on the basic data, and a target engagement object corresponding to the first object is obtained.

[0049] In operation S330, in response to the targeted content broadcast command from the first subject, the targeted content is broadcast in the virtual scene. For example, the client side C3 may generate the targeted content broadcast command for the first subject.

[0050] FIG. 3 is a schematic example showing that the execution subject of operations S310 to S330 is the server side S3.

[0051] FIG. 4 is a schematic diagram illustrating broadcasting target content in a virtual scene in a virtual scene information interaction method according to another embodiment of the present disclosure.

[0052] According to another embodiment of the present disclosure, the following embodiment can be used to realize a specific example of broadcasting target content in a virtual scene in response to a target content broadcast command from a first target in the virtual scene information interaction method. The virtual scene may be generated according to virtual scene data. The virtual scene data may include virtual broadcast device data.

[0053] 4, in operation S431, target content data is obtained in response to a target content broadcast command from a first target. For example, the client side C4 may generate a target content broadcast command for the first target.

[0054] The targeted content data may be located on a server side S42, which may include, for example, the second media server 107B described above.

[0055] As shown in FIG. 4, before responding to the target content broadcast command from the first subject and obtaining the target content, the server side S42 may identify the target content data.

[0056] In operation S432, the target content is broadcast by the virtual broadcasting equipment.

[0057] Virtual broadcast equipment is generated based on the virtual broadcast equipment data, and targeted content is generated based on the targeted content data.

[0058] Illustratively, the virtual broadcasting equipment may include at least one of a video broadcasting equipment, an audio broadcasting equipment, and a text broadcasting equipment. For example, the virtual broadcasting equipment may be a virtual projection equipment, a virtual display screen, etc.

[0059] According to the virtual scene information interaction method of the embodiment of the present disclosure, by obtaining target content data and broadcasting the target content using virtual broadcasting equipment, it is possible to simulate broadcasting the target content using broadcasting equipment in a real scene, thereby meeting the demand for broadcasting target content in a virtual scene for data interaction, improving the user's sense of realism and immersion in the virtual scene, and improving the efficiency of information interaction. For example, the target content may include a live broadcast video of a product launch, and by accessing a virtual conference and broadcasting the live broadcast video of the launch using a virtual display screen in the virtual conference, participants in the virtual conference can gather and watch the live broadcast video of the launch synchronously, for example, to discuss the live broadcast video of the launch, thereby improving the efficiency of the conference.

[0060] Illustratively, a virtual scene information interaction method according to another embodiment of the present disclosure may further include the following operations: Also, the virtual scene may include at least one participating object, and the basic data may further include location data.

[0061] Based on the position data, the participating object identifies its position coordinates in the virtual scene.

[0062] Virtual scene map data is identified based on the virtual scene data and the position coordinates of the participating objects in the virtual scene.

[0063] Send the virtual scene map data to the interested parties.

[0064] According to the virtual scene information interaction method of the embodiment of the present disclosure, virtual scene map data can be identified by the position coordinates of the participating object in the virtual scene, allowing the participating object to locate its own position in the virtual environment, and further, the virtual scene map data can also be used to identify the positions of other participating objects, improving the user experience.

[0065] FIG. 5 is a schematic diagram illustrating data interaction according to an embodiment of the present disclosure.

[0066] 5 shows six involved subjects, including involved subject User_A, involved subject User_B, involved subject User_C, involved subject User_D, involved subject User_E, and involved subject User_F. Here, the position coordinates of involved subject User_A are Pos(Xa,Ya,Za), the position coordinates of involved subject User_B are Pos(Xb,Yb,Zb), the position coordinates of involved subject User_C are Pos(Xc,Yc,Zc), the position coordinates of involved subject User_D are Pos(Xd,Yd,Zd), the position coordinates of involved subject User_E are Pos(Xe,Ye,Ze), and the position coordinates of involved subject User_F are Pos(Xf,Yf,Zf).

[0067] FIG. 5 further schematically shows a virtual broadcast device B, a conference table D, and a virtual scene map Ma.

[0068] 5, the interface of the live broadcast stream media service may be invoked to broadcast the live broadcast video by the virtual broadcast equipment B, and the target content is the live broadcast video. The live broadcast stream media service may be provided by, for example, the above-mentioned second media server 107B.

[0069] 5, for example, the target engagement target User_F may be an engagement target, and the target engagement target may deliver an audio stream through a real-time streaming media service or subscribe to the audio stream of the audio interaction target through the real-time streaming media service. The real-time streaming media service may be provided by, for example, the first media server 106B.

[0070] In the example of Figure 5, communication between the participants may be supported by a real-time communication signaling service, which may be provided, for example, by signaling server 105B as described above.

[0071] Illustratively, the virtual scene information interaction method according to another embodiment of the present disclosure may further include the following operations:

[0072] In response to a position adjustment command for the first object, adjust the position coordinates of the target-involved object based on the position adjustment data of the first object, and obtain the adjusted position coordinates of the target-involved object.

[0073] For example, a position adjustment trigger window may be set up on the display screen of the client side, and a position adjustment command for the first object may be generated by, for example, a click trigger.

[0074] The position adjustment data may include an adjustment direction and a number of adjustment units based on the adjustment direction.

[0075] The virtual scene map data is updated based on at least one of the position update frequency and the adjusted position coordinates.

[0076] The position update frequency may be understood as a predetermined frequency for updating the position coordinates, and may be determined according to the sensitivity requirement of the virtual scene. For example, when the sensitivity requirement of the virtual scene is high, the position update frequency may be 0.2 seconds / time, and when the sensitivity requirement of the virtual scene is low, the position update frequency may be 1 second / time.

[0077] Updating the virtual scene map data based on the adjusted position coordinates may be understood as adjusting the position coordinates of the target participation object in the virtual scene map data to the adjusted position coordinates after the position of the target participation object is adjusted.

[0078] The virtual scene information interaction method of the embodiment of the present disclosure supports adjusting the position coordinates of the target participating object, and further updates the virtual scene map data so that the virtual scene map data can adapt to the position adjustment of the target participating object, allowing the target participating object to accurately determine its own position and its relative position with other participating objects, improving the user experience.

[0079] Illustratively, according to another embodiment of the present disclosure, the engagement object may include a target engagement object and at least one reference engagement object. The virtual scene information interaction method may further include the following operations:

[0080] Identifying a voice interaction participant of the target participant based on the voice interaction range threshold and the position coordinates of the participant.

[0081] For example, for a target participation object, if the position coordinates of the participation object are within a voice interaction range threshold, the participation object may be identified as one voice interaction participation object of the target participation object.

[0082] Subscribe to the voice interaction participant's audio stream to the target participant.

[0083] After the target participant subscribes to the voice stream of the voice interaction participant, the target participant may receive the voice stream emitted by the voice interaction participant.

[0084] As can be understood, in a real scene, if the distance between multiple participants involved in the real scene is within a certain range threshold, the participants can receive each other's voice.

[0085] The data interaction method of the embodiment of the present disclosure can identify the voice interaction participation object of the target participation object based on the voice interaction range threshold and the position coordinates of the participation object, subscribe the voice stream of the voice interaction participation object to the target participation object, simulate the voice effect in the actual scene, and improve the user's immersion in the virtual scene.

[0086] Illustratively, a virtual scene information interaction method according to an embodiment of the present disclosure may include the following operations.

[0087] In response to the location coordinates of the voice interaction participant exceeding the voice interaction range threshold, an invalid voice interaction participant is identified.

[0088] Cancels the subscription of the disabled voice interaction participant to the target participant's voice stream.

[0089] A voice interaction participant is a participant whose location coordinates are within the voice interaction range threshold. For example, if the location coordinates of a participant are adjusted and the adjusted location coordinates exceed the voice interaction range threshold, the voice interaction participant does not meet the conditions for the target participant to subscribe to its voice stream, and the voice interaction participant becomes an invalid voice interaction participant. This allows the target participant to cancel the subscription of the invalid voice interaction participant's voice stream. After the target participant cancels the subscription of the invalid voice interaction participant's voice stream, the target participant will no longer receive the voice stream from the invalid voice interaction participant.

[0090] The data interaction method of the embodiment of the present disclosure can dynamically identify invalid voice interaction participation objects of a target participation object based on the voice interaction range threshold and the position coordinates of the voice participation object, adaptively cancel the subscription of its voice stream, simulate the voice effect in the actual scene, and improve the user's immersion in the virtual scene.

[0091] Illustratively, the virtual scene information interaction method according to the embodiment of the present disclosure may further include the following operations:

[0092] Based on the position coordinates of the target participant and the position coordinates of the voice interaction participant, relative position data of the voice interaction participant with respect to the target participant is determined.

[0093] Based on the relative position data, at least one of a mixing process and a two-channel process is performed on the voice stream of the voice interaction participant to obtain a target voice stream of the voice interaction participant.

[0094] The mixing process may align multi-channel audio into a single channel of audio. For example, a virtual environment may include a target participant and multiple voice interaction participants, and the target participant receives the voice streams of each voice interaction participant at the same time. Furthermore, the relative positions of each voice interaction participant and the target participant may also result in differences in the voice streams received by the target participant. For example, if the target participant and voice interaction participant User_G are close relative to each other and the target participant and voice interaction participant User_H are far relative to each other, the voice stream of voice interaction participant User_G received by the target participant will have low attenuation, while the voice stream of voice interaction participant User_H received by the target participant will have high attenuation.

[0095] The virtual scene information interaction method of the embodiment of the present disclosure performs at least one of mixing processing and two-channel processing on the audio stream of the audio interaction target, thereby making the audio stream of the audio interaction target more three-dimensional, improving the audio effect of the audio stream of the audio interaction target, and enhancing the user's immersive experience of the virtual scene.

[0096] Exemplarily, a virtual scene information interaction method according to an embodiment of the present disclosure may further include adjusting a virtual character of the first target in response to a character adjustment operation command for the first target, where the character adjustment operation command includes at least one of a gender adjustment operation command, a clothing adjustment operation command, a facial expression adjustment operation command, and a torso movement adjustment operation command.

[0097] For example, a character adjustment trigger window may be set on the display screen of the client side, and a character adjustment operation command for the first target may be generated by, for example, a click trigger.

[0098] According to the virtual scene information interaction method of the embodiment of the present disclosure, the virtual character for the first object can be adjusted to meet the needs of character adjustment, and an unusual and interesting usage experience can be provided.

[0099] For example, in the virtual scene information interaction method according to the embodiment of the present disclosure, the virtual scene data may include at least one of virtual conference scene data, virtual showroom scene data, and virtual hall scene data, and the target content data may include at least one of audio data, text data, and live broadcast video data.

[0100] For example, a virtual conference scene may be generated based on the virtual conference scene data, and the virtual conference scene may include, for example, a conference table, etc. A virtual showroom scene may be generated based on the virtual showroom scene data, and the virtual showroom scene may include, for example, a show platform, etc. A virtual conference hall scene may be generated based on the virtual hall scene data, and the virtual conference hall scene may include, for example, a hall venue, etc.

[0101] The virtual scene information interaction method of the embodiment of the present disclosure generates a corresponding type of virtual scene according to a corresponding type of virtual scene data, thereby covering various types of virtual scenes, and further covers the needs of broadcasting various types of target content according to a corresponding type of target content data, thereby improving the user's sense of realism and immersion based on the virtual scene.

[0102] 6 is a schematic diagram illustrating a system architecture corresponding to the application of the virtual scene information interaction method according to the embodiment of the present disclosure to a virtual meeting scene. Hereinafter, the virtual scene information interaction method according to the embodiment of the present disclosure will be described from the system architecture layer with reference to FIG. 6.

[0103] As shown in FIG. 6, the system architecture of the virtual scene information interaction method according to the embodiment of the present disclosure includes a virtual meeting scene business logic layer L1 and a virtual engine layer L2.

[0104] The virtual engine layer L2 may include a basic framework Fr, a virtual core Co, a real-time voice communication module M1, and a media broadcasting module M2.

[0105] The virtual core may provide functions such as virtual character creation, virtual scene generation, virtual character facial expression management, and virtual character body movement management. The virtual core may also include a special effects module, a rendering module, a graphics module, an input system, a management system, and an audio system.

[0106] For example, the virtual core may provide a function of virtual character creation to create a virtual character of a first subject in a virtual scene and obtain a target engagement subject corresponding to the first subject. Further, the virtual core may provide a function of virtual character facial expression management and a function of virtual character torso movement management to adjust the virtual character of the first subject.

[0107] The real-time voice communication module may provide functions of multi-party voice calls and spatial audio effects, and may include a conversation management unit, a voice collection unit, a pulse coding modulation unit, a voice transmission unit, and a spatial audio mixing unit.

[0108] For example, the real-time voice communication module may subscribe a target participant to a voice stream of a voice interaction participant, and may cancel a target participant's subscription to a voice stream of an inactive voice interaction participant.

[0109] The media broadcasting module may provide a free stream broadcasting function for multimedia users to broadcast live and request media streams in the virtual scene.

[0110] For example, the media broadcasting module may broadcast targeted content in a virtual scene.

[0111] The foundation framework may provide a business layer development interface for the virtual engine layer. The foundation framework layer packages the virtual core, the real-time voice communication module, and the media broadcasting interface, and provides some basic functions for developing virtual scenes. The basic functions include, for example, resource management functions, message management functions, user interface frameworks, network frameworks, and hot update functions.

[0112] In the example of Figure 6, the virtual scene is a virtual conference scene, and the business logic layer of the system architecture is a virtual conference function implementation based on the virtual engine interface, which mainly includes a scene map function unit U1, a virtual character function unit U2, a virtual conference scene function unit U3, a conference control function unit U4, and a media broadcasting function unit U5.

[0113] The scene map functional unit provides functionality for generating thumbnails based on a virtual conference scene model and locations of objects of interest, which may for example locate a given conference hall or other object of interest through the scene map.

[0114] The virtual character function unit provides a function for realizing a virtual character based on a virtual engine, and may customize, for example, hairstyle, clothing, gender, style, etc.

[0115] The virtual meeting scene function unit provides the function of generating a virtual meeting scene based on the virtual engine, which may include, for example, a round table meeting and a tea ceremony, and may generate a multimedia meeting room.

[0116] The conference control function unit is a conference control and management unit, which may provide normal conference communication and management functions such as room setup, participant access management, media publishing / subscription, media subscription life broadcast / request, and room cancellation.

[0117] The media broadcasting function unit may provide live broadcasting of stream media in the multimedia venue and may receive calls from the conference control function unit.

[0118] FIG. 7 is a block diagram illustrating a virtual scene information interaction device according to an embodiment of the present disclosure.

[0119] As shown in FIG. 7, the virtual scene information interaction apparatus 700 of the embodiment of the present disclosure includes, for example, a basic data acquisition module 710, a target engagement object identification module 720, and a target content broadcasting module 730.

[0120] The basic data acquisition module 710 acquires basic data of the first object in response to a virtual scene access request command for the first object.

[0121] The target engagement object identification module 720 creates a virtual character of the first object in the virtual scene based on the underlying data, and obtains a target engagement object corresponding to the first object.

[0122] The targeted content broadcast module 730 broadcasts targeted content in the virtual scene in response to a targeted content broadcast command from the first subject.

[0123] According to the virtual scene information interaction device of the embodiment of the present disclosure, the virtual scene is generated based on virtual scene data, the virtual scene data includes virtual broadcasting equipment data, and the target content broadcasting module may include a target content acquisition sub-module and a target content broadcasting sub-module.

[0124] The targeted content acquisition sub-module may acquire targeted content data in response to a targeted content broadcast command from a first subject.

[0125] The targeted content broadcasting submodule broadcasts the targeted content generated based on the targeted content data by a virtual broadcasting device generated based on the virtual broadcasting device data.

[0126] According to an embodiment of the present disclosure, the virtual scene includes at least one engagement object, the basic data further includes location data, and the virtual scene information interaction device may further include a location coordinate identification module, a virtual scene map data identification module, and a virtual scene map data transmission module.

[0127] The position coordinate determination module may determine position coordinates in the virtual scene of the object of interest based on the position data.

[0128] The virtual scene map data identification module may identify the virtual scene map data based on the virtual scene data and the position coordinates of the participating object in the virtual scene.

[0129] The virtual scene map data transmission module may transmit the virtual scene map data to the participating entities.

[0130] According to the virtual scene information interaction device of the embodiment of the present disclosure, it may further include an adjustment position coordinate identifying module and a virtual scene map data updating module.

[0131] The adjustment position coordinate identification module may respond to a position adjustment command for the first object, adjust the position coordinates of the target involved object based on the position adjustment data of the first object, and obtain the adjusted position coordinates of the target involved object.

[0132] The virtual scene map data update module may update the virtual scene map data based on at least one of the position update frequency and the adjusted position coordinates.

[0133] According to an embodiment of the present disclosure, the engagement object may include a target engagement object and at least one reference engagement object, and the virtual scene information interaction device may further include an audio interaction engagement object identification module and an audio stream subscription module.

[0134] The voice interaction involvement identification module may identify a voice interaction involvement of the target involvement based on the voice interaction range threshold and the location coordinates of the involvement.

[0135] The audio stream subscription module may subscribe to an audio stream of an audio interaction participation object to a target participation object.

[0136] The virtual scene information interaction device according to the embodiment of the present disclosure may further include an invalid voice interaction participation target identification module and an audio stream subscription cancellation module.

[0137] The invalid voice interaction participant identification module may identify the invalid voice interaction participant in response to the position coordinates of the voice interaction participant exceeding the voice interaction range threshold.

[0138] The audio stream subscription cancellation module may cancel the subscription of the audio stream of the disabled audio interaction participation object to the target participation object.

[0139] According to the virtual scene information interaction device of the embodiment of the present disclosure, it may further include a relative position data identification module and a target audio stream identification module.

[0140] The relative position data determination module may determine relative position data of the voice interaction participation object relative to the target participation object based on the position coordinates of the target participation object and the position coordinates of the voice interaction participation object.

[0141] The target audio stream identification module may perform at least one of mixing processing and two-channel processing on the audio stream of the audio interaction participant based on the relative position data to obtain the target audio stream of the audio interaction participant.

[0142] According to the virtual scene information interaction device of the embodiment of the present disclosure, the device may further include a virtual character adjustment module that adjusts the virtual character of the first object in response to a character adjustment operation command for the first object, where the character adjustment operation command includes at least one of a gender adjustment operation command, a clothing adjustment operation command, a facial expression adjustment operation command, and a torso movement adjustment operation command.

[0143] According to the virtual scene information interaction device of an embodiment of the present disclosure, the virtual scene data includes at least one of virtual conference scene data, virtual showroom scene data, and virtual hall scene data, and the target content data includes at least one of audio data, text data, and live broadcast video data.

[0144] It should be understood that some embodiments of the apparatus of the present disclosure are correspondingly the same or similar to some embodiments of the method of the present disclosure, and the technical problems solved and technical effects achieved are also correspondingly the same or similar, and will not be recited here.

[0145] According to an embodiment of the present disclosure, an electronic device, a readable storage medium, and a computer program are further provided.

[0146] 8 is a block diagram that schematically illustrates an example electronic device 800 in which embodiments of the present disclosure can be implemented. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, mobile phones, smartphones, wearable devices, and other similar computing devices. The components, their connections and relationships, and their functions illustrated herein are merely exemplary and do not limit the implementation of the present disclosure as described and / or claimed herein.

[0147] 8, the electronic device 800 includes an arithmetic unit 801, which may perform various appropriate operations and processes based on a computer program stored in a read-only memory (ROM) 802 or loaded from a storage unit 808 into a random access memory (RAM) 803. The RAM 803 may further store various programs and data necessary for the operation of the electronic device 800. The arithmetic unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output interface 805 is also connected to the bus 804.

[0148] Multiple components in the electronic device 800 are connected to an I / O interface 805, including an input unit 806 such as a keyboard, a mouse, etc., an output unit 807 such as various types of displays, speakers, etc., a storage unit 808 such as a magnetic disk, an optical disk, etc., and a communication unit 809 such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 enables the electronic device 800 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0149] The computing unit 801 may be various general-purpose and / or specialized processing modules having processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, computing units running various operational machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 executes the methods and processes described above, such as the virtual scene information interaction method. For example, in some embodiments, the virtual scene information interaction method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 808. In some embodiments, some or all of the computer program may be loaded and / or installed into the electronic device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, it may perform one or more operations of the virtual scene information interaction method described above. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the virtual scene information interaction method in any other suitable manner (eg, via firmware).

[0150] Various embodiments of the systems and techniques described herein may be implemented in digital electronic circuitry systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may be embodied in one or more computer programs that can be executed and / or interpreted by a programmable system that includes at least one programmable processor, which may be a special purpose or general purpose programmable processor, and that can receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0151] Program codes for implementing the methods of the present disclosure may be written in any combination of one or more languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus, so that when the program code is executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are performed. The program code may be executed entirely on a device, partially on a device, partially on a device as a separate software package and partially on a remote device, or entirely on a remote device or server.

[0152] In the context of this disclosure, a machine-readable medium may be a tangible medium, and may contain or store a program for use in or in connection with an instruction execution system, device, or electronic device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or electronic device, or any suitable combination of the above. More specific examples of machine-readable storage media include an electrical connection of one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0153] To provide for user interaction, a computer may implement the systems and techniques described herein and include a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user, and a keyboard and pointing device (e.g., a mouse or trackball) through which a user can provide input to the computer. Other types of devices may also provide for user interaction; for example, the feedback provided to the user may be any form of sensing feedback (e.g., visual feedback, auditory feedback, or tactile feedback) and may receive input from the user in any form (including voice input, audio input, or tactile input).

[0154] The systems and techniques described herein can be implemented in a computing system including background components (e.g., a data server), or middleware components (e.g., an application server), or front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with embodiments of the systems and techniques described herein), or any combination of such background, middleware, or front-end components. The components of the system can be connected to each other by any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include, by way of example, a local area network (LAN), a wide area network (WAN), and the Internet.

[0155] A computer system may include clients and servers. Clients and servers are generally remote and typically interact through a communication network. The relationship of client and server is created by computer programs running on the corresponding computers and having the client-server relationship.

[0156] It should be understood that various forms of flow shown above may be used, and operations may be rearranged, added, or deleted. For example, the operations described in the present invention may be performed in parallel, sequentially, or in a different order, as long as the desired results of the presently disclosed invention are achieved, and the present specification is not limited thereto.

[0157] The above specific embodiments do not limit the scope of protection of the present disclosure. It should be understood that those skilled in the art can make various modifications, combinations, subcombinations, and substitutions according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principle of the present disclosure should be included within the scope of protection of the present disclosure.

Claims

1. Responding to a virtual scene access request command for a first object, obtaining basic data of the first object; creating a virtual character of the first object in a virtual scene based on the basic data, and obtaining a target engagement object corresponding to the first object; and broadcasting target content in the virtual scene in response to a target content broadcast command from the first subject. Virtual scene information interaction method.

2. 10. The method of claim 1, the virtual scene is generated based on virtual scene data including virtual broadcast equipment data; broadcasting target content in the virtual scene in response to a target content broadcast command from the first subject, obtaining targeted content data in response to a targeted content broadcast command from the first subject; broadcasting the target content generated based on the target content data by a virtual broadcast device generated based on the virtual broadcast device data.

3. 10. The method of claim 1, the virtual scene includes at least one object of interest; The basic data further includes location data; The virtual scene information interaction method includes: determining a position coordinate of the object of interest in the virtual scene based on the position data; determining virtual scene map data based on the virtual scene data and position coordinates of the participating object in the virtual scene; and transmitting the virtual scene map data to the participating object.

4. 4. The method of claim 3, In response to a position adjustment command for the first object, adjust the position coordinates of the target-contributing object based on position adjustment data of the first object, and obtain adjusted position coordinates of the target-contributing object; updating the virtual scene map data based on at least one of a position update frequency and the adjusted position coordinates.

5. 5. The method of claim 4, The interest includes the target interest and at least one reference interest; The virtual scene information interaction method includes: Identifying a voice interaction participation object of the target participation object based on a voice interaction range threshold and the location coordinates of the participation object; The virtual scene information interaction method further includes subscribing to the target participation object an audio stream of the audio interaction participation object.

6. 6. The method of claim 5, identifying an invalid voice interaction participant in response to the location coordinate of the voice interaction participant exceeding the voice interaction range threshold; The virtual scene information interaction method further includes canceling the subscription of the disabled voice interaction participation object to the voice stream of the target participation object.

7. 4. The method of claim 3, Identifying relative position data of the voice interaction participant with respect to the target participant based on the position coordinates of the target participant and the position coordinates of the voice interaction participant; The virtual scene information interaction method further includes performing at least one of mixing processing and two-channel processing on the audio stream of the audio interaction participant based on the relative position data to obtain a target audio stream of the audio interaction participant.

8. The method according to any one of claims 1 to 7, adjusting a virtual character of the first target in response to a character adjustment operation command for the first target; The character adjustment operation command includes at least one of a gender adjustment operation command, a clothing adjustment operation command, a facial expression adjustment operation command, and a body movement adjustment operation command.

9. 3. The method of claim 2, the virtual scene data includes at least one of virtual conference scene data, virtual showroom scene data, and virtual hall scene data; The virtual scene information interaction method, wherein the target content data includes at least one of audio data, text data, and live broadcast video data.

10. a basic data acquisition module that acquires basic data of a first object in response to a virtual scene access request command for the first object; a target involvement object identification module that generates a virtual character of the first object in a virtual scene based on the basic data, and obtains a target involvement object corresponding to the first object; a target content broadcasting module for broadcasting target content in the virtual scene in response to a target content broadcasting command from the first subject.

11. 11. The apparatus of claim 10, the virtual scene is generated based on virtual scene data including virtual broadcast equipment data; The targeted content broadcasting module includes: a target content acquisition sub-module for acquiring target content data in response to a target content broadcast command from the first subject; a target content broadcasting submodule for broadcasting the target content generated based on the target content data by a virtual broadcasting device generated based on the virtual broadcasting device data.

12. 11. The apparatus of claim 10, the virtual scene includes at least one object of interest; The basic data further includes location data; The virtual scene information interaction device comprises: a position coordinate determination module that determines position coordinates of the participating object in the virtual scene based on the position data; a virtual scene map data identification module that identifies virtual scene map data based on the virtual scene data and the position coordinates of the participating object in the virtual scene; a virtual scene map data transmission module for transmitting the virtual scene map data to the participating object.

13. 13. The apparatus of claim 12, an adjusted position coordinate identification module that responds to a position adjustment command for the first object, adjusts the position coordinates of the target-involved object based on position adjustment data of the first object, and obtains adjusted position coordinates of the target-involved object; a virtual scene map data update module that updates the virtual scene map data based on at least one of a position update frequency and the adjusted position coordinates.

14. 14. The apparatus of claim 13, The interest includes the target interest and at least one reference interest; The virtual scene information interaction device comprises: a voice interaction involvement target identification module that identifies a voice interaction involvement target of the target involvement target based on a voice interaction range threshold and the location coordinates of the involvement target; The virtual scene information interaction device further includes: an audio stream subscribing module for subscribing the audio stream of the audio interaction participation object to the target participation object.

15. 15. The apparatus of claim 14, an invalid voice interaction participant identification module that identifies an invalid voice interaction participant in response to the location coordinates of the voice interaction participant exceeding the voice interaction range threshold; The virtual scene information interaction device further includes: an audio stream subscription cancellation module for canceling the subscription of the audio stream of the disabled audio interaction participation object to the target participation object.

16. 13. The apparatus of claim 12, a relative position data determining module for determining relative position data of the voice interaction participant relative to the target participant based on the position coordinates of the target participant and the position coordinates of the voice interaction participant; The virtual scene information interaction device further includes a target audio stream identification module that performs at least one of mixing processing and two-channel processing on the audio stream of the audio interaction participant based on the relative position data, and obtains a target audio stream of the audio interaction participant.

17. 17. The device according to any one of claims 10 to 16, a virtual character adjustment module that adjusts a virtual character of the first target in response to a character adjustment operation command for the first target; The character adjustment operation command includes at least one of a gender adjustment operation command, a clothing adjustment operation command, a facial expression adjustment operation command, and a body movement adjustment operation command.

18. 12. The apparatus of claim 11, the virtual scene data includes at least one of virtual conference scene data, virtual showroom scene data, and virtual hall scene data; The virtual scene information interaction device, wherein the target content data includes at least one of audio data, text data, and live broadcast video data.

19. at least one processor; a memory communicatively coupled to the at least one processor; the memory storing instructions executable by the at least one processor; An electronic device, wherein the instructions are executed by at least one processor such that the at least one processor can perform the method of any one of claims 1 to 9.

20. A non-transitory computer-readable storage medium having computer instructions stored thereon, comprising: A storage medium having computer instructions that cause a computer to perform the method of any one of claims 1 to 9.

21. A computer program which, when executed by a processor, implements the method according to any one of claims 1 to 9.

Images