Data processing method, device, electronic device and storage medium

Abstract

The present disclosure provides a data processing method, device, electronic device, and storage medium, which relate to the field of computer technology, and in particular to the field of virtual reality technology. The implementation scheme is as follows: for each of at least one second user, in response to determining that the height of the second user's handle exceeds the height of the second user's head-mounted display device by a value not less than a first preset value, determining that the second user has applied for speaking permission; and displaying an identifier corresponding to each of the one or more second users among the at least one second user who have applied for speaking permission on the head-mounted display device of the first user, the identifier indicating that the second user has applied for speaking permission, so that the first user selects a target user from the one or more second users based on the one or more identifiers corresponding to the one or more second users, to allow the target user to have speaking permission.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, in particular to the field of virtual reality technology, and specifically to a data processing method, device, electronic device, computer-readable storage medium, and computer program product. Background Art

[0002] Virtual Reality (VR) technology helps people experience more realistic visuals on screen by displaying images in 3D. Currently, VR technology is widely used in gaming, movie watching, conferencing, and other scenarios, allowing people to obtain a more realistic and immersive user experience.

[0003] The approaches described in this section are not necessarily approaches that have been previously conceived or employed. Unless otherwise indicated, it should not be assumed that any approach described in this section is prior art simply by virtue of its inclusion in this section. Similarly, unless otherwise indicated, the issues raised in this section should not be considered as having been recognized in any prior art. Summary of the Invention

[0004] The present disclosure provides a data processing method, apparatus, electronic device, computer-readable storage medium, and computer program product.

[0005] According to one aspect of the present disclosure, a data processing method applied to a virtual reality-based conference scene is provided, wherein the conference scene includes a first user who presides over the meeting and at least one second user who participates in the meeting, and each of the first user and the at least one second user wears a virtual reality device including a head-mounted display device and a handle. The method includes: for each of the at least one second user, in response to determining that the height of the second user's handle exceeds the height of the second user's head-mounted display device by a value not less than a first preset value, determining that the second user applies for speaking permission; and displaying an identifier corresponding to each of the one or more second users among the at least one second user who apply for the speaking permission on the head-mounted display device of the first user, the identifier indicating that the second user applies for the speaking permission, so that the first user selects a target user from the one or more second users based on the one or more identifiers corresponding to the one or more second users, to allow the target user to have the speaking permission.

[0006] According to another aspect of the present disclosure, a data processing device for use in a virtual reality-based conference scene is provided, wherein the conference scene includes a first user who presides over the meeting and at least one second user who participates in the meeting, and each of the first user and the at least one second user wears a virtual reality device including a head-mounted display device and a handle. The device includes: a first response unit, configured to determine, for each of the at least one second user, in response to determining that the height of the second user's handle exceeds the height of the second user's head-mounted display device by a value not less than a first preset value, that the second user applies for speaking permission; and a first display unit, configured to display an identifier corresponding to each of the one or more second users in the at least one second user who apply for the speaking permission in the head-mounted display device of the first user, the identifier indicating that the second user applies for the speaking permission, so that the first user selects a target user from the one or more second users based on the one or more identifiers corresponding to the one or more second users, to allow the target user to have the speaking permission.

[0007] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method according to an embodiment of the present disclosure.

[0008] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method according to the embodiment of the present disclosure.

[0009] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, wherein when the computer program is executed by a processor, the computer program implements the method according to the embodiment of the present disclosure.

[0010] According to one or more embodiments of the present disclosure, a virtual reality-based conference scene can be made more realistic and intelligent, thereby improving the user experience of users in the virtual reality-based conference scene.

[0011] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The accompanying drawings illustrate exemplary embodiments and constitute a part of the specification. Together with the description of the specification, they serve to explain exemplary implementation of the embodiments. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals designate similar, but not necessarily identical, elements.

[0013] Figure 1 A flow chart of a data processing method according to an embodiment of the present disclosure is shown;

[0014] Figure 2 A scene diagram showing displaying an identifier corresponding to each of the one or more second users on a head-mounted display device of a first user in a data processing method according to an embodiment of the present disclosure is shown;

[0015] Figure 3 A structural block diagram of a data processing device according to an embodiment of the present disclosure is shown; and

[0016] Figure 4 A structural block diagram of an exemplary electronic device that can be used to implement the embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0017] The following description of exemplary embodiments of the present disclosure is made in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be appreciated by those skilled in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0018] In this disclosure, unless otherwise specified, the use of terms such as "first" and "second" to describe various elements is not intended to limit the positional relationship, temporal relationship, or importance relationship of these elements. Such terms are only used to distinguish one element from another. In some examples, the first element and the second element may refer to the same instance of the element, while in some cases, based on the context of the description, they may also refer to different instances.

[0019] The terms used in the descriptions of the various examples described in this disclosure are for the purpose of describing specific examples only and are not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the element may be one or more. In addition, the term "and / or" used in this disclosure encompasses any one and all possible combinations of the listed items.

[0020] The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0021] In related technologies, when users realize a conference scene by using the virtual reality device they are wearing, they often activate a dialog box on the display interface of a head-mounted display device through the handle buttons in the virtual reality device, and click the corresponding interface in the dialog box through the handle buttons to receive the user's speaking application, allow the user to speak, and perform other operations. This operation method is relatively traditional, which makes the process of realizing the conference scene less realistic and less intelligent.

[0022] According to one aspect of the present disclosure, a data processing method for a virtual reality-based conference scenario is provided, wherein the conference scenario includes a first user hosting a conference and at least one second user participating in the conference, and each of the first user and the at least one second user wears a virtual reality device including a head-mounted display device and a handle, such as Figure 1 As shown, the data processing method 100 according to the present disclosure includes:

[0023] Step S110: For each of the at least one second user, in response to determining that the height of the second user's handle exceeds the height of the second user's head mounted display device by a value not less than a first preset value, determining that the second user applies for speaking permission; and

[0024] Step S120: Display an identifier corresponding to each of the one or more second users among the at least one second user who apply for the speaking permission in the head-mounted display device of the first user, and the identifier indicates that the second user applies for the speaking permission, so that the first user selects a target user from the one or more second users based on the one or more identifiers corresponding to the one or more second users to allow the target user to have the speaking permission.

[0025] Whether the second user applies for speaking permission is determined by ensuring that the height of the second user's handle exceeds the height of the head-mounted display device by no less than a first preset value, so that the operation of the user applying for speaking permission in the simulated conference scene simulates the action of the user raising his hand to speak in a real environment, making the operation more natural and the scene more realistic. At the same time, the first user selects a target user from one or more second users according to the identifier corresponding to each of the one or more second users who apply for speaking permission displayed in the head-mounted display device to allow the user to speak, so that the first user can directly implement the operation of allowing the second user to speak through the screen in the head-mounted display device, without using the operation handle to obtain the dialog box displaying the second user who applies for speaking, thereby improving the intelligence of the process of implementing various operations in the conference scene.

[0026] It is understood that according to the embodiments of the present disclosure, the conference scenario can be any scenario with multiple participants and a host, such as an election meeting, a discussion meeting, or a concert, and is not limited here. For example, if the conference scenario is an election meeting, the first user is the host of the election meeting, and the second user is a user participating in the election meeting. For another example, if the conference scenario is a concert, the first user is the host of the concert, and the second user is a concert audience member, etc.

[0027] In some embodiments, the head-mounted display device may be any display device worn in the form of glasses, and is not limited here.

[0028] In some embodiments, the handle may be any device that can be grasped by the first user or the second user, and is not limited herein.

[0029] In some embodiments, the virtual reality devices of the first user and each second user are communicatively connected to each other, so that the virtual image corresponding to each second user is displayed in the head-mounted display device of the first user, and similarly, the virtual image corresponding to the other second users and the first user is displayed in the head-mounted display device of each second user.

[0030] In some embodiments, the virtual reality device of the first user and each second user is directly connected in communication; so that the virtual display device of the first user can execute the data processing method according to the present disclosure.

[0031] In other embodiments, the first user and each second user are connected to each other through an intermediate device, so that the intermediate device can implement the data processing method according to the present disclosure.

[0032] In an embodiment according to the present disclosure, a sensing device is provided on the handle and / or head-mounted display device of each second user, wherein the sensing device is capable of detecting the height of the handle and the head-mounted display device, and sending the detected height to a device that executes the data processing method according to the present disclosure, so that when the height of the second user's handle exceeds the height of the second user's head-mounted display device by a value not less than a first preset value, the device can determine that the second user has applied for speaking permission.

[0033] In some embodiments, the sensing device may be an infrared sensor or an electromagnetic sensor, which is not limited herein.

[0034] In some embodiments, the first preset value may be any distance between 5 cm and 20 cm, which is not limited herein. For example, the first preset value may be 10 cm.

[0035] In some embodiments, an instruction instructing each second user to apply for speaking permission is sent through the virtual reality device worn by the first user, so that each second user can apply for speaking permission after receiving the instruction through the virtual display device worn by the second user.

[0036] In some embodiments, an instruction is sent via a button on the first user's handle to instruct each second user to apply for speaking permission.

[0037] In some embodiments, the data processing method according to the present disclosure further includes:

[0038] In response to determining that the head-mounted display device of the first user receives the first voice audio from the first user, the first voice audio is played to each of the at least one second user, and the first voice audio indicates that the at least one second user is allowed to apply for the speaking permission.

[0039] By receiving the voice audio of the first user's instruction to allow at least one second user to apply for the speaking permission, and by playing the voice audio to the second user to allow the second user to apply for the speaking permission, the operation of hosting a meeting by voice in real life is simulated in the virtual reality conference scene, making the operation more natural, the scene more realistic, and the intelligence higher.

[0040] In some embodiments, the head-mounted display device of the first user is provided with a microphone, and the voice audio of the first user is collected. The device executing the data processing method according to the present disclosure performs text analysis on the voice audio, and determines that the text corresponding to the voice contains keywords related to allowing the second user to apply for speaking permission, for example, "please ask a question", then the voice is determined to be the first voice audio, and the first voice audio is included in the ambient soundtrack and played to the first user and each second user.

[0041] In some embodiments, after determining that one or more second users apply for speaking permission, one or more virtual images corresponding to the one or more second users are displayed in the head-mounted display device of the first user, so that the first user can select a target user from the one or more second users based on the one or more virtual images to allow them to speak.

[0042] In some embodiments, displaying an identifier corresponding to each of the one or more second users on a head-mounted display device of the first user includes:

[0043] A virtual image of each of the at least one second user is displayed in a head-mounted display device of the first user, wherein an identifier of each of the one or more second users is located above the virtual image.

[0044] By displaying the virtual image of each second user in the head-mounted display device of the first user, and displaying a corresponding identifier above the virtual image of each second user among the one or more second users who apply for speaking permission, the first user presiding over the meeting can determine that the second user has applied for speaking permission based on the corresponding identifier above the virtual image, and select the target user based on the displayed one or more identifiers. This process is closer to the scene in which the person who wants to speak is selected from among multiple people participating in the meeting who have applied for speaking permission in a real meeting scene, further making the scene more realistic. At the same time, during the whole process, the picture displayed on the head-mounted display device of the first user is more consistent with the real meeting scene, and there is no need to make a selection through a dialog box, which further improves the intelligence.

[0045] In some embodiments, the identifier corresponding to each second user among the one or more second users includes the identity identifier of the second user.

[0046] The identity identifier can be used to identify the second user corresponding to the avatar, allowing the first user to accurately select the second user they want to speak with. This can improve the accuracy of the first user's selection, especially when the association between the avatar and the corresponding second user is not high enough (for example, the avatar is not similar enough to the second user's actual appearance).

[0047] In other embodiments, the identifier corresponding to each second user among the one or more second users includes an identifier indicating that the second user applies for speaking permission, for example, an identifier with words such as "raise hand" or "apply to speak".

[0048] See Figure 2 , showing a schematic diagram of a scene in which an identifier corresponding to each of the one or more second users is displayed in a head-mounted display device of a first user in some embodiments of the present disclosure, wherein a "raise hand" pattern is displayed above the virtual image 201 of the second user to indicate that he or she is applying for speaking permission.

[0049] In some other embodiments, the identifier corresponding to each of the one or more second users includes:

[0050] A virtual image of each second user among the one or more second users raising a hand.

[0051] Continue to read Figure 2 The virtual image presented by the second user 201 is also presented as an image of raising the left hand, indicating that the user is applying for speaking permission.

[0052] By presenting the virtual image of the second user who applies for speaking permission as a virtual image raising his hand, the first user can judge whether the second user has applied for speaking permission based on the virtual image presented by the second user, so that the picture displayed by the first user in the first user's head-mounted display device is more consistent with the real meeting scene, thereby further improving the authenticity of the scene.

[0053] In some embodiments, the data processing method according to the present disclosure further includes:

[0054] In response to receiving second voice audio from the head mounted display device of the first user indicating that a third user among the one or more second users is allowed to speak, the third user is determined as the target user.

[0055] The target user is selected through the voice audio of the first user who presides over the meeting, so that the first user can select the target user only through voice audio. Compared with the method that requires the first user to use the operating handle to present a dialog box in the head-mounted display device and list the second users who apply to speak in the dialog box, and then select the target user from the second users listed in the dialog box through the handle, the convenience of operation of the first user who presides over the meeting is significantly improved.

[0056] For example, the voice audio of the first user is collected through a microphone on the head-mounted display device of the first user, and the target user selected by the first user is determined by analyzing the voice audio.

[0057] In some embodiments, the data processing method according to the present disclosure further includes:

[0058] In response to the first user's handle receiving the first operation of the first user, a fourth user among the one or more second users is determined as the target user, wherein the first operation instructs the first user to select the fourth user from the one or more second users to allow the fourth user to have the speaking permission.

[0059] The selection of the target user is determined by operating the handle of the first user who presides over the meeting, making the process of selecting the target user closer to the process of the first user selecting the target user through actions in a real scene, further improving the authenticity of the virtual reality-based meeting scene.

[0060] For example, the first user uses the handle to select one of the one or more virtual images corresponding to one or more second users presented in the head-mounted display device, thereby determining the second user corresponding to the virtual image as the target user. This process is similar to the process in a real meeting scenario where the first user points to one of the one or more second users who apply for the right to speak, thereby determining that the second user is allowed to apply to speak.

[0061] In some embodiments, the data processing method according to the present disclosure further includes:

[0062] In response to determining that the target user performs a speaking operation and in response to determining that the head-mounted display device of the target user receives the speaking voice audio from the target user, the speaking voice audio is played to each of the first user and the at least one second user.

[0063] If the target user is determined to have made a speech, the target user's speech is recorded by collecting the target user's speech audio and playing it to the first user and each second user. This ensures that the target user's speech process is verified by determining whether the target user has made a speech operation, thereby improving the accuracy of the collected speech audio. Furthermore, according to the embodiments of the present disclosure, the target user's speech that is not intended to be made public is avoided from being collected and played to the first user and each second user, thereby ensuring the privacy of the second users.

[0064] In some embodiments, in response to the target user pressing a button on the handle, it is determined that the target user performs a speaking operation.

[0065] In some embodiments, in response to determining that the height of the target user's handle is lower than the height of the target user's head-mounted display device by a value not lower than a second preset value, it is determined that the target user performs the speaking operation.

[0066] By ensuring that the height of the target user's handle is lower than the height of the virtual display device by no less than a second preset value, it is determined that the target user performs a speaking operation, so that the process of the target user performing the speaking operation can simulate the action of speaking by raising the microphone in a real meeting scene, further improving the authenticity and intelligence.

[0067] In some embodiments, the second preset value ranges from 15 cm to 25 cm, for example, 25 cm.

[0068] In some embodiments, in response to determining that the target user performs a speaking operation, a virtual image corresponding to the first user is displayed in the head-mounted display device of the first user and each second user, and the virtual image presents an action of holding a microphone to speak.

[0069] In some embodiments, in response to determining that the target user performs a speaking operation, the speaking process of the first user is realized by incorporating the target user's speaking voice audio collected by the target user's head-mounted display device into the environmental sound track and playing it to the first user and other second users.

[0070] In some embodiments, in response to determining that the height of the target user's handle is lower than the height of the target user's head-mounted display device is lower than a second preset value, or the height of the target user's handle is higher than the target user's head-mounted display device, it is determined that the target user is not performing a speaking operation. At this time, the target user's voice audio is no longer included in the ambient sound track and is played to the first user and other second users.

[0071] According to another aspect of the present disclosure, a data processing device for use in a virtual reality-based conference scenario is provided, wherein the conference scenario includes a first user hosting a conference and at least one second user participating in the conference, and each of the first user and the at least one second user wears a virtual reality device including a head-mounted display device and a handle, such as Figure 3 As shown, the apparatus 300 includes:

[0072] The first responding unit 310 is configured to, for each of the at least one second user, determine that the second user applies for speaking permission in response to determining that the height of the second user's handle exceeds the height of the second user's head mounted display device by a value not less than a first preset value; and

[0073] The first display unit 320 is configured to display an identifier corresponding to each of the one or more second users among the at least one second user who apply for the speaking permission in the head-mounted display device of the first user, and the identifier indicates that the second user applies for the speaking permission, so that the first user selects a target user from the one or more second users based on the one or more identifiers corresponding to the one or more second users to allow the target user to have the speaking permission.

[0074] In some embodiments, the virtual reality device worn by the first user and each of the at least one second user further includes a handle, and the apparatus 300 further includes:

[0075] The second response unit is configured to play the first voice audio to each of the at least one second user in response to determining that the head-mounted display device of the first user has received the first voice audio from the first user, and the first voice audio indicates that the at least one second user is allowed to apply for the speaking permission.

[0076] In some embodiments, the first display unit 320 includes:

[0077] The first display subunit is configured to display a virtual image of each of the at least one second user in a head-mounted display device of the first user, wherein an identifier of each of the one or more second users is located above the virtual image.

[0078] In some embodiments, each of the one or more second users corresponds to a virtual image of a raised hand.

[0079] In some embodiments, the apparatus 300 further includes:

[0080] The third response unit is configured to determine the third user as the target user in response to receiving the second voice audio from the head-mounted display device of the first user indicating that the third user among the one or more second users is allowed to speak.

[0081] In some embodiments, the apparatus 300 further includes:

[0082] A fourth response unit is configured to determine a fourth user from the one or more second users as the target user in response to the first user's handle receiving a first operation of the first user, wherein the first operation instructs the first user to select the fourth user from the one or more second users to allow the fourth user to have the speaking permission.

[0083] In some embodiments, the apparatus 300 further includes:

[0084] A fifth response unit is configured to play the speech voice audio to the first user and each of the at least one second user in response to determining that the target user performs a speaking operation and in response to determining that the head-mounted display device of the target user receives the speech voice audio from the target user.

[0085] In some embodiments, the apparatus 300 further includes:

[0086] The sixth response unit is configured to determine that the target user performs the speaking operation in response to determining that the height of the target user's handle is lower than the height of the target user's head-mounted display device by a value not lower than a second preset value.

[0087] According to an embodiment of the present disclosure, an electronic device, a readable storage medium, and a computer program product are also provided.

[0088] refer to Figure 4, a block diagram of an electronic device 400 that can serve as a server or client of the present disclosure will now be described, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0089] like Figure 4 As shown, electronic device 400 includes a computing unit 401, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 402 or a computer program loaded from a storage unit 408 into a random access memory (RAM) 403. Various programs and data required for the operation of electronic device 400 can also be stored in RAM 403. Computing unit 401, ROM 402, and RAM 403 are connected to each other via a bus 404. An input / output (I / O) interface 405 is also connected to bus 404.

[0090] Multiple components within electronic device 400 are connected to I / O interface 405, including an input unit 406, an output unit 407, a storage unit 408, and a communication unit 409. Input unit 406 can be any type of device capable of inputting information into electronic device 400. Input unit 406 can receive input numeric or character information and generate key signal input related to user settings and / or function control of the electronic device. It can include, but is not limited to, a mouse, keyboard, touch screen, trackpad, trackball, joystick, microphone, and / or remote control. Output unit 407 can be any type of device capable of presenting information, and can include, but is not limited to, a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. Storage unit 408 can include, but is not limited to, a magnetic disk or an optical disk. Communication unit 409 allows electronic device 400 to exchange information / data with other devices via computer networks such as the Internet and / or various telecommunication networks. It can include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver and / or chipset, such as a Bluetooth™ device, an 802.11 device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.

[0091] The computing unit 401 can be a variety of general-purpose and / or specialized processing components with processing and computing capabilities. Some examples of the computing unit 401 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 401 performs the various methods and processes described above, such as method 100. For example, in some embodiments, the method 100 can be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as a storage unit 408. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 400 via the ROM 402 and / or the communication unit 409. When the computer program is loaded into the RAM 403 and executed by the computing unit 401, one or more steps of the method 100 described above can be performed. Alternatively, in other embodiments, the computing unit 401 can be configured to perform the method 100 in any other appropriate manner (e.g., by means of firmware).

[0092] Various embodiments of the systems and techniques described above can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0093] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0094] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0095] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0096] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0097] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0098] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not limited herein.

[0099] Although the embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it should be understood that the above-mentioned methods, systems and devices are merely exemplary embodiments or examples, and the scope of the present invention is not limited by these embodiments or examples, but is only limited by the claims after authorization and their equivalents. Various elements in the embodiments or examples may be omitted or replaced by their equivalents. In addition, the steps may be performed in an order different from that described in this disclosure. Further, the various elements in the embodiments or examples may be combined in various ways. It is important that as technology evolves, many of the elements described herein may be replaced by equivalent elements that appear after this disclosure.

Claims

1. A data processing method applied to a virtual reality-based conference scenario, wherein: The conference scene includes a first user hosting the conference and at least one second user participating in the conference, wherein the first user and each of the at least one second user wear a virtual reality device including a head-mounted display device and a handle, and the method includes: For each of the at least one second user, in response to determining that a height of the second user's handle exceeds a height of the second user's head mounted display device by a value not less than a first preset value, determining that the second user applies for speaking permission; and An identifier corresponding to each of the one or more second users among the at least one second user who apply for the speaking permission is displayed in the head-mounted display device of the first user, and the identifier indicates that the second user applies for the speaking permission, so that the first user selects a target user from the one or more second users based on the one or more identifiers corresponding to the one or more second users to allow the target user to have the speaking permission.

2. The method according to claim 1, further comprising: In response to determining that the head-mounted display device of the first user receives the first voice audio from the first user, the first voice audio is played to each of the at least one second user, and the first voice audio indicates that the at least one second user is allowed to apply for the speaking permission.

3. The method according to claim 1, wherein Displaying an identifier corresponding to each of the one or more second users on the head mounted display device of the first user includes: A virtual image of each of the at least one second user is displayed in a head-mounted display device of the first user, wherein an identifier of each of the one or more second users is located above the virtual image.

4. The method according to claim 1, wherein The identifier corresponding to each of the one or more second users includes: A virtual image of each second user among the one or more second users raising a hand.

5. The method according to claim 1, further comprising: In response to receiving second voice audio from the head mounted display device of the first user indicating that a third user among the one or more second users is allowed to speak, the third user is determined as the target user.

6. The method according to claim 1, further comprising: In response to the first user's handle receiving the first operation of the first user, a fourth user among the one or more second users is determined as the target user, wherein the first operation instructs the first user to select the fourth user from the one or more second users to allow the fourth user to have the speaking permission.

7. The method according to claim 1, further comprising: In response to determining that the target user performs a speaking operation and in response to determining that the head-mounted display device of the target user receives the speaking voice audio from the target user, the speaking voice audio is played to each of the first user and the at least one second user.

8. The method according to claim 7, further comprising: In response to determining that the height of the target user's handle is lower than the height of the target user's head mounted display device by a value not lower than a second preset value, it is determined that the target user performs the speaking operation.

9. A data processing device used in a virtual reality-based conference scenario, wherein: The conference scene includes a first user hosting the conference and at least one second user participating in the conference, wherein each of the first user and the at least one second user wears a virtual reality device including a head-mounted display device and a handle, and the device includes: a first responding unit configured to, for each of the at least one second user, determine that the second user applies for speaking permission in response to determining that a height of the second user's handle exceeds a height of the second user's head mounted display device by a value not less than a first preset value; and The first display unit is configured to display an identifier corresponding to each of the one or more second users among the at least one second user who apply for the speaking permission in the head-mounted display device of the first user, and the identifier indicates that the second user applies for the speaking permission, so that the first user selects a target user from the one or more second users based on the one or more identifiers corresponding to the one or more second users to allow the target user to have the speaking permission.

10. The device according to claim 9, wherein The virtual reality device worn by the first user and each of the at least one second user further includes a handle, and the apparatus further includes: The second response unit is configured to play the first voice audio to each of the at least one second user in response to determining that the head-mounted display device of the first user has received the first voice audio from the first user, and the first voice audio indicates that the at least one second user is allowed to apply for the speaking permission.

11. The device according to claim 9, wherein The first display unit includes: The first display subunit is configured to display a virtual image of each of the at least one second user in a head-mounted display device of the first user, wherein an identifier of each of the one or more second users is located above the virtual image.

12. The device according to claim 9, wherein A virtual image of each second user among the one or more second users raising a hand.

13. The apparatus according to claim 9, further comprising: The third response unit is configured to determine the third user as the target user in response to receiving the second voice audio from the head-mounted display device of the first user indicating that a third user among the one or more second users is allowed to speak.

14. The apparatus according to claim 9, further comprising: The fourth response unit is configured to determine a fourth user from the one or more second users as the target user in response to the first user's handle receiving a first operation of the first user, wherein the first operation instructs the first user to select the fourth user from the one or more second users to allow the fourth user to have the speaking permission.

15. The apparatus according to claim 9, further comprising: A fifth response unit is configured to play the speech voice audio to the first user and each of the at least one second user in response to determining that the target user performs a speaking operation and in response to determining that the head-mounted display device of the target user receives the speech voice audio from the target user.

16. The apparatus according to claim 15, further comprising: The sixth response unit is configured to determine that the target user performs the speaking operation in response to determining that the height of the target user's handle is lower than the height of the target user's head-mounted display device by a value not lower than a second preset value.

17. An electronic device comprising: at least one processor; as well as a memory communicatively coupled to the at least one processor; in The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 8.

18. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-8.

19. A computer program product comprising a computer program, wherein When the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images