A data processing method, apparatus, device, and medium

Abstract

The present invention discloses a data processing method, apparatus, device and medium. Environment image information is collected in real time; a target virtual scene is generated according to the environment image information; and the target virtual scene is sent to a target client so that the target client reproduces the target virtual scene. The problem of being unable to perform real-time and dynamic update on the target virtual scene is solved, and the target virtual scene is updated according to the actually collected image information, realizing the dynamic change of the target virtual scene.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of data processing, and in particular, to a data processing method, apparatus, device, and medium. Background Art

[0002] Virtual reality technology encompasses computers, electronic information, and simulation technology. Its basic implementation method is for a computer to simulate a virtual environment to give people a sense of immersion in the environment. With the continuous development of social productivity and science and technology, the demand for VR (Virtual Reality) technology in all walks of life is increasing day by day. VR technology has also made great progress and has gradually become a new field of science and technology. In the existing virtual reality technology, if a user wants to experience a virtual scene through a VR device, they can only select a virtual scene pre-constructed by the VR device manufacturer and cannot generate a target virtual scene according to their own requirements, which urgently needs to be improved. Summary of the Invention

[0003] Embodiments of the present invention provide a data processing method, apparatus, device, and medium, which can automatically generate a target virtual scene according to the environmental image information of a target environment, enabling a user to reproduce the target environment through the target virtual scene.

[0004] In a first aspect, embodiments of the present invention provide a data processing method, which is characterized by including:

[0005] Collecting environmental image information in real time;

[0006] Generating a target virtual scene according to the environmental image information;

[0007] Sending the target virtual scene to a target user terminal so that the target user terminal reproduces the target virtual scene.

[0008] In a second aspect, embodiments of the present invention further provide a data processing apparatus, which includes:

[0009] An environmental image information collection module for collecting environmental image information in real time;

[0010] A target virtual scene generation module for generating a target virtual scene according to the environmental image information;

[0011] A target virtual scene sending module for sending the target virtual scene to a target user terminal so that the target user terminal reproduces the target virtual scene.

[0012] In a third aspect, embodiments of the present invention further provide a data processing device, which includes:

[0013] One or more processors;

[0014] A storage device for storing one or more programs

[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the data processing method according to any embodiment of the present invention.

[0016] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, it implements the data processing method according to any embodiment of the present invention.

[0017] The technical solution provided in this embodiment can collect environmental image information of a target environment in real time, generate a target virtual scene according to the environmental image information, and can be transmitted to a target user terminal, so that the target user terminal can share the target virtual scene. The above solution solves the problem that a virtual scene cannot be constructed according to user needs, and only the virtual scenes provided by VR device manufacturers can be obtained, and the dynamic changes of the target environment cannot be felt through the generated virtual scene; it can collect the environmental image information of the target environment specified by the user in real time, generate the target virtual scene required by the user, and can update the target virtual scene in real time according to the changes of the target environment, so that the user can feel the dynamic changes of the target environment according to the target virtual scene. Description of the Drawings

[0018] Figure 1 It is a flowchart of a data processing method provided in Embodiment 1 of the present invention;

[0019] Figure 2 It is a flowchart of a data processing method provided in Embodiment 2 of the present invention;

[0020] Figure 3 It is a flowchart of a data processing method provided in Embodiment 3 of the present invention;

[0021] Figure 4 It is a schematic structural diagram of a data processing device provided in Embodiment 4 of the present invention;

[0022] Figure 5 It is a schematic structural diagram of a data processing device provided in Embodiment 5 of the present invention. Detailed Description of the Embodiments

[0023] The present invention will be further described in detail below with reference to the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present invention, rather than limiting the present invention. Additionally, it should be noted that for the sake of description, only parts related to the present invention are shown in the drawings, rather than all the structures.

[0024] Embodiment 1

[0025] Figure 1 The figure is a flowchart of a data processing method provided in the first embodiment of the present invention. This embodiment is applicable to the situation of data processing of image information, and is particularly applicable to the situation of data processing of image information collected by VR devices. This method can be executed by the data processing method device provided in the embodiment of the present invention, and the device can be implemented in a software and / or hardware manner. The device can be configured in a terminal device. Further, the terminal device can be a VR device. The method specifically includes:

[0026] S110. Collect environmental image information in real time.

[0027] Among them, the environmental image information refers to the image information of the environment to be referred to when the user constructs a virtual scene. The environmental image information may include, but is not limited to, environmental images, the acquisition angles of environmental images, and the actual positions of the scenes in the environmental images in the target environment. The environment to be referred to when the user constructs a virtual scene is the target environment.

[0028] Optionally, an image acquisition device can be used to collect environmental image information; the image acquisition device can be a camera installed on the VR device, that is, an internal image acquisition device, or an image acquisition device installed in the surrounding environment of the user at the current moment, that is, an external image acquisition device. The internal image acquisition device and the external image acquisition device have the function of panoramic shooting. Among them, each VR device has a device ID (Identity document, identity identification number), and the VR device corresponding to the device ID can be identified according to the device ID.

[0029] Specifically, an image acquisition device is used to collect image information of each angle of the surrounding environment of the user at the current moment, and the collected environmental image information is sent to the image processing module of the VR device carried by the user. The environmental image information can be picture information of the target environment or video information of the target environment. When the environmental image information is picture information of the target environment, the image acquisition device needs to collect environmental image information with different focal lengths at each angle at the current moment and send the environmental image information with different focal lengths at each angle to the image processing module of the VR device. When the environmental image information is video information of the target environment, the image acquisition device needs to collect environmental image information at each angle at the current moment and send the environmental image information at each angle to the image processing module of the VR device.

[0030] Optionally, if the image acquisition device is an internal image acquisition device, such as a camera installed on a VR device, the camera installed on the VR device can acquire environmental image information of various angles of the user's surrounding environment. When the user needs to use the VR device to generate a virtual scene, the VR device acquires the surrounding environmental image information through the camera and sends the acquired environmental image information to the VR device connected to the camera. If the image acquisition device is an external image acquisition device, such as an image acquisition device installed in the user's surrounding environment at the current moment, when the user needs to use the VR device to generate a virtual scene, the VR device sends an image acquisition request to the image acquisition device server, and at the same time sends the device ID of the VR device and the current position information of the VR device to the image acquisition device server. After receiving the image acquisition request, the image acquisition device server determines whether the VR device corresponding to the device ID has the image acquisition permission to acquire the environmental image information of the current position information of the VR device. If the VR device corresponding to the device ID has the image acquisition permission, the image acquisition device sends the acquired environmental image information to the image processing module of the VR device. Among them, the image acquisition device installed in the target environment can acquire the environmental image information of the complete surrounding environment.

[0031] Furthermore, the VR device can also be connected to an external image acquisition device in a scene where the user often sets foot. The external image acquisition device can regularly send the environmental image information acquired by the external image acquisition device to the VR device, so that the VR device can update the environmental image information in real time according to the environmental image information acquired by the external image acquisition device.

[0032] S120. Generate a target virtual scene according to the environmental image information.

[0033] Among them, the virtual scene refers to the VR scene constructed by the VR device. The target virtual scene refers to the virtual scene that the user needs to construct through the VR device according to the real environmental image information.

[0034] Specifically, after the image processing module of the VR device obtains the environmental image information sent by the image acquisition device, it determines the association relationship of each environmental image according to the acquisition angle of the image environment and the actual position of the scene in the environmental image in the target environment. The association relationship of each environmental image represents the positional relationship between each environmental image, and can be used to determine the environmental images adjacent to a certain environmental image. The image processing module sends the environmental image information and the association relationship of each environmental image to the VR scene editor. After receiving the information sent by the image processing module, the VR scene editor generates a target virtual scene according to the association relationship of each environmental image. The generated target virtual scene is the reproduction of the target environment. The VR scene editor can make real-time changes to the target virtual scene according to the environmental image information collected in real time by the image acquisition device, so that the scene information of the target virtual scene and the target environment is always kept consistent.

[0035] Optionally, the user can set the initial perspective of the virtual scene according to actual needs. For example, the perspective of one of the image acquisition devices can be selected as the initial perspective. When the VR scene editor generates the target virtual scene, it determines the perspective of the selected image acquisition device as the initial perspective, and generates the target virtual scene based on the initial perspective and the association relationship between each environmental image.

[0036] Optionally, after the image processing module of the VR device obtains the environmental image information sent by the image acquisition device, it can also send the received environmental image information to the VR scene editor of other VR devices. The VR scene editor of other VR devices can generate a target virtual scene according to the received environmental image information.

[0037] For example, when the target environment is a living room, the user can install an external image acquisition device in the living room. The VR device held by the user can transmit information with the external image acquisition device installed in the living room. The external image acquisition device installed in the living room will collect the environmental image information of the living room in real time, and send the collected environmental image information of the living room to the image processing module of the VR device in real time. The VR scene editor generates a virtual scene of the living room according to the information sent by the image processing module. And according to the information sent by the image processing module, when the environmental image information of the living room changes, the virtual scene of the living room is updated in real time.

[0038] S130. Send the target virtual scene to the target user terminal so that the target user terminal reproduces the target virtual scene.

[0039] Among them, the target user terminal refers to the user terminal of the VR device that needs to obtain the target virtual scene and has the permission to obtain the target virtual scene. Reproducing the target virtual scene means that the VR device can be used to display the target scene to the user, so that the user can be placed in the target virtual scene through the VR device.

[0040] Specifically, the target client can be one target client or multiple target clients. After the VR scene editor generates the target virtual scene based on the received environmental image information, it sends the target virtual scene to the target client. After the target client obtains the target virtual scene, the user can reproduce the target virtual scene through the target client. When the environmental image information of the target environment changes, the VR scene editor can update the target virtual scene in real time according to the environmental image information, so that the target client can feel the dynamic changes of the target environment based on the reproduced target virtual scene.

[0041] Preferably, in this step, the parties involved can be determined according to the requirement information, the target client can be determined according to the parties involved, and the target virtual scene is sent to the target client. Specifically, it can be implemented through the following sub-steps:

[0042] S1301. Determine the parties involved according to the requirement information.

[0043] Among them, the requirement information refers to the information input by the user into the VR device according to the current requirement. The parties involved are specified by the user who issues the requirement and are other users who can obtain the target virtual scene shared by the user who issues the requirement. For example, taking the user who issues the requirement information as the local user, when the local user needs to hold a video conference with colleagues through the VR device, the requirement information can be the video conference initiation requirement issued by the local user and the user information of the users who need to participate in the video conference. The user information can be the device ID of the VR device held by the user. At this time, the parties involved are the video conference participants specified by the local user.

[0044] Specifically, function options can be preset for the VR device. For example, the function options can include video function, travel function, shopping function, etc. The user can select the corresponding function according to their own needs. After determining the target function, the user can also invite other users as the parties involved in the function they have selected. The invitation method can be that the user inputs the device ID of the other VR device to be invited through the VR device, and the VR device determines the other user invited by the user as the party involved.

[0045] S1302. Use the VR device of the party involved as the target client.

[0046] Specifically, when the VR device of the local user receives the requirement information issued by the local user and the device ID of the party involved input by the local user, it uses the VR device corresponding to the device ID of the party involved as the target client.

[0047] S1303. Send the target virtual scene to the target client.

[0048] Specifically, after the VR device of the local user generates a target virtual scene based on the environmental image information and determines the target user terminal according to the demand information of the local user, it can send the target virtual scene to the target user terminal, so that the participants can reproduce the target virtual scene through the target user terminal.

[0049] Optionally, after the image processing module of the VR device of the local user obtains the environmental image information of the target environment, it can send the environmental image information of the target environment to the target user terminal through the VR device. After receiving the environmental image information, the target user terminal generates a target virtual scene according to the environmental image information through the VR scene editor in the VR device of the target user terminal, so that the participants can reproduce the target virtual scene through the target user terminal.

[0050] For example, when the local user is in an office scene and needs to have a video conference with other users in the office scene. At this time, the target scene is the office scene. The VR device of the local user collects the office environmental image information in real time. The local user can select the video function and further input the device ID of the participants who need to participate in the video conference on the VR device. The VR device of the target user determines the VR devices of the participants according to the device ID of the participants and uses the VR devices of the participants as the target user terminal. The VR device of the local user sends the generated target virtual scene to the target user terminal. After receiving the target virtual scene, the participants can choose to have a video conference in the target virtual scene.

[0051] It can be understood that in this embodiment, according to the demand information, when it is determined that the participants have the need to send the target virtual scene, the target user terminal can be specified, so that the VR device can realize the sharing of the target virtual scene according to the target user terminal specified by the user.

[0052] The technical solution provided in this embodiment can collect the environmental image information of the target environment in real time according to the user's needs, generate a target virtual scene through the VR device according to the environmental image information, and can transmit the target virtual scene between the target user terminals through the VR device, so that the target user terminals can share the target virtual scene. In addition, by collecting the environmental image information of the target environment in real time, the target virtual scene can be updated with the real-time environmental image information. It solves the problem that the virtual scene cannot be constructed according to the user's needs, and only the virtual scenes provided by the VR device manufacturers can be obtained, and the dynamic changes of the target environment cannot be felt through the generated virtual scene. It can collect the environmental image information of the target environment specified by the user in real time according to the user's needs, generate the target virtual scene required by the user, and can update the target virtual scene in real time according to the changes of the target environment, so that the user can feel the dynamic changes of the target environment according to the target virtual scene.

[0053] Embodiment 2

[0054] Figure 2 The figure is a flowchart of a data processing method provided in the second embodiment of the present invention. This embodiment is optimized based on the above embodiment, and a preferred embodiment is given for selecting a target scene mode according to the environmental image attributes and generating a target virtual scene according to the selected target scene mode. Specifically, as Figure 2 shown, the data processing method provided in this embodiment may include:

[0055] S210. Collect environmental image information in real time.

[0056] S220. Select a target scene mode from the optional scene modes according to the environmental image attributes of the environmental image information.

[0057] Among them, the environmental image attributes refer to the attributes of the scene where the environmental image is located determined according to the environmental features extracted from the environmental image information, such as residential attributes, street attributes, classroom attributes, or meeting attributes, etc. The optional scene modes refer to the scene modes available for users to select in the VR device for generating virtual scenes. For example, the scene modes may include a noisy mode, a quiet mode, a music mode, or a landscape mode, etc.; further, the optional scene modes can be dynamically added and deleted. The target scene mode is the scene mode required by the user, and the user can select the target scene mode according to the needs. Different environmental image attributes can select different scene modes. For example, if the scene attribute where the environmental image is located is a meeting attribute, the noisy mode cannot be selected. The specific attribute information and scene modes can be set according to the actual situation.

[0058] Specifically, after the image processing module of the VR device receives the environmental image information of the target environment, it uses an image processing algorithm to extract the features of the environmental image, and determines the attributes of the environmental image collected by the image acquisition device according to the extracted environmental image features. The attributes of the environmental image can be one or multiple. The VR device can display the optional scene modes to the user according to the environmental image attributes of the collected environmental image. The user determines whether there is a target scene mode required by the user according to the displayed optional scene modes. If there is a target scene mode required by the user, the user can select the target scene mode.

[0059] Further, there is a corresponding environmental image under each optional scene mode. Optionally, the scene image is obtained in the following manner: after the user obtains the material image information of the target environment, the user can send the material image information to the shared database through the sharing option. The shared database classifies the material image information sent by the user according to the image features of the environmental image, generates a scene mode list in the shared database, and stores the material image information sent by the user in the mode list to which the material image information belongs.

[0060] Further, the VR device can display the scene mode list corresponding to the target scene mode selected by the user to the user. The user can select the material image information in the scene mode list. The selected material image information by the user can be one or multiple.

[0061] S230. Generate a target virtual scene according to the environmental image information and the target scene mode.

[0062] Specifically, the VR device sends the environmental image information collected in real time and the material image information in the target scene mode selected by the user to the image processing module. The image processing module sends the environmental image information collected in real time, the material image information in the scene mode list selected by the user, and the association relationship of each environmental image to the VR scene editor. The VR scene editor generates a target virtual scene according to the environmental image information collected in real time, the material image information in the scene mode list selected by the user, and the association relationship of each environmental image.

[0063] S240. Send the target virtual scene to the target user terminal so that the target user terminal reproduces the target virtual scene.

[0064] The technical solution of this embodiment provides the user with selectable scene modes according to the environmental image attributes collected by the image acquisition device, enabling the user to select the target scene mode according to their own needs and add it to the target virtual scene to be generated. The above solution realizes the effect of being able to select the required target scene mode from the optional scene modes according to the actual needs of the user and perform personalized design on the target virtual scene to be generated, meeting the personalized needs of the user.

[0065] Embodiment III

[0066] Figure 3 This is a flowchart of a data processing method provided by Embodiment III of the present invention. This embodiment is optimized on the basis of the above embodiment. In the scenario where the environmental image information includes at least two frames of environmental images, a preferred embodiment of generating a sub-virtual scene according to each frame of environmental image and combining the sub-virtual scenes to obtain a complete target virtual scene is given. Specifically, as Figure 3 shown, the data processing method provided by this embodiment may include:

[0067] S310. Collect environmental image information in real time; wherein, the environmental image information includes at least two frames of environmental images.

[0068] S320. Generate a target virtual scene according to the environmental image information.

[0069] Optionally, if the target scene range is large, multiple frames of environmental images need to be collected by multiple groups of image acquisition devices at the same time to obtain the environmental image information of the entire target environment scene. At this time, the environmental image information may include at least two frames of images.

[0070] Exemplarily, in this step, a sub-virtual scene of each frame of environmental image can be generated according to each frame of environmental image; at least two sub-virtual scenes are combined to obtain the target virtual scene.

[0071] Among them, the sub-virtual scene refers to a local virtual scene of the target virtual scene, and combining all sub-virtual scenes can generate the target virtual scene.

[0072] Specifically, a group of image acquisition devices is set at a certain distance in the target environment, and each group of image acquisition devices is numbered. A total of N groups of image acquisition devices are set, then the numbers of the image acquisition devices are 1, 2,..., N, where N is a positive integer and N≥2. Each group of image acquisition devices can collect the environmental image information of the local scene in the target environment, and the local scene of the target scene that each group of images can collect the environmental image information is assigned a scene number, and the scene number is the same as the number of the group of image acquisition devices that can collect the environmental sub-image of this scene. For example, the first group of image acquisition devices collects the first environmental sub-image information of the first frame of the target environment, and the second group of image acquisition devices collects the second environmental sub-image information of the second frame of the target environment, etc.

[0073] The VR scene editor generates a virtual scene of the local scene in the target environment corresponding to the sub-environmental image according to the environmental sub-image information collected by each group of image acquisition devices, that is, the sub-virtual scene. The VR scene editor generates N sub-virtual scenes according to the environmental sub-image information collected by N groups of image acquisition devices. Further, the VR scene editor combines the sub-virtual scenes in the order of the numbers according to the numbers corresponding to the sub-virtual images, and the complete virtual scene obtained after combination is the target virtual scene.

[0074] Preferably, this step can be implemented through the following sub-steps:

[0075] S3201. Select a target environmental image from at least two frames of environmental images.

[0076] Among them, the target environmental image involved in this step refers to the environmental sub-image selected by the user according to his own needs for generating the target virtual scene.

[0077] Specifically, a set of image acquisition devices is set at regular intervals in the target environment, and each set of image acquisition devices is numbered. A total of N sets of image acquisition devices are set, and the numbers of the image acquisition devices are 1, 2, …, N, where N is a positive integer and N≥2. Each set of image acquisition devices can collect environmental image information of a local scene in the target environment. The target scene of the local scene from which each set of images can collect environmental image information is assigned a scene number, and the scene number is the same as the number of the set of image acquisition devices that can collect the environmental sub-image of this scene. In practical applications, users can, according to actual needs, only obtain the virtual scene of the local scene in the target environment, rather than obtaining the virtual scene of the entire scene of the target environment. Therefore, the target environment can be pre-divided into scenes, and the target environment is divided into several local scenes. Preferably, the number of local scenes can be the same as the number of sets of image acquisition devices. All local scenes combined can form a complete target environment. Users can select the local scenes for which they need to generate virtual scenes according to their own needs. A scene table can be listed for the local scenes according to the scene numbers. Users can select the target scene by clicking on the local scene numbers in the scene table. The local scenes selected by the users can be one, or multiple, and at most N local scenes can be selected. The local scenes selected by the users can be local scenes with consecutive scene numbers or local scenes with non-consecutive scene numbers. The local scenes selected by the users are used as the target local scenes. The image acquisition devices in the selected target local scenes can collect the target environmental images of the target local scenes and send the collected target environmental images to the image processing module of the VR device.

[0078] Optionally, in this step, the target environmental image can also be selected from at least two frames of environmental images according to the requirement information and / or the environmental image attributes of each frame of environmental image.

[0079] Among them, the requirement information refers to the information input by the user into the VR device according to the current requirement.

[0080] Specifically, after receiving the environmental image information sent by each group of image acquisition devices, the image processing module uses image processing algorithms to extract features from the environmental images, and determines the attributes of the environmental images collected by the image acquisition devices according to the extracted environmental image features. When the user has a need to generate a target virtual scene, the user can, according to their own needs, input the demand information into the VR device in the form of keywords. The user can input keywords in the form of text input or voice input. After receiving the demand information input by the user, the VR device associates and matches the demand information input by the user with the attributes of the environmental images, selects the target environmental image from at least two frames of environmental images according to the association and matching results, and sends the selected target environmental image to the image processing module of the VR device. The image processing module of the VR device sends the target environmental image and the association relationship of each target environmental image to the VR scene editor.

[0081] S3202. Generate a target virtual scene according to the target environmental image.

[0082] The VR scene editor generates a virtual scene of the target local scene corresponding to the target environmental image, that is, a sub-virtual scene, according to the target environmental image of the target local scene collected by each group of image acquisition devices. Further, the VR scene editor combines the sub-virtual scenes in the order of the scene numbers according to the scene numbers corresponding to the target local scenes, and the combined virtual scene is the target virtual scene.

[0083] It can be understood that generating a target virtual scene according to the selected target environmental image by the user can provide the user with more virtual scene construction solutions. The user can independently select the target scene according to their own needs, making the generation method of the target virtual scene more flexible.

[0084] S330. Send the target virtual scene to the target user terminal so that the target user terminal reproduces the target virtual scene.

[0085] Exemplarily, after obtaining the target virtual scene, it is also possible to mark in the target virtual scene. For example, the user can select a destination in the target virtual scene for marking. The VR device can generate an optimal route map according to the marking information sent by the user and the user's current location information, and prominently display the optimal route map in the target virtual scene. For example, graphic marks or color marks can be set on the optimal route map.

[0086] In the technical solution of this embodiment, multiple frames of environmental image information are collected by an image acquisition device, a sub-virtual scene of the target environment is generated according to each frame of environmental image, and the sub-virtual scenes are combined in sequence to obtain the target virtual scene. This solves the problem that when the range of the target environment is too large, only one frame of environmental image information collected by a group of image acquisition devices cannot obtain the full-scene environmental image information of the target environment, and thus a complete target virtual scene cannot be generated. It realizes the effect of obtaining a complete target virtual scene by collecting multiple frames of environmental images, generating corresponding sub-virtual scenes according to each frame of environmental image, and combining the sub-virtual scenes.

[0087] Embodiment 4

[0088] Figure 4 As shown in the structural schematic diagram of a data processing device provided in Embodiment 4 of the present invention, this embodiment is applicable to the situation where a target virtual scene is generated according to environmental image information and the target virtual scene can be reproduced on a target client, such as Figure 4 shown, the data processing device includes: an environmental image information acquisition module 410, a target virtual scene generation module 420, and a target virtual scene sending module 430.

[0089] Among them, the environmental image information acquisition module 410 is used to collect environmental image information in real time;

[0090] The target virtual scene generation module 420 is used to generate a target virtual scene according to the environmental image information;

[0091] The target virtual scene sending module 430 is used to send the target virtual scene to the target client so that the target client reproduces the target virtual scene.

[0092] The technical solution provided in this embodiment can collect environmental image information of the target environment in real time according to user needs, generate a target virtual scene through a VR device according to the environmental image information, and can transmit the target virtual scene between the target clients through the VR device, so that the target clients can share the target virtual scene. In addition, by collecting environmental image information of the target environment in real time, the target virtual scene can be updated with the real-time environmental image information. It solves the problems that a virtual scene cannot be constructed according to user needs, only the virtual scenes provided by VR device manufacturers can be obtained, and the dynamic changes of the target environment cannot be felt through the generated virtual scenes. It can collect environmental image information of the target environment specified by the user in real time according to user needs, generate the target virtual scene required by the user, and can update the target virtual scene in real time according to the changes of the target environment, so that the user can feel the dynamic changes of the target environment according to the target virtual scene.

[0093] Among them, the target virtual scene generation module 420 further includes:

[0094] A target scene mode selection unit is configured to select a target scene mode from optional scene modes according to the environmental image attributes of environmental image information; and generate a target virtual scene according to the environmental image information and the target scene mode.

[0095] Exemplarily, the target virtual scene generation module 420 further includes:

[0096] If the environmental image information includes at least two frames of environmental images, generate a sub-virtual scene for each frame of environmental image according to each frame of environmental image;

[0097] Combine at least two sub-virtual scenes to obtain a target virtual scene.

[0098] Exemplarily, the target virtual scene generation module 420 further includes:

[0099] A target environmental image selection unit is configured to select a target environmental image from at least two frames of environmental images when the environmental image information includes at least two frames of environmental images; and generate a target virtual scene according to the target environmental image.

[0100] Further, the above-mentioned target environmental image selection unit further includes:

[0101] Select a target environmental image from at least two frames of environmental images according to the requirement information and / or the environmental image attributes of each frame of environmental image.

[0102] Exemplarily, the target virtual scene sending module 430 further includes:

[0103] A participant determination unit is configured to determine a participant according to the requirement information;

[0104] A target client determination unit is configured to use the VR device of the participant as a target client; and send the target virtual scene to the target client.

[0105] The data processing device provided in this embodiment can be applied to the data processing method provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0106] Embodiment 5

[0107] Figure 5 As shown in the structural schematic diagram of a data processing device provided in Embodiment 5 of the present invention, as Figure 5 shown, the device includes a processor 50, a memory 51, an input device 52, and an output device 53; the number of processors 50 in the device can be one or more, Figure 5 taking one processor 50 as an example; the processor 50, the memory 51, the input device 52, and the output device 53 in the device can be connected through a bus or other means, Figure 5Take the bus connection as an example.

[0108] The memory 51, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the data processing method in the embodiments of the present invention. The processor 50 executes various functional applications and data processing of the device by running the software programs, instructions, and modules stored in the memory 51, that is, implements the above-mentioned data processing method.

[0109] The memory 51 may mainly include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the terminal, etc. In addition, the memory 51 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices. In some instances, the memory 51 may further include a memory remotely set relative to the processor 50, and these remote memories can be connected to the device through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0110] The input device 52 can be used to receive environmental image information and generate input of parameters related to the environmental image information related to the user settings and function control of the device. The output device 53 may include a display device such as a display screen.

[0111] The data processing device provided in this embodiment can be applied to the data processing algorithms provided in any of the above embodiments, and has corresponding functions and beneficial effects.

[0112] Embodiment Six

[0113] Embodiment Six of the present invention further provides a storage medium containing computer-executable instructions, and the computer-executable instructions are used to execute a data processing method when executed by a computer processor. The method includes:

[0114] Real-time collect environmental image information;

[0115] Generate a target virtual scene according to the environmental image information;

[0116] Send the target virtual scene to the target user terminal so that the target user terminal reproduces the target virtual scene.

[0117] Of course, for a storage medium containing computer-executable instructions provided in the embodiments of the present invention, the computer-executable instructions are not limited to the method operations as described above, and can also execute the related operations in the data processing methods provided in any embodiments of the present invention.

[0118] Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software and necessary general hardware. Of course, it can also be implemented by hardware, but in many cases the former is a better implementation manner. Based on such an understanding, the technical solution of the present invention, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as a floppy disk, a read-only memory (ROM), a random access memory (RAM), a flash memory (FLASH), a hard disk, or an optical disc of a computer, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present invention.

[0119] It should be noted that in the embodiments of the above data processing method, the various units and modules included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of mutual distinction and do not limit the protection scope of the present invention.

[0120] Note that the above is only the preferred embodiment of the present invention and the technical principles applied. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described here, and various obvious changes, re-adjustments, and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments. Without departing from the concept of the present invention, more other equivalent embodiments can be included, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A data processing method, characterized in that, Including: Real-time acquisition of environmental image information; wherein, the environmental image information includes an environmental image, the acquisition angle of the environmental image, and the actual position of the scene in the environmental image in the target environment; Generating a target virtual scene according to the environmental image information; Sending the target virtual scene to a target client so that the target client reproduces the target virtual scene; Among them, the generating of the target virtual scene according to the environmental image information includes: After obtaining the environmental image information sent by the image acquisition device through the image processing module of the VR device, determining the association relationship of each environmental image according to the acquisition angle of the environmental image and the actual position of the scene in the environmental image in the target environment included in the environmental image information; Sending the environmental image information and the association relationship of each environmental image to a VR scene editor through the image processing module of the VR device; After receiving the information sent by the image processing module through the VR scene editor, generating a target virtual scene according to the association relationship of each environmental image.

2. The method according to claim 1, wherein Generating a target virtual scene according to the environmental image information includes: Selecting a target scene mode from optional scene modes according to the environmental image attributes of the environmental image information; Generating a target virtual scene according to the environmental image information and the target scene mode.

3. The method according to claim 1, wherein If the environmental image information includes at least two frames of environmental images, then generating a target virtual scene according to the environmental image information includes: Generating a sub-virtual scene for each frame of environmental image according to each frame of environmental image; Combining at least two sub-virtual scenes to obtain a target virtual scene.

4. The method according to claim 1, wherein If the environmental image information includes at least two frames of environmental images, then generating a target virtual scene according to the environmental image information includes: Selecting a target environmental image from at least two frames of environmental images; Generating a target virtual scene according to the target environmental image.

5. The method according to claim 4, characterized in that Selecting a target environmental image from at least two frames of environmental images includes: Selecting a target environmental image from at least two frames of environmental images according to demand information and / or the environmental image attributes of each frame of environmental image.

6. The method according to claim 1, wherein Sending the target virtual scene to the target client includes: Determining the participants according to demand information; Regarding the VR devices of the participants as the target client; Sending the target virtual scene to the target client.

7. A data processing device, characterized in that, Including: An environmental image information acquisition module for real-time acquisition of environmental image information; wherein, the environmental image information includes an environmental image, the acquisition angle of the environmental image, and the actual position of the scene in the environmental image in the target environment; A target virtual scene generation module for generating a target virtual scene according to the environmental image information; A target virtual scene sending module for sending the target virtual scene to a target client so that the target client reproduces the target virtual scene; Among them, the target virtual scene generation module is specifically used for: After obtaining the environmental image information sent by the image acquisition device through the image processing module of the VR device, determine the association relationship of each environmental image according to the acquisition angle of the environmental image included in the environmental image information and the actual position of the scene in the environmental image in the target environment; Send the environmental image information and the association relationship of each environmental image to the VR scene editor through the image processing module of the VR device; After receiving the information sent by the image processing module through the VR scene editor, generate a target virtual scene according to the association relationship of each environmental image.

8. The device according to claim 7, characterized in that, The target virtual scene generation module includes: A target scene mode selection unit, configured to select a target scene mode from optional scene modes according to the environmental image attributes of the environmental image information; generate a target virtual scene according to the environmental image information and the target scene mode.

9. A data processing device, characterized in that, The device includes: One or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the data processing method according to any one of claims 1-6.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the data processing method according to any one of claims 1-6.

Images