Virtual reality real-time shooting monitoring system and control method

The VR real-time shooting system addresses the lack of real-time monitoring by integrating modules for immediate image processing and playback, reducing costs and enhancing efficiency through real-time feedback and editing.

CN112912935BActive Publication Date: 2024-12-06郑卜元
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
CN201880098903.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2018-10-25
Publication Date
2024-12-06
Estimated Expiration
2038-10-25

AI Technical Summary

Technical Problem

Current VR shooting systems lack real-time monitoring and adjustment capabilities, leading to increased costs and delays due to the inability to view stitched images in real time, necessitating re-shooting of clips after completion.

Method used

A virtual reality real-time shooting and monitoring system that includes a camera module, first image processing module, output module, editing module, and real-time playback module, allowing for real-time image processing, playback, and adjustment through a single processing unit like a GPU, enabling immediate feedback and editing.

Benefits of technology

Enables real-time monitoring and adjustment of VR content, reducing shooting costs and improving efficiency by allowing immediate confirmation and correction of shots without waiting for the complete VR file to be finished.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112912935B_ABST
    Figure CN112912935B_ABST
Patent Text Reader

Abstract

The present invention discloses a virtual reality real-time shooting and monitoring system, which can be used to allow users to shoot images and play a first virtual reality playback image, and allow users to input image processing control signals and editing instructions into the virtual reality real-time shooting and monitoring system in real time according to the first virtual reality playback image. The virtual reality real-time shooting and monitoring system includes a camera module, a first image processing module, an output module, an editing module and a real-time playback module. The camera module is used to shoot images to generate original images. The first image processing module processes the original images according to the original images and the image processing control signal to generate real-time image temporary storage data. The output module generates the first virtual reality playback image according to the real-time image temporary storage data. The editing module generates editing data according to the real-time image temporary storage data and the editing instruction. The real-time playback module is used to play the first virtual reality playback image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a virtual reality shooting monitoring system and a control method, and in particular to a virtual reality real-time shooting monitoring system and a control method capable of real-time monitoring and adjustment. Background Art

[0002] Generally speaking, when shooting a VR video, the user uses a VR camera with multiple cameras to shoot a 360-degree shooting angle. VR means that the user can see a 360-degree picture without blind spots through a head-mounted VR device, such as a VR (Virtual Reality, VR) helmet, to achieve an immersive experience.

[0003] When shooting a short or feature-length film in virtual reality, it is necessary for the cameraman and director to obtain the created virtual reality content in real time in order to control all the scenes and actors within 360 degrees. However, with the current high-definition recording and complex calculation, it is not possible to view the stitched images in real time. Only the flat unfolded images can be viewed on conventional playback devices, and it is impossible for the cameraman or director to use a virtual reality playback device, such as a VR helmet, to directly view the film from the audience's perspective.

[0004] Therefore, the director may not find out until after the VR film is completed that some clips do not meet the requirements and need to be re-shot, which increases the overall shooting cost and delays the schedule. Summary of the invention

[0005] One of the purposes of the present invention is to disclose a virtual reality real-time shooting monitoring system and control method capable of real-time monitoring and adjustment to solve the above-mentioned problems.

[0006] One embodiment of the present invention discloses a virtual reality real-time shooting and monitoring system, which can be used to allow a user to shoot images and play a first virtual reality playback image, and allow the user to input an image processing control signal and an editing instruction into the virtual reality real-time shooting and monitoring system in real time according to the first virtual reality playback image. The virtual reality real-time shooting and monitoring system includes a camera module, a first image processing module, an output module, an editing module and a real-time playback module. The camera module is used to shoot the image and generate an original image. The first image processing module processes the original image according to the image processing control signal to generate real-time image temporary storage data. The output module generates the first virtual reality playback image according to the real-time image temporary storage data. The editing module generates editing data according to the real-time image temporary storage data and the editing instruction. The real-time playback module is used to play the first virtual reality playback image.

[0007] Another embodiment of the present invention discloses a virtual reality real-time shooting and monitoring control method. The virtual reality real-time shooting and monitoring control method comprises the following steps: shooting the image and generating an original image; processing the original image in real time according to the image processing control signal to generate real-time image temporary storage data; generating a first virtual reality playback image according to the real-time image temporary storage data; and adjusting the image processing control signal according to the first virtual reality playback image.

[0008] Another embodiment of the present invention discloses a control method for a virtual reality real-time shooting and monitoring system, wherein the virtual reality real-time shooting and monitoring system comprises a camera module, a first image processing module, and an output module real-time playback module, wherein the method comprises the following steps: utilizing the camera module to shoot an image and generate an original image; controlling the first image processing module to process the original image in real time according to an image processing control signal to generate real-time image temporary storage data; controlling the output module to generate a first virtual reality playback image according to the real-time image temporary storage data; and controlling the real-time playback module to play the first virtual reality playback image.

[0009] The virtual reality real-time shooting and monitoring system and control method provided by the embodiment of the present invention processes the original image in real time through the first image processing module, allowing the user to view the playback image in real time and make adjustments or edits, thereby reducing shooting costs and increasing shooting efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 It is a functional block diagram of an embodiment of a virtual reality real-time shooting and monitoring system of the present invention.

[0011] Figure 2 It is a functional block diagram of an embodiment of a first image processing module of the present invention.

[0012] Figure 3 It is a schematic diagram of an embodiment of a virtual reality real-time shooting and monitoring system of the present invention.

[0013] Figure 4 It is a flow chart of an embodiment of a virtual reality real-time shooting monitoring control method of the present invention.

[0014] Figure 5 The present invention is a flowchart of a control method of a virtual reality real-time shooting and monitoring system according to an embodiment of the present invention.

[0015] The reference numerals are described as follows:

[0016] 100 Virtual Reality Real-time Shooting and Monitoring System

[0017] 102 Camera Module

[0018] 104 first image processing module

[0019] 106 Output Module

[0020] 108 Editing Module

[0021] 110 Real-time playback module

[0022] 200 Second image processing module

[0023] 300 images

[0024] 302 Original Image

[0025] 304 Real-time image temporary data

[0026] 306 First Virtual Reality Video

[0027] 308 Clipping Instructions

[0028] 310 Image processing control signal

[0029] 312 Clippings

[0030] 314 Second Virtual Reality Playback Image

[0031] 402 Camera Calibration Unit

[0032] 404 Image stitching unit

[0033] 406 Color Correction Unit

[0034] 408 Dual File Recording Unit

[0035] 410 Image playback and alignment unit

[0036] 412 Green Screen Video Unit

[0037] 502 Alignment Information

[0038] 504 Stitched Images

[0039] 506 Correction Image

[0040] 508 Image Matching

[0041] 510 Green Screen Video

[0042] 602 Central Processing Unit

[0043] 604 Graphics Processing Unit

[0044] 606 Memory

[0045] 700 Virtual Reality Real-time Shooting Monitoring Control Method

[0046] 702, 704, 706, 708, Steps 710, 712, 800, 902, 904, 906, 908, 910, 912

[0050] 900 Control method of virtual reality real-time shooting monitoring system DETAILED DESCRIPTION

[0051] Certain words are used in the specification and the preceding claims to refer to specific components. It should be understood by those skilled in the art that manufacturers may use different terms to refer to the same component. This specification and the preceding claims do not use differences in names as a way to distinguish components, but rather use differences in the functions of the components as the basis for distinction. The term "including" mentioned throughout the specification and the preceding claims is an open-ended term and should be interpreted as "including but not limited to". In addition, the term "coupled" herein includes any direct and indirect coupling means. Therefore, if the text describes a first device coupled to a second device, it means that the first device can be directly coupled to the second device, or indirectly coupled to the second device through other devices or connection means.

[0052] Figure 1 1 is a functional block diagram of an embodiment of a virtual reality real-time shooting and monitoring system 100 of the present invention. The virtual reality real-time shooting and monitoring system 100 may include (but is not limited to) a camera module 102, a first image processing module 104, an output module 106, an editing module 108 and a real-time playback module 110.

[0053] The camera module 102 can be used to capture an image 300 and generate an original image 302. The camera module 102 can include multiple lenses (not shown) to capture an image 300 in the real world. The original image 302 is, for example, multiple images captured by multiple lenses that have not been stitched together. The file format of the original image 302 can be a RAW file or other appropriate format. In some embodiments, the camera module 102 can have multiple hardware functions, such as lens calibration, white balance calibration, shutter control, image signal gain, frame setting, etc. For example, lens calibration can be used to calibrate the lens; white balance calibration can be applied to different scenarios, such as strong light, dusk, indoors, outdoors, fluorescent lamps or tungsten lamps, etc., or adjust the color temperature based on the needs of the user U; shutter control can control the amount of light entering, exposure time, etc.; image signal gain can enhance the image contrast under weak light sources; frame setting can set the picture frame to, for example, 24 frames, 30 frames, etc. In some embodiments, the camera module 102 can adjust the above hardware functions according to the image processing control signal 310 input by the user U.

[0054] The first image processing module 104 processes the original image 302 according to a default value (not shown) or an image processing control signal 310 to generate real-time image temporary data 304. In some embodiments, after receiving the original image 302 that has not been stitched, the first image processing module 104 can process the original image 302 in real time according to the default value or according to the image processing control signal 310 input by the user U, and then generate real-time image temporary data 304. In some embodiments, the first image processing module 104 includes a graphics processing unit (GPU). In other words, the first image processing module 104 can use the GPU to process the original image 302, and there is no need to transmit the original image 302 to the central processing unit (CPU) for processing, thereby reducing the image processing time. Among them, the file format of the real-time image temporary data 304 can be a coding format with a smaller file capacity such as H.264. In addition, the first image processing module 104 can generate the original image temporary data 302T according to the original image 302.

[0055] The output module 106 generates a first virtual reality playback image 306 according to the real-time image temporary storage data 304. In some embodiments, the output module 106 converts the real-time image temporary storage data 304 into a file format that can be played by the real-time playback module 110. For example, the output module 106 can be some specific VR application programming interface (application programmable interface, API), which can convert the real-time image temporary storage data 304 into the first virtual reality playback image 306 in a file format that can be played by a specific VR helmet.

[0056] The editing module 108 generates editing data 312 according to the real-time image temporary storage data 304 and the editing instruction 308. In some embodiments, after the user U watches the first virtual reality playback image 306 through the real-time playback module 110, the user can input the editing instruction 308 to the editing module 108 to edit the real-time image temporary storage data 304, and the editing module 108 will generate the editing data 312 according to the real-time image temporary storage data 304 and the editing instruction 308. The file format of the editing data 312 can be, for example, an EDL file.

[0057] The real-time playback module 110 is used to play the first virtual reality playback image 306, so that the user U can watch the first virtual reality playback image 306 through the real-time playback module 110. The real-time playback module 110 is, for example, a head mounted display monitor (HMD monitor) or a VR helmet.

[0058] In addition, the virtual reality real-time shooting monitoring system 100 can be further coupled to the second image processing module 200. The second image processing module 200 is, for example, included in the image post-production system. The second image processing module 200 receives the original image temporary storage data 302T and the editing data 312, and outputs the second virtual reality playback image 314. The second virtual reality playback image 314 is, for example, a complete virtual reality image file. That is to say, when the user confirms that the shooting is completed at the shooting site and performs preliminary editing in real time, the second image processing module 200 can be used to generate a further second virtual reality playback image 314 based on the original image temporary storage data 302T and the editing data 312 afterwards.

[0059] As described above, the virtual reality real-time shooting and monitoring system 100 can be used to allow the user U to shoot an image 300 and play the first virtual reality playback image 306 , and allow the user U to input the image processing control signal 310 and the editing instruction 308 into the virtual reality real-time shooting and monitoring system 100 in real time according to the first virtual reality playback image 306 .

[0060] Specifically, in the virtual reality real-time shooting and monitoring system 100 of the present invention, the user U can watch the first virtual reality playback image 306 generated by the camera module 102 through the real-time playback module 110, and can adjust the settings of the camera module 102 or the first image processing module 104 again according to the first virtual reality playback image 306 to re-shoot or re-shoot certain clips, so that the user can confirm the shooting results in real time to improve the efficiency of the shooting process.

[0061] In addition, the user U can also edit the real-time image temporary data 304 at the same time, and finally, when the user U confirms that all the shooting results meet the requirements, the complete virtual reality image file is produced through the image post-production system. In other words, the user does not need to record the edited data manually as in the prior art, but can watch the image in real time and edit it, and generate the edited data 312 in real time, thereby avoiding the errors that may be caused by manual recording.

[0062] The virtual reality real-time shooting and monitoring system 100 of the present invention does not simply convert the file format and presentation method of the image, but concentrates the image processing procedures in a single processing unit (such as GPU) to reduce the image processing time. Through the technical means proposed here, the user U can confirm the shooting results in real time and adjust or edit the image, and no longer needs to wait until the complete virtual reality image file is completed before confirming the shooting results. In this way, the overall shooting cost can be reduced and the shooting efficiency can be increased.

[0063] Figure 2 4 is a functional block diagram of an embodiment of a first image processing module 104 of the present invention. In some embodiments, the first image processing module 104 may include (but is not limited to) a camera calibration unit 402, an image stitching unit 404, a color calibration unit 406, a dual file recording unit 408, an image playback and alignment unit 410, and a green screen image unit 412.

[0064] The camera calibration unit 402 outputs the alignment information 502 according to the original image 302. The alignment information 502 is the camera module 102 (displayed on Figure 1 ) can be, for example, latitude and longitude (LatLong) information. Specifically, the camera calibration unit 402 can use the X-axis to store red color levels and the Y-axis to store green color levels, thereby generating a color definition table, which is then calculated by image stitching software (such as PTGui) to generate camera calibration parameters to redefine the positions of the lenses.

[0065] The image stitching unit 404 outputs the stitched image 504 according to the original image 302 and the alignment information 502. The image stitching unit 404 can stitch the original image 302 (e.g., images taken by multiple lenses) into the stitched image 504 (i.e., a panoramic image) in real time. The resolution of the stitched image 504 can be adjusted as required.

[0066] The color correction unit 406 outputs the corrected image 506 according to the stitched image 504. After receiving the stitched image 504, the color correction unit 406 can correct the color of the stitched image 504 in real time by using a lookup table (LUT) such as color grading through mapping.

[0067] The dual-file recording unit 408 generates the real-time image temporary data 304 according to the corrected image 506, and generates the original image temporary data 302T according to the original image 302. The dual-file recording unit 408 can simultaneously record the original image temporary data 302T for post-production of a complete virtual reality image file and the real-time image temporary data 304 (for example, in H.264 format) for real-time playback, and the real-time image temporary data 304 can be used for real-time playback.

[0068] The image playback and alignment unit 410 generates an alignment image 508 based on the real-time image temporary data 304. The image playback and alignment unit 410 can output the alignment image 508 to the image stitching unit 404, and the image stitching unit 404 can generate a stitched image 504 based on the original image 302, the alignment information 502 and the alignment image 508. In some embodiments, the alignment image 508 can be an image with high transparency. That is, for example, the image stitching unit 404 can stitch the alignment image 508 obtained by the previous shooting with the newly shot original image 302, so that the user can confirm whether the relative positions of various objects in the scene of the newly shot original image 302 are correct through the alignment image 508. In addition, the image playback and alignment unit 410 can also output the alignment image 508 to the green screen image unit 412.

[0069] The green screen image unit 412 generates a green screen image 510 to the image stitching unit 404 according to the alignment image 508. That is, for example, when some parts of some scenes need post-production special effects or are combined with other images, the green screen image unit 412 can convert the alignment image 508 into a green screen image 510 that can be matched with the green screen, so that the image stitching unit 404 can generate a stitched image 504 according to the original image 302, the alignment information 502 and the green screen image 510.

[0070] In summary, the first image processing module 104 of the present invention can simultaneously record the original image temporary data 302T for post-production and the real-time image temporary data 304 for real-time playback through the dual file recording unit 408, and through various functions, the user can adjust each functional module through the image processing control signal 310 after real-time viewing. The first image processing module 104 of the present invention does not simply convert the file format and presentation method of the image, but concentrates the image processing program in a single processing unit (such as GPU) to reduce the image processing time. In this way, the user can confirm the shooting results in real time and adjust or edit the image without waiting until the complete virtual reality image file is completed before confirming the results. In this way, the overall shooting cost can be reduced and the shooting efficiency can be increased.

[0071] Figure 36 is a schematic diagram of an embodiment of a virtual reality real-time shooting and monitoring system 100 of the present invention. In some embodiments, the internal components of the virtual reality real-time shooting and monitoring system 100 may include a central processing unit (CPU) 602, a graphics processing unit (GPU) 604, and a memory 606. The CPU 602 may be configured to perform general processing of the virtual reality real-time shooting and monitoring system 100, the GPU 604 may be configured to perform specific graphics-intensive calculations, and the memory 606 may provide volatile and / or non-volatile data storage.

[0072] The CPU 602 and / or the GPU 604 may be configured to adjust parameters for image stitching, or send updated parameters (or instructions) to the camera module 102. The above adjustments may be based on the user's image processing control signal 310. In some embodiments, such as Figure 2 The first image processing module 104 shown may include a GPU 604, or the first image processing module 104 may be executed by the GPU 604. Thus, the original image 302 does not need to be transmitted to the CPU 602 for processing, which can reduce the image processing time and system resource consumption.

[0073] Others Figure 1 The output module 106 or the editing module 108 in the video processing unit 100 may be executed by the CPU 602 and / or the GPU 604 according to the user's settings.

[0074] Figure 4 It is a flowchart of an embodiment of a virtual reality real-time shooting and monitoring control method 700 of the present invention. The virtual reality real-time shooting and monitoring control method 700 includes (but is not limited to) the following steps. Step 702, shooting an image and generating an original image. Step 704, processing the original image in real time according to the image processing signal to generate real-time image temporary storage data. Step 706, generating a first virtual reality playback image according to the real-time image temporary storage data. Step 708, adjusting the image processing control signal according to the first virtual reality playback image. Step 710, judging whether to stop shooting the image according to the first virtual reality playback image. Step 712, after stopping shooting the image, editing the real-time image temporary storage data. When the judgment of step 710 is no, return to step 702 to shoot the image again.

[0075] Finally, after the virtual reality real-time shooting and monitoring control method 700 is finished, in step 800, a second virtual reality playback image is generated based on the original image generated by the virtual reality real-time shooting and monitoring control method 700 and the edited real-time image temporary storage data. Figure 1 , Figure 2 and Figure 3 This is described in detail in , and will not be repeated here.

[0076] Figure 5 It is a flowchart of an embodiment of a control method 900 of a virtual reality real-time shooting and monitoring system of the present invention. The virtual reality real-time shooting and monitoring system includes a camera module, a first image processing module, an output module, an editing module and a real-time playback module. The control method 900 of the virtual reality real-time shooting and monitoring system includes (but is not limited to) the following steps. Step 902, using the camera module to shoot an image and generate an original image. Step 904, controlling the first image processing module to process the original image in real time according to the image processing control signal to generate real-time image temporary storage data. Step 906, controlling the output module to generate a first virtual reality playback image according to the real-time image temporary storage data. Step 908, controlling the real-time playback module to play the first virtual reality playback image. Step 910, judging whether to stop using the camera module to shoot the image according to the first virtual reality playback image. Step 912, after stopping shooting the image, controlling the editing module to generate editing data according to the real-time image temporary storage data and the editing instruction. Since the virtual reality real-time shooting and monitoring system and its control method have been in Figure 1 , Figure 2 and Figure 3 This is described in detail in , and will not be repeated here.

[0077] In summary, in the virtual reality real-time shooting monitoring system and control method of the present invention, the user can watch the first virtual reality playback image generated by the camera module through the real-time playback module, instead of the prior art where the monitoring system can only generate a plane image and the user must imagine the virtual reality screen on site based on the plane image to direct the shooting. In other words, in the prior art, the user cannot view the image at the angle closest to the virtual reality finished product during the shooting process. Furthermore, the user can also adjust the settings of the camera module or the first image processing module again based on the first virtual reality playback image, and decide on the spot whether to reshoot or reshoot certain clips, so that the user can improve the shooting efficiency and reduce the shooting cost by confirming the shooting results in real time.

[0078] In addition, users can also edit the images they have taken, and when they have confirmed that all the shooting results meet their requirements, they can create a complete virtual reality image file through the image post-production system. In other words, users do not need to manually record the editing data as in the prior art, but can watch the images and edit them in real time, and generate editing data in real time, thereby avoiding possible errors caused by manual recording and improving efficiency.

[0079] The virtual reality real-time shooting monitoring system and control method of the present invention does not simply convert the file format and presentation method of the image, but concentrates the image processing program in a single processing unit (such as GPU) to speed up the image processing time. Through the technical means proposed here, the user can adjust or edit the image in real time, and no longer needs to wait until the complete virtual reality image file is completed before confirming the results.

[0080] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A virtual reality real-time shooting and monitoring system, which can be used to allow a user to shoot an image and play a first virtual reality playback image, and allow the user to input an image processing control signal and an editing instruction into the virtual reality real-time shooting and monitoring system in real time according to the first virtual reality playback image. It is characterized in that The system comprises: A camera module, used for capturing the image and generating a raw image according to a default value; A first image processing module processes the original image according to the image processing control signal to generate real-time image temporary storage data; An output module, generating the first virtual reality playback image according to the real-time image temporary storage data; An editing module, generating editing data according to the real-time image temporary storage data and the editing instruction; as well as A real-time playback module is used to play the first virtual reality playback image. The camera module is further used to re-shoot the image according to the image processing control signal to generate an updated original image, wherein the image is re-shot according to the image processing control signal based on the content of the first virtual reality playback image. The first image processing module is further used for processing the updated original image according to the image processing control signal to generate updated real-time image temporary storage data, wherein the updated real-time image temporary storage data is different from the real-time image temporary storage data.

2. The virtual reality real-time shooting and monitoring system as claimed in claim 1, It is characterized in that The first image processing module comprises: A camera calibration unit, outputting alignment information according to the original image; An image stitching unit, outputting a stitched image according to the original image and the alignment information; a color correction unit, outputting a corrected image according to the stitched image; and The dual file recording unit generates the real-time image temporary storage data according to the corrected image, and generates the original image temporary storage data according to the original image.

3. The virtual reality real-time shooting and monitoring system as claimed in claim 2, It is characterized in that The first image processing module further comprises: The image playback and alignment unit generates an aligned image according to the real-time image temporary storage data.

4. The virtual reality real-time shooting and monitoring system as claimed in claim 3, It is characterized in that The image stitching unit generates the stitched image according to the original image, the alignment information and the aligned image.

5. The virtual reality real-time shooting and monitoring system as claimed in claim 3, It is characterized in that The first image processing module further comprises: A green screen imaging unit generates a green screen image according to the alignment image and sends it to the image stitching unit. The image stitching unit generates the stitched image according to the original image, the alignment information and the green screen image.

6. The virtual reality real-time shooting and monitoring system as claimed in claim 1, It is characterized in that The first image processing module includes a graphics processing unit (GPU).

7. A virtual reality real-time shooting monitoring control method, It is characterized in that The method comprises: Capture images and generate raw images according to default values; Processing the original image in real time according to the image processing control signal to generate real-time image temporary storage data; Generating a first virtual reality playback image according to the real-time image temporary storage data; adjusting the image processing control signal according to the first virtual reality playback image; re-shooting the image according to the image processing control signal to generate an updated original image, wherein the image re-shooting is based on the image processing control signal generated based on the first virtual reality playback image; and Processing the updated original image in real time according to the image processing control signal to generate updated real-time image temporary data, The updated real-time image temporary storage data is different from the real-time image temporary storage data.

8. The virtual reality real-time shooting monitoring control method as claimed in claim 7, It is characterized in that The method further comprises: Determine whether to stop shooting the image according to the first virtual reality playback image.

9. The virtual reality real-time shooting monitoring control method as claimed in claim 8, It is characterized in that The method further comprises: After stopping shooting the image, the real-time image temporary data is clipped.

10. The virtual reality real-time shooting monitoring control method according to claim 9, It is characterized in that The method further comprises: A second virtual reality playback image is generated according to the original image and the clipped real-time image temporary storage data.

11. A control method for a virtual reality real-time shooting and monitoring system, the virtual reality real-time shooting and monitoring system comprising a camera module, a first image processing module, an output module, a editing module and a real-time playback module, It is characterized in that The method comprises: Using the camera module to capture images according to default values ​​and generate original images; Controlling the first image processing module to process the original image in real time according to the image processing control signal to generate real-time image temporary data; Controlling the output module to generate a first virtual reality playback image according to the real-time image temporary storage data; Controlling the real-time playback module to play the first virtual reality playback image; Controlling the camera module to re-shoot the image according to the image processing control signal to generate an updated original image, wherein the image is re-shot according to the image processing control signal based on the content of the first virtual reality playback image; The first image processing module is controlled to process the updated original image in real time according to the image processing control signal to generate updated real-time image temporary data, wherein the updated real-time image temporary data is different from the real-time image temporary data.

12. The control method of the virtual reality real-time shooting and monitoring system according to claim 11, It is characterized in that The method further comprises: Determine whether to stop using the camera module to shoot the image according to the first virtual reality playback image.

13. The control method of the virtual reality real-time shooting and monitoring system according to claim 12, It is characterized in that The method further comprises: After stopping shooting the image, the editing module is controlled to generate editing data according to the real-time image temporary storage data and the editing instruction.

Citation Information

Patent Citations

  • System for filming a video movie

    CN104094318A

  • Reality enhancement shooting system and method

    CN106097435A

  • Method for VR video editing based on GPU

    CN106296588A

  • 3D stereo shooting method for mobile phone

    CN106713893A

  • Panoramic real-time image processing method

    CN108206909A