Video playing method, camera and virtual reality system
By combining a camera and a virtual reality headset, a low-cost VR experience is provided, solving the problem of the high cost of existing VR devices, achieving a three-dimensional and immersive VR experience, and increasing the flexibility and interactivity of the device.
Patent Information
- Application Number
- CN202411958866.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-26
- Publication Date
- 2026-06-26
Smart Images

Figure CN122293841A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of virtual reality technology, and more specifically, to a video playback method, a camera, and a virtual reality system. Background Technology
[0002] In the digital age, Virtual Reality (VR) technology, with its unique immersiveness and interactivity, has brought users an unprecedented visual experience. Existing VR devices are all standalone units, which have high manufacturing costs and are expensive. Summary of the Invention
[0003] One objective of this disclosure is to provide a new technical solution for a virtual reality system.
[0004] According to a first aspect of this disclosure, a virtual reality system is provided, comprising: a camera and a virtual reality glasses box, wherein the camera includes a first display screen, a second display screen, a first wide-angle camera and a second wide-angle camera, and the virtual reality glasses box includes binocular optical components;
[0005] The cameras store a first video and a second video, wherein the first video is captured by the first wide-angle camera and the second video is captured by the second wide-angle camera.
[0006] When the camera is placed in the virtual reality glasses box and a target video is selected from the captured videos, the first display screen is used to play and display a first video from the target video, and the second display screen is used to play and display a second video from the target video, so that the user can view the images played and displayed on the first display screen and the second display screen through the binocular optical components.
[0007] Optionally, if the camera is not placed in the virtual reality glasses box and a target video is selected from the captured videos, the target video is played on one of the first and second displays, and a touch interface is displayed on the other of the first and second displays.
[0008] Optionally, the touch interface displays shooting interaction controls and video playback interaction controls.
[0009] Optionally, the camera is equipped with a video selection button, allowing the user to select the target video by triggering the video selection button; or,
[0010] The virtual reality system also includes a controller, which is connected to the camera to allow the user to select the target video by operating the controller.
[0011] According to a second aspect of this disclosure, a video playback method is provided, applied to a virtual reality system as described in any of the first aspects, comprising:
[0012] In response to a user triggering the playback of a target video, determine whether the camera is placed in the virtual reality glasses box;
[0013] With the camera placed in the virtual reality glasses box, the first display screen is controlled to play a first video from the target video, and the second display screen is controlled to play a second video from the target video, so that the user can view the images played on the first display screen and the second display screen through the binocular optical components.
[0014] Optionally, the method further includes: when the camera is not placed in the virtual reality glasses box, controlling one of the first display screen and the second display screen to play the target video, and the other display screen to display a touch interface.
[0015] Optionally, the camera includes a photosensor, wherein determining whether the camera is placed in the virtual reality glasses case includes:
[0016] Obtain the light intensity value collected by the photosensitive sensor;
[0017] If the light intensity value is less than a preset intensity value, it is determined that the camera is placed in the virtual reality glasses box.
[0018] Optionally, the camera further includes a pose information acquisition component, which is used to acquire the pose data of the camera; wherein, the method further includes:
[0019] When the camera is recording video, the camera's pose data is determined based on the data collected by the pose information acquisition component.
[0020] Establish a correspondence between the camera's pose data and each frame of the video being captured;
[0021] Based on the pose data corresponding to each frame of the image, determine the pose data of the virtual camera;
[0022] Virtual elements are generated in the corresponding image using the pose data of the virtual camera.
[0023] According to a third aspect of this disclosure, a camera is provided, comprising:
[0024] A location determination module is used to determine whether the camera is placed in the virtual reality glasses box in response to a user triggering video playback.
[0025] The control module is configured to, when the camera is placed in the virtual reality glasses box, control the first display screen to play a first video from the target video and the second display screen to play a second video from the target video, so that the user can view the images played and displayed on the first display screen and the second display screen through the binocular optical components.
[0026] According to a fourth aspect of this disclosure, a camera is provided, including a memory and a processor, the memory storing a computer program for controlling the processor to operate in order to perform the method according to any one of the first aspects.
[0027] The virtual reality system provided by this invention, through the combined use of a camera and a virtual reality glasses box, makes the images seen by the user and captured by the camera have a sense of three-dimensionality and immersion.
[0028] The features and advantages of the embodiments of this specification will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description
[0029] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments of this specification and, together with their description, serve to explain the principles of these embodiments.
[0030] Figure 1 This is a schematic diagram of a virtual reality system according to an embodiment of the present invention.
[0031] Figure 2 This is a schematic diagram of a camera according to an embodiment of the present invention.
[0032] Figure 3 This is a schematic diagram of a camera according to an embodiment of the present invention.
[0033] Figure 4 This is a flowchart of a video playback method according to an embodiment of the present invention.
[0034] Figure 5 This is a schematic block diagram of a camera according to an embodiment of the present invention.
[0035] Figure 6 This is a hardware structure block diagram of a camera according to an embodiment of the present invention. Detailed Implementation
[0036] Various exemplary embodiments of this specification will now be described in detail with reference to the accompanying drawings.
[0037] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the embodiments of this specification or their application or use.
[0038] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.
[0039] One embodiment of the present invention provides a virtual reality system. According to... Figure 1 As shown, the virtual reality system includes a camera 110 and a virtual reality glasses box 120. The camera 110 and the virtual reality glasses box 120 can be used together, and the camera 110 can also be used independently.
[0040] according to Figure 2 As shown, the camera includes a first wide-angle camera 111 and a second wide-angle camera 112.
[0041] according to Figure 3 As shown, the camera also includes a first display screen 113 and a second display screen 114.
[0042] The virtual reality headset includes a binocular optical component. This component comprises two sets of optical lenses. These lenses simulate the human eye's perception of objects, giving the user a three-dimensional view.
[0043] The camera stores a first video and a second video. The first video was captured by the first wide-angle camera, and the second video was captured by the second wide-angle camera.
[0044] In this embodiment, when the camera is placed in the virtual reality glasses box and a target video is selected from the captured videos, the first display screen is used to play the first video in the target video, and the second display screen is used to play the second video in the target video, so that the user can view the images played on the first display screen and the second display screen through binocular optical components.
[0045] The selection of a target video from various captured videos can be achieved in any of the following ways. For example, the camera may have a video selection button, allowing the user to trigger the button to select the target video. Alternatively, the virtual reality system may include a controller. The controller and camera are connected, allowing the user to operate the controller to select the target video. The connection between the controller and camera can be a Wi-Fi connection or a Bluetooth connection.
[0046] The virtual reality system provided in this embodiment, through the combined use of a camera and a virtual reality glasses box, makes the images seen by the user and captured by the camera have a sense of three-dimensionality and immersion.
[0047] In some embodiments, when the camera is not placed in the virtual reality headset box and a target video is selected from the captured videos, the target video is played on one of the first and second displays, while a touch interface is displayed on the other display. For example, the first display plays a first video from the target video, and the second display shows the touch interface. As another example, the first display shows the touch interface, and the second display plays a second video from the target video.
[0048] The touch interface displays shooting and video playback controls. The shooting controls include controls for managing the shooting process and controls for adjusting shooting parameters. Controls for managing the shooting process include a start shooting button and a finish shooting button. Controls for adjusting shooting parameters include a focus button, a flash-on button, and a beauty mode button.
[0049] In this embodiment, the camera can be used independently of the virtual reality glasses box, increasing the functionality of the virtual reality system.
[0050] Figure 4 A flowchart of a video playback method according to an embodiment of the present disclosure is shown. This method is applied to a virtual reality system provided in any of the above embodiments. Figure 1 As shown, the method includes steps S410 to S420.
[0051] Step S410: In response to the user triggering the playback of the target video, determine whether the camera is placed in the virtual reality glasses box.
[0052] In step S420, with the camera placed in the virtual reality glasses box, the first display screen is controlled to play the first video in the target video, and the second display screen is controlled to play the second video in the target video, so that the user can view the images displayed on the first display screen and the second display screen through binocular optical components.
[0053] In this embodiment, the playback mode of the camera is determined based on whether the camera is placed in the virtual reality glasses box, realizing automatic switching of the camera playback mode without manual operation. On the other hand, through the combined use of the camera and the virtual reality glasses box, the images seen by the user and captured by the camera have a sense of three-dimensionality and immersion.
[0054] In some embodiments, the method further includes: controlling one of the first and second displays to play a target video when the camera is not placed in the virtual reality glasses box, and the other display to show a touch interface.
[0055] In some embodiments, the camera includes a photosensor. Determining whether the camera is placed within the virtual reality headset specifically includes: acquiring a light intensity value collected by the photosensor; if the light intensity value is less than a preset intensity value, determining that the camera is placed within the virtual reality headset; if the light intensity value is greater than or equal to the preset intensity value, determining that the camera is not placed within the virtual reality headset.
[0056] There are other ways to determine whether the camera is placed in the virtual reality headset box, such as by using a distance sensor or a pressure sensor set in the camera.
[0057] In some embodiments, the camera further includes a pose information acquisition component. The pose information acquisition component is used to acquire the camera's pose data. The camera's pose data can reflect the dynamic changes of the camera in real space. The pose information component includes an inertial sensor and a positioning camera. Figure 2 As shown, the camera also includes two positioning cameras 115.
[0058] In this embodiment, the method further includes: when the camera is shooting video, determining the camera's pose data based on the data collected by the pose information acquisition component; establishing a correspondence between the camera's pose data and each frame of the video being shot; determining the pose data of the virtual camera based on the pose data corresponding to each frame; and generating virtual elements in the corresponding images using the pose data of the virtual camera.
[0059] The acquired camera pose data is correlated with each frame captured during video recording, meaning each frame corresponds to a single camera pose data point. Based on the pose data for each frame, the virtual camera's pose data in virtual space is determined to ensure its motion in the virtual world mirrors its motion in the real world. Using the virtual camera's pose data, virtual elements are synthesized or added to the corresponding image frames. These virtual elements can be 3D models, animations, or text. In this embodiment, precise pose matching allows the virtual elements generated in the corresponding images to blend more naturally into the real-world video footage, enhancing the user's viewing experience. This approach can be applied to various fields such as film production, game development, and advertising.
[0060] This embodiment provides a camera for implementing any of the above method embodiments. Figure 5 A structural block diagram of a camera according to an embodiment of the present disclosure is shown. Figure 5 As shown, the camera 500 includes a position determination module 510 and a control module 520.
[0061] The position determination module 510 is used to determine whether the camera is placed in the virtual reality glasses box in response to the user triggering video playback.
[0062] The control module 520 is used to control the first display screen to play the first video in the target video and the second display screen to play the second video in the target video when the camera is placed in the virtual reality glasses box, so that the user can view the images displayed on the first display screen and the second display screen through binocular optical components.
[0063] In some embodiments, the control module 520 is also configured to control one of the first and second displays to play the target video and the other display to show the touch interface when the camera is not placed in the virtual reality glasses box.
[0064] In some embodiments, the camera includes a photosensor. The position determination module 510 is used to acquire the light intensity value collected by the photosensor; if the light intensity value is less than a preset intensity value, it is determined that the camera is placed in the virtual reality glasses box. If the light intensity value is greater than or equal to the preset intensity value, it is determined that the camera is not placed in the virtual reality glasses box.
[0065] In some embodiments, the camera further includes a pose information acquisition component, which is used to acquire the pose data of the camera. The camera also includes a virtual element generation module. The virtual element generation module is used to, when the camera is recording video, determine the camera's pose data based on the data acquired by the pose information acquisition component; establish a correspondence between the camera's pose data and each frame of the video being recorded; determine the pose data of a virtual camera based on the pose data corresponding to each frame; and generate virtual elements in the corresponding images using the virtual camera's pose data.
[0066] This disclosure also provides a camera for implementing any of the above method embodiments. Figure 6 A hardware block diagram of a camera 600 according to one embodiment of the present disclosure is shown. Figure 6 As shown, the camera 600 includes a processor 610 and a memory 620 for storing executable instructions of the processor 610. The processor 610 is configured to implement the method according to any embodiment of this disclosure when executing the instructions stored in the memory 620.
[0067] The processor 610 is used to execute computer instructions, which can be written using instruction sets of architectures such as x86, Arm, RISC, MIPS, and SSE. The memory 620 includes, for example, ROM (Read-Only Memory), RAM (Random Access Memory), and non-volatile memory such as a hard disk, etc., and is not limited thereto.
[0068] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. For the apparatus embodiments, relevant parts can be referred to the descriptions in the method embodiments.
[0069] The foregoing has described specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than that shown in the embodiments and may still achieve the desired result. Furthermore, the processes depicted in the drawings do not necessarily require the specific or sequential order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are possible or may be advantageous.
[0070] Embodiments of this specification may be systems, methods, and / or computer program products. A computer program product may include a computer-readable storage medium having computer instructions stored thereon for causing a processor to implement various aspects of the embodiments of this specification.
[0071] Computer-readable storage media can be tangible devices capable of holding and storing computer instructions for use by computer instruction execution devices. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing computer instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.
[0072] The computer instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network layer, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network layer may include copper cables, fiber optic cables, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network layer adapter card or network layer interface in each computing / processing device receives computer instructions from the network layer and forwards those instructions for storage on computer-readable storage media within the respective computing / processing device.
[0073] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this specification. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of computer instructions, which contains one or more executable computer instructions for implementing a specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions. It will be known to those skilled in the art that implementation in hardware, implementation in software, and implementation using a combination of software and hardware are equivalent.
[0074] Various embodiments of this specification have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.
Claims
1. A virtual reality system, characterized in that, include: A camera and a virtual reality glasses box, wherein the camera includes a first display screen, a second display screen, a first wide-angle camera and a second wide-angle camera, and the virtual reality glasses box includes binocular optical components; The cameras store a first video and a second video, wherein the first video is captured by the first wide-angle camera and the second video is captured by the second wide-angle camera. When the camera is placed in the virtual reality glasses box and a target video is selected from the captured videos, the first display screen is used to play and display the first video in the target video, and the second display screen is used to play and display the second video in the target video, so that the user can view the images played and displayed on the first display screen and the second display screen through the binocular optical components.
2. The virtual reality system according to claim 1, characterized in that, When the camera is not placed in the virtual reality glasses box and a target video is selected from the captured videos, the target video is played on one of the first display screen and the second display screen, and a touch interface is displayed on the other of the first display screen and the second display screen.
3. The virtual reality system according to claim 2, characterized in that, The touch interface displays interactive controls for shooting and video playback.
4. The virtual reality system according to any one of claims 1-3, characterized in that, The camera is equipped with a video selection button, which allows the user to select the target video by triggering the video selection button; or... The virtual reality system also includes a controller, which is connected to the camera to allow the user to select the target video by operating the controller.
5. A video playback method, characterized in that, Applied to any one of the virtual reality systems described in claims 1-4, comprising: In response to a user triggering the playback of a target video, determine whether the camera is placed in the virtual reality glasses box; With the camera placed in the virtual reality glasses box, the first display screen is controlled to play a first video from the target video, and the second display screen is controlled to play a second video from the target video, so that the user can view the images played and displayed on the first display screen and the second display screen through the binocular optical components.
6. The method according to claim 5, characterized in that, The method further includes: When the camera is not placed in the virtual reality glasses box, control one of the first display screen and the second display screen to play the target video, and control the other of the first display screen and the second display screen to display the touch interface.
7. The method according to claim 5, characterized in that, The camera includes a photosensor, wherein determining whether the camera is placed in the virtual reality glasses box includes: Obtain the light intensity value collected by the photosensitive sensor; If the light intensity value is less than a preset intensity value, it is determined that the camera is placed in the virtual reality glasses box.
8. The method according to any one of claims 5-7, characterized in that, The camera further includes a pose information acquisition component, which is used to acquire the pose data of the camera; wherein, the method further includes: When the camera is recording video, the camera's pose data is determined based on the data collected by the pose information acquisition component. Establish a correspondence between the camera's pose data and each frame of the video being captured; Based on the pose data corresponding to each frame of the image, determine the pose data of the virtual camera; Virtual elements are generated in the corresponding image using the pose data of the virtual camera.
9. A camera, characterized in that, include: A location determination module is used to determine whether the camera is placed in the virtual reality glasses box in response to a user triggering video playback. The control module is configured to, when the camera is placed in the virtual reality glasses box, control the first display screen to play a first video from the target video and the second display screen to play a second video from the target video, so that the user can view the images played and displayed on the first display screen and the second display screen through the binocular optical components.
10. A camera, characterized in that, It includes a memory and a processor, the memory storing a computer program for controlling the processor to operate in order to perform the method according to any one of claims 5-8.