Multifunctional Camera Module and VR Device

Abstract

The present invention provides a multifunctional camera module and a VR device. The multifunctional camera module includes: a beam splitting mechanism, an attitude sensor, and a color sensor. The beam splitting mechanism has a light incident surface, a first light output surface, and a second light output surface; the attitude sensor is disposed on one side of the first light output surface; the color sensor is disposed on one side of the second light output surface; the beam splitting mechanism is configured to decompose the incident light incident from the light incident surface into a first output light that is emitted from the first light output surface to the attitude sensor, or decompose the incident light incident from the light incident surface into a second output light that is emitted from the second light output surface to the color sensor. The technical solution of the present invention decomposes the incident light into two optical paths in different directions through the beam splitting mechanism, and cooperates with different sensor components to achieve different functions. Thus, only one camera module is required to implement multiple functions, saving the product design space and improving the product integration degree.

Description

Technical Field

[0001] The present invention relates to the technical field of VR, and particularly to a multifunctional camera module and a VR device. Background Art

[0002] In the current prior art, different functional sensors, chips, etc. are also widely used on VR devices. With the increasingly complex and diverse demands of the industry, in addition, more functional devices with other functions need to be assembled. Different functional devices operate independently of each other, resulting in low integration, which in turn leads to an increase in the overall volume of the device and an increase in cost. Summary of the Invention

[0003] The main object of the present invention is to provide a multifunctional camera module and a VR device, aiming to solve the problems in the prior art that different functional sensor devices on VR devices operate independently of each other, resulting in low integration, an increase in the overall volume of the device, and an increase in cost.

[0004] To achieve the above object, the present invention proposes a multifunctional camera module, and the multifunctional camera module includes:

[0005] A beam splitting mechanism, which has an incident light surface, a first outgoing light surface, and a second outgoing light surface;

[0006] An attitude sensor, which is arranged on one side of the first outgoing light surface;

[0007] A color sensor, which is arranged on one side of the second outgoing light surface;

[0008] The beam splitting mechanism is configured to decompose the incident light incident from the incident light surface into a first outgoing light that is emitted from the first outgoing light surface to the attitude sensor, or decompose the incident light incident from the incident light surface into a second outgoing light that is emitted from the second outgoing light surface to the color sensor.

[0009] Optionally, the beam splitting mechanism includes:

[0010] A polarization beam splitting prism, and the incident light surface, the first outgoing light surface, and the second outgoing light surface are respectively arranged on three different side surfaces of the polarization beam splitting prism;

[0011] A polarizer assembly, which is movably arranged on one side of the incident light surface.

[0012] Optionally, the polarizer assembly includes:

[0013] An S-polarizer and a P-polarizer, and the S-polarizer and the P-polarizer are arranged at intervals along the incident light direction, and the incident light passes through the S-polarizer and / or the P-polarizer and enters the incident light surface to form an optical path;

[0014] A driving member, which is respectively connected to the S polarizer and the P polarizer;

[0015] The driving member is used to drive the S polarizer to move away from or move to the optical path, or drive the P polarizer to move away from or move to the optical path.

[0016] Optionally, the multifunctional camera module further includes:

[0017] A detection sensor, which is electrically connected to the light splitting mechanism. The detection sensor is used to obtain environmental parameters and determine the working mode according to the environmental parameters;

[0018] The light splitting mechanism is further used to decompose the incident light incident from the incident light surface into first outgoing light and emit it from the first outgoing light surface to the attitude sensor according to the working mode, or decompose the incident light incident from the incident light surface into second outgoing light and emit it from the second outgoing light surface to the color sensor according to the working mode.

[0019] Optionally, the detection sensor includes:

[0020] An acquisition module, which is used to periodically acquire environmental images;

[0021] A comparison module, which is used to compare the currently acquired environmental image with the previously acquired environmental image;

[0022] A judgment module, which is used to determine the working mode according to the comparison result of the comparison module.

[0023] Optionally, the working mode is a first working mode and a second working mode;

[0024] The comparison module is further used to obtain event information of a reference object according to the environmental image and compare the event information of the same reference object on the two environmental images;

[0025] The judgment module is further used to determine the first working mode when the event information of the same reference object on the two environmental images is inconsistent; and determine the second working mode when the event information of the same reference object on the two environmental images is consistent;

[0026] Wherein, the event information may include one or more of distance information, volume information, and color information.

[0027] Optionally, the light splitting mechanism is used for:

[0028] When it is determined to be in the first working mode, the incident light entering from the incident light surface is decomposed into first outgoing light and emitted from the first outgoing light surface onto the attitude sensor;

[0029] When it is determined to be in the second working mode, the incident light entering from the incident light surface is decomposed into second outgoing light and emitted from the second outgoing light surface onto the color sensor.

[0030] Optionally, the attitude sensor is a dof sensor, and the dof sensor is used to acquire image information and perform modeling processing according to the image information.

[0031] Optionally, the color sensor is an RGB sensor, and the RGB sensor is used to acquire image information and generate an analog image screen according to the image information.

[0032] The technical solution of the present invention decomposes the incident light into two optical paths in different directions through the beam splitting mechanism, and cooperates with different sensor components to achieve different functions. Thus, only one camera module can achieve multiple functions, saving product design space and improving product integration. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on the structures shown in these drawings.

[0034] Figure 1 It is a schematic structural diagram of the multi-functional camera module of the present invention;

[0035] Figure 2 It is a schematic structural diagram of an embodiment of the multi-functional camera module of the present invention;

[0036] Figure 3 It is a schematic structural diagram of a second embodiment of the multi-functional camera module of the present invention.

[0037] Explanation of the reference numerals in the drawings:

[0038] Label Name Label Name 100 Polarizer assembly 10 S polarizer 20 P polarizer 30 Polarizing beam splitter prism 31 First light output surface 32 Second light output surface 33 Light input surface 40 Attitude sensor 50 Color sensor

[0039] The realization, functional characteristics and advantages of the object of the present invention will be further described in conjunction with the embodiments with reference to the drawings. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0040] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0041] It should be noted that all directional indications (such as up, down, left, right, front, back...) in the embodiments of the present invention are only used to explain the relative positional relationship and movement conditions between components in a specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indications will also change accordingly.

[0042] In addition, in the present invention, descriptions such as "first" and "second" are only for descriptive purposes, and cannot be understood as indicating or implying their relative importance or implicitly indicating the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

[0043] In the present invention, unless otherwise clearly defined and limited, terms such as "connection" and "fixation" should be understood in a broad sense. For example, "fixation" may be a fixed connection, a detachable connection, or integrated; it may be a mechanical connection or an electrical connection; it may be directly connected or indirectly connected through an intermediate medium, and it may be the internal connection of two components or the interaction relationship between two components, unless otherwise clearly defined. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0044] In addition, the technical solutions between the various embodiments of the present invention can be combined with each other, but it must be based on the ability of those of ordinary skill in the art to implement. When the combination of technical solutions is contradictory or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the protection scope required by the present invention.

[0045] The present invention provides a multifunctional camera module. Please refer to Figure 1, the multi-functional camera module includes a beam splitting mechanism, an attitude sensor, and a color sensor 50. The beam splitting mechanism has a light incident surface 33, a first light output surface 31, and a second light output surface 32. The attitude sensor 40 is disposed on one side of the first light output surface 31. The color sensor 50 is disposed on one side of the second light output surface 32. The beam splitting mechanism is configured to decompose the incident light entering from the light incident surface 33 into a first output light that is emitted from the first light output surface 31 to the attitude sensor 40, or decompose the incident light entering from the light incident surface 33 into a second output light that is emitted from the second light output surface 32 to the color sensor 50.

[0046] The multi-functional camera module further includes a housing. All components are disposed within the housing. The housing has a through hole for allowing natural light to pass through, and components such as a lens can also be installed on the through hole.

[0047] During assembly, the light incident surface 33 of the beam splitting mechanism faces outward, that is, towards the side where natural light enters. After the natural light is incident, an incident light is formed and hits the light incident surface 33 of the beam splitting mechanism. The first light output surface 31, the second light output surface 32, and the light incident surface 33 are respectively three different surfaces of the beam splitting mechanism.

[0048] The beam splitting mechanism decomposes the incident light into the first output light and the second output light. The first output light is emitted from the first light output surface 31 and finally irradiates on the attitude sensor 40, forming a light path A. The second output light is emitted from the second light output surface 32 and finally irradiates on the color sensor 50, forming another light path B.

[0049] In different working modes, the beam splitting mechanism conducts different light paths, thereby realizing different functions.

[0050] Specifically, the beam splitting mechanism includes a polarization beam splitting prism 30 and a polarizer assembly 100. The light incident surface 33, the first light output surface 31, and the second light output surface 32 are respectively disposed on three different side surfaces of the polarization beam splitting prism 30. The polarizer assembly 100 is movably disposed on one side of the light incident surface 33.

[0051] The polarization beam splitting prism 30 has a cuboid structure. In this embodiment, the top surface of the polarization beam splitting prism 30 is set as the light incident surface 33, the bottom surface is set as the first light output surface 31, and any side surface is set as the second light output surface 32.

[0052] The attitude sensor 40 is disposed at the bottom of the polarization beam splitting prism 30, and the color sensor 50 is disposed on one side of the polarization beam splitting prism 30 corresponding to the second light output surface 32.

[0053] The polarizer assembly 100 is disposed on top of the polarization beam splitter prism 30. Natural light or incident light first passes through the polarizer assembly 100 and enters the light incident surface 33. Under the action of the polarizer assembly 100, the natural light or incident light is filtered and decomposed into polarized light, such as S-polarized light or P-polarized light.

[0054] Then, by utilizing the characteristics of the polarization beam splitter prism 30, when the natural light or incident light is filtered and decomposed into P-polarized light, it directly passes through the polarization beam splitter prism 30, and the first outgoing light A is emitted from the first light exit surface 31 at the bottom; when the natural light or incident light is filtered and decomposed into S-polarized light, it is refracted by the polarization beam splitter prism 30, and the second outgoing light B is emitted from the second light exit surface 32 on the side.

[0055] Specifically, the polarizer assembly 100 includes an S-polarizer 10, a P-polarizer 20, and a driving member. The S-polarizer 10 and the P-polarizer 20 are arranged at intervals along the incident light direction. Incident light passes through the S-polarizer 10 and / or the P-polarizer 20 and enters the light incident surface 33 to form an optical path; the driving member is respectively connected to the S-polarizer 10 and the P-polarizer 20; the driving member is used to drive the S-polarizer 10 to move away from or move to the optical path, or drive the P-polarizer 20 to move away from or move to the optical path.

[0056] In this embodiment, two polarizers are provided, namely the S-polarizer 10 and the P-polarizer 20. The S-polarizer 10 and the P-polarizer 20 can be movably arranged on top of the polarization beam splitter prism 30 in a drawer-type structure. For example, a frame with a central control structure is used to fix the polarizers in the frame to ensure that light can pass through the polarizers and irradiate on the polarization beam splitter prism 30.

[0057] The driving member can adopt a moving mechanism such as a linear module. The sliding nut seat is connected to the frame, and each polarizer is connected to a linear module, so as to realize independent movement.

[0058] Among them, the S-polarizer 10 and the P-polarizer 20 are independent of each other. According to different working modes, the driving member is controlled to move the corresponding type of polarizer to the optical path A or the optical path B. For example, when the attitude sensor 40 needs to be used, the driving member moves the P-polarizer 20 to the optical path and moves the S-polarizer 10 away from the optical path. Please refer to Figure 2, after natural light or incident light passes through the P polarizer 20, only P-polarized light can pass through. Under the action of the polarization beam splitter prism 30, the P-polarized light forms the first outgoing light and exits from the first light exit surface 31; when the color sensor 50 needs to be used, the driving member moves the P polarizer 20 away from the pipeline and moves the S polarizer 10 onto the optical path. Please refer to Figure 3 , after natural light or incident light passes through the S polarizer 10, only S-polarized light can pass through. Under the action of the polarization beam splitter prism 30, the S-polarized light forms the second outgoing light and exits from the second light exit surface 32 after refraction.

[0059] In this embodiment, the multifunctional camera module has two working modes. Among them, the attitude sensor 40 is a dof sensor, such as a 6dof sensor, a 9dof sensor, etc. The dof sensor is used to obtain image information and perform modeling processing according to the image information. In the working mode of using the attitude sensor 40, the multifunctional camera module collects external image information, and the dof sensor performs modeling processing according to the image information, and finally displays it on the display screen of the VR device, so as to achieve the effect of 3D virtual imaging in the VR device.

[0060] The color sensor 50 is an RGB sensor. The RGB sensor is used to obtain image information and generate an analog image screen according to the image information. In the working mode of using the color sensor 50, the multifunctional camera module collects external image information, and the color sensor 50 forms a new virtual image by distinguishing colors and displays it on the display screen of the VR device, so that users can have a more realistic 3D experience when using the VR device.

[0061] The technical solution of the present invention decomposes incident light into two optical paths in different directions through the beam splitting mechanism, and cooperates with different sensor components to achieve different functions. Therefore, only one camera module is needed to achieve multiple functions, saving product design space and improving product integration.

[0062] Furthermore, the multifunctional camera module further includes a detection sensor. The detection sensor is electrically connected to the beam splitting mechanism. The detection sensor is used to obtain environmental parameters and determine the working mode according to the environmental parameters; the beam splitting mechanism is further used to decompose the incident light incident from the light incident surface 33 into the first outgoing light and exit from the first light exit surface 31 to the attitude sensor 40 according to the working mode, or decompose the incident light incident from the light incident surface 33 into the second outgoing light and exit from the second light exit surface 32 to the color sensor 50 according to the working mode.

[0063] The detection sensor can adopt an event sensor. The event sensor can mimic the working mechanism of the human eye to empower a new machine vision, and can detect specific changes of moving objects at high speed and high precision under different environments and conditions. In this embodiment, it can be determined whether an event occurs by detecting whether an external object has changed.

[0064] When an event is detected, the attitude sensor 40 can be automatically controlled to turn on, and the beam splitting mechanism conducts the optical path A. The external environment is remodeled through the attitude sensor 40 and finally displayed on the VR device.

[0065] When no event is detected, the color sensor 50 can be automatically controlled to turn on, and the beam splitting mechanism conducts the pipeline B. The virtual image of the external environment is displayed on the VR device through the color sensor 50 to improve the user experience.

[0066] Specifically, the detection sensor includes an acquisition module, a comparison module, and a judgment module. The acquisition module is used to periodically acquire environmental images; the comparison module is used to compare the currently acquired environmental image with the previously acquired environmental image; the judgment module is used to determine the working mode according to the comparison result of the comparison module.

[0067] The acquisition module takes a picture of the external environment every other period to obtain the environmental image.

[0068] The comparison module compares the currently captured environmental image with the previously captured environmental image. That is, it determines whether there is an event outside according to whether there are differences between the two captured environmental images.

[0069] The judgment module is used to determine the operating mode when an event occurs, that is, to turn on the attitude sensor 40 and make the beam splitting mechanism conduct the optical path A, or to turn on the color sensor 50 and make the beam splitting mechanism conduct the optical path B.

[0070] Specifically, the working modes are the first working mode and the second working mode.

[0071] The comparison module is used to obtain the event information of the reference object according to the environmental image and compare the event information of the same reference object on the two environmental images.

[0072] A reference object is selected in the environmental image. For example, it can be a table, a chair, etc. on the environmental image. The judgment module is used to determine the first working mode when the event information of the same reference object on the two environmental images is inconsistent; and determine the second working mode when the event information of the same reference object on the two environmental images is consistent.

[0073] The event information may include one or more of distance information, volume information, and color information. For example, by obtaining the distance between the reference object and the shooting position, or the volume ratio of the reference object on the environmental image or the appearance color, etc., when the event information of the reference object on the two environmental images changes, it indicates that an event has occurred.

[0074] When the judgment module determines that an event has occurred, it determines that the multi-functional camera module switches to the first working mode, that is, the incident light incident from the light incident surface 33 is decomposed into first outgoing light and emitted from the first light outgoing surface 31 to the attitude sensor 40; when the judgment module determines that no event has occurred, it determines that the multi-functional camera module switches to the second working mode, that is, the incident light incident from the light incident surface 33 is decomposed into second outgoing light and emitted from the second light outgoing surface 32 to the color sensor 50.

[0075] The above are only the preferred embodiments of the present invention, and do not limit the patent scope of the present invention. Any equivalent structural transformation made by using the description and drawings of the present invention under the inventive concept of the present invention, or direct / indirect application in other related technical fields, is included in the patent protection scope of the present invention.

Claims

1. A multi-functional camera module, characterized in that, the multi-functional camera module includes: a beam splitting mechanism, on which there are an incident light surface, a first outgoing light surface, and a second outgoing light surface; an attitude sensor, which is arranged on one side of the first outgoing light surface; a color sensor, which is arranged on one side of the second outgoing light surface; the beam splitting mechanism is configured to decompose the incident light incident from the incident light surface into a first outgoing light and emit it from the first outgoing light surface to the attitude sensor, or decompose the incident light incident from the incident light surface into a second outgoing light and emit it from the second outgoing light surface to the color sensor; the multi-functional camera module further includes: a detection sensor, which is electrically connected to the beam splitting mechanism, and the detection sensor is configured to obtain environmental parameters and determine a working mode according to the environmental parameters; the beam splitting mechanism is further configured to decompose the incident light incident from the incident light surface into a first outgoing light and emit it from the first outgoing light surface to the attitude sensor according to the working mode, or decompose the incident light incident from the incident light surface into a second outgoing light and emit it from the second outgoing light surface to the color sensor according to the working mode; the detection sensor includes: an acquisition module, which is configured to periodically acquire environmental images; a comparison module, which is configured to compare the currently acquired environmental image with the previously acquired environmental image; a judgment module, which is configured to determine the working mode according to the comparison result of the comparison module; the working mode is a first working mode and a second working mode; the comparison module is further configured to obtain event information of a reference object according to the environmental image and compare the event information of the same reference object on the two environmental images; the judgment module is further configured to determine it as the first working mode when the event information of the same reference object on the two environmental images is inconsistent; and determine it as the second working mode when the event information of the same reference object on the two environmental images is consistent; wherein, the event information includes one or more of distance information, volume information, and color information.

2. The multi-functional camera module according to claim 1, characterized in that, the beam splitting mechanism includes: a polarization beam splitting prism, on which the incident light surface, the first outgoing light surface, and the second outgoing light surface are respectively arranged on three different side surfaces of the polarization beam splitting prism; a polarizer assembly, which is movably arranged on one side of the incident light surface.

3. The multi-functional camera module according to claim 2, characterized in that, the polarizer assembly includes: an S polarizer and a P polarizer, the S polarizer and the P polarizer are arranged at intervals along the incident light direction, and the incident light passes through the S polarizer and / or the P polarizer and enters the incident light surface to form an optical path; a driving member, which is respectively connected to the S polarizer and the P polarizer; the driving member is configured to drive the S polarizer to move away from or move to the optical path, or drive the P polarizer to move away from or move to the optical path.

4. The multifunctional camera module according to claim 1, wherein, the beam splitting mechanism is configured to: when it is determined to be in the first working mode, decompose the incident light incident from the incident light surface into first outgoing light and emit the first outgoing light from the first outgoing light surface onto the attitude sensor; when it is determined to be in the second working mode, decompose the incident light incident from the incident light surface into second outgoing light and emit the second outgoing light from the second outgoing light surface onto the color sensor.

5. The multifunctional camera module according to any one of claims 1 to 4, wherein, the attitude sensor is a dof sensor, and the dof sensor is configured to acquire image information and perform modeling processing based on the image information.

6. The multifunctional camera module according to any one of claims 1 to 4, wherein, the color sensor is an RGB sensor, and the RGB sensor is configured to acquire image information and generate an analog image screen based on the image information.

7. A VR device, wherein, the VR device is applied with the multifunctional camera module according to any one of claims 1 to 6.

Images