Electronic equipment and electronic device

Abstract

The invention provides electronic equipment and an electronic device. The electronic device includes: a device body; the first imaging assembly is mounted on the equipment body and comprises a first camera, a first projector and a first depth camera, the first camera is used for forming a first plane image of a target scene by using visible light, the first projector is used for projecting first light to the target scene, the first light is invisible light, and the first depth camera is used for receiving the first plane image; the first depth camera is used for forming first depth information of the target scene by using the first light; the second imaging assembly is installed on the equipment body, the second imaging assembly comprises a second camera, and the second camera is used for forming a second plane image of the target scene through visible light; the processor is used for forming a first three-dimensional image of the target scene according to the first plane image and the first depth information; and / or the processor is used for forming a second three-dimensional image of the target scene according to the first plane image and the second plane image. The electronic equipment provided by the invention is relatively good in imaging effect.

Description

Technical Field

[0001] The present application relates to the field of 3D shooting technology, and in particular to an electronic device and an electronic apparatus. Background Art

[0002] With the rapid development of science and technology, users have higher and higher requirements for the diversification of functions of electronic devices such as mobile phones. At present, some mobile phones are equipped with 3D cameras, which can obtain the depth information of the scene being photographed, that is, the three-dimensional position and size, etc. However, the imaging quality of the 3D cameras provided in the related art is not good. Summary of the invention

[0003] The present application provides an electronic device and an electronic apparatus with better stereoscopic imaging effect.

[0004] In a first aspect, the present application provides an electronic device, the electronic device comprising:

[0005] Equipment body;

[0006] a first imaging component, the first imaging component is installed on the device body, the first imaging component includes a first camera, a first projector, and a first depth camera, the first camera is used to form a first planar image of a target scene using visible light, the first projector is used to project a first light ray to the target scene, the first light ray is invisible light, and the first depth camera is used to form first depth information of the target scene using the first light ray; and

[0007] A second imaging component, the second imaging component is mounted on the device body, the second imaging component includes a second camera, and the second camera is used to form a second planar image of the target scene using visible light;

[0008] A processor, the processor is used to form a first stereoscopic image of a target scene according to the first plane image and the first depth information; and / or, the processor is used to form a second stereoscopic image of the target scene according to the first plane image and the second plane image.

[0009] In a second aspect, the present application further provides an electronic device, which includes a display device and an electronic device, wherein the display device is used to display a stereoscopic image captured by the electronic device.

[0010] The present application sets a first camera, a first projector, a first depth camera, and a second camera on an electronic device. The user can obtain a first stereoscopic image (hereinafter referred to as the first shooting scheme) through the first camera, the first projector, and the first depth camera, and can also obtain a second stereoscopic image (hereinafter referred to as the second shooting scheme) through the first camera and the second camera. For the first shooting scheme, since the first depth camera uses the invisible light emitted by the first projector for shooting, the first shooting scheme can be applied to shooting scenes with darker light. In addition, since the first camera uses visible light for shooting, the first plane image obtained by the first camera and the first depth information obtained by the first depth camera can be combined to form a first stereoscopic image with color. For the second shooting scheme, since both the first camera and the second camera use visible light for shooting, the second shooting scheme can be applied to shooting scenes with brighter light, and the first plane image obtained by the first camera and the second plane image obtained by the second camera can both form color, so the combination of the two can also form a second stereoscopic image with color. Therefore, the electronic device provided in this embodiment allows the user to selectively use shooting schemes according to the shooting scene, so as to obtain better quality imaging effects, and each shooting scheme can form a color image, making the imaging effect more realistic. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the implementation will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0012] Figure 1 A schematic diagram of an electronic device provided by an embodiment of the present application.

[0013] Figure 2 A schematic diagram of an electronic device from another perspective provided by an embodiment of the present application.

[0014] Figure 3 A schematic diagram of an electronic device provided by another embodiment of the present application.

[0015] Figure 4 A schematic diagram of an electronic device provided in yet another embodiment of the present application.

[0016] Figure 5 A schematic diagram of an electronic device provided in yet another embodiment of the present application.

[0017] Figure 6 A schematic diagram of a first camera and a first depth camera provided in an embodiment of the present application.

[0018] Figure 7 A schematic diagram of a second camera and a second depth camera provided in an embodiment of the present application.

[0019] Figure 8 A schematic diagram of an electronic device provided in yet another embodiment of the present application.

[0020] Fig. 9 A schematic diagram of an electronic device provided in yet another embodiment of the present application.

[0021] Fig.10 for Fig. 9 A schematic diagram of a first side of an electronic device is shown.

[0022] Fig.11 for Fig. 9 A schematic diagram of a second side of an electronic device is shown.

[0023] Fig.12 for Figure 2 An exploded view of the electronic device is shown.

[0024] Fig.13 A schematic diagram of an electronic device provided in yet another embodiment of the present application.

[0025] Fig.14 A schematic diagram of an electronic device provided in an embodiment of the present application.

[0026] Description of Figure Numbers:

[0027] Electronic device 100; electronic device 10; display device 20; device body 110; first imaging component 120; second imaging component 130; processor 140; light sensor 150; display screen 111; middle frame 112; back cover 113; decorative element 114; circuit board 115; flash 116; first camera 121; first projector 122; first depth camera 123; first beam splitter 124; first flash 125; second camera 131; second projector 132; second depth camera 133; second beam splitter 134; second flash Light lamp 135; first photosensitive element 1211; first filter 1212; first lens group 1213; second photosensitive element 1231; second filter 1232; second lens group 1233; third photosensitive element 1311; third filter 1312; third lens group 1313; fourth photosensitive element 1331; fourth filter 1332; fourth lens group 1333; first side C1; second side C2; ​​light incident side C3; first long side Y1; second long side Y2; first short side X1; second short side X2; first light-transmitting window Z1; second light-transmitting window Z2. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0029] Reference to "embodiment" or "implementation" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiment or implementation may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0030] Please refer to Figure 1 and Figure 2 The present application provides an electronic device 10, which may be a mobile phone, a tablet computer, a laptop computer, a camera device, a wearable device (such as a VR device, etc.), a television, a vehicle-mounted device, etc. The electronic device 10 may be, but is not limited to, used in the fields of three-dimensional modeling, navigation positioning, face recognition, motion capture, etc. It should be noted that the embodiments of the present application are only exemplified by taking the electronic device 10 as a mobile phone, but this should not be regarded as a limitation on the present application.

[0031] The electronic device 10 includes: a device body 110 , a first imaging component 120 , a second imaging component 130 , and a processor 140 .

[0032] The device body 110 refers to the main body of the electronic device 10 , which may include electronic devices that implement the main functions of the electronic device 10 and a mechanical structure that protects and supports these electronic devices.

[0033] The first imaging component 120 is installed on the device body 110. The first imaging component 120 includes a first camera 121, a first projector 122, and a first depth camera 123. The first camera 121 is used to form a first planar image of a target scene using visible light. The first projector 122 is used to project a first light ray to the target scene, and the first light ray is invisible light. The first depth camera 123 is used to form first depth information of the target scene using the first light ray.

[0034] The second imaging component 130 is installed on the device body 110. The second imaging component 130 includes a second camera 131, and the second camera 131 is used to form a second planar image of the target scene using visible light.

[0035] The processor 140 is used to form a first stereoscopic image of the target scene according to the first plane image and the first depth information; and / or the processor 140 is used to form a second stereoscopic image of the target scene according to the first plane image and the second plane image. The stereoscopic image described here can also be called a three-dimensional image or a 3D image, and the image can be a static picture or a dynamic video.

[0036] Specifically, the above-mentioned visible light and invisible light are based on the human eye, and the wavelength range of visible light generally refers to 380nm to 780nm, and light outside this wavelength range is invisible. The above-mentioned target scene is the current scene photographed by the user using the electronic device 10, and the target scene may include scene contents such as people and scenery. The first camera 121 may also be referred to as a color camera or an RGB camera, which can use visible light to form a two-dimensional color image of the target scene, that is, a first plane image. Similarly, the second camera 131 may also be referred to as a color camera or an RGB camera, which may use visible light to form a two-dimensional color image of the target scene, that is, a second plane image. The first depth camera 123 may also be referred to as an invisible light camera, and the first depth camera 123 is used in conjunction with the first projector 122. Among them, the first projector 122 is used to project an invisible first light toward the target scene, and the first depth camera 123 then receives the first light reflected by the target scene, and processes the received first light to obtain a first depth image of the target scene, and the first depth image contains first depth information, and the first depth information is the distance information from each position point in the target scene to the first depth camera 123. The processor 140 can obtain a first stereoscopic image of the shooting scene by fusing the first plane image and the first depth image, and can also obtain a second stereoscopic image of the shooting scene by fusing the first plane image and the second plane image, and can also simultaneously obtain the first stereoscopic image and the second stereoscopic image. It should be noted that in an embodiment of simultaneously obtaining the first stereoscopic image and the second stereoscopic image, the processor 140 can further compare and correct the first stereoscopic image and the second stereoscopic image to obtain a more accurate corrected image, and the corrected image is used as the final stereoscopic image displayed to the user. Therefore, there are at least two ways to obtain the final stereoscopic image in the present application.

[0037] In this embodiment, the electronic device 10 is provided with a first camera 121, a first projector 122, a first depth camera 123, and a second camera 131. The user can obtain a first stereoscopic image (hereinafter referred to as the first shooting scheme) through the first camera 121, the first projector 122, and the first depth camera 123, and can also obtain a second stereoscopic image (hereinafter referred to as the second shooting scheme) through the first camera 121 and the second camera 131. For the first shooting scheme, since the first depth camera 123 uses the invisible light emitted by the first projector 122 for shooting, the first shooting scheme can be applied to shooting scenes with relatively dark light. In addition, since the first camera 121 uses visible light for shooting, the first plane image obtained by the first camera 121 and the first depth information obtained by the first depth camera 123 can be combined to form a first stereoscopic image with color. For the second shooting scheme, since both the first camera 121 and the second camera 131 use visible light for shooting, the second shooting scheme can be applied to shooting scenes with brighter light, and the first plane image obtained by the first camera 121 and the second plane image obtained by the second camera 131 can both form colors, so the combination of the two can also form a second stereoscopic image with colors. Therefore, the electronic device 10 provided in this embodiment allows users to selectively use shooting schemes according to shooting scenes, so as to obtain better quality imaging effects, and each shooting scheme can form a color image, making the imaging effect more realistic.

[0038] It should be noted that the above-mentioned light brightness / darkness refers to the intensity of visible light. Brighter light means stronger visible light, and darker light means weaker visible light. Please refer to here for subsequent descriptions related to light brightness / darkness.

[0039] Please refer to Figure 2, the second imaging component 130 also includes a second projector 132 and a second depth camera 133. The second projector 132 is used to project a second light ray toward the target scene, and the second light ray is invisible light. The second depth camera 133 is used to form the second depth information of the target scene using the second light ray. In other words, the second projector 132 is used to project the invisible second light ray toward the target scene, and the second depth camera 133 then receives the second light ray reflected back by the target scene, and processes the received second light ray to obtain a second depth image of the target scene, and the second depth image contains the second depth information, and the second depth information is the distance information from each position point in the target scene to the second depth camera 133. The processor 140 is also used to form a third stereoscopic image of the target scene according to the second plane image and the second depth information, that is, the processor 140 can obtain the third stereoscopic image of the shooting scene by fusing the second plane image and the second depth image. Therefore, there are at least three ways to obtain a stereoscopic image in the present application, which gives users more shooting methods to choose from.

[0040] Furthermore, the first camera 121 and the second camera 131 together constitute a binocular vision stereo imaging system. The first camera 121, the first projector 122, and the first depth camera 123 together constitute a structured light stereo imaging system or a TOF stereo imaging system. The second camera 131, the second projector 132, and the second depth camera 133 together constitute a structured light stereo imaging system or a TOF stereo imaging system. In the present application, “the first camera 121, the first projector 122, and the first depth camera 123 together constitute a structured light stereo imaging system, and the second camera 131, the second projector 132, and the second depth camera 133 together constitute a TOF stereo imaging system” is used as an example for explanation.

[0041] An introduction to the above-mentioned binocular vision stereo imaging, structured light stereo imaging, and TOF stereo imaging is as follows.

[0042] Binocular vision stereo imaging: Based on the principle of parallax, the first camera 121 and the second camera 131 respectively obtain two images of the object (target scene), namely the first plane image and the second plane image, and the processor 140 calculates the position deviation between the corresponding points of the two images to obtain the three-dimensional geometric information of the object, and then obtain the 3D photo / video of the object.

[0043] Structured light stereo imaging: An infrared structured light emitter (first projector 122) is used to project light with certain structural features onto the object being photographed (target scene), and then the infrared structured light camera (first depth camera 123) collects the light. The light emitted by the infrared structured light emitter is encoded in a certain way, and after being projected onto the object being photographed, a certain algorithm is used to calculate the distortion of the returned encoded pattern captured by the infrared structured light camera, thereby obtaining the position and depth information of the object being photographed, and then obtaining a 3D photo / video of the object being photographed.

[0044] TOF stereo imaging: TOF refers to Time-Of-Flight, i.e. the time of flight of light. The principle of stereo imaging is to use an infrared transmitter (the second projector 132) to emit a modulated pulse wave (generally a sine wave). When encountering an obstacle, diffuse reflection occurs, and the reflected sine wave is then received by the CMOS sensor of a special TOF camera (the second depth camera 133). At this time, the waveform has a phase shift. The position and depth information of the object (target scene) can be calculated through the phase shift, thereby obtaining a 3D photo / video of the object.

[0045] For the above three stereoscopic imaging solutions, users can choose to use them according to the characteristics of various solutions. For example, the binocular vision stereoscopic imaging solution is suitable for scenes with brighter light. The structured light stereoscopic imaging solution and the TOF stereoscopic imaging solution are suitable for scenes with darker light. For another example, the binocular vision stereoscopic imaging solution has low power consumption and can be used with low power. Therefore, in this embodiment, three different stereoscopic imaging solutions are integrated on the electronic device 10, which allows users to have more choices without the need to purchase multiple stereoscopic imaging devices.

[0046] Please refer to Figure 2 Optionally, a distance H1 between the optical axis of the first projector 122 and the optical axis of the first depth camera 123 satisfies: 10mm≤H1≤30mm, for example, 10mm, 12mm, 15mm, 18mm, 20mm, 22mm, 23mm, 25mm, 27mm, 30mm, etc. In this embodiment, setting H1 in the range of 10mm to 30mm can make the first light projected by the first projector 122 as far as possible within the field of view of the first depth camera 123, thereby ensuring that the first depth camera 123 can obtain sufficiently accurate first depth information.

[0047] Please refer to Figure 2Optionally, the distance H2 between the optical axis of the second projector 132 and the optical axis of the second depth camera 133 satisfies: 10mm≤H2≤30mm, for example, 10mm, 12mm, 15mm, 18mm, 20mm, 22mm, 23mm, 25mm, 27mm, 30mm, etc. In this embodiment, setting H2 in the range of 10mm to 30mm can make the second light projected by the second projector 132 as far as possible within the field of view of the second depth camera 133, thereby ensuring that the second depth camera 133 can obtain sufficiently accurate second depth information.

[0048] Please refer to Figure 2 Optionally, the distance H3 between the optical axis of the first camera 121 and the optical axis of the second camera 131 satisfies: 40mm≤H3≤170mm, for example, 40mm, 50mm, 55mm, 56mm, 60mm, 65mm, 68mm, 70mm, 75mm, 80mm, 90mm, 100mm, 120mm, 130mm, 150mm, 170mm, etc. If the distance between the optical axes of the first camera 121 and the second camera 131 is less than 40mm, the fields of view of the two cameras will overlap too much, making the first plane image and the second plane image close to the same, and finally causing the stereoscopic effect of the second stereoscopic image formed after the two plane images are fused to be poor. If the distance between the optical axes of the first camera 121 and the second camera 131 is greater than 170mm, the fields of view of the two cameras will overlap too little, making the presentation information of the same photographed object in the first plane image and the second plane image at different angles less, which will also cause the stereoscopic effect of the second stereoscopic image formed after the two plane images are fused to be poor.

[0049] Optionally, the distance H3 between the optical axis of the first camera 121 and the optical axis of the second camera 131 satisfies: 40mm≤H3≤90mm, for example, 40mm, 50mm, 55mm, 56mm, 60mm, 65mm, 68mm, 70mm, 75mm, 80mm, 90mm. Generally, the distance between the two pupils of a user (referred to as the pupil distance) is between 50mm and 80mm. By limiting H3 to the above range, it is equivalent to the pupil distance of a human eye, and thus a second stereoscopic image with good imaging effect suitable for viewing by the human eye can be obtained.

[0050] like Figure 2As shown, the first camera 121 and the first depth camera 123 are arranged adjacent to each other, that is, the first depth camera 123 is closer to the first camera 121 than the second camera 131 and the second depth camera 133. For example, the center distance between the optical axes of the first camera 121 and the first depth camera 123 ranges from 10mm to 20mm, and can specifically be 10mm, 11mm, 12mm, 13mm, 14mm, 15mm, 16mm, 17mm, 18mm, 19mm, 20mm. By arranging the first camera 121 and the first depth camera 123 adjacent to each other, the field of view of the first camera 121 and the first depth camera 123 can be made to be roughly the same as much as possible, so that a first stereoscopic image with higher accuracy and better effect can be obtained by fusing the first plane image and the first depth image.

[0051] like Figure 2 As shown, the second camera 131 and the second depth camera 133 are arranged adjacent to each other, that is, the second depth camera 133 is closer to the second camera 131 than the first camera 121 and the first depth camera 123. For example, the center distance between the optical axes of the first camera 121 and the first depth camera 123 ranges from 10mm to 20mm, and can be specifically 10mm, 11mm, 12mm, 13mm, 14mm, 15mm, 16mm, 17mm, 18mm, 19mm, 20mm. By arranging the second camera 131 and the second depth camera 133 adjacent to each other, the field of view of the second camera 131 and the second depth camera 133 can be made to be roughly the same as much as possible, so that a third stereo image with higher accuracy and better effect can be obtained by fusing the second plane image and the second depth image.

[0052] To facilitate the subsequent explanation, Figure 2 The viewing angles shown define a plane rectangular coordinate system, wherein the X-axis is parallel to the width direction of the electronic device 10 , and the Y-axis is parallel to the length direction of the electronic device 10 .

[0053] Please refer to Figure 2, the first imaging component 120 and the second imaging component 130 are arranged at intervals along the length direction of the device body 110, so that sufficient distance space can be provided to the first camera 121 and the second camera 131 to ensure the imaging quality. Specifically, for some electronic devices 10, they have miniaturization and lightness design requirements to meet the needs of users, such as mobile phones. The dimensions of these electronic devices 10 are generally limited to a certain range. For example, the length × width of a mobile phone is generally within the range of 170mm × 80mm. Since the first camera 121 and the second camera 131 together constitute a binocular vision stereo imaging system, the first camera 121 and the second camera 131 need to be spaced a certain distance apart. In this embodiment, the first imaging component 120 and the second imaging component 130 are spaced along the length direction (Y-axis direction) of the device body 110, and the spacing distance between the first camera 121 and the second camera 131 can be designed within the required distance range.

[0054] Please refer to Figure 2 , the device body 110 has a first long side Y1 and a second long side Y2 that are opposite to each other, and the first imaging component 120 and the second imaging component 130 are adjacent to the first long side Y1 and away from the second long side Y2. Among them, the first long side Y1 and the second long side Y2 are the two side edges of the device body 110 in the length direction. It can be understood that when the user takes pictures, he needs to hold the electronic device 10, but the imaging component cannot be blocked, which requires the electronic device 10 to reserve a certain space for the user's hand to be placed. In this embodiment, the first imaging component 120 and the second imaging component 130 are arranged to be adjacent to the first long side Y1 and away from the second long side Y2, so that more space can be reserved in the width direction (X-axis direction) of the device body 110 to facilitate the placement of the user's hand.

[0055] Please refer to Figure 3 The first imaging assembly 120 and the second imaging assembly 130 are arranged at intervals along the width direction of the device body 110. Such an arrangement makes the first imaging assembly 120 and the second imaging assembly 130 more compact and more beautiful.

[0056] Please refer to Figure 3 , the device body 110 has a first short side X1 and a second short side X2 that are opposite to each other, and the first imaging component 120 and the second imaging component 130 are adjacent to the first short side X1 and away from the second short side X2. The first short side X1 and the second short side X2 are the two side edges of the device body 110 in the width direction. In this way, more space can be reserved in the length direction of the device body 110, which is convenient for the user to place his hand without interfering with the first imaging component 120 and the second imaging component 130.

[0057] Please refer to Figure 3 to Figure 4 The device body 110 also includes a first long side Y1 and a second long side Y2 opposite to each other, the first camera 121 is arranged adjacent to the first long side Y1 compared to the second long side Y2, and the second camera 131 is arranged adjacent to the second long side Y2 compared to the first long side Y1.

[0058] like Figure 3 As shown, in one embodiment, the first camera 121 and the first depth camera 123 are arranged at intervals along the length direction of the device body 110. The second camera 131 and the second depth camera 133 are arranged at intervals along the length direction of the device body 110.

[0059] like Figure 4 As shown, in another embodiment, the first camera 121 and the first depth camera 123 are arranged at intervals along the width direction of the device body 110, and the first camera 121 is located on the side of the first depth camera 123 away from the second imaging component 130. The second camera 131 and the second depth camera 133 are arranged at intervals along the width direction of the device body 110, and the second camera 131 is located on the side of the second depth camera 133 away from the first imaging component 120.

[0060] The above two implementations can both realize that the first camera 121 is close to the first long side Y1, and the second camera 131 is close to the second long side Y2, so that the spacing distance between the first camera 121 and the second camera 131 can be designed to be within the required distance range to realize a binocular vision stereo imaging system.

[0061] Please refer to Figure 5 and Figure 6 The first imaging component 120 includes a first beam splitter 124, which is used to split the external light into a first light beam and a second light beam. The first camera 121 includes a first photosensitive element 1211, which is used to receive the visible light in the first light beam. The first beam splitter 124 and the first photosensitive element 1211 together constitute the first camera 121. The first depth camera 123 includes a second photosensitive element 1231, which is used to receive the first light in the second light beam. The first beam splitter 124 and the second photosensitive element 1231 together constitute the first depth camera 123.

[0062] Specifically, the first beam splitter 124 may also be referred to as a beam splitter, which refers to an optical element that can split a beam of light into two beams of light according to a certain reflection and transmission ratio. When a user uses the electronic device 10 to shoot, after the external light reaches the first beam splitter 124, a part of the light passes through the first beam splitter 124 to form a first light beam, and another part of the light is reflected by the first beam splitter 124 to form a second light beam. The propagation directions of the first light beam and the second light beam are different, wherein the first light beam propagates toward the location of the first photosensitive element 1211, and the second light beam propagates toward the location of the second photosensitive element 1231. The first camera 121 may also include a first filter 1212 and a first lens group 1213, which are arranged between the first beam splitter 124 and the first photosensitive element 1211, and the first filter 1212 is used to filter out the invisible light in the first light beam. The first photosensitive element 1211 uses the visible light in the first light beam to form a first planar image. The first depth camera 123 may also include a second filter 1232 and a second lens group 1233, which are arranged between the first beam splitter 124 and the second photosensitive element 1231, and the second filter 1232 is used to filter out the visible light in the second light beam. The second photosensitive element 1231 uses the first light in the second light beam to form a first depth image. Among them, the first beam splitter 124, the first filter 1212, and the first photosensitive element 1211 together constitute the first camera 121. The first beam splitter 124, the second filter 1232, and the second photosensitive element 1231 together constitute the first depth camera 123. A first light-transmitting window Z1 is provided on the device body 110, and the first beam splitter 124 is arranged corresponding to the first light-transmitting window Z1. The external light reaches the first beam splitter 124 after passing through the first light-transmitting window Z1.

[0063] In this embodiment, the first camera 121 and the first depth camera 123 share the first beam splitter 124, which can reduce the volume of the first imaging component 120, and only one first light-transmitting window Z1 is required to be set on the device body 110, which is more conducive to ensuring that the spacing distance between the first camera 121 and the second camera 131 is designed to be within the required distance range, so as to realize a binocular vision stereo imaging system.

[0064] Please refer to Figure 5 and Figure 7The second imaging component 130 includes a second beam splitter 134, which is used to split the external light into a third light beam and a fourth light beam. The second camera 131 includes a third photosensitive element 1311, which is used to receive the visible light in the third light beam. The second beam splitter 134 and the third photosensitive element 1311 together constitute the second camera 131. The second depth camera 133 includes a fourth photosensitive element 1331, which is used to receive the second light in the fourth light beam. The second beam splitter 134 and the fourth photosensitive element 1331 together constitute the second depth camera 133.

[0065] Specifically, the second beam splitter 134 may also be referred to as a beam splitter, which refers to an optical element that can split a beam of light into two beams of light according to a certain reflection and transmission ratio. When the user uses the electronic device 10 to shoot, after the external light reaches the second beam splitter 134, a part of the light passes through the second beam splitter 134 to form a third light beam, and another part of the light is reflected by the second beam splitter 134 to form a fourth light beam. The propagation directions of the third light beam and the fourth light beam are different, wherein the third light beam propagates toward the location of the third photosensitive element 1311, and the fourth light beam propagates toward the location of the fourth photosensitive element 1331. The second camera 131 may also include a third filter 1312 and a third lens group 1313, which are arranged between the second beam splitter 134 and the third photosensitive element 1311, and the third filter 1312 is used to filter out the invisible light in the third light beam. The third photosensitive element 1311 uses the visible light in the third light beam to form a second planar image. The second depth camera 133 may also include a fourth filter 1332 and a fourth lens group 1333, which are arranged between the second beam splitter 134 and the fourth photosensitive element 1331, and the fourth filter 1332 is used to filter out the visible light in the fourth light beam. The fourth photosensitive element 1331 uses the second light in the fourth light beam to form a second depth image. Among them, the second beam splitter 134, the third filter 1312, and the third photosensitive element 1311 together constitute the second camera 131. The second beam splitter 134, the fourth filter 1332, and the fourth photosensitive element 1331 together constitute the second depth camera 133. A second light-transmitting window Z2 is provided on the device body 110, and the second beam splitter 134 is arranged corresponding to the second light-transmitting window Z2. The external light reaches the second beam splitter 134 after passing through the second light-transmitting window Z2.

[0066] In this embodiment, the second camera 131 and the second depth camera 133 share the second beam splitter 134, which can reduce the volume of the second imaging component 130, and only one second light-transmitting window Z2 needs to be set on the device body 110, which is more conducive to ensuring that the spacing distance between the first camera 121 and the second camera 131 is designed to be within the required distance range, so as to realize a binocular vision stereo imaging system.

[0067] Please refer to Figure 8 Optionally, the first imaging component 120 is detachably connected to the device body 110, that is, the first imaging component 120 is a module independent of the device body 110, and the user can selectively install or remove the first imaging component 120 according to shooting requirements, that is, when the user needs to shoot, the first imaging component 120 can be connected to the device body 110, and when the user finishes shooting, the first imaging component 120 can be removed. For the user, using the first imaging component 120 as an independent module gives the user more choice, and the user can choose different models of first imaging components 120 according to needs, for example, choose a first imaging component 120 with better imaging quality.

[0068] The above-mentioned detachable connection includes two layers of connection relationships: one is a mechanical connection relationship, which is used to ensure that the first imaging component 120 is fixed to the device body 110; the other is a signal connection relationship, which is used to realize the signal transmission process between the first imaging component 120 and the processor 140.

[0069] The mechanical connection relationship may be, but is not limited to, a magnetic connection, a clamping connection, etc. The magnetic connection means that both the first imaging component 120 and the device body 110 are provided with magnetic materials, such as magnets, and when the two are close to each other, they can be magnetically attracted to each other to maintain the connection relationship. The clamping type means that the first imaging component 120 is similar to a heat dissipation back clip, which clamps the edge of the device body 110 to maintain the connection relationship.

[0070] For the signal connection relationship, it can be a wireless connection or a wired connection. Among them, the wireless connection refers to a communication connection form formed by the non-direct electrical contact between the first imaging component 120 and the device body 110. For example, the first imaging component 120 is connected to the device body 110 via Bluetooth, and then communicates with the processor 140. The wired connection refers to a communication connection form formed by the direct electrical contact between the first imaging component 120 and the device body 110. For example, a metal contact is provided on the device body 110, and a spring ejector is provided on the first imaging component 120. After the spring ejector contacts the metal contact, an electrical connection is formed; for another example, a first interface is provided on the device body 110, and a second interface is provided on the first imaging component 120. The first interface and the second interface are electrically connected through a data line, that is, plugs are provided at both ends of the data line, and the plugs can be inserted into the first interface and the second interface.

[0071] Optionally, the second imaging component 130 can be detachably connected to the device body 110 , please refer to the above description for details.

[0072] Please refer to Figures 9 to 11 , the device body 110 has a first side C1 and a second side C2 opposite to each other. The first imaging component 120 has a light incident side C3, which is the side that collects light during shooting, and the light enters the first camera 121 and the first depth camera 123 from the light incident side C3. The first imaging component 120 is rotatably connected to the device body 110 so that the light incident side C3 can be located on the first side C1 or on the second side C2, that is, the first imaging component 120 can be flipped. For a mobile phone, if the first side C1 is the side with a display screen, when the light incident side C3 of the first imaging component 120 is located on the first side C1, the first imaging component 120 acts as a front camera, and when the light incident side C3 of the first imaging component 120 is located on the second side C2, the first imaging component 120 acts as a rear camera. In this way, whether it is used as a front or rear camera, the user can see the first stereoscopic image in real time from the display screen.

[0073] Please refer to Fig.12 The device body 110 may include a display screen 111, a circuit board 115, a middle frame 112, a back cover 113, and a decorative piece 114. The display screen 111 and the back cover 113 are both connected to the middle frame 112 and are arranged on opposite sides of the middle frame 112. The circuit board 115 is carried by the middle frame 112 and is located between the display screen 111 and the back cover 113. The display screen 111, the first imaging component 120, the second imaging component 130, and the processor 140 are all electrically connected to the circuit board 115. The decorative piece 114 is fixed to the back cover 113, and is used to decorate the first imaging component 120 and the second imaging component 130.

[0074] During shooting using the electronic device 10, the display screen 111 displays at least one of the first stereoscopic image, the second stereoscopic image, and the third stereoscopic image. The display screen 111 may be a touch screen, so that the user can directly select a shooting mode, adjust shooting parameters, etc. by touching the display screen 111.

[0075] In some embodiments, when the user turns on the camera mode, the display screen 111 may display a "first option" and a "second option", wherein the first option is a 2D shooting mode and the second option is a 3D shooting mode. When the user clicks on the "first option", the display screen 111 displays a two-dimensional color image captured by the first camera 121 or the second camera 131. When the user clicks on the "second option", the display screen 111 displays at least one of the first stereoscopic image, the second stereoscopic image, and the third stereoscopic image.

[0076] Optionally, when the user clicks on the "second option", the first imaging component 120 and the second imaging component 130 work simultaneously, and the display screen 111 displays the first stereoscopic image, the second stereoscopic image, and the third stereoscopic image in different areas, that is, the three images are displayed on the same screen. When the display screen 111 receives a touch operation, the processor 140 controls the display screen 111 to display the image corresponding to the touched area (the first stereoscopic image, the second stereoscopic image, or the third stereoscopic image) in full screen.

[0077] For example: Assume that the first stereo image is formed by a binocular vision stereo imaging system, the second stereo image is formed by a structured light stereo imaging system, and the third stereo image is formed by a TOF stereo imaging system. When the user enters the "second option", the first imaging component 120 and the second imaging component 130 work simultaneously. At this time, the first stereo image, the second stereo image, and the third stereo image are displayed on the display screen 111 at the same time. The first stereo image is displayed in the first area of ​​the display screen 111, the second stereo image is displayed in the second area of ​​the display screen 111, and the third stereo image is displayed in the third area of ​​the display screen 111. When the user touches the first area with a finger, the first stereo image is displayed in full screen; when the user touches the second area with a finger, the second stereo image is displayed in full screen; when the user touches the third area with a finger, the third stereo image is displayed in full screen. For this implementation, the first stereoscopic image, the second stereoscopic image, and the third stereoscopic image are first displayed on the same screen. At this time, the user can intuitively see the imaging effects of each of the three images and select an image that is more suitable for the current scene for 3D shooting. This setting can avoid the problem that the user does not know which stereoscopic imaging system to use for shooting due to not understanding the shooting principles of each stereoscopic imaging system, which can bring a better user experience.

[0078] Furthermore, the three shooting modes of binocular vision stereo imaging system, structured light stereo imaging system and TOF stereo imaging system all need to use color cameras (i.e., the first camera 121 and the second camera 131). Since the color camera needs to use visible light for shooting, the shooting effect of the color camera is poor when the shooting environment is dark. Fig.13 Based on this problem, the device body 110 may further include a flash 116, which is electrically connected to the processor 140. When the user takes a photo in a dark environment, the processor 140 controls the flash 116 to turn on to illuminate the environment and provide visible light.

[0079] Optionally, the device body 110 may also include a light sensor 150, which is electrically connected to the processor 140. The light sensor 150 is used to obtain the ambient light intensity and send the ambient light intensity to the processor 140. The processor 140 compares the ambient light intensity with a preset threshold. If the ambient light intensity is greater than or equal to the preset threshold, it is determined that the light in the current environment is brighter. If the ambient light intensity is less than the preset threshold, it is determined that the light in the current environment is darker.

[0080] Optionally, when the user selects the "second option", if it is determined that the current ambient light is dark, the processor 140 turns on the structured light stereo imaging system (i.e., turns on the first camera 121, the first projector 122, and the first depth camera 123) to shoot, and turns on the first flash 125; or, the processor 140 turns on the TOF stereo imaging system (i.e., turns on the second camera 131, the second projector 132, and the second depth camera 133) to shoot, and turns on the second flash 135. If it is determined that the current ambient light is bright, the processor 140 turns on the binocular vision stereo imaging system (i.e., turns on the first camera 121 and the second camera 131) to shoot, and can also turn on the structured light stereo imaging system or the TOF stereo imaging system to shoot.

[0081] Please refer to Fig.14 The present application also provides an electronic device 100 , which includes a display device 20 and the electronic device 10 described in any of the above embodiments, and the display device 20 is used to display a stereoscopic image captured by the electronic device 10 .

[0082] The display device 20 may be a display device such as a VR, a television, a computer, a tablet, a monitor, a car central control screen, etc. The display device 20 may establish a communication connection with the electronic device 10, and the communication connection type may be a wired connection (e.g., connected via a data cable) or a wireless connection (e.g., connected via Bluetooth), so that the display device 20 displays a stereoscopic image captured by the electronic device 10. For the introduction of the electronic device 10, please refer to the description in the previous embodiment, which will not be repeated here.

[0083] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in the field can change, modify, replace and modify the above embodiments within the scope of the present application, and these improvements and modifications are also regarded as the scope of protection of the present application.

Claims

1. An electronic device, characterized in that: The electronic device comprises: Equipment body; a first imaging component, the first imaging component is installed on the device body, the first imaging component includes a first camera, a first projector, and a first depth camera, the first camera is used to form a first planar image of a target scene using visible light, the first projector is used to project a first light ray to the target scene, the first light ray is invisible light, and the first depth camera is used to form first depth information of the target scene using the first light ray; and A second imaging component, the second imaging component is mounted on the device body, the second imaging component includes a second camera, and the second camera is used to form a second planar image of the target scene using visible light; A processor, the processor is used to form a first stereoscopic image of a target scene according to the first plane image and the first depth information; and / or, the processor is used to form a second stereoscopic image of the target scene according to the first plane image and the second plane image.

2. The electronic device according to claim 1, wherein: The second imaging component also includes a second projector and a second depth camera. The second projector is used to project a second light ray to the target scene, and the second light ray is invisible light. The second depth camera is used to form second depth information of the target scene using the second light ray. The processor is also used to form a third stereoscopic image of the target scene based on the second plane image and the second depth information.

3. The electronic device according to claim 2, characterized in that: The first camera and the second camera together form a binocular vision stereo imaging system; The first camera, the first projector, and the first depth camera together constitute a structured light stereo imaging system or a TOF stereo imaging system; The second camera, the second projector, and the second depth camera together constitute a structured light stereo imaging system or a TOF stereo imaging system.

4. The electronic device according to claim 2, characterized in that: A distance H1 between the optical axis of the first projector and the optical axis of the first depth camera satisfies: 10 mm ≤ H1 ≤ 30 mm; And / or, the distance H2 between the optical axis of the second projector and the optical axis of the second depth camera satisfies: 10mm≤H2≤30mm.

5. The electronic device according to claim 1, wherein: A distance H3 between the optical axis of the first camera and the optical axis of the second camera satisfies: 40 mm ≤ H3 ≤ 170 mm.

6. The electronic device according to claim 1, wherein: The first imaging assembly and the second imaging assembly are spaced apart along the length direction of the device body.

7. The electronic device according to claim 6, characterized in that: The device body has a first long side and a second long side opposite to each other, and the first imaging component and the second imaging component are adjacent to the first long side and away from the second long side.

8. The electronic device according to claim 1, wherein: The first imaging assembly and the second imaging assembly are spaced apart from each other along the width direction of the device body.

9. The electronic device according to claim 8, characterized in that: The device body has a first short side and a second short side opposite to each other, and the first imaging component and the second imaging component are adjacent to the first short side and away from the second short side.

10. The electronic device according to claim 8, characterized in that: The device body further includes a first long side and a second long side opposite to each other, the first camera is disposed adjacent to the first long side compared to the second long side, and the second camera is disposed adjacent to the second long side compared to the first long side.

11. The electronic device according to claim 1, wherein: The first imaging component includes a first beam splitter, and the first beam splitter is used to split the external light into a first light beam and a second light beam; The first camera includes a first photosensitive element, the first photosensitive element is used to receive the visible light in the first light beam, and the first beam splitter and the first photosensitive element together constitute the first camera; The first depth camera includes a second photosensitive element, which is used to receive the first light in the second light beam. The first beam splitter and the second photosensitive element together constitute the first depth camera.

12. The electronic device according to claim 2, characterized in that: The second imaging component includes a second beam splitter, and the second beam splitter is used to split the external light into a third light beam and a fourth light beam; The second camera includes a third photosensitive element, the third photosensitive element is used to receive the visible light in the third light beam, and the second beam splitter and the third photosensitive element together constitute the second camera; The second depth camera includes a fourth photosensitive element, and the fourth photosensitive element is used to receive the second light in the fourth light beam. The second beam splitter and the fourth photosensitive element together constitute the second depth camera.

13. The electronic device according to any one of claims 1 to 12, characterized in that: The first imaging component is detachably connected to the device body.

14. The electronic device according to any one of claims 1 to 12, characterized in that: The device body has a first side and a second side opposite to each other, the first imaging component has a light incident side, and the first imaging component is rotatably connected to the device body so that the light incident side can be located on the first side or on the second side.

15. An electronic device, characterized in that: The electronic device comprises a display device and the electronic device according to any one of claims 1 to 14, wherein the display device is used to display a stereoscopic image captured by the electronic device.

Images