Wide-area 3D shooting and playback system
By using multiple cameras and smartphones in the 3D stereoscopic image system to process image information and generate and play 3D images, the problem of insufficient film sources is solved, and the ability of consumers to shoot and play 3D images by themselves is realized, and the 3D visual experience is expanded. range.
Patent Information
- Application Number
- CN202211217637.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-29
- Publication Date
- 2025-02-07
- Estimated Expiration
- 2042-09-29
AI Technical Summary
The existing 3D stereoscopic image system has the problem of insufficient film sources, and ordinary consumers cannot shoot or play 3D stereoscopic images by themselves, which limits the promotion and application of 3D videos.
Provided a wide-area 3D shooting and playback system, including at least three cameras and smartphones distributed at equal intervals in the horizontal direction. The smartphone receives and processes the cameras through a communication unit, an image information processing unit, a 3D real image generation unit and a playback unit. image information, generate and play 3D images.
It enables ordinary consumers to shoot and play 3D stereoscopic images by themselves, breaking the limitations of traditional 3D cameras and playback, and providing a wider 3D visual experience.
Smart Images

Figure CN115580718B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of 3D video recording and playback, and in particular to a wide-area 3D video recording and playback system. Background Art
[0002] The so-called "stereoscopic image" is an image with parallax. The reason why we have a three-dimensional feeling when looking at objects is that there is a distance difference (interpupillary distance) between our left and right eyes in horizontal distribution. This distance difference makes the left and right eyes see different pictures (mostly overlapping, and partly different). For example, if you are facing a person's face, your right eye can see the left ear of the person, but your left eye cannot see it, or can only see a little bit of the edge, while your left eye can see the right ear of the person, but your right eye can't see it very much. Similarly, the background image behind the face seen from the right eye will be different from the background image behind the face seen from the left eye. It is because of this difference that we can feel that the face and its relationship with the background are "three-dimensional".
[0003] We are used to this in our daily life, or we are not aware of the difference in binocular vision. Some people use the principle of perspective to draw a "3D" image on a plane to deceive vision. But the way to test whether this figure is just a flat "scam" or a real 3D is very simple, that is, use your left and right eyes to look at the picture separately. If the picture seen by the left and right eyes is the same, there is no parallax, then it is a false 3D.
[0004] How do 3D movies in cinemas and TVs provide images with parallax on a flat screen? No matter how different the details are, the basic principle is to provide two "left and right" images of an object to the left and right eyes at the same time. In this way, when you look at such an image from a flat surface, your left and right eyes see different images, just like you are looking at the displayed object with your own eyes (two eyes).
[0005] Specifically, this is done on a movie screen with a screen and two projectors (each playing an object photographed by a camera. The two projectors shoot at the same time, and the difference in horizontal position creates two simultaneous images of the same object with parallax). Each projector projects the image seen by the left or right eye. In this way, an image appears on the screen that appears to the naked eye as a superposition of two images with misaligned pictures.
[0006] However, when the projectors project images onto the screen, both projectors have added polarizing filters, one to polarize the light to the left and the other to polarize the light to the right, so that the light emitted by the two machines has different polarization directions. This polarization phenomenon cannot be distinguished by the naked eye, so what we see under naked eye conditions are two overlapping and misaligned images.
[0007] In order to make the audience see "stereo" images instead of overlapping images, the audience also needs to wear a pair of glasses, which are polarized glasses. The polarization directions of the left and right lenses are different, one to the left and the other to the right. After wearing polarized glasses, the audience's left eye can only see the image projected by the projector with a polarized lens pointing to the left, while the right eye can only see the image projected by the projector with a polarized lens pointing to the right. As a result, the left and right eyes can only see the image that the glasses on the side can see when facing the object directly. Once the two images are superimposed in the brain, a "stereoscopic picture" is perceived (seen).
[0008] The "stereo" image is not seen by one eye, as each eye sees only a flat image. "Stereo" is generated by the brain combining the different images with parallax from the two eyes. In this way, by sending (reflecting) two parallax images of the same object from a flat screen, and allowing the human eye to choose the image for the left and right eyes to "see" through glasses, we can see a "stereo" image from a flat surface.
[0009] The principle of stereoscopic image playback on television is the same as that in cinemas, and there can be different technical approaches. For example, for projection televisions, a completely cinema-like approach can be adopted, with two lenses projecting left and right images at the same time, and then the audience uses glasses with different left and right polarization to see the left and right eye images respectively.
[0010] But for flat-screen TVs, since the light source is generated by the screen and images are formed by the light emitted by the pixels on the screen, one pixel cannot emit the light required for two different images at the same time. Therefore, the left and right images of flat-screen TVs are realized through another method, which is to play the left and right images "in turns".
[0011] When playing moving images (such as movies), you only need to play at least 24 static images per second to achieve an image that looks like a continuous movement. This is because the human brain has a temporary memory of images. As long as a different image appears during the temporary memory period of the previous image but the image is in the same time sequence as the previous image, the human brain will automatically perceive the previous and next images as "continuous action".
[0012] The screen refresh rate of a TV is above 50 times per second. In this way, if the left eye can receive 25 images within one second, and the right eye can also receive 25 images within this second, then both the left and right eyes can see "continuous" images. Moreover, when playing, it is not that only the left eye is played in the first 0.5 seconds, and the right eye is played in the next 0.5 seconds, but the left and right eye images are played in turn, one left eye image, one right eye image... in turn. In this way, the images corresponding to the left and right eyes appear in turn on a flat surface. At this time, if you watch with naked eyes, you should see the image shaking, but because of the temporary memory of the image in the human brain, what we actually see is the "overlapping" like on the theater screen, and you can't see the "three-dimensional".
[0013] At this time, the audience also needs to wear a pair of glasses with different left and right polarizations, and use these glasses to select the left and right images emitted by the TV screen: when it is the right eye's turn to play the image, only the right lens allows light to pass through, and when it is the left eye's turn to play the image, only the left lens allows light to pass through. The result is that the left and right eyes take turns to see the "continuous" left and right images, and a three-dimensional image is generated in the brain.
[0014] There is a technical detail here, which is how the polarization direction of the light emitted by the TV screen matches the different polarization directions of the left and right polarization lenses. The light source is on the screen, and it can only emit one polarization at a time, either left or right, unlike the cinema, which emits two polarizations at the same time. The polarization of the glasses in the cinema only needs to distinguish between left and right, and there is no time synchronization requirement. However, the TV screen emits different left and right images in turn, which requires the polarization lenses of the glasses to be synchronized with them in time.
[0015] There are two ways to do this. One is that the screen only emits polarized light at a fixed angle, such as 0 degrees. The glasses are active, and the polarization direction of their lenses can be changed. If it is adjusted to zero degrees, it will be in the same direction as the screen light polarization, and the image can pass through, and the glasses can see it; if the polarization direction is changed to 90 degrees, the zero-degree polarized light cannot pass through, and the glasses cannot see the image.
[0016] In this way, when the screen displays the left-eye image, the active glasses adjust the polarization direction of the left lens to zero degrees, the same as the screen light, so that the image passes through the left lens and the left eye can see the left image; but at the same time, the polarization direction of the right lens is adjusted to 90 degrees, which is perpendicular to the polarization direction of the screen light. The screen light cannot pass through the right lens, and the right eye cannot see the left image. At this time, the brain only receives the left image. When the screen plays the right image, the active glasses adjust the polarization direction of the right lens to 0 degrees, allowing the zero-degree polarized screen light to pass through, so that the right eye can see the right image, and adjust the polarization direction of the left lens to 90 degrees, so that the polarization direction of the left lens is perpendicular to the polarization direction of the screen light. The screen light cannot pass through the left lens, and the left eye cannot see any image. The brain can only receive the right image in this round.
[0017] In this way, through an active pair of glasses, the light transmittance of the left and right lenses is adjusted according to the frequency of the left and right images played on the screen, so that the left and right eyes can only see the corresponding left and right images, creating a three-dimensional perception in the brain.
[0018] Another method is to use ordinary passive polarized glasses (the glasses in the cinema are passive), and the polarization directions of the left and right lenses are preset to differ by 90°, for example, the left lens is 0 degree polarization direction, and the right lens is 90 degree polarization direction. A transparent screen that can adjust the polarization angle of the screen light is installed in front of the existing smart phone 200 screen. When playing the left image, the polarization direction of the screen is 0 degree, and when playing the right image, the polarization direction of the screen is 90 degrees. In this way, when playing the left and right images respectively, the passive glasses can make the left and right eyes only see their own images.
[0019] Since the screen of a TV is relatively large, it is relatively expensive to install an active polarizing lens for the screen, so active polarization-adjustable glasses are usually used.
[0020] The principle of playing stereoscopic images on a flat-screen TV can be directly applied to the screen of the smartphone 200. As for the matching of the screen light and the polarization direction of the glasses lens, since the screen of the smartphone 200 is relatively small, it is not expensive to install an active polarization light adjustment screen for the screen, and the above two technical solutions can be used.
[0021] Although existing 3D movies or TVs provide left and right images with parallax, their viewing angle is single and fixed, that is, the audience can only see the 3D images from the viewing angle of the two left and right lenses.
[0022] For example, if you sit opposite a target object (such as a person), you can see the three-dimensional image of the target object with your eyes. At this time, if you slightly tilt your head to the left or right, you will see a slightly changed three-dimensional image. For example, if you tilt your head to the left, your right eye can also see the left ear of the other person, and your left eye can also see the background behind the other person, which the left eye could not see just now. On the contrary, if you tilt your head to the right, your left eye can see the right ear of the other person, and your right eye can see more of the background of the object that you could not see just now. In this way, the three-dimensional image of the object you can observe will be wider.
[0023] However, in existing 3D movies and TV shows, although the images are 3D, no matter which side you turn your head, you can only see the 3D images at the angle determined by the camera when shooting, and you cannot see different 3D images by moving your head like you do on the spot. This kind of 3D visual experience is still far from the real visual experience on the spot.
[0024] In addition, existing 3D videos or photos must be shot with special 3D camera equipment, and ordinary consumers cannot shoot (produce) their own 3D stereoscopic images (3D photos, 3D videos). In other words, the existing 3D stereoscopic imaging systems (movies, television) have a serious problem of insufficient film sources, which seriously restricts the promotion and application of 3D videos. Summary of the invention
[0025] The present invention is developed to solve the problem of insufficient film sources in the above-mentioned 3D stereoscopic image system, and aims to provide a wide-area 3D shooting and playback system.
[0026] The present invention provides a wide-area 3D shooting and playback system, which has the following characteristics, including: a camera device, which is used for performing multi-angle shooting at the same time, including at least three cameras equally spaced along the horizontal direction, the cameras are used for shooting to generate image information; a smart phone, which is connected to the camera device for communication, and is used for receiving image information and generating and playing 3D images based on the image information, wherein the spacing between two adjacent cameras is 75mm to 85mm, the smart phone at least includes a communication unit, an image information processing unit, a 3D real image generating unit, a playing unit and a control unit, the control unit is used to control the operation of the communication unit, the image information processing unit, the 3D real image generating unit, the playing unit and the camera device, the communication unit is connected to the camera device for communication, and is used to send a control signal to the camera device, the camera device shoots based on the control signal, and thus generates image information, the communication unit is also used to receive image information from the camera device, the image information processing unit processes the image information to obtain real image data corresponding to the multiple cameras respectively, the 3D real image generating unit generates a 3D real image based on all the real image data, and the playing unit is at least used to play the 3D real image.
[0027] The wide-area 3D shooting and playback system provided by the present invention may also have the following features: wherein the smart phone also includes a wide-area 3D image generation unit, the wide-area 3D image generation unit includes a simulation image data generation unit, a 3D simulation image generation unit and a wide-area 3D image generation unit, the simulation image data generation unit generates a set of simulation image data according to the real image data corresponding to any two adjacent cameras, the simulation image data is a simulation of the shooting result of the camera set between the corresponding two cameras, the 3D simulation image generation unit generates a 3D simulation image according to multiple sets of simulation image data, the wide-area 3D image generation unit generates a wide-area 3D image according to the 3D real image and the 3D simulation image, and the playback unit also plays the wide-area 3D image.
[0028] The wide-area 3D shooting and playback system provided by the present invention may also have the following features: wherein the playback unit at least includes an image playback unit, the image playback unit has a display screen, and the display screen is a finger touch screen display screen, the smart phone also includes a sliding information acquisition unit and an offset image acquisition unit, the sliding information acquisition unit acquires sliding information according to the sliding action of the user's finger on the display screen, the sliding information includes the direction and amplitude of the sliding, the offset image acquisition unit acquires the corresponding 3D image from the wide-area 3D image according to the sliding information and uses it as the offset image, and the image playback unit plays the offset image.
[0029] The wide-area 3D shooting and playback system provided by the present invention may also have the following features: wherein the smart phone also includes a storage unit, which is used to store the wide-area 3D image and store the corresponding relationship between sliding information and the degree of viewing angle offset, and the offset image acquisition unit acquires a 3D image at a corresponding degree of viewing angle offset from the wide-area 3D image as an offset image based on the sliding information and the corresponding relationship.
[0030] The wide-area 3D shooting and playback system provided by the present invention may also have the following features: wherein the smart phone further includes a camera, an offset angle calculation unit, and an offset image acquisition unit, the camera is used to capture the baseline image information when the user's face is facing a predetermined position of the display screen and the offset image information after the user's face is offset, the offset angle calculation unit generates the offset degree of the user's face relative to the predetermined position based on the baseline image information and the offset image information, the offset image acquisition unit acquires the corresponding 3D image after the offset from the wide-area 3D image based on the offset degree and uses it as the offset image, and the playback unit plays the offset image.
[0031] The wide-area 3D shooting and playback system provided by the present invention may also have such a feature, further comprising: polarized glasses for watching the 3D image played by the playback unit, wherein the playback unit at least comprises an image playback unit, the image playback unit having a display screen, the display screen is a display screen that emits fixed-angle polarized light, or a common display screen with a transparent polarized screen arranged outside the common display screen, when the display screen is a display screen that emits fixed-angle polarized light, the polarized glasses are active polarized glasses adapted to the display screen, and when the display screen is a common display screen, the polarized glasses are passive polarized glasses.
[0032] The wide-area 3D shooting and playback system provided by the present invention may also have the following features: wherein the playback unit at least includes an image playback unit, the image playback unit has a display screen, and the display screen is a finger touch screen display screen. The smart phone also includes an offset image generation unit, which generates a corresponding 3D image based on all real image data, a 3D real image, and the direction and amplitude of the user's finger sliding on the display screen and uses it as an offset image. The image playback unit plays the offset image.
[0033] The wide-area 3D shooting and playback system provided by the present invention may also have the following features: wherein the smart phone further includes a camera, an offset angle calculation unit, and an offset image generation unit; the camera is used to capture reference image information when the user's face is facing a predetermined position of the display screen and offset image information after the user's face is offset; the offset angle calculation unit generates the offset degree of the user's face relative to the predetermined position based on the reference image information and the offset image information; the offset image generation unit generates a corresponding 3D image based on the offset degree, the 3D real image corresponding to the predetermined position, and all the real image data and uses it as an offset image; and the playback unit plays the offset image.
[0034] The wide-area 3D shooting and playback system provided by the present invention may also have the following features: wherein the camera device includes: a mounting shell, which is in the shape of a rectangular parallelepiped and has at least a front surface, a rear surface and a lower surface; at least one camera assembly, which is mounted on the front surface of the mounting shell and has a camera; a circuit board, which is arranged in the mounting shell and is electrically connected to all the cameras, and is used to control the camera of the camera assembly and output the image captured by the camera assembly; a plug-in interface, which is arranged on the lower surface of the mounting shell and is electrically connected to the circuit board, and is used to connect to a smart phone via a data cable or to be plugged into a switching mechanism to power the camera and the circuit board and transmit information; and at least one spring clip, which is fixedly arranged on the rear surface of the mounting shell and is adapted to the thickness of the smart phone and is used to clamp the mounting shell on the smart phone.
[0035] The wide-area 3D shooting and playback system provided by the present invention may also have the following features: wherein the distance between two adjacent cameras is 80 mm, and two spring clips are provided.
[0036] Functions and Effects of the Invention
[0037] According to the wide-area 3D shooting and playback system involved in the present invention, because it includes a camera device and a smart phone 200, the camera device includes at least three cameras equally spaced in the horizontal direction, and the spacing between two adjacent cameras is 75mm to 85mm, so that at least three different angles of images of a photographed object can be obtained through these cameras. This is equivalent to having two pairs of eyes watching an object at the same time, and the two pairs of eyes are separated by a horizontal distance of the pupil distance, wherein the left eye of the right observer and the right eye of the left observer overlap.
[0038] In addition, because the smart phone 200 includes a communication unit, an image information processing unit, a 3D real image generating unit and a playback unit, wherein the communication unit is communicatively connected to the camera device and can send a control signal to the camera device, and the camera device shoots based on the control signal to generate image information, the communication unit can also receive image information from the camera device, the image information processing unit processes the image information to obtain real image data corresponding to multiple cameras respectively, the 3D real image generating unit generates a 3D real image based on all the real image data, and the playback unit plays the 3D real image, so that ordinary consumers can achieve 3D photography and playback of 3D effects through the wide-area 3D shooting and playback system.
[0039] The above wide-area 3D shooting and playback system not only breaks the traditional 3D camera mode, but also breaks the traditional 3D playback mode, that is, playback is limited to theaters and televisions. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] Figure 1 is a structural block diagram of a wide-area 3D shooting and playback system in Embodiment 1 of the present invention;
[0041] Figure 2 Schematic diagram of the stereoscopic structure of the camera device in Embodiment 1 of the present invention Figure 1 ;
[0042] Figure 3 Schematic diagram of the stereoscopic structure of the camera device in Embodiment 1 of the present invention Figure 2 ;
[0043] Figure 4 is a schematic diagram of a state in which the camera of the camera device in Embodiment 1 of the present invention is removed from the camera interface;
[0044] Figure 5 is a structural block diagram of a smart phone in Embodiment 1 of the present invention;
[0045] Figure 6 is a schematic diagram of the principle of performing 3D imaging based on the shooting results of the camera according to Embodiment 1 of the present invention;
[0046] Figure 7 are images of the same object captured by three cameras in Embodiment 1 of the present invention;
[0047] Figure 8 is a shooting flow chart of the wide-area 3D shooting and playback system in Embodiment 1 of the present invention;
[0048] Fig. 9 is a playback flow chart of the wide-area 3D shooting and playback system in Embodiment 1 of the present invention;
[0049] Fig.10is a structural block diagram of a smart phone in Embodiment 2 of the present invention;
[0050] Fig.11 is a playback flow chart of a wide-area 3D shooting and playback system in Embodiment 2 of the present invention;
[0051] Fig.12 is a structural block diagram of a smart phone in Embodiment 3 of the present invention;
[0052] Fig.13 is a shooting flow chart of a wide-area 3D shooting and playback system in Embodiment 3 of the present invention;
[0053] Fig.14 is a playback flow chart of a wide-area 3D shooting and playback system in Embodiment 3 of the present invention;
[0054] Fig.15 is a structural block diagram of the smart phone 200 in Embodiment 4 of the present invention;
[0055] Fig.16 is a playback flow chart of a wide-area 3D shooting and playback system in Embodiment 4 of the present invention; DETAILED DESCRIPTION
[0056] In order to make the technical means, creative features, objectives and effects of the present invention easy to understand, the following embodiments are combined with the accompanying drawings to specifically illustrate the wide-area 3D shooting and playback system of the present invention.
[0057] <Example 1>
[0058] Figure 1 It is a structural block diagram of the wide-area 3D shooting and playback system in Embodiment 1 of the present invention.
[0059] like Figure 1 As shown, Embodiment 1 provides a wide-area 3D shooting and playback system 1000, which includes a camera device 100, a smart phone 200, and polarized glasses 300. The camera device 100 is connected to the smart phone 200 for communication.
[0060] Figure 2 Schematic diagram of the stereoscopic structure of the camera device in Embodiment 1 of the present invention Figure 1 ; Figure 3 Schematic diagram of the stereoscopic structure of the camera device in Embodiment 1 of the present invention Figure 2 ; Figure 4 It is a schematic diagram of the state when the camera of the camera device in embodiment 1 of the present invention is removed from the camera interface.
[0061] The camera device 100 is used for performing multi-angle shooting simultaneously, and includes a housing 10 , a camera assembly 20 , a camera connector 30 , a circuit board (not shown in the figure), a plug-in interface 40 , and a spring clip 50 .
[0062] The mounting housing 10 is in a rectangular parallelepiped shape, and has a front surface 11, a rear surface 12, an upper surface 13, a lower surface 14, and two side surfaces. In this embodiment, the mounting housing 10 has a length of 190 mm, a width of 30 mm, and a thickness of 8 mm.
[0063] The number of the camera assembly 20 is one, which is mounted on the front surface 11 of the mounting housing 10, and has at least three cameras 21 that are evenly spaced along the length direction of the mounting housing 10. The spacing between two adjacent cameras 21 is 75 mm to 85 mm, and preferably, the spacing between two adjacent cameras is 80 mm. In this embodiment, the camera assembly 20 has three cameras 21.
[0064] like Figure 3 As shown, in this embodiment, the camera 21 has a camera interface. Three camera connectors 30 are also provided on the front surface 11 of the mounting housing 10. The camera connectors 30 are adapted to the camera interface. The three camera connectors 30 correspond to the three cameras 21 one by one, are plugged together and are electrically connected.
[0065] The circuit board is disposed in the mounting housing 10 and is electrically connected to the three cameras 21 through three camera connectors 30, and is used to control the camera 21 and output the camera identification information of the camera and the image captured by the camera (as image information) through the plug interface 40. The structure of the circuit board is prior art.
[0066] The plug interface 40 is disposed on the lower surface 14 of the mounting housing 10 and is electrically connected to the circuit board. The plug interface 40 is used to connect to the smart phone 200 via a data cable so that the smart phone 200 can power the camera 21 and the circuit board and transmit information with the camera device 100. In this embodiment, the plug interface 40 is a universal C-type interface.
[0067] The spring clip 50 is fixedly disposed on the rear surface 12 of the mounting housing 10 and is adapted to the thickness of the smart phone 200, and is used to clamp and fix the mounting housing 10 to the smart phone 200. In this embodiment, two spring clips 50 are provided, and the interval between the two spring clips 50 is about 30 mm. The spring clip 50 is a universal spring clip.
[0068] When in use, the camera device 100 is first clamped and fixed on the smart phone 200 by the spring clip 50, and then the plug interface 40 and the interface of the smart phone 200 are connected by a data cable, and finally the camera device 100 is controlled by the smart phone 200 to shoot.
[0069] Figure 5 It is a block diagram of the structure of the smart phone 200 in the first embodiment of the present invention.
[0070] like Figure 5 As shown, the smartphone 200 includes a communication unit 61, an image information processing unit 62, a 3D real image generation unit 63, a wide-area 3D image generation unit 64, a storage unit 65, a slide information acquisition unit 66, an offset image acquisition unit 67, a playback unit 68, and a control unit 69.
[0071] The communication unit 61 is connected to the camera device 100 via a data line for receiving camera identification information and corresponding image information from the camera device 100 .
[0072] The storage unit 65 stores the camera identification information and the corresponding image information. The storage unit 65 also stores the position information of each camera and the corresponding relationship between the sliding information and the degree of viewing angle deviation.
[0073] The image information processing unit 62 is used to process the image information to obtain real image data corresponding to each camera 21. The processing process is, for example, conventional denoising, restoration and the like.
[0074] The 3D real image generating unit 63 is used to generate a 3D real image based on all the real image data, and the process is the same as the process of generating a 3D image in the prior art. The 3D real image is a 3D image captured by the real camera 21.
[0075] Figure 6 It is a schematic diagram of the principle of performing 3D imaging based on the shooting results of the camera according to Embodiment 1 of the present invention. Figure 7 It is a schematic diagram of images of the same object captured by three cameras in Embodiment 1 of the present invention.
[0076] Assume that the object to be photographed includes a bag 01 and a water cup 02 placed in front of the bag 01. The positions of the three cameras 21 of the camera device 100 when photographing the object to be photographed are: Figure 6 As shown, the three cameras 21 are respectively recorded as camera 211, camera 212 and camera 213, and the images (videos) captured by them are respectively as shown in FIG. Figure 7 As shown in (a), 7(b), and 7(c).
[0077] Camera 211 is equivalent to the left eye of the person at the observation position 03, and camera 212 is equivalent to the right eye of the person at the observation position 03. Therefore, the image captured by camera 211 is equivalent to the image seen by the person with the left eye at the observation position 03, and the image captured by camera 212 is equivalent to the image seen by the person with the right eye at the observation position 03. The 3D real image obtained by using the images captured by camera 211 and camera 212 is equivalent to the real three-dimensional stereoscopic image seen by the person at the observation position 03.
[0078] Similarly, camera 212 is equivalent to the left eye of the person at observation position 04, and camera 213 is equivalent to the right eye of the person at observation position 04. Therefore, the image captured by camera 212 is equivalent to the image seen by the person with the left eye at observation position 04, and the image captured by camera 213 is equivalent to the image seen by the person with the right eye at observation position 04. The 3D real image obtained by using the images captured by camera 212 and camera 213 is equivalent to the real three-dimensional stereoscopic image seen by the person at observation position 04.
[0079] The 3D real image generating unit 63 can generate two groups of 3D real images corresponding to two different observation positions according to all the real image data.
[0080] The wide area 3D image generating section 64 includes a simulation image data generating unit 641 , a 3D simulation image generating unit 642 , and a wide area 3D image generating unit 643 .
[0081] The simulated image data generating unit 641 generates a set of simulated image data according to the real image data and position information corresponding to any two adjacent cameras 21, and the set of simulated image data is a simulated shooting result of a camera located at any position on the camera distribution line and between the corresponding two cameras 21. The simulated image data generating unit can generate two sets of simulated image data, one set of simulated data corresponding to camera 211 and camera 212, and the other set of simulated data corresponding to camera 212 and camera 213.
[0082] The 3D simulation image generation unit 642 generates a plurality of 3D simulation images according to the plurality of sets of simulation image data and the position information. The plurality of 3D simulation images are equivalent to the three-dimensional stereoscopic images seen by a person at any position between the observation position 03 and the observation position 04.
[0083] The wide-area 3D image generation unit 643 generates a wide-area 3D image based on the 3D real image and the 3D simulated image. The wide-area 3D image includes all 3D real images and all 3D simulated images. The storage unit 65 also stores the wide-area 3D image.
[0084] The playback unit 68 includes an image playback unit 681, which has a display screen. The display screen is a finger touch screen display screen, and the user can input shooting start instructions, shooting end instructions and viewing angle instructions through the display screen.
[0085] Once the user inputs a shooting start command, the communication unit 61 sends the shooting start command to the camera 100, and the camera 100 starts shooting. Once the user inputs a shooting end command, the communication unit 61 sends the shooting end command to the camera 100, and the camera 100 ends shooting.
[0086] The user inputs the viewing angle instruction through the display screen by sliding a finger on the display screen.
[0087] The sliding information acquisition unit 66 acquires sliding information according to the sliding action of the user's finger on the display screen. The sliding information includes the sliding direction and amplitude.
[0088] The offset image acquisition unit 67 acquires a corresponding 3D image from the wide area 3D image based on the sliding information and the correspondence relationship between the sliding information and the degree of viewing angle shift stored in the storage unit 65 and uses it as an offset image.
[0089] If the sliding amplitude in the sliding information acquired by the sliding information acquisition unit 66 is greater than the amplitude range in the sliding information stored in the storage unit 65, the offset image acquisition unit 67 uses the 3D real image corresponding to the observation position closest to the actual sliding amplitude as the offset image.
[0090] The image playing unit 681 plays the offset image through the display screen. In addition to the above-mentioned finger touch screen function, the display screen of this example can also emit polarized light with a fixed angle, thereby realizing the playback of 3D images.
[0091] The control unit 69 is used to control the operation of the communication unit 61, the image information processing unit 62, the 3D real image generation unit 63, the wide-area 3D image generation unit 64, the storage unit 65, the slide information acquisition unit 66, the offset image acquisition unit 67, the playback unit 68 and the camera device 100.
[0092] The polarized glasses 300 are used for users to wear so as to watch the 3D images played by the image playing unit 681. The polarized glasses 300 are active polarized glasses adapted to the display screen.
[0093] The working process of the wide-area 3D shooting and playback system 1000 in Example 1 includes a shooting process and a playback process, and the details are as follows:
[0094] Figure 8 It is a shooting flow chart of the wide area 3D shooting and playback system in Embodiment 1 of the present invention.
[0095] like Figure 8 As shown, the shooting process of the wide-area 3D shooting and playback system 1000 includes the following steps:
[0096] In step S1 - 1 , the user inputs a shooting start instruction through the display screen of the smart phone 200 .
[0097] In step S1 - 2 , the communication unit 61 sends a shooting start instruction to the imaging device 100 .
[0098] In step S1 - 3 , all cameras 31 of the camera device 100 start shooting to obtain image information.
[0099] In step S1 - 4 , the camera device 100 sends the camera identification information of the camera and the corresponding image information to the smart phone 200 .
[0100] Step S1 - 5 , the communication unit 61 receives the camera identification information and its corresponding image information.
[0101] In step S1-6, the storage unit 65 stores the camera identification information and the corresponding image information.
[0102] Step S1 - 7 : the image information processing unit 62 processes the image information to obtain real image data corresponding to each camera 21 .
[0103] Step S1 - 8 : the 3D real image generating unit 63 generates a 3D real image according to all the real image data.
[0104] Step S1 - 9 , the simulated image data generating unit 641 generates a set of simulated image data according to the real image data and position information corresponding to any two adjacent cameras 21 , and generates two sets of simulated image data in total.
[0105] In step S1 - 10 , the 3D simulation image generation unit 642 generates a plurality of 3D simulation images according to the two sets of simulation image data and the position information. The plurality of 3D simulation images are equivalent to the three-dimensional stereoscopic images seen by a person at any position between the observation position 03 and the observation position 04 .
[0106] Step S1-11: the wide-area 3D image generating unit 643 generates a wide-area 3D image according to the 3D real image and the 3D simulated image. The wide-area 3D image includes all the 3D real images and all the 3D simulated images.
[0107] In step S1 - 12 , the storage unit 65 stores the wide area 3D image.
[0108] Step S1 - 13 , the user inputs a shooting end instruction through the display screen of the smart phone 200 .
[0109] In step S1 - 14 , the communication unit 61 sends a shooting end instruction to the camera 100 .
[0110] Step S1-15, then the camera device 100 ends shooting.
[0111] Fig. 9 It is a playback flow chart of the wide-area 3D shooting and playback system in Embodiment 1 of the present invention.
[0112] like Fig. 9As shown, the playback process of the wide-area 3D capture and playback system 1000 includes the following steps:
[0113] In step S2-1, the user inputs a viewing angle instruction through the display screen of the smart phone 200, and the specific method of the input is to slide a finger on the display screen.
[0114] Step S2-2: The sliding information acquisition unit 66 acquires sliding information according to the sliding action of the user's finger on the display screen. The sliding information includes the sliding direction and amplitude.
[0115] In step S2 - 3 , the offset image acquisition unit 67 acquires the corresponding 3D image from the wide area 3D image according to the sliding information and the correspondence between the sliding information and the degree of viewing angle offset stored in the storage unit 65 and uses it as the offset image.
[0116] In step S2-4, the image playing unit 681 plays the offset image through the display screen.
[0117] Function and Effect of Example 1
[0118] According to the wide-area 3D shooting and playback system involved in Example 1, because it includes a camera device and a smart phone 200, the camera device includes at least three cameras equally spaced in the horizontal direction, and the spacing between two adjacent cameras is 75mm to 85mm, so that the image information of at least three different angles of a photographed object can be obtained through these cameras. This is equivalent to having two pairs of eyes watching an object at the same time, and the two pairs of eyes are separated by a horizontal distance of the pupil distance, wherein the left eye of the right observer and the right eye of the left observer overlap.
[0119] In addition, because the smart phone 200 includes a communication unit, an image information processing unit, a 3D real image generating unit and a playback unit, wherein the communication unit is communicatively connected to the camera device and can send a control signal to the camera device, and the camera device shoots based on the control signal to generate image information, the communication unit can also receive image information from the camera device, the image information processing unit processes the image information to obtain real image data corresponding to multiple cameras respectively, the 3D real image generating unit generates a 3D real image based on all the real image data, and the playback unit plays the 3D real image, so that ordinary consumers can achieve 3D photography and playback of 3D effects through the wide-area 3D shooting and playback system.
[0120] The above wide-area 3D shooting and playback system not only breaks the traditional 3D camera mode, but also breaks the traditional 3D playback mode, that is, playback is limited to theaters and televisions.
[0121] Furthermore, because the smartphone also includes a wide-area 3D image generating unit, which includes a simulation image data generating unit, a 3D simulation image generating unit and a wide-area 3D image generating unit, the wide-area 3D image generating unit can generate a wide-area 3D image containing 3D real images at two observation positions corresponding to the actual shooting results of the three cameras and 3D simulation images corresponding to each position between the two observation positions, so that the stereoscopic image of the object that the user can observe has a wider range.
[0122] Furthermore, the image playback unit of the playback unit has a display screen, which is a finger touch screen display screen, and the smart phone also includes a sliding information acquisition unit and an offset image acquisition unit. The sliding information acquisition unit acquires sliding information according to the sliding action of the user's finger on the display screen, and the offset image acquisition unit acquires the corresponding 3D image from the wide-area 3D image according to the sliding information and uses it as an offset image, and the image playback unit plays the offset image. In this way, the user can input the viewing angle instruction by sliding his finger on the display screen, and the image playback unit will play the 3D image corresponding to the viewing angle instruction, so that the user can see the 3D image corresponding to the deflection angle after the head is deflected, instead of the prior art that no matter which side the user's head is tilted, can only see the stereoscopic image at the viewing angle determined by the camera when shooting.
[0123] In addition, users can choose to see stereoscopic images of objects within a certain range from different perspectives by sliding on the display screen, which will provide users with an "immersive" visual experience. This is a greater evolution of the 3D stereoscopic visual experience obtained from a flat screen.
[0124] In addition, in Example 1, during the shooting process, 3D images of all observation positions between observation position 03 and observation position 04, that is, wide-area 3D images, are first obtained, and then corresponding images are directly obtained from the wide-area 3D images based on the viewing angle instructions input by the user through a sliding action on the display screen. In this way, the corresponding 3D images can be played for the user more quickly and accurately.
[0125] <Example 2>
[0126] Embodiment 2 provides a wide-area 3D shooting and playback system, which differs from the wide-area 3D shooting and playback system 1000 in Embodiment 1 only in the structures of the smart phone and the polarized glasses. For ease of expression, the same symbols are given to the same structures as those in Embodiment 1 in this embodiment, and the same descriptions are omitted.
[0127] Fig.10 It is a structural block diagram of a smart phone in Example 2 of the present invention.
[0128] like Fig.10 As shown, the smartphone 200a in Example 2 includes a communication unit 61, an image information processing unit 62, a 3D real image generation unit 63, a wide-area 3D image generation unit 64, a storage unit 65a, an offset angle calculation unit 66a, an offset image acquisition unit 67a, a playback unit 68a, a control unit 69a and a mobile phone camera (not shown in the figure).
[0129] Among them, the structures and functions of the communication unit 61, the image information processing unit 62, the 3D real image generating unit 63, and the wide-area 3D image generating unit 64 are exactly the same as those in Example 1, and are not described again here.
[0130] The storage unit 65a stores camera identification information and corresponding image information, and also stores position information of each camera. The storage unit 65a also stores wide-area 3D images.
[0131] The playback unit 68a includes an image playback unit 681a, which has a display screen. The display screen is a common finger touch screen display screen, and the user can input shooting start instructions and shooting end instructions through the display screen. In addition, a transparent polarization screen is also provided outside the display screen to facilitate the playback of 3D images.
[0132] In Embodiment 2, the user inputs the viewing angle instruction by using the mobile phone camera to capture an image of the user's face.
[0133] Specifically, the mobile phone camera is used to capture the reference image information when the user's face is facing the predetermined position of the display screen and the offset image information after the user's face is offset (deflected). The predetermined position is, for example, the center line of the mobile phone screen.
[0134] The deviation angle calculation unit 66a generates the degree of deviation of the user's face from a predetermined position based on the reference image information and the deviation image information.
[0135] The offset image acquisition unit 67a acquires the corresponding 3D image after the offset from the wide-area 3D image according to the offset degree and the reference 3D image and uses it as the offset image. The reference 3D image is, for example, a 3D simulation image corresponding to the observation position exactly between the observation position 03 and the observation position 04. When the user's face is facing the display screen, the corresponding viewing angle is the observation position exactly between the observation position 03 and the observation position 04.
[0136] If the degree of deviation exceeds a predetermined range, the deviation image acquisition unit 67 uses the 3D real image corresponding to the observation position (ie, one of the observation position 03 and the observation position 04 ) closest to the actual degree of deviation as the deviation image.
[0137] The image playing unit 681a plays the offset image through the display screen.
[0138] The control unit 69 is used to control the operation of the communication unit 61, the image information processing unit 62, the 3D real image generation unit 63, the wide-area 3D image generation unit 64, the storage unit 65a, the offset angle calculation unit 66a, the offset image acquisition unit 67a, the playback unit 68a, the mobile phone camera and the camera device 100.
[0139] The polarized glasses 300a in Embodiment 2 are used for users to wear so as to watch the 3D images played by the image playing unit 681a. The polarized glasses 300 are passive polarized glasses adapted to the display screen.
[0140] The shooting process of the wide-area 3D shooting and playback system in Embodiment 2 is exactly the same as that in Embodiment 1, and will not be described again here.
[0141] Fig.11 It is a playback flow chart of the wide-area 3D shooting and playback system in Embodiment 2 of the present invention.
[0142] The playback process of the wide-area 3D shooting and playback system in Example 2 includes the following steps:
[0143] Step S3-1, the user uses the mobile phone camera to capture the baseline image information when the user's face is facing the predetermined position of the display screen and the offset image information after the user's face is offset (deflected), thereby inputting the viewing angle instruction.
[0144] In step S3-2, the deviation angle calculation unit 66a generates the degree of deviation of the user's face relative to a predetermined position based on the reference image information and the deviation image information.
[0145] In step S3 - 3 , the offset image acquisition unit 67 a acquires a corresponding 3D image after offset from the wide area 3D image according to the offset degree and the reference 3D image and uses the 3D image as the offset image.
[0146] In step S4-4, the image playing unit 681a plays the offset image through the display screen.
[0147] Function and Effect of Example 2
[0148] The parts in Example 2 that are the same as those in Example 1 have the same technical effects and will not be described in detail here.
[0149] The input method of the viewing angle instruction in the second embodiment is different from that in the first embodiment. The method in the second embodiment for the user to input the viewing angle instruction is that the mobile phone camera captures an image of the user's face. Therefore, the smart phone 200a of the second embodiment includes a mobile phone camera, an offset angle calculation unit, and an offset image acquisition unit. The mobile phone camera can capture the reference image information when the user's face is facing the predetermined position of the display screen and the offset image information after the user's face is offset (deflected). The offset angle calculation unit generates the offset degree of the user's face relative to the predetermined position based on the reference image information and the offset image information. The offset image acquisition unit acquires the corresponding 3D image after the offset from the wide-area 3D image based on the offset degree and uses it as the offset image.
[0150] This also allows the user to see the 3D image at the corresponding deflection angle after the head is deflected, instead of the prior art where the user can only see the stereoscopic image at the viewing angle determined by the camera when shooting no matter which direction the user's head is tilted.
[0151] In addition, users can choose to see three-dimensional images of objects in a certain range from different perspectives by turning their faces. Compared with the method of making selections by sliding on the display screen, the operation is simpler and users have a more "immersive" visual experience.
[0152] <Example 3>
[0153] Embodiment 3 provides a wide-area 3D capture and playback system, which differs from the wide-area 3D capture and playback system 1000 in Embodiment 1 only in the structure of the smart phone. For ease of expression, the same symbols are given to the same structures as those in Embodiment 1 in this embodiment, and the same descriptions are omitted.
[0154] Fig.12 It is a structural block diagram of a smart phone in Example 3 of the present invention.
[0155] like Fig.12 As shown, the smartphone 200b in the third embodiment includes a communication unit 61, an image information processing unit 62, a 3D real image generating unit 63, a storage unit 65b, a sliding information acquiring unit 66, an offset image generating unit 67b, a playback unit 68 and a control unit 69b.
[0156] The structures and functions of the communication unit 61 , the image information processing unit 62 , the 3D real image generating unit 63 and the playing unit 68 are the same as those in the first embodiment and will not be described in detail herein.
[0157] The storage unit 65b stores the camera identification information, the corresponding image information, and the 3D real image. The storage unit 65 also stores the position information of each camera, and the corresponding relationship between the sliding information and the degree of viewing angle deviation.
[0158] When the sliding information acquisition unit 66 acquires sliding information including the sliding direction and amplitude according to the sliding action of the user's finger on the display screen, the offset image generation unit 67b generates a corresponding 3D image according to the real image data, the 3D real image, the position information, the sliding information and the correspondence between the sliding information and the degree of viewing angle offset stored in the storage unit 65 and uses it as the offset image.
[0159] If the sliding amplitude in the sliding information acquired by the sliding information acquiring unit 66 is larger than the amplitude range in the sliding information stored in the storage unit 65, the offset image generating unit 67b uses the 3D real image corresponding to the observation position closest to the actual sliding amplitude as the offset image.
[0160] The control unit 69 is used to control the operation of the communication unit 61 , the image information processing unit 62 , the 3D real image generating unit 63 , the storage unit 65 b , the slide information acquiring unit 66 , the offset image generating unit 67 b , the playback unit 68 , and the camera device 100 .
[0161] The working process of the wide-area 3D shooting and playback system in Example 3 includes a shooting process and a playback process, and the specific situation is as follows:
[0162] Fig.13 It is a shooting flow chart of the wide-area 3D shooting and playback system in Embodiment 3 of the present invention.
[0163] like Fig.13 As shown, the shooting process of the wide-area 3D shooting and playback system includes the following steps:
[0164] In step S4-1, the user inputs a shooting start instruction through the display screen of the smart phone 200b.
[0165] In step S4 - 2 , the communication unit 61 sends a shooting start instruction to the imaging device 100 .
[0166] In step S4-3, all cameras 31 of the camera device 100 start shooting to obtain image information.
[0167] In step S4-4, the camera device 100 sends the camera identification information of the camera and the corresponding image information to the smart phone 200b.
[0168] In step S4-5, the communication unit 61 receives the camera identification information and its corresponding image information.
[0169] In step S4-6, the storage unit 65 stores the camera identification information and the corresponding image information.
[0170] Step S4 - 7 : the image information processing unit 62 processes the image information to obtain real image data corresponding to each camera 21 .
[0171] Step S4-8: the 3D real image generating unit 63 generates a 3D real image according to all the real image data.
[0172] Step S4-9: the storage unit 65b stores the 3D real image.
[0173] In step S4-10, the user inputs a shooting end instruction through the display screen of the smart phone 200b.
[0174] In step S4 - 11 , the communication unit 61 sends a shooting end instruction to the camera 100 .
[0175] Step S4-12, then the camera device 100 ends shooting.
[0176] Fig.14 It is a playback flow chart of the wide-area 3D shooting and playback system in Embodiment 3 of the present invention.
[0177] like Fig.14 As shown, the playback process of the wide-area 3D capture and playback system 1000 includes the following steps:
[0178] In step S5-1, the user inputs a viewing angle instruction through the display screen of the smart phone 200, and the specific method of the input is to slide a finger on the display screen.
[0179] Step S5-2: The sliding information acquisition unit 66 acquires sliding information according to the sliding action of the user's finger on the display screen. The sliding information includes the sliding direction and amplitude.
[0180] In step S5-3, the offset image generating unit 67b generates a corresponding 3D image as the offset image according to the real image data, the 3D real image, the position information, the sliding information and the correspondence between the sliding information and the degree of viewing angle offset stored in the storage unit 65.
[0181] In step S5-4, the image playing unit 681b plays the offset image through the display screen.
[0182] Function and Effect of Example 3
[0183] The parts in Example 3 that are the same as those in Example 1 have the same technical effects and will not be described in detail here.
[0184] In addition, in the first embodiment, during the shooting process, 3D images of all observation positions between observation position 03 and observation position 04, i.e., wide-area 3D images, are first obtained, and then corresponding images are directly obtained from the wide-area 3D images based on the viewing angle instruction input by the user through a sliding action on the display screen. In the third embodiment, the user first inputs the viewing angle instruction through a sliding action on the display screen, and then the offset image generation unit 67b directly generates the corresponding 3D image based on the viewing angle instruction and uses it as the offset image. The two different implementations can achieve the same technical effect.
[0185] <Example 4>
[0186] Embodiment 4 provides a wide-area 3D shooting and playback system, which differs from the wide-area 3D shooting and playback system in Embodiment 3 only in the structures of the smart phone and the polarized glasses. For ease of expression, the same symbols are given to the same structures as in Embodiment 3 in this embodiment, and the same descriptions are omitted.
[0187] Fig.15 It is a block diagram of the structure of the smart phone 200 in the fourth embodiment of the present invention.
[0188] like Fig.15 As shown, the smartphone 200c in Example 4 includes a communication unit 61, an image information processing unit 62, a 3D real image generating unit 63, a storage unit 65c, an offset angle calculating unit 66c, an offset image generating unit 67c, a playback unit 68c, a control unit 69c and a mobile phone camera (not shown in the figure).
[0189] The structures and functions of the communication unit 61 , the image information processing unit 62 and the 3D real image generating unit 63 are the same as those in the third embodiment and will not be described in detail here.
[0190] The storage unit 65c stores the camera identification information, the corresponding image information, and the 3D real image. The storage unit 65 also stores the position information of each camera.
[0191] The playback section 68c includes an image playback unit 681c, which has a display screen. The structure and setting method of the display screen are the same as those of the display screen in Example 2.
[0192] In Example 4, the method for the user to input the viewing angle instruction is that the mobile phone camera captures an image of the user's face, which is the same as that in Example 2.
[0193] The structure and function of the mobile phone camera are the same as those of the camera in Example 2. The function of the offset angle calculation unit 66c is the same as that of the offset angle calculation unit 66a in Example 2.
[0194] The offset image generating unit 67c generates a corresponding 3D image after offset according to the real image data, the 3D real image, the position information and the offset degree and uses it as the offset image. It is assumed that when the user's face is facing the display screen, the corresponding viewing angle is the observation position 03 or the observation position 04.
[0195] If the degree of deviation exceeds a predetermined range, the deviation image generating unit 67c uses the 3D real image corresponding to the observation position (ie, one of the observation position 03 and the observation position 04) closest to the actual degree of deviation as the deviation image.
[0196] The control unit 69c is used to control the operation of the communication unit 61, the image information processing unit 62, the 3D real image generation unit 63, the storage unit 65c, the offset angle calculation unit 66c, the offset image generation unit 67c, the playback unit 68c, the control unit 69c, the mobile phone camera and the camera device 100.
[0197] The structure and function of the polarized glasses are the same as those in Example 3, and will not be described in detail here.
[0198] The shooting process of the wide-area 3D shooting and playback system in Embodiment 4 is exactly the same as that in Embodiment 3, and will not be described again here.
[0199] Fig.16 It is a playback flow chart of the wide-area 3D shooting and playback system in Embodiment 4 of the present invention.
[0200] like Fig.16 As shown, the playback process of the wide-area 3D capture and playback system 1000 includes the following steps:
[0201] Step S6-1, the user uses the mobile phone camera to capture the baseline image information when the user's face is facing the predetermined position of the display screen and the offset image information after the user's face is offset (deflected), thereby inputting the viewing angle instruction.
[0202] In step S6-2, the deviation angle calculation unit 66a generates a deviation degree of the user's face relative to a predetermined position based on the reference image information and the deviation image information.
[0203] In step S6 - 3 , the offset image generating unit 67 c generates a corresponding 3D image after offset according to the real image data, the 3D real image, the position information, and the offset degree and uses it as the offset image.
[0204] In step S6-4, the image playing unit 681c plays the offset image through the display screen.
[0205] The above-mentioned embodiments are preferred examples of the present invention and are not intended to limit the protection scope of the present invention.
[0206] For example, in the above embodiment, the viewing angle instruction is input by sliding a finger on the display screen or capturing the angle changes of the user's face through the camera of the smartphone. However, in actual use, other input methods can also be used, such as cooperating with the smartphone and the user's polarized glasses to obtain the angle between the display screen of the smartphone and the plane of the polarized glasses, and determining the viewing angle based on the angle.
Claims
1. A wide-area 3D shooting and playback system, characterized in that: include: A camera device, used for simultaneously shooting at multiple angles, comprising at least three cameras equally spaced in the horizontal direction, the cameras being used for shooting to generate image information; A smart phone is connected to the camera device for receiving the image information and generating and playing a 3D image based on the image information. The distance between two adjacent cameras is 75 mm to 85 mm. The smart phone at least includes a communication unit, an image information processing unit, a 3D real image generating unit, a playback unit and a control unit, wherein the control unit is used to control the operation of the communication unit, the image information processing unit, the 3D real image generating unit, the playback unit and the camera device. The communication unit is connected to the camera device for sending a control signal to the camera device. The camera device performs shooting based on the control signal to generate image information. The communication unit is also used to receive the image information from the camera device. The image information processing unit processes the image information to obtain real image data corresponding to the plurality of cameras respectively. The 3D real image generating unit generates a 3D real image according to all the real image data. The playback unit is at least used to play the 3D real image. The smartphone further includes a wide-area 3D image generating unit, which includes a simulated image data generating unit, a 3D simulated image generating unit, and a wide-area 3D image generating unit. The simulated image data generating unit generates a set of simulated image data according to the real image data corresponding to any two adjacent cameras, wherein the simulated image data is a shooting result of a camera set between the corresponding two cameras. The 3D simulation image generation unit generates a 3D simulation image according to multiple sets of simulation image data. The wide-area 3D image generation unit generates a wide-area 3D image according to the 3D real image and the 3D simulation image, The playback unit further plays the wide area 3D image.
2. The wide area 3D shooting and playback system according to claim 1, characterized in that: in, The playback unit at least includes an image playback unit, and the image playback unit has a display screen, which is a finger touch screen display screen. The smart phone also includes a sliding information acquisition unit and a displacement image acquisition unit. The sliding information acquisition unit acquires sliding information according to the sliding action of the user's finger on the display screen, and the sliding information includes the sliding direction and amplitude. The offset image acquisition unit acquires a corresponding 3D image from the wide area 3D image according to the sliding information and uses the image as an offset image. The image playing unit plays the offset image.
3. The wide area 3D shooting and playback system according to claim 2, characterized in that: in, The smart phone further includes a storage unit, the storage unit being used to store the wide-area 3D image and storing a corresponding relationship between the sliding information and the degree of viewing angle deviation. The offset image acquisition unit acquires a 3D image at a corresponding viewing angle offset degree from the wide-area 3D image as the offset image according to the sliding information and the corresponding relationship.
4. The wide-area 3D shooting and playback system according to claim 1, characterized in that: in, The smart phone also includes a camera, a deviation angle calculation unit and a deviation image acquisition unit. The camera is used to capture reference image information when the user's face is facing a predetermined position of the display screen and offset image information after the user's face is offset. The deviation angle calculation unit generates a deviation degree of the user's face relative to the predetermined position based on the reference image information and the deviation image information. The offset image acquisition unit acquires a 3D image corresponding to the offset from the wide area 3D image according to the offset degree and uses the 3D image as the offset image. The playback unit plays the offset image.
5. The wide area 3D shooting and playback system according to claim 1, characterized in that: Also includes: Polarized glasses, used for watching the 3D images played by the playing unit, The playback unit at least includes an image playback unit having a display screen. The display screen is a display screen that emits fixed-angle polarized light, or A normal display screen with a transparent polarized screen arranged outside the normal display screen, When the display screen is a display screen that emits polarized light at a fixed angle, the polarized glasses are active polarized glasses adapted to the display screen. When the display screen is a common display screen, the polarized glasses are passive polarized glasses.
6. The wide area 3D shooting and playback system according to claim 1, characterized in that: in, The playback unit at least includes an image playback unit, and the image playback unit has a display screen, which is a finger touch screen display screen. The smart phone also includes an offset image generating unit, which generates a corresponding 3D image according to all the real image data, the 3D real image, and the direction and amplitude of the user's finger sliding on the display screen and uses it as an offset image. The image playing unit plays the offset image.
7. The wide area 3D shooting and playback system according to claim 1, characterized in that: in, The smart phone also includes a camera, a deviation angle calculation unit and a deviation image generation unit. The camera is used to capture reference image information when the user's face is facing a predetermined position of the display screen and offset image information after the user's face is offset. The deviation angle calculation unit generates a deviation degree of the user's face relative to the predetermined position based on the reference image information and the deviation image information. The offset image generating unit generates a corresponding 3D image according to the offset degree, the 3D real image corresponding to the predetermined position, and all the real image data and uses it as the offset image. The playback unit plays the offset image.
8. The wide-area 3D shooting and playback system according to claim 1, Features: in, The camera device comprises: The mounting housing is in the shape of a cuboid and has at least a front surface, a rear surface and a lower surface; at least one camera assembly, mounted on the front surface of the mounting housing, having the camera; A circuit board is arranged in the installation housing and is electrically connected to all the cameras, and is used to control the camera of the camera assembly and output the image captured by the camera assembly; A plug interface, disposed on the lower surface of the mounting housing and electrically connected to the circuit board, for connecting to a smart phone via a data cable or for plugging into a switching mechanism to supply power to the camera and the circuit board and transmit information; and At least one spring clip is fixedly arranged on the rear surface of the mounting shell and is adapted to the thickness of the smart phone, and is used to clamp and fix the mounting shell on the smart phone.
9. The wide area 3D shooting and playback system according to claim 8, characterized in that: in, The distance between two adjacent cameras is 80 mm. The spring clips are provided in two.
Citation Information
Patent Citations
Image shooting apparatus, information acquiring apparatus, system and method, and transmission control method
CN106254756A
System, program, and the like
JP2022034107A