METHODS FOR THE RESTORATION AND SIMULTANEOUS PLAYBACK OF STEREOSCOPIC IMAGES IN AUDIOVISUAL SEQUENCE BY ELECTRONIC DEVICES

Abstract

The process is characterized by the simultaneous reconstruction of a stereoscopic audiovisual image from a sequential image in red, green, and blue. This image is formed either by a stereo camera with a shutter that alternates between the left and right images, or through editing from two cameras, such that the video signal is compatible while forming a comparable double image that creates the illusion of depth. This simultaneous reconstruction process includes an electronic device for distributing the color components of the two fields of an image, such that the green component of the first field is combined with the red and blue components of the second field to form the first new field, and conversely, the green component of the second field is combined with the red and blue components of the first field to form the second new field.The video signal / frames is complete and compatible and contains a dual stereoscopic representation of the plane / object.

Description

i 2645385 PROCESSES SIMULTANEOUS IMAGE RESTORATION AND PLAYBACK STEREOSCOPIC IN SEQUENTIAL AUDIOVISUAL In patent application FR / 88-13432, a process was defined for creation and rendering of a quasi-stereoscopic image in vi- sequential deodorant. Contemporary art uses two processes resulting from right and left-facing shots taken by two cameras: - Sequential image reproduction; the succession of images left and right being made by frames and reading being assured Produced by PLZT ceramic or liquid crystal glasses. A An older but less compatible method was based on anaglyphs. - Maintaining simultaneous juxtaposition by preserving the synchronized dual channel for playback with two monitors or two video projectors. Besides the drawbacks of these reading methods such as modification- color shifts, bleaching, or excessive response time unstable, these processes are based on a sequential rea- system - tg read from two paths which, to be feasible, must discard the even frame of image A and the odd frame of image A' to obtain a complete image A", composed of two non-identical frames but close. In these systems, stereoscopic comparison creates relief will require too much visual accommodation which will be der- This results from fatigue and a qualitative reduction in relief. A correction of this excessive disparity is necessary to bring the two images as close as possible to their coincidence. This is something that current art does not provide. not. Furthermore, the technical constraints are such that the assembly and the lighting are... that these solutions cannot provide a satisfactory answer for everyday use of the relief. It is therefore necessary to reconsider the possibilities for innovation. This is what the process of comparing and creating a quasi-stereoscopic image described in the referenced patent. According to the process, the image is sequential: frames or phases from the moment of shooting, due to the fact that the automatic variable-base lens has a double set of lenses and alternates the right and left images by the action of a shutter rotating at the chosen frequency. - 2 2645385 - The shooting frequency is fixed at 100 Hz and modulated according to the usage. adjustments allow for a better approach to stereoscopic quality of the double sequential image. The comparison of these two digital images- risées, results in the real-time creation of a new, almost- stereoscopic: comparison performed by a systolic architecture microprocessor which stores this double image in RGB and RI V' B' and allows, using appropriate software, to reuse these images in the appropriate standards. This process uses only one camera for filming, a single magnetic tape for a single player and a single projection. But this simplification is not always possible for some scientific or industrial applications. The latter can ex- to have two synchronized cameras and a dual right and left channel, se- similar but comparable. During editing, this dual channel is reduced to a single strip that will hold the odd-numbered frame of image A and the even-numbered frame. from image A' to create a second image A", as in current art. The comparative quality and, consequently, the relief obtained will be inferior to a classic stereoscopic image if, to improve the image, one does not use- I do not read the comparison and modification process described in the patent referenced. The following three cases are considered: 1 - Direct sequential shooting according to the process. 2 - The sequence obtained from a two-camera shot have sequential by editing without image creation according to the process. 3 - Sequential editing from two channels by editing after modifying the disappearance and creating a new image as planned in the reference process. Within the framework of innovation and considering these sequential cases, the reading devices proposed by the referenced patent were based on the succession of right and left images, as in art current and on alternating polarization or ocular afterglow. The proposed innovation eliminates the drawbacks associated with se- quential and mechanical alternating solutions, the technical advance being to eliminate the succession of right and left images during playback to return to the photographic conception of the juxtaposition of the image stereoscopic and simultaneous superimposition on the screen. This innovation is indeed characterized by the reconstruction of the simultaneity of the stereoscopic image using electronic means and polarization from a sequential image in Red, Green, 3 2645385. Blue, regardless of its origin and method of obtaining it, to the point input into the cathode ray tube or liquid crystal displays. It is then characterized by an opposite polarization no longer between images or patterns as in contemporary art, but between components of the image- of the grain or of the weave: either Green on one side and Red, Blue on the other so that simultaneity is possible through the cross-juxtaposition of compositions the values ​​of the two images or frames in the video signal and their superposition to the projection on the screen, while retaining a complete video image. The devices recommended by this method are: based on a video signal Red, Green, Blue demodulated, at the output of the color matrix. 1 - On the electronic level: - A frame or phase separator with addressing of the first frame to a digitizer and to the memories reserved for Red, Green, Blue; of the second frame to a digitizer and to the memories reserved for Red' Green', Blue'. - Upon emerging from these memoirs (this is one of the characteristics of the in- novation) A- Simultaneous and juxtaposed addressing, after synchronization and conversion Analog configuration: 2O - Green signals, from the first frame to the Green electron beam. - Red Blue signals from the second frame to the Red Blue beams. This forms the first framework of the new image. B- Similar addressing of Green from the second frame and of Red Blue from the first frame to the corresponding electron beams; This constitutes the second layer of the new image. This image is therefore complete within the standard used and compatible. From From a stereoscopic point of view, juxtaposition and simultaneity are reconstructed killed. This electronic module is independent; it synchronizes by frequency upon reading. I1 can be supplemented: - Or by a demodulator which, from a composite or other signal, provides the Red Green Blue signals upstream. -- Or through the module for modifying and creating a quasi-image stereoscopic according to the referenced patent. It is compatible with any video viewing device. The described process concerns the two cases where juxtaposition is obtained from two successive and different frames due to the movement recorded between each frame. It is a sequential juxtaposition or the coincidence of homo- points logs will not be perfect, even corrected by the log creation system quasi-stereoscopic image. However, the two-channel imaging system allows for simultaneous juxtaposition and perfect coincidence of corresponding points. To achieve this, image processing is performed entirely for each channel, so that each image is stored left and right in Red, Green, Blue and Red', Green', Blue'. The signal for each image is complete. and in perfect correspondence. Upon output from memory, addressing to the player or recording VCR will be done as follows: - From the first frame of the left image, only the green luminance is recorded; from the first frame of the right image, only the... Red and Blue signals. - For the second frame, we do the same and so on. Each frame therefore contains all the points / images of the video signal and the The coincidence will be perfect between the points of the double stereoscopic image. This two-way processing system ensures optimal juxtaposition simultaneous and the best coincidence while preserving the advances in reading scenes from a single magnetic tape. On the other hand, during filming and editing, the practical difficulties and the importance of the equipment constitute a handicap. Adapting the camera will facilitate operations. The features are as follows: A single housing with a common control panel for two shooting systems, each with its own lens and one of the moving arms of the variable base, synchronized in such a way as to retain the advantages of the variable- automatic tee. This handy single-camera allows for simultaneous dual recording and ju- xtaposable which, using the proposed means of distribution in Red, Green, Blue, will retain, after inscription on a single strip, all the qualities of simultaneous stereoscopic image. 2 - In terms of polarization: When viewing any screen, green images will be polarized, for example, X, and red and blue images will be polarized Y, such that the double image, projected simultaneously and complementaryly on the color component plane and on the stereoscopic plane, will be read by each eye through a simple pair of glasses. X / Y "crossed" polarized. One variant introduces rear projection with miniaturized tubes, adjustable mirrors for convergence, and a diffusing screen that keeps the polarization, with identical reading through simple polarized glasses. For a television monitor, the recommended device is an application of the two characteristics of the innovation: the separation of the Red, Green, Blue components into sequential frames 1 and 2 and their simultaneity in addressing on the one hand, and, on the other hand, the means of applying an X polarization to Green and a Y polarization to Red and Blue at the image output. on the screen. This device takes into account the configuration of the phosphors on the screen so that the image provided by the green phosphors and that provided by Red and blue receive a different polarization on the screen. Experience shows that if two polarized filters are placed in opposition at 1800: - For the right eye, polarized X, the filter located behind darkens the image The image is polarized in Y, and the filter in front of it allows the image to pass through and is polarized in X. - For the left eye, polarized in Y, the situation is reversed: it can see the rear image, not the front one. If we now place the two filters together, in order for Green to be seen by the eye at X and for Red and Blue to be seen by the eye at Y, it is necessary and sufficient that: - Y-polarized light can pass through X - X-polarized light can pass through Y Without interference between the two polarizations. Since the X polarization was assigned to Green, the Green image must can pass through the Y screen facing the green phosphors and since the polarization The Y position is assigned to Red, Blue; Red, Blue must be able to pass through the X filter opposite the Red, Blue phosphors without these two passages alter the polarization of each image. The recommended method is to draw a depolarized line on the Y filter facing to each green phosphor in such a way that the green light and image are transmitted. pour this filter without being polarized, to take on the X polarization by passing through the second filter and be seen by the X polarized eye. Conversely, for Red, Blue, the second X filter must be marked by two depolarized lines opposite the Red, Blue phosphors, so that each in its own Red, Blue channel, passes through the first filter taking on the Y polarization and passes through the depolarized channel of the second X filter keeping its Y polarization to be seen by the Y polarized eye. 6 2645385 The eyes will therefore have a double juxtaposed image and, without playing the The afterimage effect will allow this double image to coincide into a single three-dimensional image. The twin polarizing screens are fixed in front of the cathode ray tube and The eyes are wearing simple crossed polarized glasses. These process assemblies with electronic modules and screens of polarizations are compatible with all current standards. Disconnected from monitors and video projectors, they leave the user classic devices for flat vision. The figures in the appendix will provide a better understanding of the innovation. Figure 1 is a schematic representation of a simultaneous stereo image se- Regarding the last case proposed: - In 100, the first Red, Green, Blue pattern; in 101, the first tra- My right is marked in Red, Green, Blue. The components are labeled 1, 2, 3. - In 102, each color component is digitized and then stored in 103 and 104, left and right. - In 105, the microprocessor calculates for addressing and synchronization, still by components which are distributed on a new frame in 106, which will be composed of 100 / 2 or Green of the left frame 100 and 101 / 1 or Red and 101 / 3 or Blue of the straight 101 grid. - In frames 107 and 108, components 1, 2, 3, or Red, Green, Blue, of the second left / right frames are analyzed, stored, and sent to the new frame 109, composed of Green or 108 / 2 and of Red or 107 / 1 and of Blue or 107 / 3. - The new frames 106 and 109 are video and stereo frames complete, each forming in itself a stereo image compa- rable, juxtaposed, simultaneous and in perfect cbIncidence. When each frame is repeated on the tubes of the projectors or displays Liquid crystals, which are polarized in opposite directions (PX, Green, and PY, Red / Blue), allow each eye to see its own image and perceive depth. on each frame. This system restores the quality of stereoscopic photography. tographic. Audiovisual sequentials no longer play a role in stereoscopic perception. Figure 2 is a schematic representation of a simultaneous image in originating from a sequential series of frames; therefore from successive frames. The distribution, digitization and storage are identical to the previous case. 26-45385 Addressing in 205 changes the distribution system. The first frame of the new image will have simultaneous juxtaposed components (206 / 1), but originating from two successive frames that do not perfectly coincide: Green from 200 / 2, Red from 201 / 1, and Blue from 201 / 3. The second frame of the new image (206 / 2) will be made of components Green 201 / 2, Red 200 / 1, Blue 200 / 3. Each frame will therefore have simultaneous right / left components with pos- The ability to recreate the relief with each frame. The succession of images in Sequential mode will therefore no longer be used. Figure 3 schematically illustrates the simultaneous image reading system for Red, Green, Blue on a television. In 300, the screen with its parallel and vertical lines of phosphors, in Red, Green, Blue. In 301, the first polarized X-screen in 2- facing Red and Blue. In 1, a depolarized line lets Y light (i.e., Green) through. In 302, the second screen, Y-polarized at 1, receives the Y or Green light from the television screen and, at 2, lets X-polarized light pass through. through two depolarized lines. Thus, at 303 vision, the left eye sees Red, Blue at 301 / of the rear screen and obscures 1 at 302. The right eye sees Green at 302 / 1 and obscures 302 / 2. 8 2645385 REVE ND ICA TI 0 NS 1 - Method according to claims 1 to 8 of the original patent, CHARACTERIZED in that: A- A set of electronic means, either from the signals de- modulated in Red, Green, Blue in sequential frames, either from right / left images demodulated on separate channels in Red, Green, Blue - after memorization and synchronization - distributes the components teslRed, Green, Blue, of two comparable frames in a stereo image- juxtaposed, simultaneous, and complementary right / left scopic waves, composed of the green signal from the first frame combined with the red and blue signals from the second frame, and then the green signal from the second frame combined with the red and blue signals from the first. frame to create both a complete and compa- video image a simple and a juxtaposed right / left stereoscopic image; which image will be served at the input of cathode ray tubes or displays liquid crystals. B- A right / left polarization, X and Y, opposed by fundamental components The red, green, and blue colors of the image allow the eye to distinguish them. the screen through Y-X polarized glasses, the only component / ima- ge which is intended for it, either Green component for one and component- Yours is Red, Blue for the other. 2 - A method according to claim 1, comprising an electronic device for creating a new juxtaposed and simultaneous stereoscopic image, CHARACTERIZED after frame separation operations (FIG. 1 / 100- 101, FIG. 2 / 200-201) of digitization (1 / 102 - 2 / 202) of memorization (FIG. 1 / 103-104 - 2 / 203-204) in that it includes an addressing and synchronization code (FIG. 1 / 105 - 2 / 205) which: - In the case of frame-based sequential - FIG. 2, creates the first new frame (206 1) with the Green signals of the first frame (200 / 2) and the Red / Blue signals of the second frame (201 / 1 - 201 / 3) and the second new frame with the Green signals (201 / 2) of the second frame and the Red / Blue signals of the second frame (200 / 1 - 200 / 3) of the first frame to constitute the video image com- complete and compatible 210, which is at the same time stereoscopic image juxtaposed and complementary. - In the case of the two paths used (FIG.1), the first frame is created. 9 2645385 new (FIG.1-1063) with the Green (100 / 2) signals of the first right frame and Red-Blue (101 / 1 - 101 / 3) of the second left frame; and the second new frame (FIG.1 - 109) with the Green (108 / 2) signals of the second left frame and Red-Blue (107 / 1 - 107 / 3) of the second right frame to constitute the new complete and compatible video image (110) which is at the same time, a stereoscopic image in simultaneous juxtaposition and in perfect coincidence of corresponding points. 3 - Method according to claim 2 CHARACTERIZED in that the device of relief reconstruction by polarization, in all cases of use- LO tion, includes X and Y polarization filters distributed across the components Red-Green-Blue colors of the image such that the image in Green and the image in Red-Blue should be in opposite polarization. - Method according to claims 1, 2, 3, characterized in that on receiver Whatever its form, the polarization device consists of: L5 A- by a fixed screen composed of two polarized filters PX (FIG.3 -301) and PY (302) whose polarization direction conforms to the configuration- tion of the phosphors of the television screen (300) over their entire surface. B- by depolarized channels (301 / 1 - 302 / 2) traced by any means appropriate tO on each filter, to allow the "Green" component, polari- The X component, polarized by the first filter (301 / 2), passes unmodified through the second filter (302 / 2), and the components, polarized by the second filter (302 / 2), are polarized by the second filter (302 / 1) to pass through the first filter (301 / 1) without undergoing mo- difications, such that, when viewing the screen, each eye, polarized X and Y (303), sees the only image reserved for it to create the terrain. - Method according to claims 1 and 2, characterized in that the camera of The camera system includes a single unit with a control panel. mun for two complete shooting devices, each of whose lenses is one of the movable arms of the stereoscopic variable base and synchronized with each other, so that this single camera ensures a Two-track recording that can be juxtaposed simultaneously (Red-) Green-Blue on a single stripe.

Claims

DEMANDS. 1 - The innovative process, to reconcile the relationship between the requirements of ocular vision of an audiovisual image obtained through the constraints of optical and videoelectronic means on the one hand and, on the other hand, the qualitative standards of stereoscopy requiring the convergence and coincidence of homologous points by juxtaposition of a double image or right and left frame, is CHARACTERIZED in that: a - a set of systems is created, from shooting to playback which allows, with a right and left stereo image, used either in juxtaposition or successively, to reconstitute a quality relief with audiovisual means using a single magnetic tape compatible with recording, transmission and playback systems to current and future standards.Hence b - are created shooting systems featuring a dual-lens camera with continuously variable automatic base to harmonize ocular convergence and optical convergence; systems which are adaptable either to current standards or to high definition standards which are considered imperative and must be integrated into the system in innovation to obtain high quality relief by bringing together fineness of line and pixel analysis and eye resolving power. c - means are created for distributing the frames of the double image to compose a single magnetic tape either in simple sequential by keeping one frame out of two for each channel or in sequential with simultaneous or successive juxtaposition by distributing the components / frame according to a cross process. d - electronic systems for comparing and correcting parallax and chromatism by "global repositioning" without discontinuity between successive frames, considered as complementary, and in real time, using systolic architecture processors, are created only for simple sequential if it presents a filmed shot with movement. e - universal reading means are created adapted to distribution systems and using: for simple sequential (O 50 or 100 Hz) and successive juxtaposed (50Hz read at 100 Hz) specific glasses with switching based on persistence and keeping the image full of light density and color. For simultaneous or simultaneous juxtaposed sequential, glasses based on the property of polarization which, in rotation parallel to its axis, retains illumination and obscuration over 900; or a screen with opposite dual polarization, placed in front of the monitor. 20- Device for implementing the method according to claim 1 CHARACTERIZED in that: in simple sequential mode, for a single-channel camera body, a double lens for taking right and left shots with continuously variable automatic base is created, (Fig.4 / 10) equipped with a shutter alternating left and right image (11) on a single magnetic tape. 30- Device for implementing the method according to claim 1, for the juxtaposed and simultaneous sequential CHARACTERIZED in that a single-unit dual camera with a single control is created with two right and left lenses, each constituting one of the telescopic mobile arms of the variable base, synchronized with each other and allowing this dual camera to ensure on two channels a simultaneous juxtaposable recording which can be taken back on a single channel in the classic standard. 40 - Device according to claims 2 and 3, CHARACTERIZED in that the rotary movement of the mobile arms is replaced by a horizontal movement of the image input lens so as not to modify the parallax with respect to the plane / film, the variation in length of the arms being compensated by a telescopic system. 5 - Device according to claims 2 and 3 CHARACTERIZED in that: - a programming module calculates the continuous movement of the variable base according to the desired relief (13); programming based on the 50th rule of the plane / film-object distance and on the correspondence between the 64mm eyepiece base and the 36nif optical base. - a cell transmits to a motion control microprocessor (12) the variations of the focus-object distance to continuously modify the spacing of the variable base. 60 - Method for distributing the right and left frames of images produced, according to claim 1, for the creation of a new stereoscopic image in simultaneous and juxtaposed sequential order, CHARACTERIZED in that, from the demodulated signals and after the standard frame separation operations ( Fig.1 / 100-101 and fig. 2) of digitization (1 / 102 and 2 / 202) and of memorization (1 / 103-104 and 2 / 203-204), it includes an addressing and synchronization code (1 / 105 and 2 / 205). - creating for simple frame-based sequential (Fig. 2) the first new frame (206 / 1) with the Green signal of the 1st frame (200 / 2) and Red / Blue of the 2nd frame (201 / 1-3) and the second new frame with the Green signal of the 2nd frame (201-2) and the Red-Blue signal (200 / 1-3) of the 1st frame to constitute the complete and compatible video image and at the same time a juxtaposed and complementary stereoscopic image. (210) - creating, in the case of using two channels (Fig. 1) the first new frame (106) with the Green (100 / 2) signals of the first left frame and Red-Blue (101 / 1-3) of the first right frame; and the 2nd new frame (109) with the Green (107 / 2) signals of the 2nd left frame and Red-Blue (108 / 1-3) of the 2nd right frame to constitute the new complete and compatible video image (110), in simultaneous juxtaposed stereoscopy and in perfect coincidence of homologous points. 70 - Method according to claim 1 for continuously comparing and correcting in real time the parallax and chromatic differences of two images taken at an interval of 20mls; CHARACTERIZED in that a specific program: drives the comparisons between previous and next frame. calculates parallax corrections and, based on these, brightness and chromaticity corrections. integrates them into the comparative framework by "global repositioning. reconstructs a complete image, stored in memory, serving as a basis for comparison to the next frame. controls a network of microprocessors with a systolic architecture, ensuring the required throughput per second by the number of chips used. 80 - Device for reading simple sequential, according to claims 1 and 6, CHARACTERIZED in that the recommended reading means are: a) for the single television used, glasses comprising: - a first black filter with an opening in the form of a slit corresponding to a convergence of vision of 2.5cm at 6m. (Fig.6 -20 / 21) - an alternating shutter mechanism in synchronization with the scrolling of the frames. - a shutter using polarizing filters, one of which is fixed (28) near the eyes and the other mobile, fixed on the alternating shutter mechanism, or a switching system, either drum or circular, with a recess and black mask alternating the afterimage and the direct vision image, the latter system retaining all the density of light and color. - a micromotor for driving the shutter (27), controlled by a double cell (25) synchronizing by microprocessor, the alternation of polarization or switching on the frequency / frame of the monitor, from 50 to 100 Hz. b) for the video projector, a system adapted for viewing relief on a screen comprising for the single video projector, an adapter with alternating polarization (Fig.5)(32) according to the principle of rotation parallel to the polarization axis; a drive mechanism (36); a micromotor (37) controlled by a cell (35) and a microprocessor (38) which ensures synchronization on the frequency / frames; reading on the screen being done with simple cross-polarization glasses. 90 - Device according to claims 1 and 6, for reading audiovisual relief in simultaneous sequential display on a video projector, the fixed cross-polarization is in opposition according to the components / frames, either in Y for the Green or Luminance signal and in X for the Red / Blue or chrominance signals; the reading being done on a screen using simple cross-polarized glasses. 100 - Device according to claim 1 and 6 for reading relief in simultaneous sequential on receiver-monitor, CAAACIRISE in that the device is constituted by a fixed screen composed of two opposingly polarized filters, either PX (Fig.3 / 301) or PY (302) with a polarization direction conforming to the configuration of the phosphors of the receiver screen (300) over their entire surface; this double screen being provided with depolarized channels (301 / 1302 / 2) traced by any suitable means on each filter to allow the Green component, X-polarized by the first filter (301 / 2) to pass without modification through the second filter (301 / 2) and the components, polarized by the second filter (302 / 1) to pass through the first (301 / 1) without undergoing modification; each X- and Y-polarized eye (303) seeing the only image reserved for it.