3D image display device and 3D image display method

Abstract

Even with 2D images that change in real time, we made it easy to make them appear three-dimensional. [Solution] The stereoscopic image device of the present invention consists of a stereoscopic device and a filter device. The stereoscopic device consists of a calculation memory processing unit, a shift display unit, a shift amount adjustment unit, and a shift timing transmission unit. The shift display unit displays each two-dimensional original frame image sent from the original image source at a first position a desired distance from the reference center position in the left-right direction for left-eye observation, and at a second position a desired distance from the reference center position for right-eye observation. The original frame images are sequentially displayed alternately at the first and second positions. The filter device is configured so that the user can view the image with their left eye when it is displayed at the first position, and with their right eye when it is displayed at the second position.

Description

Technical Field

[0001] The present invention relates to a device for stereoscopically displaying a two-dimensional video (moving image) on a display screen of a video display device such as a mobile terminal, a personal computer, a television, a game machine, a projector, a camera, a video, etc.

[0002] Conventionally, for each image constituting a video on a display screen of a video display device such as a television, an image for the left eye and an image for the right eye are displayed, and the user uses a stereoscopic glasses so that the left-eye image is viewed with the left eye and the right-eye image is viewed with the right eye, and by viewing the display screen, the video on the display screen can be seen stereoscopically.

Summary of the Invention

Problems to be Solved by the Invention

[0003] However, in order to make a video appear stereoscopic, it is necessary to create different left-eye images and right-eye images for each image constituting the video in advance and display them on the display screen. For example, it was impossible to show a real-time changing video such as a two-dimensional TV image distributed from a broadcasting station, etc. stereoscopically.

[0004] The inventor of the present invention has developed a device that can make a two-dimensional video that changes in real time appear stereoscopic through various experiments and the like.

Means for Solving the Problems

[0005] The stereoscopic video device of the present invention consists of a stereoscopic device and a filter device. The above-mentioned stereoscopic device consists of an arithmetic and storage processing unit that performs various operations and storage, a shift display unit, a shift amount adjustment unit, and a shift timing transmission unit. The above-mentioned shift display unit is for each two-dimensional original frame image constituting the video sent from the original video source, for either left-eye observation or right-eye observation, Video display deviceThe system is configured to display the original frame image on the display screen at a first position a desired distance from the reference center position in the left-right direction, then display the original frame image at a second position a desired distance from the reference center position for either left-eye observation or right-eye observation, and sequentially display each original frame image sent from the original video source alternately at the first and second positions on the display screen, the shift amount adjustment unit is configured to set the first and second positions, and the shift timing transmission unit sets each Original Frame The filter device is configured to transmit a synchronization signal to the filter device to display the image at the first position and the second position, and the filter device is configured to transmit the first position to the filter device Original Frame When the image is displayed in the first position above, the user, Original Frame The image can be viewed with either the left or right eye, as described above. Original Frame When the image is displayed in the second position, Original Frame The image is configured to be viewed with either the left or right eye. Furthermore, the shift amount adjustment unit can set the first position for either left-eye observation or right-eye observation to the left and right of the reference center position, and the second position is set to a position symmetric to the first position in the left-right direction with respect to the reference center position. It is characterized by the following:

[0006] Furthermore, the above-mentioned shift amount adjustment unit is While each original frame image is displayed sequentially on the above display screen, the first position of each original frame image can be changed to a desired distance left or right from the above reference center position. It is characterized by the following.

[0007] Furthermore, the shift amount adjustment unit sequentially displays each original frame image on the display screen, and then adjusts each original frame image In the original images in the desired order, the desired distance and shift amount are changed in the left-right direction from the above reference center position. It is characterized by the following.

[0008] Furthermore, the shift amount adjustment unit sequentially displays each original frame image on the display screen, Depending on the scene, the first position of each of the original frame images described above is configured to be changed by a desired distance to the left or right from the reference center position described above. It is characterized by the following.

[0009] Also, The present invention provides a stereoscopic image device and a filter device, the stereoscopic image device comprising an arithmetic memory processing unit that performs various calculations and storage, a shift display unit, a shift amount adjustment unit, and a shift timing transmission unit, the shift display unit displays each two-dimensional original frame image constituting the image transmitted from the original image source at a first position a desired distance from the reference center position in the left-right direction on the display screen of the image display device for either left-eye observation or right-eye observation, and then displays the original frame image at a second position a desired distance from the reference center position for either left-eye observation or right-eye observation, and so on, sequentially displaying each original frame image transmitted from the original image source alternately at the first position and the second position on the display screen, the shift amount adjustment unit The first position and the second position are configured to be set, the shift timing transmission unit is configured to transmit a synchronization signal to the filter device to display each original frame image at the first position and the second position, the filter device is configured so that when the original frame image is displayed at the first position, the user can view the original frame image with either the left or right eye, and when the original frame image is displayed at the second position, the user can view the original frame image with either the left or right eye, the shift amount adjustment unit is configured so that the first position for either left-eye observation or right-eye observation can be set to the left or right of the reference center position, and the second position is set to a position symmetrical to the first position in the left-right direction with respect to the reference center position. The above shift display unit divides each of the above original frame images, and for each divided image portion, it displays different first and second positions. of Set it, Applicable Each image section Each,It is characterized by being configured to display the first position and the second position in sequence.

[0010] Furthermore, the shift amount adjustment unit is characterized in that, while each original frame image is displayed sequentially on the display screen, it changes the shift amount of the first position of each divided portion of the original frame images in a desired order.

[0011] Furthermore, the shift amount adjustment unit is characterized in that, by changing the shift amount of the first position of one of the image portions obtained by dividing the original frame image into multiple parts, the shift amount of the first position of the other image portions of the original frame image is changed in accordance with the amount of change in the shift amount of the first image portion.

[0012] Furthermore, the shift amount adjustment unit is configured to change the first position displacement of adjacent image portions in accordance with the amount of change in the shift amount of one image portion obtained by dividing the original frame image into multiple image portions, and further, in accordance with the amount of change in the shift amount of the adjacent image portion, change the first position shift amount of the adjacent image portion, thereby sequentially changing the displacement of the first position of adjacent image portions.

[0013] Furthermore, the method for creating stereoscopic images of the present invention involves processing each two-dimensional original frame image that constitutes the image transmitted from the original image source, for either left-eye observation or right-eye observation. Video display device The image on the display screen is displayed at a first position at a desired distance from the reference center position in the left-right direction, and then the original frame image is displayed at a second position at a desired distance from the reference center position for either left-eye observation or right-eye observation, and a filter device is used to... Original Frame When the image is displayed in the first position above, the user, Original Frame The image can be viewed with either the left or right eye, as described above. Original Frame When the image is displayed in the second position, Original FrameThe image can be viewed with either the left eye or the right eye, and for each original frame image sequentially sent from the original video source, it is alternately displayed at a first position and a second position on the display screen. The filter device makes each Original Frame image appear three-dimensional. The first position can be set to the left or right of the reference center position. and The second position is set to a position symmetric to the first position in the left-right direction with respect to the reference center position.

Advantages of the Invention

[0014] According to the present invention, two-dimensional TV images distributed from a TV station or the like, game videos during game use, etc. can be made to appear three-dimensional in real time.

Brief Description of the Drawings

[0015] [Figure 1] It is an explanatory diagram of the video three-dimensionalization device of the present invention. [Figure 2] It is an explanatory diagram of the three-dimensionalization device and the filter device of the video three-dimensionalization device of the present invention. [Figure 3] It is an explanatory diagram of the three-dimensionalization device of the video three-dimensionalization device of the present invention. [Figure 4] It is an explanatory diagram of the shift display unit of the video three-dimensionalization device of the present invention. [Figure 5] It is an explanatory diagram of the shift display unit of the video three-dimensionalization device of the present invention. [Figure 6] It is an explanatory diagram of the shift display unit of the video three-dimensionalization device of the present invention. [Figure 7] It is an explanatory diagram of the three-dimensionalization device of the video three-dimensionalization device of the present invention. [Figure 8] It is an explanatory diagram of the shift display unit of the video three-dimensionalization device of the present invention. [Figure 9] It is a flowchart of the video three-dimensionalization device of the present invention. [Figure 10] It is an explanatory diagram of each divided image of the second embodiment of the present invention. [Figure 11]This is an explanatory diagram showing how each segmented image of the second embodiment of the present invention is displayed at the first position and the second position. [Figure 12] This is an explanatory diagram illustrating the case where the first position of each segmented image of the second embodiment of the present invention is changed. [Modes for carrying out the invention]

[0016] The present invention will be described below with reference to the drawings. [Examples]

[0017] (1. Explanation of the 3D image creation device)

[0018] As shown in Figures 1 and 2, the stereoscopic image device of the present invention comprises a stereoscopic device 2 that sequentially displays each original frame image of a 2D video source 8, such as a 2D television video distributed from a broadcasting station, a 2D video stored in the memory unit of the video display device 1, or a 2D game video being executed in the arithmetic memory processing unit of a game console, on the display screen 1a of the video display device 1, for example, by alternating between displaying each original frame image sequentially on the display screen 1a at a first position for viewing with the left eye and displaying each original frame image sequentially at a second position for viewing with the right eye, and a filter device 3 configured so that when the 2D image is displayed at the first position, the user can view the 2D image with their left eye, and when the 2D image is displayed at the second position, the user can view the 2D image with their right eye.

[0019] (2.1. Explanation of filter device 3 (shutter-type glasses))

[0020] The filter device 3 described above consists, for example, of eyeglasses with left and right shutters that can be opened and closed, for example, of an eyeglass-shaped frame 3a that can be worn on the head, and left and right liquid crystal (LC) shutters 3L and 3R that can be opened and closed, respectively, provided on the frame 3a in front of the left and right eyes of the user.

[0021] The left shutter 3L and right shutter 3R mentioned above are known commercially available optical shutters, such as liquid crystal shutters, micromirror shutters, and mechanical shutters.

[0022] Furthermore, the above-mentioned eyeglasses with shutters may also be those in which the left lens 3b and right lens 3c of a standard corrective eyeglasses are equipped with shutters 3L and 3R, respectively.

[0023] Furthermore, as will be described later, the left shutter 3L is configured to open when the original frame image is displayed in the first position and close when it is displayed in the second position, based on the reception of a synchronization signal from the shift timing transmission unit. Similarly, the right shutter 3R is configured to open when the original frame image is displayed in the second position and close when it is displayed in the first position.

[0024] (2.1. Explanation of Filter Device 3 (Circular Polarizing Glasses))

[0025] Another example of the filter device 3 is a pair of polarized glasses comprising a display polarizing filter provided on the display screen that can change the linear polarization of an image passing through it to left-rotating or right-rotating circular polarization, or that allows an image whose circular polarization direction is either left-rotating or right-rotating to pass through; a left-rotating circular polarizing filter that passes only left-rotating polarization; and a right-rotating circular polarizing filter that passes only right-rotating polarization. These polarized glasses consist of, for example, a glasses-like frame that can be worn on the head, and a left-rotating polarizing filter and a right-rotating polarizing filter provided on the part of the frame that is positioned in front of each of the user's left and right eyes.

[0026] Furthermore, the left-rotating polarizing filters and right-rotating polarizing filters on the left and right sides of the above-mentioned polarized glasses may be installed in the frame in reverse.

[0027] As will be described later, the display polarizing filter, upon receiving a synchronization signal from the shift timing transmitter, polarizes the original frame image in a left-rotating direction when the original frame image is displayed at the first position, so that the image can be seen only by the left-rotating polarizing filter. When the original frame image is displayed at the second position, it polarizes the original frame image in a right-rotating direction so that the image can be seen by the right-rotating polarizing filter.

[0028] (3. Explanation of the 3D rendering device 2)

[0029] Furthermore, the 3D modeling device 2 consists of an arithmetic memory processing unit 4 that performs various calculations and storage, a shift display unit 5, a shift amount adjustment unit 6, and a shift timing transmission unit 7.

[0030] Furthermore, all or part of the shift display unit 5, the shift amount adjustment unit 6, and the shift timing transmission unit 7 may be included within the calculation and storage processing unit 4.

[0031] Furthermore, the 3D modeling device 2 may have input devices, which may include a keyboard, keypad, touchscreen, mouse, trackball, laser pointer, voice-activated user control, joystick, steering wheel, and many known user interface input devices, as needed.

[0032] (3.1. Explanation of Shift Display Unit 5)

[0033] The shift display unit 5 receives a plurality of original frame images constituting a two-dimensional image sequentially from the original image source 8. For each received original frame image, it is shifted (moved) on the display screen to a first position, which is a desired distance to the left or right from the reference center position used when displaying a normal image on the display screen, for left-eye observation, and displayed for a desired time. Next, the original frame image is shifted (moved) to a second position, which is a desired distance from the center, for right-side observation, and displayed for a desired time. The unit is configured to sequentially display each original frame image sent from the original image source 8 alternately at the first and second positions on the display screen 1a.

[0034] In other words, when the 3D display unit 5 receives the original video source 8 from the original video source 8, in the order of the first original frame image, the second original frame image, the third original frame image, and so on, the shift display unit 5 will first display the first original frame image at the first position, then at the second position, then at the first position of the second original frame image, and so on, for the third original frame image and subsequent images, in the same order, alternating between the first and second positions.

[0035] Furthermore, the first position and the second position are set symmetrically with respect to the reference center position, for example, and the first position and the second position are set at equidistant positions in the left-right direction from the reference center position of the display screen.

[0036] In the example above, the original frame image is initially displayed in the first position for left-eye observation, and then in the second position for right-eye observation. However, it is also possible to initially display the original frame image in the second position for right-eye observation, and then in the first position for left-eye observation.

[0037] In addition to displaying each original frame image that makes up the two-dimensional image sequentially from left to right, it is also possible to display only the original frame images at desired intervals, such as every other frame or every two frames, instead of displaying all of the received original frame images.

[0038] Furthermore, the original frame image sent may be scaled down for display in the first and second positions.

[0039] In addition to displaying the entire original frame image that was sent, it is also possible to display only a portion of the original frame image, for example, excluding the sides or edges.

[0040] (3.2. Explanation of Shift Amount Adjustment Unit 6)

[0041] The shift amount adjustment unit 6 sets the distance (shift amount) in the left-right direction between the first position and the reference center position, and also sets the shift amount of the second position.

[0042] The shift adjustment unit 6 is set as the second position, for example, by determining the shift amount between the first position and the reference center position, so that it is symmetrical with respect to the reference center position in the left-right direction.

[0043] Furthermore, the shift amount can be set or changed, for example, before viewing the video, or after displaying the video, depending on the time, the scene, the user, or a pre-set setting.

[0044] The maximum distance to the left and the maximum distance to the right of the first position, and the maximum distance to the right and the maximum distance to the left of the second position, can be set by finding a threshold distance at which the images displayed at the first and second positions no longer appear as a single image when viewed by the user.

[0045] Furthermore, the maximum shift position to the left of the above-mentioned reference center position at the first position is the maximum position at which an image can be formed by both eyes, and is, for example, a position shifted by half the interpupillary distance of the user.

[0046] Then, when each of the original frame images is shifted by the amount adjusted by the shift amount setting unit 6a, the user will be able to view the images three-dimensionally in the front-to-back (forward-to-back) direction relative to the display screen.

[0047] For example, as shown in Figure 4, if the first position A is shifted to the left by the desired amount from the reference center position X, and the second position B is shifted to the right by the desired amount, the image-forming portions Y of the left and right eye EL and ER will be behind the display 1a screen, and therefore the image will appear to be behind the display 1a screen.

[0048] For simplicity, positions A and B above indicate the center position of the original frame image after it has been shifted and displayed.

[0049] Furthermore, as the first position A approaches the reference center position X from the maximum left-side shift position, the sense of depth and three-dimensionality decreases.

[0050] Furthermore, when the first position A is the reference center position X, as shown in Figure 5, the image appears as if it were displayed on the display screen 1a, and the image does not appear three-dimensional.

[0051] In this case, the first position and the second position will be the same.

[0052] Furthermore, if the first position A is shifted to the right beyond the reference center position X, as shown in Figure 6, the image-forming portions X of the left and right eye EL and ER will be in front of the display screen 1a, and the image will appear to be in front of the display screen 1a.

[0053] Furthermore, the first position A is to the right of the reference center position X, and as it moves away from the reference center position X, it becomes visible closer to the viewer than the display screen 1a.

[0054] Furthermore, depending on the settings or by the user, the first position described above may be set to be, for example, only to the right of the reference center position described above.

[0055] Furthermore, in addition to setting the above-mentioned shift amount before displaying the image on the display screen, the shift amount may also be changed to a different value while the image is being displayed, for example, at predetermined intervals or for each image scene.

[0056] By making these changes, it becomes easier to grasp the passage of time and the transition between scenes.

[0057] Furthermore, the shift amount adjustment unit 4 may be configured to continuously change the shift amount while images are being displayed sequentially, either through a pre-set configuration or through user operation.

[0058] For example, the shift amount of each of the multiple original frame images that make up the two-dimensional video sent sequentially from the original video source 8 is changed in the desired order of images.

[0059] The images in the desired order described above can be shifted in order for each image, or by changing the shift amount for images at desired intervals, such as every other image or every two images.

[0060] Furthermore, the shift amount may be changed discontinuously by changing the direction (changing the shift amount from decreasing to increasing, or from increasing to decreasing), for example, by decreasing (or increasing) the shift amount of the first position so that the first position is sequentially changed in one direction, such as from left to right, or sequentially moved in one direction and then moved in the other direction.

[0061] Furthermore, the concept of the shift amount of the first position from the reference center position includes negative values. If the first position is to the left of the reference center position, it is displayed as a positive value; if it is to the right of the reference center position, it is displayed as a negative value. When the shift amount decreases, the object moves from left to right; when the shift amount increases, it moves from right to left.

[0062] Furthermore, the amount of change in the shift amount may be set to a constant value or changed according to predetermined conditions.

[0063] For example, the change amount could be set to move from left to right in increments of 0.1 mm, and when it reaches a preset rightward shift amount, it could move to the left, and similarly when it reaches a preset leftward shift amount, it could move to the left, and so on.

[0064] The above settings for the left-hand shift amount and the right-hand shift amount can be set to a constant value, or they can be changed.

[0065] Additionally, while the video is being displayed, the user may be able to change the shift amount left or right through their operation, thereby moving the video forward or backward.

[0066] Furthermore, the display screen 1a may be divided into cases where the image is displayed only on the far side and cases where it is displayed only on the near side.

[0067] In other words, for example, to change the difficulty level in a game, you can move the object to the back or to the front.

[0068] Furthermore, the shift amount adjustment unit 6 may be modified so that the user can freely change the shift amount using a remote control.

[0069] (3.3. Explanation of Shift Timing Transmitter 7)

[0070] Furthermore, the shift timing transmission unit 7 is configured to transmit a synchronization signal to the shutter-type glasses, for example, when the filter device 3 is a shutter-type glasses, to open the left eye shutter and close the right eye shutter when the displayed image is shown in the first position for left eye observation, and to close the left eye shutter and open the right eye shutter when the image is shown in the second position for right eye observation.

[0071] Furthermore, the shift timing transmission unit 7 is configured to transmit a synchronization signal to the display polarizing filter, in the case of circular polarizing glasses, such that when the displayed image is displayed at a first position for left-eye observation, the original frame image is polarized in the left-rotating direction and passes through the display polarizing filter so that the image can only be seen with the left-rotating polarizing filter, and when the image is displayed at a second position for right-eye observation, the original frame image is polarized in the right-rotating direction and passes through the display polarizing filter so that the image can only be seen with the right-rotating polarizing filter.

[0072] The synchronization signal can be transmitted via a wired connection, such as wired synchronization, or wirelessly, such as wireless synchronization. The synchronization signal may include both radio frequency (RF) and infrared (IR) signals.

[0073] (4. An example of a 3D modeling device 2)

[0074] Figure 7 shows details of an example of the shift device of the 3D modeling apparatus 2 of the present invention.

[0075] Cable 234 transmits the original video, consisting of original frame images, from the original video source to the stereoscopic device 2.

[0076] Cable 234 can be connected to a DVI connector 241. The DVI connector 241 is connected to a DVI receiver 242, for example, a shortest transition time differential signal (TDMS) receiver manufactured by Silicon Imaging Inc. (Costa Mesa, California). The DVI receiver 242 may include a general-purpose IC.

[0077] Furthermore, the DVI receiver 242 is connected to the input / output module 244I of the frame processor 244. The frame processor 244 comprises a central processing unit, i.e., a CPU 244C, an electrically erasable read-only memory, i.e., an EEPROM 244E, and a line memory 244L.

[0078] The EEPROM244E described above may contain instructions for the CPU244C, such as a modifiable and upgradeable frame processing program.

[0079] Furthermore, the shift display unit 5 includes a frame processor 244 and a controller 246 that output pixel data 245 to a dual-port video memory.

[0080] The controller 246 described above includes a first frame buffer 246A and a second frame buffer 246B.

[0081] The first frame buffer 246A contains processed frames 246X stored therein, and the second frame buffer 246B contains processed frames 246Y stored therein.

[0082] Furthermore, the controller 246 reads out the first frame buffer 246A and the second frame buffer 246B as pixel data 247.

[0083] The above pixel data 247 is transmitted from the controller 246 to the DVI transmitter 248, for example, a TDMS transmitter manufactured by Silicon Imaging Inc.

[0084] The DVI transmitter 248 described above may be equipped with a general-purpose IC. The DVI transmitter 248 is connected to the DVI connector 249.

[0085] The DVI connector 249 is connected to the cable 236 so that the shifted frame image is transmitted to the display screen 1a.

[0086] Furthermore, the filter device 3 is connected to the timing signal from the shift display unit 5.

[0087] The left signal 236L is transmitted to the left shutter 3L, and the right signal 236R is transmitted to the right shutter 3R.

[0088] In some embodiments, the left and right shutter command signals may be multiplexed by a single signal from the shift display unit 5.

[0089] The signal from the shift display unit 5 to the shutter synchronizes the observation of each eye with the video frame presented on the display, such that the left shutter opens when the left eye image is on the display, and the right eye shutter opens when the right eye image is on the display.

[0090] (5. Explanation of frame images)

[0091] Next, I will explain the frame images that are displayed on the screen.

[0092] Figure 8 shows the input frame 234F, the first frame buffer 246A, the second frame buffer 246B, and the output frame 236F of the system in Figure 1.

[0093] Input frame 234F may be output from the original video source 8 and provided to the stereoscopic device 2.

[0094] The input frame 234F may be received and, for example, reduced and stored in one of the first frame buffer 246A or the second frame buffer 246B.

[0095] In many embodiments, for example, in computer games, movies, and computer graphics, input frames may be received without reducing the frame size to avoid trimming and stored in one of the first frame buffer 246A or the second frame buffer 246B.

[0096] In some embodiments, for example, on some personal computers running Windows® and / or Macintosh®, it may be useful to reduce the input frame size and / or the magnification of the image displayed on the screen in order to avoid cropping.

[0097] Frame reduction may involve scaling down the image within the frame so that the size of the image and / or frame is reduced when displayed on the display screen, in order to avoid cropping of the shifted image.

[0098] Reduction may occur before the image is split into left and right images so that the magnification and size of the images shown to each eye are the same.

[0099] The first input frame 234X is received by the processor, for example, reduced in size, and stored in the first frame buffer 246A. The first input frame 234X can then be read, shifted, and transmitted as output frames 234X1 and 234X2.

[0100] The output frame 234X1 above corresponds to the frame seen by the left eye, and the output frame 234X2 may correspond to the frame seen by the right eye.

[0101] Output frame 234X1 can be shifted to the left, for example, and output frame 234X2 can be shifted to the right.

[0102] The second input frame 234Y may be received and read by the processor and stored in the second frame buffer 246B. The second input frame 234Y may then be read, shifted, and transmitted as output frames 234Y1 and 234Y2.

[0103] Output frame 234Y1 may correspond to the frame seen by the left eye, and output frame 234Y2 may correspond to the frame seen by the right eye.

[0104] The third input frame 234Z may be received, reduced, and stored in the first frame buffer 246A by the processor. The third input frame 234Z may be read out, shifted, and transmitted as output frames 234Z1 and 234Z2.

[0105] Output frame 234Z1 may correspond to the frame seen by the left eye, and output frame 234Z2 may correspond to the frame seen by the right eye.

[0106] Further frames may be received, reduced, stored, loaded, shifted, and transmitted accordingly.

[0107] In some embodiments, the speed of the input frame 234F may be half the speed of the output frame 236F. The output frame speed (FR OUT) can be twice the input frame speed (FR IN) (Hertz (Hz)). Accordingly, the duration of the output frame may be half the duration of the input frame.

[0108] Many applications can be made in the embodiments shown in Figures 1 to 8.

[0109] For example, input frames may be trimmed instead of being reduced in size, and every other input frame may be omitted so that the time interval of the input frames matches the time interval of the output frames.

[0110] (6. Description of the process of the present invention)

[0111] Figure 9 illustrates the process of the present invention.

[0112] For the sake of simplicity, this is an example where the shift amount is set in advance.

[0113] Method 300 can be performed by the shift display unit 5 equipped with the processor described above.

[0114] Step 305 is to input a frame, for example, a video frame containing an image, as described above.

[0115] Step 310 reduces the frame to a suitable size so that it is not cropped during observation.

[0116] Step 315 saves the frame in memory, for example, in a video memory buffer. Step 320 reads the frame.

[0117] Step 325 shifts the frame, dividing it into frames corresponding to the left and right eyes.

[0118] Step 330 transmits the frame to the display.

[0119] Step 335 opens the left shutter so that the eye can observe the left frame. Step 340 observes the left frame with the left eye.

[0120] Step 345 closes the left shutter. Then, step 250 opens the right shutter so that the right eye can observe the right frame.

[0121] Then, step 360 closes the right shutter.

[0122] In step 365, the user perceives a shifted image, such as a shifted image on a display.

[0123] Step 370 involves adjusting the shift distance. The image shift distance is adjustable within the above range for user comfort. Furthermore, the shift distance can be selected by the user according to their perception of the image at the shift distance.

[0124] Additionally, users can adjust the selected distance using an input device.

[0125] In some embodiments, the shift distance may be gradually and / or incrementally increased until the user perceives two images instead of one, in order to establish a maximum shift distance that is slightly less than the distance at which the user first perceives two images.

[0126] In some embodiments, the user is provided with software buttons, a graphic display, etc., for indicating a selected shift distance in relation to an established maximum shift distance.

[0127] In some embodiments, the shift distance selected by the user may be less than the established maximum shift distance, depending on user perception and comfort.

[0128] For example, alternative embodiments of the present invention may perform the above steps in a different order. [Examples]

[0129] (7. Explanation of the divided images when the original frame image 9 is divided)

[0130] In a second embodiment of the present invention, the shift display unit 5 divides each original frame image 9 sent from the original video source 8 into multiple parts, such as three, as shown in Figure 10, and displays each divided image portion of the original frame image sequentially at the first position, the second position, and so on, so that each original frame image is displayed in sequence.

[0131] Unless otherwise specified, the details are the same as in Example 1.

[0132] Alternatively, the single image sent from the original video source 8 may be split into multiple parts.

[0133] The divided portion may have a division pattern such as a central portion 9a including the center of the display screen 1a, an outer peripheral portion 9c adjacent to the frame of the display screen, and an intermediate portion 9b between the central portion and the outer peripheral portion, as shown in Figure 10.

[0134] Alternatively, the above divisions can be divided horizontally into left, center, and right sections, or vertically into upper, center, and lower sections. Many other divisions are also possible.

[0135] Furthermore, the above division may be configured before displaying the video, or within the video table, either by pre-settings or by the user.

[0136] Furthermore, in addition to making the division points the same for all original frame images that make up the original video from the original video source 8, the number and location of divisions in each original frame image may be changed while each original frame image is being displayed.

[0137] Then, in each of the above-mentioned divided sections 9a, 9b, and 9c, the first position and the second position are set to be different.

[0138] For example, as shown in Figures 10 and 11, if the original frame image 9 is divided into three parts: a central image portion 9a, an intermediate image portion 9b, and an outer image portion 9c, then the distance from the reference center position P to the first position of image portion 9a (hereinafter referred to as the shift amount) is a1, the shift amount of image portion 9b is b1, and the shift amount of image portion 9c is c1, and these a1, b1, and c1 are set to different values.

[0139] As shown in Figures 11(b), (d), and (f), the second positions of each of the image portions 9a, 9b, and 9c are set at positions symmetric to the shift amount of the first position with respect to the reference center position.

[0140] For example, set a1 > b1 > c1.

[0141] The shift amounts a1, b1, and c1 can be freely set to the left, right, or left of the reference center position.

[0142] By configuring it in this way, each image portion 9a, 9b, and 9c, which is divided for each original frame image 9, is displayed on the display screen in the order of (a), (b), (c), (d), (e), and (f), as shown in Figures 11(a) to 11(f), for example, (a), (b), (c), (d), (e), and (f). The user will see the outer image portion 9c, the middle image portion 9b, and the central image portion 9a as they move further away, and the secondary image sent from the original video source will appear three-dimensional.

[0143] (8. Explanation of changing the shift amount)

[0144] In the above example, the first position shift amounts a1, b1, and c1 of each of the division parts 9a, 9b, and 9c of each of the original frame images are displayed as constant without being changed.

[0145] (8.1. Explanation of how to change the shift amount of each image portion using the desired original frame image)

[0146] Furthermore, the shift amount adjustment unit 4 may be used to change the shift amount to a different value at a certain division, multiple divisions, or all divisions, depending on a certain original frame image, while the video is being displayed, for example, at a predetermined time or for each video scene.

[0147] In this case, for example, as shown in Figures 12(a), (c), and (e), the first position shift amounts a1, b1, and c1 of each divided portion 9a, 9b, and 9c are changed to a2, b2, and c2 respectively, with respect to a certain original frame image, as shown in Figures 12(a'), (c'), and (e'). After that, each divided portion of each original frame image is displayed with the shift amounts (a2, b2, c2).

[0148] (8.2. Explanation of continuously changing the shift amount of each image portion)

[0149] Furthermore, depending on the settings in advance or by user operation, when images are being displayed sequentially, the shift amount adjustment unit 4 may be configured to continuously change the first and second positions of a certain division, multiple divisions, or all divisions.

[0150] The continuous modification of each divided section is the same as the continuous modification of the original frame image in Example 1.

[0151] That is, for example, during video display, the shift amount may be changed for each segment of the original frame images that make up the two-dimensional video sequentially sent from the original video source 8, in a desired order.

[0152] That is, in the images in the desired order, the amount of shift of the first position of each divided part may be changed sequentially, such as (a3, b3, c3), (a4, b4, c4), ...

[0153] The desired order described above involves changing the shift amount for each of the multiple original frame images that make up the two-dimensional video sent sequentially from the original video source 8, as well as changing the shift amount for images in a desired order, such as every other image or every two images.

[0154] (8.3. Explanation of an example where the shift amount of the first position of one image portion changes in accordance with the shift amount of the first position of another image portion.)

[0155] In addition to changing the shift amount of the first position of each divided portion of each original frame image, the shift amount adjustment unit 4 may also be configured to change the shift amount of the first position of the other divided portions in accordance with the change in the shift amount of one of the divided portions of each original frame image.

[0156] That is, for example, the shift amounts b2 and c2 of image portion 9b and image portion 9c are set in accordance with (and linked to) the change in the shift amount of image portion 9a from a1 to a2.

[0157] Alternatively, for example, the amount by which the shift amount (b2) of the first position of an image portion adjacent to one image portion is changed may be adjusted according to the amount by which the first position (a1) of the first image portion is changed.

[0158] For example, the amount of shift of the first position of one part of an image is to be changed sequentially for each desired original frame image by a desired distance (a constant value, a constant percentage, or a variable value), or the first position of other parts of the image is to be changed according to the amount of change by the user.

[0159] Furthermore, for example, the amount of change in the shift amount of the first position of each image portion may be set to be small or large depending on the distance from the above-mentioned reference center position.

[0160] In other words, for example, the amount of change made to the image portion further away from the center should be smaller than the amount of change made to the image portion closer to the center. Or, conversely, the amount of change made should be larger.

[0161] For example, if the first position of the central image portion 9a is changed by a first amount, the first position of the adjacent intermediate image portion 9b is changed and displayed by a desired second amount, such as half the first amount (or a desired percentage), and the first position of the outer periphery image portion 9c is changed and displayed by a desired third amount, such as half the second amount (or a desired percentage).

[0162] In this way, by changing the first position of one part of the image, the first positions of the other parts of the image also change in conjunction, so that the entire original frame image comes to have a continuous sense of depth.

[0163] Furthermore, if the first position of the image portion described above is changed in succession, the other image portions will also be changed in succession, resulting in a continuous sense of depth in the video.

[0164] Furthermore, increasing the amount of change in the central part of the image can create a greater sense of depth.

[0165] (9.1. Explanation of an example of splitting the original frame image)

[0166] A specific example of the second embodiment of this embodiment is, for example, that the initial original frame image from the original video source is divided into three parts, image parts 9a, 9b, and 9c, and first, as shown in Figure 11(a), image part a is displayed at the first position (a1), then as shown in Figure 11(b), it is displayed at the second position, then as shown in Figure 11(c), image part b is displayed at the first position (b1), then as shown in Figure 11(d), it is displayed at the second position, and then as shown in Figure 11(e), image part c is displayed at the first position (c1), then as shown in Figure 11(f), it is displayed at the second position.

[0167] Then, the image portions 9a, 9b, and 9c, which are obtained by dividing the next original frame image into three parts, are similarly displayed as follows: image portion a is displayed in the first position (a1), then in the second position; then image portion b is displayed in the first position (b1), then in the second position; and then image portion c is displayed in the first position (c1), then in the second position.

[0168] Then, each original frame image will be displayed sequentially, in the same manner as described above.

[0169] (9.2. Example when the shift amount is changed only once)

[0170] Furthermore, if the first position described above is changed midway through, the original frame image after the change is divided into three parts, image parts 9a, 9b, and 9c, and image part 9a is displayed at the changed first position (a2), and then at the second position corresponding to the first position.

[0171] Next, for example, an image portion 9b adjacent to the image portion 9a is configured to display a desired percentage change, such as half of the change in the first amount from the first position (a1) before the change to the first position (a2) after the change, at a first position (b2) which is added to the first position (b1) before the change, and then display at a second position corresponding to the first position.

[0172] Similarly, in image portion c, the image portion c adjacent to image portion b is configured to display a desired percentage change, such as half of the change in a third amount, from the first position (b1) before the change to the first position (b2) after the change in image portion 9b, at a first position (c2) which is added to the first position (c1) before the change, and to display it at a second position corresponding to the first position.

[0173] Then, the first positions of the divided images 9a, 9b, and 9c of the next original frame image will be displayed with shift amounts of a2, b2, and c3, respectively.

[0174] (9.3. Explanation of an example where the shift amount changes continuously)

[0175] Furthermore, if the first position of the image portion 9a is changed, that is, if each image portion is changed consecutively, the next original frame image is further divided into three parts, and in the image portions 9a, 9b, and 9c, they are displayed at the first position (a3, b3, c3) respectively, and then at the second position corresponding to the first position.

[0176] Furthermore, by changing the shift amount sequentially for each original frame image, or by continuously changing the shift amount for images at desired intervals, such as every other image or every two images, it is possible to create a continuous change in the sense of depth, such as making the images appear to move from back to front or front to back.

[0177] Furthermore, the amount by which the shift amount of one image portion of one original frame image is changed may be set to a fixed value, a fixed percentage, or a value according to predetermined conditions.

[0178] (10. Description of the effects of the second embodiment of the present invention)

[0179] In the second embodiment of the present invention, the original frame image can be divided into multiple image parts to create a greater sense of depth.

[0180] Furthermore, by changing the first position of one part of the image, other parts of the image can also be changed, and a three-dimensional image can be obtained.

[0181] Furthermore, by continuously changing the first position of one part of the image, other parts of the image also change in conjunction, allowing for a continuous three-dimensional transformation to be observed.

[0182] Furthermore, when users operate the system, they can change the entire image by manipulating only a portion of it, making it easier to use. [Explanation of Symbols]

[0183] 1 display 1a Display screen 2 Three-dimensional device 3. Filter device 3a Eyeglass Frames 3b Left lens 3c Right Lens 3L Shutter 3R Shutter 4. Arithmetic and Memory Processing Unit 5 Shift display section 6. Shift amount adjustment section 7. Shift timing transmission unit 8. Original video source 9 Original frame image

Claims

1. It consists of a 3D rendering device and a filtering device. The above-mentioned 3D rendering device consists of an arithmetic and memory processing unit that performs various calculations and storage, a shift display unit, a shift amount adjustment unit, and a shift timing transmission unit. The shift display unit is configured to display each two-dimensional original frame image constituting the video transmitted from the original video source at a first position, a desired distance from the reference center position in the left-right direction on the display screen of the video display device, for either left-eye observation or right-eye observation; then, to display the original frame image at a second position, a desired distance from the reference center position, for either left-eye observation or right-eye observation; and so on, sequentially displaying each original frame image transmitted from the original video source alternately at the first and second positions on the display screen. The above-mentioned shift amount adjustment unit is configured to set the first position and the second position. The shift timing transmission unit described above is configured to transmit a synchronization signal to the filter device that causes each of the original frame images described above to be displayed at the first position and the second position, The above-described filter device is configured such that when the original frame image is displayed in the first position, the user can view the original frame image with either their left or right eye, and when the original frame image is displayed in the second position, the user can view the original frame image with either their left or right eye. The above-mentioned shift amount adjustment unit can set the first position for either left-eye observation or right-eye observation to the left or right of the above-mentioned reference center position. The second position described above is set to a position symmetrical to the first position described above in the left-right direction with respect to the reference center position described above. The above-mentioned shift display unit is configured to divide each of the above-mentioned original frame images, set different first and second positions for each divided image portion, and display the first and second positions sequentially for each of the image portions.

2. The image stereoscopic device according to claim 1, characterized in that the shift amount adjustment unit changes the shift amount of the first position of each divided portion of the original frame images in a desired order while each original frame image is sequentially displayed on the display screen.

3. The shift amount adjustment unit is characterized in that, by changing the shift amount of the first position of one of the image portions obtained by dividing the original frame image into multiple parts, the shift amount of the first position of the other image portions of the original frame image is changed in accordance with the amount of change in the shift amount of the first image portion.

4. The stereoscopic image device according to claim 1 is configured such that the shift amount adjustment unit changes the first position of one of the image portions obtained by dividing the original frame image into multiple parts, and in accordance with the amount of change in the shift amount of the first image portion, the shift amount of the first position of the image portion adjacent to the first image portion, and further, in accordance with the amount of change in the shift amount of the adjacent image portion, the shift amount of the first position of the image portion adjacent to the adjacent image portion, thereby sequentially changing the displacement of the first position of the adjacent image portions.

Images