Stereoscopic display controller

Abstract

To provide a controller for stereoscopic display that can improve the image quality of a stereoscopic vision provided to a user.SOLUTION: A controller for stereoscopic display includes: a display 2 that displays a parallax image; an input unit 3 that can receive input of a viewpoint position of a user; and control means 4 that can execute composition processing including first composition processing and second composition processing of mixing a left image and a right image to compose a parallax image. The control means 4 can output the parallax image toward the display 2. The control means 4 can execute the first composition processing in correspondence with a frame period of the parallax image, and can execute the second composition processing in correspondence with the input of the viewpoint position to the input unit 2.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a controller for stereoscopic displays. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there has been known a configuration for correcting distortion in an optical system in an image display device that provides stereoscopic vision (for example, see Patent Document 1, etc.). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-15823 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is a demand for further improvement in the image quality of the stereoscopic vision provided to users. An object of the present disclosure is to provide a stereoscopic display controller that can improve the image quality of the stereoscopic vision provided to the user. [Means for solving the problem]

[0005] A stereoscopic display controller according to the present disclosure includes a display device that displays parallax images, an input unit configured to be able to input a user's viewpoint position, and a control means configured to be able to execute a synthesis process including a first synthesis process and a second synthesis process that mixes a left image and a right image to synthesize them into a parallax image, the control means being configured to be able to output the parallax images to the display device, the control means being configured to be able to execute the first synthesis process in response to a frame period of the parallax images, and being configured to be able to execute the second synthesis process in response to an input of the viewpoint position to the input unit, the first synthesis process is a synthesis process for synthesizing, at the beginning of a next frame, image data of the next frame based on the viewpoint position of the parallax image last synthesized in the certain frame, After the first synthesis process is performed, The above When changing to output of parallax image and displaying one frame, the first synthesis process is performed once. The first disparity image synthesized byand performing the second synthesis process multiple times. of Execute and sequentially outputting the plurality of second parallax images synthesized by the above-mentioned method to the display device within the one frame. It is composed of. Effect of the Invention

[0006] According to the present invention, it is possible to provide a stereoscopic display controller that can improve the image quality of the stereoscopic vision provided to the user. [Brief description of the drawings]

[0007] [Figure 1] 2 is a block diagram showing a configuration of a stereoscopic display controller according to the present disclosure. [Diagram 2] FIG. 2 is a sequence diagram of stereoscopic display controller 1. [Diagram 3] 4 is a timing chart for explaining the operation of a control means. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, embodiments of the light emitting device of the present disclosure will be described with reference to the accompanying drawings.

[0009] (overview) 1 is a block diagram showing the configuration of a stereoscopic display controller of the present disclosure. The stereoscopic display controller 1 of this embodiment includes a display device 2 that displays parallax images, an input unit 3 configured to be able to input a user's viewpoint position, and a control unit 4 configured to be able to execute a synthesis process including a first synthesis process and a second synthesis process that mixes a left image and a right image to synthesize them into a parallax image. The control unit 4 is configured to be able to output the parallax images to the display device 2, and is configured to be able to execute the first synthesis process in response to a frame period of the parallax images, and is configured to be able to execute the second synthesis process in response to an input of the viewpoint position to the input unit 2.

[0010] The control means 4 may execute the first synthesis process once and the second synthesis process at least once when displaying one frame. The control means 4 may execute the second synthesis process multiple times when displaying one frame.

[0011] The control means 4 has a synthesis table 5 for synthesizing the left and right images, and is configured to synthesize the left and right images with reference to the synthesis table 5, thereby generating a parallax image.

[0012] When a viewpoint position is input, the control means 4 updates the synthesis table 5 in accordance with the viewpoint position. The control means 4 has a distortion correction unit 6 configured to execute a correction process for correcting distortions in the left and right images.

[0013] The control means 4 includes a first control means 4a and a second control means 4b. The first control means 4a is configured to execute a synthesis process, and the second control means 4b is configured to execute a correction process.

[0014] The second control means 4b has a correction table 6 for correcting distortion of the left image and the right image, and is configured to perform correction processing by referring to the correction table 6.

[0015] When the viewpoint position is input, the control means 4 updates the correction table 6 in accordance with the viewpoint position.

[0016] The input period of the viewpoint position is shorter than the frame period. The control means 4 calculates a predicted value of the viewpoint position based on the amount of change of the viewpoint position per unit time, and executes the second synthesis process based on the calculated predicted value of the previous point position.

[0017] The display device 2 may be composed of, for example, a liquid crystal panel, a light-shielding barrier disposed on the viewer side of the liquid crystal panel, and a surface light source located behind the liquid crystal panel. A TN type liquid crystal panel may be used as the light-shielding barrier.

[0018] The liquid crystal panel may be configured to include a light-incident glass substrate, a light-exit glass substrate, a liquid crystal layer provided between these substrates, a light-incident polarizing plate attached to the light-incident glass substrate, and a light-exit polarizing plate attached to the light-exit glass substrate. This liquid crystal panel is driven, for example, by a matrix driving method, and an image is displayed by applying a voltage to a transparent pixel electrode (not shown) according to an image signal. Then, by processing a video signal supplied to the liquid crystal panel, two buffers 7 and 8 are switched by a display control unit 9 every other vertical line, and a right eye image R and a left eye image L are alternately provided to the display device 2 by one of the buffers 7 or 8 and displayed.

[0019] FIG. 2 is a sequence diagram of the stereoscopic display controller 1. The control means 4 may include one or more processors. The processor may include a general-purpose processor that reads a specific program to execute a specific function, and a dedicated processor specialized for a specific process. The dedicated processor may include an application specific integrated circuit (ASIC). The processor may include a programmable logic device (PLD). The PLD may include a field-programmable gate array (FPGA). The control means 4 may be either a system-on-a-chip (SoC) in which one or more processors work together, or a system in a package (SiP). The control means 4 includes a storage unit, and may store various information, or programs for operating each component of the three-dimensional display system 10, in the storage unit. The storage unit may be composed of, for example, a semiconductor memory. The storage unit may function as a work memory for the control means 4.

[0020] The control means 4 is configured to cause a plurality of sub-pixels included in the left visible region of the display device 2 to display a left eye image, and a plurality of sub-pixels included in the left dimming region to display a right eye image. This makes it easier for the left eye to view the left eye image, and harder for the left eye to view the left eye image. The control means 4 is configured to cause a plurality of sub-pixels included in the right visible region to display a right eye image, and a plurality of sub-pixels included in the right dimming region to display the right eye image. This makes it easier for the right eye to view the right eye image, and harder for the left eye image to view. This allows the user's eyes to view a three-dimensional image.

[0021] The detection device 11 is configured to detect an image of the eye from a captured image, and detect the position of the eye in real space based on the image of the eye in the image space. The detection device 11 is configured to transmit position data including the position of the eye in real space to the stereoscopic display controller 1. It takes time for the detection device 11 to detect the position of the eye, for the detection device 11 to transmit the position data to the stereoscopic display controller 1, and for the display image to be changed and reflected based on the received position data. The display time at which an image based on the position of the eye included in the face is displayed has a time difference from the image capture time at which the detection device 11 captures the face. The time difference includes the detection time, the transmission time, and the reflection time. The time difference depends on the performance of the detection device 11, and the communication speed of the detection device 11 and the stereoscopic display controller. When the movement speed of the user's eyes becomes faster than the speed obtained by dividing the control unit length at which the display image is changed in accordance with the movement of the user's eyes by the time difference, the user will view an image that does not correspond to the position of the eye. For example, if the control unit length is 62.4 mm and the time difference is 65 ms, if the user's eyes move at a speed of 0.24 mm / ms (millimeter per milli-second) (24 cm / s (centimeter per second)) or faster, the user may feel uncomfortable with the three-dimensional image.

[0022] In order to reduce the difficulty in viewing such a three-dimensional image, the control means 4 performs the process described below. In the following description, "eyes" may represent "left eye and right eye".

[0023] (Position data storage processing) The control means 4 is configured to store in a memory the position data indicating the eye position (actual position) input by the input unit 3 and the order in which the position data was acquired. The memory sequentially stores the actual eye positions based on each of a plurality of captured images captured at a predetermined imaging time interval. The memory may also store the order in which the eyes were positioned at the actual positions. The predetermined imaging time interval is the time interval between one captured image and the time at which the one captured image is captured, which can be appropriately set depending on the performance and design of the detection device 11.

[0024] (Filtering process) The control means 4 may be configured to filter the position data stored in the memory, for example, using a low-pass filter. The control means 4 may filter position data with a large amount of change per unit time in the eye position. The control means 4 may extract effective position data from position data with low detection accuracy of the eye position by filtering. When calculating a prediction function, the control means 4 may increase the accuracy of the prediction function by filtering. The control means 4 may filter to extract only position data with small changes over time, specifically, with a frequency of position change lower than a predetermined value. The predetermined value is the maximum value of the frequency of position change required to achieve a desired accuracy, determined by experiments, etc.

[0025] (Prediction processing) The control means 4 is configured to output a future position as a predicted position using a plurality of position data stored in the memory. The future here refers to the future with respect to the plurality of position data stored in the memory. The control means 4 may use a plurality of position data filtered using a low-pass filter. The control means 4 may be configured to output a predicted position using a plurality of new position information. The control means 4 may be configured to calculate a prediction function based on, for example, a plurality of position data with a newer storage time among the position data stored in the memory and a reflection time to the display. The control means 4 may be configured to determine the newness of the storage time based on the imaging time. The control means 4 may be configured to calculate a prediction function based on the actual position of the eye, the acquisition time when the position data was acquired by the acquisition unit 3, and a predetermined reflection time expected in advance by an experiment or the like.

[0026] The prediction function may be a function obtained by fitting a plurality of pairs of actual measured positions and the timing of imaging of the actual measurements. The prediction function may adopt the imaging time as the imaging timing. The prediction function is used to output a predicted position at a time obtained by adding a reflection time to the current time. More specifically, the control means 4 is configured to calculate a prediction function indicating a relationship between a time after the current time and the position of the eye at the time based on the actual measured position of the eye and the time when the eye was located at the actual measured position, assuming that the time obtained by subtracting the reflection time from the acquisition time is the time when the eye was located at the actual measured position. The prediction function may be a function obtained by fitting a plurality of actual measured positions arranged by the imaging rate. The prediction function may correspond to the current time based on the reflection time.

[0027] (Prediction processing) The control means 4 is configured to output a predicted eye position corresponding to a time obtained by adding a predetermined time to the current time in the prediction function at a predetermined output time interval. The predetermined time is based on a display processing time that is the time expected to be required from when the control means 4 starts display control until an image is displayed on the display device 2. The predetermined output time interval may be a time interval shorter than a predetermined imaging time interval.

[0028] The control means 4 is configured to start control for displaying an image in each sub-pixel corresponding to a visible area based on the most recently output predicted position at a display time interval determined so that the display device 2 updates the image at a predetermined frequency. After a display processing time has elapsed since the control of the display by the control means 4 was started, an image based on the predicted position is displayed and updated on the display.

[0029] The detection device 11 may employ, for example, a camera that captures images at 20 fps. The camera has an imaging time interval of 50 ms. The control means 4 may be configured to output captured images at an output time interval equal to the imaging time interval. The control means 4 may be configured to output at an output time interval different from the imaging time interval. The output time interval may be longer than the imaging time interval. The output time interval may be 20 ms. In this case, the control means 4 outputs the predicted position once every 20 ms (i.e., at 50 sps (samples per second)). The control means 4 may display an image based on the predicted eye position output at a time interval shorter than the imaging time interval. Therefore, the display device 2 may provide the user with a three-dimensional image that corresponds to a finer change in the eye position.

[0030] The output time interval may be shorter than the display time interval for updating the image displayed on the display device 2. For example, when the control means 4 updates the image on the display device 2 at 60 Hz (Hertz), i.e., the display time interval is about 16.7 ms, the output time interval may be 2 ms. In this case, the control means 4 outputs the predicted position once every 2 ms (i.e., 500 sps). The control means 4 can display the image based on the positions of the left and right eyes at a time closer to the display time than the time when the image was displayed last time. Therefore, the display device 2 can further reduce the difficulty that the user has in properly viewing the three-dimensional image due to the change in the eye position.

[0031] (Evaluation process) The control means 4 may evaluate the prediction function and modify it based on the evaluation. Specifically, the control means 4 may compare the predicted eye position output based on the prediction function with the actual eye position detected from the captured image that corresponds to the predicted eye position. The control means 4 may match the predicted eye position with the actual eye position based on the recorded imaging time. The control means 4 may match the predicted eye position with the actual eye position based on the imaging time interval. The control means 4 may modify the prediction function based on the result of the comparison. In the subsequent prediction process, the control means 4 may output the eye position using the modified prediction function and cause the display device 2 to display an image based on the predicted eye position using the modified prediction function.

[0032] 2 is a sequence diagram for explaining the operation of the stereoscopic display controller 1. First, the detection device 11 acquires one captured image captured by a camera, and when one captured image is acquired, the detection device 11 detects the position of the eyes based on the acquired one captured image. When one eye position is detected, the detection device 11 transmits position data indicating the eye position to the display device 2. When the position data is transmitted, the detection device 11 determines whether or not an end instruction has been input. When it is determined that an end instruction has been input, the detection device 11 terminates the process. When it is determined that an end instruction has not been input, the detection device 11 repeats the detection process operation.

[0033] Next, the control means 4 of the display device 1 determines whether or not the position data has been received by the acquisition unit 3. If it is determined that the position data has not been received, the control means 4 goes into a standby state, and if it is determined that the position data has been received, the control means 4 can execute the next operation of storing the position data in memory.

[0034] (1) The image resulting from the warping is divided into two buffers 7 and 8, which are alternately divided for each frame. Here, in this embodiment, warping includes sampling pixels in a digital image, calculating new positions for each pixel, and then assembling the mapped digital image with the sub-pixels at the new positions, and is also called resampling. The mapping function may also include other transformations of the sub-pixels, such as changes in brightness or color. The brightness mapping of pixels is also called shading. During resampling, interpolation between pixels is desired. Interpolation can be performed using nearest neighbor, linear or non-linear calculations according to conventional algorithms. The mapping function may include a spatially varying filter to change the white level (contrast), black level (brightness), or other image parameters depending on the spatial location and content in the digital image.

[0035] (2) After the distortion-corrected image is placed in buffer 7 or 8, enable that buffer for reading and disable the other buffer for reading, and then place the next distortion-corrected image in buffer 7 or 8. (3) The 3D image synthesis unit synthesizes the buffer images of the images that are permitted to be read. (4) Image synthesis processing is performed when an index is input and buffer switching is notified. (5) When the transfer is completed, the distortion correction unit 6 is notified of the switching between the buffers 7 and 8. (6) When switching buffers, rewriting of a single buffer should be done during the V blank period. This can be extended to about 2 ms.

[0036] (7) The pupil position detection by the detection device 11 is performed at 100 fps (asynchronous with 3D synthesis), and therefore the detection result is updated a maximum of two times during processing of one frame. (8) The 3D image synthesis unit 13 uses two systems of image synthesis H / W to execute synthesis processing in accordance with the pupil position detection result. Information on the pupil position and index (phase) is sent simultaneously from the detection device 11 to the 3D image synthesis unit 13. Each time, the distortion correction unit 6 updates the distortion correction table 5 for the left image or the right image, executes 3D image synthesis processing, and outputs it from the synthesized image output unit 12 to the display device 2. Then, image data processing for the next frame begins, and the second control means 4b instructs the 3D image synthesis unit 13 to execute 3D image synthesis processing beforehand (the amount of time required for image synthesis processing by the 3D image synthesis processing unit 13), so 3D image synthesis processing is executed with the image data of the next frame.

[0037] (9) During this image-concave synthesis processing period, two frames of images are temporarily mixed, but if the end timing is synchronized, the mixing of two frames will not affect the display. The 3D image synthesis processing unit 13 is made to start the image synthesis processing from the time when the image data is completely sent to the display device 2, back by the time required for the 3D image synthesis processing.

[0038] The control means 4 filters the position data stored in the memory. The control means 4 generates a prediction function based on the filtered position data. The control means 4 again determines whether or not the position data has been received by the acquisition unit 3. If it is determined that the position data has not been received, the control means 4 maintains the standby state, and if it is determined that the position data has been received, the control means 4 stores the position data in the memory.

[0039] The control means 4 filters the position data stored in the memory.

[0040] The control means 4 corrects the prediction function using the actual eye position indicated by the position data indicating the eye position captured at the display time when the image was displayed, among the actual positions indicated by the filtered position data, in the display process described in detail later. The control means 4 judges whether or not an instruction to end the prediction function generation process has been input. If it is judged that an instruction to end the prediction function generation process has been input, the control means 4 ends the prediction function generation process. If it is judged that an instruction to end the prediction function generation process has not been input, the control means 4 returns to a standby state. The control means 4 outputs the predicted position based on the most recently predicted or corrected prediction function in the above-mentioned prediction function generation process, at the output time interval.

[0041] The control means 4 changes the display image based on the most recently output predicted position at the display time interval, and causes the display device 2 to display the changed image.

[0042] The control means 4 judges whether or not an instruction to end the image display process has been input. When it is judged that an instruction to end the image display process has been input, the control means 4 ends the image display process. The display device 2 of this embodiment outputs a predicted eye position at a display time future to the current time based on the position data stored in the memory, and displays a parallax image on each sub-pixel P of the display panel based on the predicted eye position. Therefore, it is possible to display an image based on the eye position at a time close to the display time, rather than starting control to display an image based on the eye position detected based on the captured captured image at the time the position is acquired as in the conventional method. Therefore, the display device 2 can reduce the difficulty of the user viewing a three-dimensional image even when the position of the user's eyes changes.

[0043] The display device 2 of this embodiment calculates a prediction function indicating the relationship between future display times and eye positions based on the position data stored in the memory, and outputs a predicted eye position based on the prediction function. The display device 2 can output a predicted eye position regardless of the image capture time of the camera. The measured position of the focus in the camera image is used to predict where the future focus point will be found.

[0044] The display device 2 of this embodiment can output the predicted eye positions based on the prediction function at an output time interval different from the image capture time interval. The display device 2 can output the predicted eye positions at an output time interval that is not based on the image capture time interval of the camera.

[0045] The display device 2 of the present embodiment can output a predicted eye position based on a prediction function at an output time interval shorter than the image capture time interval. The display device 2 can provide a three-dimensional image according to a change in eye position that occurs at a time interval shorter than the image capture time interval.

[0046] The display device 2 of this embodiment corrects the prediction function by comparing the predicted position with the actual position. The display device 2 can output the predicted eye position appropriately based on the prediction function corrected each time. The display device 2 can display an image based on the appropriate predicted position. The display device 2 can reduce the difficulty that the user has in properly viewing a three-dimensional image due to a change in the eye position.

[0047] The detection device 11 may not be able to detect the eye position due to, for example, the state of the ambient light or the influence of an obstacle located on the optical path between the user's eye and the camera. The acquisition unit 3 may fail to acquire the position data when the detection device fails to detect the eye position. In the display device 2 of this embodiment, the control means 4 performs the process described below, so that even if the acquisition unit 3 fails to acquire the position data, the deterioration of the accuracy of the prediction function can be reduced. In the display device 2, the control 8 maintains the accuracy of the prediction function, so that it is possible to reduce the difficulty that the user has in properly viewing the three-dimensional image.

[0048] The distortion correction unit 6 may be synchronized with the display device 2, but may not be synchronized. As described above, the control means 4 has a synthesis table 5 for synthesizing the left and right images, and is configured to synthesize the left and right images with reference to the synthesis table 5 and generate a parallax image. When a viewpoint position is input, the distortion correction table 5 is updated so as to correspond to the viewpoint position. When displaying one frame, the first synthesis process may be executed once and the second synthesis process at least once, and when displaying one frame, the second synthesis process may be executed multiple times.

[0049] (Prediction processing) The control means 4 may be configured to output a predicted position at the current time using a plurality of position data stored in the memory when the acquisition unit 3 fails to acquire position data. The control means 4 may be configured to calculate a prediction function for predicting the eye position at the current time using the plurality of position data stored in the memory. The prediction function for predicting the eye position at the current time may be referred to as a first prediction function. The control means 4 may be configured to output a predicted position at the current time based on the first prediction function.

[0050] The control means 4 may use a plurality of position data filtered using a low-pass filter when calculating the first prediction function. The control means 4 may be configured to output a predicted position using a plurality of new position information. The control means 4 may be configured to calculate the first prediction function based on, for example, a plurality of position data with a newer storage time among the position data stored in the memory and a reflection time to the display. The control means 4 may be configured to determine the newness of the storage time based on any one or more of the imaging time, the storage order, and the serial number. In one example, the memory is configured to store only the position information necessary for calculating the first prediction function, and the control means 4 may be configured to calculate the first prediction function based on all the position information stored in the memory. The control means 4 may be configured to calculate the first prediction function based on the actual position of the eye, the acquisition time when the position data was acquired by the acquisition unit 3, and a predetermined reflection time expected in advance by an experiment or the like.

[0051] The control means 4 may be configured to, when the acquisition unit 3 acquires position data, compare the position data with the most recently stored position data among the multiple position data stored in the memory. The control means 4 may determine that the acquisition unit 3 has failed to acquire the position data when the two position data are position data indicating the same value. In other words, the control means 4 may be configured to determine that the acquisition unit 3 has failed to acquire the position data when the acquisition unit 3 continuously acquires position data indicating the same value. The position data indicating the same value here may be two position data whose three coordinate values ​​in three-dimensional space completely match. The position data indicating the same value may be two position data whose sum of the differences between the three coordinate values ​​in three-dimensional space is less than a threshold value, or two position data whose maximum value of the differences between the three coordinate values ​​in three-dimensional space is less than a threshold value. The threshold value may be determined in advance by experiments or the like.

[0052] The control means 4 may be configured to, when the acquisition unit 3 continuously acquires position data showing the same value, discard the second position data, i.e., the position data acquired more recently among the two consecutively acquired position data. The control means 4 may be configured to output a predicted position at the current time based on a plurality of position data including the position data acquired earlier among the two consecutively acquired position data.

[0053] (Prediction processing) The control means 4 is configured to output a predicted eye position at a future time using a plurality of position data including a predicted position at the current time. The future time here refers to a time after the current time. The control means 4 may be configured to calculate a prediction function for predicting the eye position at the current time using a plurality of position data stored in the memory. The prediction function for predicting the eye position at a future time may be referred to as a second prediction function. The control means 4 may be configured to output a predicted position at a future time based on the second prediction function.

[0054] The control means 4 may use a plurality of position data filtered using a low-pass filter when calculating the second prediction function. The control means 4 may be configured to output a predicted position using a plurality of new position information. The control means 4 may be configured to calculate the second prediction function based on, for example, a plurality of position data with a newer storage time among the position data stored in the memory and a reflection time to the display. The control means 4 may be configured to determine the newness of the storage time based on one or more of the imaging time, the storage order, and the serial number. The control means 4 may be configured to calculate the second prediction function based on the actual position of the eye, the acquisition time when the position data was acquired by the acquisition unit 3, and a predetermined reflection time that is expected in advance by an experiment or the like. The second prediction function may be the same function as the first prediction function, or may be a function different from the first prediction function.

[0055] (Image display processing) The control means 4 is configured to start control for displaying an image in each sub-pixel P corresponding to the visible area 5a based on the most recently output predicted position at a display time interval determined so that the display device 2 updates the image at a predetermined frequency. After a display processing time has elapsed since the control means 4 started controlling the display, the image based on the predicted position is displayed and updated on the display device 2.

[0056] (Evaluation process) The control means 4 may evaluate the second prediction function and modify the second prediction function based on the evaluation. The control means 4 may compare the predicted eye position output based on the second prediction function with the actual eye position detected from the captured image that corresponds to the predicted eye position. The control means 4 may match the predicted eye position with the actual eye position based on the recorded imaging time. The control means 4 may match the predicted eye position with the actual eye position based on the imaging time interval. The control means 4 may modify the second prediction function based on the result of the comparison. The control means 4 may output the eye position using the modified second prediction function in the subsequent prediction process and cause the display device 2 to display an image based on the predicted eye position using the modified second prediction function.

[0057] Next, another example of the prediction function generation process and image display process performed by the display device 2 will be described with reference to the timing chart of Fig. 3. The control means 4 can execute the process at time intervals shorter than the image capture time interval of the camera of the detection device 11. The control means 4 judges whether or not position data has been received by the input unit 3. If it is judged that position data has not been received, the control means 4 calculates a first prediction function using a plurality of position data stored in the memory, and outputs a predicted position at the current time based on the first prediction function. The control means 4 calculates a second prediction function based on a plurality of position data including the predicted position at the current time, and outputs a predicted position at a future time based on the second prediction function.

[0058] The control means 4 changes the display image based on the predicted position at a future time at the display time interval, and causes the display device 2 to display the changed image. The control means 4 judges whether or not an instruction to end the image display process has been input. If it is judged that an instruction to end the image display process has been input, the control means 4 ends the image display process. If it is judged that an instruction to end the image display process has not been input, the control means 4 returns to a standby state. If it is judged that the position data has been received, the control means 4 judges whether or not position data indicating the same value has been continuously acquired. The control means 4 compares the received position data with the position data with the most recent image capture time among the multiple position data stored in the memory. If it is judged that position data indicating the same value has been continuously acquired, the control means 4 discards the second position data acquired in succession. If it is judged that position data indicating the same value has not been continuously acquired, the control means 4 calculates a predicted position of the eye at the current time based on the multiple position data stored in the memory when the input unit 3 has failed to acquire position data, and outputs the predicted position as position data at the current time. Therefore, when the detection device 11 is unable to detect the eye position, the display device 2 can accurately predict the eye position at the current time.

[0059] The control means 4 outputs a predicted eye position at a future time based on a plurality of position data including the predicted position at the current time, and causes each sub-pixel of the display device 2 to display a parallax image based on the predicted position. Therefore, even if the detection device 11 cannot detect the eye position, the display device 2 can accurately predict the eye position at a future time. Since the display device 2 can display an image based on the predicted eye position at a future time, it is possible to reduce the difficulty for the user in viewing a three-dimensional image.

[0060] In this embodiment, the control means 4 predicts the eye position at a time after the imaging time based on the captured image acquired by the detection device 11 from the camera and the imaging time of the captured image. Therefore, the display device 2 may be configured so that the control means 4 and the detection device 11 operate asynchronously with each other. In other words, the display device 2 may be configured so that the control means 4 and the detection device 11 are systems separated from each other. As a result, the display device 2 can supply the detection device 11 and the control means 4 with clock signals of frequencies suitable for the processing performed by each of them, so that the detection device 11 and the control means 4 can operate quickly and normally. The control means 4 and the detection device 11 may operate asynchronously based on the same clock signal, or may operate asynchronously based on separate clock signals. One of the control means 4 and the detection device 11 may operate in synchronization with a first clock signal, and the other may operate in synchronization with a second clock signal obtained by dividing the first clock signal.

[0061] Although the above-mentioned embodiment has been described as a representative example, it is clear to those skilled in the art that many modifications and substitutions can be made within the spirit and scope of the present disclosure. Therefore, the present disclosure should not be interpreted as being limited by the above-mentioned embodiment, and various modifications and changes are possible without departing from the scope of the claims. For example, it is possible to combine multiple building blocks described in the embodiment and examples into one, or to divide one building block.

[0062] The display device 2 controlled by the stereoscopic display controller is not limited to a transmissive display panel, and other display panels such as a self-luminous display panel can also be used. Transmissive display panels include liquid crystal panels and MEMS (Micro Electro Mechanical Systems) shutter-type display panels. Self-luminous display panels include organic EL (electro-luminescence) and inorganic EL display panels. When a self-luminous display panel is used as the display device 2, the illuminator 4 is not required. When a self-luminous display panel is used as the display device 2, the parallax barrier 6 is located on the side where the image light of the display device 2 is emitted.

[0063] In the present disclosure, the term "mobile body" includes vehicles, ships, and aircraft. In the present disclosure, the term "vehicle" includes, but is not limited to, automobiles and industrial vehicles, and may include railroad vehicles, lifestyle vehicles, and fixed-wing aircraft that run on runways. Automobiles include, but are not limited to, passenger cars, trucks, buses, motorcycles, trolley buses, and the like, and may include other vehicles that run on roads. Industrial vehicles include industrial vehicles for agriculture and construction. Industrial vehicles include, but are not limited to, forklifts and golf carts. Industrial vehicles for agriculture include, but are not limited to, tractors, cultivators, transplanters, binders, combines, and lawnmowers. Industrial vehicles for construction include, but are not limited to, bulldozers, scrapers, excavators, cranes, dump trucks, and road rollers. Vehicles include those that run by human power. The classification of vehicles is not limited to the above. For example, automobiles may include industrial vehicles that can run on roads, and the same vehicle may be included in multiple classifications. In the present disclosure, the vessel includes a marine jet, a boat, and a tanker. In the present disclosure, the aircraft includes a fixed-wing aircraft and a rotorcraft.

[0064] Although the embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the above-mentioned embodiments, and various modifications and improvements are possible within the scope of the gist of the present disclosure. It goes without saying that all or part of the components of each of the above-mentioned embodiments can be appropriately combined within the scope of not contradicting each other. [Explanation of symbols]

[0065] 1 Stereoscopic display controller 2 Display device 4. Control Measures 4a First control means 4b Second control means 5. Composite Table 6 Distortion correction section 9. Display control section 7,8 Buffer 11 Detection device 12. Composite image output section 13 3D image synthesis section R Right eye image L Left eye image

Claims

1. a display device for displaying a parallax image; An input unit configured to be able to input a user's viewpoint position; A control unit configured to be capable of executing a synthesis process including a first synthesis process and a second synthesis process for synthesizing a parallax image by mixing the left image and the right image, the control means is configured to be able to output the parallax image to the display device; The control means The first synthesis process is configured to be executed in accordance with a frame period of the parallax image, The second synthesis process is executed in response to an input of a viewpoint position to the input unit, the first synthesis process is a synthesis process for synthesizing, at the beginning of a next frame, image data of the next frame based on the viewpoint position of the parallax image last synthesized in the certain frame, After the first synthesis process is performed, the output of the parallax image is changed to the output of the second synthesis process; a stereoscopic display controller that, when displaying one frame, sequentially outputs, to the display device within the one frame, a first parallax image synthesized by executing the first synthesis process once and a plurality of second parallax images synthesized by executing the second synthesis process a plurality of times.

2. 2. The stereoscopic display controller according to claim 1, The control means has a synthesis table for synthesizing the left image and the right image, and is configured to synthesize the left image and the right image by referring to the synthesis table to generate a parallax image.

3. The stereoscopic display controller according to claim 2 , The control means is a stereoscopic display controller that, when the viewpoint position is input, updates the synthesis table in accordance with the viewpoint position.

4. 4. The stereoscopic display controller according to claim 2, The control means is configured to execute a correction process to correct distortion of the left image and the right image.

5. 5. The stereoscopic display controller according to claim 4, The control means includes a first control means and a second control means, The first control means is configured to execute the synthesis process; The second control means is configured to execute the correction process.

6. 6. The stereoscopic display controller according to claim 5, The second control means has a correction table for correcting distortion of the left image and the right image, and is configured to perform the correction process by referring to the correction table.

7. 7. The stereoscopic display controller according to claim 6, The control means is a stereoscopic display controller that, when the viewpoint position is input, updates the correction table and the synthesis table in accordance with the viewpoint position.

8. The stereoscopic display controller according to any one of claims 1 to 7, A stereoscopic display controller, wherein an input period of the viewpoint position is shorter than the frame period.

9. The stereoscopic display controller according to any one of claims 1 to 8, The control means calculates a predicted value of the viewpoint position based on an amount of change in the viewpoint position per unit time, and executes the second synthesis process based on the calculated predicted value of the viewpoint position.

Images