Stereoscopic display system

By detecting the observer's position and generating a stereoscopic image within a predetermined tracking area in an automatic stereoscopic display system, the problem of inappropriate alteration of stereoscopic images in existing technologies is solved, and stable stereoscopic image presentation is achieved.

CN112770101BActive Publication Date: 2024-11-15TIANMA JAPAN LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011122632.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-10-21
Filing Date
2020-10-20
Publication Date
2024-11-15
Estimated Expiration
2040-10-20

AI Technical Summary

Technical Problem

Existing automatic stereoscopic display systems fail to properly change the image as the observer moves, or change the image even when the observer is stationary, resulting in inappropriate stereoscopic image presentation.

Method used

The stereoscopic viewing area is determined by detecting the position of the observer within a predetermined tracking area, generating and displaying a stereoscopic image, displaying an image within a predetermined time based on the last detected position when the observer is lost, and displaying an image at a predetermined position when no observer is detected.

Benefits of technology

It reduces the frequency of unwanted changes to stereoscopic images, ensuring stable stereoscopic image presentation when the observer is moving or temporarily unable to track, and preventing unnecessary image changes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112770101B_ABST
    Figure CN112770101B_ABST
Patent Text Reader

Abstract

The control system is configured to acquire an image captured by an imaging device, and based on the position of an observer detected in a predetermined tracking area in the acquired image, display a stereoscopic visual image on a display device. The tracking area is a portion of an area in which an observer can be tracked, and the tracking area includes a stereoscopic viewing area in which a stereoscopic image can be identified from the stereoscopic visual image. The control system is also configured to display the stereoscopic visual image within a predetermined time based on the position of the observer detected last time after the detected observer becomes untrackable in the tracking area, and to display the stereoscopic visual image corresponding to the predetermined position in the stereoscopic viewing area when the observer is not detected in the tracking area for more than a predetermined time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a stereoscopic display system. Background Art

[0002] An autostereoscopic display device using binocular parallax is known. The autostereoscopic display device includes a display panel and a light control element arranged in front of the display panel. The display panel displays an image for the right eye and an image for the left eye simultaneously using pixels for the right eye and pixels for the left eye arranged alternately. The light control element may be a parallax barrier or a biconvex lens so that the observer can see the image for the right eye only with the right eye and the image for the left eye only with the left eye. As a result, the observer can recognize the stereoscopic image without using optical elements such as special glasses.

[0003] Meanwhile, an automatic stereoscopic display system is known that works with a tracking device for tracking an observer so that the observer can recognize a stereoscopic image in a wide space. The automatic stereoscopic display system generates an image to be displayed by the automatic stereoscopic display device in real time based on the position of the observer's eyes acquired by the tracking device and the optical characteristics of the automatic stereoscopic display device to provide the observer with a stereoscopic image that looks comfortable. Summary of the invention

[0004] However, existing autostereoscopic display systems sometimes do not change the image appropriately as the observer moves, or change the image even though the observer does not move. Therefore, a technology is needed to present an appropriate stereoscopic image to a specific observer.

[0005] A stereoscopic display system according to one aspect of the present disclosure includes: a display device configured to display a stereoscopic visual image and a control system. The control system is configured to acquire an image captured by an imaging device, and based on the position of an observer detected in a predetermined tracking area in the acquired image, display the stereoscopic visual image on the display device. The tracking area is a portion of an area in which an observer can be tracked, and the tracking area includes a stereoscopic viewing area in which a stereoscopic image can be identified from the stereoscopic visual image. The control system is also configured to display a stereoscopic visual image within a predetermined time based on the position of the observer last detected in the tracking area after the detected observer becomes untrackable, and to display a stereoscopic visual image corresponding to a predetermined position in the stereoscopic viewing area when no observer is detected in the tracking area for more than a predetermined time.

[0006] One aspect of the present disclosure provides a proper stereoscopic visual image to an observer.

[0007] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 schematically shows an example configuration of an autostereoscopic display system;

[0009] Figure 2 An example of the structure of an image processing device is shown;

[0010] Figure 3 is a plan view showing a stereoscopic viewing area of ​​a display device;

[0011] Figure 4 An example of the relationship between the stereo viewing area, the best viewing point, and the tracking area is shown;

[0012] Figure 5 is a flowchart of an example of processing by an image processing apparatus;

[0013] Figure 6 An example of the detected observer's position and the change of the displayed image over time is shown;

[0014] Fig. 7A An example of the change in position of two observers in relation to the position of a target is shown;

[0015] Figure 7B Another example showing the relationship between the position changes of two observers and the target position;

[0016] Figure 8 An example of a stereoscopic viewing area composed of a plurality of sub-stereoscopic viewing areas is shown;

[0017] Fig. 9 An example is shown where the center between the observer's eyes is within the sub-stereoscopic viewing area;

[0018] Fig.10 shows an example where the center between the observer's eyes is not within any sub-stereoscopic viewing area; and

[0019] Fig.11 An example of the relationship between a stereoscopic viewing area composed of a plurality of sub-stereoscopic viewing areas and a tracking area is shown. DETAILED DESCRIPTION

[0020] In the following, embodiments are described in detail with reference to the accompanying drawings. For a clear understanding of the specification, the size or shape of the elements in the accompanying drawings may be exaggerated. It should be noted that the following description is to explain the embodiments of the present disclosure, rather than to limit the scope of the present disclosure.

[0021] The automatic stereoscopic display system disclosed herein includes: a display device for displaying a stereoscopic visual image and a control system for generating an image to be displayed by the display device. The stereoscopic visual image can be a still image or a moving image. The control system detects the position of the observer in a predetermined tracking area in the image captured by the imaging device. The tracking area is a part of the area in which the control system can detect or track the observer, and includes a stereoscopic viewing area in which the observer can recognize the stereoscopic image in the stereoscopic viewing area. The control system generates a stereoscopic visual image based on the position of the observer detected in the tracking area, and displays the stereoscopic visual image using the display device.

[0022] This display of a stereoscopic image based on the position of an observer detected in a predetermined tracking area reduces the frequency of changing the displayed stereoscopic image to fit the position of a person different from the target observer.

[0023] When the observer being tracked is lost in the tracking area, the control system displays the stereoscopic vision image within a predetermined time based on the last detected position of the observer. If the observer is not detected in the tracking area within the predetermined time, the control system displays the stereoscopic vision image at a predetermined position in the stereoscopic viewing area.

[0024] This configuration reduces the frequency of undesired changes in the stereoscopic image by maintaining the stereoscopic image for the observer even when the observer is temporarily lost in the tracking area. In addition, this configuration eliminates unnecessary changes in the stereoscopic image by displaying the stereoscopic image at a predetermined position in the stereoscopic viewing area when there is no observer.

[0025] The stereoscopic viewing area depends on the characteristics of the display device. The stereoscopic viewing area may consist of one continuous area or multiple isolated sub-areas. The tracking area may consist of one continuous area or multiple isolated sub-areas. An example of a tracking area includes a stereoscopic viewing area. The tracking area may include an area outside the stereoscopic viewing area. Another example of a tracking area is a continuous area and overlaps with a stereoscopic viewing area of ​​a continuous area. Yet another example of a tracking area consists of multiple sub-areas, and each sub-area overlaps with a sub-area of ​​the stereoscopic viewing area. The tracking area may overlap with a portion of the stereoscopic viewing area, or may include a portion of the stereoscopic viewing area and an area outside the stereoscopic viewing area.

[0026] Example 1

[0027] Figure 1An example of a configuration of an automatic stereoscopic display system is schematically shown. The automatic stereoscopic display system 1 includes a display device 10, an image processing device 20, and a tracking device 30. The display device 10 includes a display device and an optical element, which is arranged in front of the display device screen (between the screen and the observer). The display device can be a liquid crystal display device or an organic light emitting diode (OLED) display device. Any type of display device can be used. For example, the display device includes: a display panel, which includes a plurality of pixels arranged in a matrix, a drive circuit for driving the pixels of the display panel, and a control circuit for the drive circuit.

[0028] The display device simultaneously displays an image for the right eye and an image for the left eye using pixels for the right eye and pixels for the left eye that are alternately arranged. The light control element may be a parallax barrier or a double convex lens, which enables the observer's right eye to see only the image for the right eye, and the observer's left eye to see only the image for the left eye.

[0029] The tracking device 30 tracks one or more observers observing the image displayed on the display device 10. The tracking device 30 includes a camera (imaging device) for capturing moving images to detect and track observers within a trackable area in the captured image. The trackable area is an area that allows the tracking device 30 to detect (determine) the position of the observer in the captured image. In one example, the tracking device 30 is fixed on the top of the display device 10; the area to be captured by the camera is unchanged.

[0030] The tracking device 30 detects the position of the observer's eyes. In an example, the tracking device 30 also detects the position of a predetermined body part in addition to the eyes. The predetermined body part may be the head (a part above the neck) or the shoulder. The position of the head may be the position of a predetermined point in the detected head, such as the center of mass of the detected head. The head is a body part that has a specific and invariant positional relationship with the eyes.

[0031] exist Figure 1 In the example of FIG. 1 , the tracking device 30 determines the positions of the eyes and head of the observer in a space defined by the X-axis, the Y-axis, and the Z-axis, and sends the positions to the image processing device 20. The X-axis and the Y-axis are parallel to the screen 105 of the display device 10, and the Z-axis is perpendicular to the screen 105. The X-axis is parallel to the horizontal direction of the screen 105 and the Y-axis is parallel to the vertical direction of the screen 105.

[0032] exist Figure 1In the example of , two observers 50A and 50B are tracked. The positions of the left eye, right eye, and head of observer 50A are represented by LA, RA, and HA, respectively. The positions of the left eye, right eye, and head of observer 50B are represented by LB, RB, and HB, respectively. If any of the left eye, right eye, and head cannot be located, data indicating the situation (e.g., a NULL value) is forwarded.

[0033] The image processing device 20 acquires position data of the observers 50A and 50B in real time. The image processing device 20 generates a stereoscopic vision image based on the position of one of the observers tracked (detected) in the tracking area 401. The image processing device 20 generates a stereoscopic vision image based on the center position between the eyes.

[0034] If the center position between the eyes cannot be located, the image processing device 20 generates a stereoscopic vision image based on the position of the observer's head. Then, even if the center position between the eyes cannot be located, a stereoscopic vision image suitable for the selected observer can be displayed. Detecting the position of the observer's head is optional. The tracking area 401 is a part of the area that the tracking device 30 can track. The details of the tracking area 401 will be described later.

[0035] This embodiment is configured to select the observer 50A from the observers in the tracking area 401 and generate a stereoscopic vision image based on the position of the observer 50A. A strategy for selecting an observer from a plurality of observers in the tracking area 401 will be described later. The tracking device 30 may be configured to send only the position data of the observer detected in the predetermined tracking area 401 to the image processing apparatus 20.

[0036] When the tracked observer is lost in the tracking area 401, the image processing device 20 displays the stereoscopic vision image for a predetermined period of time based on the observer's last position. This configuration reduces the possibility of inappropriately changing the stereoscopic vision image when the observer is still in the tracking area 401 but cannot be tracked temporarily for some reason (for example, the observer turns his face).

[0037] The area (referred to as a stereoscopic viewing area) in which the observer can appropriately recognize the stereoscopic visual image is determined according to the characteristics of the display device 10. The characteristics of the display device 10 are designed to have a stereoscopic viewing area based on the average pupil distance of an adult, for example, 63 mm. An optimal viewing point P can be defined in the stereoscopic viewing area. The details of the stereoscopic viewing area and the optimal viewing point P will be described later. Figure 1 In the example, an optimal viewing point P is defined, and the optimal viewing point P is located at a certain distance from the center of the display 101 on the display device 10 along the normal of the screen of the display device 10 (in the normal direction).

[0038] When no observer is detected in the tracking area 401 within a predetermined period of time, the image processing device 20 displays a predetermined stereoscopic vision image. In an example, the image processing device 20 displays a stereoscopic vision image for the best viewing point. As a result, unnecessary changes in the stereoscopic vision image can be eliminated. The predetermined position (reference position) for displaying the stereoscopic vision image may be different from the best viewing point.

[0039] Figure 2 2 shows an example of a configuration of the image processing apparatus 20. The image processing apparatus 20 may have a general computer configuration. The image processing apparatus 20 includes a processor 201, a memory (main storage device) 202, an auxiliary storage device 203, an output device 204, an input device 205, and a communication interface (I / F) 207. These constituent elements are interconnected by a bus. The memory 202, the auxiliary storage device 203, or a combination thereof is a storage device.

[0040] The memory 202 may be a semiconductor memory and is mainly used to hold the program and data being executed. The processor 201 performs various processes according to the program stored in the memory 202. The processor 201 operates according to the program to implement various functional units. The auxiliary storage device 203 may be a large-capacity storage device such as a hard disk drive or a solid-state drive; it is used to store programs and data for a long time.

[0041] Processor 201 may be one or more processing units and may include one or more computing units or multiple processing cores. Processor 201 may be implemented as one or more central processing units, microprocessors, microcomputers, microcontrollers, digital signal processors, state machines, logic circuits, graphics processing units, systems on chips, and / or any device that operates signals according to control instructions.

[0042] At startup or when necessary, the program and data stored in the auxiliary storage device 203 are loaded to the memory 202, and the program is executed by the processor 201 to perform various processes of the image processing apparatus 20. Therefore, the process performed by the image processing apparatus 20 is the process performed by the processor 201 or the program.

[0043] The input device 205 is a hardware device for a user to input instructions and information to the image processing apparatus 20. The output device 204 is a hardware device for presenting images for input and output, for example, a display device or a printing device. The communication I / F 207 is an interface for connecting to a network. In this example, the image processing apparatus 20 communicates with the tracking device 30 through the communication I / F 207. The input device 205 and the output device 204 are optional, and the image processing apparatus 20 can be accessed from a terminal via a network.

[0044] The functions of the image processing apparatus 20 may be implemented in a computer system including one or more computers equipped with one or more processors and one or more storage devices including non-transitory storage media. The computers communicate with each other via a network. For example, a portion of the functions of the image processing apparatus 20 may be implemented in one computer, and another portion may be implemented in another computer.

[0045] The memory 202 of the image processing device 20 stores a tracking point acquisition module 221, a position determination module 222, an elapsed time determination module 223, and a stereoscopic vision image generation module 224. These are programs including command codes to be executed by the processor 201. The memory 202 also stores an operating system not shown and necessary temporary tables. The processing details of each program will be described later.

[0046] The auxiliary storage device 203 stores area definition information 231 and an image database 232. The area definition information 231 includes information about a tracking area and an optimal viewing point. The image database 232 stores image data for generating a stereoscopic image to be displayed by the display apparatus 10.

[0047] exist Figure 2 In the embodiment of the present invention, for the sake of convenience, the software elements are shown in the auxiliary storage device 203 or the memory 202; however, these elements may be stored in any area of ​​the storage device. As described above, the processor 201 operates according to a specific program to function as a specific functional unit. For example, the processor functions as a tracking point acquisition unit, a position determination unit, an elapsed time determination unit, and a stereoscopic vision image generation unit according to the above program.

[0048] Figure 3 is an XZ plan view showing the stereoscopic viewing area of ​​the display device 10. As described above, a stereoscopic viewing area in which a viewer can recognize a stereoscopic image is defined for the display device 10. Figure 3 An example of a stereoscopic viewing area 403 consisting of one continuous area is shown. If the center between the eyes 503 of the observer 50 is located in the stereoscopic viewing area 403, the observer 50 can properly recognize a stereoscopic image. When defining the stereoscopic viewing area 403, a specific value (for example, the average pupil distance of an adult, 63 mm) is used as the distance between the eyes of the observer 50.

[0049] Figure 4 An example of the relationship between the stereo viewing area, the optimal viewing point, and the tracking area is shown. Figure 4In the example of FIG. 4 , the tracking area 401 is a continuous area and includes a portion of the stereoscopic viewing area 403 and an area outside the stereoscopic viewing area 403. The image processing device 20 displays a stereoscopic vision image suitable for the position of the center between the eyes of the observer in the tracking area 401. When the center between the eyes of the observer is located outside the stereoscopic viewing area 403, the image processing device 20 may display a stereoscopic vision image suitable for the position closest to the center between the eyes in the stereoscopic viewing area 403. As described above, the tracking area 401 may overlap with a portion or all of the stereoscopic viewing area 403, or may include the entire stereoscopic viewing area 403 and an area outside the stereoscopic viewing area 403.

[0050] The best viewing point P is the intersection of a line connecting the maximum point Pmax and the minimum point Pmin of the stereoscopic viewing area 403 in the Z-axis direction and a line connecting the maximum point Pr and the minimum point P1 of the stereoscopic viewing area 403 in the X-axis direction. The maximum point Pmax and the minimum point Pmin in the Z-axis direction are points at the maximum and minimum distances from the screen 105. The maximum point Pr and the minimum point P1 in the X-axis direction are points located at the rightmost and leftmost ends relative to the screen 105. The best viewing point P is the point with the widest movable range in the stereoscopic viewing area 403.

[0051] Figure 5 It is a flowchart of an example of the processing of the image processing device 20. Figure 5 This is an example of processing in the case where only one observer is detected or one observer is selected from a plurality of observers in the tracking area 401. First, for example, the image processing apparatus 20 performs initial settings at the time of startup (S101).

[0052] Specifically, the position determination module 222 first acquires information about the tracking area and the best viewing point from the area definition information 231. The acquired information is stored to the memory 202. In addition, the elapsed time determination module 223 clears the counter used for timing.

[0053] Next, the tracking point acquisition module 221 acquires data on the positions of the eyes and head of the observer from the tracking device 30 (S102). The position determination module 222 determines whether the center between the eyes is located within the tracking area based on the acquired eye positions (S103). If the center between the eyes is located within the tracking area (S103: Yes), the position determination module 222 stores its position as a target point in the memory 202 (S104).

[0054] If the center between the eyes is outside the tracking area (S103: No and S105: No), the position determination module 222 returns to step S102. If the center between the eyes cannot be located (S105: Yes), the position determination module 222 determines whether the acquired position of the head is within the tracking area (S106). If the position of the head is within the tracking area (S106: Yes), the position determination module 222 stores the position as a target point in the memory 202 (S107).

[0055] If the position of the head is outside the tracking area or is not located (S106: No), the elapsed time determination module 223 increments the counter (S108). The elapsed time determination module 223 determines whether the value of the counter is higher than a predetermined value (S109). If the counter value is higher than the predetermined value (S109: Yes), the elapsed time determination module 223 stores the best viewing point as the target point in the memory 202 and clears the counter (S110).

[0056] The stereoscopic image generation module 224 generates a stereoscopic image suitable for the position held as the target point (S111). The stereoscopic image generation module 224 acquires image data from the image database 232, and processes the acquired image data based on the target point to generate a stereoscopic image suitable for the target point. The stereoscopic image generation module 224 outputs the generated stereoscopic image to the display device 10 to display the stereoscopic image (S112). If the position is not held as the target point (for example, after startup), the stereoscopic image generation module 224 does not generate a stereoscopic image.

[0057] Figure 6 An example of the position of the detected observer and the displayed image changing over time is shown. At time T1, the automatic stereoscopic display system 1 is activated. It is determined that there is no observer in the tracking area 401. Since the predetermined time has not elapsed since the activation, the display device 10 does not display any image. At time T2 after the predetermined time has elapsed from time T1, no observer is detected. The automatic stereoscopic display system 1 displays a stereoscopic vision image suitable for the best viewing point P.

[0058] At time T3, the observer 50 is detected in the tracking area 401. The autostereoscopic display system 1 generates and displays a stereoscopic vision image based on the position of the observer 50. At time T4, the observer 50 is being tracked. The autostereoscopic display system 1 generates and displays a stereoscopic vision image based on the position of the observer 50.

[0059] At time T5 , no observer is detected in the tracking area 401 . Since the observer 50 is lost in the tracking area 401 without the elapse of the predetermined time, and therefore, the autostereoscopic display system 1 generates and displays a stereoscopic image based on the last position of the observer 50 .

[0060] At time T6, a time longer than a predetermined time has elapsed since the observer 50 was lost in the tracking area 401. The autostereoscopic display system 1 displays a stereoscopic vision image suitable for the optimal viewing point P. At time T7, another observer 50 is detected in the tracking area 401. The autostereoscopic display system 1 generates and displays a stereoscopic vision image based on the position of the observer 50.

[0061] As described above, the automatic stereoscopic display system tracks the observer in the tracking area, but does not track the observer outside the tracking area, to generate and display a stereoscopic visual image based on the position of the observer in the tracking area. Since the tracking area is predetermined and the observer outside the tracking area is not tracked, flickering of the display is prevented, which is caused by a passerby behind the observer in the tracking area or a person crossing in front of the display device. This configuration of tracking the observer located in the tracking area enables the display of an image suitable for the observer.

[0062] When the observer is lost in the tracking area, the autostereoscopic display system maintains the last acquired observer's position to generate and display a stereoscopic visual image based on the position. This configuration prevents display flickering when the tracking device is temporarily unable to track the observer in the tracking area for some reason.

[0063] When there is no observer in the predetermined area, the autostereoscopic display system will keep the display for a predetermined time, and then display the image based on a predetermined position (optimal viewing point). When there is no observer, determining the optimal viewing point can display a fixed image.

[0064] The autostereoscopic display system detects the eyes and head (body) of the viewer and displays stereoscopic images based on the head (body) when the eyes cannot be detected. Detecting the eyes and head of the viewer can prevent sudden changes in the display when the autostereoscopic display system temporarily cannot detect the eyes.

[0065] Depending on the operating environment, the optimal viewing point P may be determined to be an arbitrary point. For example, in the case of displaying a stereoscopic image for a driver in a vehicle, the optimal viewing point P may be determined to be in front of the headrest of the driver's seat, in front of which the upper part of the driver's head may be located. The driver in the vehicle will look at the side mirror or rearview mirror to check safety. When the driver's eyes cannot be detected during a safety check, the display will change suddenly. The sudden change in display may attract the driver's attention. If the reference position is determined to be the upper part of the driver's head, sudden changes in the display while driving can be prevented.

[0066] The automatic stereoscopic display system can be configured to obtain the distance between the observer's eyes and control the light control element according to the obtained distance between the eyes to define a stereoscopic viewing area suitable for the observer. As described above, the best viewing point P can be determined as the point with the widest movable range in the stereoscopic viewing area.

[0067] For the light control element, a light control element whose optical characteristics are electrically controllable, such as a parallax barrier with a variable position or width of a slit or a liquid crystal lens with a variable curvature, can be used. Then, a stereoscopic viewing area that is optimal for the acquisition distance between the eyes of the observer can be defined. Defining a stereoscopic viewing area suitable for an observer whose eyes are at a distance different from the average distance of a single person of an adult human being, such as a toddler with a small skull, can display an appropriate stereoscopic image for the observer.

[0068] Example 2

[0069] Hereinafter, the processing in the case where multiple observers are detected in the tracking area is described. When the positions of multiple observers are obtained from the tracking area, the position determination module 222 of the image processing device 20 generates a stereoscopic visual image based on the position of the observer closest to the predetermined position (second reference position). The second reference position may be the same as or different from the reference position for displaying the stereoscopic visual image described above. In an example, the position determination module 222 selects the observer closest to the best viewing point. Selecting one person (observer) closest to the appropriate position (best viewing point) from multiple people can prevent display flickering.

[0070] If there are multiple observers closest to the best viewing point, the position determination module 222 maintains the position of the observer that has been maintained as the target point. The position of the last selected observer is maintained as the target point and the latest stereoscopic vision image is displayed to prevent sudden changes in the display when multiple observers are at the same distance from the best viewing point.

[0071] Fig. 7A An example of the change of position of two observers is shown. Fig. 7AIn the example of FIG. 2 , during the period from time T1 to time T2, the observer 50A is stationary and the observer 50B approaches the optimal viewing point P. As a result, the distance between the observer 50B and the optimal viewing point P becomes equal to the distance between the observer 50A and the optimal viewing point P. In this case, the position of the observer 50A is held in the memory 202 as a target point.

[0072] Figure 7B Another example of the change in position of two observers is shown. Figure 7B In the example of , in the time period from time T1 to time T2, the observer 50A approaches the best viewing point P, and the observer 50B moves away from the best viewing point P. As a result, the distance between the observer 50A and the best viewing point P becomes equal to the distance between the observer 50B and the best viewing point P. In this case, the position of the observer 50B is held in the memory 202 as a target point.

[0073] As in Embodiment 1, if the observer's eyes cannot be located, the position determination module 222 determines the position of the observer's head (body) as the target point. For example, when the observer A's sight temporarily leaves the screen 105, the position of the observer A's head is stored as the target point in the memory 202. Even if the observer moves away, the position of the observer's head is maintained so that the observer's sight is not tracked, thereby preventing sudden changes in the display.

[0074] Example 3

[0075] Hereinafter, a process in a case where the stereoscopic viewing area is composed of a plurality of sub-areas is described. Figure 8 Another example of a stereoscopic viewing area is shown. Figure 3 and Figure 4 The depicted example of stereoscopic viewing area 403 is composed of one continuous area. Figure 8 The example of the stereoscopic viewing area in FIG. 4 is composed of a plurality of isolated sub-areas. Specifically, the stereoscopic viewing area is composed of sub-stereoscopic viewing areas 403A to 403E. In each of the sub-stereoscopic viewing areas 403A to 403E, an optimal viewing point is defined. Figure 4 , defining each of the optimal viewing points PA to PE in the sub-stereoscopic observation areas 403A to 403E.

[0076] If the center between the eyes 503 of the observer 50 is located in any one of the sub-stereoscopic viewing areas 403A to 403E, that is, as Fig. 9 403A to 403E, the observer 50 can properly recognize the stereoscopic image. However, if the center between the eyes 503 of the observer 50 is not located in any of the sub-stereoscopic viewing areas 403A to 403E, that is, as shown in FIG. Fig.10 If the image shown in FIG. 5 is outside the stereoscopic viewing area, the observer 50 cannot properly recognize the stereoscopic image.

[0077] Fig.11 An example of the relationship between the stereoscopic viewing area composed of the sub-stereoscopic viewing areas 403A to 403E and the tracking area is shown. Fig.11 The tracking area in 404 is composed of a plurality of sub-areas (sub-tracking areas) 410A to 410E that overlap with the sub-stereoscopic viewing areas 403A to 403E. Each sub-tracking area may include an area outside the stereoscopic viewing area, or include only a portion of the corresponding sub-stereoscopic viewing area.

[0078] The sub-tracking areas 410A to 410E may be areas obtained by dividing one continuous area. In other words, the sub-tracking areas 410A to 410E may be continuous. For example, each of the sub-tracking areas 410A to 410E includes a corresponding sub-stereoscopic viewing area and an area outside the stereoscopic viewing area located between the sub-stereoscopic viewing areas.

[0079] Each of the sub-tracking areas 410A to 410E includes an optimal viewing point of a corresponding sub-stereoscopic viewing area. In an example, the sub-tracking areas 410A to 410E are pre-assigned different priorities. Information about the sub-tracking areas and the priorities assigned thereto is stored in the area definition information 231.

[0080] The position determination module 222 selects the sub-tracking areas 410A to 410E one by one in descending order of priority. If an observer is detected in the selected sub-tracking area, the position determination module 222 stores the target point in the memory 202 as described in Embodiments 1 and 2. The processing after selecting the sub-tracking area is the same as that in Embodiments 1 and 2. If an observer is not detected in any sub-tracking area, a stereoscopic vision image suitable for a predetermined best viewing point is displayed, which may be the best viewing point of the sub-tracking area to which the highest priority is assigned.

[0081] When the stereoscopic vision image for the selected sub-tracking area is on the display, if an observer is detected therein, the display may be changed to the stereoscopic vision image for the sub-tracking area with a higher priority. The position determination module 222 may be configured to start searching for another sub-tracking area including the observer in order of priority when a condition for displaying the stereoscopic vision image for the best viewing point is satisfied in the selected sub-tracking area.

[0082] The position determination module 222 may be configured to select one sub-tracking area from the plurality of sub-tracking areas based on the distance between the best viewing point in each sub-tracking area and the observer closest to the sub-tracking area. For example, in the case where some or all of the sub-tracking areas are assigned the same priority and an observer is detected in the sub-tracking areas assigned the same priority, the position determination module 222 may select the sub-tracking area in which the distance between the best viewing point and the observer closest to the best viewing point is the shortest. Assigning the same priority to all sub-tracking areas means that no priority is defined.

[0083] As mentioned above, the embodiments of the present disclosure have been described. However, the present disclosure is not limited to the aforementioned embodiments. Within the scope of the present disclosure, those skilled in the art can easily modify, add or convert each element in the aforementioned embodiments. A part of the configuration of an embodiment can be replaced by the configuration of another embodiment, or the configuration of an embodiment can be incorporated into the configuration of another embodiment.

Claims

1. A stereoscopic display system, comprising: A display device configured to display a stereoscopic image; as well as Control systems, The control system is configured as follows: acquiring an image captured by an imaging device; and displaying a stereoscopic vision image on a display device based on a position of an observer detected in a predetermined tracking area in the acquired image; wherein the tracking area is a portion of an area in which the observer can be tracked, and the tracking area includes a stereoscopic viewing area in which a stereoscopic image can be recognized from the stereoscopic visual image; and The control system is further configured as follows: After the detected observer becomes untrackable in the tracking area, displaying a stereoscopic vision image for a predetermined time based on the last detected position of the observer; and In the case where no observer is detected in the tracking area for more than a predetermined time, a stereoscopic vision image corresponding to a predetermined position in the stereoscopic viewing area is displayed.

2. The stereoscopic display system according to claim 1, wherein: The control system is configured as: determining the position of the observer based on the position of the observer's eyes when the observer's eyes are detected; and In a case where the eyes of the observer are not detected, the position of the observer is determined based on the position of a predetermined body part different from the eyes.

3. The stereoscopic display system according to claim 1, wherein: The predetermined position is the position of the intersection of a line connecting the maximum point and the minimum point of the stereoscopic viewing area in a direction parallel to the screen of the display device and a line connecting the maximum point and the minimum point of the stereoscopic viewing area in a direction normal to the screen of the display device.

4. The stereoscopic display system according to claim 1, wherein: The control system is configured to display a stereoscopic vision image on the display device based on a position of an observer closest to the predetermined position among a plurality of observers detected in the tracking area.

5. The stereoscopic display system according to claim 4, wherein: The control system is configured to maintain an updated stereoscopic image when a plurality of observers closest to the predetermined position are detected.

6. The stereoscopic display system according to claim 1, in, A tracking area consists of multiple sub-tracking areas. Each of the plurality of tracking sub-areas includes a stereoscopic viewing area in which a stereoscopic image can be recognized from a stereoscopic visual image displayed on a display device, and The control system is configured as follows: selecting the plurality of sub-tracking areas one by one in descending order of pre-assigned priorities until an observer is detected; and A stereoscopic image is displayed based on the detected position of the observer.

7. A method for displaying a stereoscopic image on a display device, comprising: acquiring an image captured by an imaging device; displaying a stereoscopic image on a display device based on a position of the observer detected in a predetermined tracking area in the acquired image, the tracking area being a portion of an area in which the observer can be tracked and including a stereoscopic viewing area in which a stereoscopic image can be recognized from the stereoscopic image, After the detected observer becomes untrackable in the tracking area, displaying a stereoscopic vision image for a predetermined time based on the last detected position of the observer; as well as In a case where no observer is detected in the tracking area for more than a predetermined time, a stereoscopic vision image corresponding to a predetermined position in the stereoscopic viewing area is displayed.

8. The method according to claim 7, further comprising: determining a position of the observer based on the position of the observer's eye in the event that an eye of the observer region is detected; as well as In a case where the eyes of the observer are not detected, the position of the observer is determined based on the position of a predetermined body part different from the eyes.

9. The method according to claim 7, wherein: The predetermined position is the position of the intersection of a line connecting the maximum point and the minimum point of the stereoscopic viewing area in a direction parallel to the screen of the display device and a line connecting the maximum point and the minimum point of the stereoscopic viewing area in a direction normal to the screen of the display device.

10. The method according to claim 7, further comprising: A stereoscopic vision image is displayed on a display device based on the position of an observer closest to the predetermined position among a plurality of observers detected in the tracking area.

11. The method according to claim 10, further comprising: When a plurality of observers closest to the predetermined position are detected, the latest stereoscopic image is maintained.

12. The method according to claim 7, in, A tracking area consists of multiple sub-tracking areas. Each of the plurality of tracking sub-areas includes a stereoscopic viewing area in which a stereoscopic image can be recognized from a stereoscopic visual image displayed on a display device, and Wherein, the method further comprises: selecting the plurality of sub-tracking areas one by one in descending order of pre-assigned priorities until an observer is detected; and A stereoscopic image is displayed based on the detected position of the observer.