Display control device, display control method, and program

Abstract

For example, when multiple people are captured in the front camera of a smartphone, tracking the position of the user's eyes becomes difficult, resulting in problems such as the image appearing to flicker or losing its 3D effect. [Solution] The display control device 100 comprises a display 12 which is a glasses-free 3D display; an image acquisition unit 110 which acquires a forward image captured from in front of the display surface of the display 12; an identification unit 130 which, when it is determined from the forward image that multiple people are positioned in front of the display surface of the display 12, identifies one of the multiple people as a tracking target; an information acquisition unit 140 which acquires eye tracking information including the positions of both eyes of the person to be tracked; and a display control unit 150 which controls the display of the display 12 based on the eye tracking information.

Description

Technical Field

[0001] The present invention relates to a display control device, a display control method, and a program.

Background Art

[0002] Patent Document 1 describes that "the visibility of the screen is controlled by a rotating support so that the screen is visible only to the user based on the position / angle of the user's eyes." [Prior Art Document] [Patent Document] [Patent Document 1] Japanese Patent Application Publication No. 2020-524311

Summary of the Invention

Means for Solving the Problems

[0003] According to an embodiment of the present invention, a display control device is provided. The display control device may include an image acquisition unit that acquires a front image obtained by imaging the front of the display surface of the autostereoscopic 3D display. When it is determined based on the front image that a plurality of persons are located in front of the display surface of the autostereoscopic 3D display, the display control device may include an identification unit that identifies one of the plurality of persons as a tracking target. The display control device may include an information acquisition unit that acquires eye tracking information including the positions of both eyes of the person who is the tracking target. The display control device may include a display control unit that controls the display of the autostereoscopic 3D display based on the eye tracking information.

[0004] In the display control device, the identification unit may identify, as the tracking target, the person among the plurality of persons who is closest to the autostereoscopic 3D display. In any of the display control devices, the identification unit may identify, as the person closest to the autostereoscopic 3D display, the person based on the features of the face portions of the plurality of persons in the front image.

[0005] In any of the above-mentioned display control devices, the identification unit may identify the person whose distance from the naked-eye 3D display is closest based on the distance between the eyes of each of the multiple people in the forward-facing image. In any of the above-mentioned display control devices, the identification unit may further identify the person whose distance from the naked-eye 3D display is closest based on the facial attributes of each of the multiple people in the forward-facing image.

[0006] In any of the above-mentioned display control devices, the identification unit may identify the person closest to the naked-eye 3D display based on distance measurement information obtained by measuring the distance between each of the multiple people and the naked-eye 3D display. In any of the above-mentioned display control devices, the identification unit may identify the tracking target based on a pre-stored face image of the person to be tracked and the forward-facing image.

[0007] In any of the above-mentioned display control devices, if the identification unit determines that there are multiple people who are closest to the naked-eye 3D display, it may identify one of the multiple people who are closest to the naked-eye 3D display as the tracking target based on the time-series eye-tracking information. Any of the above-mentioned display control devices may further include the naked-eye 3D display.

[0008] According to one embodiment of the present invention, a display control method performed by a computer is provided. The display control method may include an image acquisition step of acquiring a forward image captured from in front of the display surface of a glasses-free 3D display. The display control method may include a selection step of identifying one of the multiple persons as a tracking target when it is determined from the forward image that multiple persons are positioned in front of the display surface of the glasses-free 3D display. The display control method may include an information acquisition step of acquiring eye tracking information, including the positions of both eyes of the person being tracked. The display control method may include a display control step of controlling the display of the glasses-free 3D display based on the eye tracking information.

[0009] According to one embodiment of the present invention, a program is provided for causing a computer to execute any of the above-mentioned display control methods.

[0010] It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. Furthermore, subcombinations of these features may also constitute an invention. [Brief explanation of the drawing]

[0011] [Figure 1] An example of the functional configuration of the image display system 10 and the display control device 100 is schematically shown. [Figure 2] An example of the image display system 10 is shown schematically. [Figure 3] This is an explanatory diagram for describing the conventional technology. [Figure 4] An example of the image display system 10 is shown schematically. [Figure 5] An example of the image display system 10 is shown schematically. [Figure 6] An example of the processing flow by the display control device 100 is schematically shown. [Figure 7] A schematic example of the hardware configuration of a computer 1200 that functions as a display control device 100 is shown. [Modes for carrying out the invention]

[0012] The present invention will be described below through embodiments of the invention, but these embodiments are not intended to limit the invention as defined in the claims. Furthermore, not all combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0013] In recent years, advancements in 3D image capture technology and viewing devices have enriched the viewing environment for 3D content. For example, using HMDs (Head Mounted Displays) allows users to experience immersive visuals such as XR (Extended Reality, Cross Reality), VR (Virtual Reality), and AR (Augmented Reality).

[0014] However, the viewing method using HMDs (Head-Mounted Displays) faces significant hurdles due to the high cost of HMDs and the requirement for users to wear the device on their heads. In contrast, for example, glasses-free 3D devices that attach a film to a smartphone allow users to experience 3D content at a low cost without wearing an HMD.

[0015] For example, a lenticular lens film, consisting of multiple semi-cylindrical convex lenses arranged horizontally, can be attached to the display surface of a smartphone. 3D stereoscopic viewing can then be achieved by utilizing the refraction of light by the lenticular lens. In this case, a composite image is displayed on the smartphone, created by arranging images for the right and left eyes, each with parallax, in alternating, narrow strips. By using the refraction of light by the lenticular lens to ensure that the left-eye image reaches only the left eye and the right-eye image reaches only the right eye, the composite image is displayed on the smartphone, enabling 3D viewing.

[0016] Furthermore, for example, the smartphone's front camera can track the position of both of the user's eyes, and the displayed image can be dynamically controlled according to the tracked eye positions. In this case, for example, if the user looks at the smartphone display from the right, the image displayed will be dynamically controlled to match the position of the user's eyes when looking from the right. However, if, for example, multiple people are captured in the smartphone's front camera, tracking the position of both of the user's eyes becomes difficult, leading to problems such as the image appearing to flicker or losing its 3D effect.

[0017] The display control device 100 according to this embodiment has a configuration that contributes to solving such problems. For example, the display control device 100 identifies one of the multiple people captured by the front camera of the smartphone who is the closest as the tracking target and tracks both eyes of that person. Thereby, even when multiple people are captured by the front camera of the smartphone, it is possible to suppress the 3D image seen by the user from being disturbed.

[0018] FIG. 1 schematically shows an example of the functional configuration of the image display system 10 and the display control device 100. In the example shown in FIG. 1, the image display system 10 includes a display control device 100, a display 12, and an imaging unit 14. In the example shown in FIG. 1, a person 80 is viewing the content displayed on the display 12, and a person 90 is located behind the person 80 with respect to the display 12.

[0019] The display 12 may be a naked-eye 3D display. The display 12 is, for example, a horizontal parallax type naked-eye 3D display. For example, the display 12 is a light ray reproduction type. For example, the display 12 may be a display that performs 3D display using the refraction of light by an optical element arranged on the display surface. For example, the display 12 may be a lenticular lens method. For example, the display 12 may be an integral imaging method. The display 12 may also be a parallax barrier method.

[0020] The display 12 may also be a wavefront reproduction type naked-eye 3D display. For example, the display 12 is a holography.

[0021] The display control device 100 controls the display of the display 12. For example, the display control device 100 controls the display of the display 12 so that the person 80 can view the 3D content.

[0022] In the example shown in FIG. 1, an example is illustrated in which the terminal 11 includes all of the display control device 100, the display 12, and the imaging unit 14, but the present invention is not limited thereto. For example, some or all of the display control device 100, the display 12, and the imaging unit 14 may be separate devices. In this case, the display control device 100 and the display 12 are communicably connected, and the display control device 100 and the imaging unit 14 are communicably connected.

[0023] As a specific example, there may be a display control device 100 including the display 12. In this case, the device itself may or may not include the imaging unit 14.

[0024] In the example shown in FIG. 1, an example is illustrated in which the terminal 11 is a smartphone including the display 12, but the terminal 11 is not limited thereto. The terminal 11 may be a PC (Personal Computer), a tablet terminal, a display terminal arranged on the street, a signage terminal, etc. including the display 12. The terminal 11 may be a PC connected to the display 12. The terminal 11 may be a control terminal or the like connected to the display 12.

[0025] Hereinafter, an example will be described in which the image display system 10 as shown in FIG. 1 is a smartphone including the display control device 100, the display 12, and the imaging unit 14. In addition, an example will be described in which the display 12 and the imaging unit 14 are arranged close to each other, and the distance between the subject imaged by the imaging unit 14 and the imaging unit 14 is substantially equal to the distance between the display 12 and the subject. It should be understood by those skilled in the art that when the imaging unit 14 and the display 12 are arranged apart from each other, appropriate correction is added according to the relative position between the imaging unit 14 and the display 12, so that the following description of the distance between the display 12 and the subject holds.

[0026] In the example shown in Figure 1, the display control device 100 includes an image acquisition unit 110, a storage unit 120, a specification unit 130, an information acquisition unit 140, and a display control unit 150. The image acquisition unit 110 acquires a forward image 200 captured from in front of the display surface of the display 12. In the example shown in Figure 1, the image acquisition unit 110 acquires a forward image 200 that shows person 80 and person 90. In the example shown in Figure 1, the image acquisition unit 110 acquires a forward image 200 captured by the imaging unit 14 of the user terminal 11.

[0027] The storage unit 120 stores various types of information. For example, the storage unit 120 stores the forward image 200 acquired by the image acquisition unit 110. The storage unit 120 may also store the user's face image. For example, the storage unit 120 pre-stores the face image of person 80 as the user of terminal 11. The storage unit 120 may also store the face image of person 90 as the user of terminal 11. The display control device 100 may accept a specification of which face image from among multiple person face images should be used as the user's face image.

[0028] The identification unit 130 identifies the person to be tracked based on the forward image 200. For example, if there is one person in the forward image 200, the identification unit 130 may identify that person as the target for tracking.

[0029] The identification unit 130 determines, based on the forward image 200, that multiple people are positioned in front of the display surface of the display 12, and then identifies one of the multiple people as the tracking target. This determination may be made by the identification unit 130. In the example shown in Figure 1, for example, the identification unit 130 determines, by image recognition of the forward image 200, that person 80 and person 90 are positioned in front of the display surface of the display 12. The identification unit 130 then identifies person 80 as the tracking target, for example, out of person 80 and person 90. The identification unit 130 may exclude people other than person 80 from the tracking target.

[0030] The information acquisition unit 140 acquires eye-tracking information, including the positions of both eyes of the person being tracked. In the example shown in Figure 1, the information acquisition unit 140 calculates the positions of both eyes of person 80 based on the forward image 200. For example, the information acquisition unit 140 derives the positions of both eyes of person 80 in the forward image 200 by image recognition of person 80 in the forward image 200. For example, the information acquisition unit 140 may derive the relative position of both eyes of person 80 and the display 12 based on the positions of both eyes of person 80 in the forward image 200.

[0031] The method for deriving the positions of both eyes of person 80 can be appropriately selected from existing image recognition methods, and this will be understandable to those skilled in the art. For example, if the relative position between the display 12 and the imaging unit 14, and the distance 82 between the display 12 and person 80 are known, the relative position between both eyes of person 80 and the display 12 can be derived. For example, regarding the distance 82, by pre-storing the relationship between the distance 82 and the size of each part of person 80's face in the forward image 200, the distance 82 can be derived by image recognition of each part of person 80's face in the forward image 200.

[0032] The display control unit 150 controls the display of the display 12 based on eye-tracking information. For example, the display control unit 150 controls the display of the display 12 so that the person being tracked can view 3D content. In the example shown in Figure 1, the display control unit 150 controls the display of the display 12 based on the information about the positions of both of the person 80's eyes included in the eye-tracking information, so that the image for the right eye is projected at the location of the person 80's right eye, and the image for the left eye is projected at the location of the person 80's left eye.

[0033] Figure 2 schematically shows an example of the image display system 10. In the figures from Figure 2 onward, the display control device 100 is not shown in the figures, but the fact that the terminal 11 is equipped with the display control device 100 is the same as in the example shown in Figure 1. In the example shown in Figure 2, person 80 is viewing content displayed on the display 12. Since there are no people near person 80, no people other than person 80 are shown in the forward image 200.

[0034] In this case, the position of the user's eyes can be correctly tracked, as can the position of the person's eyes 80. Therefore, problems such as the image appearing to flicker or losing its 3D effect, as mentioned above, are less likely to occur, and person 80 can view the content displayed on display 12 in 3D.

[0035] Figure 3 is an explanatory diagram for explaining the prior art. In the example shown in Figure 3, person 80 is viewing content displayed on display 12, and person 90 is positioned behind person 80 relative to display 12.

[0036] In such cases, if no correction is taken, for example, the positions of both eyes of person 80 and person 90 will be tracked as the user's eye positions. Therefore, it is possible that, for example, the image for the right eye will be displayed on person 80's left eye, and the image for the left eye will be displayed on person 90's right eye. In such cases, the aforementioned problems may occur, such as the image appearing to flicker or losing its 3D effect.

[0037] Figure 4 schematically shows an example of the image display system 10. The identification unit 130 may identify one person from among several people who is closest to the display 12 as the tracking target. In the example shown in Figure 4, the identification unit 130 identifies person 80, who is closest to the display 12, as the tracking target among person 80 and person 90. As a result, only the positions of person 80's eyes are tracked. Therefore, the image for the right eye can be correctly displayed on person 80's right eye, and the image for the left eye can be correctly displayed on person 80's left eye, making it less likely for problems such as the image appearing to flicker or not appearing in 3D to occur.

[0038] For example, the identification unit 130 may identify the person closest to the display based on distance measurement information obtained by measuring the distance between each of the multiple people and the display 12. The image display system 10 may be equipped with distance measuring means. The distance measuring means is not particularly limited, but may be, for example, LiDAR (Light Detection and Ranging), TOF (Time of Flight), etc. For example, the identification unit 130 identifies the tracking target based on the distance 82 between the display 12 and person 80, and the distance 92 between the display 12 and person 90, which are acquired by the distance measuring means provided by the image display system 10. For example, the identification unit 130 identifies person 80 as the tracking target by comparing distance 82 and distance 92.

[0039] The identification unit 130 may identify the person closest to the display 12 based on the facial features of multiple people in the forward image 200. For example, the identification unit 130 may identify the person closest to the display 12 based on the relative positions and / or sizes of the facial feature points of each of the multiple people. Facial feature points include, for example, eyes, nose, mouth, ears, cheeks, and the entire face.

[0040] For example, the identification unit 130 identifies one person from among several people as the tracking target, based on the area of ​​the triangle formed by connecting both eyes and the mouth in the front image 200. For example, the identification unit 130 identifies one person from among several people as the tracking target, based on the area of ​​the face in the front image 200.

[0041] The identification unit 130 may identify the person closest to the display 12 by deriving the distance between the display 12 and each of the multiple people based on the relative positions and / or sizes of the facial feature points of each of the multiple people. For example, the identification unit 130 may pre-acquire the actual relative positions, sizes, etc., of the facial feature points of each of the multiple people, and calculate the distance from the ratio of the relative positions, etc., in the forward image 200 to the actual relative positions, etc. The identification unit 130 may also estimate the distance between the display 12 and each of the multiple people from the facial features of each of the multiple people in the forward image 200 using depth estimation with AI (Artificial Intelligence). This makes it easier to derive the distance accurately even when the size and shape of the faces are not constant.

[0042] For example, the identification unit 130 may identify the person closest to the display 12 based on the distance between the eyes of each of the multiple people in the forward image 200. For example, the identification unit 130 may identify the person with the largest distance between their eyes in the forward image 200 from among the multiple people as the tracking target.

[0043] In the example shown in Figure 4, the starting state is when the identification unit 130 has identified person 80 as the tracking target, and person 90 may gradually approach the display 12 from behind person 80. Subsequently, when the distance between the display 12 and person 80 and the distance between the display 12 and person 90 become approximately the same, the question arises as to which person the identification unit 130 will identify as the tracking target.

[0044] For example, if the identification unit 130 determines that there are multiple people who are closest to the display 12, it identifies one of the multiple people who are closest to the display 12 as the tracking target based on time-series eye-tracking information. For example, the identification unit 130 continues to identify the person who was identified as the tracking target immediately before as the tracking target.

[0045] Subsequently, it is possible that person 90 moves even closer to the display 12, and person 90 becomes closer to the display 12 than person 80. In this case, the identification unit 130 may switch the tracking target to person 90, who is the person closest to the display 12.

[0046] After the identification unit 130 detects that the distance between the display 12 and another person different from the person previously identified as the tracking target is smaller than the distance between the display 12 and the person previously identified as the tracking target, it may continue to identify the person previously identified as the tracking target until a predetermined waiting time has elapsed. After the predetermined waiting time has elapsed, the identification unit 130 may switch the tracking target to the other person.

[0047] For example, after the identification unit 130 detects that person 90 is closer to the display 12 than person 80, it continues to identify person 80 as the tracking target until a waiting period has elapsed, and then switches the tracking target to person 90 after the waiting period has elapsed. This prevents distortion of the 3D display for person 80, such as when person 90 briefly looks at the display 12, blocking the space between person 80 and the display 12, and allows person 80 to continue stable 3D viewing.

[0048] Even after detecting that person 90 is closer to the display 12 than person 80, if it is desired to continue tracking person 80 instead of person 90, the identification unit 130 may, for example, identify the tracking target by facial recognition of the user being tracked.

[0049] For example, the identification unit 130 identifies the tracking target based on a pre-stored facial image of the person to be tracked and the forward image 200. For example, the storage unit 120 pre-stores a facial image of person 80 as the facial image of the person to be tracked. The identification unit 130 may compare the facial image of person 80 stored by the storage unit 120 with the facial parts of multiple people in the forward image 200 to determine whether person 80 is present in the forward image 200.

[0050] If the identification unit 130 determines that a person 80 is present in the forward image 200, it identifies the person 80 in the forward image 200 as the tracking target. If the identification unit 130 determines that a person 80 is not present in the forward image 200, it may identify the person closest to the display 12 as the tracking target. If the identification unit 130 determines that a person 80 is not present in the forward image 200, it may terminate the process without identifying a tracking target.

[0051] Figure 5 schematically shows an example of the image display system 10. In the example shown in Figure 5, person 80 is a child and person 90 is an adult. Similar to the example shown in Figure 4, person 80 is viewing content displayed on the display 12, and person 90 is positioned behind person 80 relative to the display 12.

[0052] The identification unit 130 may identify the person closest to the display 12 based on the facial attributes of each of the multiple people in the forward image 200. For example, the identification unit 130 may identify person 80 as the person closest to the display 12 based on the facial attributes of person 80, which indicate that the person is a child.

[0053] The closer a subject is to the camera, the larger its size will appear in the captured image. However, since children's faces are generally smaller than adults' faces, it can be difficult to determine which is closer to the camera based solely on the size of each face in an image containing both a child's and an adult's face.

[0054] In the example shown in Figure 5, the sizes of person 80 and person 90 in the front image 200 are approximately the same. The distance between the eyes of person 80 and person 90 in the front image 200 are also approximately the same.

[0055] In such cases, the identification unit 130 may further identify the person closest to the display 12 based on the attributes of each face of the multiple people in the forward image 200. For example, if the difference in the width between the eyes of each of the multiple people in the forward image 200 is less than a predetermined threshold, the identification unit 130 may further identify the person closest to the display 12 based on the attributes of each face of the multiple people in the forward image 200. For example, if the difference between the width between the eyes of person 80 and the width between the eyes of person 90 in the forward image 200 is less than a predetermined threshold, the identification unit 130 may identify person 80 as the person closest to the display 12 based on the fact that person 80 has the face of a child.

[0056] The identification unit 130 may use AI to determine the facial attributes of multiple people in the forward image 200. For example, the identification unit 130 may use facial features such as the contours of the faces of multiple people, the presence or absence of wrinkles, and skin texture, as well as physical features such as height and clothing, to determine the facial attributes of multiple people in the forward image 200.

[0057] Figure 6 schematically shows an example of the processing flow by the display control device 100. In step 102 (steps may be abbreviated as S), the image acquisition unit 110 acquires the forward image 200.

[0058] In S104, based on the forward image 200 acquired by the image acquisition unit 110, the identification unit 130 determines that multiple people are positioned in front of the display surface of the display, and identifies one of the multiple people as the tracking target. In S106, the information acquisition unit 140 acquires eye tracking information, including the positions of both eyes of the tracking target person identified by the identification unit 130.

[0059] In S108, the display control unit 150 controls the display of the display 12 based on the eye-tracking information acquired by the information acquisition unit 140.

[0060] Figure 7 schematically shows an example of the hardware configuration of a computer 1200 that functions as a display control device 100. A program installed on the computer 1200 can cause the computer 1200 to function as one or more "parts" of the apparatus according to this embodiment, or to cause the computer 1200 to execute operations associated with the apparatus according to this embodiment or such one or more "parts", and / or to cause the computer 1200 to execute a process or a stage of such process according to this embodiment. Such a program may be executed by the CPU 1212 to cause the computer 1200 to execute specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

[0061] The computer 1200 according to this embodiment includes a CPU 1212, RAM 1214, and a graphics controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224, a DVD drive, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive may be a DVD-ROM drive and a DVD-RAM drive, etc. The storage device 1224 may be a hard disk drive and a solid-state drive, etc. The computer 1200 also includes legacy input / output units such as a ROM 1230 and a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0062] The CPU 1212 operates according to the programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires the image data generated by the CPU 1212 and stores it in the frame buffer provided in RAM 1214 or within itself, so that the image data is displayed on the display device 1218.

[0063] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0064] The ROM 1230 stores boot programs and / or hardware-dependent programs of the computer 1200, which are executed by the computer 1200 upon activation. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, etc.

[0065] The program is provided on a computer-readable storage medium such as a DVD-ROM or IC card. The program is read from the computer-readable storage medium and installed on a storage device 1224, RAM 1214, or ROM 1230, which are examples of computer-readable storage media, and executed by the CPU 1212. The information processing described within these programs is read by the computer 1200, resulting in coordination between the program and the various types of hardware resources described above. The apparatus or method may be configured to realize the operation or processing of information in accordance with the use of the computer 1200.

[0066] For example, when communication is performed between a computer 1200 and an external device, the CPU 1212 may execute a communication program loaded into RAM 1214 and, based on the processing described in the communication program, instruct the communication interface 1222 to perform communication processing. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in a recording medium such as RAM 1214, storage device 1224, DVD-ROM, or IC card, transmits the read transmission data to the network, or writes received data received from the network to a reception buffer area provided on the recording medium.

[0067] Furthermore, the CPU 1212 may read all or necessary parts of a file or database stored on an external recording medium such as the storage device 1224, a DVD drive (DVD-ROM), or an IC card into the RAM 1214, and perform various types of processing on the data in the RAM 1214. The CPU 1212 may then write the processed data back to the external recording medium.

[0068] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and subjected to information processing. The CPU 1212 may perform various types of processing on the data read from RAM 1214, including various types of operations, information processing, conditional judgments, conditional branching, unconditional branching, information retrieval / replacement, etc., as described throughout this disclosure and specified by the program instruction sequence, and write the results back to RAM 1214. The CPU 1212 may also retrieve information in files, databases, etc., within the recording medium. For example, if multiple entries are stored in the recording medium, each having an attribute value of a first attribute associated with an attribute value of a second attribute, the CPU 1212 may search among the multiple entries for an entry that matches the specified condition for the attribute value of the first attribute, read the attribute value of the second attribute stored in that entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies the predetermined condition.

[0069] The program or software module described above may be stored on or near the computer 1200 in a computer-readable storage medium. Alternatively, a recording medium such as a hard disk or RAM provided within a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, thereby providing the program to the computer 1200 via the network.

[0070] In this embodiment, blocks in the flowchart and block diagram may represent a stage in a process in which an operation is performed or a "part" of a device that has the role of performing an operation. A particular stage and "part" may be implemented by a dedicated circuit, a programmable circuit supplied with computer-readable instructions stored on a computer-readable storage medium, and / or a processor supplied with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuit may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. The programmable circuit may include reconfigurable hardware circuits, such as field-programmable gate arrays (FPGAs) and programmable logic arrays (PLAs), which include logical AND, logical OR, exclusive OR, negated AND, negated OR, and other logical operations, flip-flops, registers, and memory elements.

[0071] A computer-readable storage medium may include any tangible device capable of storing instructions that can be executed by a suitable device, and as a result, a computer-readable storage medium having instructions stored therein will comprise a product that includes instructions that can be executed to create means for performing operations specified in a flowchart or block diagram. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disk read-only memory (CD-ROM), digital multipurpose disc (DVD), Blu-ray® disc, memory stick, integrated circuit card, etc.

[0072] Computer-readable instructions may include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, Java®, C++, and traditional procedural programming languages ​​such as the C programming language or similar programming languages.

[0073] Computer-readable instructions may be provided locally or via a wide area network (WAN) such as a local area network (LAN) or the internet to a processor or programmable circuit of a general-purpose computer, special-purpose computer, or other programmable data processing device, so that the processor or programmable circuit of the programmable data processing device, such as a computer, can execute the instructions to generate means for performing operations specified in a flowchart or block diagram. Here, the computer may be a PC (personal computer), tablet computer, smartphone, workstation, server computer, general-purpose computer, or special-purpose computer, and may also be a computer system in which multiple computers are connected. Such a computer system in which multiple computers are connected is also called a distributed computing system and is a computer in a broad sense. In a distributed computing system, multiple computers execute a program collectively by each computer executing a part of the program and passing data during program execution between computers as needed.

[0074] Examples of processors include computer processors, central processing units, processing units, microprocessors, digital signal processors, controllers, and microcontrollers. A computer may have one or more processors. In a multiprocessor system with multiple processors, each processor executes a portion of the program, and the processors collectively execute the program by passing program execution data between them as needed. For example, in the execution of multitasks, each of the multiple processors may execute a portion of each task in small chunks by switching tasks at each time slice. In this case, which part of a program each processor executes changes dynamically. Which part of a program each of the multiple processors executes may also be statically determined by multiprocessor-aware programming.

[0075] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications or improvements can be made to the above embodiments. It will be clear from the claims that such modified or improved forms may also be included in the technical scope of the present invention.

[0076] It should be noted that the execution order of operations, procedures, steps, and stages in the apparatus, systems, programs, and methods shown in the claims, specifications, and drawings is not explicitly stated as "before" or "prior to," and that these can be implemented in any order unless the output of a previous process is used in a later process. Even if the operation flow in the claims, specifications, and drawings is described using phrases such as "first," and "next," for convenience, this does not mean that it is essential to perform the operations in that order. [Explanation of Symbols]

[0077] 10 Image display system, 11 Terminal, 12 Display, 14 Imaging unit, 80 Person, 82 Distance, 90 Person, 92 Distance, 100 Display control device, 110 Image acquisition unit, 120 Storage unit, 130 Identification unit, 140 Information acquisition unit, 150 Display control unit, 200 Forward image, 1200 Computer, 1210 Host controller, 1212 CPU, 1214 RAM, 1216 Graphics controller, 1218 Display device, 1220 Input / Output controller, 1222 Communication interface, 1224 Storage device, 1230 ROM, 1240 Input / Output chip

Claims

1. An image acquisition unit that acquires a forward-facing image by capturing the area in front of the display surface of a glasses-free 3D display, When it is determined that multiple people are positioned in front of the display surface of the naked-eye 3D display based on the forward image, the identification unit identifies one of the multiple people as the tracking target. An information acquisition unit that acquires eye-tracking information including the positions of both eyes of the person being tracked, A display control unit that controls the display of the glasses-free 3D display based on the eye-tracking information. A display control device equipped with the following features.

2. The display control device according to claim 1, wherein the identifying unit identifies one of the multiple persons who is closest to the naked-eye 3D display as the tracking target.

3. The display control device according to claim 2, wherein the identifying unit identifies the person whose face is closest to the naked-eye 3D display based on the characteristics of the facial portions of the multiple people in the forward image.

4. The display control device according to claim 3, wherein the identifying unit identifies the person who is closest to the naked-eye 3D display based on the distance between the eyes of each of the multiple people in the forward image.

5. The display control device according to claim 4, wherein the identifying unit further identifies the person whose distance from the naked-eye 3D display is closest, based on the attributes of each of the multiple faces in the forward image.

6. The display control device according to claim 2, wherein the identifying unit identifies the person who is closest to the naked-eye 3D display based on distance measurement information obtained by measuring the distance between each of the plurality of people and the naked-eye 3D display.

7. The display control device according to claim 1, wherein the identification unit identifies the tracking target based on a pre-stored facial image of the person to be tracked and the forward image.

8. The display control device according to any one of claims 2 to 6, wherein the identifying unit determines that there are multiple persons who are closest to the naked-eye 3D display, and based on the time-series eye-tracking information, identifies one of the multiple persons who are closest to the naked-eye 3D display as the tracking target.

9. The display control device according to any one of claims 1 to 7, further comprising the aforementioned glasses-free 3D display.

10. A display control method performed by a computer, The image acquisition stage involves capturing a forward-facing image of the area in front of the display surface of a glasses-free 3D display, When it is determined that multiple people are positioned in front of the display surface of the naked-eye 3D display based on the forward-facing image, the identification step involves identifying one of the multiple people as the tracking target. The information acquisition step involves acquiring eye-tracking information, including the positions of both eyes of the person being tracked, A display control step that controls the display of the glasses-free 3D display based on the eye-tracking information. A display control method comprising the following:

11. A program for causing a computer to execute the display control method described in claim 10.

Images