Display control device, display control method, and program

Abstract

For example, if multiple people are captured in the front camera of a smartphone, it becomes difficult to track the position of the user's eyes, causing the image to appear to flicker or not appear 3D. [Solution] The display control device 100 comprises a display 12 which is a naked-eye 3D display, an image acquisition unit 110 which acquires a forward image captured in front of the display surface of the display 12, an identification unit 130 which, when it is determined based on the forward image that multiple people are located in front of the display surface of the display 12, identifies one of the multiple people as a tracking target, an information acquisition unit 140 which acquires eye-tracking information including the positions of both eyes of the person to be tracked, and a display control unit 150 which controls the display of the display 12 based on the eye-tracking information.

Description

[Technical Field]

[0001] The present invention relates to a display control device, a display control method, and a program. [Background technology]

[0002] Patent Document 1 states that "the rotating support controls the visibility of the screen so that the screen is only visible to the user based on the position / angle of the user's eyes." [Prior art document] [Patent documents] [Patent Document 1] Special Publication No. 2020-524311 Summary of the Invention [Means for solving the problem]

[0003] According to one embodiment of the present invention, there is provided a display control device. The display control device may include an image acquisition unit that acquires a front image captured in front of a display surface of a naked-eye 3D display. The display control device may include an identification unit that, when it is determined based on the front image that multiple people are located in front of the display surface of the naked-eye 3D display, identifies one of the multiple people as a tracking target. The display control device may include an information acquisition unit that acquires eye-tracking information including the positions of both eyes of the tracking target person. The display control device may include a display control unit that controls the display of the naked-eye 3D display based on the eye-tracking information.

[0004] In the display control device, the identification unit may identify one of the plurality of persons who is closest to the naked-eye 3D display as the tracking target.In any of the display control devices, the identification unit may identify the one of the plurality of persons who is closest to the naked-eye 3D display based on features of facial portions of the plurality of persons in the forward image.

[0005] In any of the display control devices, the identification unit may identify one person who is closest to the naked-eye 3D display based on the width between the eyes of each of the plurality of people in the front image.In any of the display control devices, the identification unit may identify one person who is closest to the naked-eye 3D display further based on facial attributes of each of the plurality of people in the front image.

[0006] In any of the display control devices, the identification unit may identify one person who is closest to the naked-eye 3D display based on distance measurement information obtained by measuring the distance between each of the plurality of people and the naked-eye 3D display.In any of the display control devices, the identification unit may identify the tracking target based on a pre-stored face image of the person to be tracked and the forward image.

[0007] In any of the display control devices, when it is determined that there are multiple people who are closest to the naked-eye 3D display, the identification unit may identify one of the multiple people who are closest to the naked-eye 3D display as the tracking target based on the time-series eye tracking information. Any of the display control devices may further include the naked-eye 3D display.

[0008] According to one embodiment of the present invention, there is provided a display control method executed by a computer. The display control method may include an image acquisition step of acquiring a front image of an area in front of a display surface of the naked-eye 3D display. The display control method may include an identification step of identifying one of the multiple people as a tracking target when it is determined based on the front image that multiple people are located in front of the display surface of the naked-eye 3D display. The display control method may include an information acquisition step of acquiring eye-tracking information including the positions of both eyes of the person to be tracked. The display control method may include a display control step of controlling the display of the naked-eye 3D display based on the eye-tracking information.

[0009] According to one embodiment of the present invention, there is provided a program for causing a computer to execute any one of the display control methods described above.

[0010] The above summary of the invention does not list all of the necessary features of the present invention, and subcombinations of these features may also constitute inventions. [Brief explanation of the drawings]

[0011] [Figure 1] 1 shows an example of a functional configuration of an image display system 10 and a display control device 100. [Figure 2] 1 shows a schematic diagram of an example image display system 10. [Figure 3] FIG. 1 is an explanatory diagram for explaining a conventional technique. [Figure 4] 1 shows a schematic diagram of an example image display system 10. [Figure 5] 1 shows a schematic diagram of an example image display system 10. [Figure 6] 10 shows an example of a processing flow by the display control device 100. [Figure 7] 1 shows an example of a hardware configuration of a computer 1200 that functions as the display control device 100. DETAILED DESCRIPTION OF THE INVENTION

[0012] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention according to the claims. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0013] In recent years, advances in 3D image capture technology and viewing devices have led to improvements in the viewing environment for 3D content. For example, viewing methods using HMDs (Head Mounted Displays) allow users to experience immersive video images such as XR (Extended Reality, Cross Reality), VR (Virtual Reality), and AR (Augmented Reality).

[0014] However, viewing using an HMD is hindered by the high price of the HMD and the need for users to wear the device on their head.In contrast, glasses-free 3D devices, for example, which involve attaching a film to a smartphone, allow users to experience 3D content at a low cost without having to wear an HMD.

[0015] For example, a lenticular lens film consisting of multiple semi-cylindrical convex lenses arranged horizontally can be attached to the display surface of a smartphone, and 3D stereoscopic vision can be achieved by utilizing the refraction of light by the lenticular lens. In this case, a right-eye image and a left-eye image, which have parallax, are arranged alternately in the shape of thin strips and synthesized and displayed on the smartphone. Utilizing the refraction of light by the lenticular lens, the synthesized image is displayed on the smartphone so that the left-eye image reaches only the left eye and the right-eye image reaches only the right eye, enabling 3D viewing.

[0016] Furthermore, for example, the position of the user's eyes can be tracked using the front camera of the smartphone, and the image to be displayed can be dynamically controlled according to the tracked position of the eyes. In this case, for example, when the user looks at the smartphone display from the right side, the image that would be seen when looking from the right side is dynamically controlled to be displayed at the position of the user's eyes when looking from the right side. However, for example, when multiple people are captured in the front camera of the smartphone, it becomes difficult to track the position of the user's eyes, and there is a problem that the image appears to flash or does not appear 3D.

[0017] The display control device 100 according to this embodiment has a configuration that contributes to solving such problems. For example, the display control device 100 identifies the closest person among multiple people captured by the front camera of a smartphone as a tracking target and tracks both eyes of that person. This makes it possible to prevent distortion of the 3D image viewed by the user even when multiple people are captured by the front camera of the smartphone.

[0018] Fig. 1 shows an example of the functional configuration of an image display system 10 and a display control device 100. In the example shown in Fig. 1, the image display system 10 includes the display control device 100, a display 12, and an imaging unit 14. In the example shown in Fig. 1, a person 80 is viewing content displayed on the display 12, and a person 90 is located behind the person 80 with respect to the display 12.

[0019] The display 12 may be a naked-eye 3D display. The display 12 may be, for example, a horizontal parallax type naked-eye 3D display. For example, the display 12 may be a ray reproduction type. For example, the display 12 may be a display that performs 3D display using refraction of light by optical elements arranged on the display surface. For example, the display 12 may be a lenticular lens type. For example, the display 12 may be an integral imaging type. The display 12 may be a parallax barrier type.

[0020] The display 12 may be a wavefront reconstruction type autostereoscopic 3D display, for example the display 12 is holographic.

[0021] The display control device 100 controls the display on the display 12. For example, the display control device 100 controls the display on the display 12 so that the person 80 can view 3D content.

[0022] 1 illustrates an example in which the terminal 11 includes all of the display control device 100, the display 12, and the imaging unit 14, but this is not limiting. For example, some or all of the display control device 100, the display 12, and the imaging unit 14 may be separate devices. In this case, the display control device 100 and the display 12 are connected to be able to communicate with each other, and the display control device 100 and the imaging unit 14 are connected to be able to communicate with each other.

[0023] A specific example may be a display control device 100 that includes a display 12. In this case, the device itself may or may not include an imaging unit 14.

[0024] 1 illustrates an example in which the terminal 11 is a smartphone equipped with a display 12, but the terminal 11 is not limited to this. The terminal 11 may be a PC (Personal Computer), a tablet terminal, a display terminal installed on the street, a signage terminal, or the like, equipped with the display 12. The terminal 11 may be a PC connected to the display 12. The terminal 11 may be a control terminal or the like connected to the display 12.

[0025] 1, the following description will be given taking as an example a case where the image display system 10 is a smartphone including a display control device 100, a display 12, and an imaging unit 14. The following description will be given taking as an example a case where the display 12 and the imaging unit 14 are arranged close to each other, and the distance between the imaging unit 14 and a subject imaged by the imaging unit 14 is approximately equal to the distance between the display 12 and the subject. Note that if the imaging unit 14 and the display 12 are arranged apart, it will be understood by those skilled in the art that the following description of the distance between the display 12 and the subject will be valid by making appropriate corrections in accordance with the relative positions between the imaging unit 14 and the display 12.

[0026] 1, the display control device 100 includes an image acquisition unit 110, a storage unit 120, an identification unit 130, an information acquisition unit 140, and a display control unit 150. The image acquisition unit 110 acquires a forward image 200 captured by capturing an image in front of the display surface of the display 12. In the example shown in FIG. 1, the image acquisition unit 110 acquires the forward image 200 in which a person 80 and a person 90 appear. In the example shown in FIG. 1, the image acquisition unit 110 acquires the forward image 200 captured by an imaging unit 14 included in the user terminal 11.

[0027] The storage unit 120 stores various types of information. For example, the storage unit 120 stores the forward image 200 acquired by the image acquisition unit 110. The storage unit 120 may store a facial image of a user. For example, the storage unit 120 stores in advance a facial image of a person 80 as the user of the terminal 11. The storage unit 120 may also store a facial image of a person 90 as the user of the terminal 11. The display control device 100 may accept a designation of which facial image from the facial images of multiple people is to be used as the facial image of the user.

[0028] The identification unit 130 identifies a person to be tracked based on the front image 200. For example, when one person appears in the front image 200, the identification unit 130 may identify the person as a tracking target.

[0029] When it is determined that multiple people are located in front of the display surface of the display 12 based on the forward image 200, the identification unit 130 identifies one of the multiple people as a tracking target. This determination may be made by the identification unit 130. In the example shown in FIG. 1 , for example, the identification unit 130 determines that person 80 and person 90 are located in front of the display surface of the display 12 by image recognition of the forward image 200. For example, the identification unit 130 identifies person 80 of person 80 and person 90 as a tracking target. The identification unit 130 may exclude people other than person 80 from the tracking targets.

[0030] The information acquisition unit 140 acquires eye tracking information including the positions of the eyes of a person to be tracked. In the example shown in FIG. 1 , the information acquisition unit 140 calculates the positions of the eyes of the person 80 based on the front image 200. For example, the information acquisition unit 140 derives the positions of the eyes of the person 80 in the front image 200 by image recognition of the person 80 in the front image 200. For example, the information acquisition unit 140 may derive the relative positions of the eyes of the person 80 and the display 12 based on the positions of the eyes of the person 80 in the front image 200.

[0031] A method for deriving the positions of the eyes of person 80 may be appropriately selected from existing methods using image recognition, and would be understood by a person skilled in the art. For example, if the relative positions of the display 12 and the imaging unit 14 and the distance 82 between the display 12 and person 80 are known, the relative positions of the eyes of person 80 and the display 12 can be derived. For example, by storing in advance the relationship between the distance 82 and the size of each part of the face of person 80 in the forward image 200, the distance 82 can be derived by image recognition of each part of the face of person 80 in the forward image 200.

[0032] The display control unit 150 controls the display of the display 12 based on the eye tracking information. For example, the display control unit 150 controls the display of the display 12 so that the person being tracked can view 3D content. In the example shown in Fig. 1, the display control unit 150 controls the display of the display 12 based on information about the positions of the eyes of the person 80 included in the eye tracking information so that an image for the right eye is formed at the location where the right eye of the person 80 is located, and an image for the left eye is formed at the location where the left eye of the person 80 is located.

[0033] Fig. 2 shows a schematic diagram of an example of an image display system 10. In the figures following Fig. 2, the display control device 100 is not shown, but the terminal 11 is equipped with the display control device 100, as is the case with the example shown in Fig. 1. In the example shown in Fig. 2, a person 80 is viewing content displayed on a display 12. As there is no one near the person 80, no one other than the person 80 appears in the forward image 200.

[0034] In such a case, the positions of the eyes of person 80 can be correctly tracked as the positions of the user's eyes. Therefore, the above-mentioned problems of images appearing to flash or not appearing 3D are unlikely to occur, and person 80 can view content displayed on display 12 in 3D.

[0035] Fig. 3 is an explanatory diagram for explaining the conventional technology. In the example shown in Fig. 3, a person 80 is viewing content displayed on a display 12, and a person 90 is positioned behind the person 80 with respect to the display 12.

[0036] In such a case, if no measures are taken, for example, the positions of the eyes of person 90 will be tracked in addition to the positions of the eyes of person 80 as the positions of the user's eyes. Therefore, for example, a right-eye image may be displayed to the left eye of person 80, and a left-eye image may be displayed to the right eye of person 90. In such a case, problems such as the image appearing to flicker or not appearing 3D may occur, as described above.

[0037] FIG. 4 schematically illustrates an example of the image display system 10. The identification unit 130 may identify, as the tracking target, one of multiple people who is closest to the display 12. In the example illustrated in FIG. 4, the identification unit 130 identifies, as the tracking target, person 80, who is closest to the display 12, of people 80 and 90. This allows only the positions of both eyes of person 80 to be tracked. Therefore, a right-eye image can be correctly displayed to the right eye of person 80, and a left-eye image can be correctly displayed to the left eye of person 80, which makes it less likely that the above-mentioned problems of images appearing to flash or not appearing 3D will occur.

[0038] For example, the identification unit 130 may identify one person who is closest to the display 12 based on distance measurement information obtained by measuring the distance between each of a plurality of people and the display 12. The image display system 10 may include a distance measurement unit. The distance measurement unit is not particularly limited, and may be, for example, LiDAR (Light Detection and Ranging), TOF (Time of Flight), etc. For example, the identification unit 130 identifies the tracking target based on a distance 82 between the display 12 and a person 80 and a distance 92 between the display 12 and a person 90, which are acquired by the distance measurement unit included in the image display system 10. For example, the identification unit 130 identifies the person 80 as the tracking target by comparing the distance 82 with the distance 92.

[0039] The identification unit 130 may identify one person who is closest to the display 12 based on the features of the facial parts of the multiple people in the forward image 200. For example, the identification unit 130 may identify one person who is closest to the display 12 based on the relative positions and / or sizes of the facial feature points of each of the multiple people. The facial feature points include, for example, the eyes, nose, mouth, ears, cheeks, and the entire face.

[0040] For example, the identification unit 130 identifies, from among the multiple people, one person whose triangle area connecting both eyes and mouth is the largest in the forward image 200. For example, the identification unit 130 identifies, from among the multiple people, one person whose face area is the largest in the forward image 200 as the tracking target.

[0041] The identification unit 130 may derive the distance between the display 12 and each of the plurality of persons based on the relative positions and / or sizes of the facial feature points of each of the plurality of persons, and thereby identify one person who is closest to the display 12. For example, the identification unit 130 may acquire in advance the actual relative positions, sizes, etc. of the facial feature points of each of the plurality of persons, and calculate the distance from the ratio of the relative positions, etc. in the forward image 200 to the actual relative positions, etc. The identification unit 130 may estimate the distance between the display 12 and each of the plurality of persons from the facial features of each of the plurality of persons in the forward image 200 by depth estimation using AI (artificial intelligence). This makes it easier to derive the distance with high accuracy even when the size and shape of the faces are not uniform.

[0042] For example, the identification unit 130 may identify one person who is closest to the display 12 based on the width between the eyes of each of the multiple people in the front image 200. For example, the identification unit 130 identifies, from the multiple people, one person who has the largest width between the eyes in the front image 200 as the tracking target.

[0043] 4, starting from a state in which the identification unit 130 has identified person 80 as the tracking target, person 90 may gradually approach the display 12 from behind person 80. After that, when the distance between the display 12 and person 80 and the distance between the display 12 and person 90 become approximately the same, it may become a problem as to which person the identification unit 130 should identify as the tracking target.

[0044] For example, when the identification unit 130 determines that there are multiple people who are closest to the display 12, it identifies one of the multiple people who is closest to the display 12 as a tracking target based on the time-series eye tracking information. For example, the identification unit 130 continues to identify the person who was identified as a tracking target immediately before as a tracking target.

[0045] Thereafter, the person 90 may move even closer to the display 12, and the person 90 may become closer to the display 12 than the person 80. In this case, the identification unit 130 may switch the tracking target to the person 90, who is the person closest to the display 12.

[0046] After detecting that the distance between the display 12 and a person different from the person who was previously identified as the tracking target is smaller than the distance between the display 12 and the person, the identification unit 130 may continue to identify the person who was previously identified as the tracking target as the tracking target until a predetermined waiting time has elapsed. After the predetermined waiting time has elapsed, the identification unit 130 may switch the tracking target to the other person.

[0047] For example, after detecting that person 90 has come closer to the display 12 than person 80, the identification unit 130 continues to identify person 80 as the tracking target until a waiting time has elapsed, and then switches the tracking target to person 90 after the waiting time has elapsed. This prevents the 3D display for person 80 from being disturbed, for example, when person 90 blocks the gap between person 80 and display 12 and peers into the display 12 for just a moment, and allows person 80 to continue watching 3D content stably.

[0048] If it is desired to continue tracking person 80 rather than person 90 even after detecting that person 90 has come closer to display 12 than person 80, for example, the identification unit 130 may identify the tracking target by facial recognition of the user of the tracking target.

[0049] For example, the identification unit 130 identifies the tracking target based on a pre-stored facial image of the tracking target person and the forward image 200. For example, the storage unit 120 stores a facial image of person 80 in advance as the facial image of the tracking target person. The identification unit 130 may compare the facial image of person 80 stored in the storage unit 120 with the facial portions of multiple people in the forward image 200, and determine whether person 80 is present in the forward image 200.

[0050] When the identification unit 130 determines that a person 80 is present in the forward image 200, it identifies the person 80 in the forward image 200 as a tracking target. When the identification unit 130 determines that a person 80 is not present in the forward image 200, it may identify one person closest to the display 12 as a tracking target. When the identification unit 130 determines that a person 80 is not present in the forward image 200, it may end the processing without identifying a tracking target.

[0051] Fig. 5 schematically illustrates an example of image display system 10. In the example illustrated in Fig. 5, person 80 is a child and person 90 is an adult. As in the example illustrated in Fig. 4, person 80 is viewing content displayed on display 12, and person 90 is located behind person 80 with respect to display 12.

[0052] The identification unit 130 may identify one person who is closest to the display 12 based on the facial attributes of each of the multiple people in the forward image 200. For example, the identification unit 130 identifies the person 80 as one person who is closest to the display 12 based on the facial attribute of the person 80 being a child.

[0053] The closer a subject is to the camera, the larger it appears in the captured image. However, because children's faces are generally smaller than adult faces, it can be difficult to determine whether a child or adult is closer to the camera based solely on the size of each face in an image that includes both.

[0054] 5, the sizes of person 80 and person 90 are approximately the same in front image 200. The width between the eyes of person 80 and person 90 in front image 200 is also approximately the same.

[0055] In such a case, the identification unit 130 may identify one person who is closest to the display 12, further based on the attributes of the faces of each of the multiple people in the front image 200. For example, when the difference between the widths between the eyes of each of the multiple people in the front image 200 is less than a predetermined threshold, the identification unit 130 identifies one person who is closest to the display 12, further based on the attributes of the faces of each of the multiple people in the front image 200. For example, when the difference between the widths between the eyes of person 80 and person 90 in the front image 200 is less than a predetermined threshold, the identification unit 130 identifies person 80 as one person who is closest to the display 12, based on the fact that person 80 has a face of a child.

[0056] The identification unit 130 may use AI to determine the attributes of the faces of multiple people in the forward image 200. The identification unit 130 may determine the attributes of the faces of multiple people in the forward image 200 using, for example, facial features such as the contours of the faces of the multiple people, the presence or absence of wrinkles, and the texture of their skin, as well as physical features such as their heights and clothing.

[0057] 6 shows an example of the flow of processing by the display control device 100. In step (sometimes abbreviated as S) 102, the image acquisition unit 110 acquires the forward image 200.

[0058] In S104, if the identification unit 130 determines that multiple people are located in front of the display surface of the display based on the forward image 200 acquired by the image acquisition unit 110, it identifies one of the multiple people as a tracking target. In S106, the information acquisition unit 140 acquires eye tracking information including the positions of both eyes of the tracking target person identified by the identification unit 130.

[0059] In S108, the display control unit 150 controls the display on the display 12 based on the eye tracking information acquired by the information acquisition unit 140.

[0060] 7 schematically illustrates an example of the hardware configuration of a computer 1200 that functions as the display control device 100. A program installed on the computer 1200 can cause the computer 1200 to function as one or more "units" of an apparatus according to this embodiment, or can cause the computer 1200 to perform operations associated with the apparatus according to this embodiment or one or more "units," and / or can cause the computer 1200 to perform a process according to this embodiment or steps of the process. Such a program can be executed by the CPU 1212 to cause the computer 1200 to perform specific operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

[0061] The computer 1200 according to this embodiment includes a CPU 1212, a RAM 1214, and a graphics controller 1216, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communications interface 1222, a storage device 1224, a DVD drive, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The DVD drive may be a DVD-ROM drive, a DVD-RAM drive, or the like. The storage device 1224 may be a hard disk drive, a solid-state drive, or the like. The computer 1200 also includes a ROM 1230 and legacy input / output units such as a keyboard, which are connected to the input / output controller 1220 via an input / output chip 1240.

[0062] The CPU 1212 operates according to programs stored in the ROM 1230 and the RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires image data generated by the CPU 1212 into a frame buffer or the like provided in the RAM 1214 or into the graphics controller itself, and causes the image data to be displayed on the display device 1218.

[0063] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0064] The ROM 1230 stores therein a boot program or the like that is executed by the computer 1200 upon activation, and / or programs that depend on the hardware of the computer 1200. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a USB port, a parallel port, a serial port, a keyboard port, a mouse port, etc.

[0065] The programs are provided by a computer-readable storage medium such as a DVD-ROM or an IC card. The programs are read from the computer-readable storage medium, installed in the storage device 1224, RAM 1214, or ROM 1230, which are also examples of computer-readable storage media, and executed by the CPU 1212. Information processing described in these programs is read by the computer 1200, and causes cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing operations or processing of information in accordance with the use of the computer 1200.

[0066] For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 may execute a communication program loaded into the RAM 1214 and instruct the communication interface 1222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in the RAM 1214, the storage device 1224, a DVD-ROM, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes reception data received from the network to a reception buffer area or the like provided on the recording medium.

[0067] Furthermore, the CPU 1212 may cause all or a necessary portion of a file or database stored in an external recording medium such as the storage device 1224, a DVD drive (DVD-ROM), an IC card, etc. to be read into the RAM 1214, and may perform various types of processing on the data on the RAM 1214. The CPU 1212 may then write back the processed data to the external recording medium.

[0068] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. The CPU 1212 may perform various types of processing on data read from the RAM 1214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequences of the programs, and write the results back to the RAM 1214. The CPU 1212 may also search for information in a file, database, etc. on the recording medium. For example, if multiple entries, each having an attribute value of a first attribute associated with an attribute value of a second attribute, are stored on the recording medium, the CPU 1212 may search for an entry whose attribute value of the first attribute matches a specified condition from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0069] The above-described programs or software modules may be stored in a computer-readable storage medium on or near the computer 1200. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can also be used as a computer-readable storage medium, thereby providing the programs to the computer 1200 via the network.

[0070] The blocks in the flowcharts and block diagrams in the present embodiments may represent stages of a process in which an operation is performed or "parts" of an apparatus responsible for performing the operation. Particular stages and "parts" may be implemented by dedicated circuitry, programmable circuitry provided with computer-readable instructions stored on a computer-readable storage medium, and / or a processor provided with computer-readable instructions stored on a computer-readable storage medium. The dedicated circuitry may include digital and / or analog hardware circuits, including integrated circuits (ICs) and / or discrete circuits. The programmable circuitry may include reconfigurable hardware circuits, such as field programmable gate arrays (FPGAs) and programmable logic arrays (PLAs), including AND, OR, XOR, NAND, NOR, and other logical operations, flip-flops, registers, and memory elements.

[0071] A computer-readable storage medium may include any tangible device capable of storing instructions that are executed by an appropriate device, such that a computer-readable storage medium having instructions stored thereon comprises an article of manufacture, including instructions that can be executed to create means for performing the operations specified in the flowcharts or block diagrams. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable storage media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick, integrated circuit card, etc.

[0072] The computer readable instructions may include either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state-setting data, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk®, JAVA®, C++, etc., and conventional procedural programming languages ​​such as the “C” programming language or similar programming languages.

[0073] Computer-readable instructions may be provided to a general-purpose computer, a special-purpose computer, or another programmable data processing device, or a programmable circuit, either locally or via a local area network (LAN) or a wide area network (WAN) such as the Internet, so that the processor of the programmable data processing device, such as a computer, or the programmable circuit executes the computer-readable instructions to generate means for performing the operations specified in the flowcharts or block diagrams. Here, the computer may be a personal computer (PC), a tablet computer, a smartphone, a workstation, a server computer, a general-purpose computer, a special-purpose computer, or the like, or may be a computer system in which multiple computers are connected. Such a computer system in which multiple computers are connected is also called a distributed computing system, and is a broad definition of computers. In a distributed computing system, multiple computers collectively execute a program by each executing a portion of the program and passing data between the computers as needed during program execution.

[0074] Examples of processors include computer processors, central processing units, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc. A computer may have one or more processors. In a multiprocessor system with multiple processors, each processor executes a portion of a program and passes data between processors as needed during program execution, allowing the multiple processors to collectively execute the program. For example, in multitasking, each of the multiple processors may execute a portion of each task in small chunks by switching tasks at time slice intervals. In this case, which portion of a program each processor executes changes dynamically. Which portion of a program each of the multiple processors executes may also be statically determined by multiprocessor-aware programming.

[0075] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.

[0076] It should be noted that the execution order of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a later process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order. [Explanation of symbols]

[0077] 10 image display system, 11 terminal, 12 display, 14 imaging unit, 80 person, 82 distance, 90 person, 92 distance, 100 display control device, 110 image acquisition unit, 120 memory unit, 130 identification unit, 140 information acquisition unit, 150 display control unit, 200 forward image, 1200 computer, 1210 host controller, 1212 CPU, 1214 RAM, 1216 graphics controller, 1218 display device, 1220 input / output controller, 1222 communication interface, 1224 storage device, 1230 ROM, 1240 input / output chip

Claims

1. an image acquisition unit that acquires a front image obtained by capturing an image of an area in front of a display surface of the naked-eye 3D display; an identification unit that, when it is determined based on the forward image that multiple people are located in front of a display surface of the naked-eye 3D display, identifies one of the multiple people as a tracking target; an information acquisition unit that acquires eye tracking information including the positions of both eyes of the person to be tracked; a display control unit that controls the display of the naked-eye 3D display based on the eye tracking information; Equipped with the identification unit identifies one of the plurality of persons who is closest to the naked-eye 3D display as the tracking target, When it is determined that there are multiple people who are closest to the naked-eye 3D display, the identification unit identifies, as the tracking target, a person who has been identified as a tracking target until just before among the multiple people who are closest to the naked-eye 3D display, based on the time-series eye tracking information. Display control device.

2. The display control device according to claim 1 , wherein the specifying unit specifies one person who is closest to the naked-eye 3D display based on features of facial parts of the plurality of people in the forward image.

3. The display control device according to claim 2 , wherein the identification unit identifies one person who is closest to the naked-eye 3D display based on a width between the eyes of each of the plurality of people in the forward image.

4. The display control device according to claim 3 , wherein the specifying unit specifies one person who is closest to the naked-eye 3D display, further based on facial attributes of each of the plurality of people in the forward image.

5. The display control device according to claim 1 , wherein the identification unit identifies one person who is closest to the naked-eye 3D display based on distance measurement information obtained by measuring the distance between each of the plurality of people and the naked-eye 3D display.

6. The display control device according to claim 1 , further comprising the naked-eye 3D display.

7. A computer-implemented display control method, comprising: an image acquisition step of acquiring a front image of an area in front of a display surface of the naked-eye 3D display; an identification step of identifying one of the plurality of people as a tracking target when it is determined that a plurality of people are located in front of a display surface of the naked-eye 3D display based on the forward image; an information acquisition step of acquiring eye tracking information including the positions of both eyes of the person to be tracked; a display control step of controlling the display of the naked-eye 3D display based on the eye tracking information; Equipped with the identifying step includes identifying one of the plurality of people who is closest to the naked-eye 3D display as the tracking target; In the identification step, when it is determined that there are multiple people who are closest to the naked-eye 3D display, a person who was identified as a tracking target until just before among the multiple people who are closest to the naked-eye 3D display is identified as the tracking target based on the time-series eye tracking information. Display control method.

8. A program for causing a computer to execute the display control method according to claim 7.

Images