Display control device, display control method, and program

Abstract

It is desirable to provide technology that allows users to examine the details of an image while reducing the possibility of areas within the image remaining unseen by the user. [Solution] A display control device is provided, comprising: a gaze position detection unit that detects a first gaze position in a first image by the user based on the user's viewpoint position; an enlarged image generation unit that generates a second image by enlarging a region of the first image corresponding to the first gaze position based on the detection of the first gaze position; and a display control unit that controls the display unit so that the second image and the first image are displayed by the display unit.

Description

Technical Field

[0001] The present invention relates to a display control device, a display control method, and a program.

Background Art

[0002] In recent years, a technique has been known in which an image is displayed, and a partial area of an image (hereinafter, also referred to as "original image") is enlarged by enlarging the partial area based on a user operation on the displayed image, and the enlarged image (hereinafter, also referred to as "enlarged image") is generated and the enlarged image is displayed. According to such a technique, the user can easily check an area in the original image that the user wants to check in detail by visually recognizing the enlarged image.

[0003] For example, Patent Document 1 discloses a technique for measuring the movement of a user's line of sight and moving the enlarged image based on the measured movement of the line of sight. According to such a technique, the user can easily move the enlarged image by moving the line of sight.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when the enlarged image is displayed, the original image may disappear from the screen. Alternatively, the enlarged image may be displayed superimposed on a part of the original image. In these cases, since the whole or a part of the original image cannot be visually recognized by the user, an area that cannot be visually recognized by the user may occur in the original image.

[0006] Therefore, it is desired to provide a technique capable of reducing the possibility that an area that cannot be visually recognized by the user occurs in the image while allowing the user to check the details of the image. [Means for solving the problem]

[0007] To solve the above problems, according to one aspect of the present invention, a display control device is provided, comprising: a gaze position detection unit that detects a first gaze position in a first image by the user based on the user's viewpoint position; an enlarged image generation unit that generates a second image by enlarging the region corresponding to the first gaze position in the first image; and a display control unit that controls the display unit so that the second image and the first image are displayed by the display unit.

[0008] The display control device may include a zoom start operation detection unit that detects a predetermined zoom start operation by the user, and the display control unit may control the display unit to start displaying the second image based on the detection of the zoom start operation.

[0009] The gaze position detection unit may detect the second gaze position by the user before detecting the first gaze position, and the zoom start operation detection unit may detect that the second gaze position is within a preset zoom start determination area as the zoom start operation.

[0010] The display control unit may control the display unit to start displaying the first image before the detection of the zoom start operation, and to continue displaying the first image by the display unit after the detection of the zoom start operation.

[0011] The enlarged image generation unit may determine the magnification ratio of the second image relative to the region based on a predetermined magnification ratio determination parameter, and generate the second image by enlarging the region based on the magnification ratio.

[0012] The aforementioned scaling factor determination parameters may include user characteristics or environmental characteristics.

[0013] The display unit includes a screen that displays the first image and the second image, and the magnified image generation unit may change the magnification ratio based on the amount of change in the distance between the screen and the user's viewpoint.

[0014] The magnified image generation unit may determine the amount of change in the magnification ratio based on the amount of change in distance and the ratio of the amount of change in the magnification ratio to the amount of change in distance, and may change the magnification ratio based on the amount of change in the magnification ratio.

[0015] The ratio may be comprised of a combination of the interval of the distance that changes the magnification ratio and the interval at which the magnification ratio changes when the distance changes by the interval.

[0016] The enlarged image generation unit may determine the ratio based on user characteristics or environmental characteristics.

[0017] Furthermore, in order to solve the above problems, according to another aspect of the present invention, a display control method is provided which is performed by a computer and includes: detecting a first gaze position in a first image by the user based on the user's viewpoint position; generating a second image by enlarging the region of the first image based on the region corresponding to the first gaze position in the first image; and controlling the display unit so that the second image and the first image are displayed by the display unit.

[0018] Furthermore, in order to solve the above problems, according to another aspect of the present invention, a program is provided that causes a computer to function as: a gaze position detection unit that detects a first gaze position in a first image by the user based on the user's viewpoint position; an enlarged image generation unit that generates a second image by enlarging the region of the first image based on the region corresponding to the first gaze position in the first image; and a display control unit that controls the display unit so that the second image and the first image are displayed by the display unit. [Effects of the Invention]

[0019] As described above, according to the present invention, there is provided a technique capable of reducing the possibility that an area not confirmed by the user occurs in an image while allowing the user to confirm the details of the image.

Brief Description of the Drawings

[0020] [Figure 1] It is a diagram showing a schematic configuration example of a display control system 1 according to a first embodiment of the present invention. [Figure 2] It is a diagram showing an example of the content displayed on the screen 122 at the start of work. [Figure 3] It is a diagram showing an example of the content displayed on the screen 122 after detection of an enlargement start operation. [Figure 4] It is a diagram showing an example of the content displayed on the screen 122 after the gaze position in the work instruction g10 is detected. [Figure 5] It is a diagram showing an example of the relationship between the change amount of the screen viewpoint distance Dp and the change amount of the magnification M. [Figure 6] It is a flowchart showing an operation example of a display control system 1 according to a first embodiment of the present invention. [Figure 7] It is a diagram showing a schematic configuration example of a display control system 2 according to a second embodiment of the present invention. [Figure 8] It is a diagram showing a configuration example of the worker DB218. [Figure 9] It is a diagram showing a configuration example of the environment DB220. [Figure 10] It is a flowchart showing an operation example of a display control system 2 according to a second embodiment of the present invention. [Figure 11] It is a diagram showing the hardware configuration of an information processing device 900 as an example of a display control device 100 according to a first embodiment of the present invention. <​​​​​Preferred embodiments of the present invention will be described in detail below with reference to the attached drawings. In this specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant descriptions will be omitted.

[0022] Furthermore, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different numbers after the same reference numeral. However, if there is no need to particularly distinguish each of multiple components having substantially the same functional configuration, only the same reference numeral will be used.

[0023] (0. Overview) First, an overview of the embodiments of the present invention will be described.

[0024] As mentioned above, there is a known technique that displays the original image and then displays an enlarged image of a portion of the original image based on user interaction with the displayed original image. With this technique, users can more easily examine areas of the original image that they want to check in detail by viewing the enlarged image.

[0025] The technology for displaying such enlarged images may be needed in various fields. The following explanation primarily considers its application in the manufacturing sector. However, the fields to which this technology can be applied are not limited to manufacturing.

[0026] Furthermore, the following explanation primarily assumes that the user is a worker performing tasks in a factory. However, the user may be someone other than a worker. Also, the following explanation primarily assumes that the work performed by the worker is the assembly of products using parts. However, the type of work performed by the worker does not need to be limited.

[0027] In the manufacturing sector, the production of a wide variety of products in small quantities is progressing, and it is expected that the amount of information per page of work instructions will increase. Furthermore, an aging workforce is also anticipated.

[0028] Therefore, there may be a need for a technology that displays the work instruction as the original image, as well as an enlarged image of a specific area of ​​the work instruction. Such a technology is expected to make it easier for workers to examine areas of the work instruction they want to check in detail using the enlarged image.

[0029] Furthermore, the displays on small terminals (such as tablet devices) are increasingly being used to display work instructions. When work instructions are displayed on such small terminals, they tend to appear small. Therefore, when work instructions are displayed on small terminals, the ability to display enlarged images is all the more significant.

[0030] However, when an enlarged image is displayed, the work instructions may disappear from the screen. Alternatively, the enlarged image may be superimposed on a portion of the work instructions. In these cases, all or part of the work instructions may become invisible to the worker, potentially resulting in areas of the work instructions that are not visible to the worker.

[0031] Therefore, this specification will primarily describe a technology that allows workers to confirm the details of a work instruction while reducing the possibility of areas in the work instruction not being confirmed by the worker.

[0032] The embodiments of the present invention have been described above.

[0033] (1. First Embodiment) Next, a first embodiment of the present invention will be described.

[0034] (1-1. Configuration of the display control system) A configuration example of a display control system according to the first embodiment of the present invention will be described with reference to Figures 1 to 6.

[0035] (Display control system 1) Figure 1 is a diagram showing a schematic configuration example of a display control system 1 according to the first embodiment of the present invention. As shown in Figure 1, the display control system 1 according to the first embodiment of the present invention comprises a display control device 100, a gaze sensor unit 102, and a display unit 120.

[0036] The display control device 100 and the gaze sensor unit 102 are connected by wire or wireless. Furthermore, the display control device 100 and the display unit 120 are connected by wire or wireless.

[0037] As shown in Figure 1, the display control device 100, the gaze sensor unit 102, and the display unit 120 may be configured as separate components. In this case, the display control device 100, the gaze sensor unit 102, and the display unit 120 may each be connected to a network. The display control device 100 and the gaze sensor unit 102 are configured to communicate via the network. The display control device 100 and the display unit 120 are also configured to communicate via the network. Furthermore, the display control device 100 functions as a server, and the display control device 100 may be an on-premise server or a server located on the cloud.

[0038] Alternatively, the display control device 100, the gaze sensor unit 102, and the display unit 120 may be configured as a single unit.

[0039] (Eye-gaze sensor unit 102) The gaze sensor unit 102 detects the worker's line of sight. In the following description, it is mainly assumed that the gaze sensor unit 102 is composed of an infrared LED (Light-Emitting Diode) and an infrared sensor. In such a case, the gaze sensor unit 102 may detect the position of the pupil center and the position of the Purkinje image based on the detection result by the infrared sensor of the infrared light that is irradiated by the infrared LED and reflected from the worker's eye.

[0040] Furthermore, the gaze sensor unit 102 may detect the worker's gaze based on the relative positional relationship between the center position of the pupil and the position of the Purkinje image. The gaze detected by the gaze sensor unit 102 may be a three-dimensional gaze direction. The gaze direction may also include the center position of the pupil and the direction of the gaze. The center position of the pupil may correspond to the worker's viewpoint. Also, if the three-dimensional coordinate system defining real space is the xyz coordinate system with the central position of the display unit 120 as the origin, the center position of the pupil can also be expressed as P(Px,Py,Pz).

[0041] Furthermore, although calibration of the gaze sensor unit 102 is required before use, the explanation continues assuming that the calibration has already been performed. Through such calibration, the gaze sensor unit 102 can acquire the correspondence between the worker's gaze and the two-dimensional coordinates on the screen 122. The gaze sensor unit 102 can detect the two-dimensional coordinates on the screen 122 that correspond to the worker's gaze as the worker's viewpoint position. If the two-dimensional coordinate system defining the screen 122 is the XY coordinate system, the viewpoint position can also be expressed as G(GX,GY).

[0042] When the measurement interval by the gaze sensor unit 102 is Δt, the pupil center position P(Px,Py,Pz) and the viewpoint position G(GX,GY) are obtained for each measurement interval Δt. For example, if the gaze sensor unit 102 performs measurements from measurement time (Δt×1) to measurement time (Δt×t), an array of three-dimensional coordinates such as pupil center position P1(Px1,Py1,Pz1)~Pt(Pxt,Pyt,Pzt) and an array of two-dimensional coordinates such as viewpoint position G1(GX1,GY1)~Gt(GXt,GYt) are obtained.

[0043] (Display control device 100) The display control device 100 controls the display unit 120 so that a work instruction sheet, which is implemented by a computer and confirmed by the worker, is displayed. Furthermore, the display control device 100 performs various controls according to the worker's gaze based on the detection of the worker's gaze by the gaze sensor unit 102.

[0044] As shown in Figure 1, the display control device 100 includes a data processing unit 106 and an enlargement control unit 108. The enlargement control unit 108 also includes an enlargement display start determination unit 110, an enlargement ratio calculation unit 112, and a display control unit 114. For example, the display control device 100 may include a control unit (not shown) and a storage unit (not shown), and the data processing unit 106 and the enlargement control unit 108 may be implemented by a control unit (not shown).

[0045] The control unit (not shown) of the display control device 100 includes a processor such as a CPU (Central Processing Unit), and its functions can be realized by the processor loading a program stored in ROM (Read Only Memory) into RAM and executing it. In this case, a computer-readable recording medium on which the program is stored may also be provided. Alternatively, these blocks may be composed of dedicated hardware or a combination of multiple hardware components.

[0046] The storage unit (not shown) of the display control device 100 is a memory capable of storing programs and data for operating the control unit (not shown) of the display control device 100. The storage unit (not shown) of the display control device 100 can also temporarily store various data required during the operation of the control unit (not shown) of the display control device 100. For example, the memory may be non-volatile memory.

[0047] The data processing unit 106 may correspond to the gaze position detection unit. The magnification start determination unit 110 may correspond to the magnification start operation detection unit. The magnification ratio calculation unit 112 may correspond to the magnified image generation unit. Details of the functions of the data processing unit 106, the magnification start determination unit 110, the magnification ratio calculation unit 112, and the display control unit 114 will be explained later with reference to Figures 2 to 5.

[0048] (Display section 120) The display unit 120 includes a display and has a screen 122 for displaying various information. The display unit 120 displays various information on the screen 122 according to the control of the display control device 100. For example, the display unit 120 displays work instructions on the screen 122 according to the control of the display control device 100. The display unit 120 may be implemented as a desktop display or a tablet terminal. The display unit 120 may also be equipped with an input device (e.g., a touch panel).

[0049] (Functional details of the display control device 100) The details of the functions of the display control device 100 will be explained with reference to Figures 2 to 5 (and Figure 1 as appropriate).

[0050] Figure 2 shows an example of the content displayed on screen 122 at the start of work. As shown in Figure 2, the display control unit 114 controls the display unit 120 so that the work instruction sheet g10 is displayed on screen 122 at the start of work. The work instruction sheet g10 is an image and may correspond to the first image. The work instruction sheet g10 includes the work instruction content g11, an image of the assembly parts g12, and an image of the assembly tools g13.

[0051] Furthermore, the display control unit 114 controls the display unit 120 so that the zoom start button b11 is displayed on the screen 122. The zoom start button b11 may correspond to a pre-set zoom start determination area. The zoom start button b11 may be displayed at any position on the screen 122. For example, as shown in Figure 2, the zoom start button b11 may be displayed outside the work instruction sheet g10, or it may be displayed inside the work instruction sheet g10.

[0052] The data processing unit 106 detects the worker's gaze position (second gaze position) based on the worker's viewpoint position. In this specification, "gaze position" refers to a position that the worker is fixated on, and "the gaze position is within the area" may mean that the time the worker's viewpoint position has been continuously within the area has reached a predetermined time. Alternatively, "the gaze position is within the area" may mean that the worker's viewpoint position is momentarily within the area.

[0053] The magnification start determination unit 110 detects a predetermined magnification start operation performed by the operator. Specifically, the magnification start determination unit 110 can detect that the gaze position detected by the data processing unit 106 is located inside the magnification start button b11 as a magnification start operation. With this configuration, the operator can easily perform the magnification start operation simply by gazing at the inside of the magnification start button b11.

[0054] The operation to start zooming is not limited to the above example. For example, if the display unit 120 is equipped with an input device (e.g., a touch panel), the detection of the operation to start zooming may be achieved by the input device detecting the operation of pressing the zoom display start button b11.

[0055] Figure 3 shows an example of the content displayed on screen 122 after the detection of the zoom start operation. As shown in Figure 3, the display control unit 114, based on the detection of the zoom start operation, provides an instruction display area R1 and a zoom display area R2 on screen 122. The work instruction sheet g10 is placed inside the instruction display area R1. The zoom display area R2 will be described later.

[0056] Furthermore, the display control unit 114 controls the display unit 120 so that the zoom end button b12 is displayed on the screen 122. Note that the zoom end button b12 may be displayed anywhere. For example, the zoom end button b12 may be displayed in place of the zoom start button b11, or in the same position where the zoom start button b11 was displayed.

[0057] Furthermore, Figure 3 displays a viewpoint object g14 that indicates the worker's viewpoint. In the example shown in Figure 3, the worker wants to check the tools to be used for the task and is directing their gaze inside the assembly tool image g13. Therefore, the viewpoint object g14 is located inside the assembly tool image g13. Note that the viewpoint object g14 does not necessarily have to be displayed.

[0058] The data processing unit 106 detects the position of the worker's gaze on the work instruction sheet g10 (first gaze position) based on the worker's viewpoint. For example, suppose the worker keeps their gaze fixed on the inside of the assembly tool image g13 and gazes at the inside of the assembly tool image g13 in the work instruction sheet g10. Note that the position gazed at by the worker is not limited to the inside of the assembly tool image g13, but can be anywhere within the work instruction sheet g10.

[0059] Figure 4 shows an example of the content displayed on screen 122 after the gaze position in work instruction sheet g10 is detected. As shown in Figure 4, screen 122 continues to have an instruction sheet display area R1 and an enlarged display area R2. Based on the fact that the gaze position has been detected by the data processing unit 106, the magnification calculation unit 112 generates an enlarged image g20 by enlarging the area corresponding to the gaze position in work instruction sheet g10 (hereinafter also referred to as the "enlargement target area g16"). More specifically, the magnification calculation unit 112 generates the enlarged image g20 by duplicating the enlargement target area g16 while leaving it inside the instruction sheet display area R1, and then enlarging the duplicated enlargement target area g16.

[0060] Note that the enlarged image g20 may correspond to the second image. Figure 4 shows an example in which, because the gaze position is inside the assembly tool image g13, the enlarged image g20 is generated based on the assembly tool image g13 in which the gaze position exists. However, the area to be enlarged g16 only needs to be an area based on the gaze position (for example, a rectangular area with the gaze position as the center).

[0061] In the example shown in Figure 4, the magnification target area object g15, which indicates the magnification target area g16, is displayed on screen 122. Specifically, in the example shown in Figure 4, the magnification target area object g15 is displayed by a frame surrounding the assembly tool image g13, which is the magnification target area g16. However, the magnification target area object g15 does not necessarily have to be displayed.

[0062] The display control unit 114 controls the display unit 120 so that the display of the enlarged image g20 by the display unit 120 begins. At this time, as shown in Figure 4, the display control unit 114 may place the enlarged image g20 inside the enlarged display area R2.

[0063] As described above, the display control unit 114 controls the display unit 120 to start displaying the entire work instruction sheet g10 before detecting the zoom start operation (Figure 2). Furthermore, the display control unit 114 controls the display unit 120 to continue displaying the entire work instruction sheet g10 even after detecting the zoom start operation (Figure 4).

[0064] In other words, the display control unit 114 controls the display unit 120 so that both the entire work instruction sheet g10 and the enlarged image g20 are displayed by the display unit 120. As a result, even when the enlarged image g20 is displayed, the entire work instruction sheet g10 continues to be displayed, which reduces the possibility that areas of the work instruction sheet g10 may remain unseen by the worker while still allowing the worker to confirm the details of the work instruction sheet g10.

[0065] Here, the magnification ratio of the magnified image g20 relative to the magnified area g16 (hereinafter also referred to as "magnification ratio M") may be set to a fixed value. Alternatively, the magnification ratio calculation unit 112 may determine the magnification ratio M of the magnified image g20 relative to the magnified area g16 based on predetermined magnification ratio determination parameters. The magnification ratio determination parameters will be described in detail in the second embodiment of the present invention. The magnification ratio calculation unit 112 generates the magnified image g20 by magnifying the magnified area g16 based on the determined magnification ratio M.

[0066] Furthermore, if the operator wants to check a narrow area of ​​the magnified image g20, they may view the magnified image g20 from closer up. In this case, the distance between the screen 122 and the operator's viewpoint (hereinafter also referred to as "screen-to-viewpoint distance Dp") may decrease. On the other hand, if the operator wants to check a wide area of ​​the magnified image g20, they may view the magnified image g20 from further away. In this case, the screen-to-viewpoint distance Dp may increase. The magnification calculation unit 112 can calculate the screen-to-viewpoint distance Dp using the following formula (1).

[0067] Dp=(Px 2 +Py 2 +Pz 2 ) 1 / 2 ...(1)

[0068] Therefore, the magnification calculation unit 112 may store the screen viewpoint distance Dp at the start of displaying the magnified image g20 as the initial value of the screen viewpoint distance (hereinafter sometimes referred to as "Dp0") in a storage unit not shown. Alternatively, the magnification calculation unit 112 may store the magnification M at the start of displaying the magnified image g20 as the initial value of the magnification (hereinafter sometimes referred to as "M0") in a storage unit not shown.

[0069] The magnification calculation unit 112 may also change the magnification ratio M based on the change in the distance DP between screen viewpoints (hereinafter also referred to as "ΔDp"), with respect to the initial value Dp0 of the distance between screen viewpoints. In the following explanation, the change in the magnification ratio M may be referred to as "ΔM".

[0070] More specifically, the ratio of the change in the magnification ratio M to the change in the distance between screen viewpoints Dp (hereinafter also referred to as "change rate Ra") may be set in advance. The magnification ratio calculation unit 112 may then determine the change in the magnification ratio ΔM based on the change in the distance between screen viewpoints ΔDp and the change rate Ra, and change the magnification ratio M based on the change in the magnification ratio ΔM. The magnification ratio calculation unit 112 may also determine the change in the magnification ratio ΔM by multiplying the change in the distance between screen viewpoints ΔDp by the change rate Ra, and then determine the magnification ratio M by adding the change in the magnification ratio ΔM to the initial value of the magnification ratio M0.

[0071] The rate of change Ra may be constructed by a combination of the intervals in the screen viewpoint distance Dp that change the magnification factor M (hereinafter also referred to as "distance interval d") and the interval at which the magnification factor M changes when the screen viewpoint distance Dp changes by the distance interval d (hereinafter also referred to as "magnification interval m"). However, d > 0 and m > 0.

[0072] Figure 5 shows an example of the relationship between the change in screen viewpoint distance Dp and the change in magnification M. Referring to Figure 5, "distance," "working status," "magnified image," and "magnification" are shown in correspondence.

[0073] "Distance" is the distance Dp between screen viewpoints. The distance Dp between screen viewpoints changes in increments of d (cm) from Dp0+d (cm) to Dp0-2d (cm).

[0074] "Work Status" indicates the situation in which worker U is performing work. Worker U is working with a part placed on a workbench Ta. Screen 122 is located above the workbench Ta. "Work Status" also shows the screen-to-viewpoint distance Dp, which is the distance between screen 122 and worker U's viewpoint.

[0075] The "enlarged image" is the enlarged image g20 displayed on screen 122. The enlarged image g20 is gradually enlarged in accordance with the change in the distance between the screen viewpoints Dp from Dp0+d(cm) to Dp0-2d(cm) in increments of d(cm).

[0076] The "magnification ratio" is the magnification ratio M of the magnified image g20 relative to the area to be magnified. Corresponding to the change in distance interval d (cm) of the screen viewpoint distance Dp from Dp0+d (cm) to Dp0-2d (cm), the magnification ratio M changes in magnification ratio interval m (%) from M0-m (%) to M0+2m (%). For example, the minimum value of the magnification ratio M may be 100 (%), and the maximum value of the magnification ratio M may be 200 (%), but the minimum and maximum values ​​of the magnification ratio M are not limited to these examples.

[0077] As can be seen from the example shown in Figure 5, the magnification M of the magnified image g20 can be adjusted so that the smaller the distance Dp between the screen viewpoints of the operator U, the greater the magnification M of the magnified image g20. The combination of the distance interval d and the magnification interval m may be adjusted as appropriate. This allows the rate of change Ra, which is the ratio of the change in the magnification M to the change in the distance Dp between the screen viewpoints, to be adjusted. The adjustment of such a rate of change Ra will be described later in the second embodiment of the present invention.

[0078] Let's return to Figure 4 and continue the explanation. For example, suppose a worker has checked the tools and then wants to check the contents of the work instruction sheet g10 other than the assembly tool image g13 (for example, the work instruction content g11 or the assembly part image g12). Let's assume the worker then focuses on the location inside the work instruction sheet g10 but outside the assembly tool image g13.

[0079] In such cases, the data processing unit 106 may detect the external location as a new gaze position. The magnification calculation unit 112 may then generate a new magnified image by enlarging the area of ​​the work instruction sheet g10 corresponding to the new gaze position. Furthermore, the display control unit 114 may control the display unit 120 so that the display of the new magnified image is started instead of the magnified image g20.

[0080] At this time, the magnification calculation unit 112 may recalculate the screen viewpoint distance Dp based on the viewpoint position. The magnification calculation unit 112 may update the initial value Dp0 of the screen viewpoint distance stored in a storage unit (not shown) with the screen viewpoint distance Dp at the start of displaying the new magnified image. Furthermore, the magnification calculation unit 112 may update the initial value M0 of the magnification rate stored in a storage unit (not shown) with the magnification rate M at the start of displaying the new magnified image.

[0081] The magnification start determination unit 110 detects a predetermined magnification end operation performed by the operator. Specifically, the magnification start determination unit 110 can detect that the gaze position detected by the data processing unit 106 is inside the magnification end button b12 as a magnification end operation. With this configuration, the operator can easily perform the magnification end operation simply by gazing at the inside of the magnification end button b12.

[0082] Furthermore, if the zoom start determination unit 110 detects that the zoom end operation has been performed, the content displayed on screen 122 will revert to the content displayed on screen 122 before the zoom start operation was detected (Figure 2).

[0083] The above describes an example of the configuration of the display control system 1 according to the first embodiment of the present invention.

[0084] (1-2. Operation of the display control system) Referring to Figure 6 (and Figures 1 to 5 as appropriate), an example of the operation of the display control system 1 according to the first embodiment of the present invention will be described.

[0085] Figure 6 is a flowchart showing an example of the operation of the display control system 1 according to the first embodiment of the present invention. As shown in Figure 6, the worker starts work (S100). As shown in Figure 2, when the worker starts work, the work instruction sheet g10 is displayed on the screen 122. Then, the gaze sensor unit 102 starts measuring the worker's gaze (S102). The gaze may include the center position of the worker's pupil and the direction of the gaze.

[0086] The gaze sensor unit 102 measures the line of sight and starts processing to detect the two-dimensional coordinates on the screen 122 corresponding to the worker's line of sight as the worker's viewpoint position. The data processing unit 106 detects the position of the worker's gaze based on the worker's viewpoint position. The zoom display start determination unit 110 can detect that the gaze position detected by the data processing unit 106 is inside the zoom display start button b11 as a zoom start operation.

[0087] If the magnification start determination unit 110 detects a magnification start operation (S104), S106 to S110 are executed. The magnification start determination unit 110 can detect that the gaze position detected by the data processing unit 106 is inside the magnification end button b12 as a magnification end operation. If the magnification start determination unit 110 detects a magnification end operation, the repetition of S104 to S112 ends (S112). On the other hand, if no magnification end operation is detected, S106 to S110 are executed again.

[0088] When the process moves to S106, the data processing unit 106 detects the worker's gaze position based on the worker's viewpoint. The magnification calculation unit 112 generates an enlarged image g20 by enlarging the area corresponding to the gaze position on the work instruction sheet g10. Then, the display control unit 114 controls the display unit 120 so that the display of the enlarged image g20 by the display unit 120 begins (S106).

[0089] The magnification calculation unit 112 calculates the screen viewpoint distance Dp based on the viewpoint position. The magnification calculation unit 112 stores the screen viewpoint distance Dp at the start of displaying the magnified image g20 as the initial value Dp0 of the screen viewpoint distance in a storage unit (not shown). Furthermore, the magnification calculation unit 112 stores the magnification M at the start of displaying the magnified image g20 as the initial value M0 of the magnification in a storage unit (not shown).

[0090] The data processing unit 106 continuously detects the viewpoint position at each measurement interval Δt. Each time the viewpoint position is detected by the data processing unit 106, the magnification calculation unit 112 recalculates the screen viewpoint distance Dp based on the viewpoint position and changes the magnification ratio M based on the change in screen viewpoint distance ΔDp relative to the initial value Dp0 of the screen viewpoint distance (S108).

[0091] More specifically, the magnification calculation unit 112 may determine the change in magnification ΔM based on the change in the distance between screen viewpoints ΔDp and the rate of change Ra, and may change the magnification M based on the change in magnification ΔM. The rate of change Ra may be composed of a combination of a distance interval d, which is the interval of the distance between screen viewpoints Dp that changes the magnification M, and a magnification interval m, which is the interval at which the magnification M changes when the distance between screen viewpoints Dp changes by the distance interval d.

[0092] Next, if the data processing unit 106 detects a new gaze position by the worker (YES in S110), the process moves to S106. When the process moves to S106, the magnification calculation unit 112 may generate a new magnified image by magnifying the area of ​​the work instruction sheet g10 corresponding to the new gaze position. Furthermore, the display control unit 114 may control the display unit 120 so that the display of the new magnified image is started instead of the magnified image g20.

[0093] At this time, the magnification calculation unit 112 recalculates the screen viewpoint distance Dp based on the viewpoint position. The magnification calculation unit 112 updates the initial value Dp0 of the screen viewpoint distance stored in a storage unit (not shown) with the screen viewpoint distance Dp at the start of displaying the new magnified image. Furthermore, the magnification calculation unit 112 updates the initial value M0 of the magnification rate stored in a storage unit (not shown) with the magnification rate M at the start of displaying the new magnified image.

[0094] On the other hand, if the data processing unit 106 does not detect a new gaze position by the operator (NO in S110), the process proceeds to S112. When the repeated processing from S104 to S112 is completed, the content displayed on screen 122 is returned to the content displayed on screen 122 before the detection of the zoom start operation (Figure 2).

[0095] The above describes an example of the operation of the display control system 1 according to the first embodiment of the present invention.

[0096] (1-3. Effects of the First Embodiment) According to the first embodiment of the present invention, both the entire work instruction sheet g10 and the enlarged image g20 are displayed by the display unit 120. As a result, even when the enlarged image g20 is displayed, the entire work instruction sheet g10 continues to be displayed, which reduces the possibility that areas of the work instruction sheet g10 may remain unseen by the worker while allowing the worker to confirm the details of the work instruction sheet g10.

[0097] Furthermore, according to the first embodiment of the present invention, the presence of a gaze position detected by the data processing unit 106 inside the magnification start button b11 can be detected as a magnification start operation. With this configuration, the operator can easily perform a magnification start operation simply by gazing inside the magnification start button b11. Moreover, with this configuration, whether or not the gaze position is inside the magnification start button b11 makes it clearer whether or not the operator wants to start magnification, thus enabling a magnification start determination that more accurately reflects the operator's intention.

[0098] The first embodiment of the present invention has been described above.

[0099] (2. Second Embodiment) Next, a second embodiment of the present invention will be described. In the following, the description of parts common to the second embodiment and the first embodiment of the present invention will be omitted, and the parts of the second embodiment that differ from the first embodiment of the present invention will be described.

[0100] (2-1. Configuration of the display control system) Referring to Figures 7 to 9, an example of the configuration of the display control system 2 according to the second embodiment of the present invention will be described.

[0101] (Display control system 2) Figure 7 shows a schematic configuration example of a display control system 2 according to a second embodiment of the present invention. As shown in Figure 7, the display control system 2 according to the second embodiment of the present invention differs from the display control system 1 according to the first embodiment of the present invention in that the display control device 100 is replaced by a display control device 200, and a worker ID acquisition unit 204 and an environment ID acquisition unit 206 are added, while other aspects are the same. Note that ID is an abbreviation for Identification.

[0102] Therefore, in the following description, the display control device 200, the worker ID acquisition unit 204, and the environment ID acquisition unit 206 will be described mainly, and a detailed description of other components of the display control system 2 according to the second embodiment of the present invention will be omitted.

[0103] (Worker ID acquisition unit 204) The worker ID acquisition unit 204 acquires a worker ID, which is an ID used to identify a worker. For example, the worker ID acquisition unit 204 may be implemented by a worker ID reader that reads a work ID pre-recorded on a work ID card from the work ID card, and may be connected to the parameter management unit 216. In this case, the worker may have the worker ID read by the worker ID acquisition unit 204 by holding the work ID card over the worker ID acquisition unit 204.

[0104] Furthermore, a work ID card may be considered a recording medium on which a work ID is recorded. The work ID may be pre-recorded on the work ID card using an information code (for example, a one-dimensional code or a two-dimensional code).

[0105] (Environmental ID acquisition unit 206) The environment ID acquisition unit 206 acquires an environment ID, which is an ID used to identify the environment in which the work is performed. For example, the environment in which the work is performed may be a workbench used for the work. In this case, the environment ID may be different for each workbench. Alternatively, the environment ID corresponding to multiple workbenches having the same or similar characteristics may be the same.

[0106] For example, the environmental ID acquisition unit 206 may be implemented by an environmental ID reader that reads the environmental ID pre-recorded on the environmental ID card from the environmental ID card, and may be connected to the parameter management unit 216. In this case, the worker may have the environmental ID acquisition unit 206 read the environmental ID by holding the environmental ID card over the environmental ID acquisition unit 206. The reading order of the worker ID and the environmental ID is not limited. The environmental ID acquisition unit 206 may be a different device from the worker ID acquisition unit 204, or it may be the same device.

[0107] Furthermore, an environmental ID card may be considered a recording medium on which an environmental ID is recorded. The environmental ID may be pre-recorded on the environmental ID card using an information code (for example, a one-dimensional code or a two-dimensional code).

[0108] (Display control device 200) The display control device 200 according to the second embodiment of the present invention has a parameter management unit 216, an operator DB 218, and an environment DB 220 added compared to the display control device 100 according to the first embodiment of the present invention, and the magnification control unit 108 is replaced by the magnification control unit 208, with other features being the same. The magnification control unit 208 according to the second embodiment of the present invention has a magnification ratio calculation unit 112 replaced by the magnification ratio calculation unit 212 compared to the magnification control unit 108 according to the first embodiment of the present invention, with other features being the same. DB stands for Database.

[0109] Therefore, in the following description, we will mainly describe the magnification calculation unit 212, the parameter management unit 216, the worker DB 218, and the environment DB 220, and omit a detailed description of other components of the display control device 200 according to the second embodiment of the present invention.

[0110] (Worker DB218) Figure 8 shows an example of the configuration of the worker database 218. As shown in Figure 8, the worker database 218 is configured by associating worker IDs with worker characteristics.

[0111] Here, we primarily assume that worker characteristics are divided into worker characteristics for each of several items (hereinafter also referred to as "item-specific worker characteristics"), and that item-specific worker characteristics are mainly the worker's eyesight, worker's height, worker's proficiency in the work, and worker's personality. However, worker characteristics may consist of one or more combinations of such item-specific worker characteristics. Alternatively, worker characteristics may consist of item-specific worker characteristics different from these item-specific worker characteristics.

[0112] Furthermore, it can be assumed that the more times a worker performs a task, the higher their proficiency in that task will be. Therefore, the number of times a worker has performed a task may be used as an indicator of their proficiency. In addition, the personality of a worker may be classified using a personality trait classification method known as the Big Five.

[0113] (Environment DB220) Figure 9 shows an example of the configuration of the environment DB220. As shown in Figure 9, the environment DB220 is configured by associating environment IDs with environment characteristics.

[0114] Here, we primarily assume that the environmental characteristics are divided into environmental characteristics for each of several items (hereinafter also referred to as "item-specific environmental characteristics"), and that the item-specific environmental characteristics are the size of the workbench where the work is performed (depth, width, height) and the height of screen 122. However, the environmental characteristics may have one or more combinations of such item-specific environmental characteristics. Alternatively, the environmental characteristics may have item-specific environmental characteristics different from these item-specific environmental characteristics.

[0115] Note that the height of the workbench may be the height of the workbench from the floor. Similarly, the height of screen 122 may be the height of screen 122 from the floor. The size of the workbench may be expressed numerically, such as the size of the workbench corresponding to environment ID "00001". Alternatively, the size of the workbench may be expressed by information indicating the size classification (e.g., an alphabet), such as the sizes of the workbenches corresponding to environment IDs "00002" and "00003".

[0116] (Parameter management unit 216) The parameter management unit 216 obtains worker characteristics corresponding to the worker ID obtained by the worker ID acquisition unit 204 from the worker DB 218. These worker characteristics may be included in the scaling factor determination parameters described above. The parameter management unit 216 also obtains environmental characteristics corresponding to the environment ID obtained by the environment ID acquisition unit 206 from the environment DB 220. These environmental characteristics may be included in the scaling factor determination parameters described above.

[0117] (Magnification calculation unit 212) The magnification calculation unit 212 may determine the initial value M0 of the magnification of the magnified image g20 based on the worker characteristics. For example, if the magnification calculation unit 212 has prior correspondence information that associates worker characteristics with the initial value M0 of the magnification, it may obtain the initial value M0 of the magnification corresponding to the worker characteristics from said correspondence information.

[0118] Alternatively, the magnification calculation unit 212 may determine the rate of change Ra, which is the ratio of the change in the magnification ratio M to the change in the screen viewpoint distance Dp, based on the worker characteristics. For example, if the parameter management unit 216 has correspondence information in which worker characteristics and the rate of change Ra are associated, it may obtain the rate of change Ra corresponding to the worker characteristics from said correspondence information.

[0119] The rate of change Ra may be constructed by a combination of the distance interval d and the magnification interval m, as described above. For example, increasing the rate of change Ra may be achieved by decreasing the distance interval d. Alternatively, increasing the rate of change Ra may be achieved by increasing the magnification interval m.

[0120] For example, the lower the worker's visual acuity, the larger the initial value of the magnification M0 or the rate of change Ra may be. This makes it easier for workers with poor visual acuity to view the magnified image g20, and is expected to reduce work errors caused by such workers.

[0121] Alternatively, the greater the difference between the worker's height and the height of the screen 122, the larger the initial value M0 or the rate of change Ra of the magnification can be. This makes it easier for workers whose viewing position is far from the screen 122 to see the magnified image g20, and is expected to reduce work errors caused by workers with a large difference between the height of the screen 122 and their own height.

[0122] Alternatively, the lower the worker's skill level, the larger the initial value of the magnification (M0) or the rate of change (Ra). This makes it easier for less skilled workers to examine the magnified image g20, which is expected to reduce errors caused by less skilled workers. Alternatively, the higher the worker's skill level, the larger the initial value of the magnification (M0) or the rate of change (Ra). This may reduce the possibility of errors caused by highly skilled workers not examining the magnified image g20 in detail.

[0123] Alternatively, if the worker has an impatient personality, the initial value M0 of the magnification or the rate of change Ra may be larger than if the worker has a relaxed personality. This can be expected to result in the display of the magnified image g20 being matched to both impatient workers who want to quickly check the magnified image g20 and relaxed workers who want to carefully check the magnified image g20.

[0124] The magnification calculation unit 212 may determine the initial value M0 of the magnification of the magnified image g20 based on the environmental characteristics. For example, if the parameter management unit 216 has previously stored correspondence information that associates environmental characteristics with the initial value M0 of the magnification, it may obtain the initial value M0 of the magnification corresponding to the environmental characteristics from that correspondence information.

[0125] Alternatively, the magnification calculation unit 212 may determine a rate of change Ra, which is the ratio of the change in the magnification ratio M to the change in the distance between screen viewpoints Dp, based on the environmental characteristics. For example, if the parameter management unit 216 has previously stored correspondence information where environmental characteristics and the rate of change Ra are associated, it may obtain the rate of change Ra corresponding to the environmental characteristics from said correspondence information.

[0126] For example, if the screen 122 is located at the back of the workbench from the worker's perspective, the greater the depth of the workbench, the greater the distance between the screen 122 and the worker. Therefore, the initial value M0 of the magnification or the rate of change Ra can be large. This makes it easier for the worker to see the magnified image g20, even in environments where the distance between the screen 122 and the worker is large and it is difficult for the worker to see the screen 122, and is expected to reduce the number of work errors made by the worker.

[0127] Alternatively, if the screen 122 is located to the side (left or right) of the workbench from the worker's perspective, the wider the workbench, the greater the distance between the screen 122 and the worker. In this case, the initial value M0 of the magnification or the rate of change Ra may be large. This makes it easier for the worker to view the magnified image g20, even in environments where the distance between the screen 122 and the worker is large and it is difficult for the worker to see the screen 122, and is expected to reduce worker errors.

[0128] Alternatively, the greater the difference between the height of screen 122 and the worker's height, the larger the initial value M0 or the rate of change Ra of the magnification can be. This makes it easier for workers whose viewing position is far from screen 122 to view the magnified image g20, and is expected to reduce work errors caused by workers with a large difference between the height of screen 122 and their own height.

[0129] In this case, if the height of the workbench is greater than the worker's height, it is assumed that the higher the workbench, the greater the worker will have to stretch. Therefore, if the height of the workbench is greater than the worker's height, the worker's height may be adjusted to be greater as the workbench is higher. Alternatively, if the height of the workbench is lower than the worker's height, it is assumed that the lower the workbench, the greater the worker will have to bend down. Therefore, if the height of the workbench is lower than the worker's height, the worker's height may be adjusted to be smaller as the workbench is lower.

[0130] Although not shown in Figure 9, the environmental characteristics for each item may include the brightness around the workbench. In this case, the lower the brightness around the workbench, the larger the initial value of the magnification M0 or the rate of change Ra may be. This makes it easier for the worker to see the magnified image g20 even when the area around the workbench is dark and the contents displayed on screen 122 are difficult to see, and is expected to reduce worker errors.

[0131] The above describes an example of the configuration of the display control system 2 according to the second embodiment of the present invention.

[0132] (2-2. Operation of the display control system) Referring to Figure 10 (and Figures 7 to 9 as appropriate), an example of the operation of the display control system 2 according to the second embodiment of the present invention will be described.

[0133] Figure 10 is a flowchart showing an example of operation of the display control system 2 according to a second embodiment of the present invention.

[0134] The operation of the display control system 2 according to the second embodiment of the present invention is similar to that of the display control system 1 according to the first embodiment of the present invention, with the addition of S201 and S203, while other operations are the same. Therefore, S201 and S203 will be described below in detail.

[0135] As shown in Figure 10, when S100 is executed, the worker holds their work ID card over the worker ID acquisition unit 204 to allow the worker ID acquisition unit 204 to read their work ID. The worker also holds their environment ID card over the environment ID acquisition unit 206 to allow the environment ID acquisition unit 206 to read their environment ID. As described above, the worker ID acquisition unit 204 and the environment ID acquisition unit 206 may be different devices or the same device.

[0136] The worker ID acquisition unit 204 acquires the worker ID, and the environment ID acquisition unit 206 acquires the environment ID (S201).

[0137] The parameter management unit 216 retrieves worker characteristics corresponding to the worker ID acquired by the worker ID acquisition unit 204 from the worker DB 218. The parameter management unit 216 also retrieves environmental characteristics corresponding to the environment ID acquired by the environment ID acquisition unit 206 from the environment DB 220. Then, the scaling factor calculation unit 212 adjusts the parameters (S203).

[0138] For example, the magnification calculation unit 212 may determine an initial value M0 of the magnification of the magnified image g20 based on the operator characteristics. Alternatively, the magnification calculation unit 212 may determine a change rate Ra, which is the ratio of the change in the magnification M to the change in the distance Dp between screen viewpoints, based on the operator characteristics.

[0139] Alternatively, the magnification calculation unit 212 may determine an initial value M0 of the magnification of the magnified image g20 based on environmental characteristics. Alternatively, the magnification calculation unit 212 may determine a rate of change Ra, which is the ratio of the change in the magnification M to the change in the distance Dp between screen viewpoints, based on environmental characteristics.

[0140] When S203 is executed, S102 to S112 are executed by the display control system 2 according to the second embodiment of the present invention, similar to S102 to S112 executed by the display control system 1 according to the first embodiment of the present invention.

[0141] The above describes an example of the operation of the display control system 2 according to the second embodiment of the present invention.

[0142] (2-3. Effects of the second embodiment) According to a second embodiment of the present invention, similar effects to those achieved by the first embodiment can be obtained. Furthermore, according to the second embodiment of the present invention, parameters can be adjusted based on operator characteristics or environmental characteristics. Parameters may include an initial value M0 of the magnification ratio of the magnified image g20, or a rate of change Ra which is the ratio of the change in the magnification ratio M to the change in the screen-to-viewpoint distance Dp. With such a configuration, more individually optimized magnified display can be achieved.

[0143] The second embodiment of the present invention has been described above.

[0144] (3. Hardware Configuration Example) Next, an example of the hardware configuration of the display control device 100 according to the first embodiment of the present invention will be described. Note that the hardware configuration of each of the display control devices 200 according to the second embodiment of the present invention may be implemented in the same manner as the hardware configuration of the display control device 100 according to the first embodiment of the present invention.

[0145] In the following, an example of the hardware configuration of the information processing device 900 will be described as an example of the hardware configuration of the display control device 100 according to the first embodiment of the present invention. Note that the example of the hardware configuration of the information processing device 900 described below is merely one example of the hardware configuration of the display control device 100. Therefore, the hardware configuration of the display control device 100 may be modified by removing unnecessary components from the hardware configuration of the information processing device 900 described below, or new components may be added.

[0146] Figure 11 shows the hardware configuration of an information processing device 900 as an example of a display control device 100 according to the first embodiment of the present invention. The information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a host bus 904, a bridge 905, an external bus 906, an interface 907, an input device 908, an output device 909, a storage device 910, and a communication device 911.

[0147] The CPU 901 functions as both an arithmetic processing unit and a control unit, controlling the overall operation of the information processing unit 900 according to various programs. The CPU 901 may also be a microprocessor. The ROM 902 stores programs and arithmetic parameters used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that change as needed during its execution. These are interconnected by a host bus 904, which consists of a CPU bus and other components.

[0148] The host bus 904 is connected to an external bus 906, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 905. It is not always necessary to configure the host bus 904, bridge 905, and external bus 906 separately; these functions may be implemented on a single bus.

[0149] The input device 908 consists of input means for the user to input information, such as a mouse, keyboard, touch panel, buttons, microphone, switches, and levers, and an input control circuit that generates input signals based on the user's input and outputs them to the CPU 901. The user operating the information processing device 900 can input various types of data to the information processing device 900 or instruct it to perform processing operations by operating this input device 908.

[0150] The output device 909 includes, for example, display devices such as CRT (Cathode Ray Tube) display devices, liquid crystal display (LCD) devices, OLED (Organic Light Emitting Diode) devices, lamps, and audio output devices such as speakers.

[0151] The storage device 910 is a device for storing data. The storage device 910 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, and a deletion device for deleting data recorded on the storage medium. The storage device 910 is composed of, for example, an HDD (Hard Disk Drive). This storage device 910 drives the hard disk and stores programs executed by the CPU 901 and various data.

[0152] The communication device 911 is a communication interface composed of, for example, a communication device for connecting to a network. The communication device 911 may support either wireless or wired communication.

[0153] The hardware configuration example of the display control device 100 according to the first embodiment of the present invention has been described above.

[0154] (4. Supplement) Although preferred embodiments of the present invention have been described in detail above with reference to the attached drawings, the present invention is not limited to these examples. It is clear to any person with ordinary skill in the art to which the present invention belongs that various modifications or alterations can be conceived within the scope of the technical idea described in the claims, and these are also understood to fall within the technical scope of the present invention.

[0155] For example, in the first and second embodiments of the present invention, it was mainly assumed that the gaze sensor unit 102 is configured to include an infrared LED and an infrared sensor. However, the gaze sensor unit 102 may be implemented by a visible light camera. For example, the visible light camera may be a webcam. A visible light camera is less expensive than a combination of an infrared LED and an infrared sensor. Therefore, the second embodiment of the present invention can be constructed at a lower cost compared to the first embodiment of the present invention, in which the gaze sensor unit 102 including an infrared LED and an infrared sensor is used.

[0156] Furthermore, known technologies can be used for detecting gaze directions using a visible light camera. For example, gaze detection using a visible light camera can be achieved by extracting features around the eyes based on image data captured by the visible light camera, and then detecting the relative angle of the gaze, based on the direction from the worker's eyes to the visible light camera, based on these features around the eyes.

[0157] Furthermore, in the first and second embodiments of the present invention, it was primarily assumed that the display unit 120 is implemented by a desktop display or a tablet terminal. However, the display unit 120 may be implemented by other forms of displays. For example, the display unit 120 may be implemented by a projector that projects an image and a screen on which the image is projected.

[0158] Furthermore, in the second embodiment of the present invention, the case in which the worker ID acquisition unit 204 is implemented by a reader device that reads the worker ID from a worker ID card was mainly described. Similarly, the case in which the environment ID acquisition unit 206 is implemented by a reader device that reads the environment ID from an environment ID card was mainly described. However, the methods for implementing the worker ID acquisition unit 204 and the environment ID acquisition unit 206 are not limited to these examples.

[0159] For example, the worker ID acquisition unit 204 may be implemented by an input device (e.g., a touch panel) into which the worker ID is manually entered by the worker. Similarly, the environment ID acquisition unit 206 may be implemented by an input device into which the environment ID is manually entered by the worker. Furthermore, the worker ID acquisition unit 204 may acquire the worker's biometric information as the worker ID. [Explanation of symbols]

[0160] 1,2 Display control system 100 Display control device 102 Eye-gaze sensor unit 106 Data Processing Unit 108, 208 Enlarged Control Unit 110 Magnification display start determination unit 112, 212 Magnification Calculation Unit 114 Display Control Unit 120 Display section 122 screens 204 Worker ID acquisition section 206 Environment ID acquisition section 216 Parameter Management Unit 218 Worker Database 220 Environment DB

Claims

1. A gaze position detection unit that detects a first gaze position in a first image by the user based on the user's viewpoint position, An enlarged image generation unit generates a second image by enlarging the region of the first image based on the region corresponding to the first gaze position of the first image, A display control unit controls the display unit so that the second image and the first image are displayed by the display unit, A display control device equipped with the following features.

2. The aforementioned display control device is The system includes a zoom start operation detection unit that detects a predetermined zoom start operation performed by the user, The display control unit controls the display unit so that the display of the second image is started based on the detection of the zoom start operation. The display control device according to claim 1.

3. The gaze position detection unit detects the second gaze position by the user before detecting the first gaze position. The magnification start operation detection unit detects that the second gaze position is within a pre-set magnification start determination area as the magnification start operation. The display control device according to claim 2.

4. The display control unit controls the display unit to start displaying the first image before the detection of the zoom start operation, and controls the display unit to continue displaying the first image after the detection of the zoom start operation. The display control device according to claim 2.

5. The enlarged image generation unit determines the magnification ratio of the second image relative to the region based on a predetermined magnification ratio determination parameter, and generates the second image by enlarging the region based on the magnification ratio. The display control device according to claim 1.

6. The aforementioned scaling factor determination parameters include user characteristics or environmental characteristics. The display control device according to claim 5.

7. The display unit includes a screen that displays the first image and the second image, The magnified image generation unit changes the magnification ratio based on the amount of change in the distance between the screen and the user's viewpoint. The display control device according to claim 5.

8. The magnified image generation unit determines the amount of change in the magnification ratio based on the amount of change in the distance and the ratio of the amount of change in the magnification ratio to the amount of change in the distance, and changes the magnification ratio based on the amount of change in the magnification ratio. The display control device according to claim 7.

9. The aforementioned ratio is comprised of a combination of the interval of the distance that changes the magnification ratio and the interval at which the magnification ratio changes when the distance changes by the aforementioned interval. The display control device according to claim 8.

10. The enlarged image generation unit determines the ratio based on user characteristics or environmental characteristics. The display control device according to claim 8.

11. Based on the user's viewpoint position, a first gaze position in the first image by the user is detected, Based on the region corresponding to the first gaze position of the first image, a second image is generated in which the region is enlarged. Controlling the display unit so that the second image and the first image are displayed by the display unit, A computer-based display control method, including [a specific method].

12. Computers, A gaze position detection unit that detects a first gaze position in a first image by the user based on the user's viewpoint position, An enlarged image generation unit generates a second image by enlarging the region of the first image based on the region corresponding to the first gaze position of the first image, A display control unit controls the display unit so that the second image and the first image are displayed by the display unit, A program that makes it function as such.

Images