Display processing device, training system, and display processing method

Abstract

To enable the visual recognition of a monitoring object to be appropriately prompted.SOLUTION: Provided is a display processing device for executing display processing regarding a machine operated on the basis of a plurality of monitoring objects, the device comprising: a display unit for displaying an image to an operator; a gaze detector for detecting the viewpoint position of the operator in the image; and a control unit for executing display processing on the image, on the basis of the viewpoint position in the image having been detected by the gaze detector. The image includes a target region that is a display region for the monitoring objects included in the machine. When it is assumed that the display region in the image that includes the viewpoint position is a visible region, the control unit executes display processing on the target region included in a non-visible region which is other than the visible region.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present disclosure relates to a display processing device, a training system, and a display processing method. [Background technology]

[0002] Conventionally, a driving information processing device that executes information processing for driving a vehicle is known (for example, see Patent Document 1). The driving information processing device includes a gaze detection device that detects the gaze of the driver of the vehicle, and when the driver gazes at a specific range, notifies a notification unit installed in a part other than the vehicle of information related to driving. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-124892 A Summary of the Invention [Problem to be solved by the invention]

[0004] In a training system using a simulator for training the operation of transportation machinery such as a vehicle, an operator operates the transportation machinery while visually checking multiple monitored objects. In Patent Document 1, information related to driving is notified to a notification unit installed in a part other than the vehicle, so when the operator checks the notification, the operator may miss the monitored objects or may have a burden in understanding the notification content. In addition, it is difficult to know whether the operator is properly visually checking the multiple monitored objects.

[0005] Therefore, an object of the present disclosure is to provide a display processing device, a training system, and a display processing method that can appropriately encourage viewing of monitored objects. [Means for solving the problem]

[0006] The display processing device of the present disclosure is a display processing device that performs display processing for a machine operated based on a plurality of monitored objects, and includes a display unit that displays an image to an operator, a gaze detection device that detects the viewpoint position of the operator on the image, and a control unit that performs display processing on the image based on the viewpoint position on the image detected by the gaze detection device, wherein the image includes a target area that is a display area for the monitored objects included in the machine, and the control unit performs display processing on the target area included in a non-visual area, which is an area other than the visible area, when the display area on the image including the viewpoint position is considered to be a visible area.

[0007] The training system of the present disclosure includes the above-mentioned display processing device and a simulator that simulates the operation of the machine including a plurality of the monitored objects.

[0008] The display processing method disclosed herein is a display processing method for causing a display processing device having a display unit that displays an image to an operator to execute display processing related to a machine that is operated based on a number of monitored objects, the display processing method comprising the steps of: detecting the viewpoint position of the operator on the image; and executing display processing on the image based on the detected viewpoint position on the image, wherein the image includes a target area that is a display area for the monitored objects included in the machine, and in the step of executing display processing, when the display area on the image that includes the viewpoint position is defined as a visible area, display processing is executed on the target area included in a non-visual area that is an area other than the visible area. Effect of the Invention

[0009] According to the present disclosure, it is possible to appropriately encourage viewing of a monitored object. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic configuration diagram showing a training system according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram of the training system according to the first embodiment. [Diagram 3] FIG. 3 is a diagram showing an image displayed on the display unit. [Figure 4] FIG. 4 is a diagram showing an image when the highlighting process is executed. [Diagram 5] FIG. 5 is a diagram showing an image when the highlighting process is not executed. [Figure 6] FIG. 6 is a flowchart of an example of a display processing method according to the first embodiment. [Figure 7] FIG. 7 is a flowchart of another example of the display processing method according to the first embodiment. [Figure 8] FIG. 8 is a diagram showing an example of an image when the highlighting process is executed. [Figure 9] FIG. 9 is a diagram showing another example of an image when the highlighting process is executed. [Figure 10] FIG. 10 is a diagram showing an image displayed on a display unit in the training system according to the second embodiment. [Figure 11] FIG. 11 is a flowchart of an example of a display processing method according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings. Note that the present invention is not limited to these embodiments. In addition, the components in the following embodiments include those that are easily replaceable by those skilled in the art, or those that are substantially the same. Furthermore, the components described below can be appropriately combined, and when there are multiple embodiments, the respective embodiments can be combined.

[0012] [Embodiment 1] The training system 1 according to the first embodiment is a device for training an operator to operate a machine, and is also a device for simulating the operation of the machine according to the operation of the machine. The machine is a machine operated based on a plurality of monitored objects, and for example, a transport machine such as a vehicle or an aircraft, or a facility consisting of a plurality of devices, is applied. Note that the machine is not particularly limited as long as it is a machine operated based on a plurality of monitored objects. In the first embodiment, the training system 1 is described as being used for training an aircraft. In addition, the plurality of monitored objects in an aircraft may be, for example, instruments inside the aircraft or buildings outside the aircraft. This training system 1 is a system in which a simulator for simulating the operation of an aircraft and a display processing device for processing a display unit for displaying to an operator are integrated.

[0013] FIG. 1 is a schematic diagram showing a configuration of a training system according to the first embodiment. FIG. 2 is a block diagram of the training system according to the first embodiment. FIG. 3 is a diagram showing an image displayed on a display unit. FIG. 4 is a diagram showing an image when highlighting processing is executed. FIG. 5 is a diagram showing an image when highlighting processing is not executed. FIG. 6 is a flowchart of an example of a display processing method according to the first embodiment. FIG. 7 is a flowchart of another example of a display processing method according to the first embodiment.

[0014] (Simulator) 1 and 2, the training system 1 includes a head mounted display (HDM: hereinafter simply referred to as a display) 11 functioning as a display unit, a gaze detection device 12, a control device 13, and a control device 15. The display 11, the gaze detection device 12, and the control device 15 function as a display processing device.

[0015] The display 11 is a device that displays an image to an operator. As an image to be displayed, the display 11 displays, for example, an image 20 that displays an in-aircraft object O1 that is a monitoring target inside the aircraft and an outside-aircraft object O2 that is a monitoring target outside the aircraft, as shown in FIG. 3. That is, the image 20 includes a display area that displays the in-aircraft object O1 and a display area that displays the outside-aircraft object O2. The in-aircraft object O1 is, for example, an aircraft frame, a plurality of instruments, a window, a window frame, etc. The outside-aircraft object O2 is, for example, a building, etc. As shown in FIG. 3, the image 20 includes a plurality of target areas E1 that are display areas that simulate a plurality of instruments that are the in-aircraft object O1. Examples of the instruments that correspond to the plurality of target areas E1 include an A / S (airspeed indicator), an A / I (attitude indicator), an ALT (altimeter), a T / B (climb indicator), a D / G (directional indicator), a V / S (inclinometer), and an RPM (engine revolutions per minute). The display process, which will be described later, is performed on the display area displaying the inside-aircraft object O1, but is not performed on the display area displaying the outside-aircraft object O2.

[0016] In addition, since the display 11 is a head-mounted display, it detects the posture and position of the display 11 (the operator wearing the display). The display 11 is connected to the control device 15, and outputs information relating to the posture and position to the control device 15. The display 11 is also under the display control of the control device 15, and displays an image 20 that has been subjected to display processing.

[0017] The gaze detection device 12 is a device that detects the gaze of the operator, and for example, an eye tracker, a camera, or other device is used. The gaze detection device 12 detects the viewpoint position P of the operator on the display 11. The gaze detection device 12 is connected to the control device 15, and outputs information related to the viewpoint position P on the display 11 obtained by gaze detection to the control device 15. In addition, since the gaze detection device 12 detects the viewpoint position P at a predetermined sampling period and outputs it to the control device 15, as shown by the solid lines in Figs. 4 and 5, the control device 15 can acquire the acquired multiple viewpoint positions P as a history (movement history) related to the movement of the viewpoint position P.

[0018] The control device 13 is a device that acquires an operation input from an operator. The control device 13 is connected to the control device 15, and outputs information related to the operation input to the control device 15.

[0019] The control device 15 simulates the operation of an aircraft, detects operations by an operator, and controls the display on the display 11. The control device 15 has a control unit 25 and a storage unit .

[0020] The storage unit 26 includes any storage device, such as a semiconductor storage device and a magnetic storage device. The storage unit 26 is used as a working area for temporarily storing the processing results of the control unit 25, and stores various programs and various data. The storage unit 26 stores, for example, various programs such as a program for simulating the operation of an aircraft, a program for controlling the display of the display 11, a program for performing gaze detection, and a program for performing operation detection. The storage unit 26 also stores, as various data, information on the viewpoint position P detected by the gaze detection device 12, information on a required gaze ratio, which is information used in the display processing described later, and the like.

[0021] The control unit 25 includes an integrated circuit such as a CPU (Central Processing Unit). Specifically, the control unit 25 realizes various functions by executing instructions included in a program stored in the storage unit 26. The control unit 25 executes a program for controlling the display of the display 11, thereby performing display processing for the image 20 displayed on the display 11, for example.

[0022] Here, in the first embodiment, the display process shown in Fig. 4 and Fig. 5 is executed as the display process. If the display area on the image 20 including the viewpoint position P is defined as the visual recognition area E2, the display process of the first embodiment is executed for the target area E1 included in the non-visual recognition area, which is an area other than the visual recognition area E2. Specifically, the display process of the first embodiment is executed when a predetermined training event is executed, and a gaze area E3 that is the target area E1 that the operator is required to gaze at is set in association with the training event. In the display process shown in Fig. 4 and Fig. 5, the target area E1 corresponding to the A / S (airspeed indicator), the A / I (attitude indicator), the ALT (altimeter), the T / B (climb indicator), the D / G (heading indicator), and the V / S (inclinometer) is set as the gaze area E3. Note that the gaze area E3 is not particularly limited to the above-mentioned target area E1, and may be any display area as long as it is a display area that displays a structure that constitutes an aircraft. Furthermore, the visual recognition area E2 need only be a display area that includes at least the viewpoint position P, and may be a display area as a point corresponding to the viewpoint position P, or may be a circular display area centered on the viewpoint position P.

[0023] As shown in Fig. 4, the control unit 25 of the control device 15 determines whether or not the visual recognition area E2 and the gaze area E3 overlap in the image 20 including the gaze area E3, and if it determines that they do not overlap, executes a highlighting process to highlight the non-overlapping gaze area E3 as a display process. As an example of the highlighting process shown in Fig. 4, a lighting display is used to light up the periphery of the gaze area E3. The highlighting process is not particularly limited to a lighting display, and may be a blinking display or an enlarged display.

[0024] On the other hand, as shown in FIG. 5, the control unit 25 of the control device 15 determines whether or not the visual recognition area E2 and the gaze area E3 overlap in an image 20 including the gaze area E3, and if it determines that they overlap, does not execute the highlighting process.

[0025] (Display processing method) Next, an example of a display processing method executed in the training system 1 will be described with reference to FIG. 6. The display processing method shown in FIG. 6 is executed in a plurality of gaze areas E3. The display processing method is executed when a predetermined training event is started by the training system 1 (step S1). After executing step S1, the control unit 25 detects the operator's viewpoint position P by the line of sight detection device 12 and acquires a visual recognition area E2 including the viewpoint position P (step S2). Then, the control unit 25 executes steps S3 to S5 of executing a display process on the image 20 based on the visual recognition area E2 on the image 20. That is, the control unit 25 determines whether or not the acquired visual recognition area E2 overlaps with the set visual recognition area E3 to determine whether or not there is gaze (step S3). When the control unit 25 determines that the visual recognition area E2 and the visual recognition area E3 overlap, it determines that there is gaze (step S3: Yes) and stops the execution of the highlighting process for the visual recognition area E3 (step S4). On the other hand, when the control unit 25 determines that the visual recognition area E2 and the gaze area E3 do not overlap, it executes a highlighting process for the gaze area E3 as no gaze (step S3: No). The overlap determination between the visual recognition area E2 and the gaze area E3 in step S3 may include the gaze time as a parameter. That is, in step S3, the control unit 25 determines that the visual recognition area E2 and the gaze area E3 do not overlap when they overlap and the gaze time is equal to or less than a predetermined threshold. On the other hand, in step S3, the control unit 25 may determine that the visual recognition area E2 and the gaze area E3 overlap and the gaze time is longer than a predetermined threshold. After executing step S4 or step S5, the control unit 25 determines whether the training event has ended (step S6). When the control unit 25 determines that the training event has ended (step S6: Yes), it ends a series of controls related to the display process. On the other hand, if the control unit 25 determines that the training event has not ended (step S6: No), the control unit 25 again proceeds to step S2 and executes control related to the display process until the training event ends.

[0026] Next, referring to FIG. 7, another example of the display processing method executed in the training system 1 will be described. In the display processing method shown in FIG. 7, the presence or absence of gaze in step S3 is determined using a gaze ratio. The gaze ratio is the ratio of gaze time in a predetermined period. The predetermined period is the period between the current time and a time t seconds before the current time. The gaze time is the time during which the visual recognition area E2 and the gaze area E3 overlap, and is an accumulated time in the predetermined period t. In the display processing method of FIG. 7, an actual gaze ratio P and a required gaze ratio Pref are used as the gaze ratio. The actual gaze ratio P is a numerical value calculated from the visual recognition area E2 based on the viewpoint position P detected by the gaze detection device 12. The required gaze ratio Pref is a numerical value required in advance for each of the gaze areas E3 in a predetermined training event. The required gaze ratio Pref is stored in advance in the storage unit 26.

[0027] The display processing method shown in Fig. 7 is executed by starting a predetermined training event by the training system 1, similarly to the display processing method of Fig. 6 (step S1). After executing step S1, the control unit 25 detects the operator's viewpoint position P by the gaze detection device 12, and acquires a visual recognition area E2 including the viewpoint position P (step S2). Then, the control unit 25 executes steps S3a to S3c for executing display processing on the image 20 based on the visual recognition area E2 on the image 20, and thereafter executes steps S4 to S6 similarly to the display processing method of Fig. 6.

[0028] Specifically, the control unit 25 determines whether the acquired visual recognition area E2 overlaps with the set gaze area E3, and if so, counts it as gaze time (step S3a). In addition, in step S3a, the control unit 25 calculates an actual gaze ratio P, which is a ratio of gaze time to a predetermined period t. Thereafter, the control unit 25 acquires a required gaze ratio Pref from the storage unit 26 (step S3b). Then, the control unit 25 compares the calculated actual gaze ratio P with the acquired required gaze ratio Pref to determine whether or not gaze is present (step S3c). That is, in step S3c, the control unit 25 determines whether or not the actual gaze ratio P is greater than the required gaze ratio Pref. If the control unit 25 determines that the actual gaze ratio P is greater than the required gaze ratio Pref, it determines that gaze is present (step S3c: Yes) and does not execute highlighting processing for the gaze area E3 (step S4). On the other hand, when the control unit 25 determines that the actual gaze ratio P is equal to or less than the required gaze ratio Pref, it determines that there is no gaze (step S3c: No) and stops the execution of the highlighting process for the gaze area E3 (step S5). After executing step S4 or step S5, the control unit 25 determines whether or not the training event has ended (step S6), similar to the display processing method of FIG. 6. When the control unit 25 determines that the training event has ended (step S6: Yes), it ends a series of controls related to the display processing. On the other hand, when the control unit 25 determines that the training event has not ended (step S6: No), it proceeds to step S2 again and executes control related to the display processing until the training event ends.

[0029] The above-mentioned highlighting process is an example, and the highlighting process is not particularly limited to the above-mentioned process. For example, the control unit 25 may execute the highlighting process shown in Fig. 8 and Fig. 9 as the highlighting process. Fig. 8 is a diagram showing an example of an image when the highlighting process is executed. Fig. 9 is a diagram showing another example of an image when the highlighting process is executed.

[0030] Fig. 8 shows an image 20 in which a required gaze ratio Pref corresponding to a predetermined gaze area E3 becomes larger due to a change in training event. Specifically, Fig. 8 shows a case in which a required gaze ratio Pref corresponding to the gaze area E3 of the A / I (attitude indicator) becomes larger before and after a change in training event, and in this case, the control unit 25 executes highlighting processing for the gaze area E3 of the A / I (attitude indicator) based on the display processing method shown in Fig. 7.

[0031] 9, the highlighting display mode in the highlighting process is an enlarged display. That is, the control unit 25 may execute the enlarged display so that the gaze area E3 that is the target of the highlighting process becomes a larger display area.

[0032] In addition, in the highlighting process of the first embodiment, the control unit 25 may change the intensity of the highlighting based on the actual gaze ratio P. That is, in the highlighting process, when the actual gaze ratio P is significantly smaller than the required gaze ratio Pref, the brightness of the lighting display may be brightened, and as it approaches the required gaze ratio Pref, the brightness may be darkened. In addition, the control unit 25 may change the intensity of the highlighting according to the length of the non-gazing time (the time during which the visual recognition area E2 and the gaze area E3 do not overlap) in addition to the actual gaze ratio P. Furthermore, the control unit 25 may change the intensity of the highlighting according to the time during which the actual gaze ratio P is smaller than a predetermined threshold value.

[0033] In the first embodiment, the target area E1 corresponding to a plurality of instruments is set as the gaze area E3, but the gaze area E3 to be set may be any display area as long as it is an in-flight object O1. For example, when requesting an outside gaze as the gaze area E3, the control unit 25 may perform a process of highlighting a window or a window frame as the in-flight object O1.

[0034] Furthermore, the control unit 25 may store a history of the execution of the display process as history data in the storage unit 26, and perform evaluation using the history data.

[0035] [Embodiment 2] Next, a second embodiment will be described with reference to Fig. 10 and Fig. 11. In the second embodiment, in order to avoid repetitive description, only parts different from the first embodiment will be described, and parts having the same configuration as the first embodiment will be described with the same reference numerals. Fig. 10 is a diagram showing an image displayed on a display unit in a training system according to the second embodiment. Fig. 11 is a flowchart of an example of a display processing method according to the second embodiment.

[0036] In the second embodiment, as shown in FIG. 10, the control unit 25 executes a mask display process to hide the non-visual area E5 as a display process. The non-visual area E5 is an area other than the visual area E2. That is, the control unit 25 determines whether the visual area E2 overlaps on the image 20, and when it determines that the visual area E2 does not overlap, that is, it is the non-visual area E5, executes a mask display process to hide the non-visual area E5 as a display process. As an example of the mask display process shown in FIG. 10, a blurred display is performed to blur the non-visual area E5. The mask display is not particularly limited to a blurred display, and may be any display process as long as it hides the non-visual area E5.

[0037] (Display processing method) Next, an example of a display processing method according to the second embodiment executed in the training system 1 will be described with reference to Fig. 11. The display processing method shown in Fig. 11 is obtained by replacing steps S3 to S5 of the display processing method shown in Fig. 6 with steps S13 to S15. Steps S13 to S15 will be described below.

[0038] When the control unit 25 acquires the visual recognition area E2 in step S2, the control unit 25 determines whether or not the visual recognition area E2 overlaps on the image 20 (step S13). If the control unit 25 determines that the visual recognition area E2 overlaps with the image 20 (step S13: Yes), the control unit 25 stops the execution of the blurring process on the visual recognition area E2 (step S14). On the other hand, if the control unit 25 determines that the visual recognition area E2 does not overlap with the image 20, that is, it is a non-visual recognition area E5 (step S13: No), the control unit 25 executes the blurring process on the non-visual recognition area E5 (step S15). Thereafter, the control unit 25 executes step S6 in FIG. 6 to end the series of controls.

[0039] As described above, the display processing device, the training system 1, and the display processing method described in this embodiment can be understood, for example, as follows.

[0040] The display processing device of the first embodiment is a display processing device that performs display processing related to a machine including a plurality of monitored objects, and includes a display unit (display 11) that displays an image 20 to an operator, a gaze detection device 12 that detects the operator's viewpoint position P on the image 20, and a control unit 25 that performs display processing on the image 20 based on the viewpoint position P on the image 20 detected by the gaze detection device 12, wherein the image 20 includes a target area E1 that is a display area for the monitored objects, and the control unit 25 performs display processing on the target area E1 included in a non-visual area E5 that is an area other than the visual area E2, assuming that the display area on the image 20 including the viewpoint position P is a visual area E2.

[0041] According to this configuration, by executing the display process on the target area E1 included in the non-visual area E5, it is possible to appropriately encourage the viewing of a monitored object that is not being watched.

[0042] In a second aspect, the image 20 includes a gaze area E3 which is the target area to which the operator is required to gaze, and when the control unit 25 determines that the visible area E2 and the gaze area E3 do not overlap, the control unit 25 executes a highlighting process as the display process to highlight the gaze area E3.

[0043] According to this configuration, when the gaze area E3, which requires attention, is not being gazed at, the gaze area E3 that is not being gazed at can be highlighted, thereby appropriately encouraging the viewer to look at the gaze area E3 that is not being gazed at.

[0044] As a third aspect, the control unit 25 acquires the time during which the visual recognition area E2 and the gaze area E3 overlap as the gaze time, and in the highlighting process uses an actual gaze ratio P, which is the proportion of the gaze time in a specified period, and a required gaze ratio Pref, which is required in advance for the gaze area E3.If the actual gaze ratio P becomes greater than the required gaze ratio Pref, the execution of the highlighting process is stopped, while if the actual gaze ratio P becomes equal to or less than the required gaze ratio Pref, the highlighting process is executed.

[0045] According to this configuration, it is possible to determine whether or not to execute the highlighting process based on the required gaze ratio and the actual gaze ratio, so that it is possible to appropriately determine whether or not gaze on the gaze area E3 has been performed appropriately.

[0046] As a fourth aspect, the control unit 25 changes the intensity of highlighting based on the actual gaze ratio P when executing the highlighting process.

[0047] According to this configuration, by changing the intensity of highlighting depending on the proportion of gaze time to the gaze area E3, it is possible to grasp the degree of gaze to the gaze area E3.

[0048] As a fifth aspect, the control unit 25 acquires the time during which the visual recognition area E2 and the gaze area E3 do not overlap as non-gaze time, and when executing the highlighting process, changes the intensity of the highlighting based on the non-gaze time.

[0049] According to this configuration, by changing the intensity of the highlighting depending on the length of the non-gazing time, it is possible to grasp the degree of gaze on the gaze area E3.

[0050] As a sixth aspect, the highlighting process is a display process including at least one of a lighting display, a blinking display, and an enlarged display.

[0051] According to this configuration, a display form suitable for the gaze area E3 can be achieved.

[0052] As a seventh aspect, the control unit 25 executes, as the display process, a mask display process for hiding the non-visual area E5.

[0053] According to this configuration, by hiding the non-visual area E5, it is possible to encourage viewing of the target area E1 included in the non-visual area E5.

[0054] A training system 1 according to an eighth embodiment includes the above-mentioned display processing device and a simulator that simulates the operation of the machine including a plurality of the monitored objects.

[0055] According to this configuration, the operator can be appropriately prompted to look at a monitored object that he or she is not focusing on, thereby enabling appropriate training.

[0056] A display processing method according to a ninth aspect is a display processing method for causing a display processing device having a display unit (display 11) that displays an image to an operator to execute display processing related to a machine including multiple monitored objects, the display processing method comprising: a step S2 of detecting the viewpoint position of the operator on the image 20; and steps S3 to S5, S13 to S15 of executing display processing on the image 20 based on the detected viewpoint position P on the image 20, wherein the image 20 includes a target area E1 which is a display area for the monitored objects, and in steps S3 to S5, S13 to S15 of executing the display processing, when the display area on the image 20 including the viewpoint position P is defined as a visible area E2, display processing is executed on the target area E1 which is included in a non-visual area E5 which is an area other than the visible area E2.

[0057] According to this configuration, by executing the display process on the target area E1 included in the non-visual area E5, it is possible to appropriately encourage the viewing of a monitored object that is not being watched. [Explanation of symbols]

[0058] 1. Training System 11 Display 12. Line of Sight Detection Device 13. Controls 15 Control device 20 images 25 Control Unit 26 Memory section E1 Target Area E2 visibility area E3 Gaze area E5 Blind Zone P Viewpoint position O1 In-flight Objects O2 External Objects

Claims

1. A display processing device that performs display processing related to a machine operated based on a plurality of monitored objects, a display unit that displays an image to an operator; a gaze detection device for detecting a gaze position of the operator on the image; a control unit that executes a display process on the image based on the viewpoint position on the image detected by the line-of-sight detection device, the image includes a region of interest that is a representation of the monitored object contained in the machine; The control unit is When the display area on the image including the viewpoint position is defined as a visual recognition area, a display process is performed on the target area included in a non-visual recognition area that is an area other than the visual recognition area, the image includes a gaze area that is the target area on which gaze by the operator is required, When the control unit determines that the visual recognition area and the gaze area do not overlap, the control unit executes, as the display process, an emphasis display process that emphasizes the gaze area.

2. The control unit is A time during which the visual recognition area and the gaze area overlap is acquired as a gaze time; In the highlighting process, an actual gaze ratio, which is a ratio of the gaze time in a predetermined period, and a required gaze ratio, which is previously required for the gaze area, are used, When the actual gaze ratio is greater than the required gaze ratio, the execution of the highlighting process is stopped, while The display processing device according to claim 1 , wherein the highlighting process is executed when the actual gaze ratio is equal to or smaller than the required gaze ratio.

3. The display processing device according to claim 2 , wherein the control unit, when executing the highlighting process, changes an intensity of highlighting based on the actual gaze ratio.

4. The control unit is A time during which the visual recognition area and the gaze area do not overlap is acquired as a non-gaze time; The display processing device according to claim 2 , wherein, when the highlighting process is executed, an intensity of the highlighting is changed based on the non-gazing time.

5. The display processing device according to claim 1 , wherein the highlighting process includes at least one of a lighting display, a blinking display, and an enlarged display.

6. The display processing device according to claim 1 , wherein the control unit executes, as the display process, a mask display process for hiding the non-visual area.

7. A display processing device that performs display processing related to a machine operated based on a plurality of monitored objects, a display unit that displays an image to an operator; a gaze detection device for detecting a gaze position of the operator on the image; a control unit that executes a display process on the image based on the viewpoint position on the image detected by the line-of-sight detection device, the image includes a region of interest that is a representation of the monitored object contained in the machine; The control unit is A display processing device that performs display processing on the target area included in a non-visual area, which is an area other than the visible area, when the display area on the image including the viewpoint position is considered to be a visible area, and performs a mask display processing to hide the non-visual area as the display processing.

8. A display processing device according to any one of claims 1 to 7, a simulator that simulates the operation of the machine including a plurality of the monitored objects.

9. A display processing method for causing a display processing device having a display unit that displays an image to an operator to execute display processing related to a machine operated based on a plurality of monitored objects, comprising: detecting a viewpoint position of the operator on the image; and executing a display process on the image based on the detected viewpoint position on the image, the image includes a region of interest that is a representation of the monitored object contained in the machine; In the step of executing the display process, When the display area on the image including the viewpoint position is defined as a visual recognition area, a display process is performed on the target area included in a non-visual recognition area that is an area other than the visual recognition area, the image includes a gaze area that is the target area on which gaze by the operator is required, In the step of executing the display process, a display processing method for executing, as the display processing, a highlighting process for highlighting the gaze area when it is determined that the visual recognition area and the gaze area do not overlap;

10. A display processing method for causing a display processing device having a display unit that displays an image to an operator to execute display processing related to a machine that is operated based on a plurality of monitored objects, comprising: detecting a viewpoint position of the operator on the image; and executing a display process on the image based on the detected viewpoint position on the image, the image includes a region of interest that is a representation of the monitored object contained in the machine; In the step of executing the display process, A display processing method in which, when the display area on the image including the viewpoint position is defined as a visible area, a display process is performed on the target area included in a non-visual area, which is an area other than the visible area, and as the display process, a mask display process is performed to hide the non-visual area.

Images