Information presentation device, program, and information presentation method
The information presentation device optimizes task allocation based on device and worker performance to reduce fatigue and maintain efficiency in outdoor monitoring scenarios.
Patent Information
- Application Number
- JP2024515186
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-04-11
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2042-04-11
AI Technical Summary
Conventional information presentation devices struggle to maintain optimal resource allocation between sensor data processing and worker visual information processing, leading to increased fatigue and decreased performance when monitoring objects in outdoor environments with varying weather conditions.
An information presentation device and method that includes data receiving, analysis, device performance estimation, task amount determination, and display content determination units to adjust the task load on monitoring workers based on device and worker performance, ensuring appropriate resource allocation.
This approach effectively reduces worker fatigue and maintains performance by optimizing task allocation according to device and worker capabilities, even in challenging outdoor conditions.
Smart Images

Figure 0007595809000001 
Figure 0007595809000002 
Figure 0007595809000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an information presentation device, a program, and an information presentation method. [Background technology]
[0002] Patent Document 1 discloses a plant monitoring device that presents the operating status of a plant to an operator. The plant monitoring device includes a section that measures the operator's biological information and a section that analyzes the operator's psychological state, and controls the content of the information presented according to the operator's state. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Patent No. 291237 Summary of the Invention [Problem to be solved by the invention]
[0004] The conventional technology is not only applicable to a plant monitoring device for monitoring a plant. For example, the technology can also be applied to an information display device for displaying the detection results of sensors to a monitoring worker, by arranging sensors to capture objects to be monitored that are moving within a specific space, for the purpose of discovering or confirming the objects to be monitored that are moving within the space.
[0005] However, when the space in which the monitored object moves is outdoors, the ability to process sensor data and detect the monitored object (hereinafter referred to as the sensor information processing resource of the information presentation device) and the ability to estimate associated information (hereinafter referred to as device performance) vary depending on the weather.
[0006] If the presented information is controlled based only on the work performance of the supervisor, when the supervisor's work performance is high, the supervisor's visual information processing resources may be excessively consumed even though the device performance is maintained at a high level. In such a case, the supervisor's fatigue level increases, and his / her performance deteriorates more quickly than necessary. As a result, when the device performance deteriorates due to weather changes, the sensor information processing resources of the information presentation device and the visual information processing resources of the supervisor may be insufficient.
[0007] Therefore, one or more aspects of the present disclosure aim to reduce the rate at which fatigue accumulates in a monitoring worker by appropriately allocating resources on the device side and resources of the monitoring worker. [Means for solving the problem]
[0008] An information presentation device according to one aspect of the present disclosure includes a data receiving unit that receives sensor data from a sensor that detects data for monitoring a monitoring object as sensor data, a data analysis unit that analyzes the sensor data to analyze the monitoring object, an equipment performance estimation unit that estimates equipment performance that indicates a reliability of a result of the analysis, a task amount determination unit that determines a task amount such that the higher the equipment performance, the smaller the task amount of a monitoring worker monitoring the monitoring object, a display content determination unit that determines content to be displayed using the sensor data such that the content differs depending on the task amount, and a display data generation unit that generates display data for displaying the determined content. a work sensor that detects data relating to the supervisory worker as work data; and a work performance estimation unit that uses the work data to estimate work performance that represents the efficiency of the work of the supervisory worker; Equipped with The task amount determination unit determines the task amount so that the higher the device performance and the higher the work performance, the smaller the task amount becomes. It is characterized by:
[0009] A program according to one aspect of the present disclosure includes a computer including a data receiving unit that receives sensor data from a sensor that detects data for monitoring a monitoring object as sensor data, a data analysis unit that analyzes the sensor data to analyze the monitoring object, an equipment performance estimation unit that estimates equipment performance that indicates a reliability of a result of the analysis, a task amount determination unit that determines a task amount such that the higher the equipment performance, the smaller the task amount of a monitoring worker monitoring the monitoring object, and a display content determination unit that determines content to be displayed using the sensor data so as to differ depending on the task amount. 、 a display data generating unit that generates display data for displaying the determined content; a work sensor that detects data relating to the supervisory worker as work data, and a work performance estimation unit that estimates work performance that represents the efficiency of the work of the supervisory worker using the work data; Function as The task amount determination unit determines the task amount so that the higher the device performance and the higher the work performance, the smaller the task amount becomes. It is characterized by:
[0010] An information presentation method according to one aspect of the present disclosure includes receiving sensor data from a sensor that detects data for monitoring a monitored object as sensor data, analyzing the sensor data to analyze the monitored object, estimating device performance that indicates a reliability of a result of the analysis, determining a task amount of a monitoring worker monitoring the monitored object such that the higher the device performance is, the smaller the task amount is, determining content to be displayed using the sensor data in a manner that differs depending on the task amount, and generating display data for displaying the determined content. and detecting data related to the supervisory worker as task data and estimating task performance, which indicates the efficiency of the task of the supervisory worker, using the task data, wherein the task amount is determined so that the higher the device performance and the higher the task performance, the smaller the task amount becomes. It is characterized by: Effect of the Invention
[0011] According to one or more aspects of the present disclosure, the rate at which fatigue accumulates in the monitoring worker can be reduced by appropriately allocating the resources of the device and the resources of the monitoring worker. [Brief description of the drawings]
[0012] [Figure 1] 1 is a block diagram illustrating a schematic configuration of an air traffic control system as an information presentation system according to first and fourth embodiments. [Diagram 2]FIG. 1 is a schematic diagram showing a monitoring operation in a control room. [Diagram 3] FIG. 1 is a block diagram illustrating a schematic configuration of an information display device according to first and fourth embodiments. [Figure 4] 1 is a schematic diagram of an image included in a video captured by a camera. [Diagram 5] 13 is an example of an image included in a video that is displayed on a display when the device performance is evaluated as "high" and the task amount is determined to be "low." [Figure 6] 13 is an example of an image included in a video that is displayed on a display when the device performance is evaluated as "medium" and the task amount is determined to be "normal." [Figure 7] 13 is an example of an image included in a video that is displayed on a display when the device performance is evaluated as "low" and the task amount is determined to be "high." [Figure 8] 1A and 1B are block diagrams illustrating an example of a hardware configuration. [Figure 9] FIG. 11 is a block diagram illustrating a schematic configuration of an air traffic control system as an information presentation system according to a second embodiment. [Figure 10] FIG. 11 is a block diagram illustrating a schematic configuration of an information display device according to second and third embodiments. [Figure 11] FIG. 1 is a first schematic diagram for explaining resources. [Figure 12] FIG. 11 is a schematic diagram for explaining resource evaluation. [Figure 13] FIG. 2 is a schematic diagram illustrating a first example display for assisting a first observer task of searching for newly arrived aircraft. [Figure 14] 1 is a schematic diagram showing a first example of an image included in a video displayed on a display; [Figure 15] 11 is a schematic diagram showing a second example of an image included in a video displayed on the display. FIG. [Figure 16] FIG. 11 is a schematic diagram showing a third example of an image included in a video displayed on the display. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Embodiment 1 The first embodiment will be described using an air traffic control system as an example. FIG. 1 is a block diagram illustrating a schematic configuration of an air traffic control system 100 serving as an information presentation system according to the first embodiment. The air traffic control system 100 includes a sensor 110 and an information presentation device 120 .
[0014] The sensor 110 is installed in a control tower 102 provided in an airport 101. The sensor 110 is provided to monitor the surrounding space. In other words, the sensor 110 detects data for monitoring a monitored object as sensor data. In this example, the sensor 110 is a camera for capturing an aircraft 103#1, which is a monitored object.
[0015] The sensor data collected by the sensor 110 is transmitted to the control room 105 via the sensor data communication path 104 . The control room 105 is equipped with facilities for performing control work, and monitors are on standby. For example, the control room 105 is equipped with an information display device 120 that displays information to the monitors. The control room 105 may be located within the control tower 102, but may also be located in a remote location. The monitors give control instructions to aircraft, and the instructions are transmitted to the control tower 102 via the control instruction communication path 106, and then transmitted from the control tower 102 to the aircraft 103#1.
[0016] FIG. 2 is a schematic diagram showing the monitoring operation in the control room 105. The control room 105 is equipped with an information presentation device 120 and a display 107 that functions as a display unit.
[0017] The information presentation device 120 displays the sensor data transmitted from the sensor 110 or the results of processing the sensor data on the display 107. The monitoring worker pays attention to the display 107 and performs the following monitoring tasks. The first monitor task is to search for and find aircraft appearing in the vicinity of airport 101 . The second monitoring task is to confirm the individual information of the discovered aircraft, such as the aircraft type, airline, or flight number. The third task of the monitor is to check the status of the detected aircraft, such as its speed, flight position, or aircraft health.
[0018] After completing these monitoring tasks, the monitoring worker determines the content of the control instructions to be given to the aircraft.
[0019] The information presentation device 120 presents sensor data or the results of processing the sensor data to the monitoring worker in order to assist the monitoring worker in his / her work. For example, the information presentation device 120 processes the sensor data by performing image processing to improve visibility or by superimposing information obtained from the results of data analysis. In the first embodiment, it is assumed that the sensor data is video data that is video data of the surroundings of the airport 101 captured by the camera, which is the sensor 110, in other words, the space where aircraft are traveling.
[0020] FIG. 3 is a block diagram illustrating a schematic configuration of the information display device 120 according to the first embodiment. The information presentation device 120 includes a data receiving unit 121 , a data analyzing unit 122 , a device performance estimating unit 123 , a task amount determining unit 124 , a display content determining unit 125 , and a data processing unit 126 .
[0021] The data receiving unit 121 receives the sensor data sent from the sensor 110 .
[0022] The data analysis unit 122 analyzes the received sensor data. For example, the data analysis unit 122 analyzes the sensor data to analyze the monitored object. Here, the data analysis unit 122 performs the following tasks as presentation-side tasks, which are tasks on the information presentation device 120 side. The first proposed task is to detect aircraft in a video, which are objects that are likely to be aircraft. The second presenter task is the estimation of individual information of the detected aircraft. The third posed task is the estimation of the state of the detected aircraft. These results are used as display content to assist the surveillance worker in his work.
[0023] The equipment performance estimation unit 123 calculates the equipment performance that indicates the reliability of the results of the analysis performed by the data analysis unit 122 . The device performance estimation unit 123 can calculate the device performance by using an estimated likelihood when detecting an aircraft from a video as an index. Furthermore, the device performance estimation unit 123 can also calculate the device performance by using an estimated likelihood of a position, a moving speed, or individual identification information as an index. For example, the device performance estimation unit 123 can calculate the device performance such that the higher the estimated likelihood, the higher the device performance. Furthermore, the device performance estimation unit 123 may also use as an index an overall or partial statistical quantity of an image included in a video, such as contrast or brightness distribution, etc. For example, the device performance estimation unit 123 can calculate the device performance such that the higher the contrast or brightness, the higher the device performance.
[0024] The equipment performance estimation unit 123 may select a representative one from these multiple indicators to represent the equipment performance. Alternatively, the equipment performance estimation unit 123 may calculate a linear sum using these indicators and a predetermined coefficient, and represent the calculated value as the equipment performance. The device performance estimation unit 123 provides the calculated device performance to the task amount determination unit 124 .
[0025] The task amount determination unit 124 evaluates the equipment performance calculated by the equipment performance estimation unit 123, and determines the task amount of the monitoring operator from the evaluation result. For example, the task amount determination unit 124 determines the task amount such that the higher the equipment performance, the smaller the task amount of the monitoring operator who monitors the monitored object.
[0026] Specifically, the task amount determination unit 124 evaluates the equipment performance calculated by the equipment performance estimation unit 123 in three stages: high, medium, and low. For example, by setting two thresholds for the estimated likelihood when detecting an aircraft from the above-mentioned image, the task amount determination unit 124 can evaluate the equipment performance in three stages.
[0027] The task amount determination unit 124 then determines the task amount of the monitoring worker from the identified evaluation results. For example, if the evaluation of the equipment performance is "high," the analysis results from the data analysis unit 122 can be highly trusted, and so the task amount determination unit 124 determines the task amount of the monitoring worker to be "low." If the evaluation of the equipment performance is "medium," the analysis results from the data analysis unit 122 cannot be highly trusted, and so the task amount determination unit 124 determines the task amount of the monitoring worker to be "normal." If the evaluation of the equipment performance is "low," the analysis results from the data analysis unit 122 cannot be highly trusted, and so the task amount determination unit 124 determines the task amount of the monitoring worker to be "high."
[0028] The display content determination unit 125 receives the analysis results of the data analysis unit 122 and the task amount of the monitoring worker determined by the task amount determination unit 124, and determines the display content using the sensor data so that it differs depending on the task amount of the monitoring worker. For example, the display content determination unit 125 can determine whether or not to display a button for the monitoring worker to perform work depending on the task amount. The display content determined here is displayed on the display 107.
[0029] The data processing unit 126 functions as a display data generating unit that generates display data for displaying the content determined by the display content determining unit 125. For example, the data processing unit 126 processes the sensor data transferred from the data receiving unit 121 based on the determination by the display content determining unit 125. The data processing unit 126 further transmits the processed result to the display 107 for display.
[0030] 4 to 7 are schematic diagrams for explaining the relationship between the task amount determined by task amount determination section 124 and the images included in the video displayed on display 107. FIG. FIG. 4 is a schematic diagram of an image included in a video captured by a camera, which is a sensor 110 installed in the control tower 102. 4, two aircraft 103#2 and 103#3 are shown in image 160#1 captured by the camera. One of the aircraft, 103#2, is an aircraft that has just recently appeared in the vicinity of airport 101, and the other aircraft, 103#3, is an aircraft that has been around for some time since its appearance.
[0031] FIG. 5 is an example of an image included in the video displayed on the display 107 when the device performance is evaluated as "high" and the task amount is determined to be "low." Similarly to FIG. 4, image 160#2 shown in FIG. 5 also shows aircraft 103#2 that has just appeared and aircraft 103#3 that has appeared for some time. The data analysis unit 122 has already detected the aircraft 103#2 and the aircraft 103#3 as newly appeared aircraft when they appeared in space, and has also completed estimation of the individual information of the aircraft 103#3.
[0032] Here, since the analysis results from the data analysis unit 122 can be trusted, the data analysis unit 122 performs the first presentation side task and the second presentation side task, and the first monitoring side task and the second monitoring side task of the monitoring work worker are omitted, thereby reducing the amount of tasks of the monitoring work worker.
[0033] Therefore, the aircraft status input popup 161 displays the individual information estimated by the data analysis unit 122, that is, the estimated results of the speed, approach distance, and presence or absence of anomalies of the aircraft 103#3.
[0034] The task assigned to the monitoring worker here is to check the contents displayed in the aircraft status input popup 161, and if they are correct, to press an approval button (not shown) using an input unit (not shown), or if there is an item that needs to be corrected, to input the correction for that item using an input unit (not shown) and press an approval button (not shown). The accuracy of the displayed information can be judged by visually checking the signals of other sensors such as radar, and by the contents of communication with the pilot. This corresponds to the third monitoring task among the monitoring tasks mentioned above.
[0035] FIG. 6 is an example of an image included in the video displayed on the display 107 when the device performance is evaluated as "medium" and the task amount is determined to be "normal." Similarly to FIG. 4, image 160#3 shown in FIG. 6 also shows aircraft 103#2 that has just appeared, and aircraft 103#3 that has appeared for some time. The data analysis unit 122 has already detected the aircraft 103#2 and the aircraft 103#3 as newly appeared aircraft when they appeared in space, and has also completed estimation of the individual information of the aircraft 103#3.
[0036] Here, the data analysis unit 122 performs the first presentation task, and the first monitoring task of the monitoring worker can be omitted, but the reliability of the analysis result by the data analysis unit 122 is not very high, so the second monitoring task of the monitoring worker cannot be omitted. For this reason, a model selection button area 162 is displayed, and the model estimation result of the aircraft 103#3 performed by the data analysis unit 122 is displayed, with multiple buttons corresponding to models with high probability lined up as candidates. Also, the aircraft status input popup 161 displays the estimation results of the aircraft's speed, proximity distance, and the presence or absence of abnormality, as in FIG. 5.
[0037] The monitoring worker uses an input unit (not shown) to select the button corresponding to the correct model from the buttons displayed in model selection button area 162. The monitoring worker also checks the contents displayed in aircraft status input popup 161, judges whether the information is correct as in the explanation of Fig. 5, makes corrections as necessary, and presses the approve button. These correspond to the second monitoring task and the third monitoring task among the tasks mentioned above.
[0038] FIG. 7 is an example of an image included in the video displayed on the display 107 when the device performance is evaluated as "low" and the task amount is determined to be "high." Similarly to FIG. 4, image 160#4 shown in FIG. 7 also shows aircraft 103#2 that has just appeared and aircraft 103#3 that has appeared for some time.
[0039] The data analysis unit 122 has already detected the aircraft 103#2 and the aircraft 103#3 as newly appeared aircraft when they appeared in space, and has also completed estimation of the individual information of the aircraft 103#3. However, if the evaluation of the equipment performance is low, the tasks assigned to the monitoring operator cannot be omitted. Therefore, similarly to the case where the device performance is rated as "medium" as shown in FIG. 6, the image 160#4 displays the device status input pop-up 161 and the model selection button area 162.
[0040] The data analysis unit 122 detects objects in the image that are likely to be aircraft. A discovery confirmation button area 163 is displayed near the object detected as a candidate. The monitoring worker determines whether the detected object is an aircraft or not, and inputs whether the detection was correct or incorrect by selecting a displayed button via an input unit (not shown).
[0041] Here, it is assumed that a certain amount of time has passed since the detection of aircraft 103#3, and the detection result has already been determined to be correct by a monitoring worker.
[0042] As described above, when the device performance is low, the monitoring operator performs all of the first monitoring task, the second monitoring task, and the third monitoring task.
[0043] A part or all of the above-described data analysis unit 122, device performance estimation unit 123, task amount determination unit 124, display content determination unit 125, and data processing unit 126 can be configured, for example, as shown in FIG. 8(A), by a memory 10 and a processor 11 such as a CPU (Central Processing Unit) that executes a program stored in the memory 10. In other words, the information presentation device 120 can be realized by a so-called computer. Such a program may be provided through a network, or may be provided by being recorded on a recording medium. That is, such a program may be provided, for example, as a program product.
[0044] In addition, some or all of the data analysis unit 122, the device performance estimation unit 123, the task amount determination unit 124, the display content determination unit 125 and the data processing unit 126 can also be configured as a processing circuit 12 such as a single circuit, a composite circuit, a processor operated by a program, a parallel processor operated by a program, an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array), as shown in Figure 8 (B). As described above, the data analysis unit 122, the device performance estimation unit 123, the task amount determination unit 124, the display content determination unit 125 and the data processing unit 126 can be realized by a processing circuit network.
[0045] The data receiving unit 121 can be realized by a communication interface such as a network interface card (NIC). The information presentation device 120 may also include an input interface (not shown) such as a keyboard or a mouse that functions as an input unit.
[0046] As described above, according to the first embodiment, the amount of tasks imposed on the monitor can be adjusted according to the device performance. In other words, the sensor information processing resources of the information presentation device 120 and the visual information processing resources of the monitor can be appropriately allocated. This makes it possible to minimize the rate at which the monitor's fatigue level accumulates.
[0047] In the first embodiment, the operation performed by the monitoring worker is a button operation or keyboard input, but the first embodiment is not limited to such an example.
[0048] In the above-described embodiment, the first submit-side task, the second submit-side task, and the third submit-side task are set as the submit-side task, but the first embodiment is not limited to such an example. For example, the task amount determination unit 124 may define performance indicators and thresholds corresponding to the check items corresponding to the first submit-side task, the second submit-side task, and the third submit-side task, respectively, and determine whether or not to omit each check item. In addition, the task amount determination unit 124 may adjust the task amount by setting multiple thresholds for each check item and making the check method more detailed or simpler.
[0049] In addition, when detecting aircraft, the data analysis unit 122 can learn in advance the relationship between previously obtained images of aircraft and individual information such as model, and can detect the appearance of an aircraft from images obtained during operation and estimate the individual information.
[0050] In the first embodiment described above, information on aircraft (e.g., size, movement speed, etc.) obtained from a radar sensor that detects aircraft flying around the airport 101 may be added as sensor data. Also, data obtained from a sensor for detecting meteorological conditions around the airport 101 may be added to the sensor data. Adding such data is expected to improve the reliability of the analysis results by the data analysis unit 122 as well as the reliability of the output results from the equipment performance estimation unit 123.
[0051] Embodiment 2 The second embodiment will also be described using an air traffic control system as an example. FIG. 9 is a block diagram illustrating a schematic configuration of an air traffic control system 200 serving as an information presentation system according to the second embodiment. The air traffic control system 200 includes a sensor 110, an information presentation device 220, and an operation sensor 240.
[0052] The sensor 110 of the air traffic control system 200 according to the second embodiment is similar to the sensor 110 of the air traffic control system 100 according to the first embodiment.
[0053] The work sensor 240 detects data related to the monitoring worker as work data. For example, the work sensor 240 is a sensor for measuring the performance of the monitoring worker. Specifically, the work sensor 240 collects biological data such as the monitoring worker's gaze, movements such as button operation or keyboard operation, facial expression, heart rate, or breathing as work data. The work sensor 240 may be attached directly to the monitoring worker's living body to directly collect the biological data, or may be collected in a non-contact manner using a camera or radio waves.
[0054] FIG. 10 is a block diagram illustrating a schematic configuration of an information display device 220 according to the second embodiment. The information presentation device 220 includes a data receiving unit 221 , a data analyzing unit 122 , a device performance estimating unit 123 , a task amount determining unit 224 , a display content determining unit 125 , a data processing unit 126 , and a task performance estimating unit 227 .
[0055] The data analysis unit 122, the device performance estimation unit 123, the display content determination unit 125 and the data processing unit 126 of the information presentation device 220 in embodiment 2 are similar to the data analysis unit 122, the device performance estimation unit 123, the display content determination unit 125 and the data processing unit 126 of the information presentation device 120 in embodiment 1.
[0056] The data receiving unit 221 receives the sensor data sent from the sensor 110 . Furthermore, the data receiving unit 221 receives biological data sent from the work sensor 240 . The received sensor data is provided to the data analysis unit 122 and the data processing unit 126 , and the received biological data is provided to the task performance estimation unit 227 .
[0057] The work performance estimation unit 227 receives biometric data such as the movements, facial expressions, gaze, and heart rate variability of the supervisory worker, and estimates the work performance indicating the efficiency of the supervisory worker's work from the biometric data.
[0058] For example, the work performance estimation unit 227 can determine the work performance as the eye movement speed, button operation speed, or character input speed of the monitoring worker. The work performance estimation unit 227 can also determine the total of a combination of a number of speeds selected from these. Here, the line of sight movement speed can be calculated as the reciprocal of the time from when the information presentation device 220 detects an object presumed to be an aircraft until when the monitoring worker moves his / her line of sight to the detected position of the object. The button operation speed can be calculated as the reciprocal of the time from when the confirmation button appears on the screen to when the monitoring worker finishes operating the button. The character input speed can be calculated as the reciprocal of the time from when the status confirmation pop-up is displayed until the supervisor finishes inputting characters and presses the approval button. The character input speed can also be calculated as the keyboard key operation speed, which is the number of key operations by the supervisor divided by the time required for those operations.
[0059] In addition, when the work performance estimation unit 227 detects a negative psychological state from the facial expression of the monitoring worker, or detects an abnormal physiological state from the heart rate or breathing, it may determine the work performance by multiplying the value calculated as above by a value of 1 or less, or may set the value of the work performance to zero. Then, the task performance estimating unit 227 provides the calculated task performance to the task amount determining unit 224 .
[0060] The task amount determination unit 224 determines the task amount so that the higher the equipment performance and the higher the work performance, the smaller the task amount of the monitoring worker. Here, the task amount determination unit 224 evaluates the equipment performance calculated by the equipment performance estimating unit 123 and the work performance estimated by the work performance estimating unit 227, and determines the task amount of the monitoring worker from the evaluation results.
[0061] For example, the task amount determination unit 224 expresses the total resources of the devices and monitoring workers that can be allocated to task processing as a linear sum of the device performance and the work performance. The coefficients related to each are predefined, and the values multiplied by the coefficients are regarded as the device resources and the work resources, respectively.
[0062] The "total resources" shown in Fig. 11 is the sum of the device resources and the work resources. The dotted lines shown in Fig. 11 represent the required resources, which are the resources required to complete the first monitor task, the second monitor task, and the third monitor task.
[0063] The "resource allocation" shown in Fig. 11 represents the result of adjusting the device resource and the work resource. The adjustment amount of the device resource is zero, but the adjusted work resource is the work resource minus the surplus of the total resource with respect to the required resource.
[0064] The task amount determination unit 224 determines the amount of tasks to be assigned to the monitoring worker by evaluating the total resources as shown in Fig. 12. For example, the task amount determination unit 224 determines the amount of tasks in three levels, "high," "normal," and "low," by using two thresholds for the adjusted work resources.
[0065] If the task amount is judged to be "small", the same contents as those in Fig. 5 are displayed on the display 107. The processing contents and monitoring tasks are the same as those explained in Fig. 5. If the task amount is determined to be "normal", the same content as in Fig. 6 is displayed on the display 107. The processing content and monitoring tasks are the same as those explained in Fig. 6. If the task amount is determined to be "large", the same contents as those in Fig. 7 are displayed on the display 107. The processing contents and monitoring tasks are the same as those explained in Fig. 7.
[0066] A part or all of the work performance estimation unit 227 described above can be configured, for example, as shown in FIG. 8(A), by a memory 10 and a processor 11 such as a CPU that executes a program stored in the memory 10. Also, a part or the whole of the task performance estimation unit 227 can be configured by the processing circuitry 12, for example, as shown in FIG. 8(B). As described above, the task performance estimation unit 227 can be realized by a processing circuit network.
[0067] As described above, according to the second embodiment, the amount of tasks assigned to the monitoring worker can be adjusted according to the device performance and the work performance. In other words, the sensor information processing resource of the information presentation device 220 and the visual information processing resource of the monitoring worker can be appropriately allocated. This makes it possible to minimize the rate at which the monitoring worker accumulates fatigue, while maintaining the quality of the monitoring task.
[0068] External information such as a weather forecast for the area around the airport 101, a predetermined aircraft operation plan, and a personnel allocation plan for air traffic control operations may be added as input information to the task amount determination unit 224. By adding these pieces of information to the input, the task amount determination unit 224 can predict fluctuations in required resources, fluctuations in device performance, and fluctuations in work performance due to fatigue accumulation or personnel changes of monitoring workers, and can also flexibly determine resource allocation. For example, by changing the threshold value for evaluating the total resources, it is possible to make decisions such as permitting a temporary increase in the task amount or encouraging early personnel changes.
[0069] Specifically, the task amount determination unit 224 can predict the deterioration and recovery of equipment performance as a time series by receiving a weather forecast for the vicinity of the airport. This allows the task amount determination unit 224 to evaluate the amount of tasks that should be handled by the monitoring worker and estimate the resources required for each task related to monitoring. For example, when equipment performance deteriorates, the task amount determination unit 224 may increase the task amount of the monitoring worker by decreasing the threshold for the total resources.
[0070] Furthermore, by receiving an input of an aircraft flight plan, the task amount determination unit 224 can predict an increase in the task amount due to an increase in the number of aircraft subject to control per period. This allows the task amount determination unit 224 to determine whether the increase in the task amount will continue or not from the aircraft flight plan. If the increase in the task amount continues, it can be predicted that the work performance will decrease, so the task amount determination unit 224 may reduce the task amount of the monitoring worker by increasing the threshold value for evaluating the total resources.
[0071] Furthermore, by receiving an input of a personnel allocation plan related to air traffic control operations, the task amount determination unit 224 can predict time series fluctuations in the amount of task to be assigned to each person from the personnel allocation plan. As a result, since each person's work performance decreases depending on the passage of time and the amount of task assigned, the task amount determination unit 224 can predict time series fluctuations in each person's work performance taking this into consideration. When the work performance of a monitoring worker decreases, the task amount determination unit 224 may reduce the task amount of the monitoring worker by increasing the threshold for evaluating the total resources.
[0072] As described above, the task amount determination unit 224 may increase the task amount of the monitoring worker when it is predicted that the device performance will deteriorate, and may decrease the task amount when it is predicted that the work performance will deteriorate.
[0073] In addition, there may be cases where the total resources are less than the required resources, or where the prediction of the device performance and the work performance as described above results in a prediction result in which the total resources are less than the required resources. In such cases, the information presentation device 220 may warn the supervisor of the need for assistant personnel or substitute personnel.
[0074] The work performance estimation unit 227 may previously learn the relationship between the biometric data obtained from the work sensor 240 and the work performance of the monitoring worker, and estimate the work performance from the biometric data obtained during operation.
[0075] Embodiment 3 If the amount of work assigned to the monitoring worker continues to be small, the monitoring worker's senses may become dull and his / her work performance may decline. In this case, it is effective to intentionally vary the amount of work assigned to the monitoring worker.
[0076] The third embodiment will also be described using an air traffic control system as an example. As shown in FIG. 9, an air traffic control system 300 serving as an information presentation system according to the third embodiment includes a sensor 110, an information presentation device 320, and a work sensor 240.
[0077] The sensor 110 of the air traffic control system 300 according to the third embodiment is similar to the sensor 110 of the air traffic control system 100 according to the first embodiment. The working sensor 240 of the air traffic control system 300 according to the third embodiment is similar to the working sensor 240 of the air traffic control system 200 according to the second embodiment.
[0078] As shown in FIG. 10, the information presentation device 320 in embodiment 3 includes a data receiving unit 221, a data analysis unit 122, an apparatus performance estimation unit 123, a task amount determination unit 224, a display content determination unit 325, a data processing unit 126, and a work performance estimation unit 227.
[0079] The data analysis unit 122, the device performance estimation unit 123, and the data processing unit 126 of the information display device 320 in the third embodiment are similar to the data analysis unit 122, the device performance estimation unit 123, and the data processing unit 126 of the information display device 120 in the first embodiment. Furthermore, the data receiving unit 221, the task amount determining unit 224, and the task performance estimating unit 227 of the information display device 320 in the third embodiment are similar to the data receiving unit 221, the task amount determining unit 224, and the task performance estimating unit 227 of the information display device 220 in the second embodiment.
[0080] The display content determination unit 325 receives the analysis results from the data analysis unit 122 and the task amount of the monitoring worker determined by the task amount determination unit 224, and determines the display content of the display 107 according to the task amount of the monitoring worker. In the third embodiment, the display content determination unit 325 switches between display content corresponding to a certain task amount and display content corresponding to another task amount. In other words, the display content determination unit 325 changes the content to be displayed corresponding to the task amount according to time.
[0081] For example, if the task amount is determined to be "low," the same content as in Fig. 5 is displayed on display 107. The processing content and monitoring tasks are the same as those explained in Fig. 5. The same content as in Fig. 6 is also displayed. The processing content and monitoring tasks are the same as those explained in Fig. 6. The display of Fig. 5 and the display of Fig. 6 may be determined regularly, such as alternately, or may be set randomly so that the display ratio over a certain period of time is constant.
[0082] If the task amount is determined to be "normal", the same contents as in Fig. 6 are displayed on display 107. The processing contents and monitoring tasks are the same as those explained in Fig. 6. The same contents as in Fig. 7 are also displayed. The processing contents and monitoring tasks are the same as those explained in Fig. 7. The display of Fig. 6 and the display of Fig. 7 may be determined regularly, such as alternately, or may be set randomly so that the display ratio over a certain period of time is constant.
[0083] If the task amount is determined to be "large", the same contents as those in Fig. 7 are displayed on the display 107. The processing contents and monitoring tasks are the same as those explained in Fig. 7.
[0084] In this way, the amount of work assigned to the monitoring worker can be intentionally varied, thereby preventing the monitoring worker's sense for the monitoring work from becoming dulled and maintaining the quality of the monitoring task.
[0085] Embodiment 4 As a method of using the aircraft detection results by the data analysis unit 122 to assist the first monitoring task, it is also effective to perform control to guide the line of sight of the monitoring worker, making it possible to finely adjust the amount of work.
[0086] As shown in FIG. 1, an air traffic control system 400 serving as an information presentation system according to the fourth embodiment includes a sensor 110 and an information presentation device 420.
[0087] The sensor 110 of the air traffic control system 400 according to the fourth embodiment is similar to the sensor 110 of the air traffic control system 100 according to the first embodiment.
[0088] As shown in FIG. 3, the information presentation device 420 in embodiment 4 includes a data receiving unit 121, a data analysis unit 122, an apparatus performance estimation unit 123, a task amount determination unit 124, a display content determination unit 425, and a data processing unit 126.
[0089] The data receiving unit 121, the data analysis unit 122, the device performance estimation unit 123, the task amount determination unit 124 and the data processing unit 126 of the information presentation device 420 in embodiment 4 are similar to the data receiving unit 121, the data analysis unit 122, the device performance estimation unit 123, the task amount determination unit 124 and the data processing unit 126 of the information presentation device 120 in embodiment 1.
[0090] The display content determination unit 425 determines the display content of the display 107 according to the task amount of the monitoring worker determined by the task amount determination unit 124, as in the first embodiment. Furthermore, for example, when a monitoring operator issues an instruction via an input unit (not shown), the display content determination unit 425 determines to display content to assist the monitoring operator in carrying out his / her tasks.
[0091] For example, the display content determination unit 425 can determine to display content indicating the position of a monitored object detected by analysis by the data analysis unit 122. For example, the display content determination unit 425 determines display content for displaying a screen such as the one below, based on the aircraft detection result by the data analysis unit 122, to assist the monitoring worker in the first monitoring task. The following Figs. 13 to 16 show images included in video based on data processed by the data processing unit 126 in accordance with the display content determined by the display content determination unit 425.
[0092] For example, FIG. 13 is a schematic diagram illustrating a first example display to assist a first observer task of searching for newly arrived aircraft. In the image 160#5 shown in FIG. 13, an indicator display window 164 is provided at a specific position of the image indicated by the sensor data.
[0093] An arrow 164a is displayed as an indicator in the indicator display window 164. When the data analysis unit 122 detects an object in the image that is estimated to be an aircraft, the arrow 164a indicates the position where the object was detected. In other words, the arrow 164a is displayed so as to guide the line of sight in a specific direction as viewed from a certain point on the display 107 as the origin. Note that the method of guidance may be a different symbol, such as a symbol resembling a human eye, pointing in the direction of the object, instead of the arrow 164a.
[0094] In this case, the monitoring worker uses an input unit (not shown) to operate the cursor on image 160#5, align it with the object's position, and click to confirm that the new aircraft has been detected. This corresponds to pressing the button described in the explanation of FIG. 7.
[0095] When the first monitoring task is omitted in order to adjust the task amount, this can be achieved by closing the window that displays the indicator.
[0096] Moreover, by adjusting the difficulty of the first monitoring task, rather than imposing the first monitoring task, it is possible to prevent the sensory dulling shown in the third embodiment. For example, the display content determination unit 425 may encourage the monitoring worker to search for the aircraft by scanning his / her line of sight by opening the indicator display window 164 but not displaying the indicator, as in the image 160#6 shown in Fig. 14. The display content determination unit 425 may also encourage the monitoring worker to use more visual information resources for the first monitoring task without relying on the information presentation device 420, for example, by delaying the time from opening the indicator display window to displaying the indicator.
[0097] As another control for guiding the line of sight of the monitoring operator, the display content determination unit 425 may change the contrast for each part on the display 107, or the like.
[0098] An image 160#7 shown in FIG. 15 is an example in which the contrast of an image portion including a detected object is changed and edges are emphasized. Also, as in image 160#8 shown in FIG. 16, the detected object may be enlarged to guide the line of sight of the monitoring worker.
[0099] In the above-described first to fourth embodiments, the information presentation devices 120 to 420 do not include the display 107. However, the information presentation devices 120 to 420 may include the display 107. [Explanation of symbols]
[0100] 100,200,300,400 Air traffic control system, 107 Display, 110 Sensor, 120,220,320,420 Information presentation device, 121,221 Data receiving unit, 122 Data analysis unit, 123 Device performance estimation unit, 124,224 Task amount determination unit, 125,325 Display content determination unit, 126 Data processing unit, 227 Work performance estimation unit.
Claims
1. a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data; a data analysis unit that analyzes the sensor data to analyze the monitored object; an apparatus performance estimation unit for estimating an apparatus performance indicating a reliability of a result of the analysis; a task amount determination unit that determines the task amount so that the higher the device performance is, the smaller the task amount of the monitoring worker who monitors the monitoring object is; a display content determination unit that determines a content to be displayed using the sensor data so as to vary depending on the task amount; a display data generating unit that generates display data for displaying the determined content; a work sensor that detects data related to the monitoring worker as work data; a work performance estimation unit that estimates a work performance that represents the efficiency of the work of the monitoring worker using the work data, The task amount determination unit determines the task amount such that the higher the device performance and the higher the work performance, the smaller the task amount becomes. An information presentation device comprising:
2. The task amount determination unit increases the task amount when it is predicted that the device performance will be degraded.
2. The information presentation device according to claim 1,
3. The task amount determination unit reduces the task amount when it is predicted that the work performance will be reduced.
2. The information presentation device according to claim 1,
4. a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data; a data analysis unit that analyzes the sensor data to analyze the monitored object; an apparatus performance estimation unit for estimating an apparatus performance indicating a reliability of a result of the analysis; a task amount determination unit that determines the task amount so that the higher the device performance is, the smaller the task amount of the monitoring worker who monitors the monitoring object is; a display content determination unit that determines a content to be displayed using the sensor data so as to vary depending on the task amount; a display data generating unit that generates display data for displaying the determined content, The task amount determination unit increases the task amount when it is predicted that the device performance will be degraded. An information presentation device comprising:
5. a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data; a data analysis unit that analyzes the sensor data to analyze the monitored object; an apparatus performance estimation unit for estimating an apparatus performance indicating a reliability of a result of the analysis; a task amount determination unit that determines the task amount so that the higher the device performance is, the smaller the task amount of the monitoring worker who monitors the monitoring object is; a display content determination unit that determines a content to be displayed using the sensor data so as to vary depending on the task amount; a display data generating unit that generates display data for displaying the determined content, The display content determining unit determines whether or not to display a button for the monitoring worker to perform a task according to the task amount. An information presentation device comprising:
6. The display content determination unit changes the content to be displayed in accordance with the task amount according to time. The information presentation device according to claim 1 ,
7. The display content determining unit determines whether or not to display a button for the monitoring worker to perform a task according to the task amount. The information presentation device according to claim 1 ,
8. The display content determination unit determines, using a result of the analysis, to display content for assisting the monitoring worker in performing a task. The information presentation device according to claim 1 ,
9. The display content determination unit displays content indicating the position of the monitored object detected by the analysis.
9. The information presentation device according to claim 8,
10. Computer, a data receiving unit that receives sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data; a data analysis unit that analyzes the sensor data to analyze the monitored object; an apparatus performance estimation unit for estimating an apparatus performance representative of the reliability of the result of the analysis; a task amount determination unit that determines the task amount such that the higher the device performance is, the smaller the task amount of the monitoring worker monitoring the monitoring object is; a display content determination unit that determines content to be displayed using the sensor data so as to vary depending on the task amount; a display data generating unit that generates display data for displaying the determined content; A work sensor that detects data related to the monitoring worker as work data; and a work performance estimation unit that estimates work performance representing the efficiency of the work of the monitoring worker using the work data; The task amount determination unit determines the task amount such that the higher the device performance and the higher the work performance, the smaller the task amount becomes. A program characterized by.
11. receiving sensor data from a sensor that detects data for monitoring an object to be monitored as sensor data; Analyzing the sensor data to perform an analysis of the monitored object; estimating an apparatus performance representative of a degree of confidence in the results of said analysis; determining the amount of work to be performed by a monitoring worker for monitoring the object to be monitored such that the higher the performance of the device is, the smaller the amount of work to be performed by the monitoring worker for monitoring the object to be monitored is; determining content to be displayed using the sensor data so as to vary depending on the task amount; generating display data for displaying the determined content; Detecting data relating to the monitoring worker as work data; An information presentation method for estimating a work performance representing an efficiency of a work of the monitoring worker by using the work data, comprising: The task amount is determined such that the higher the device performance and the higher the work performance, the smaller the task amount is. An information presentation method comprising:
Citation Information
Patent Citations
Device for detecting obstacle around vehicle
JP2017074873A
Vehicle management system, on-vehicle unit, and center device
JP2020013394A
JP291237B
