Information providing device, information providing method, and information providing program

Abstract

To effectively grasp a state of a monitoring object.SOLUTION: Server device 10 receives the conversion information including each conversion value corresponding to each hue, acquires the video data of the monitoring target captured by camera 30, and calculates the evaluation value for evaluating the state of the monitoring target based on the received conversion information and the acquired video data.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information providing device, an information providing method, and an information providing program. [Background technology]

[0002] Surveillance cameras are used to monitor the progress and status of manufacturing processes in plants, and to check for the occurrence of abnormalities, etc. Operators can monitor the images captured by the surveillance cameras in real time, or can review the images stored in a storage device at a later time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-336171 Summary of the Invention [Problem to be solved by the invention]

[0004] However, it is difficult to effectively grasp the status of monitored objects such as manufacturing processes in a plant. For example, when monitoring in real time, an operator must monitor the video and check the status, which places a heavy burden on the operator if they are required to ensure that nothing is overlooked. Also, when checking video stored in a storage device, the risk of the operator overlooking something is eliminated, but the operator must review the video later, which places a heavy burden on the operator.

[0005] The present invention has been made in view of the above, and has an object to effectively grasp the state of a monitored object. [Means for solving the problem]

[0006] An information providing device according to one embodiment of the present invention includes a receiving unit that receives conversion information including conversion values ​​corresponding to each hue, an acquisition unit that acquires video data of a monitored object captured by a photographing device, and a calculation unit that calculates an evaluation value that evaluates the state of the monitored object based on the received conversion information and the acquired video data.

[0007] An information provision method according to one embodiment of the present invention involves a computer receiving conversion information indicating conversion values ​​corresponding to each hue, acquiring video data of a monitored object captured by a photographing device, and calculating an evaluation value for evaluating the state of the monitored object based on the received conversion information and the acquired video data.

[0008] An information provision program according to one embodiment of the present invention causes a computer to execute a process of receiving conversion information indicating each conversion value corresponding to each hue, acquiring video data of a monitored object captured by a photographing device, and calculating an evaluation value for evaluating the state of the monitored object based on the received conversion information and the acquired video data. [Effects of the Invention]

[0009] According to the present invention, it is possible to effectively grasp the state of the monitored object. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating a configuration example and a processing example of a process monitoring system according to an embodiment; [Figure 2] FIG. 10 is a diagram illustrating a processing example of an evaluation calculation process of the process monitoring system according to the embodiment. [Figure 3] 1 is a block diagram showing an example of the configuration of each device in a process monitoring system according to an embodiment; [Figure 4] FIG. 4 is a diagram illustrating an example of a setting information storage unit of the server device according to the embodiment. [Figure 5] FIG. 2 is a diagram illustrating an example of a video data storage unit of a server device according to an embodiment. [Figure 6] FIG. 4 is a diagram illustrating an example of an evaluation value storage unit of the server device according to the embodiment. [Figure 7] FIG. 2 is a diagram for explaining the entire HSV model used in the process monitoring system according to the embodiment. [Figure 8] FIG. 2 is a diagram for explaining the hue of an HSV model used in the process monitoring system according to the embodiment. [Figure 9] 3A and 3B are diagrams for explaining saturation and brightness of an HSV model used in the process monitoring system according to the embodiment. [Figure 10] FIG. 2 is a diagram illustrating a specific example 1 of each process of the process monitoring system according to the embodiment. [Figure 11] FIG. 10 is a diagram showing a specific example 2 of each process of the process monitoring system according to the embodiment. [Figure 12] FIG. 10 is a diagram showing a specific example 3 of each process of the process monitoring system according to the embodiment. [Figure 13] FIG. 4 is a diagram showing a specific example 4-1 of each process of the process monitoring system according to the embodiment. [Figure 14] FIG. 4 is a diagram showing a specific example 4-2 of each process of the process monitoring system according to the embodiment. [Figure 15] FIG. 4 is a diagram showing a specific example 4-3 of each process of the process monitoring system according to the embodiment. [Figure 16] FIG. 4 is a diagram showing a specific example 4-4 of each process of the process monitoring system according to the embodiment. [Figure 17] 1 is a flowchart illustrating an example of the overall flow of a process monitoring system according to an embodiment. [Figure 18] 10 is a flowchart illustrating an example of the flow of a setting information management process of the process monitoring system according to the embodiment. [Figure 19] 10 is a flowchart illustrating an example of the flow of a video data management process of the process monitoring system according to the embodiment. [Figure 20] 10 is a flowchart showing an example of the flow of evaluation value management processing in the process monitoring system according to the embodiment. [Figure 21]10 is a flowchart illustrating an example of the flow of an alarm management process in the process monitoring system according to the embodiment. [Figure 22] FIG. 2 is a diagram illustrating an example of a hardware configuration according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] An information providing device, an information providing method, and an information providing program according to embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.

[0012] The configuration and processing of the process monitoring system 100 according to the embodiment, the configuration and processing of each device of the process monitoring system 100, and the processing flow of the process monitoring system 100 will be described below in order, and finally the effects of the embodiment will be described.

[0013] 1. Configuration and Processing of Process Monitoring System 100 The configuration and processing of a process monitoring system 100 according to an embodiment will be described in detail using Fig. 1. Fig. 1 is a diagram showing an example of the configuration and processing of the process monitoring system 100 according to an embodiment. Below, an example of the overall configuration of the process monitoring system 100, an example of the processing of the process monitoring system 100, and the effects of the process monitoring system 100 will be described. Note that in the embodiment, monitoring in a manufacturing process of a plant will be described as an example, but the monitored object and the field of use are not limited thereto.

[0014] (1-1. Example of the overall configuration of the process monitoring system 100) The process monitoring system 100 includes a server device 10, an operator terminal 20, and a camera 30. The server device 10, the operator terminal 20, and the camera 30 are connected to each other via a predetermined communication network (not shown) so as to be able to communicate with each other via wired or wireless communication. The predetermined communication network may be any of various communication networks such as the Internet or a dedicated line.

[0015] (1-1-1. Server device 10) The server device 10 is an information providing device that calculates an evaluation value for evaluating the state of a manufacturing process in a plant based on video data acquired from the camera 30. For example, the server device 10 may be realized in a cloud environment, an on-premise environment, an edge environment, or the like. Note that the process monitoring system 100 shown in FIG. 1 may include multiple server devices 10.

[0016] (1-1-2. Operator terminal 20) The operator terminal 20 is a manager terminal used by an operator O who is a manager of the manufacturing process of the plant. Note that the process monitoring system 100 shown in FIG.

[0017] (1-1-3. Camera 30) The camera 30 is a photographing device installed in the manufacturing process of a plant. Note that the process monitoring system 100 shown in FIG.

[0018] (1-2. Example of overall processing of the process monitoring system 100) The following describes the overall processing of the process monitoring system 100. Note that the processing of steps S1 to S4 below may be executed in a different order. Also, some of the processing of steps S1 to S4 below may be omitted.

[0019] (1-2-1. Setting information reception process) First, the server device 10 receives setting information from the operator terminal 20 (step S1). For example, the server device 10 receives and saves setting information input by the operator O to the setting screen of the operator terminal 20.

[0020] Here, the setting information is information related to the settings when calculating the evaluation value of the monitoring target, and is information including, for example, a specified range, an area division, and conversion information. The specified range is a range set by the operator O that includes each pixel in the video data for which an evaluation value is to be calculated. The area division is a division (primary color area, whitish area, blackish area) that classifies the pigments of the pixels in the video data. The conversion information is a conversion table, a conversion function, a fixed value, etc. that are set by the operator O and indicate each conversion value corresponding to each color information.

[0021] (1-2-2. Video data acquisition process) Second, the server device 10 acquires video data from the camera 30 (step S2). For example, the server device 10 acquires video data of still images taken every second from the camera 30 installed in the manufacturing process of the plant. Alternatively, the server device 10 may acquire video data of moving images from the camera 30 installed in the manufacturing process of the plant.

[0022] (1-2-3. Evaluation value calculation process) Third, the server device 10 calculates an evaluation value from the video data (step S3). For example, the server device 10 calculates an evaluation value for evaluating the state of the manufacturing process of the plant using setting information (e.g., designated range, area division, conversion information) set by the operator O and the video data acquired from the camera 30.

[0023] 1, the server device 10 calculates the evaluation values ​​for each time period in the designated range corresponding to the flame in the video data of the burner in the manufacturing process of the plant, as follows: {time: "9:10", evaluation value: "50"}, {time: "9:20", evaluation value: "160"}, and {time: "9:30", evaluation value: "450"}, and monitors the state in which the temperature of the burner flame increases over time. Details of the evaluation value calculation process will be described later in (1-3. Evaluation Value Calculation Process of the Process Monitoring System 100).

[0024] (1-2-4. Alarm notification processing) Fourth, the server device 10 notifies the operator O of an alarm (step S4). For example, if the calculated evaluation value exceeds a threshold value set by the operator O, the server device 10 transmits alarm data indicating an abnormal state to the operator terminal 20 and causes the alarm to be displayed on the monitor screen of the operator terminal 20. In addition, the server device 10 transmits table data or graph data indicating the evaluation value to the operator terminal 20 and causes the operator terminal 20 to display a table or graph (e.g., a line graph or a histogram) of the evaluation value on the monitor screen of the operator terminal 20.

[0025] (1-3. Evaluation Value Calculation Process of Process Monitoring System 100) The evaluation calculation process of the process monitoring system 100 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the evaluation calculation process of the process monitoring system 100 according to the embodiment. The following describes the designated range identification process, HSV value conversion process, area division classification process, converted value output process, and converted value aggregation process.

[0026] (1-3-1. Specified range identification processing) First, the server device 10 identifies a designated range of the video data (see FIG. 2(1)). In the example of FIG. 2(1), the server device 10 identifies a designated range corresponding to a flame in the video data of a burner in the manufacturing process of the plant, which is set by the operator O via the setting screen of the operator terminal 20.

[0027] (1-3-2. HSV value conversion processing) Second, the server device 10 converts the pigment (color information) of each pixel included in the specified range of the video data into an HSV value (see FIG. 2(2)). In the example of FIG. 2(2), the server device 10 converts the pigment (e.g., light blue, red, white, black) of each pixel included in the specified range corresponding to the flame in the video data of a burner in the manufacturing process of a plant into an HSV value, which is a combination of hue, which is a numerical value (0 to 360°) indicating the difference in color, saturation, which is a numerical value (0 to 255) indicating vividness, and value, which is a numerical value (0 to 255) indicating brightness.

[0028] (1-3-3. Area division classification processing) Third, the server device 10 classifies the pigments (color information) of each pixel included in the specified range of the video data into area segments (see FIG. 2(3)). In the example of FIG. 2(3), for the pigments light blue (hatched), red (diagonal lines), white (solid), and black (diamond-shaped mesh), the server device 10 classifies light blue and red into the primary color area, white into the whitish area, and black into the blackish area.

[0029] (1-3-4. Conversion value output processing) Fourth, the server device 10 outputs a conversion value for each pixel using conversion information set according to the area division (see FIGS. 2(4a) and 2(4b)). In the example of FIG. 2(4a), the server device 10 outputs a conversion value for light blue and red classified in the primary color area using a conversion function, which is an equation between hue and conversion value, indicating a conversion value corresponding to the hue (0 to 360°). In the example of FIG. 2(4b), the server device 10 outputs a conversion value for white classified in the whitish area using a fixed value of "30" for the pigment classified in the whitish area as conversion information. In the example of FIG. 2(4b), the server device 10 outputs a conversion value for black classified in the blackish area using a fixed value of "0" for the pigment classified in the blackish area as conversion information. As described above, the server device 10 repeats the HSV value conversion process, area division classification process, and conversion value output process for all pixels included in the specified range of the video data.

[0030] (1-3-5. Conversion value aggregation process) Fifth, the server device 10 aggregates the converted values ​​of all pixels and calculates an evaluation value (see FIG. 2(5)). In the example of FIG. 2(5), the server device 10 aggregates the converted value "10" for light blue (shaded), the converted value "20" for red (diagonal lines), the converted value "30" for white (solid), and the converted value "0" for black (diamond-shaped mesh), and calculates the total value of all pixels, "60," as the evaluation value. Also, in the example of FIG. 2(5), the server device 10 aggregates the converted value "10" for light blue (shaded), the converted value "20" for red (diagonal lines), the converted value "30" for white (solid), and the converted value "0" for black (diamond-shaped mesh), and calculates the average value of all pixels, "15," as the evaluation value.

[0031] (1-3-6. Other) The server device 10 can further convert the calculated evaluation value into a numerical value desired by the operator O. For example, in order to convert the calculated evaluation value into a numerical value corresponding to the temperature of a burner flame in a manufacturing process of a plant, the server device 10 can convert the calculated evaluation value of all pixels, which is an average value of "15", by a predetermined coefficient of "30" to convert the calculated evaluation value into a flame temperature of "450°C".

[0032] (1-4. Effects of the process monitoring system 100) Below, the problems of the process monitoring system 100P according to the reference technology will be explained, and then the effects of the process monitoring system 100 will be explained.

[0033] (1-4-1. Problems with the Process Monitoring System 100P) In a process monitoring system 100P according to the reference technology, a camera 30 such as a surveillance camera is used for the purpose of monitoring the progress and status of the manufacturing process of the plant and checking for the occurrence of any abnormalities. In this case, an operator O can monitor the video captured by the camera 30 in real time, or can review the video stored in a storage device later. In addition, the process monitoring system 100P can also use AI (artificial intelligence) to determine whether the state is normal or abnormal.

[0034] However, the process monitoring system 100P has the following problems. First, when monitoring in real time with the process monitoring system 100P, the operator O needs to monitor the video and check the status, which places a heavy burden on the operator O if there is a need to ensure that nothing is overlooked. Second, when checking video stored in a storage device, the risk of the operator O overlooking something is eliminated, but the operator O needs to review the video later, which places a heavy burden on the operator O. Third, when using AI, the AI ​​needs to learn normal and abnormal conditions in the relevant manufacturing process, which places a heavy burden on the operator O.

[0035] (1-4-2. Overview of the Process Monitoring System 100) The process monitoring system 100 executes the following processes. First, the server device 10 receives setting information from the operator O, including a specified range, area division, conversion information, etc. Second, the server device 10 acquires video data, such as still images and videos, from the cameras 30 installed in the manufacturing process of the plant. Third, the server device 10 calculates an evaluation value for evaluating the state of the manufacturing process of the plant, using the setting information set by the operator O and the video data acquired from the cameras 30. Fourth, if the calculated evaluation value exceeds a threshold value set by the operator O, the server device 10 notifies the operator O with an alarm indicating an abnormal state.

[0036] By performing the above processing, the process monitoring system 100 can provide a mechanism for converting color information in the video of the monitored object into a desired numerical value by the operator O. Furthermore, the process monitoring system 100 can label the state of the monitored object in designated range units set by the operator O, rather than the entire video (dividing the area to be monitored into smaller sections and managing them with identifiable names).

[0037] (1-4-3. Effects of the process monitoring system 100) The process monitoring system 100 has the following advantages. First, the process monitoring system 100 allows the operator O to grasp the time series of changes in color and size (spread) within a specified range set by the operator O by displaying the trend of the transition of the numerical data. Second, the process monitoring system 100 allows the operator O to grasp the state of the manufacturing process of the plant from the magnitude of the numerical values ​​without checking the video from the camera 30.

[0038] As described above, the process monitoring system 100 can effectively grasp the state of the monitored object.

[0039] 2. Configuration and Processing of Each Device in the Process Monitoring System 100 The configuration and processing of each device included in the process monitoring system 100 shown in Fig. 1 will be described using Fig. 3. Fig. 3 is a block diagram showing an example configuration of each device of the process monitoring system 100 according to the embodiment. Below, an example configuration of the entire process monitoring system 100 according to the embodiment will be described, followed by detailed descriptions of an example configuration and processing of the server device 10, an example configuration and processing of the operator terminal 20, and an example configuration and processing of the camera 30.

[0040] (2-1. Example of the overall configuration of the process monitoring system 100) An example of the overall configuration of the process monitoring system 100 shown in Fig. 1 will be described using Fig. 3. As shown in Fig. 3, the process monitoring system 100 is made up of a server device 10, an operator terminal 20, and a camera 30. The server device 10, the operator terminal 20, and the camera 30 are communicatively connected via a communication network N realized by the Internet, a dedicated line, or the like.

[0041] The server device 10 is installed in a cloud environment, an on-premise environment, an edge environment, etc. The operator terminal 20 is installed in a monitoring room or the like of a facility or equipment managed by an operator O. The camera 30 is installed at a monitoring target site, which is the monitoring site of the facility or equipment.

[0042] (2-2. Configuration Example and Processing Example of Server Device 10) An example of the configuration and processing of the server device 10 will be described with reference to Fig. 3. The server device 10 is an information providing device, and includes an input unit 11, an output unit 12, a communication unit 13, a storage unit 14, and a control unit 15.

[0043] (2-2-1. Input section 11) The input unit 11 controls input of various information to the server device 10. For example, the input unit 11 is realized by a mouse, a keyboard, etc., and accepts input of various information to the server device 10.

[0044] (2-2-2. Output section 12) The output unit 12 controls the output of various information from the server device 10. For example, the output unit 12 is realized by a display or the like, and displays various information stored in the server device 10.

[0045] (2-2-3. Communications Department 13) The communication unit 13 controls data communication with other devices. For example, the communication unit 13 performs data communication with each communication device via a router, etc. The communication unit 13 can also perform data communication with an operator's terminal (not shown).

[0046] (2-2-4. Storage section 14) The storage unit 14 stores various pieces of information referenced by the control unit 15 when it operates and various pieces of information acquired when the control unit 15 operates. The storage unit 14 is configured with a setting information storage unit 14a, a video data storage unit 14b, and an evaluation value storage unit 14c. Here, the storage unit 14 can be realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. Note that, in the example of FIG. 3, the storage unit 14 is installed inside the server device 10, but it may also be installed outside the server device 10, or multiple storage units may be installed.

[0047] (2-2-4-1. Setting information storage unit 14a) The setting information storage unit 14a stores setting information. For example, the setting information storage unit 14a stores setting information received by a reception unit 15a of the control unit 15, which will be described later. Here, an example of data stored in the setting information storage unit 14a will be described with reference to FIG. 4. FIG. 4 is a diagram showing an example of the setting information storage unit 14a of the server device 10 according to the embodiment. In the example of FIG. 4, the setting information storage unit 14a has items such as "monitoring target," "specified range," "area classification," and "conversion information."

[0048] The term "monitoring target" refers to identification information for identifying the facility, equipment, or section for which the status is to be evaluated, such as the identification number or symbol of a plant's manufacturing process. The term "designated range" refers to a user-specified range of video data that includes each pixel for which an evaluation value is to be calculated. For example, the range is a rectangle, circle, sector, polygon, or any other shape specified by the operator O on the setup screen. The term "area classification" refers to a user-specified classification of pixel pigments in video data. For example, the term "area classification" refers to a color information classification, such as a primary color area, a whitish area, or a blackish area, defined by the maximum or minimum values ​​of saturation or brightness, entered by the operator O on the setup screen. The term "conversion information" refers to conversion values ​​corresponding to color information entered by the user. For example, the term "conversion table" refers to a conversion function or conversion value corresponding to each hue in the primary color area, or fixed values ​​for the whitish or blackish area, entered by the operator O on the setup screen.

[0049] That is, Figure 4 shows an example in which the following data is stored in the setting information storage unit 14a for the monitored object "manufacturing process #1": {specified range: "specified range #1", area division: "area division #1", conversion information: "conversion information #1"}, {specified range: "specified range #2", area division: "area division #2", conversion information: "conversion information #2"}, {specified range: "specified range #3", area division: "area division #3", conversion information: "conversion information #3"}, ...

[0050] (2-2-4-2. Video data storage unit 14b) The video data storage unit 14b stores video data. For example, the video data storage unit 14b stores video data acquired by an acquisition unit 15b of the control unit 15, which will be described later. Here, an example of data stored in the video data storage unit 14b will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of the video data storage unit 14b of the server device 10 according to the embodiment. In the example of FIG. 5, the video data storage unit 14b has items such as "monitoring target," "monitoring device," "time," and "video data."

[0051] "Monitoring target" refers to identification information for identifying the facility, equipment, or section whose condition is being evaluated, such as the identification number or symbol of the plant's manufacturing process. "Monitoring equipment" refers to identification information for identifying the imaging equipment, such as the identification number or symbol of camera 30, which is a monitoring camera for the plant's manufacturing process. "Time" refers to the time of imaging by the imaging equipment, such as expressed in terms of year, month, day, hour, minute, and second. "Video data" refers to the video data at the time of imaging, such as still image video data, video video data, or video video data including audio data, captured every second.

[0052] That is, Figure 5 shows an example in which the following data is stored in the video data storage unit 14b for the camera 30, which is a monitoring device identified by the monitored object "manufacturing process #1" and "camera #1": {time: "time #1", video data: "video data #1"}, {time: "time #2", video data: "video data #2"}, {time: "time #3", video data: "video data #3"}, ...

[0053] (2-2-4-3. Evaluation value storage unit 14c) The evaluation value storage unit 14c stores evaluation values. For example, the evaluation value storage unit 14c stores evaluation values ​​calculated by a calculation unit 15c of the control unit 15, which will be described later. Here, an example of data stored in the evaluation value storage unit 14c will be described with reference to FIG. 6. FIG. 6 is a diagram showing an example of the evaluation value storage unit 14c of the server device 10 according to the embodiment. In the example of FIG. 6, the evaluation value storage unit 14c has items such as "monitoring target," "specified range," "time," and "evaluation value."

[0054] "Monitoring target" refers to identification information for identifying the facility, equipment, or section whose status is to be evaluated, such as the identification number or symbol of a plant's manufacturing process. "Specified range" refers to a range set by the user that includes each pixel in the video data for which an evaluation value is to be calculated, such as a range enclosed by a rectangle, circle, sector, polygon, or any other shape specified by operator O on the settings screen. "Time" refers to the time of capture by the imaging device, expressed, for example, in years, months, days, hours, minutes, and seconds. "Evaluation value" refers to a numerical value for evaluating the status of the monitoring target, such as a numerical value corresponding to the temperature of the burner flame in a plant's manufacturing process, or a numerical value indicating danger or safety.

[0055] That is, Figure 6 shows an example in which data such as {time: "time #1", evaluation value: "evaluation value #1"}, {time: "time #2", evaluation value: "evaluation value #2"}, {time: "time #3", evaluation value: "evaluation value #3"}, ... is stored in the evaluation value memory unit 14c for the specified range of evaluation values ​​identified by the monitored object "manufacturing process #1" and "specified range #1".

[0056] (2-2-5. Control unit 15) The control unit 15 controls the entire server device 10. The control unit 15 includes a reception unit 15a, an acquisition unit 15b, a calculation unit 15c, and a notification unit 15d. Here, the control unit 15 can be realized by, for example, an electronic circuit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0057] (2-2-5-1. Reception section 15a) The reception unit 15a receives various types of information. The reception unit 15a stores the received various types of information in the storage unit 14. The setting information reception process (designated range reception process, area division reception process, and conversion information reception process) will be described below.

[0058] (Setting information reception process) The reception unit 15a executes a setting information reception process. For example, the reception unit 15a receives, as setting information, a specified range, an area division, and conversion information set on a setting screen of the user terminal of the user.

[0059] A specific example of the setting information reception process will be described. The reception unit 15a receives the following setting information set by the operator O who manages the monitoring target "manufacturing process #1" via the operator terminal 20: {designated range: "designated range #1", area division: "area division #1", conversion information: "conversion information #1"}, {designated range: "designated range #2", area division: "area division #2", conversion information: "conversion information #2"}, {designated range: "designated range #3", area division: "area division #3", conversion information: "conversion information #3"}, ..., and stores it in the setting information storage unit 14a.

[0060] (Specified range reception processing) The reception unit 15a executes a designated range reception process as the setting information reception process. For example, the reception unit 15a receives a designated range of video data. The reception unit 15a also receives a designated range through a user operation on a video displayed on a setting screen of the user terminal of the user.

[0061] (Area classification reception processing) The reception unit 15a executes a region division reception process as the setting information reception process. For example, the reception unit 15a receives region divisions indicating a primary color region, a whitish region, and a blackish region. The reception unit 15a also receives the region divisions by the user inputting saturation and brightness on a setting screen of the user terminal of the user.

[0062] (Conversion information reception process) The reception unit 15a executes a conversion information reception process as the setting information reception process. For example, the reception unit 15a receives conversion information (a conversion table, a conversion function, and a fixed value) indicating a conversion value corresponding to color information. The reception unit 15a also receives conversion information including each conversion value corresponding to each hue. The reception unit 15a also receives conversion information including each conversion value corresponding to each saturation. The reception unit 15a also receives conversion information including each conversion value corresponding to each brightness. In the following, the conversion table, the conversion function, and the fixed value will be described as the conversion information.

[0063] (Conversion table) The receiving unit 15a receives, as conversion information, a conversion table indicating the relationship between each hue and each conversion value. For example, the receiving unit 15a receives a conversion table capable of converting each hue from 0 to 360° into each conversion value. At this time, the receiving unit 15a can also receive a conversion table capable of converting each saturation and each brightness into each conversion value.

[0064] (Conversion functions) The receiving unit 15a receives, as conversion information, a conversion function that indicates the relationship between each hue and each conversion value. For example, the receiving unit 15a receives a conversion function that indicates a linear equation between predetermined hues. The receiving unit 15a also receives a conversion function that indicates a curved equation between predetermined hues. In this case, the receiving unit 15a can also receive a conversion function that indicates a linear equation or a curved equation between predetermined saturations or between predetermined brightnesses.

[0065] (fixed value) The receiving unit 15a receives, as conversion information, fixed values ​​defined by the region classification. For example, the receiving unit 15a receives fixed values ​​corresponding to the pigments of pixels classified as a white region as the region classification. The receiving unit 15a also receives fixed values ​​corresponding to the pigments of pixels classified as a black region as the region classification. In this case, the receiving unit 15a can also receive fixed values ​​corresponding to the pigments of pixels classified as a primary color region as the region classification.

[0066] (2-2-5-2. Acquisition part 15b) The acquisition unit 15b acquires various types of information. The acquisition unit 15b stores the acquired various types of information in the storage unit 14. The video data acquisition process will be described below.

[0067] (Video data acquisition processing) The acquiring unit 15b executes a video data acquiring process. For example, the acquiring unit 15b acquires video data of a monitoring target captured by a camera 30, which is a photographing device. The acquiring unit 15b also acquires still image data or video data output by a camera 30 installed in a manufacturing process of a plant.

[0068] A specific example of the video data acquisition process will be described. Acquiring unit 15b acquires the following video data that has been generated by camera 30, a monitoring device identified as "camera #1," installed in monitoring target "manufacturing process #1," and transmitted to server device 10: {time: "time #1," video data: "video data #1"}, {time: "time #2," video data: "video data #2"}, {time: "time #3," video data: "video data #3"}, ..., and stores the acquired video data in video data storage unit 14b.

[0069] (2-2-5-3. Calculation part 15c) The calculation unit 15c calculates various pieces of information. Note that the calculation unit 15c refers to the various pieces of information stored in the storage unit 14. The calculation unit 15c also stores the calculation results in the storage unit 14. The evaluation value calculation process will be described below.

[0070] (Evaluation value calculation process) The calculation unit 15c executes an evaluation value calculation process. For example, the calculation unit 15c calculates an evaluation value for evaluating the state of the monitoring target based on the received conversion information (conversion table, conversion function, fixed value) and the acquired video data.

[0071] The calculation unit 15c calculates the evaluation value using each conversion value corresponding to the color information of each pixel of the video data included in the specified range. For example, the calculation unit 15c calculates the evaluation value using each conversion value corresponding to each hue of each pixel of the video data included in the specified range. At this time, the calculation unit 15c can also calculate the evaluation value using each conversion value corresponding to each saturation or each brightness of each pixel of the video data included in the specified range.

[0072] The calculation unit 15c calculates the evaluation value using conversion information set according to the region classification. For example, the calculation unit 15c calculates the evaluation value for the pigment of a pixel classified as a primary color region using a conversion table or a conversion function as conversion information. Also, the calculation unit 15c calculates the evaluation value for the pigment of a pixel classified as a white region or a black region using a fixed value as conversion information.

[0073] The calculation unit 15c calculates the evaluation value using each conversion value corresponding to each hue of each pixel of the video data converted by the conversion function. For example, the calculation unit 15c calculates the evaluation value using each conversion value corresponding to each hue of each pixel of the video data converted by the conversion function representing a linear equation or a curved equation.

[0074] The calculation unit 15c calculates, as the evaluation value, the sum of the conversion values ​​corresponding to each hue of each pixel of the video data. The calculation unit 15c also calculates, as the evaluation value, the average of the conversion values ​​corresponding to each hue of each pixel of the video data. Furthermore, the calculation unit 15c can convert the calculated sum or average into a value desired by the user using a predetermined coefficient set by the user as the evaluation value.

[0075] A specific example of the evaluation value calculation process will be described. First, the calculation unit 15c refers to {designated range: "designated range #1", area division: "area division #1", conversion information: "conversion information #1"} stored in the setting information storage unit 14a. Second, the calculation unit 15c refers to {time: "time #1", video data: "video data #1"}, {time: "time #2", video data: "video data #2"}, and {time: "time #3", video data: "video data #3"} stored in the video data storage unit 14b. Third, the calculation unit 15c calculates the evaluation values ​​{time: "time #1", evaluation value: "evaluation value #1"}, {time: "time #2", evaluation value: "evaluation value #2"}, and {time: "time #3", evaluation value: "evaluation value #3"}, and stores them in the evaluation value storage unit 14c.

[0076] (2-2-5-4. Notification section 15d) The notification unit 15d notifies various types of information. Note that the notification unit 15d may acquire the various types of information from the storage unit 14. The alarm notification process and the evaluation value notification process will be described below.

[0077] (Alarm notification processing) The notification unit 15d executes an alarm notification process. For example, if the calculated evaluation value exceeds a threshold, the notification unit 15d notifies the user with an alarm indicating an abnormality in the monitored object.

[0078] A specific example of the alarm notification process will be described. When the evaluation value "evaluation value #3" calculated by the calculation unit 15c exceeds the threshold value, the notification unit 15d transmits "abnormal alarm #1" to the operator terminal 20 as alarm data indicating an abnormal state of the monitoring target "manufacturing process #1," and notifies the operator O by displaying the alarm indicated by "abnormal alarm #1" on the display of the operator terminal 20.

[0079] (Evaluation value notification processing) The notification unit 15d executes an evaluation value notification process. For example, the notification unit 15d notifies the user of a table or graph showing the calculated evaluation values. At this time, the notification unit 15d notifies the user of a table showing the evaluation values ​​for each shooting time as a table showing the calculated evaluation values. The notification unit 15d also notifies the user of a graph showing the calculated evaluation values, such as a line graph showing the evaluation values ​​for each shooting time, or a histogram showing the distribution of the converted values ​​and evaluation values.

[0080] A specific example of the evaluation value notification process will be described. First, notification unit 15d refers to {time: "time #1", evaluation value: "evaluation value #1"}, {time: "time #2", evaluation value: "evaluation value #2"}, and {time: "time #3", evaluation value: "evaluation value #3"} stored in evaluation value storage unit 14c. Second, notification unit 15d generates table data "tables #1-3" showing the evaluation values ​​for each shooting time, line graph data "line graphs #1-3" showing the evaluation values ​​for each shooting time, and histogram data "histograms #1-3" showing the distribution of the converted values ​​and evaluation values. Third, the notification unit 15d transmits "Tables #1-3," "Line graphs #1-3," and "Histograms #1-3" to the operator terminal 20, and notifies the operator O by displaying the tables indicated by "Tables #1-3," the line graphs indicated by "Line graphs #1-3," and the histograms indicated by "Histograms #1-3" on the display of the operator terminal 20.

[0081] (2-3. Configuration Example and Processing Example of Operator Terminal 20) 3 again, a description will be given of an example of the configuration and processing of the operator terminal 20. The operator terminal 20 is made up of an input / output unit 21, a transmitting / receiving unit 22, and a communication unit 23.

[0082] (2-3-1. Input / output section 21) The input / output unit 21 controls the input of various types of information to the operator terminal 20. For example, the input / output unit 21 is realized by a mouse, a keyboard, a touch panel, or the like, and accepts input of various types of information to the operator terminal 20. The input / output unit 21 also controls the display of various types of information from the operator terminal 20. For example, the input / output unit 21 is realized by a display, or the like, and displays various types of information stored in the operator terminal 20.

[0083] The input / output unit 21 also displays a setting screen that allows input of setting information by operation of the operator O. The input / output unit 21 also displays an alarm indicated by alarm data transmitted from the server device 10, which is an information providing device. The input / output unit 21 also displays a table indicated by table data transmitted from the server device 10, or a graph indicated by graph data.

[0084] (2-3-2. Transmitter / receiver 22) The transmitting / receiving unit 22 transmits various types of information. For example, the transmitting / receiving unit 22 transmits to the server device 10 setting information input by the operator O via a setting screen.

[0085] The transmitting / receiving unit 22 receives various types of information. For example, the transmitting / receiving unit 22 receives alarm data transmitted from the server device 10. The transmitting / receiving unit 22 also receives table data or graph data transmitted from the server device 10.

[0086] (2-3-3. Communications Department 23) The communication unit 23 controls data communication with other devices. For example, the communication unit 23 performs data communication with each communication device via a router, etc. The communication unit 23 can also perform data communication with an operator's terminal (not shown).

[0087] (2-4. Configuration and Processing Examples of Camera 30) 3 again, a description will be given of an example of the configuration and processing of camera 30. For example, camera 30 is realized by a camera 30 that is a photographing device such as a surveillance camera or security camera installed in a facility managed by operator O, and is configured by generation unit 31 and communication unit 32.

[0088] (2-4-1. Generation unit 31) The generation unit 31 generates video data. For example, the generation unit 31 generates video data of still images and moving images by capturing images of the inside of a facility every second.

[0089] The generation unit 31 transmits the generated video data to the server device 10. For example, the generation unit 31 transmits the generated video data of a still image or a moving image to the server device 10.

[0090] (2-4-2. Communication Unit 32) The communication unit 32 controls data communication with other devices. For example, the communication unit 32 performs data communication with each communication device via a router, etc. The communication unit 32 can also perform data communication with a terminal (not shown).

[0091] 3. Specific Examples of Processes in the Process Monitoring System 100 7 to 16, specific examples of each process of the process monitoring system 100 according to the embodiment will be described. Below, the basic principle of the HSV model, which is one of the color models used in the process monitoring system 100, will be explained, followed by specific examples 1 to 4 of each process of the process monitoring system 100.

[0092] (3-1. Basic principles of the HSV model) Here, the basic principles of the HSV model used in the process monitoring system 100 will be described with reference to Figures 7 to 9. Figure 7 is a diagram illustrating the entire HSV model used in the process monitoring system 100 according to the embodiment. Figure 8 is a diagram illustrating the hue of the HSV model used in the process monitoring system 100 according to the embodiment. Figure 9 is a diagram illustrating the saturation and brightness of the HSV model used in the process monitoring system 100 according to the embodiment. Below, the premise of the color model used in the process monitoring system 100 will be explained, and then the elements of the HSV model will be explained.

[0093] (3-1-1. Color model assumptions) The following describes the premises for the color model used in the process monitoring system 100. First, it is desirable that the color model used in the process monitoring system 100 be a color model that can be used intuitively by humans. For example, humans can easily specify and distinguish colors such as red and purple, but have difficulty recognizing colors such as (R255,B0,G0) or (C150,M200,Y0). For this reason, it is desirable that the color model used in the process monitoring system 100 match human senses (senses that are familiar to us in our daily lives) as closely as possible.

[0094] Here, we will explain the RGB model, a common color model used to represent colors in computers. The RGB model is a color model that represents a wide range of colors through additive color mixing, which involves adjusting and mixing the amounts of the three primary colors red (R), green (G), and blue (B), making it easy to create light on displays, etc. However, in the RGB model, there are approximately 16.77 million possible combinations of red (R), green (G), and blue (B) (RGB values), making it difficult for people to guess or specify RGB values ​​by looking at a color.

[0095] Second, it is desirable that the color model used in the process monitoring system 100 does not change significantly in numerical value due to the influence of sunlight and lighting. For example, in an actual monitoring site, the colors do not always appear exactly the same due to the influence of sunlight and lighting, so a color model in which the converted values ​​vary significantly with the amount of light makes it difficult to compare numerical values. For this reason, it is desirable that the color model used in the process monitoring system 100 does not change significantly in converted value even if the amount of light varies slightly.

[0096] For these reasons, it is desirable that the color model used in the process monitoring system 100 be the HSV model, which satisfies the conditions of being "close to human intuition and easy to use" and "not susceptible to the influence of brightness, etc." The same applies to the HSB model.

[0097] (3-1-2. Elements of the HSV model) The elements of the HSV model used in the process monitoring system 100 will be described below. The HSV model is a color model that expresses color as a combination of three numerical values: hue, saturation, and value. The HSV model is characterized by being closer to human perception and easier to convey imagined colors than the RGB model, in which colors are determined by a combination of primary colors.

[0098] As shown by "H" in Figure 7(1), hue indicates the circumference of a cylinder in the HSV model and is expressed as an angle between 0 and 360°. As shown by "S" in Figure 7(2), saturation indicates the distance from the center to the circumference of a cylinder in the HSV model and is expressed as an angle between 0 and 255. As shown by "V" in Figure 7(2), lightness indicates the height from the bottom to the top of a cylinder in the HSV model and is expressed as an angle between 0 and 255.

[0099] As shown in Figure 8(1), hue is represented by a hue wheel where "H60" corresponds to "yellow," "H120" corresponds to "green," "H180" corresponds to "cyan," "H240" corresponds to "blue," "H300" corresponds to "magenta," and "H360" ("H0") corresponds to "red." Also, as shown in Figure 8(2), hue is represented by a hue scale showing a scale from 0 to 360° and the corresponding color.

[0100] As shown in Figure 9, saturation and brightness are each represented on a two-dimensional scale ranging from 0 to 255, indicating the corresponding color. Here, the higher the saturation and brightness, the closer the color is to a primary color. Conversely, the lower the saturation and brightness, the closer the color is to white. Conversely, the lower the brightness, the closer the color is to black.

[0101] (3-2. Example 1) Here, a specific example 1 of each process of the process monitoring system 100 will be described with reference to Fig. 10. Fig. 10 is a diagram showing a specific example 1 of each process of the process monitoring system 100 according to the embodiment. Below, the premise of the HSV model used in the process monitoring system 100 will be explained, and then a specific example of the area division classification process executed by the server device 10 of the process monitoring system 100 will be described.

[0102] (3-2-1. Assumptions of the HSV model) The premise of the HSV model used in the process monitoring system 100 will be explained. First, in the HSV model, when the brightness is low, any hue appears black. Second, in the HSV model, when the saturation is low and the brightness is high, any hue appears whitish. Third, in the HSV model, there is no black or white on the color wheel, so "white" or "black" cannot be selected.

[0103] (3-2-2. Area classification) The following describes area divisions based on the HSV model used in the process monitoring system 100. Based on the above assumptions, the server device 10 classifies the area into three areas, "primary color area," "whitish area," and "black area," based on saturation and brightness. The server device 10 also sets conversion information according to each of the classified area divisions. The following describes the conversion information for the area divisions of the primary color area, whitish area, and black area.

[0104] (3-2-2-1.Primary color area) The conversion information for the area division of the primary color area will be described. As shown in the example of Fig. 10(1), the server device 10 classifies pigments that have a predetermined saturation or more and a predetermined brightness or more into the primary color area. At this time, the server device 10 uses, as the conversion information, a conversion table that can convert each hue from 0 to 360° into each conversion value, or a conversion function that shows a linear equation or a curved equation that can convert a hue between predetermined hues into a conversion value.

[0105] (3-2-2-2. White area) The conversion information for the area classification of the whitish region will be described. As shown in the example of FIG. 10(2), the server device 10 classifies pigments that are less than a predetermined saturation and have a predetermined brightness or more into the whitish region. At this time, the server device 10 uses a fixed value set for the pigments in the whitish region as the conversion information. Note that the server device 10 can also use a conversion table or conversion function as the conversion information, similar to the pigments in the primary color region.

[0106] (3-2-2-3. Black area) The conversion information for the black region segmentation will now be described. As shown in the example of FIG. 10(3), the server device 10 classifies pigments that exhibit a brightness level less than a predetermined value into the black region. At this time, the server device 10 uses a fixed value set for the pigments in the black region as the conversion information. Note that the server device 10 can also use a conversion table or conversion function as the conversion information, similar to the pigments in the primary color region.

[0107] (3-3. Example 2) Here, a specific example 2 of each process of the process monitoring system 100 will be described with reference to Fig. 11. Fig. 11 is a diagram showing a specific example 2 of each process of the process monitoring system 100 according to the embodiment. Below, a specific example of the conversion value output process and the evaluation value calculation process executed by the server device 10 of the process monitoring system 100 will be described.

[0108] (3-3-1. Specific example of conversion value output processing) A specific example of the conversion value output process of the process monitoring system 100 will be described. In the example of Fig. 11(1), the server device 10 outputs a conversion value of "10" for light blue (horizontal lines), which is a pigment in the primary color region, using the conversion information. The server device 10 also outputs a conversion value of "30" for yellow (diagonal lines), which is a pigment in the primary color region, using the conversion information. The server device 10 also outputs a conversion value of "50" for orange (vertical lines), which is a pigment in the primary color region, using the conversion information.

[0109] (3-3-2. Specific example of evaluation value calculation process) A specific example of the evaluation value calculation process of the process monitoring system 100 will be described. In the example of Fig. 11(2), the server device 10 calculates a total evaluation value of "200" and an average evaluation value of "12.5" because, out of the 16 pixels (number of pigments) included in the specified range, the total conversion value for light blue is 10 x 14 = 140, the total conversion value for yellow is 30 x 2 = 60, and the total conversion value for orange is 50 x 0 = 0.

[0110] In the example of Figure 11 (3), the server device 10 calculates the evaluation value as a total of "240" and an average of "15" because, out of the 16 pixels (number of pigments) included in the specified range, the total conversion value for light blue is 10 x 12 = 120, the total conversion value for yellow is 30 x 4 = 120, and the total conversion value for orange-red is 50 x 0 = 0.

[0111] In the example of Figure 11 (4), the server device 10 calculates the evaluation value as a total of "440" and an average of "27.5" because, out of the 16 pixels (number of pigments) included in the specified range, the total conversion value for light blue is 10 x 6 = 60, the total conversion value for yellow is 30 x 6 = 180, and the total conversion value for orange is 50 x 4 = 200.

[0112] (3-4. Example 3) Here, a specific example 3 of each process of the process monitoring system 100 will be described with reference to Fig. 12. Fig. 12 is a diagram showing a specific example 3 of each process of the process monitoring system 100 according to the embodiment. Below, the premise of the conversion function used in the conversion value output process executed by the server device 10 of the process monitoring system 100 will be explained, and then a linear equation and a curve equation will be explained as specific examples of the conversion function.

[0113] (3-4-1. Assumptions of the conversion function) The premise of the conversion function used in the conversion value output process of the process monitoring system 100 will be explained. In the process monitoring system 100, the operator O needs to set each conversion value corresponding to each hue as conversion information. However, for example, setting each conversion value for each integer value of hue from 0 to 360° places a heavy burden on the operator O. Therefore, in the process monitoring system 100, the conversion value can be obtained using a conversion function created by plotting several points between the hue and the conversion value. In other words, by using the conversion function, the process monitoring system 100 does not need to set conversion values ​​corresponding to all hues, further reducing the burden on the operator O.

[0114] (3-4-2. Example of transformation function 1: Linear equation) A linear equation will be described as a first specific example of a conversion function used in the conversion value output process of the process monitoring system 100. As shown in the example of FIG. 12(1), the server device 10 sets a linear conversion function that indicates hue on the horizontal axis and conversion value on the vertical axis and is capable of converting hue between 0 and 360° into a conversion value. In the example of FIG. 12(1), the server device 10 uses the linear equation to output a conversion value of "25" corresponding to a hue of "150."

[0115] (3-4-3. Example of transformation function 2: Curve equation) A curve equation will be described as a second specific example of a conversion function used in the conversion value output process of the process monitoring system 100. As shown in the example of Fig. 12(2), the server device 10 sets a curved conversion function that indicates hue on the horizontal axis and conversion value on the vertical axis and is capable of converting hue between 0 and 360° into a conversion value. In the example of Fig. 12(2), the server device 10 uses the curve equation to output a conversion value of "10" corresponding to a hue of "150."

[0116] (3-5. Example 4) 13 to 16, a fourth specific example of each process of the process monitoring system 100 will be described. A specific example of a setting screen displayed on the operator terminal 20 of the process monitoring system 100 will be described below.

[0117] (3-5-1. Example of the settings screen 1: Overall settings screen) Here, a specific example 1 of the setting screen displayed by the operator terminal 20 will be described with reference to Fig. 13. Fig. 13 is a diagram showing a specific example 4-1 of each process of the process monitoring system 100 according to the embodiment. The following describes the specified range setting screen, and the conversion information setting screen and area division setting screen.

[0118] (3-5-1-1. Specified range setting screen) As shown in the example of FIG. 13(1), the operator terminal 20 displays a designated range setting screen that displays video captured by the camera 30. In the example of FIG. 13(1), the operator terminal 20 displays, as the designated range setting screen, a video of the vicinity of a burner in a manufacturing process of a plant. At this time, the operator O can set the designated range of the video data by encircling a predetermined range on the displayed video with the pointer and clicking the image crop button (see FIG. 13(6)). Details of the designated range setting screen will be described later in (3-5-2. Specific Example 2 of Setting Screen: Designated Range Setting Screen).

[0119] (3-5-1-2. Conversion information setting screen, area division setting screen) As shown in the example of FIG. 13(3), the operator terminal 20 displays a conversion information setting screen and an area division setting screen for inputting conversion values ​​corresponding to color information. In the example of FIG. 13(3), the operator terminal 20 displays, as the conversion information setting screen, a conversion value input text box into which a conversion value can be input and a fixed value input text box into which a fixed value can be input. At this time, the operator O can set the conversion information by inputting a conversion value or a fixed value into each text box. In addition, when inputting a conversion value into each text box, the operator O can also select a hue for which the conversion value is to be set on the hue scale (see FIG. 13(2)). In addition, after inputting a conversion value into each text box, the operator O can set a conversion function and display a conversion function graph (see FIG. 13(4)) showing the conversion function by clicking the "Graph Drawing" button. Note that details of the conversion information setting screen and the conversion function graph will be described later in (3-5-3. Specific Example 3 of Setting Screen: Conversion Information Setting Screen).

[0120] In the example of FIG. 13(3), the operator terminal 20 displays, as a region division setting screen, region division condition input text boxes in which saturation or brightness corresponding to the region divisions of the primary color region, the whitish region, and the blackish region can be input. At this time, the operator O can set the region division conditions by inputting saturation or brightness in each text box. Furthermore, the operator O can set the region division conditions and display a region division graph (see FIG. 13(5)) showing the region divisions by inputting saturation or brightness corresponding to the region division in each text box. Details of the region division setting screen and the region division graph will be described later in (3-5-4. Specific Example 4 of Setting Screen: Region Division Setting Screen).

[0121] (3-5-2. Example of setting screen 2: Specified range setting screen) Here, a specific example 2 of the setting screen displayed by the operator terminal 20 will be described with reference to Fig. 14. Fig. 14 is a diagram showing a specific example 4-2 of each process of the process monitoring system 100 according to the embodiment. Below, the video display screen and the video detail screen will be described as details of the specified range setting screen.

[0122] (3-5-2-1. Video display screen) 14(1), the operator terminal 20 displays, as a designated range setting screen, a video display screen showing a video of the vicinity of a burner in a manufacturing process of a plant. At this time, the operator O can specify a rectangular range including the flame by encircling a predetermined range with a pointer on the video of the vicinity of the burner in the manufacturing process of the plant displayed on the video display screen.

[0123] At this time, the operator O can specify a range of any shape, including a rectangle, a circle, a sector, a polygon, etc. The operator O can also specify the range by inputting coordinate values ​​corresponding to the specified range of the video data.

[0124] (3-5-2-2. Video details screen) As shown in the example of Fig. 14(2), the operator terminal 20 displays a video detail screen corresponding to the specified range as a specified range setting screen. In the example of Fig. 14(2), the operator terminal 20 displays, as the video detail screen, the specified range video shown in (a), the hue histogram shown in (b), and the evaluation value histogram shown in (c).

[0125] In the example of Figure 14(2)(a), the operator terminal 20 displays a specified range image corresponding to the specified range cut out by the operator O, and displays the pixels in the horizontal direction of the image on the horizontal axis and the pixels in the vertical direction of the image on the vertical axis.

[0126] In the example of Figure 14(2)(b), the operator terminal 20 displays a hue histogram showing the distribution of hues in the video data of the specified range, and also displays hue on the horizontal axis and the sum of the conversion values ​​of hues with the same numerical value on the vertical axis.

[0127] In the example of Figure 14(2)(c), the operator terminal 20 displays an evaluation value histogram showing the distribution of evaluation values ​​in the video data of the specified range, with the evaluation value displayed on the horizontal axis and the sum of the conversion values ​​of hues with the same numerical value displayed on the vertical axis, as well as the average value of the conversion values ​​in the video data of the specified range.

[0128] (3-5-3. Example of setting screen 3: Conversion information setting screen) Here, a specific example 3 of the setting screen displayed by the operator terminal 20 will be described with reference to Fig. 15. Fig. 15 is a diagram showing a specific example 4-3 of each process of the process monitoring system 100 according to the embodiment. Below, as details of the conversion information setting screen, a conversion information input text box and a conversion function graph screen will be described.

[0129] (3-5-3-1. Conversion information input text box) As shown in the example of Fig. 15(1), the operator terminal 20 displays, as a conversion information setting screen, a conversion information input text box in which a conversion value or a fixed value corresponding to color information can be input. In the example of Fig. 15(1), the operator terminal 20 displays, as the conversion information input text box, a conversion value input text box shown in (a) and a fixed value input text box shown in (b).

[0130] In the example of Fig. 15(1)(a), the operator terminal 20 displays conversion value input text boxes into which conversion values ​​corresponding to the hues of the pigments of pixels classified into the area segments of the primary color area can be input. Also, in the example of Fig. 15(1)(a), the operator O inputs into each of the conversion value input text boxes a conversion value of "30" corresponding to the hue "0", a conversion value of "36" corresponding to the hue "60", a conversion value of "24" corresponding to the hue "120", a conversion value of "24" corresponding to the hue "180", a conversion value of "24" corresponding to the hue "240", a conversion value of "28" corresponding to the hue "300", and a conversion value of "30" corresponding to the hue "360".

[0131] In the example of Figure 15(1)(b), the operator terminal 20 displays a conversion value input text box into which a fixed value can be input for the pigment of a pixel classified into the area segment of a whitish region. Similarly, the operator terminal 20 displays a conversion value input text box into which a fixed value can be input for the pigment of a pixel classified into the area segment of a blackish region. In the example of Figure 15(1)(b), the operator O inputs a fixed value of "36" for the pixel classified into the area segment of a whitish region and a fixed value of "10" for the pixel classified into the area segment of a blackish region into each of the conversion value input text boxes.

[0132] (3-5-3-2. Conversion function graph screen) 15(2), the operator terminal 20 displays a conversion function graph showing the relationship between hue and conversion value as a setting screen that can be displayed or transitioned to from the conversion information setting screen. In the example of Fig. 15(2), the operator terminal 20 plots {hue: "0", conversion value: "30"}, {hue: "60", conversion value: "36"}, {hue: "120", conversion value: "24"}, {hue: "180", conversion value "24"}, {hue: "240", conversion value: "24"}, {hue: "300", conversion value: "28"}, and {hue: "360", conversion value: "30"} as a conversion function graph showing the relationship between the conversion value input by the operator O in the conversion value input text box and the hue, and creates and displays a conversion function graph in which each point is connected by a straight line.

[0133] (3-5-4. Example of setting screen 4: Area division setting screen) Here, a specific example 4 of the setting screen displayed by the operator terminal 20 will be described with reference to Fig. 16. Fig. 16 is a diagram showing a specific example 4-4 of each process of the process monitoring system 100 according to the embodiment. Below, as details of the area division setting screen, an area division condition input text box and an area division graph screen will be described.

[0134] (3-5-4-1. Area classification condition input text box) As shown in the example of Fig. 16(1), the operator terminal 20 displays, as a region division setting screen, region division condition input text boxes in which region division conditions can be input. In the example of Fig. 16(1), the operator terminal 20 displays, as the region division condition input text boxes, a primary color region division condition input text box shown in (a), a whitish region division condition input text box shown in (b), and a black region division condition input text box shown in (c).

[0135] In the example of Fig. 16(1)(a), the operator terminal 20 displays a primary color region division condition input text box in which the saturation and lightness, which are the region division conditions of the primary color region, can be input. Also, in the example of Fig. 16(1)(a), the operator O inputs "0.3" as the minimum value of saturation and "0.4" as the minimum value of lightness as the region division conditions of the primary color region.

[0136] In the example of Fig. 16(1)(b), the operator terminal 20 displays a whitish region division condition input text box in which the saturation and lightness, which are the region division conditions for the whitish region, can be input. Also, in the example of Fig. 16(1)(b), the operator O inputs "0.3" as the maximum value of saturation and "0.6" as the minimum value of lightness as the region division conditions for the whitish region.

[0137] In the example of Fig. 16(1)(c), the operator terminal 20 displays a black area division condition input text box in which the lightness, which is the area division condition for the black area, can be input. Also, in the example of Fig. 16(1)(c), the operator O inputs "0.3" as the maximum lightness value as the area division condition for the black area.

[0138] (3-5-4-2. Area division graph screen) As shown in the example of Fig. 16(2), the operator terminal 20 displays an area division graph showing the relationship between area division conditions and area divisions as a setting screen that can be displayed or transitioned to from the area division setting screen. In the example of Fig. 16(2), the operator terminal 20 displays the primary color area shown in (a), the whitish area shown in (b), and the blackish area shown in (c) as the area division graph.

[0139] In the example of Fig. 16(2)(a), the operator terminal 20 displays a primary color region (diagonal lines). Also, in the example of Fig. 16(2)(a), the operator terminal 20 displays {saturation: "0.3 to 1.0", brightness: "0.4 to 1.0"} as the region division conditions for the primary color region. Note that the operator terminal 20 can also set the saturation and brightness to values ​​between 0 and 255.

[0140] In the example of Fig. 16(2)(b), the operator terminal 20 displays a whitish area (shaded). Also, in the example of Fig. 16(2)(b), the operator terminal 20 displays {saturation: "0.0 to 0.3", brightness: "0.6 to 1.0"} as the area division conditions for the whitish area. Note that the operator terminal 20 can also set the saturation and brightness to values ​​between 0 and 255.

[0141] In the example of Fig. 16(2)(c), the operator terminal 20 displays a black area (diamond-shaped mesh). Also, in the example of Fig. 16(2)(c), the operator terminal 20 displays {brightness: "0.0 to 0.3"} as the area division condition for the black area. Note that the operator terminal 20 can also set the brightness as a numerical value between 0 and 255.

[0142] 4. Flow of Each Process in the Process Monitoring System 100 17 to 21, the processing flow of the process monitoring system 100 according to the embodiment will be described. Below, the processing flow of the entire process monitoring system 100 will be described, and then each processing, that is, the setting information management processing, the video data management processing, the evaluation value management processing, and the alarm management processing, will be described.

[0143] (4-1. Overall processing of the process monitoring system 100) The overall processing flow of the process monitoring system 100 according to the embodiment will be described with reference to Fig. 17. Fig. 17 is a flowchart showing an example of the overall processing flow of the process monitoring system 100 according to the embodiment. Note that the processing of steps S101 to S104 below can also be executed in a different order. Furthermore, some of the processing of steps S101 to S104 below may be omitted.

[0144] (4-1-1. Setting information management processing) First, the process monitoring system 100 executes a setting information management process (step S101). For example, the process monitoring system 100 manages the setting information set by the operator O by executing the processes of steps S201 to S204, which will be described later.

[0145] (4-1-2. Video data management processing) Second, the process monitoring system 100 executes a video data management process (step S102). For example, the process monitoring system 100 manages video data of a monitoring target captured by the camera 30 by executing the processes of steps S301 to S303, which will be described later.

[0146] (4-1-3. Evaluation value management process) Third, the process monitoring system 100 executes an evaluation value management process (step S103). For example, the process monitoring system 100 executes the processes of steps S401 to S408, which will be described later, to manage an evaluation value that evaluates the state of the monitoring target.

[0147] (4-1-4. Alarm management processing) Fourth, the process monitoring system 100 executes an alarm management process (step S104). For example, the process monitoring system 100 executes the processes of steps S501 to S504, which will be described later, to manage alarms that indicate abnormal conditions of the monitored objects.

[0148] (4-2. Setting information management processing) The flow of the setting information management process of the process monitoring system 100 according to the embodiment will be described with reference to Fig. 18. Fig. 18 is a flowchart showing an example of the flow of the setting information management process of the process monitoring system 100 according to the embodiment. Note that the processes of steps S201 to S204 below can also be executed in a different order. Furthermore, some of the processes of steps S201 to S204 below may be omitted.

[0149] (4-2-1. Specified range reception process) First, the server device 10 executes a designated range reception process (step S201). For example, the server device 10 receives a designated range of video data set by the operator O via the operator terminal 20.

[0150] (4-2-2. Area classification reception process) First, the server device 10 executes an area division receiving process (step S202). For example, the server device 10 receives area divisions of a primary color area, a whitish area, and a blackish area set by the operator O via the operator terminal 20.

[0151] (4-2-3. Conversion information reception process) First, the server device 10 executes a conversion information reception process (step S203). For example, the server device 10 receives conversion information such as a conversion table, a conversion function, and fixed values ​​set by the operator O via the operator terminal 20.

[0152] (4-2-4. Setting information storage process) Fourth, the server device 10 executes a setting information storage process (step S204) and ends the setting information management process. For example, the server device 10 stores the setting information, including the designated range, area division, and conversion information of the video data, in the setting information storage unit 14a.

[0153] (4-3. Video data management processing) The flow of the video data management process of the process monitoring system 100 according to the embodiment will be described with reference to Fig. 19. Fig. 19 is a flowchart showing an example of the flow of the video data management process of the process monitoring system 100 according to the embodiment. Note that the processes of steps S301 to S303 below can also be executed in a different order. Furthermore, some of the processes of steps S301 to S303 below may be omitted.

[0154] (4-3-1. Video data generation process) First, the camera 30 executes a video data generation process (step S301). For example, the camera 30 captures an image of a monitoring target and generates video data of a still image or a moving image.

[0155] (4-3-2. Video data acquisition process) Second, the server device 10 executes a video data acquisition process (step S302). For example, the server device 10 acquires video data of a still image or a moving image generated by the camera 30.

[0156] (4-3-3. Video data storage processing) Third, the server device 10 executes a video data storage process (step S303), and ends the video data management process. For example, the server device 10 stores the video data of a still image or a moving image acquired from the camera 30 in the video data storage unit 14b.

[0157] (4-4. Evaluation value management process) The flow of evaluation value management processing in the process monitoring system 100 according to the embodiment will be described with reference to Fig. 20. Fig. 20 is a flowchart showing an example of the flow of evaluation value management processing in the process monitoring system 100 according to the embodiment. Note that the processing in the following steps S401 to S408 may be executed in a different order. Furthermore, some of the processing in the following steps S401 to S408 may be omitted.

[0158] (4-4-1. Setting information reference process) First, the server device 10 executes a setting information reference process (step S401). For example, the server device 10 references setting information including a designated range, area division, and conversion information of the video data stored in the setting information storage unit 14a.

[0159] (4-4-2. Video data reference processing) Second, the server device 10 executes a video data reference process (step S402). For example, the server device 10 references the video data stored in the video data storage unit 14b.

[0160] (4-4-3. Specified range identification processing) Third, the server device 10 executes a designated range specification process (step S403). For example, the server device 10 specifies the designated range of the video data using the designated range indicated by the setting information.

[0161] (4-4-4. HSV value conversion processing) Fourth, the server device 10 executes an HSV value conversion process (step S404). For example, the server device 10 converts color information of each pixel included in the specified range of the video data into an HSV value, which is a combination of hue, saturation, and brightness.

[0162] (4-4-5. Area classification processing) Fifth, the server device 10 executes an area division classification process (step S405). For example, the server device 10 classifies the pigments of each pixel into an area division of a primary color area, a whitish area, and a blackish area using the area division indicated by the setting information.

[0163] (4-4-6. Conversion value output processing) Sixth, the server device 10 executes a conversion value output process (step S406). For example, the server device 10 outputs a conversion value for each pixel using conversion information according to the classified area division.

[0164] (4-4-7. Conversion value aggregation process) Seventh, the server device 10 executes a conversion value aggregation process (step S407). For example, the server device 10 aggregates the output conversion values ​​of each pixel and calculates the sum or average of the conversion values ​​of all pixels as an evaluation value. At this time, the server device 10 can also create a table or graph showing the conversion values ​​or evaluation values.

[0165] (4-4-8. Evaluation value storage process) Eighth, the server device 10 executes an evaluation value storage process (step S408), and ends the evaluation value management process. For example, the server device 10 stores the calculated evaluation value in the evaluation value storage unit 14c.

[0166] (4-5. Alarm management processing) The flow of video data management processing in the process monitoring system 100 according to the embodiment will be described with reference to Fig. 21. Fig. 21 is a flowchart showing an example of the flow of alarm management processing in the process monitoring system 100 according to the embodiment. Note that the processing in the following steps S501 to S504 may be executed in a different order. Furthermore, some of the processing in the following steps S501 to S504 may be omitted.

[0167] (4-5-1. Evaluation value reference processing) First, the server device 10 executes an evaluation value reference process (step S501). For example, the server device 10 references the evaluation value stored in the evaluation value storage unit 14c. At this time, if the evaluation value exceeds the threshold (step S502: Yes), the server device 10 proceeds to the process of step S503. On the other hand, if the evaluation value does not exceed the threshold (step S502: No), the server device 10 proceeds to the process of step S504.

[0168] (4-5-2. Alarm notification processing) Second, the server device 10 executes an alarm notification process (step S503). For example, the server device 10 transmits alarm data indicating an abnormal state of the monitoring target to the operator terminal 20, and notifies the operator O of the alarm by causing the operator terminal 20 to display the alarm.

[0169] (4-5-3. Evaluation value notification processing) Third, the server device 10 executes the evaluation value notification process (step S504) and ends the alarm management process. For example, the server device 10 transmits table data or graph data indicating the evaluation value to the operator terminal 20, and notifies the operator O of the evaluation value by causing the operator terminal 20 to display the table or graph indicating the evaluation value.

[0170] 5. Effects of the embodiment Finally, the effects of the embodiment will be described below: Effects 1 to 13 corresponding to the processing according to the embodiment will be described below.

[0171] (5-1. Effect 1) First, in the process according to the embodiment described above, the server device 10 receives conversion information including conversion values ​​corresponding to each hue, acquires video data of the monitoring target captured by the camera 30, and calculates an evaluation value for evaluating the state of the monitoring target based on the received conversion information and the acquired video data. Therefore, in this process, the state of the monitoring target can be effectively grasped.

[0172] (5-2. Effect 2) Second, in the process according to the embodiment described above, the server device 10 receives a specified range of video data and calculates an evaluation value using conversion values ​​corresponding to the hues of the pixels of the video data included in the specified range. Therefore, in this process, the state of the monitoring target specified by the operator O can be effectively grasped.

[0173] (5-3. Effect 3) Thirdly, in the process according to the embodiment described above, the server device 10 accepts a range designated by an operation of the operator O on the image displayed on the setting screen of the operator terminal 20 of the operator O. Therefore, in this process, the state of the monitoring target designated by the operator O who is monitoring in real time can be effectively grasped.

[0174] (5-4. Effect 4) Fourth, in the process according to the embodiment described above, the server device 10 receives area divisions indicating the primary color area, the whitish area, and the blackish area, and calculates the evaluation value using conversion information set according to the area division. Therefore, in this process, by adopting a conversion method according to the pigments of the different area divisions, it is possible to effectively grasp the state of the monitored object.

[0175] (5-5. Effect 5) Fifth, in the process according to the embodiment described above, the server device 10 accepts the area division by the operator O inputting the saturation and brightness on the setting screen of the operator terminal 20 of the operator O. Therefore, in this process, by adopting a conversion method according to the pigment of the area division that takes into account not only the hue but also the saturation or brightness, it is possible to effectively grasp the state of the monitored object.

[0176] (5-6. Effect 6) Sixth, in the process according to the embodiment described above, the server device 10 receives a conversion function indicating the relationship between each hue and each conversion value as conversion information, and calculates an evaluation value using each conversion value corresponding to each hue of each pixel of the video data converted by the conversion function. Therefore, in this process, by adopting a conversion function that makes it easy to set the conversion information, the state of the monitored object can be effectively grasped.

[0177] (5-7. Effect 7) Seventh, in the process according to the above-described embodiment, the server device 10 receives a conversion function that represents a linear equation between predetermined hues. Therefore, in this process, by adopting a linear equation as a conversion function that makes it easy to set conversion information, the state of the monitored object can be effectively grasped.

[0178] (5-8. Effect 8) Eighth, in the process according to the embodiment described above, the server device 10 receives the conversion function that indicates a curved equation between predetermined hues. Therefore, in this process, by adopting a curved equation as a conversion function that makes it easy to set conversion information, the state of the monitored object can be effectively grasped.

[0179] (5-9. Effect 9) Ninth, in the process according to the above-described embodiment, the server device 10 calculates the sum of the conversion values ​​corresponding to the hues of the pixels of the video data as the evaluation value. Therefore, in this process, the intensity of the entire video is calculated as the evaluation value, thereby making it possible to effectively grasp the state of the monitored object.

[0180] (5-10. Effect 10) Tenth, in the process according to the above-described embodiment, the server device 10 calculates the average value of the conversion values ​​corresponding to the hues of the pixels of the video data as the evaluation value. Therefore, in this process, the average intensity of the video is calculated as the evaluation value, thereby making it possible to effectively grasp the state of the monitored object.

[0181] (5-11. Effect 11) Eleventh, in the process according to the above-described embodiment, when the calculated evaluation value exceeds a threshold value, the server device 10 notifies the operator O of an alarm indicating an abnormality in the monitored object. Therefore, in this process, the operator O can effectively grasp the state of the monitored object without constantly monitoring it.

[0182] (5-12. Effect 12) Twelfth, in the process according to the embodiment described above, the server device 10 notifies the operator O of a table or graph showing the calculated evaluation values. Therefore, in this process, the operator O can effectively grasp the past state of the monitoring target.

[0183] (5-13. Effect 13) Thirteenth, in the process according to the above-described embodiment, the server device 10 acquires still image data or video data output by the camera 30 installed in the manufacturing process of the plant. Therefore, in this process, it is possible to effectively grasp the state of the manufacturing process of the plant, which requires safety and urgency.

[0184] 6. Application Examples of the Embodiments Application Examples of the Embodiments will be Described below. Application Examples 1 to 8 of the embodiment will be described below.

[0185] (6-1. Application Example 1) As a first application example of the embodiment, it is possible to detect impurities in iron ore flowing on a belt conveyor in a manufacturing process of a plant.

[0186] (6-2. Application Example 2) As a second application example of the embodiment, it is possible to detect impurities contained in a fluid flowing through a pipe in a manufacturing process of a plant.

[0187] (6-3. Application example 3) As a third application example of the embodiment, it is possible to detect an abnormality in the water level or flow of a fluid flowing through a pipe in a manufacturing process of a plant.

[0188] (6-4. Application Example 4) As a fourth application example of the embodiment, it is possible to detect strain caused by pressure in pipes or tanks in a manufacturing process at a plant.

[0189] (6-5. Application Example 5) As a fifth application example of the embodiment, it is possible to detect an abnormality in a product being transported on a belt conveyor in a manufacturing process in a plant.

[0190] (6-6. Application Example 6) As a sixth application example of the embodiment, it is possible to detect abnormalities in smoke emitted from a chimney in a manufacturing process of a plant.

[0191] (6-7. Application Example 7) As a seventh application example of the embodiment, it is possible to detect the intrusion of people or animals into buildings, farmland, etc.

[0192] (6-8. Application Example 8) As an application example 8 of the embodiment, it is possible to detect abnormalities in parks, roads, rivers, and the like.

[0193] [7. System] The information including the processing procedures, control procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified.

[0194] Furthermore, the components of each device shown in the figure are functional concepts and do not necessarily have to be physically configured as shown. In other words, the specific form of distribution and integration of each device is not limited to that shown. In other words, all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0195] Furthermore, all or any part of the processing functions performed by each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware using wired logic.

[0196] [8. Hardware] Next, an example of the hardware configuration of the server device 10, which is an information providing device, will be described. Note that other devices may also have a similar hardware configuration. FIG. 22 is a diagram illustrating an example of the hardware configuration according to an embodiment. As shown in FIG. 22, the server device 10 includes a communication device 10a, an HDD (Hard Disk Drive) 10b, a memory 10c, and a processor 10d. The components shown in FIG. 22 are connected to each other via a bus or the like.

[0197] The communication device 10a is a network interface card or the like, and communicates with other servers. The HDD 10b stores programs and databases that operate the functions shown in FIG.

[0198] The processor 10d reads out from the HDD 10b or the like a program that executes the same processes as the respective processing units shown in Fig. 3 and loads it into the memory 10c, thereby operating a process that executes each function described in Fig. 3 or the like. For example, this process executes the same functions as the respective processing units of the server device 10. Specifically, the processor 10d reads out from the HDD 10b or the like a program that has the same functions as the reception unit 15a, the acquisition unit 15b, the calculation unit 15c, the notification unit 15d, and the like. Then, the processor 10d executes a process that executes the same processes as the reception unit 15a, the acquisition unit 15b, the calculation unit 15c, the notification unit 15d, and the like.

[0199] In this way, the server device 10 operates as a device that executes various processing methods by reading and executing the programs. The server device 10 can also realize functions similar to those of the above-described embodiment by reading the programs from a recording medium using a media reader and executing the read programs. Note that the programs of the embodiments are not limited to being executed by the server device 10. For example, the present invention can also be applied in the same way to cases where another computer or server executes the programs, or where these execute the programs in cooperation with each other.

[0200] This program can be distributed via a network such as the Internet. In addition, this program can be recorded on a computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, a magneto-optical disk (MO), or a digital versatile disk (DVD), and can be executed by being read from the recording medium by a computer.

[0201] [9. Other] Some examples of combinations of the disclosed technical features are set out below.

[0202] (1) An information providing device comprising: a receiving unit that receives conversion information including conversion values ​​corresponding to each hue; an acquisition unit that acquires video data of a monitored object captured by a photographing device; and a calculation unit that calculates an evaluation value that evaluates the state of the monitored object based on the received conversion information and the acquired video data.

[0203] (2) The information providing device described in (1), wherein the receiving unit receives a specified range of the video data, and the calculation unit calculates the evaluation value using the conversion values ​​corresponding to the hues of each pixel of the video data included in the specified range.

[0204] (3) The information providing device according to (2), wherein the reception unit receives the specified range through an operation by the user on an image displayed on a setting screen of the user terminal of the user.

[0205] (4) An information providing device described in any one of (1) to (3), wherein the reception unit receives area divisions indicating primary color areas, white areas, and black areas, and the calculation unit calculates the evaluation value using the conversion information set according to the area divisions.

[0206] (5) The information providing device according to (4), wherein the reception unit receives the area division by the user inputting saturation and brightness on a setting screen of the user terminal of the user.

[0207] (6) An information providing device described in any one of (1) to (5), wherein the receiving unit receives a conversion function indicating the relationship between each hue and each conversion value as the conversion information, and the calculation unit calculates the evaluation value using each conversion value corresponding to each hue of each pixel of the video data converted by the conversion function.

[0208] (7) The information providing device according to (6), wherein the reception unit receives the conversion function that indicates a linear equation between predetermined hues.

[0209] (8) The information providing device according to (6), wherein the reception unit receives the conversion function that indicates a curved equation between predetermined hues.

[0210] (9) The information providing device according to any one of (1) to (8), wherein the calculation unit calculates, as the evaluation value, a sum of the conversion values ​​corresponding to the hues of the pixels of the video data.

[0211] (10) The information providing device according to any one of (1) to (9), wherein the calculation unit calculates, as the evaluation value, an average value of the conversion values ​​corresponding to the hues of the pixels of the video data.

[0212] (11) The information providing device according to any one of (1) to (10), further comprising a notification unit that notifies a user of an alarm indicating an abnormality in the monitored object when the calculated evaluation value exceeds a threshold value.

[0213] (12) The information providing device according to any one of (1) to (11), further comprising a notification unit that notifies the user of a table or graph showing the calculated evaluation value.

[0214] (13) The information providing device according to any one of (1) to (12), wherein the acquiring unit acquires still image data or video data output by the imaging device installed in the manufacturing process of a plant.

[0215] (14) An information providing method in which a computer receives conversion information including conversion values ​​corresponding to each hue, acquires video data of a monitored object captured by a photographing device, and calculates an evaluation value for evaluating the state of the monitored object based on the received conversion information and the acquired video data.

[0216] (15) An information providing program that causes a computer to execute a process of receiving conversion information including conversion values ​​corresponding to each hue, acquiring video data of a monitored object captured by a photographing device, and calculating an evaluation value for evaluating the state of the monitored object based on the received conversion information and the acquired video data. [Explanation of symbols]

[0217] 10 Server device 10a Communication equipment 10b HDD 10c memory 10d processor 11 Input section 12 Output section 13 Communications Department 14 Storage section 14a Setting information storage section 14b Video data storage unit 14c Evaluation value storage unit 15 Control Unit 15a Reception 15b Acquisition part 15c Calculation part 15d Notification Department 20 Operator terminal 21 Input / output section 22 Transmitter / Receiver 23 Communications Department 30 Camera 31 Generation part 32 Communications Department 100 Process Monitoring Systems N communication network O Operator

Claims

1. a receiving unit that receives conversion information including each conversion value corresponding to each hue; an acquisition unit that acquires video data of a monitoring target captured by a photographing device; a calculation unit that calculates an evaluation value for evaluating a state of the monitoring target based on the received conversion information and the acquired video data; An information providing device comprising:

2. The reception unit Accepting a designated range of the video data; The calculation unit calculating the evaluation value using the conversion values ​​corresponding to the hues of the pixels of the video data included in the specified range; The information providing device according to claim 1 .

3. The reception unit Accepting the specified range through an operation by the user on an image displayed on a setting screen of the user's user terminal; The information providing device according to claim 2 .

4. The reception unit receiving area divisions indicating a primary color area, a white area, and a black area; The calculation unit calculating the evaluation value using the conversion information set in accordance with the area division; The information providing device according to claim 1 .

5. The reception unit accepting the area division by the user inputting saturation and brightness on a setting screen of the user terminal of the user; 5. The information providing device according to claim 4.

6. The reception unit receiving, as the conversion information, a conversion function indicating a relationship between each of the hues and each of the conversion values; The calculation unit calculating the evaluation value using the conversion values ​​corresponding to the hues of the pixels of the video data converted by the conversion function; The information providing device according to claim 1 .

7. The reception unit receiving the conversion function that indicates a linear equation between predetermined hues; The information providing device according to claim 6.

8. The reception unit receiving the conversion function representing a curve equation between predetermined hues; The information providing device according to claim 6.

9. The calculation unit calculating, as the evaluation value, a sum of the conversion values ​​corresponding to the hues of the pixels of the video data; The information providing device according to any one of claims 1 to 8.

10. The calculation unit calculating an average value of the conversion values ​​corresponding to the hues of the pixels of the video data as the evaluation value; The information providing device according to any one of claims 1 to 8.

11. a notification unit that notifies a user of an alarm indicating an abnormality in the monitored object when the calculated evaluation value exceeds a threshold value; The information providing device according to claim 1 , further comprising:

12. a notification unit that notifies a user of a table or graph showing the calculated evaluation value; The information providing device according to claim 1 , further comprising:

13. The acquisition unit Acquiring still image data or video data output by the imaging device installed in the manufacturing process of the plant; The information providing device according to any one of claims 1 to 8.

14. The computer Accepting conversion information including conversion values ​​corresponding to each hue; Acquires video data of the monitored object captured by the imaging device, calculating an evaluation value for evaluating the state of the monitoring target based on the received conversion information and the acquired video data; How information is provided to perform the process.

15. On the computer, Accepting conversion information including conversion values ​​corresponding to each hue; Acquires video data of the monitored object captured by the imaging device, calculating an evaluation value for evaluating the state of the monitoring target based on the received conversion information and the acquired video data; An information providing program that executes processing.

Images