Information providing device, information providing method, and information providing program

Abstract

To effectively grasp the status of the object to be monitored. [Solution] The server device 10 receives conversion information including conversion values ​​corresponding to each hue, acquires video data of the monitored object captured by the camera 30, and calculates an evaluation value for evaluating the state of the monitored object based on the received conversion information and the acquired video data.

Description

[Technical field]

[0001] The present invention relates to an information providing device, an information providing method, and an information providing program. [Background technology]

[0002] Surveillance cameras are used for the purpose of monitoring the progress and status of the manufacturing process in a plant, checking for the occurrence of abnormalities, etc. Operators can monitor the images captured by the surveillance cameras in real time, and can also review the images stored in a storage device at a later time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2004-336171 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, it is difficult to effectively grasp the state of a monitored object such as a manufacturing process in a plant. For example, in the case of real-time monitoring, an operator needs to monitor the video and check the state, which places a heavy burden on the operator if there is a need to ensure that nothing is overlooked. In addition, in the case of checking video stored in a storage device, although there is no risk of the operator overlooking something, the operator needs to review the video later, which places a heavy burden on the operator.

[0005] The present invention has been made in consideration of the above, and has an object to effectively grasp the state of a monitored object. [Means for solving the problem]

[0006] An information providing device according to one embodiment of the present invention includes a receiving unit that receives conversion information including conversion values ​​corresponding to each hue, an acquisition unit that acquires video data of a monitored object captured by a photographing device, and a calculation unit that calculates an evaluation value that evaluates the state of the monitored object based on the received conversion information and the acquired video data.

[0007] An information provision method according to one embodiment of the present invention includes a computer executing a process in which the computer receives conversion information indicating each conversion value corresponding to each hue, acquires video data of a monitored object captured by a photographing device, and calculates an evaluation value for evaluating the status of the monitored object based on the received conversion information and the acquired video data.

[0008] An information provision program according to one embodiment of the present invention causes a computer to execute a process of receiving conversion information indicating each conversion value corresponding to each hue, acquiring video data of a monitored object captured by a photographing device, and calculating an evaluation value for evaluating the status of the monitored object based on the received conversion information and the acquired video data. Effect of the Invention

[0009] According to the present invention, it is possible to effectively grasp the state of an object to be monitored. [Brief description of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating a configuration example and a processing example of a process monitoring system according to an embodiment; [Diagram 2] FIG. 11 is a diagram illustrating a processing example of an evaluation calculation process of the process monitoring system according to the embodiment. [Diagram 3] 1 is a block diagram showing an example of the configuration of each device in a process monitoring system according to an embodiment; [Figure 4] FIG. 4 is a diagram illustrating an example of a setting information storage unit of the server device according to the embodiment. [Diagram 5] FIG. 4 is a diagram illustrating an example of a video data storage unit of the server device according to the embodiment. [Figure 6] FIG. 4 is a diagram illustrating an example of an evaluation value storage unit of the server device according to the embodiment. [Figure 7] FIG. 2 is a diagram for explaining an entire HSV model used in the process monitoring system according to the embodiment. [Figure 8] FIG. 2 is a diagram for explaining the hue of an HSV model used in the process monitoring system according to the embodiment. [Figure 9] 1 is a diagram for explaining saturation and brightness of an HSV model used in a process monitoring system according to an embodiment. FIG. [Figure 10] FIG. 2 is a diagram showing a specific example 1 of each process of the process monitoring system according to the embodiment. [Figure 11] FIG. 4 is a diagram showing a specific example 2 of each process of the process monitoring system according to the embodiment. [Figure 12] FIG. 11 is a diagram showing a specific example 3 of each process of the process monitoring system according to the embodiment. [Figure 13] FIG. 4 is a diagram showing a specific example 4-1 of each process of the process monitoring system according to the embodiment. [Figure 14] FIG. 4 is a diagram showing a specific example 4-2 of each process of the process monitoring system according to the embodiment. [Figure 15] FIG. 4 is a diagram showing a specific example 4-3 of each process of the process monitoring system according to the embodiment. [Figure 16] FIG. 4 is a diagram showing a specific example 4-4 of each process of the process monitoring system according to the embodiment. [Figure 17] 2 is a flowchart showing an example of an overall flow of a process monitoring system according to the embodiment. [Figure 18] 1 is a flowchart showing an example of a flow of a setting information management process of the process monitoring system according to the embodiment. [Figure 19] 10 is a flowchart showing an example of the flow of a video data management process of the process monitoring system according to the embodiment. [Figure 20] 10 is a flowchart showing an example of the flow of evaluation value management processing in the process monitoring system according to the embodiment. [Figure 21]5 is a flowchart showing an example of the flow of an alarm management process of the process monitoring system according to the embodiment. [Figure 22] FIG. 2 is a diagram illustrating an example of a hardware configuration according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] An information providing device, an information providing method, and an information providing program according to an embodiment of the present invention will be described below in detail with reference to the drawings. Note that the present invention is not limited to the embodiment described below.

[0012] The configuration and processing of the process monitoring system 100 according to the embodiment, the configuration and processing of each device of the process monitoring system 100, and the processing flow of the process monitoring system 100 will be described below in order, and finally the effects of the embodiment will be described.

[0013] 1. Configuration and Processing of Process Monitoring System 100 The configuration and processing of the process monitoring system 100 according to the embodiment will be described in detail with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration and processing of the process monitoring system 100 according to the embodiment. An example of the overall configuration of the process monitoring system 100, an example of the processing of the process monitoring system 100, and the effects of the process monitoring system 100 will be described below. Note that in the embodiment, monitoring in a manufacturing process of a plant will be described as an example, but the object to be monitored and the field of use are not limited thereto.

[0014] (1-1. Example of the Overall Configuration of the Process Monitoring System 100) The process monitoring system 100 includes a server device 10, an operator terminal 20, and a camera 30. The server device 10, the operator terminal 20, and the camera 30 are connected to each other via a predetermined communication network (not shown) so as to be communicable with each other by wire or wirelessly. The predetermined communication network may be any of various communication networks such as the Internet or a dedicated line.

[0015] (1-1-1. Server device 10) The server device 10 is an information providing device that calculates an evaluation value for evaluating the state of a manufacturing process of a plant based on video data acquired from the camera 30. For example, the server device 10 is realized in a cloud environment, an on-premise environment, an edge environment, or the like. Note that the process monitoring system 100 shown in FIG. 1 may include a plurality of server devices 10.

[0016] (1-1-2. Operator terminal 20) The operator terminal 20 is a manager terminal used by an operator O who is a manager of the manufacturing process of the plant. Note that the process monitoring system 100 shown in FIG.

[0017] (1-1-3. Camera 30) The camera 30 is a photographing device installed in the manufacturing process of a plant. Note that the process monitoring system 100 shown in FIG.

[0018] (1-2. Example of Overall Processing of the Process Monitoring System 100) The following describes the overall processing of the above-described process monitoring system 100. Note that the processing of steps S1 to S4 below may be executed in a different order. Also, some of the processing of steps S1 to S4 below may be omitted.

[0019] (1-2-1. Setting information reception process) First, the server device 10 accepts setting information from the operator terminal 20 (step S1). For example, the server device 10 accepts and stores setting information input by the operator O to a setting screen of the operator terminal 20.

[0020] Here, the setting information is information related to the settings when calculating the evaluation value of the monitoring target, and is information including, for example, a specified range, an area division, and conversion information. The specified range is a range set by the operator O that includes each pixel in the video data for which an evaluation value is to be calculated. The area division is a division (primary color area, whitish area, blackish area) that classifies the pigments of the pixels in the video data, set by the operator O. The conversion information is a conversion table, conversion function, fixed value, etc. that indicates each conversion value corresponding to each color information, set by the operator O.

[0021] (1-2-2. Video data acquisition process) Secondly, the server device 10 acquires video data from the camera 30 (step S2). For example, the server device 10 acquires video data of still images captured every second from the camera 30 installed in the manufacturing process of the plant. The server device 10 may also acquire video data of moving images from the camera 30 installed in the manufacturing process of the plant.

[0022] (1-2-3. Evaluation value calculation process) Thirdly, the server device 10 calculates an evaluation value from the video data (step S3). For example, the server device 10 calculates an evaluation value for evaluating the state of the manufacturing process of the plant by using setting information (e.g., designated range, area division, conversion information) set by the operator O and the video data acquired from the camera 30.

[0023] 1, the server device 10 calculates {time: "9:10", evaluation value: "50"}, {time: "9:20", evaluation value: "160"}, and {time: "9:30", evaluation value: "450"} as evaluation values ​​for each time period in a specified range corresponding to a flame in the video data of a burner in a manufacturing process of a plant, and monitors the state in which the temperature of the burner flame increases over time. Details of the evaluation value calculation process will be described later in (1-3. Evaluation Value Calculation Process of the Process Monitoring System 100).

[0024] (1-2-4. Alarm notification processing) Fourth, the server device 10 notifies the operator O of an alarm (step S4). For example, when the calculated evaluation value exceeds a threshold value set by the operator O, the server device 10 transmits alarm data indicating an abnormal state to the operator terminal 20 and causes the alarm to be displayed on the monitor screen of the operator terminal 20. In addition, the server device 10 transmits table data or graph data indicating the evaluation value to the operator terminal 20 and causes the operator terminal 20 to display a table or graph (e.g., a line graph or a histogram) of the evaluation value on the monitor screen of the operator terminal 20.

[0025] (1-3. Evaluation Value Calculation Processing of the Process Monitoring System 100) The evaluation calculation process of the process monitoring system 100 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the evaluation calculation process of the process monitoring system 100 according to the embodiment. The following describes the designated range identification process, the HSV value conversion process, the area division classification process, the converted value output process, and the converted value aggregation process.

[0026] (1-3-1. Specified range identification processing) First, the server device 10 identifies a designated range of the video data (see FIG. 2(1)). In the example of FIG. 2(1), the server device 10 identifies a designated range corresponding to a flame in the video data of a burner in the manufacturing process of the plant, which is set by the operator O via the setting screen of the operator terminal 20.

[0027] (1-3-2. HSV value conversion process) Secondly, the server device 10 converts the pigment (color information) of each pixel included in the specified range of the video data into an HSV value (see FIG. 2(2)). In the example of FIG. 2(2), the server device 10 converts the pigment (e.g. light blue, red, white, black) of each pixel included in the specified range corresponding to the flame in the video data of a burner in the manufacturing process of a plant into an HSV value which is a combination of hue, which is a numerical value (0-360°) indicating the difference in color, saturation, which is a numerical value (0-255) indicating the vividness, and value, which is a numerical value (0-255) indicating the brightness.

[0028] (1-3-3. Area division classification processing) Third, the server device 10 classifies the pigments (color information) of each pixel included in the specified range of the video data into area divisions (see FIG. 2(3)). In the example of FIG. 2(3), for the pigments light blue (hatched), red (diagonal lines), white (solid color), and black (diamond mesh), the server device 10 classifies light blue and red into the primary color area, white into the whitish area, and black into the blackish area.

[0029] (1-3-4. Conversion value output processing) Fourthly, the server device 10 outputs the conversion value of each pixel using the conversion information set according to the area division (see Figs. 2(4a) and (4b)). In the example of Fig. 2(4a), the server device 10 outputs the conversion value for light blue and red classified in the primary color area using a conversion function that is an equation of the hue and the conversion value indicating the conversion value corresponding to the hue (0 to 360°) as the conversion information. Also, in the example of Fig. 2(4b), the server device 10 outputs the conversion value for white classified in the whitish area using the fixed value "30" of the pigment classified in the whitish area as the conversion information. Also, in the example of Fig. 2(4b), the server device 10 outputs the conversion value for black classified in the blackish area using the fixed value "0" of the pigment classified in the blackish area as the conversion information. As described above, the server device 10 repeats the HSV value conversion process, the area division classification process, and the conversion value output process for all pixels included in the specified range of the video data.

[0030] (1-3-5. Conversion value aggregation process) Fifth, the server device 10 counts up the converted values ​​of all pixels and calculates an evaluation value (see FIG. 2(5)). In the example of FIG. 2(5), the server device 10 counts up the converted value of light blue (shaded), "10", the converted value of red (diagonal lines), "30", the converted value of white (solid color), and the converted value of black (diamond mesh), "0", and calculates the total value of all pixels, "60", as the evaluation value. Also, in the example of FIG. 2(5), the server device 10 counts up the converted value of light blue (shaded), "10", the converted value of red (diagonal lines), "30", the converted value of white (solid color), and the converted value of black (diamond mesh), "0", and calculates the average value of all pixels, "15", as the evaluation value.

[0031] (1-3-6.Others) The server device 10 can further convert the calculated evaluation value into a numerical value desired by the operator O. For example, in order to convert the evaluation value into a numerical value corresponding to the temperature of the burner flame in the manufacturing process of the plant, the server device 10 can convert the evaluation value into a flame temperature of "450° C." by multiplying the average value "15" of all pixels calculated as the evaluation value by a predetermined coefficient "30."

[0032] (1-4. Effects of the process monitoring system 100) In the following, problems with the process monitoring system 100P according to the reference technology will be described, and then the effects of the process monitoring system 100 will be described.

[0033] (1-4-1. Problems with the Process Monitoring System 100P) In the process monitoring system 100P according to the reference technology, a camera 30 such as a surveillance camera is used for the purpose of monitoring the progress and state of the manufacturing process of the plant and checking for the occurrence of abnormalities. At this time, an operator O can monitor the video captured by the camera 30 in real time, and can also review the video stored in a storage device later. In addition, the process monitoring system 100P can also use AI (Artificial Intelligence) to determine whether the state is normal or abnormal.

[0034] However, the process monitoring system 100P has the following problems. First, in the case of real-time monitoring in the process monitoring system 100P, the operator O needs to monitor the video and check the condition, so if there is a need to ensure that nothing is overlooked, the burden on the operator O is heavy. Second, in the case of checking video stored in a storage device, the risk of the operator O overlooking something is eliminated, but the operator O needs to review the video later, so the burden on the operator O is heavy. Third, in the case of using AI, it is necessary to have the AI ​​learn normal and abnormal conditions in the corresponding manufacturing process, so the burden on the operator O is heavy.

[0035] (1-4-2. Overview of the process monitoring system 100) In the process monitoring system 100, the following processing is executed. First, the server device 10 accepts setting information including a specified range, an area division, conversion information, etc. from the operator O. Second, the server device 10 acquires video data of still images and videos from the camera 30 installed in the manufacturing process of the plant. Third, the server device 10 calculates an evaluation value for evaluating the state of the manufacturing process of the plant using the setting information set by the operator O and the video data acquired from the camera 30. Fourth, when the calculated evaluation value exceeds a threshold value set by the operator O, the server device 10 notifies the operator O of an alarm indicating an abnormal state.

[0036] By executing the above processing, the process monitoring system 100 can provide a mechanism for converting color information in the video of the monitored object into a desired numerical value by the operator O. Furthermore, the process monitoring system 100 can label the state of the monitored object in a specified range unit set by the operator O, rather than the entire video (dividing the area to be monitored into small sections and managing them with identifiable names).

[0037] (1-4-3. Effects of the process monitoring system 100) The process monitoring system 100 has the following advantages. First, in the process monitoring system 100, the operator O can grasp the time series of color changes and changes in size (spread) within a specified range set by the operator O by displaying the transition of the numerical data as a trend. Second, in the process monitoring system 100, the operator O can grasp the state of the manufacturing process of the plant from the magnitude of the numerical values ​​without checking the image from the camera 30.

[0038] As described above, the process monitoring system 100 can effectively grasp the state of the monitored object.

[0039] 2. Configuration and Processing of Each Device in the Process Monitoring System 100 The configuration and processing of each device included in the process monitoring system 100 shown in Fig. 1 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of the configuration of each device of the process monitoring system 100 according to the embodiment. In the following, an example of the overall configuration of the process monitoring system 100 according to the embodiment will be described, and then an example of the configuration and processing of the server device 10, the operator terminal 20, and the camera 30 will be described in detail.

[0040] (2-1. Example of the Overall Configuration of the Process Monitoring System 100) An example of the overall configuration of the process monitoring system 100 shown in Fig. 1 will be described with reference to Fig. 3. As shown in Fig. 3, the process monitoring system 100 is composed of a server device 10, an operator terminal 20, and a camera 30. The server device 10, the operator terminal 20, and the camera 30 are communicatively connected to each other via a communication network N realized by the Internet, a dedicated line, or the like.

[0041] The server device 10 is installed in a cloud environment, an on-premise environment, an edge environment, etc. The operator terminal 20 is installed in a monitoring room or the like of a facility or equipment managed by an operator O. The camera 30 is installed at a monitoring target base that is a monitoring site of the facility or equipment.

[0042] (2-2. Configuration and Processing Examples of Server Device 10) An example of the configuration and processing of the server device 10 will be described with reference to Fig. 3. The server device 10 is an information providing device, and includes an input unit 11, an output unit 12, a communication unit 13, a storage unit 14, and a control unit 15.

[0043] (2-2-1. Input section 11) The input unit 11 is responsible for inputting various types of information to the server device 10. For example, the input unit 11 is realized by a mouse, a keyboard, etc., and accepts input of various types of information to the server device 10.

[0044] (2-2-2. Output section 12) The output unit 12 controls the output of various information from the server device 10. For example, the output unit 12 is realized by a display or the like, and displays various information stored in the server device 10.

[0045] (2-2-3. Communications Department 13) The communication unit 13 manages data communication with other devices. For example, the communication unit 13 performs data communication with each communication device via a router, etc. The communication unit 13 can also perform data communication with an operator's terminal (not shown).

[0046] (2-2-4. Storage section 14) The storage unit 14 stores various information referenced when the control unit 15 operates and various information acquired when the control unit 15 operates. The storage unit 14 is composed of a setting information storage unit 14a, a video data storage unit 14b, and an evaluation value storage unit 14c. Here, the storage unit 14 can be realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. Note that, in the example of FIG. 3, the storage unit 14 is installed inside the server device 10, but it may be installed outside the server device 10, or multiple storage units may be installed.

[0047] (2-2-4-1. Setting information storage unit 14a) The setting information storage unit 14a stores setting information. For example, the setting information storage unit 14a stores setting information received by a reception unit 15a of the control unit 15 described later. An example of data stored in the setting information storage unit 14a will now be described with reference to FIG. 4. FIG. 4 is a diagram showing an example of the setting information storage unit 14a of the server device 10 according to the embodiment. In the example of FIG. 4, the setting information storage unit 14a has items such as "monitoring target," "specified range," "area division," and "conversion information."

[0048] The term "monitoring target" refers to identification information for identifying a facility, equipment, or section for which the state is to be evaluated, such as an identification number or identification symbol for a manufacturing process in a plant. The term "designated range" refers to a range set by a user that includes each pixel in the video data for which an evaluation value is to be calculated, such as a range surrounded by a rectangle, a circle, a sector, a polygon, or any other shape in the video, as specified by the operator O on the setting screen. The term "area division" refers to a division that classifies the pigments of pixels in the video data, such as a primary color region, a whitish region, a blackish region, or the like, defined by the maximum or minimum value of saturation or brightness, as entered by the operator O on the setting screen. The term "conversion information" refers to a conversion value corresponding to the color information set by a user, such as a conversion table or conversion function indicating each conversion value corresponding to each hue in the color information of the primary color region, or fixed values ​​in the color information of the whitish region or blackish region, as entered by the operator O on the setting screen.

[0049] That is, FIG. 4 shows an example in which the following data is stored in the setting information storage unit 14a for the monitored object "manufacturing process #1": {specified range: "specified range #1", area division: "area division #1", conversion information: "conversion information #1"}, {specified range: "specified range #2", area division: "area division #2", conversion information: "conversion information #2"}, {specified range: "specified range #3", area division: "area division #3", conversion information: "conversion information #3"}, ...

[0050] (2-2-4-2. Video data storage unit 14b) The video data storage unit 14b stores video data. For example, the video data storage unit 14b stores video data acquired by an acquisition unit 15b of the control unit 15, which will be described later. Here, an example of data stored in the video data storage unit 14b will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of the video data storage unit 14b of the server device 10 according to the embodiment. In the example of FIG. 5, the video data storage unit 14b has items such as "monitoring target," "monitoring device," "time," and "video data."

[0051] "Monitoring target" refers to identification information for identifying the facility, equipment, or section whose condition is to be evaluated, such as the identification number or identification symbol of the plant's manufacturing process. "Monitoring equipment" refers to identification information for identifying the imaging equipment, such as the identification number or identification symbol of camera 30, which is a monitoring camera for the plant's manufacturing process. "Time" refers to the time of imaging by the imaging equipment, such as expressed in terms of year, month, day, hour, minute, and second. "Video data" refers to the video data at the time of imaging, such as still image video data, video video data, video video data including audio data, etc., captured every second.

[0052] That is, FIG. 5 shows an example in which the following data is stored in video data storage unit 14b for camera 30, which is a monitoring device identified by the monitored object "manufacturing process #1" and "camera #1": {time: "time #1", video data: "video data #1"}, {time: "time #2", video data: "video data #2"}, {time: "time #3", video data: "video data #3"}, ...

[0053] (2-2-4-3. Evaluation value storage unit 14c) The evaluation value storage unit 14c stores the evaluation value. For example, the evaluation value storage unit 14c stores the evaluation value calculated by a calculation unit 15c of the control unit 15, which will be described later. An example of data stored in the evaluation value storage unit 14c will be described with reference to FIG. 6. FIG. 6 is a diagram showing an example of the evaluation value storage unit 14c of the server device 10 according to the embodiment. In the example of FIG. 6, the evaluation value storage unit 14c has items such as "monitoring target", "specified range", "time", and "evaluation value".

[0054] "Monitoring target" refers to identification information for identifying a facility, equipment, or section for which the status is to be evaluated, such as an identification number or identification symbol for a manufacturing process in a plant. "Specified range" refers to a range set by a user that includes each pixel in the video data for which an evaluation value is to be calculated, such as a range surrounded by a rectangle, circle, sector, polygon, or any other shape in the video specified on a setting screen by operator O. "Time" refers to the time of shooting by a camera, such as the year, month, day, hour, minute, and second. "Evaluation value" refers to a numerical value for evaluating the status of the monitoring target, such as a numerical value corresponding to the temperature of the burner flame in a manufacturing process in a plant, or a numerical value indicating danger or safety.

[0055] That is, FIG. 6 shows an example in which data such as {time: "time #1", evaluation value: "evaluation value #1"}, {time: "time #2", evaluation value: "evaluation value #2"}, {time: "time #3", evaluation value: "evaluation value #3"}, ... are stored in evaluation value memory unit 14c for the specified range of evaluation values ​​identified by the monitored object "manufacturing process #1" and "specified range #1".

[0056] (2-2-5. Control unit 15) The control unit 15 controls the entire server device 10. The control unit 15 includes a reception unit 15a, an acquisition unit 15b, a calculation unit 15c, and a notification unit 15d. Here, the control unit 15 can be realized by, for example, an electronic circuit such as a central processing unit (CPU) or a micro processing unit (MPU), or an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[0057] (2-2-5-1. Reception section 15a) The reception unit 15a receives various types of information. The reception unit 15a stores the received various types of information in the storage unit 14. The setting information reception process (designated range reception process, area division reception process, and conversion information reception process) will be described below.

[0058] (Settings information reception process) The reception unit 15a executes a setting information reception process. For example, the reception unit 15a receives, as setting information, a specified range, an area division, and conversion information set on a setting screen of a user terminal of a user.

[0059] A specific example of the setting information reception process will be described. The reception unit 15a receives the following as setting information set by the operator O who manages the monitoring target "manufacturing process #1" via the operator terminal 20: {designated range: "designated range #1", area division: "area division #1", conversion information: "conversion information #1"}, {designated range: "designated range #2", area division: "area division #2", conversion information: "conversion information #2"}, {designated range: "designated range #3", area division: "area division #3", conversion information: "conversion information #3"}, ..., and stores them in the setting information storage unit 14a.

[0060] (Specified range reception process) The reception unit 15a executes a designated range reception process as the setting information reception process. For example, the reception unit 15a receives a designated range of video data. The reception unit 15a also receives a designated range by a user's operation on a video displayed on a setting screen of the user terminal of the user.

[0061] (Area division reception processing) The reception unit 15a executes an area division reception process as the setting information reception process. For example, the reception unit 15a receives area divisions indicating a primary color area, a whitish area, and a blackish area. The reception unit 15a also receives the area divisions by the user inputting saturation and brightness on the setting screen of the user terminal of the user.

[0062] (Conversion information reception process) The reception unit 15a executes a conversion information reception process as the setting information reception process. For example, the reception unit 15a receives conversion information (a conversion table, a conversion function, a fixed value) indicating a conversion value corresponding to color information. The reception unit 15a also receives conversion information including each conversion value corresponding to each hue. The reception unit 15a also receives conversion information including each conversion value corresponding to each saturation. The reception unit 15a also receives conversion information including each conversion value corresponding to each brightness. In the following, the conversion table, the conversion function, and the fixed value will be described as the conversion information.

[0063] (Conversion table) The reception unit 15a receives a conversion table indicating the relationship between each hue and each conversion value as the conversion information. For example, the reception unit 15a receives a conversion table capable of converting each hue from 0 to 360° into each conversion value. At this time, the reception unit 15a can also receive a conversion table capable of converting each saturation and each brightness into each conversion value.

[0064] (Conversion functions) The reception unit 15a receives, as the conversion information, a conversion function indicating a relationship between each hue and each conversion value. For example, the reception unit 15a receives a conversion function indicating a linear equation between predetermined hues. The reception unit 15a also receives a conversion function indicating a curved equation between predetermined hues. At this time, the reception unit 15a can also receive a conversion function indicating a linear equation or a curved equation between predetermined saturations or between predetermined brightnesses.

[0065] (Fixed value) The reception unit 15a receives fixed values ​​defined by region classification as conversion information. For example, the reception unit 15a receives fixed values ​​corresponding to the pigments of pixels classified as a white region as the region classification. The reception unit 15a also receives fixed values ​​corresponding to the pigments of pixels classified as a black region as the region classification. At this time, the reception unit 15a can also receive fixed values ​​corresponding to the pigments of pixels classified as a primary color region as the region classification.

[0066] (2-2-5-2. Acquisition part 15b) The acquiring unit 15b acquires various kinds of information. The acquiring unit 15b stores the acquired various kinds of information in the storage unit 14. The video data acquisition process will be described below.

[0067] (Video data acquisition process) The acquiring unit 15b executes a video data acquiring process. For example, the acquiring unit 15b acquires video data of a monitoring target captured by a camera 30, which is a photographing device. The acquiring unit 15b also acquires still image data or video data output by a camera 30 installed in a manufacturing process of a plant.

[0068] A specific example of the video data acquisition process will be described. The acquisition unit 15b acquires the video data {time: "time #1", video data: "video data #1"}, {time: "time #2", video data: "video data #2"}, {time: "time #3", video data: "video data #3"}, ... as video data generated by the camera 30, which is a monitoring device identified as "camera #1" installed in the monitoring target "manufacturing process #1", and transmitted to the server device 10, and stores the video data in the video data storage unit 14b.

[0069] (2-2-5-3. Calculation part 15c) The calculation unit 15c calculates various pieces of information. The calculation unit 15c refers to various pieces of information stored in the storage unit 14. The calculation unit 15c stores the calculation results in the storage unit 14. The evaluation value calculation process will be described below.

[0070] (Evaluation value calculation process) The calculation unit 15c executes an evaluation value calculation process. For example, the calculation unit 15c calculates an evaluation value for evaluating the state of the monitoring target based on the received conversion information (conversion table, conversion function, fixed value) and the acquired video data.

[0071] The calculation unit 15c calculates the evaluation value using each conversion value corresponding to the color information of each pixel of the video data included in the specified range. For example, the calculation unit 15c calculates the evaluation value using each conversion value corresponding to each hue of each pixel of the video data included in the specified range. At this time, the calculation unit 15c can also calculate the evaluation value using each conversion value corresponding to each saturation or each brightness of each pixel of the video data included in the specified range.

[0072] The calculation unit 15c calculates the evaluation value using conversion information set according to the region division. For example, the calculation unit 15c calculates the evaluation value for the pigment of a pixel classified as a primary color region as the region division using a conversion table or a conversion function as the conversion information. The calculation unit 15c also calculates the evaluation value for the pigment of a pixel classified as a white region or a black region as the region division using a fixed value as the conversion information.

[0073] The calculation unit 15c calculates the evaluation value using each conversion value corresponding to each hue of each pixel of the video data converted by the conversion function. For example, the calculation unit 15c calculates the evaluation value using each conversion value corresponding to each hue of each pixel of the video data converted by the conversion function indicating a linear equation or a curved equation.

[0074] The calculation unit 15c calculates the sum of the conversion values ​​corresponding to the hues of each pixel of the video data as the evaluation value. The calculation unit 15c also calculates the average of the conversion values ​​corresponding to the hues of each pixel of the video data as the evaluation value. Furthermore, the calculation unit 15c can convert the calculated sum or average into a value desired by the user using a predetermined coefficient set by the user as the evaluation value.

[0075] A specific example of the evaluation value calculation process will be described. First, the calculation unit 15c refers to {designated range: "designated range #1", area division: "area division #1", conversion information: "conversion information #1"} stored by the setting information storage unit 14a. Second, the calculation unit 15c refers to {time: "time #1", video data: "video data #1"}, {time: "time #2", video data: "video data #2"}, {time: "time #3", video data: "video data #3"} stored by the video data storage unit 14b. Third, the calculation unit 15c calculates {time: "time #1", evaluation value: "evaluation value #1"}, {time: "time #2", evaluation value: "evaluation value #2"}, {time: "time #3", evaluation value: "evaluation value #3"} as the evaluation value, and stores it in the evaluation value storage unit 14c.

[0076] (2-2-5-4. Notification section 15d) The notification unit 15d notifies various kinds of information. Note that the notification unit 15d may obtain the various kinds of information from the storage unit 14. The alarm notification process and the evaluation value notification process will be described below.

[0077] (Alarm notification processing) The notification unit 15d executes an alarm notification process. For example, when the calculated evaluation value exceeds a threshold, the notification unit 15d notifies the user of an alarm indicating an abnormality in the monitored object.

[0078] A specific example of the alarm notification process will be described. When the evaluation value "evaluation value #3" calculated by the calculation unit 15c exceeds a threshold value, the notification unit 15d transmits "abnormal alarm #1" to the operator terminal 20 as alarm data indicating an abnormal state of the monitoring target "manufacturing process #1" and notifies the operator O by displaying the alarm indicated by "abnormal alarm #1" on the display of the operator terminal 20.

[0079] (Evaluation value notification process) The notification unit 15d executes an evaluation value notification process. For example, the notification unit 15d notifies the user of a table or graph showing the calculated evaluation value. At this time, the notification unit 15d notifies the user of a table showing the evaluation value for each shooting time as a table showing the calculated evaluation value. The notification unit 15d also notifies the user of a line graph showing the evaluation value for each shooting time, a histogram showing the distribution of the conversion value and the evaluation value, or the like as a graph showing the calculated evaluation value.

[0080] A specific example of the evaluation value notification process will be described. First, notification unit 15d refers to {time: "time #1", evaluation value: "evaluation value #1"}, {time: "time #2", evaluation value: "evaluation value #2"}, {time: "time #3", evaluation value: "evaluation value #3"} stored by evaluation value storage unit 14c. Second, notification unit 15d generates table data "tables #1-3" showing evaluation values ​​for each shooting time, line graph data "line graphs #1-3" showing evaluation values ​​for each shooting time, and histogram data "histograms #1-3" showing the distribution of conversion values ​​and evaluation values. Thirdly, the notification unit 15d transmits "Tables #1-3", "Line graphs #1-3", and "Histograms #1-3" to the operator terminal 20, and notifies the operator O by displaying the tables indicated by "Tables #1-3", the line graphs indicated by "Line graphs #1-3", and the histograms indicated by "Histograms #1-3" on the display of the operator terminal 20.

[0081] (2-3. Configuration and Processing Examples of Operator Terminal 20) 3 again, a description will be given of an example of the configuration and processing of the operator terminal 20. The operator terminal 20 is made up of an input / output unit 21, a transmitting / receiving unit 22, and a communication unit .

[0082] (2-3-1. Input / output section 21) The input / output unit 21 controls input of various information to the operator terminal 20. For example, the input / output unit 21 is realized by a mouse, a keyboard, a touch panel, or the like, and accepts input of various information to the operator terminal 20. The input / output unit 21 also controls display of various information from the operator terminal 20. For example, the input / output unit 21 is realized by a display, or the like, and displays various information stored in the operator terminal 20.

[0083] The input / output unit 21 also displays a setting screen that allows input of setting information by an operation of the operator O. The input / output unit 21 also displays an alarm indicated by alarm data transmitted from the server device 10, which is an information providing device. The input / output unit 21 also displays a table indicated by table data transmitted from the server device 10, or a graph indicated by graph data transmitted from the server device 10.

[0084] (2-3-2. Transmitter / receiver 22) The transmitting / receiving unit 22 transmits various types of information. For example, the transmitting / receiving unit 22 transmits to the server device 10 setting information input by the operator O via a setting screen.

[0085] The transmitting / receiving unit 22 receives various types of information. For example, the transmitting / receiving unit 22 receives alarm data transmitted from the server device 10. The transmitting / receiving unit 22 also receives table data or graph data transmitted from the server device 10.

[0086] (2-3-3. Communications Department 23) The communication unit 23 manages data communication with other devices. For example, the communication unit 23 performs data communication with each communication device via a router, etc. The communication unit 23 can also perform data communication with an operator's terminal (not shown).

[0087] (2-4. Configuration and Processing Examples of Camera 30) 3 again, a configuration example and a processing example of the camera 30 will be described. For example, the camera 30 is realized by a camera 30 that is a photographing device such as a surveillance camera or a security camera installed in a facility managed by an operator O, and is composed of a generation unit 31 and a communication unit 32.

[0088] (2-4-1. Generation unit 31) The generating unit 31 generates video data. For example, the generating unit 31 generates video data of still images and moving images by capturing images of the inside of a facility every second.

[0089] The generation unit 31 transmits the generated video data to the server device 10. For example, the generation unit 31 transmits the generated video data of a still image or a moving image to the server device 10.

[0090] (2-4-2. Communication section 32) The communication unit 32 is responsible for data communication with other devices. For example, the communication unit 32 performs data communication with each communication device via a router, etc. The communication unit 32 can also perform data communication with a terminal (not shown).

[0091] 3. Specific Examples of Processes in the Process Monitoring System 100 7 to 16, specific examples of each process of the process monitoring system 100 according to the embodiment will be described. Below, the basic principle of the HSV model, which is one of the color models used in the process monitoring system 100, will be explained, and then specific examples 1 to 4 of each process of the process monitoring system 100 will be described.

[0092] (3-1. Basic principles of the HSV model) Here, the basic principle of the HSV model used in the process monitoring system 100 will be described with reference to Figs. 7 to 9. Fig. 7 is a diagram for explaining the entire HSV model used in the process monitoring system 100 according to the embodiment. Fig. 8 is a diagram for explaining the hue of the HSV model used in the process monitoring system 100 according to the embodiment. Fig. 9 is a diagram for explaining the saturation and brightness of the HSV model used in the process monitoring system 100 according to the embodiment. In the following, the premise of the color model used in the process monitoring system 100 will be explained first, and then the elements of the HSV model will be explained.

[0093] (3-1-1. Color model premise) The premise of the color model used in the process monitoring system 100 will be explained. First, it is desirable that the color model used in the process monitoring system 100 is a color model that humans can use intuitively. For example, humans can easily specify and distinguish colors such as red and purple, but have difficulty recognizing colors such as (R255, B0, G0) and (C150, M200, Y0). For this reason, it is desirable that the color model used in the process monitoring system 100 matches human senses (senses that are familiar to us on a daily basis) as much as possible.

[0094] Here, we will explain the RGB model, which is a common color model for expressing colors in computers. The RGB model is a color model that expresses a wide range of colors through additive color mixing, which adjusts and mixes the amounts of the three primary colors red (R), green (G), and blue (B), making it easy to create light on a display, etc. On the other hand, in the RGB model, there are approximately 16.77 million combinations (RGB values) of red (R), green (G), and blue (B), making it difficult for a person to guess or specify RGB values ​​by looking at a color.

[0095] Secondly, it is desirable for the color model used in the process monitoring system 100 to have values ​​that do not change significantly due to the influence of sunlight and lighting. For example, in an actual monitoring site, the colors are not always exactly the same due to the influence of the amount of sunlight and lighting, so a color model in which the converted values ​​vary significantly due to differences in the amount of light makes it difficult to compare values ​​numerically. For this reason, it is desirable for the color model used in the process monitoring system 100 to have converted values ​​that do not change significantly even if the amount of light differs slightly.

[0096] For these reasons, it is desirable for the color model used in the process monitoring system 100 to be the HSV model, which satisfies the conditions of being "close to human intuition and easy to use" and "not easily affected by brightness, etc." The same applies to the HSB model.

[0097] (3-1-2. Elements of the HSV model) The elements of the HSV model used in the process monitoring system 100 will be described. The HSV model is a color model that expresses colors as a combination of three numerical values: hue, saturation, and value. The HSV model is characterized by being closer to human senses and easier to convey imagined colors than the RGB model, in which colors are determined by a combination of primary colors.

[0098] As shown by "H" in Fig. 7(1), hue indicates the circumference of a cylinder in the HSV model and is expressed as 0 to 360°. As shown by "S" in Fig. 7(2), saturation indicates the distance from the center to the circumference of a cylinder in the HSV model and is expressed as 0 to 255. As shown by "V" in Fig. 7(2), lightness indicates the height from the bottom to the top of a cylinder in the HSV model and is expressed as 0 to 255.

[0099] As shown in Figure 8(1), the hue is represented by a hue wheel where "H60" corresponds to "yellow," "H120" corresponds to "green," "H180" corresponds to "cyan," "H240" corresponds to "blue," "H300" corresponds to "magenta," and "H360" ("H0") corresponds to "red." Also, as shown in Figure 8(2), the hue is represented by a hue scale showing a scale of 0 to 360 degrees and the corresponding colors.

[0100] As shown in Figure 9, saturation and brightness are expressed on a two-dimensional scale that indicates the corresponding color and the scale from 0 to 255. Here, the higher the saturation and brightness, the closer the color is to the primary color. Also, the lower the saturation and the higher the brightness, the closer the color is to white. Also, the lower the brightness, the closer the color is to black.

[0101] (3-2. Specific Example 1) Here, a specific example 1 of each process of the process monitoring system 100 will be described with reference to Fig. 10. Fig. 10 is a diagram showing a specific example 1 of each process of the process monitoring system 100 according to the embodiment. In the following, the premise of the HSV model used in the process monitoring system 100 will be described, and then a specific example of the area division classification process executed by the server device 10 of the process monitoring system 100 will be described.

[0102] (3-2-1. Assumptions of the HSV model) The premise of the HSV model used in the process monitoring system 100 will be described. First, in the HSV model, when the brightness is low, any hue appears blackish. Second, in the HSV model, when the saturation is low and the brightness is high, any hue appears whitish. Third, in the HSV model, since there is no black or white on the color wheel, "white" or "black" cannot be selected.

[0103] (3-2-2. Area classification) The area division based on the HSV model used in the process monitoring system 100 will be described. Based on the above premise, the server device 10 classifies the area into three areas, "primary color area", "whitish area", and "black area", according to saturation and brightness. The server device 10 also sets conversion information according to each of the classified area divisions. The conversion information for the area divisions of the primary color area, the whitish area, and the black area will be described below.

[0104] (3-2-2-1.Primary color area) The conversion information of the area division of the primary color area will be described. As shown in the example of Fig. 10(1), the server device 10 classifies pigments that have a predetermined saturation or more and a predetermined brightness or more into the primary color area. At this time, the server device 10 uses, as the conversion information, a conversion table capable of converting each hue from 0 to 360° into each conversion value, or a conversion function indicating a linear equation or a curved equation capable of converting a hue between predetermined hues into a conversion value.

[0105] (3-2-2-2. White area) The conversion information for the area division of the whitish region will be described. As shown in the example of FIG. 10(2), the server device 10 classifies pigments that are less than a predetermined saturation and have a predetermined brightness or more into the whitish region. At this time, the server device 10 uses a fixed value set for the pigments in the whitish region as the conversion information. Note that the server device 10 can also use a conversion table or a conversion function as the conversion information, similar to the pigments in the primary color region.

[0106] (3-2-2-3. Black area) The conversion information for the black region division will be described. As shown in the example of FIG. 10(3), the server device 10 classifies pigments that show a brightness less than a predetermined value into the black region. At this time, the server device 10 uses a fixed value set for the pigments in the black region as the conversion information. Note that the server device 10 can also use a conversion table or a conversion function as the conversion information, similar to the pigments in the primary color region.

[0107] (3-3. Specific Example 2) Here, a specific example 2 of each process of the process monitoring system 100 will be described with reference to Fig. 11. Fig. 11 is a diagram showing a specific example 2 of each process of the process monitoring system 100 according to the embodiment. Below, a specific example of the conversion value output process and the evaluation value calculation process executed by the server device 10 of the process monitoring system 100 will be described.

[0108] (3-3-1. Specific example of conversion value output process) A specific example of the conversion value output process of the process monitoring system 100 will be described. In the example of Fig. 11(1), the server device 10 outputs a conversion value of "10" for light blue (horizontal lines), which is a pigment in the primary color region, using the conversion information. The server device 10 also outputs a conversion value of "30" for yellow (diagonal lines), which is a pigment in the primary color region, using the conversion information. The server device 10 also outputs a conversion value of "50" for orange (vertical lines), which is a pigment in the primary color region, using the conversion information.

[0109] (3-3-2. Specific example of evaluation value calculation process) A specific example of the evaluation value calculation process of the process monitoring system 100 will be described. In the example of Fig. 11(2), the server device 10 calculates a total of "200" and an average of "12.5" as the evaluation value, since, out of the 16 pixels (number of dyes) included in the specified range, the total of the conversion values ​​for light blue is 10 x 14 = 140, the total of the conversion values ​​for yellow is 30 x 2 = 60, and the total of the conversion values ​​for orange is 50 x 0 = 0.

[0110] In the example of Figure 11 (3), the server device 10 calculates the evaluation value as a sum of "240" and an average of "15" because, out of the 16 pixels (number of pigments) contained in the specified range, the sum of the conversion values ​​for light blue is 10 x 12 = 120, the sum of the conversion values ​​for yellow is 30 x 4 = 120, and the sum of the conversion values ​​for orange-red is 50 x 0 = 0.

[0111] In the example of Figure 11 (4), the server device 10 calculates the evaluation value as a sum of "440" and an average of "27.5" because, out of the 16 pixels (number of pigments) included in the specified range, the sum of the conversion values ​​for light blue is 10 x 6 = 60, the sum of the conversion values ​​for yellow is 30 x 6 = 180, and the sum of the conversion values ​​for orange is 50 x 4 = 200.

[0112] (3-4. Specific Example 3) Here, a specific example 3 of each process of the process monitoring system 100 will be described with reference to Fig. 12. Fig. 12 is a diagram showing a specific example 3 of each process of the process monitoring system 100 according to the embodiment. In the following, the premise of the conversion function used in the conversion value output process executed by the server device 10 of the process monitoring system 100 will be described, and then a straight line equation and a curve equation will be described as specific examples of the conversion function.

[0113] (3-4-1. Assumptions for conversion functions) The premise of the conversion function used in the conversion value output process of the process monitoring system 100 will be described. In the process monitoring system 100, the operator O needs to set each conversion value corresponding to each hue as conversion information. However, for example, setting each conversion value for each integer value of the hue from 0 to 360° places a heavy burden on the operator O. Therefore, in the process monitoring system 100, the conversion value can be obtained using a conversion function created by plotting several points between the hue and the conversion value. That is, in the process monitoring system 100, by using the conversion function, it is not necessary to set conversion values ​​corresponding to all hues, and the burden on the operator O can be further reduced.

[0114] (3-4-2. Example of conversion function 1: Linear equation) A linear equation will be described as a first specific example of a conversion function used in the conversion value output process of the process monitoring system 100. As shown in the example of Fig. 12(1), the server device 10 sets a linear conversion function that indicates hue on the horizontal axis and conversion value on the vertical axis and can convert hue between 0 and 360° into a conversion value. In the example of Fig. 12(1), the server device 10 uses the linear equation to output a conversion value of "25" that corresponds to a hue of "150".

[0115] (3-4-3. Example of conversion function 2: Curve equation) A curve equation will be described as a second specific example of the conversion function used in the conversion value output process of the process monitoring system 100. As shown in the example of Fig. 12(2), the server device 10 sets a curved conversion function that indicates hue on the horizontal axis and conversion value on the vertical axis and is capable of converting hue between 0 and 360° into a conversion value. In the example of Fig. 12(2), the server device 10 uses the curve equation to output a conversion value of "10" that corresponds to a hue of "150".

[0116] (3-5. Specific Example 4) 13 to 16, a fourth specific example of each process of the process monitoring system 100 will be described. A specific example of a setting screen displayed on the operator terminal 20 of the process monitoring system 100 will be described below.

[0117] (3-5-1. Example 1 of the setting screen: the entire setting screen) Here, a specific example 1 of the setting screen displayed by the operator terminal 20 will be described with reference to Fig. 13. Fig. 13 is a diagram showing a specific example 4-1 of each process of the process monitoring system 100 according to the embodiment. The specified range setting screen, and the conversion information setting screen and area division setting screen will be described below.

[0118] (3-5-1-1. Specified range setting screen) As shown in the example of FIG. 13(1), the operator terminal 20 displays a designated range setting screen that displays the video captured by the camera 30. In the example of FIG. 13(1), the operator terminal 20 displays a video of the vicinity of a burner in the manufacturing process of a plant as the designated range setting screen. At this time, the operator O can set the designated range of the video data by encircling a predetermined range on the displayed video with the pointer and clicking the image crop button (see FIG. 13(6)). Details of the designated range setting screen will be described later in (3-5-2. Specific example 2 of setting screen: designated range setting screen).

[0119] (3-5-1-2. Conversion information setting screen / area division setting screen) As shown in the example of FIG. 13(3), the operator terminal 20 displays a conversion information setting screen and an area division setting screen for inputting a conversion value corresponding to color information. In the example of FIG. 13(3), the operator terminal 20 displays, as the conversion information setting screen, a conversion value input text box in which a conversion value can be input, and a fixed value input text box in which a fixed value can be input. At this time, the operator O can set the conversion information by inputting a conversion value or a fixed value into each text box. In addition, when inputting a conversion value into each text box, the operator O can also select a hue for which a conversion value is to be set on the hue scale (see FIG. 13(2)). In addition, after inputting a conversion value into each text box, the operator O can set a conversion function and display a conversion function graph (see FIG. 13(4)) showing the conversion function by clicking the "Graph drawing" button. Details of the conversion information setting screen and the conversion function graph will be described later in (3-5-3. Specific example 3 of setting screen: Conversion information setting screen).

[0120] In the example of FIG. 13(3), the operator terminal 20 displays, as a region division setting screen, region division condition input text boxes in which saturation or brightness corresponding to the region divisions of the primary color region, the whitish region, and the blackish region can be input. At this time, the operator O can set the region division conditions by inputting saturation or brightness in each text box. In addition, the operator O can set the region division conditions by inputting saturation or brightness corresponding to the region division in each text box, and can display a region division graph (see FIG. 13(5)) indicating the region division. Details of the region division setting screen and the region division graph will be described later in (3-5-4. Specific example 4 of setting screen: region division setting screen).

[0121] (3-5-2. Example of setting screen 2: Specified range setting screen) Here, a specific example 2 of the setting screen displayed by the operator terminal 20 will be described with reference to Fig. 14. Fig. 14 is a diagram showing a specific example 4-2 of each process of the process monitoring system 100 according to the embodiment. In the following, the video display screen and the video detail screen will be described as details of the designated range setting screen.

[0122] (3-5-2-1. Video display screen) 14(1), the operator terminal 20 displays, as a designated range setting screen, a video display screen showing a video of the vicinity of a burner in a manufacturing process of a plant. At this time, the operator O can specify a rectangular range including a flame by encircling a predetermined range with a pointer on the video of the vicinity of the burner in the manufacturing process of the plant displayed on the video display screen.

[0123] At this time, the operator O can specify a range of any shape, including a rectangle, a circle, a sector, a polygon, etc. The operator O can also specify the range by inputting coordinate values ​​corresponding to the specified range of the video data.

[0124] (3-5-2-2. Video details screen) As shown in the example of Fig. 14(2), the operator terminal 20 displays a video detail screen corresponding to the designated range as a designated range setting screen. In the example of Fig. 14(2), the operator terminal 20 displays, as the video detail screen, the designated range video shown in (a), the hue histogram shown in (b), and the evaluation value histogram shown in (c).

[0125] In the example of Figure 14(2)(a), the operator terminal 20 displays a specified range image corresponding to the specified range cut out by the operator O, and displays pixels in the horizontal direction of the image on the horizontal axis and pixels in the vertical direction of the image on the vertical axis.

[0126] In the example of FIG. 14(2)(b), the operator terminal 20 displays a hue histogram showing the distribution of hues in the video data of a specified range, along with displaying hue on the horizontal axis and the sum of the conversion values ​​of hues with the same numerical value on the vertical axis.

[0127] In the example of FIG. 14(2)(c), the operator terminal 20 displays an evaluation value histogram showing the distribution of evaluation values ​​in the video data of the specified range, with the evaluation value displayed on the horizontal axis and the sum of the conversion values ​​of hues with the same numerical value displayed on the vertical axis, as well as the average value of the conversion values ​​in the video data of the specified range.

[0128] (3-5-3. Example 3 of the setting screen: Conversion information setting screen) Here, a specific example 3 of the setting screen displayed by the operator terminal 20 will be described with reference to Fig. 15. Fig. 15 is a diagram showing a specific example 4-3 of each process of the process monitoring system 100 according to the embodiment. In the following, a conversion information input text box and a conversion function graph screen will be described as details of the conversion information setting screen.

[0129] (3-5-3-1. Conversion information input text box) As shown in the example of Fig. 15(1), the operator terminal 20 displays, as a conversion information setting screen, a conversion information input text box in which a conversion value or a fixed value corresponding to color information can be input. In the example of Fig. 15(1), the operator terminal 20 displays, as the conversion information input text box, a conversion value input text box shown in (a) and a fixed value input text box shown in (b).

[0130] In the example of Fig. 15(1)(a), the operator terminal 20 displays conversion value input text boxes in which conversion values ​​corresponding to hues can be input for the pigments of pixels classified into the area division of the primary color area. Also, in the example of Fig. 15(1)(a), the operator O inputs, into each of the conversion value input text boxes, a conversion value "30" corresponding to a hue "0", a conversion value "36" corresponding to a hue "60", a conversion value "24" corresponding to a hue "120", a conversion value "24" corresponding to a hue "180", a conversion value "24" corresponding to a hue "240", a conversion value "28" corresponding to a hue "300", and a conversion value "30" corresponding to a hue "360".

[0131] In the example of FIG. 15(1)(b), the operator terminal 20 displays a conversion value input text box into which a fixed value can be input for the pigment of a pixel classified into the area division of a whitish region. Similarly, the operator terminal 20 displays a conversion value input text box into which a fixed value can be input for the pigment of a pixel classified into the area division of a blackish region. In the example of FIG. 15(1)(b), the operator O inputs a fixed value of "36" for a pixel classified into the area division of a whitish region and a fixed value of "10" for a pixel classified into the area division of a blackish region into each of the conversion value input text boxes.

[0132] (3-5-3-2. Conversion function graph screen) As shown in the example of Fig. 15(2), the operator terminal 20 displays a conversion function graph showing the relationship between the hue and the conversion value as a setting screen that can be displayed or transitioned to from the conversion information setting screen. In the example of Fig. 15(2), the operator terminal 20 plots {hue: "0", conversion value: "30"}, {hue: "60", conversion value: "36"}, {hue: "120", conversion value: "24"}, {hue: "180", conversion value "24"}, {hue: "240", conversion value: "24"}, {hue: "300", conversion value: "28"}, and {hue: "360", conversion value: "30"} as a conversion function graph showing the relationship between the conversion value input by the operator O in the conversion value input text box and the hue, and creates and displays a conversion function graph in which each point is connected by a straight line.

[0133] (3-5-4. Example of setting screen 4: Area division setting screen) Here, a specific example 4 of the setting screen displayed by the operator terminal 20 will be described with reference to Fig. 16. Fig. 16 is a diagram showing a specific example 4-4 of each process of the process monitoring system 100 according to the embodiment. In the following, an area division condition input text box and an area division graph screen will be described as details of the area division setting screen.

[0134] (3-5-4-1. Area division condition input text box) As shown in the example of Fig. 16(1), the operator terminal 20 displays, as a region division setting screen, region division condition input text boxes in which region division conditions can be input. In the example of Fig. 16(1), the operator terminal 20 displays, as the region division condition input text boxes, a primary color region division condition input text box shown in (a), a whitish region division condition input text box shown in (b), and a blackish region division condition input text box shown in (c).

[0135] In the example of Fig. 16(1)(a), the operator terminal 20 displays a primary color region division condition input text box in which the saturation and lightness, which are the region division conditions of the primary color region, can be input. Also, in the example of Fig. 16(1)(a), the operator O inputs "0.3" as the minimum saturation value and "0.4" as the minimum lightness value as the region division conditions of the primary color region.

[0136] In the example of Fig. 16(1)(b), the operator terminal 20 displays a whitish region division condition input text box in which the saturation and lightness, which are the region division conditions of the whitish region, can be input. Also, in the example of Fig. 16(1)(b), the operator O inputs "0.3" as the maximum saturation value and "0.6" as the minimum lightness value as the region division conditions of the whitish region.

[0137] In the example of Fig. 16(1)(c), the operator terminal 20 displays a black region division condition input text box in which the lightness, which is the region division condition of the black region, can be input. Also, in the example of Fig. 16(1)(c), the operator O inputs "0.3" as the maximum lightness as the region division condition of the black region.

[0138] (3-5-4-2. Area division graph screen) As shown in the example of Fig. 16(2), the operator terminal 20 displays an area division graph showing the relationship between area division conditions and area divisions as a setting screen that can be displayed or transitioned to from the area division setting screen. In the example of Fig. 16(2), the operator terminal 20 displays, as the area division graph, a primary color area shown in (a), a whitish area shown in (b), and a blackish area shown in (c).

[0139] In the example of Fig. 16(2)(a), the operator terminal 20 displays a primary color region (shaded). Also, in the example of Fig. 16(2)(a), the operator terminal 20 displays {saturation: "0.3 to 1.0", brightness: "0.4 to 1.0"} as the region division conditions of the primary color region. Note that the operator terminal 20 can also set the saturation and brightness to values ​​from 0 to 255.

[0140] In the example of Fig. 16(2)(b), the operator terminal 20 displays a whitish area (shaded). Also, in the example of Fig. 16(2)(b), the operator terminal 20 displays {saturation: "0.0 to 0.3", brightness: "0.6 to 1.0"} as the area division conditions for the whitish area. Note that the operator terminal 20 can also set the saturation and brightness to values ​​from 0 to 255.

[0141] In the example of Fig. 16(2)(c), the operator terminal 20 displays a black region (diamond-shaped mesh). Also, in the example of Fig. 16(2)(c), the operator terminal 20 displays {brightness: "0.0 to 0.3"} as the region division condition for the black region. Note that the operator terminal 20 can also set the brightness to a value between 0 and 255.

[0142] 4. Flow of each process in the process monitoring system 100 17 to 21, the process flow of the process monitoring system 100 according to the embodiment will be described. In the following, the process flow of the entire process monitoring system 100 will be described, and then the setting information management process, video data management process, evaluation value management process, and alarm management process will be described as each process.

[0143] (4-1. Overall processing of the process monitoring system 100) The overall processing flow of the process monitoring system 100 according to the embodiment will be described with reference to Fig. 17. Fig. 17 is a flowchart showing an example of the overall processing flow of the process monitoring system 100 according to the embodiment. Note that the processing of steps S101 to S104 below can also be executed in a different order. Also, some of the processing of steps S101 to S104 below may be omitted.

[0144] (4-1-1. Setting information management process) First, the process monitoring system 100 executes a setting information management process (step S101). For example, the process monitoring system 100 manages the setting information set by the operator O by executing the processes of steps S201 to S204 described later.

[0145] (4-1-2. Video data management processing) Second, the process monitoring system 100 executes a video data management process (step S102). For example, the process monitoring system 100 manages the video data of the monitoring target captured by the camera 30 by executing the processes of steps S301 to S303 described below.

[0146] (4-1-3. Evaluation value management process) Third, the process monitoring system 100 executes an evaluation value management process (step S103). For example, the process monitoring system 100 executes the processes of steps S401 to S408 described below to manage an evaluation value for evaluating the state of a monitoring target.

[0147] (4-1-4. Alarm management processing) Fourth, the process monitoring system 100 executes an alarm management process (step S104). For example, the process monitoring system 100 executes the processes of steps S501 to S504 described below to manage alarms indicating abnormal conditions of the monitored object.

[0148] (4-2. Setting information management processing) A flow of the setting information management process of the process monitoring system 100 according to the embodiment will be described with reference to Fig. 18. Fig. 18 is a flowchart showing an example of the flow of the setting information management process of the process monitoring system 100 according to the embodiment. Note that the processes of steps S201 to S204 below can also be executed in a different order. Also, some of the processes of steps S201 to S204 below may be omitted.

[0149] (4-2-1. Specified range reception process) First, the server device 10 executes a designated range receiving process (step S201). For example, the server device 10 receives a designated range of video data set by the operator O via the operator terminal 20.

[0150] (4-2-2. Area classification reception process) First, the server device 10 executes an area division receiving process (step S202). For example, the server device 10 receives area divisions of a primary color area, a white area, and a black area set by the operator O via the operator terminal 20.

[0151] (4-2-3. Conversion information reception process) First, the server device 10 executes a conversion information reception process (step S203). For example, the server device 10 receives conversion information such as a conversion table, a conversion function, and a fixed value set by the operator O via the operator terminal 20.

[0152] (4-2-4. Setting information storage process) Fourth, the server device 10 executes a setting information storage process (step S204) and ends the setting information management process. For example, the server device 10 stores the setting information including the designated range, area division, and conversion information of the video data in the setting information storage unit 14a.

[0153] (4-3. Video data management processing) The flow of the video data management process of the process monitoring system 100 according to the embodiment will be described with reference to Fig. 19. Fig. 19 is a flowchart showing an example of the flow of the video data management process of the process monitoring system 100 according to the embodiment. Note that the processes of steps S301 to S303 below can also be executed in a different order. Also, some of the processes of steps S301 to S303 below may be omitted.

[0154] (4-3-1. Video data generation process) First, the camera 30 executes a video data generation process (step S301). For example, the camera 30 captures an image of a monitoring target and generates video data of a still image or a moving image.

[0155] (4-3-2. Video data acquisition process) Secondly, the server device 10 executes a video data acquisition process (step S302). For example, the server device 10 acquires video data of still images or moving images generated by the camera 30.

[0156] (4-3-3. Video data storage processing) Third, the server device 10 executes a video data storage process (step S303), and ends the video data management process. For example, the server device 10 stores the video data of a still image or a moving image acquired from the camera 30 in the video data storage unit 14b.

[0157] (4-4. Evaluation value management process) The flow of evaluation value management processing in the process monitoring system 100 according to the embodiment will be described with reference to Fig. 20. Fig. 20 is a flowchart showing an example of the flow of evaluation value management processing in the process monitoring system 100 according to the embodiment. Note that the processing in steps S401 to S408 below may be executed in a different order. Also, some of the processing in steps S401 to S408 below may be omitted.

[0158] (4-4-1. Setting information reference process) First, the server device 10 executes a setting information reference process (step S401). For example, the server device 10 refers to setting information including a designated range, an area division, and conversion information of the video data stored in the setting information storage unit 14a.

[0159] (4-4-2. Video data reference processing) Secondly, the server device 10 executes a video data reference process (step S402). For example, the server device 10 refers to the video data stored in the video data storage unit 14b.

[0160] (4-4-3. Specified range identification processing) Thirdly, the server device 10 executes a designated range specification process (step S403). For example, the server device 10 specifies a designated range of the video data by using the designated range indicated by the setting information.

[0161] (4-4-4. HSV value conversion process) Fourth, the server device 10 executes an HSV value conversion process (step S404). For example, the server device 10 converts color information of each pixel included in the specified range of the video data into an HSV value, which is a combination of hue, saturation, and brightness.

[0162] (4-4-5. Area division classification processing) Fifth, the server device 10 executes an area division classification process (step S405). For example, the server device 10 classifies the pigments of each pixel into an area division of a primary color area, a white area, and a black area using the area division indicated by the setting information.

[0163] (4-4-6. Conversion value output processing) Sixth, the server device 10 executes a conversion value output process (step S406). For example, the server device 10 outputs a conversion value of each pixel using conversion information according to the classified area division.

[0164] (4-4-7. Conversion value aggregation process) Seventh, the server device 10 executes a conversion value tallying process (step S407). For example, the server device 10 tallies the conversion values ​​of each output pixel, and calculates the sum or average of the conversion values ​​of all pixels as an evaluation value. At this time, the server device 10 can also create a table or graph showing the conversion values ​​or evaluation values.

[0165] (4-4-8. Evaluation value storage process) Eighth, the server device 10 executes an evaluation value storage process (step S408), and ends the evaluation value management process. For example, the server device 10 stores the calculated evaluation value in the evaluation value storage unit 14c.

[0166] (4-5. Alarm management processing) The flow of video data management processing in the process monitoring system 100 according to the embodiment will be described with reference to Fig. 21. Fig. 21 is a flowchart showing an example of the flow of alarm management processing in the process monitoring system 100 according to the embodiment. Note that the processing in steps S501 to S504 below can also be executed in a different order. Also, some of the processing in steps S501 to S504 below may be omitted.

[0167] (4-5-1. Evaluation value reference process) First, the server device 10 executes an evaluation value reference process (step S501). For example, the server device 10 refers to the evaluation value stored in the evaluation value storage unit 14c. At this time, if the evaluation value exceeds the threshold (step S502: Yes), the server device 10 proceeds to the process of step S503. On the other hand, if the evaluation value does not exceed the threshold (step S502: No), the server device 10 proceeds to the process of step S504.

[0168] (4-5-2. Alarm notification processing) Secondly, the server device 10 executes an alarm notification process (step S503). For example, the server device 10 transmits alarm data indicating an abnormal state of the monitoring target to the operator terminal 20 and causes the operator terminal 20 to display the alarm, thereby notifying the operator O of the alarm.

[0169] (4-5-3. Evaluation value notification processing) Thirdly, the server device 10 executes an evaluation value notification process (step S504) and ends the alarm management process. For example, the server device 10 transmits table data or graph data indicating the evaluation value to the operator terminal 20 and causes the operator terminal 20 to display the table or graph indicating the evaluation value, thereby notifying the operator O of the evaluation value.

[0170] 5. Effects of the embodiment Finally, effects of the embodiment will be described below: Effects 1 to 13 corresponding to the processing according to the embodiment will be described below.

[0171] (5-1. Effect 1) First, in the process according to the embodiment described above, the server device 10 receives conversion information including conversion values ​​corresponding to each hue, acquires video data of the monitoring target captured by the camera 30, and calculates an evaluation value for evaluating the state of the monitoring target based on the received conversion information and the acquired video data. Therefore, in this process, the state of the monitoring target can be effectively grasped.

[0172] (5-2. Effect 2) Secondly, in the process according to the embodiment described above, the server device 10 accepts a designated range of video data, and calculates an evaluation value using each conversion value corresponding to each hue of each pixel of the video data included in the designated range. Therefore, in this process, the state of the monitoring target designated by the operator O can be effectively grasped.

[0173] (5-3. Effect 3) Thirdly, in the process according to the embodiment described above, the server device 10 accepts a range designated by an operation of the operator O on the image displayed on the setting screen of the operator terminal 20 of the operator O. Therefore, in this process, it is possible to effectively grasp the state of a monitoring target designated by the operator O who is monitoring in real time.

[0174] (5-4. Effect 4) Fourth, in the process according to the embodiment described above, the server device 10 receives area divisions indicating the primary color area, the whitish area, and the blackish area, and calculates the evaluation value using conversion information set according to the area division. Therefore, in this process, the state of the monitored object can be effectively grasped by adopting a conversion method according to the pigments of the different area divisions.

[0175] (5-5. Effect 5) Fifth, in the process according to the embodiment described above, the server device 10 accepts the area division by the operator O inputting the saturation and brightness on the setting screen of the operator terminal 20 of the operator O. Therefore, in this process, by adopting a conversion method according to the pigment of the area division that takes into account not only the hue but also the saturation or brightness, it is possible to effectively grasp the state of the monitored object.

[0176] (5-6. Effect 6) Sixth, in the process according to the embodiment described above, the server device 10 receives a conversion function indicating the relationship between each hue and each conversion value as conversion information, and calculates an evaluation value using each conversion value corresponding to each hue of each pixel of the video data converted by the conversion function. Therefore, in this process, by adopting a conversion function that makes it easy to set the conversion information, the state of the monitored object can be effectively grasped.

[0177] (5-7. Effect 7) Seventh, in the process according to the embodiment described above, the server device 10 receives a conversion function that indicates a linear equation between predetermined hues. Therefore, in this process, by adopting a linear equation as a conversion function that makes it easy to set the conversion information, the state of the monitored object can be effectively grasped.

[0178] (5-8. Effect 8) Eighth, in the process according to the embodiment described above, the server device 10 receives the conversion function indicating a curved equation between predetermined hues. Therefore, in this process, by adopting a curved equation as a conversion function that makes it easy to set the conversion information, the state of the monitored object can be effectively grasped.

[0179] (5-9. Effect 9) Ninth, in the process according to the embodiment described above, the server device 10 calculates the sum of the conversion values ​​corresponding to the hues of the pixels of the video data as the evaluation value. Therefore, in this process, the intensity of the entire video is calculated as the evaluation value, so that the state of the monitored object can be effectively grasped.

[0180] (5-10. Effect 10) Tenth, in the process according to the embodiment described above, the server device 10 calculates the average value of each conversion value corresponding to each hue of each pixel of the video data as the evaluation value. Therefore, in this process, the state of the monitored object can be effectively grasped by calculating the average intensity of the video as the evaluation value.

[0181] (5-11. Effect 11) Eleventh, in the process according to the embodiment described above, when the calculated evaluation value exceeds a threshold value, the server device 10 notifies the operator O of an alarm indicating an abnormality in the monitored object. Therefore, in this process, the operator O can effectively grasp the state of the monitored object without constantly monitoring it.

[0182] (5-12. Effect 12) Twelfth, in the process according to the embodiment described above, the server device 10 notifies the operator O of a table or a graph showing the calculated evaluation value. Therefore, in this process, the operator O can effectively grasp the past state of the monitoring target.

[0183] (5-13. Effect 13) Thirteenth, in the process according to the embodiment described above, the server device 10 acquires still image data or video data output by the camera 30 installed in the manufacturing process of the plant. Therefore, in this process, the state of the manufacturing process of the plant, which requires safety and urgency, can be effectively grasped.

[0184] 6. Application Examples of the Embodiments Application examples of the embodiment will be described below. Application examples 1 to 8 of the embodiment will be described below.

[0185] (6-1. Application Example 1) As a first application example of the embodiment, it is possible to detect impurities in iron ore flowing on a conveyor belt in a manufacturing process of a plant.

[0186] (6-2. Application Example 2) As a second application example of the embodiment, it is possible to detect impurities contained in a fluid flowing through a pipe in a manufacturing process of a plant.

[0187] (6-3. Application example 3) As a third application example of the embodiment, it is possible to detect an abnormality in the water level or water flow of a fluid flowing through a pipe in a manufacturing process of a plant.

[0188] (6-4. Application Example 4) As a fourth application example of the embodiment, it is possible to detect distortion due to pressure in pipes or tanks in a manufacturing process of a plant.

[0189] (6-5. Application Example 5) As a fifth application example of the embodiment, it is possible to detect an abnormality in a product moving along a conveyer belt in a manufacturing process in a plant.

[0190] (6-6. Application Example 6) As a sixth application example of the embodiment, it is possible to detect an abnormality in smoke emitted from a chimney in a manufacturing process of a plant.

[0191] (6-7. Application Example 7) As a seventh application example of the embodiment, it is possible to detect the intrusion of people or animals into buildings, farmland, and the like.

[0192] (6-8. Application Example 8) As an eighth application example of the embodiment, it is possible to detect abnormalities in parks, roads, rivers, and the like.

[0193] [7. System] The information including the processing procedures, control procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified.

[0194] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure. In other words, all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0195] Furthermore, each processing function performed by each device may be realized, in whole or in part, by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware using wired logic.

[0196] [8. Hardware] Next, a hardware configuration example of the server device 10, which is an information providing device, will be described. Note that other devices may have a similar hardware configuration. FIG. 22 is a diagram for explaining a hardware configuration example according to an embodiment. As shown in FIG. 22, the server device 10 has a communication device 10a, a HDD (Hard Disk Drive) 10b, a memory 10c, and a processor 10d. Furthermore, each unit shown in FIG. 22 is connected to each other via a bus or the like.

[0197] The communication device 10a is a network interface card or the like, and communicates with other servers. The HDD 10b stores programs and databases that operate the functions shown in FIG.

[0198] The processor 10d reads out a program that executes the same processes as the respective processing units shown in Fig. 3 from the HDD 10b etc. and loads it in the memory 10c, thereby operating a process that executes each function described in Fig. 3 etc. For example, this process executes a function similar to that of each processing unit possessed by the server device 10. Specifically, the processor 10d reads out a program having functions similar to those of the reception unit 15a, the acquisition unit 15b, the calculation unit 15c, the notification unit 15d etc. from the HDD 10b etc. Then, the processor 10d executes a process that executes the same processes as those of the reception unit 15a, the acquisition unit 15b, the calculation unit 15c, the notification unit 15d etc.

[0199] In this way, the server device 10 operates as a device that executes various processing methods by reading and executing the programs. The server device 10 can also realize functions similar to those of the above-described embodiment by reading the programs from a recording medium using a media reading device and executing the read programs. Note that the programs of the embodiment are not limited to being executed by the server device 10. For example, the present invention can be similarly applied to cases where other computers or servers execute the programs, or where these execute the programs in cooperation with each other.

[0200] This program can be distributed via a network such as the Internet. This program can also be recorded on a computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, a magneto-optical disk (MO), or a digital versatile disk (DVD), and can be executed by being read out from the recording medium by a computer.

[0201] [9. Others] Some examples of combinations of the disclosed technical features are set out below.

[0202] (1) An information providing device comprising: a receiving unit that receives conversion information including conversion values ​​corresponding to each hue; an acquisition unit that acquires video data of a monitoring target captured by a photographing device; and a calculation unit that calculates an evaluation value that evaluates a state of the monitoring target based on the received conversion information and the acquired video data.

[0203] (2) The information providing device described in (1), wherein the reception unit receives a specified range of the video data, and the calculation unit calculates the evaluation value using the conversion values ​​corresponding to the hues of each pixel of the video data included in the specified range.

[0204] (3) The information providing device according to (2), wherein the reception unit receives the specified range through operation by the user on an image displayed on a setting screen of the user terminal of the user.

[0205] (4) An information providing device described in any one of (1) to (3), wherein the reception unit receives area divisions indicating a primary color area, a white area, and a black area, and the calculation unit calculates the evaluation value using the conversion information set according to the area division.

[0206] (5) The information providing device according to (4), wherein the reception unit receives the area division by the user inputting saturation and brightness on a setting screen of the user terminal of the user.

[0207] (6) An information providing device according to any one of (1) to (5), wherein the reception unit receives a conversion function indicating a relationship between each of the hues and each of the conversion values ​​as the conversion information, and the calculation unit calculates the evaluation value using each of the conversion values ​​corresponding to each of the hues of each pixel of the video data converted by the conversion function.

[0208] (7) The information providing device according to (6), wherein the reception unit receives the conversion function indicating a linear equation between predetermined hues.

[0209] (8) The information providing device according to (6), wherein the reception unit receives the conversion function indicating a curved equation between predetermined hues.

[0210] (9) The information providing device according to any one of (1) to (8), wherein the calculation unit calculates, as the evaluation value, a sum of the conversion values ​​corresponding to the hues of each pixel of the video data.

[0211] (10) The information providing device according to any one of (1) to (9), wherein the calculation unit calculates, as the evaluation value, an average value of the conversion values ​​corresponding to the hues of each pixel of the video data.

[0212] (11) The information providing device according to any one of (1) to (10), further comprising a notification unit that notifies a user of an alarm indicating an abnormality in the monitored object when the calculated evaluation value exceeds a threshold value.

[0213] (12) The information providing device according to any one of (1) to (11), further comprising a notification unit that notifies a user of a table or graph showing the calculated evaluation value.

[0214] (13) The information providing device according to any one of (1) to (12), wherein the acquisition unit acquires still image data or video data output by the imaging device installed in a manufacturing process of a plant.

[0215] (14) An information providing method in which a computer receives conversion information including conversion values ​​corresponding to each hue, acquires video data of a monitored object captured by a photographing device, and calculates an evaluation value for evaluating a state of the monitored object based on the received conversion information and the acquired video data.

[0216] (15) An information providing program that causes a computer to execute a process of receiving conversion information including conversion values ​​corresponding to each hue, acquiring video data of a monitored object captured by a photographing device, and calculating an evaluation value for evaluating a state of the monitored object based on the received conversion information and the acquired video data. [Explanation of symbols]

[0217] 10. Server equipment 10a Communication equipment 10b HDD 10c Memory 10d Processor 11 Input section 12 Output section 13. Communications Department 14 Storage section 14a Setting information storage section 14b Video data storage unit 14c Evaluation value storage unit 15 Control section 15a Reception 15b Acquisition part 15c Calculation part 15d Notification Department 20 Operator terminal 21 Input / output section 22 Transmitter / receiver 23 Communications Department 30 Camera 31 Generation part 32 Communications Department 100 Process Monitoring Systems N Communication Network O Operator

Claims

1. A reception unit that receives conversion information including each conversion value corresponding to each hue; an acquisition unit that acquires video data of a surveillance target captured by a photographing device; a calculation unit that calculates an evaluation value for evaluating a state of the monitoring target based on the received conversion information and the acquired video data; Equipped with The reception unit is receiving area divisions indicating a primary color area, a white area, and a black area; The calculation unit is Calculating the evaluation value using the conversion information set according to the area division. Information providing device.

2. The reception unit is Accepting a designated range of the video data; The calculation unit is calculating the evaluation value using the conversion values ​​corresponding to the hues of the pixels of the video data included in the specified range; 2. The information providing device according to claim 1.

3. The reception unit is accepting the designated range through an operation by the user on an image displayed on a setting screen of the user's user terminal; 3. The information providing device according to claim 2.

4. The reception unit is accepting the area division by the user inputting saturation and brightness on a setting screen of a user terminal of the user; 2. The information providing device according to claim 1.

5. The reception unit is receiving, as the conversion information, a conversion function indicating a relationship between each of the hues and each of the conversion values; The calculation unit is calculating the evaluation value using the conversion values ​​corresponding to the hues of the pixels of the video data converted by the conversion function; 2. The information providing device according to claim 1.

6. The reception unit is receiving the conversion function that indicates a linear equation between predetermined hues; 6. An information providing device according to claim 5.

7. The reception unit is receiving the conversion function that indicates a curve equation between predetermined hues; 6. An information providing device according to claim 5.

8. The calculation unit is calculating, as the evaluation value, a sum of the conversion values ​​corresponding to the respective hues of the respective pixels of the video data; The information providing device according to any one of claims 1 to 7.

9. The calculation unit is calculating an average value of the conversion values ​​corresponding to the hues of the pixels of the video data as the evaluation value; The information providing device according to any one of claims 1 to 7.

10. a notification unit that notifies a user of an alarm indicating an abnormality in the monitored object when the calculated evaluation value exceeds a threshold value; The information providing device according to claim 1 , further comprising:

11. a notification unit that notifies a user of a table or graph showing the calculated evaluation value; The information providing device according to claim 1 , further comprising:

12. The acquisition unit is acquiring still image data or video data output by the photographing device installed in the manufacturing process of the plant; The information providing device according to any one of claims 1 to 7.

13. The computer accepts transformation information including respective transformation values ​​corresponding to each hue; Acquire the video data of the surveillance subject captured by the imaging device, calculating an evaluation value for evaluating a state of the monitoring target based on the received conversion information and the acquired video data; Execute the process, receiving area divisions indicating a primary color area, a white area, and a black area; Calculating the evaluation value using the conversion information set according to the area division. Information provision method.

14. On the computer, accepts transformation information including respective transformation values ​​corresponding to each hue; Acquire the video data of the surveillance subject captured by the imaging device, calculating an evaluation value for evaluating a state of the monitoring target based on the received conversion information and the acquired video data; Execute the process, receiving area divisions indicating a primary color area, a white area, and a black area; Calculating the evaluation value using the conversion information set according to the area division. Informational program.

Images