Product production safety monitoring method and system based on scene driving and electronic equipment

Abstract

The invention provides a product production safety monitoring method and system based on scene driving and electronic equipment, and the method comprises the steps: S100, obtaining a first image of any production equipment in an actual production state in a factory area, processing the first image to obtain a contour line of the production equipment, determining the type of the production equipment according to the contour line, and calling a preset normal production temperature threshold value of the production equipment; s200, acquiring actual production temperature data of the production equipment; and S300, judging whether the production equipment is abnormal or not according to the actual production temperature data of the production equipment. According to the invention, in product production safety monitoring, the safety monitoring of each production device does not need to independently set a corresponding safety parameter threshold value, and the product production safety monitoring can be realized through an image processing mode, so that the intelligent degree of the system is improved to a great extent, the manual workload is greatly reduced, and the production efficiency is improved. And the application scene of the method is expanded to a great extent.

Description

Technical Field

[0001] The present invention relates to the technical field of scenario-driven product production safety monitoring solution design, and in particular to a scenario-driven product production safety monitoring method and system, and electronic equipment. Background Art

[0002] Object detection in computer vision has attracted widespread attention due to its numerous real-world application needs, such as autonomous driving, video surveillance, and robot vision. In object detection, the edges and contours of objects contain rich image information and represent the characteristics of the objects. Through edges and contours, people can identify objects more accurately. Therefore, contour extraction and contour fitting techniques are considered to be a very important part of object detection technology. In current product production safety monitoring, the safety monitoring of each production equipment requires the setting of corresponding safety parameter thresholds separately, which requires a huge amount of manual work.

[0003] Therefore, the prior art needs to be further developed. Summary of the invention

[0004] The purpose of the present invention is to overcome the above-mentioned technical deficiencies and provide a scenario-driven product production safety monitoring method and system, and electronic equipment to solve the problems existing in the prior art.

[0005] To achieve the above technical objectives, according to a first aspect of the present invention, the present invention provides a scenario-driven product production safety monitoring method, the method comprising:

[0006] S100, obtaining a first image of any production equipment in an actual production state in the factory, processing the first image to obtain a contour line of the production equipment, determining the type of the production equipment according to the contour line, and retrieving a preset normal production temperature threshold of the production equipment;

[0007] S200, obtaining actual production temperature data of the production equipment;

[0008] S300: Determine whether the production equipment is abnormal based on actual production temperature data of the production equipment.

[0009] Specifically, the acquiring of a first image of any production equipment in an actual production state in a factory, obtaining a contour line of the production equipment after processing the first image, and determining the type of the production equipment according to the contour line includes:

[0010] Obtain images of samples of each production equipment in the factory area, perform binarization processing, obtain a target binarized image, extract pixel points of the contour of the sample of each production equipment from the target binarized image, and obtain the target contour line of the sample of each production equipment;

[0011] After binarization processing is performed on the first image, a first binarized image is obtained, pixel points of the outline of the production equipment in the actual production state are extracted from the first binarized image, and a first contour line of the production equipment in the actual production state is obtained;

[0012] The first contour line is compared with the target contour line of the sample of each production equipment to confirm the type of the production equipment in the actual production state.

[0013] Specifically, comparing the first contour line with the target contour line of the sample of each production equipment to confirm the type of the production equipment in the actual production state includes:

[0014] The areas of the non-overlapping parts of the first contour line and the target contour lines are sorted according to their sizes, and the type of the production equipment in the actual production state is confirmed according to the target contour line corresponding to the minimum value.

[0015] Specifically, the step of sorting the areas of the non-overlapping parts of the first contour line and the target contour lines according to their sizes includes:

[0016] The target range is determined according to the non-overlapping parts of the first contour line and each of the target contour lines. Each of the target ranges needs to include the non-overlapping parts of the first contour line and each of the target contour lines. A target search box is established according to each target range, and the area of ​​the target search box is calculated, and the areas of the target search boxes are sorted according to size.

[0017] Specifically, the method further includes:

[0018] According to the type of the production equipment, the corresponding preset temperature threshold is retrieved, and the surface temperature of the production equipment is obtained at a first time interval using a temperature sensor arranged on the surface of the production equipment to determine whether the surface temperature of the production equipment is greater than or equal to the corresponding preset temperature threshold. Based on the determination result, it is determined whether the production equipment is abnormal.

[0019] Specifically, the determining whether the surface temperature of the production equipment is greater than or equal to a corresponding preset temperature threshold, and determining whether the production equipment is abnormal according to the determination result, includes:

[0020] If the surface temperature of the production equipment is greater than or equal to the corresponding preset temperature threshold, determine whether the production equipment is abnormal, and output an alarm signal related to the abnormality of the production equipment;

[0021] If the surface temperature of the production equipment is lower than the corresponding preset temperature threshold, the production equipment is judged to be normal, and a prompt signal indicating that the production equipment is normal is output.

[0022] Specifically, the method further includes:

[0023] According to the type of the production equipment, the corresponding preset temperature change rate threshold is retrieved, the temperature change rate of the production equipment is calculated using the surface temperature of the production equipment and the first time interval, it is determined whether the temperature change rate of the production equipment is greater than or equal to the preset temperature change rate threshold, and whether the production equipment is abnormal is determined based on the judgment result.

[0024] Specifically, the determining whether the temperature change rate of the production equipment is greater than or equal to a preset temperature change rate threshold, and determining whether the production equipment is abnormal according to the determination result, includes:

[0025] If the temperature change rate of the production equipment is greater than or equal to the corresponding preset temperature change rate threshold, determine whether the production equipment is abnormal, and output an alarm signal related to the abnormality of the production equipment;

[0026] If the temperature change rate of the production equipment is less than the corresponding preset temperature change rate threshold, the production equipment is judged to be normal, and a prompt signal indicating that the production equipment is normal is output.

[0027] According to a second aspect of the present invention, a scenario-driven product production safety monitoring system is provided, comprising:

[0028] An acquisition module, used to acquire a first image of any production equipment in an actual production state in the factory area; or used to acquire actual production temperature data of the production equipment;

[0029] A control module is used to obtain the contour line of the production equipment after processing the first image, determine the type of the production equipment according to the contour line, and call the preset normal production temperature threshold of the production equipment; or to determine whether the production equipment is abnormal according to the actual production temperature data of the production equipment.

[0030] According to a third aspect of the present invention, there is provided an electronic device, comprising: a memory; and a processor, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the above-mentioned scenario-driven product production safety monitoring method is implemented.

[0031] Beneficial effects:

[0032] The present invention obtains a first image of any production equipment in actual production status in the factory, processes the first image to obtain the contour of the production equipment, determines the type of the production equipment according to the contour, and retrieves the preset normal production temperature threshold of the production equipment; obtains the actual production temperature data of the production equipment; and determines whether the production equipment is abnormal according to the actual production temperature data of the production equipment. In the product production safety monitoring, the safety monitoring of each production equipment does not need to set the corresponding safety parameter threshold separately, and the product production safety monitoring can be realized by image processing, which greatly improves the intelligence level of the present invention, greatly reduces the manual workload, and greatly expands the application scenarios of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 is a flow chart of a scenario-driven product production safety monitoring method provided in a specific embodiment of the present invention;

[0034] Figure 2 It is a system composition diagram of a scenario-driven product production safety monitoring system provided in a specific embodiment of the present invention. DETAILED DESCRIPTION

[0035] In order to enable those skilled in the art to better understand the technical solution of the present invention, the technical solution of the present invention is clearly and completely described below in conjunction with the accompanying drawings of the present invention. Based on the embodiments in this application, other similar embodiments obtained by ordinary technicians in this field without making creative work should all fall within the scope of protection of this application. In addition, the directional words mentioned in the following embodiments, such as "up", "down", "left", "right", etc., are only reference to the directions of the accompanying drawings. Therefore, the directional words used are used to illustrate rather than limit the invention.

[0036] The present invention will be further described below in conjunction with the accompanying drawings and preferred embodiments.

[0037] See also Figure 1 The present invention provides a scenario-driven product production safety monitoring method, comprising:

[0038] S100, obtaining a first image of any production equipment in actual production status within the factory, obtaining a contour line of the production equipment after processing the first image, determining the type of the production equipment according to the contour line, and retrieving a preset normal production temperature threshold value of the production equipment.

[0039] It should be noted that the steps before step S100 include:

[0040] A preset normal production temperature threshold and a preset temperature change rate threshold for each production equipment are preset in the control module.

[0041] Specifically, the acquiring of a first image of any production equipment in an actual production state in a factory, obtaining a contour line of the production equipment after processing the first image, and determining the type of the production equipment according to the contour line includes:

[0042] Obtain images of samples of each production equipment in the factory area, perform binarization processing, obtain a target binarized image, extract pixel points of the contour of the sample of each production equipment from the target binarized image, and obtain the target contour line of the sample of each production equipment;

[0043] After binarization processing is performed on the first image, a first binarized image is obtained, pixel points of the outline of the production equipment in the actual production state are extracted from the first binarized image, and a first contour line of the production equipment in the actual production state is obtained;

[0044] The first contour line is compared with the target contour line of the sample of each production equipment to confirm the type of the production equipment in the actual production state.

[0045] Specifically, comparing the first contour line with the target contour line of the sample of each production equipment to confirm the type of the production equipment in the actual production state includes:

[0046] The areas of the non-overlapping parts of the first contour line and the target contour lines are sorted according to their sizes, and the type of the production equipment in the actual production state is confirmed according to the target contour line corresponding to the minimum value.

[0047] Specifically, the sorting of the areas of the non-overlapping parts of the first contour line and each of the target contour lines according to their sizes includes:

[0048] The target range is determined according to the non-overlapping parts of the first contour line and each of the target contour lines. Each of the target ranges needs to include the non-overlapping parts of the first contour line and each of the target contour lines. A target search box is established according to each target range, and the area of ​​the target search box is calculated, and the areas of the target search boxes are sorted according to size.

[0049] It should be noted here that the area of ​​the target search box is calculated as the area of ​​the rectangle enclosed by the upper left pixel point and the lower right pixel point of the target search box.

[0050] S200, obtaining actual production temperature data of the production equipment.

[0051] Specifically, the method further includes:

[0052] According to the type of the production equipment, the corresponding preset temperature threshold is retrieved, and the surface temperature of the production equipment is obtained at a first time interval using a temperature sensor arranged on the surface of the production equipment to determine whether the surface temperature of the production equipment is greater than or equal to the corresponding preset temperature threshold. Based on the determination result, it is determined whether the production equipment is abnormal.

[0053] S300: Determine whether the production equipment is abnormal based on actual production temperature data of the production equipment.

[0054] Specifically, the determining whether the surface temperature of the production equipment is greater than or equal to a corresponding preset temperature threshold, and determining whether the production equipment is abnormal according to the determination result, includes:

[0055] If the surface temperature of the production equipment is greater than or equal to the corresponding preset temperature threshold, it is determined whether the production equipment is abnormal, and an alarm signal regarding the abnormality of the production equipment is output.

[0056] It should be noted here that if the surface temperature of the production equipment is greater than or equal to the corresponding preset temperature threshold, it proves that the surface temperature of the production equipment is greater than or equal to the preset normal production temperature threshold when the production equipment is in normal production, proving that the surface temperature of the production equipment is abnormal. At this time, an alarm signal about the abnormality of the production equipment is output. In the product production safety monitoring, the safety monitoring of each production equipment does not need to set the corresponding safety parameter threshold separately, and the product production safety monitoring can be realized by image processing, which greatly improves the intelligence level of the present invention, greatly reduces the manual workload, and greatly expands the application scenarios of the present invention.

[0057] If the surface temperature of the production equipment is lower than the corresponding preset temperature threshold, the production equipment is judged to be normal, and a prompt signal indicating that the production equipment is normal is output.

[0058] Specifically, the method further includes:

[0059] According to the type of the production equipment, the corresponding preset temperature change rate threshold is retrieved, the temperature change rate of the production equipment is calculated using the surface temperature of the production equipment and the first time interval, it is determined whether the temperature change rate of the production equipment is greater than or equal to the preset temperature change rate threshold, and whether the production equipment is abnormal is determined based on the judgment result.

[0060] Specifically, the determining whether the temperature change rate of the production equipment is greater than or equal to a preset temperature change rate threshold, and determining whether the production equipment is abnormal according to the determination result, includes:

[0061] If the temperature change rate of the production equipment is greater than or equal to the corresponding preset temperature change rate threshold, it is determined whether the production equipment is abnormal, and an alarm signal regarding the abnormality of the production equipment is output.

[0062] It should be noted here that if the temperature change rate of the production equipment is greater than or equal to the corresponding preset temperature change rate threshold, it proves that the temperature change rate of the production equipment is greater than or equal to the preset temperature change rate threshold during normal production of the production equipment, proving that the temperature change rate of the production equipment is abnormal. At this time, an alarm signal about the abnormality of the production equipment is output. In the product production safety monitoring, the safety monitoring of each production equipment does not need to set the corresponding safety parameter threshold separately, and the product production safety monitoring can be realized by image processing, which further improves the intelligence level of the present invention, further reduces the manual workload, and further expands the application scenarios of the present invention.

[0063] If the temperature change rate of the production equipment is less than the corresponding preset temperature change rate threshold, the production equipment is judged to be normal, and a prompt signal indicating that the production equipment is normal is output.

[0064] It can be understood that the present invention obtains a first image of any production equipment in actual production status in the factory area, obtains the contour line of the production equipment after processing the first image, determines the type of the production equipment according to the contour line, and retrieves the preset normal production temperature threshold of the production equipment; obtains the actual production temperature data of the production equipment; and determines whether the production equipment is abnormal according to the actual production temperature data of the production equipment. In the product production safety monitoring, the safety monitoring of each production equipment does not need to set the corresponding safety parameter threshold separately, and the product production safety monitoring can be realized by image processing, which greatly improves the intelligence level of the present invention, greatly reduces the manual workload, and greatly expands the application scenarios of the present invention.

[0065] See also Figure 2 The present invention provides another embodiment, which provides a scenario-driven product production safety monitoring system, and the scenario-driven product production safety monitoring system includes:

[0066] The acquisition module 100 is used to acquire a first image of any production equipment in an actual production state in the factory area; or to acquire actual production temperature data of the production equipment;

[0067] The control module 200 is used to obtain the contour line of the production equipment after processing the first image, determine the type of the production equipment according to the contour line, and call the preset normal production temperature threshold of the production equipment; or to determine whether the production equipment is abnormal according to the actual production temperature data of the production equipment.

[0068] It should be noted here that the present invention obtains a first image of any production equipment in actual production status in the factory area, obtains the contour line of the production equipment after processing the first image, determines the type of the production equipment according to the contour line, and retrieves the preset normal production temperature threshold of the production equipment; obtains the actual production temperature data of the production equipment; and determines whether the production equipment is abnormal according to the actual production temperature data of the production equipment. In the product production safety monitoring, the safety monitoring of each production equipment does not need to set the corresponding safety parameter threshold separately, and the product production safety monitoring can be realized by image processing, which greatly improves the intelligence level of the present invention, greatly reduces the manual workload, and greatly expands the application scenarios of the present invention.

[0069] In a preferred embodiment, the present application further provides an electronic device, the electronic device comprising:

[0070] A memory; and a processor, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the scenario-driven product production safety monitoring method is implemented. The computer device can be broadly a server, a terminal, or any other electronic device with necessary computing and / or processing capabilities. In one embodiment, the computer device may include a processor, a memory, a network interface, a communication interface, etc. connected via a system bus. The processor of the computer device can be used to provide necessary computing, processing and / or control capabilities. The memory of the computer device may include a non-volatile storage medium and an internal memory. An operating system, a computer program, etc. may be stored in or on the non-volatile storage medium. The internal memory may provide an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface and the communication interface of the computer device can be used to connect and communicate with external devices through a network. When the computer program is executed by the processor, the steps of the method of the present invention are performed.

[0071] The present invention may be implemented as a computer-readable storage medium having a computer program stored thereon, which causes the steps of the method of an embodiment of the present invention to be executed when executed by a processor. In one embodiment, the computer program is distributed on a plurality of computer devices or processors coupled to a network so that the computer program is stored, accessed and executed in a distributed manner by one or more computer devices or processors. A single method step / operation, or two or more method steps / operations, may be performed by a single computer device or processor or by two or more computer devices or processors. One or more method steps / operations may be performed by one or more computer devices or processors, and one or more other method steps / operations may be performed by one or more other computer devices or processors. One or more computer devices or processors may perform a single method step / operation, or perform two or more method steps / operations.

[0072] It will be appreciated by those skilled in the art that the method steps of the present invention may be performed by instructing related hardware such as a computer device or a processor through a computer program, and the computer program may be stored in a non-temporary computer-readable storage medium, which causes the steps of the present invention to be performed when the computer program is executed. Depending on the circumstances, any reference to memory, storage, database, or other media herein may include non-volatile and / or volatile memory. Examples of non-volatile memory include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid state disk, etc. Examples of volatile memory include random access memory (RAM), external cache memory, etc.

[0073] It can be understood that the present invention obtains a first image of any production equipment in actual production status in the factory area, obtains the contour line of the production equipment after processing the first image, determines the type of the production equipment according to the contour line, and retrieves the preset normal production temperature threshold of the production equipment; obtains the actual production temperature data of the production equipment; and determines whether the production equipment is abnormal according to the actual production temperature data of the production equipment. In the product production safety monitoring, the safety monitoring of each production equipment does not need to set the corresponding safety parameter threshold separately, and the product production safety monitoring can be realized by image processing, which greatly improves the intelligence level of the present invention, greatly reduces the manual workload, and greatly expands the application scenarios of the present invention.

[0074] The various technical features described above can be combined arbitrarily. Although all possible combinations of these technical features are not described, any combination of these technical features should be considered to be covered by this specification as long as there is no contradiction in such combination.

[0075] The specific implementation of the present invention described above does not constitute a limitation on the protection scope of the present invention. Any other corresponding changes and modifications made based on the technical concept of the present invention should be included in the protection scope of the claims of the present invention.

Claims

1. A scenario-driven product production safety monitoring method, characterized in that: The method comprises: S100, obtaining a first image of any production equipment in an actual production state in the factory, obtaining a contour line of the production equipment after processing the first image, determining the type of the production equipment according to the contour line, and retrieving a preset normal production temperature threshold value of the production equipment; S200, obtaining actual production temperature data of the production equipment; S300: Determine whether the production equipment is abnormal based on actual production temperature data of the production equipment.

2. The scenario-driven product production safety monitoring method according to claim 1 is characterized in that: The step of acquiring a first image of any production equipment in actual production state in the factory, obtaining a contour line of the production equipment after processing the first image, and determining the type of the production equipment according to the contour line includes: Obtain images of samples of each production equipment in the factory area, perform binarization processing, obtain a target binarized image, extract pixel points of the contour of the sample of each production equipment from the target binarized image, and obtain the target contour line of the sample of each production equipment; After binarization processing is performed on the first image, a first binarized image is obtained, pixel points of the outline of the production equipment in the actual production state are extracted from the first binarized image, and a first contour line of the production equipment in the actual production state is obtained; The first contour line is compared with the target contour line of the sample of each production equipment to confirm the type of the production equipment in the actual production state.

3. The scenario-driven product production safety monitoring method according to claim 2 is characterized in that: The step of comparing the first contour line with the target contour line of the sample of each production equipment to confirm the type of the production equipment in the actual production state includes: The areas of the non-overlapping parts of the first contour line and the target contour lines are sorted according to their sizes, and the type of the production equipment in the actual production state is confirmed according to the target contour line corresponding to the minimum value.

4. The scenario-driven product production safety monitoring method according to claim 3 is characterized in that: The step of sorting the areas of the non-overlapping parts of the first contour line and the target contour lines according to their sizes includes: The target range is determined according to the non-overlapping parts of the first contour line and each of the target contour lines. Each of the target ranges needs to include the non-overlapping parts of the first contour line and each of the target contour lines. A target search box is established according to each target range, and the area of ​​the target search box is calculated, and the areas of the target search boxes are sorted according to size.

5. The scenario-driven product production safety monitoring method according to claim 1 is characterized in that: The method further comprises: According to the type of the production equipment, the corresponding preset temperature threshold is retrieved, and the surface temperature of the production equipment is obtained at a first time interval using a temperature sensor arranged on the surface of the production equipment to determine whether the surface temperature of the production equipment is greater than or equal to the corresponding preset temperature threshold. Based on the determination result, it is determined whether the production equipment is abnormal.

6. The scenario-driven product production safety monitoring method according to claim 5 is characterized in that: The determining whether the surface temperature of the production equipment is greater than or equal to a corresponding preset temperature threshold, and determining whether the production equipment is abnormal according to the determination result, includes: If the surface temperature of the production equipment is greater than or equal to the corresponding preset temperature threshold, determine whether the production equipment is abnormal, and output an alarm signal related to the abnormality of the production equipment; If the surface temperature of the production equipment is lower than the corresponding preset temperature threshold, the production equipment is judged to be normal, and a prompt signal indicating that the production equipment is normal is output.

7. The scenario-driven product production safety monitoring method according to claim 6 is characterized in that: The method further comprises: According to the type of the production equipment, the corresponding preset temperature change rate threshold is retrieved, the temperature change rate of the production equipment is calculated using the surface temperature of the production equipment and the first time interval, and it is determined whether the temperature change rate of the production equipment is greater than or equal to the preset temperature change rate threshold. Based on the judgment result, it is determined whether the production equipment is abnormal.

8. The scenario-driven product production safety monitoring method according to claim 7 is characterized in that: The determining whether the temperature change rate of the production equipment is greater than or equal to a preset temperature change rate threshold, and determining whether the production equipment is abnormal according to the determination result, includes: If the temperature change rate of the production equipment is greater than or equal to the corresponding preset temperature change rate threshold, determine whether the production equipment is abnormal, and output an alarm signal related to the abnormality of the production equipment; If the temperature change rate of the production equipment is less than the corresponding preset temperature change rate threshold, the production equipment is judged to be normal, and a prompt signal indicating that the production equipment is normal is output.

9. A scenario-driven product production safety monitoring system, characterized in that: The system comprises: An acquisition module, used to acquire a first image of any production equipment in an actual production state in the factory; or to acquire actual production temperature data of the production equipment; A control module is used to obtain the contour line of the production equipment after processing the first image, determine the type of the production equipment according to the contour line, and call the preset normal production temperature threshold of the production equipment; or to determine whether the production equipment is abnormal according to the actual production temperature data of the production equipment.

10. An electronic device, characterized in that: include: Memory; and a processor, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the scenario-driven product production safety monitoring method according to any one of claims 1 to 8 is implemented.

Images