Event prompting method and device, equipment and storage medium

Abstract

The invention relates to an event prompting method, device and equipment and a storage medium, and is used for paving equipment, the paving equipment comprises a camera, and the method comprises the steps: obtaining a plurality of construction images of the paving equipment through the camera, obtaining the operation information of the paving equipment and the user information of a construction worker of the paving equipment, and analyzing the plurality of construction images according to the operation information and the user information to obtain a prompt event of a construction worker and / or a fault event of the paving equipment, and carrying out event prompt according to the prompt event and / or the fault event, and by adopting the event prompt method and device, the event prompt efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of paving equipment, and in particular to an event prompting method, device, equipment and storage medium. Background Art

[0002] At present, construction workers use paving equipment to lay photovoltaic panels, which has become an important means of laying photovoltaic panels. However, in the process of operating the paving equipment, construction workers cannot avoid paving equipment failures, which will affect the operation of the paving equipment. How to improve the efficiency of prompting the occurrence of failure events is a technical problem to be solved by technicians in this field. Summary of the invention

[0003] The purpose of the present invention is to provide an event prompting method, device, equipment and storage medium, which can improve the efficiency of event prompting.

[0004] To achieve the purpose of the present invention, the present invention provides the following technical solutions:

[0005] In the first aspect, an embodiment of the present application provides an event prompt method for paving equipment, wherein the paving equipment includes a camera, and the method includes: obtaining multiple construction images of the paving equipment through the camera; obtaining operation information of the paving equipment and user information of a construction worker of the paving equipment; analyzing the multiple construction images according to the operation information and the user information to obtain a prompt event of the construction worker and / or a fault event of the paving equipment; and providing an event prompt according to the prompt event and / or the fault event. It can be understood that the efficiency of event prompts is improved by identifying prompt events and / or fault events through image analysis and providing event prompts.

[0006] In a possible example, the analysis of the multiple construction images according to the operation information and the user information to obtain the prompt event of the construction worker and / or the fault event of the paving equipment includes: identifying each of the multiple construction images to obtain multiple first images of the paving equipment; evaluating the action of the paving equipment paving the photovoltaic panel in the multiple first images according to the operation information to obtain the first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panel; determining a reasonable value of the first evaluation value according to the user information; and determining the prompt event of the construction worker and / or the fault event of the paving equipment according to the multiple first images when the reasonable value is less than the first threshold. In this way, by performing action recognition on each construction image, then evaluating the recognized action, and then determining a reasonable value for the first evaluation value, the accuracy of the evaluation of the prompt event of the construction worker and / or the fault event of the paving equipment is improved.

[0007] In a possible example, the operation information includes a preset paving action and a preset paving quantity of a photovoltaic panel, and the operation information is used to evaluate the action of the paving equipment paving the photovoltaic panel in the multiple first images to obtain a first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panel, including: obtaining a first matching value between the action of the paving equipment paving the photovoltaic panel in the multiple first images and the preset paving action of the photovoltaic panel; determining the actual paving quantity of the photovoltaic panel according to the action of the paving equipment paving the photovoltaic panel in the multiple first images; obtaining a first ratio between the actual paving quantity and the preset paving quantity; and determining the first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panel according to the first matching value and the first ratio. In this way, by analyzing and generating the first matching value and the first ratio, and then obtaining the first evaluation value according to the first matching value and the first ratio, the accuracy of the first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panel is improved.

[0008] In a possible example, the determining of the construction worker's prompt event and / or the paving equipment's fault event based on the multiple first images includes: determining the target paving action of the paving equipment in the multiple first images based on the preset paving action; and determining the construction worker's prompt event and / or the paving equipment's fault event based on the action type of the target paving action. In this way, determining the target paving action and then analyzing the action type of the target paving action can improve the accuracy and efficiency of determining the construction worker's prompt event and / or the paving equipment's fault event.

[0009] In a possible example, the operation information includes preset standard items of the construction worker, and the method further includes: identifying each of the multiple construction images to obtain multiple second images of the construction worker; determining the violations of the construction worker in the multiple second images according to the preset standard items; and determining the reminder event of the construction worker according to the item type of the violation items. In this way, multiple second images are obtained according to multiple construction images, and then the violations of the construction worker in the multiple second images are determined, and then the reminder event of the construction worker is determined according to the item type of the violation items, thereby improving the accuracy and efficiency of determining the reminder event of the construction worker.

[0010] In a possible example, the event prompting according to the prompting event and / or the fault event includes: determining the target prompting object in the prompting object set according to the event type of the prompting event and / or the fault event, the prompting object set including the construction worker and the safety inspector; and sending the event prompting information of the prompting event and / or the fault event to the target prompting object. In this way, the target prompting object is determined according to the event type, and the event prompting information is sent to the target prompting object, which improves the comprehensiveness and accuracy of the sending of the event prompting information.

[0011] In a possible example, the prompt object set includes multiple safety inspectors, the target prompt object is a target safety inspector, and the method further includes: determining the first position of the paving equipment; determining the second position of each safety inspector in the prompt object set; and determining the target safety inspector from the multiple safety inspectors based on the distance between the second position and the first position. In this way, the target safety inspector is determined from the multiple safety inspectors based on the first position of the paving equipment and the second position of each safety inspector, thereby improving the accuracy of determining the target safety inspector.

[0012] In a second aspect, an embodiment of the present application provides an event prompt device, comprising a unit for executing the method provided in the first aspect or any implementation scheme of the first aspect.

[0013] In a third aspect, an embodiment of the present application provides an event prompt device, comprising a processor, a memory, and one or at least one program, wherein the one or at least one program is stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the method provided in the first aspect or any embodiment of the first aspect.

[0014] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program enables a computer to execute to implement the method provided in the first aspect or any embodiment of the first aspect.

[0015] Implementing the embodiments of the present application will have the following beneficial effects:

[0016] The camera acquires multiple construction images of the paving equipment, and acquires the operation information of the paving equipment and the user information of the construction worker of the paving equipment. Then, the multiple construction images are analyzed based on the operation information and the user information to obtain the prompt events of the construction worker and / or the fault events of the paving equipment, and then event prompts are given based on the prompt events and / or the fault events. In this way, the prompt events and / or the fault events are identified through image analysis, and event prompts are given, thereby improving the efficiency and accuracy of event prompts. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 This is a schematic diagram of an application scenario of an event prompt method provided in an embodiment of the present application;

[0019] Figure 2 It is a flowchart of an event prompt method provided in an embodiment of the present application;

[0020] Figure 3 It is a schematic diagram of a process for analyzing multiple construction images provided in an embodiment of the present application;

[0021] Figure 4 It is a structural schematic diagram of an event prompting device provided in an embodiment of the present application;

[0022] Figure 5 It is a structural schematic diagram of an event prompt device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0024] It should be noted that when a component is said to be "fixed to" another component, it can be directly on the other component or there can be a central component. When a component is said to be "connected to" another component, it can be directly connected to the other component or there can be a central component at the same time.

[0025] Unless otherwise defined, all technical and scientific terms used in the present invention have the same meaning as those commonly understood by those skilled in the art to which the present invention belongs. The terms used in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used in the present invention includes any and all combinations of one or more of the related listed items.

[0026] Some embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0027] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0028] The terms "1" and "2" etc. in this application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.

[0029] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0030] See also Figure 1 , Figure 1 Schematic diagram of an application scenario of an event prompt method provided in an embodiment of the present application. Figure 1 As shown, the schematic diagram of the application scenario includes a construction worker 101, a paving device 102, a photovoltaic panel 103, a server 104, and a safety inspector 105. Optionally, the paving device 102 includes multiple cameras. Optionally, the paving device 102 may also include a rangefinder, etc., and the present application does not limit the structure of the paving device 102.

[0031] Optionally, the server 104 may be an independent server 104, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks (CDNs), and big data and artificial intelligence platforms. The server 104 may also be implemented as a server cluster consisting of multiple sub-servers.

[0032] It should be noted that Figure 1The number and form of each device in the system shown, as well as the number of construction workers 101 and safety inspectors 105 are for example only and do not constitute a limitation on the embodiments of the present application. One construction worker 101 can operate multiple paving devices 102, and one paving device 102 can pave multiple photovoltaic panels 103. The safety inspector 105 can prompt one or more construction workers 101.

[0033] The construction worker 101 can operate the paving equipment 102 to control the paving equipment 102 to perform corresponding actions to lay the photovoltaic panels 103. The paving equipment 102 can be Figure 1 The photovoltaic panel laying equipment shown may also be electronic devices of other application types, or may be a robot, which is not limited. The server 104 may include multiple personal computers (PCs), cloud virtual hosts, cloud databases, and cloud storage. The operating system of the electronic devices on the PC side, such as computers, may include but is not limited to Linux systems, Unix systems, Windows series systems (such as Windows XP, Windows 7, etc.) and other operating systems.

[0034] The event prompt method provided in an embodiment of the present application is introduced below. The method can be executed by an event prompt device, which can be implemented by software and / or hardware and can generally be integrated in the paving equipment 102 or the server 104.

[0035] Please refer to Figure 2 , Figure 2 1 is a flow chart of an event prompt method provided in an embodiment of the present application. Taking the method applied to the event prompt process as an example, the event prompt device may include a server or an electronic device. The method includes the following steps S201-S204, wherein:

[0036] S201: Acquire multiple construction images of paving equipment through a camera.

[0037] In the embodiment of the present application, the number of cameras installed on each paving device can be multiple or one, and there is no limitation on this. Optionally, the construction image can be an image of a construction worker operating the paving device to pave the photovoltaic panel. Optionally, the construction image can be an image of the paving device paving the photovoltaic panel.

[0038] Optionally, the number of paving equipment may be one or more. The construction images from different paving equipment may be sent to the server respectively. After the server receives the construction image of the paving equipment, it may be sent to the terminal device and displayed on the display screen of the terminal device.

[0039] Optionally, the paving equipment includes a lower computer and a host computer, and the construction image acquired by the camera can be first transmitted to the lower computer, and then the lower computer transmits the construction image to the host computer, and the host computer can send it to the server to achieve cloud storage. Optionally, the cloud sends the construction image to the terminal device in the control room, and the display screen of the terminal device displays the construction image for real-time supervision.

[0040] In this way, multiple construction images of the paving equipment can be obtained in real time through the camera, which improves the efficiency of supervision of the paving equipment and construction workers.

[0041] S202: Acquire operation information of the paving equipment and user information of the construction worker of the paving equipment.

[0042] In an embodiment of the present application, the operation information of the paving equipment includes the action of the paving equipment paving photovoltaic panels. The operation information of the paving equipment may also include the number of photovoltaic panels to be paved and the paving rate of the paving equipment, etc., which can be used to determine the task volume and work efficiency of the paving equipment. The user information of the construction worker of the paving equipment includes the information of the construction worker operating the paving equipment to pave photovoltaic panels. The user information of the construction worker of the paving equipment may also include the construction worker's entry time, the construction worker's age and the construction worker's assessment results, etc., which can be used to determine the construction worker's proficiency. In this way, after obtaining the operation information of the paving equipment and the user information of the construction worker of the paving equipment, the working status of the paving equipment can be judged according to the construction workers of different proficiency levels and the specific content of the operation information, thereby improving the accuracy of the supervision of the paving equipment.

[0043] S203: Analyze the multiple construction images according to the operation information and the user information to obtain the prompt events of the construction workers and / or the failure events of the paving equipment.

[0044] In an embodiment of the present application, the reminder event of the construction worker can be used to remind the construction worker. The reminder event of the construction worker is the problem of the construction worker, and the failure event of the paving equipment is the problem of the paving equipment. For example, after the paving equipment picks up the photovoltaic panel, it turns around the mounting frame three times, and it is determined to be a reminder event of the construction worker. For example, after the paving equipment picks up the photovoltaic panel, the paving equipment does not take any action within the next preset time, and it is determined to be a failure event of the paving equipment. In this way, the reminder event of the construction worker and / or the failure event of the paving equipment are obtained based on the operation information and user information, which improves the accuracy of the judgment of the reminder event or the failure event.

[0045] In a possible example, multiple construction images are analyzed according to the operation information and the user information to obtain the prompt event of the construction worker and / or the failure event of the paving equipment, including the following steps S301-S304, see Figure 3 , Figure 3is a schematic diagram of a process for analyzing multiple construction images provided in an embodiment of the present application, wherein:

[0046] S301: Identify each of the multiple construction images to obtain multiple first images of paving equipment.

[0047] In an embodiment of the present application, the first image includes an image of the paving equipment, such as an image of the movement of the paving equipment's crawler tracks, an image of the movement of the paving equipment's robotic arms, an image of the paving equipment picking up photovoltaic panels, and an image of the paving equipment placing photovoltaic panels on a mounting frame.

[0048] Optionally, a first recognition model can be established, and the first recognition model is used to recognize construction images. For example, the first recognition model is used to recognize images of paving equipment, and a training set is established. The training set includes multiple different construction images. The first recognition model is trained using the training set to obtain a second recognition model. The second recognition model is used to recognize each construction image to obtain multiple first images of paving equipment, thereby improving the accuracy of recognizing the first image.

[0049] The present application does not limit the number of the first images, which may be 2, 3, 100 or 200. Optionally, the format of the first image is not limited. Optionally, the resolution of the first image may be 640x400, 1024x600, 1920×1080, 3840x2160, etc.

[0050] S302: Evaluate the actions of the paving equipment in paving the photovoltaic panels in the plurality of first images according to the operation information, and obtain a first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panels.

[0051] In an embodiment of the present application, the first evaluation value is a numerical value of the normality of the action of the construction worker operating the paving equipment to pave the photovoltaic panels. The first evaluation value can be a numerical value, or it can be an evaluation index such as A, B, C and D, which is not limited. When the first evaluation value is a numerical value, the higher the numerical value, the more normal the action of the construction worker operating the paving equipment to pave the photovoltaic panels. In this way, the action of the paving equipment paving the photovoltaic panels in multiple first images is evaluated to obtain the first evaluation value, which improves the precision of the recognition of the action of the paving equipment paving the photovoltaic panels.

[0052] In a possible example, the operation information includes a preset paving action and a preset paving quantity of a photovoltaic panel. The action of the paving equipment paving the photovoltaic panel in multiple first images is evaluated according to the operation information to obtain a first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panel, including the following steps: obtaining a first matching value between the action of the paving equipment paving the photovoltaic panel in multiple first images and the preset paving action of the photovoltaic panel; determining the actual paving quantity of the photovoltaic panel according to the action of the paving equipment paving the photovoltaic panel in multiple first images; obtaining a first ratio between the actual paving quantity and the preset paving quantity; and determining a first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panel according to the first matching value and the first ratio.

[0053] In an embodiment of the present application, the action of paving the photovoltaic panel by the paving equipment is compared with the preset paving action of the photovoltaic panel, and the similarity between the two is the first matching value.

[0054] In the embodiment of the present application, the preset paving action of the photovoltaic panel may include multiple first sub-actions, and the first sub-action includes a preset action of the paving equipment picking up the photovoltaic panel, a preset action of the paving equipment moving the photovoltaic panel, and a preset action of the paving equipment placing the photovoltaic panel. For example, the degree of proximity between the action of the paving equipment picking up the photovoltaic panel and the preset action of the paving equipment picking up the photovoltaic panel is the first matching value. For example, the degree of proximity between the action of the paving equipment placing the photovoltaic panel and the preset action of the paving equipment placing the photovoltaic panel is the first matching value.

[0055] In this way, obtaining the first matching value between the action of the paving equipment paving the photovoltaic panel and the preset paving action of the photovoltaic panel is conducive to a detailed and accurate analysis of the action of the paving equipment paving the photovoltaic panel.

[0056] In the embodiment of the present application, the action of the paving equipment paving the photovoltaic panel includes the sub-action of the paving equipment placing the photovoltaic panel on the mounting rack. The image of the sub-action of the paving equipment placing the photovoltaic panel on the mounting rack can be identified from multiple first images, and the first sub-time of the action is generated. In a preset time period before or after the first sub-time, the same action in multiple first images is identified and classified as the action of paving the same photovoltaic panel. Finally, multiple actions of the sub-action of the paving equipment placing the photovoltaic panel on the mounting rack are counted to determine the actual number of photovoltaic panels paved. In this way, the actual number of photovoltaic panels paved is determined according to the action of the paving equipment paving the photovoltaic panel, which improves the accuracy of the calculation of the actual number of paving.

[0057] In the embodiment of the present application, the first ratio is the ratio between the actual paving quantity and the preset paving quantity, which is used to reflect the normal level of efficiency of the construction workers operating the paving equipment to pave photovoltaic panels. The larger the first ratio, the closer the efficiency of the construction workers operating the paving equipment to pave photovoltaic panels is to the normal level.

[0058] For example, when the actual number of paving is 20 and the preset number of paving is 100, in the calculation process of the first ratio, 20 is divided by 100 to obtain 0.2, that is, the first ratio is 0.2.

[0059] In this way, obtaining the first ratio between the actual paving quantity and the preset paving quantity is conducive to analyzing and evaluating the efficiency of the construction workers operating the paving equipment to pave the photovoltaic panels.

[0060] In the embodiment of the present application, the first matching value multiplied by the first important coefficient plus the first ratio multiplied by the second important coefficient is obtained as the first evaluation value, wherein the first important coefficient and the second important coefficient can be preset according to actual needs. In this way, by analyzing and generating the first matching value and the first ratio, and then obtaining the first evaluation value according to the first matching value and the first ratio, the accuracy of the first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panel is improved.

[0061] S303: Determine a reasonable value of the first evaluation value according to the user information.

[0062] In an embodiment of the present application, a reasonable value is a numerical value used to describe the reasonableness of the first evaluation value. Optionally, determining the reasonable value of the first evaluation value based on user information may include: generating a preset first evaluation value based on the user's entry time; and then dividing the first evaluation value by the preset first evaluation value to obtain a reasonable value. Among them, the earlier the user's entry time, the higher the preset first evaluation value, and the preset first evaluation value can be set manually. Optionally, based on user information, a second evaluation value of a construction worker operating paving equipment to pave photovoltaic panels is determined, and the second evaluation value is a numerical value that reflects the normality of the construction worker's operation of paving equipment to pave photovoltaic panels, and a reasonable value is a matching value between the first evaluation value and the second evaluation value.

[0063] In the embodiment of the present application, the user information of the construction worker of the paving equipment may include the construction worker's employment time, the construction worker's age, and the construction worker's assessment score, etc., to determine the construction worker's proficiency. For example, the requirements for construction workers with high proficiency are more stringent. For example, the requirements for construction workers with low assessment scores are more stringent, and the reasonable value is larger.

[0064] In this way, a reasonable value of the first evaluation value is determined according to the user information, thereby improving the accuracy of the first evaluation value.

[0065] S304: When the reasonable value is less than the first threshold, determine a construction worker's prompt event and / or a paving equipment failure event according to the plurality of first images.

[0066] In the embodiment of the present application, the first threshold value may correspond to the time of employment of the construction worker. The earlier the employment time and the longer the length of service, the stricter the requirements for the construction worker. The lower the first threshold value, the later the employment time and the shorter the length of service, the lower the requirements for the construction worker. The higher the first threshold value, the less work experience the new employees have and the less confidence they lose in construction. Optionally, the first threshold value may correspond to the paving equipment, or may be the average value of reasonable statistical values ​​during multiple construction processes.

[0067] In this way, when the reasonable value is less than the first threshold, the construction worker's prompt event and / or the paving equipment's failure event is determined, thereby improving the accuracy and rationality of determining the prompt event and / or failure event.

[0068] In a possible example, determining a construction worker's prompt event and / or a paving equipment's fault event based on multiple first images includes the following steps: determining a target paving action of the paving equipment in the multiple first images based on a preset paving action; determining a construction worker's prompt event and / or a paving equipment's fault event based on the action type of the target paving action.

[0069] In the embodiment of the present application, the target paving action includes additional paving actions and non-standard paving actions, etc. For example, the additional paving actions include: after the paving equipment picks up the photovoltaic panel, it turns around the mounting frame three times; after the paving equipment picks up the photovoltaic panel, it puts down the photovoltaic panel, then picks up the photovoltaic panel again, and then puts down the photovoltaic panel again; the paving equipment does not pick up the photovoltaic panel, but turns around the mounting frame three times.

[0070] For example, irregular paving actions include: the paving equipment throws the photovoltaic panels toward the mounting frame; the paving equipment takes the photovoltaic panels at too high a height.

[0071] In the embodiment of the present application, the action type includes abnormal construction worker type and abnormal paving equipment type. The abnormal construction worker type includes the paving equipment picking up the photovoltaic panel and then turning around the mounting frame three times; the paving equipment did not pick up the photovoltaic panel and turned around the mounting frame three times. If the action type of the target paving action is abnormal construction worker type, it is a reminder event for the construction worker.

[0072] Abnormal paving equipment types include: the paving equipment repeatedly moves back and forth at a certain position, the paving equipment's mechanical arm does not move; the paving equipment repeatedly circles in place. If the action type of the target paving action is an abnormal paving equipment type, it is a paving equipment failure event.

[0073] In the embodiment of the present application, the failure of the paving equipment is a failure event of the paving equipment, and the construction worker's lack of proficiency in the operation of the robot is a reminder event of the construction worker. For example, after the paving equipment picks up the photovoltaic panel, it turns around the mounting frame three times, which is determined to be a reminder event of the construction worker. For example, after the paving equipment picks up the photovoltaic panel, the paving equipment does not take any action within the next preset time, which is determined to be a failure event of the paving equipment.

[0074] In this way, determining the target paving action and then analyzing the action type of the target paving action can improve the accuracy and efficiency of determining the construction worker's prompt event and / or the paving equipment's failure event.

[0075] In a possible example, the operation information includes preset specification items of the construction worker, and multiple construction images are analyzed according to the operation information and user information to obtain prompt events of the construction worker and / or failure events of the paving equipment, and the following steps are also included: each of the multiple construction images is identified to obtain multiple second images of the construction worker; according to the preset specification items, the violation items of the construction worker in the multiple second images are determined; according to the item type of the violation item, the prompt event of the construction worker is determined.

[0076] In the embodiment of the present application, the number of the second images is not limited, and may be 2, 3, 100 or 200, etc. Optionally, the format of the second image is not limited. Optionally, the resolution of the second image may be 640x400, 1024x600, 1920×1080, 3840x2160, etc.

[0077] In the embodiment of the present application, the violation includes additional paving actions of the paving equipment or irregular paving actions of the paving equipment, etc. For example, the additional paving action includes: after the paving equipment picks up the photovoltaic panel, the photovoltaic panel hits the ground or the non-installation area of ​​the rack.

[0078] The irregular paving actions of the paving equipment include: after the paving equipment picks up the photovoltaic panel, it travels around the mounting frame for multiple circles; when the paving equipment is traveling, the track of the paving equipment hits the mounting frame of the photovoltaic panel.

[0079] Optionally, the construction workers' violations also include improper attire, lateness and early departure, and sleeping at the construction site.

[0080] In the embodiment of the present application, the violation items include multiple item types, including attitude type and capability type, etc. The attitude type includes: the construction worker manipulates the paving equipment to hit the installation frame; the construction worker manipulates the paving equipment to take the photovoltaic panel and causes the photovoltaic panel to hit the crowd; the paving equipment is not operated for a preset time. Capability types include: the construction worker manipulates the paving equipment to fail to take the photovoltaic panel the first time, but succeeds in taking the photovoltaic panel the second time; the construction worker manipulates the paving equipment to place the photovoltaic panel in the wrong position the first time, but places the photovoltaic panel in the correct position the second time. When an attitude type item occurs, the level of the prompt event is high, and a record is kept; when an capability type item occurs, the level of the prompt event is low, and no record is kept.

[0081] In the embodiment of the present application, the prompt event includes a video prompting the construction worker on how to operate, a document prompting the construction worker on how to operate, and a photo prompting the construction worker on how to operate.

[0082] In this way, multiple second images are obtained based on multiple construction images, and then the violations of the construction workers in the multiple second images are determined. Then, the prompt events of the construction workers are determined according to the types of the violations, thereby improving the accuracy and efficiency of determining the prompt events of the construction workers.

[0083] S204: Providing event prompts according to prompt events and / or fault events.

[0084] In an embodiment of the present application, event prompts based on prompt events and / or fault events include: determining a target prompt object in a prompt object set based on the event type of the prompt event and / or fault event, the prompt object set including construction workers and safety inspectors; and sending event prompt information of the prompt event and / or fault event to the target prompt object.

[0085] In the embodiment of the present application, when the prompt event and / or the fault event is a problem with the paving equipment, the target prompt object is the construction worker. When the event type of the prompt event and / or the fault event is a problem with the construction worker, the target prompt objects are the construction worker and the safety inspector.

[0086] In the embodiment of the present application, the prompt object set also includes mechanics, safety officers, production managers, and project chief engineers at the construction site. When a construction worker or safety inspector fails to respond within the preset response time after being prompted, the mechanic, safety officer, production manager, and project chief engineer are taken as target prompt objects. Optionally, the prompt object set includes other construction workers.

[0087] In this way, the target prompt object in the prompt object set is determined according to the event type, thereby improving the efficiency and accuracy of the event prompt.

[0088] In an embodiment of the present application, the method of sending to the target prompt object can be automatically dialing the target prompt object's phone, sending an email to the target prompt object's mailbox, and sending a text message to the target prompt object's mobile phone.

[0089] In an embodiment of the present application, after a prompt event and / or a fault event occurs, event prompt information of the prompt event and / or the fault event may be sent to a target prompt object. Alternatively, after sending the event prompt information, the event prompt information may be sent to the target prompt object at preset intervals until feedback from the target prompt object is received and the sending is stopped. Alternatively, if no feedback from the target prompt object is received within a preset period of time, the received event prompt information may be sent to other prompt objects.

[0090] In the embodiment of the present application, the prompt event includes a video prompting the construction worker how to operate, a document prompting the construction worker how to operate, and a photo prompting the construction worker how to operate. In this way, the target prompt object is determined according to the event type, and the event prompt information is sent to the target prompt object, which improves the comprehensiveness and accuracy of the event prompt information.

[0091] In another possible example, event prompts are provided based on prompt events and / or fault events, and also include: determining a first position of the paving equipment; determining a second position of each safety inspector in the prompt object set; and determining a target safety inspector from multiple safety inspectors based on a distance between the second position and the first position.

[0092] In an embodiment of the present application, the first position is the position of the paving equipment. The paving equipment may include a rangefinder, and the position of the construction worker or the paving equipment may be determined by the rangefinder. The paving equipment may include an image recognition module, and the image recognition module may include a camera. The image recognition module may be used to determine the captured image, and then the position of the construction worker or the paving equipment may be determined by the image. Alternatively, the position of the construction worker or the paving equipment is determined by the image recognition module and the rangefinder, and the first position of the construction worker or the paving equipment is reported to the server.

[0093] In an embodiment of the present application, the paving equipment includes a rangefinder, and the camera includes an image recognition module. The second position of each safety inspector is determined by the rangefinder, and the second position of each safety inspector is reported to the cloud; alternatively, the second position of each safety inspector is determined by the image recognition module, and the second position of each safety inspector is reported to the cloud; alternatively, the second position of each safety inspector is determined by the image recognition module and the rangefinder, and the second position of each safety inspector is reported to the cloud.

[0094] In the embodiment of the present application, the target safety supervisor can be the closest safety supervisor among multiple safety supervisors. For example, the first safety supervisor is 1 meter away from the faulty paving equipment, the second safety supervisor is 2 meters away from the faulty paving equipment, and the third safety supervisor is 3 meters away from the faulty paving equipment. Since 1 meter is less than both 2 meters and 3 meters, the first safety supervisor is determined as the target safety supervisor from among the first, second and third safety supervisors.

[0095] The above method is only an example and does not limit the method of determining the target safety inspector. For example, the target safety inspector can be determined by the safety inspector's availability, and the safety inspector with the most available availability can be determined as the target safety inspector; the safety inspector with the closest professional skills to the prompt event or fault event can be determined as the target safety inspector based on the similarity between the prompt event or fault event and the safety inspector's professional skills.

[0096] In this way, a target safety inspector is determined from multiple safety inspectors based on the first position of the paving equipment and the second position of each safety inspector, thereby improving the accuracy of determining the target safety inspector.

[0097] See also Figure 4 , Figure 4 300 is a schematic diagram of the structure of an event prompt device provided in an embodiment of the present application. Based on the above system architecture, the event prompt device 300 can be a server or a paving device, or a module in a server. The event prompt device 300 at least includes: a collection module 301, a processing module 302 and a prompt module 303, wherein:

[0098] The acquisition module 301 is used to obtain multiple construction images of the paving equipment, operation information of the paving equipment, and user information of the construction workers of the paving equipment.

[0099] The processing module 302 is used to analyze multiple construction images according to the operation information and user information to obtain the prompt events of the construction workers and / or the failure events of the paving equipment.

[0100] The prompt module 303 is used to provide event prompts according to prompt events and / or fault events.

[0101] In one possible example, the processing module 302 is used to identify each of the multiple construction images to obtain multiple first images of the paving equipment; evaluate the actions of the paving equipment in the multiple first images to pave the photovoltaic panels based on the operation information to obtain a first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panels; determine a reasonable value of the first evaluation value based on the user information; and when the reasonable value is less than the first threshold, determine the construction worker's prompt event and / or the paving equipment's failure event based on the multiple first images.

[0102] In a possible example, the operation information includes a preset paving action and a preset paving quantity of the photovoltaic panel, and the processing module 302 is used to call a preset code to convert the first format model into the second format model.

[0103] In a possible example, the acquisition module 301 is used to obtain a first matching value between the action of the paving equipment paving photovoltaic panels in multiple first images and the preset paving action of the photovoltaic panels; the processing module 302 determines the actual paving quantity of the photovoltaic panels according to the action of the paving equipment paving photovoltaic panels in multiple first images; the acquisition module 301 is used to obtain a first ratio between the actual paving quantity and the preset paving quantity; the processing module 302 determines a first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panels according to the first matching value and the first ratio.

[0104] In one possible example, the processing module 302 is used to determine the target paving action of the paving equipment in multiple first images according to the preset paving action; the processing module 302 determines the construction worker's prompt event and / or the paving equipment's failure event according to the action type of the target paving action.

[0105] In one possible example, the processing module 302 is used to identify each construction image in multiple construction images to obtain multiple second images of construction workers; determine the violations of the construction workers in the multiple second images according to preset specification items; and determine the prompt events of the construction workers according to the item type of the violations.

[0106] In one possible example, the processing module 302 is used to determine the target prompt object in the prompt object set according to the event type of the prompt event and / or the fault event, and the prompt object set includes construction workers and safety inspectors; the prompt module 303 sends event prompt information of the prompt event and / or the fault event to the target prompt object.

[0107] In one possible example, the processing module 302 is used to determine a first position of the paving equipment; determine a second position of each safety inspector in the prompt object set; and determine a target safety inspector from multiple safety inspectors based on a distance between the second position and the first position.

[0108] See also Figure 5 , Figure 5 Schematic diagram of the structure of an event prompt device provided in an embodiment of the present application. Figure 5 As shown, the event prompt device 400 includes a processor 401, a memory 402, a communication interface 404 and a program 403. The number of the program 403 can be one or at least one. The program 403 is stored in the memory 402 and is configured to be executed by the processor 401. The program 403 includes instructions for executing the following steps:

[0109] Acquire multiple construction images of paving equipment through cameras;

[0110] Obtaining operation information of paving equipment and user information of construction workers of paving equipment;

[0111] Analyze multiple construction images according to operation information and user information to obtain reminder events of construction workers and / or failure events of paving equipment;

[0112] Provide event notification based on notification events and / or fault events.

[0113] In a possible example, program 403 is specifically used to execute instructions of the following steps:

[0114] Recognize each of the multiple construction images to obtain multiple first images of the paving equipment;

[0115] The actions of the paving equipment in paving the photovoltaic panels in the plurality of first images are evaluated according to the operation information to obtain a first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panels;

[0116] Determine a reasonable value of the first evaluation value based on the user information;

[0117] When the reasonable value is less than the first threshold, a construction worker's prompt event and / or a paving equipment failure event is determined according to the plurality of first images.

[0118] In a possible example, the operation information includes a preset paving action and a preset paving quantity of the photovoltaic panel, and the program 403 is specifically used to execute instructions of the following steps:

[0119] Acquire a first matching value between an action of paving a photovoltaic panel by a paving device in a plurality of first images and a preset paving action of the photovoltaic panel;

[0120] Determine the actual number of photovoltaic panels installed according to the actions of the installation equipment installing the photovoltaic panels in the plurality of first images;

[0121] Obtaining a first ratio between an actual paving quantity and a preset paving quantity;

[0122] Based on the first matching value and the first ratio, a first evaluation value of a construction worker operating the paving equipment to pave the photovoltaic panels is determined.

[0123] In a possible example, program 403 is specifically used to execute instructions of the following steps:

[0124] Determining a target paving action of the paving equipment in the plurality of first images according to a preset paving action;

[0125] According to the action type of the target paving action, a prompt event for the construction worker and / or a failure event of the paving equipment is determined.

[0126] In a possible example, the operation information includes the preset specification items of the construction worker, and the program 403 is specifically used to execute the instructions of the following steps:

[0127] Recognize each of the multiple construction images to obtain multiple second images of the construction workers;

[0128] Determine violations of construction workers in the plurality of second images according to preset specification items;

[0129] Determine the reminder event for the construction worker based on the type of violation.

[0130] In a possible example, program 403 is specifically used to execute instructions of the following steps:

[0131] Determine a target prompt object in a prompt object set according to the event type of the prompt event and / or the fault event, where the prompt object set includes a construction worker and a safety inspector;

[0132] Send event prompt information of prompt events and / or fault events to the target prompt object.

[0133] In a possible example, the prompt object set includes multiple safety inspectors, the target prompt object is the target safety inspector, and the program 403 is specifically used to execute the following steps:

[0134] Determine the first location of the paving equipment;

[0135] Determine the second position of each safety inspector in the reminder target set;

[0136] A target safety inspector is determined from among a plurality of safety inspectors according to a distance between the second position and the first position.

[0137] Those skilled in the art will appreciate that for ease of description, Figure 5 Only one memory 402 and processor 401 are shown. In an actual terminal or server, there may be multiple processors and memories. The memory may also be referred to as a storage medium or a storage device, etc., which is not limited in the embodiments of the present application.

[0138] It should be understood that in the present application, the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor may also be a general-purpose microprocessor, a graphics processing unit (GPU), or one or more integrated circuits to execute related programs to implement the functions required to be executed in the embodiments of the present application.

[0139] The processor 401 can also be an integrated circuit chip with signal processing capabilities. In the implementation process, the various steps of the present application can be completed by the integrated logic circuit of the hardware in the processor 401 or the instructions in the form of software. The above-mentioned processor 401 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor to be executed, or the hardware and software modules in the decoding processor are combined and executed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory and a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 402, and the processor 401 reads the information in the memory 402, and completes the functions required to be performed by the unit included in the method, device and storage medium of the embodiment of the present application in combination with its hardware.

[0140] It should also be understood that the memory mentioned in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DR RAM). The memory may also be a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited to this. The memory may be independent and connected to the processor via a bus. The memory may also be integrated with the processor. The memory may store programs. When the programs stored in the memory are executed by the processor, the processor is used to execute the various steps of the determination method in the above embodiment of the present application.

[0141] It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, the memory (storage module) is integrated into the processor. It should be noted that the memory described herein is intended to include but is not limited to these and any other suitable types of memory.

[0142] It should be understood that the term "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0143] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in a processor for execution. The software module can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

[0144] Those skilled in the art will appreciate that the various illustrative logic blocks (ILBs) and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or in a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0145] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a program product of computer programming. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the processor, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center, or can be transmitted from a website site, a computer, a server or a data center by wired mode to a mobile phone processor. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0146] The above are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be covered by the protection scope of the present application.

Claims

1. An event prompting method, characterized in that: For a paving device, the paving device includes a camera, and the method includes: Acquire multiple construction images of the paving equipment through the camera; Acquire operation information of the paving equipment and user information of a construction worker of the paving equipment; Analyze the multiple construction images according to the operation information and the user information to obtain the prompt event of the construction worker and / or the failure event of the paving equipment; An event prompt is performed according to the prompt event and / or the fault event.

2. The event prompting method according to claim 1, characterized in that: The analyzing the plurality of construction images according to the operation information and the user information to obtain the prompt event of the construction worker and / or the failure event of the paving equipment includes: Recognize each of the multiple construction images to obtain multiple first images of the paving equipment; Evaluate the action of the paving equipment paving the photovoltaic panels in the plurality of first images according to the operation information, and obtain a first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panels; Determining a reasonable value of the first evaluation value according to the user information; When the reasonable value is less than the first threshold, the prompt event of the construction worker and / or the failure event of the paving equipment is determined according to the multiple first images.

3. The event prompting method according to claim 2, characterized in that: The operation information includes a preset paving action and a preset paving quantity of the photovoltaic panel, and the action of the paving equipment paving the photovoltaic panel in the plurality of first images is evaluated according to the operation information to obtain a first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panel, including: Acquire a first matching value between an action of the paving equipment paving the photovoltaic panel and a preset paving action of the photovoltaic panel in the plurality of first images; Determining the actual number of photovoltaic panels installed according to the actions of the installing equipment installing photovoltaic panels in the plurality of first images; Obtaining a first ratio between the actual paving quantity and the preset paving quantity; A first evaluation value of the construction worker operating the paving equipment to pave the photovoltaic panels is determined based on the first matching value and the first ratio.

4. The event prompting method according to claim 3, characterized in that: The determining, according to the plurality of first images, the reminder event of the construction worker and / or the failure event of the paving equipment comprises: Determining a target paving action of the paving equipment in the plurality of first images according to the preset paving action; According to the action type of the target paving action, a prompt event of the construction worker and / or a failure event of the paving equipment is determined.

5. The event prompting method according to claim 2, characterized in that: The operation information includes the preset specification items of the construction worker, and the method further includes: Recognize each of the multiple construction images to obtain multiple second images of the construction worker; Determining the violation items of the construction worker in the plurality of second images according to the preset specification items; The reminder event for the construction worker is determined according to the type of the violation.

6. The event prompting method according to any one of claims 1 to 5, characterized in that: The performing event prompting according to the prompting event and / or the fault event includes: Determine a target prompt object in a prompt object set according to the event type of the prompt event and / or the fault event, wherein the prompt object set includes the construction worker and the safety inspector; Sending event prompt information of the prompt event and / or the fault event to the target prompt object.

7. The event prompting method according to claim 6, characterized in that: The prompt object set includes a plurality of safety inspectors, the target prompt object is a target safety inspector, and the method further includes: determining a first position of the paving equipment; Determine the second position of each safety inspector in the reminder object set; The target safety inspector is determined from among the plurality of safety inspectors according to the distance between the second position and the first position.

8. An event prompting device, characterized in that: Comprising means for performing the method as claimed in any one of claims 1 to 7.

9. An event prompting device, characterized in that: The method comprises a processor, a memory and one or at least one program, wherein the one or at least one program is stored in the memory and configured to be executed by the processor, and the program comprises instructions for executing the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which enables a computer to execute to implement the method according to any one of claims 1 to 7.

Images