Construction business management platform using big data acquired by smart glasses

Abstract

The present invention relates to a platform for utilizing speech and an image acquired by a camera of smart glasses for construction project management. The platform comprises: an access unit for receiving an image and speech from smart glasses; a monitoring unit for providing and storing same to and in a manager terminal in real time; a documentation unit for converting the speech into text to statistically process and document work instructions, inspection details, corrective actions, deployed equipment, materials, and workforce; and a database unit for storing all data for each user. According to the present invention, an on-site image and speech can be provided in real time through smart glasses, a work burden of a construction worker can be reduced through automatic documentation, and a virtuous cycle system for work improvement can be constructed by deriving vulnerabilities and providing feedback through big data analysis.

Description

Construction project management platform utilizing big data acquired from smart glasses

[0001] The present invention relates to an industrial management platform utilizing smart glasses, and more specifically, to a smart glasses-based industrial management platform that provides video and audio data acquired through a camera mounted on the smart glasses in real time, automatically documents this data to reduce the workload of workers, and enables the identification of vulnerabilities and the establishment of a feedback-based work improvement system through the analysis of collected big data. The present invention can be applied to various industrial fields, including construction management and safety monitoring at construction sites, as well as quality control, remote technical support, and work manual sharing at manufacturing sites.

[0002] In general, the construction of buildings requires planned progress, easy monitoring of construction progress based on established timelines and completion rates, coordination and management of personnel and equipment, and safety management at the construction site. To achieve this, it is necessary to effectively collect information regarding the progress of construction, the status of personnel and equipment, and hazardous situations at the site; this necessitates the on-site presence of construction-related personnel, including supervisors and inspectors.

[0003] Construction management systems are being developed to reduce the labor intensity or costs of on-site construction personnel. As a related prior art, the "Construction Site Management System Based on 360-Degree Omnidirectional Video" disclosed in Korean Published Patent No. 10-2021-0128822 has been presented. This is a construction site management system comprising: a system operation server built for construction site management based on 360-degree omnidirectional video, which communicates via Web access or App access through a communication network from a client terminal on the construction site side and a terminal of the managing entity; wherein the system operation server comprises: a construction site video providing unit that provides construction site video based on 360-degree omnidirectional panoramic video captured for each individual construction site and displays management information regarding the individual construction site in conjunction with the corresponding construction site video; at least one database that stores construction data, site data, and work data for each individual construction site; and a message linkage unit that performs message linkage processing based on message transmission and reception between the terminal of the managing entity and a remote client terminal on the construction site side. and includes a server operation unit that is linked with at least one database and comprehensively controls the construction site image provision unit and the message linkage unit for the operation of a construction site management service according to the construction site management system.

[0004] However, such conventional technology is insufficient for obtaining the necessary information mentioned above by merely providing 360-degree panoramic images, and is inadequate for enhancing the efficiency of construction management through its utilization. Consequently, the presence of construction-related workers, including managers, supervisors, and inspectors, is still required at construction sites. This has led to a decline in work proficiency due to the aging of construction workers and the increasing number of foreign workers. Consequently, the importance of management systems and inspections by managers is increasing due to the decline in work proficiency, and it has become necessary to establish a system that can minimize the fatigue of managers and others.

[0005] To solve the problems of the conventional technology described above, the present invention aims to provide video and audio obtained through a glasses-mounted camera to workers, thereby reducing the workload of construction workers through automated document processing, and to establish a virtuous cycle system that enables the identification of vulnerabilities and the promotion of work improvement through feedback via the analysis of big data provided by the glasses-mounted camera. Furthermore, it aims to reduce implementation costs by allowing the construction of a camera-based system while utilizing existing systems and equipment, increase the usability and utility of smart equipment by enabling easy attachment and detachment of equipment by workers and managers, and enhance performance while improving usability, thereby minimizing the workload of facility managers. Additionally, it aims to acquire video and audio aligned with the worker's line of sight using a camera format adjusted to eye level, and to perform data classification and document creation using AI without separate editing of the acquired video and audio information.

[0006] Other objectives of the present invention will be easily understood through the description of the following embodiments.

[0007] To achieve the above-mentioned purpose, according to one aspect of the present invention, a construction project management platform utilizing smart glasses equipped with a camera to provide video and audio acquired from the camera via communication is provided, comprising: a connection unit that receives video and audio from the smart glasses using a communication terminal; a monitoring unit that provides the video and audio received through the connection unit in real time to a terminal of a construction project management related person for monitoring and stores the video and audio; a documentation unit that receives information regarding the audio from the monitoring unit, converts it into text, statistically documents work instructions, inspection details, supplementary matters, input equipment, materials, and personnel, and provides the documented content to a terminal of a construction project management related person; and a database unit that stores the video and audio provided by the monitoring unit and the document provided by the documentation unit, respectively, for each user.

[0008] It may further include a safety management unit that determines whether a worker is wearing a safety helmet and safety shoes, whether a worker located above a predetermined height is wearing a safety belt, and determines the occurrence of flames or smoke through image processing of the video provided through the connection unit, and provides the determined result to the terminal of the construction project management personnel.

[0009] It may further include a control linkage unit that provides information regarding the video and audio stored in the database unit upon request from the smart supervision and construction project management system.

[0010] It may further include a specification calculation unit that identifies reinforcing bars in an image through an image processing of an image provided through the connection unit, calculates the thickness and spacing of the reinforcing bars using an image dimension measurement algorithm, and provides the calculated information to a terminal of a construction project management related person.

[0011] By image processing of the video provided through the aforementioned connection unit, the number of workers determined to be located within the construction site is identified in real time, and the number of workers is provided in real time to the terminal of the construction project management related person; the hourly scheduled number of workers at the relevant construction site is received as information from the terminal of the personnel manager, and if the number of workers exceeds the hourly scheduled number of workers corresponding to the identified time, the terminal of the personnel manager checks whether the relevant construction site is registered as an access control area; if the construction site is registered as an access control area, the terminal of the personnel manager is notified to submit details regarding the current excess personnel within a set time, and the received details or the fact that no notification was received within the set time is provided to the terminal of a pre-registered senior manager; and if the number of workers is less than the hourly scheduled number of workers corresponding to the identified time, the terminal of the personnel manager is notified to submit details regarding the current shortage of personnel within a set time, and the terminal of a pre-registered construction site manager is instructed to check whether the personnel shortage affects the current process, and the received details and whether there is an impact are provided to the terminal of the senior manager It may further include an access control unit provided to the terminal.

[0012] According to the construction project management platform utilizing big data acquired by smart glasses according to the present invention, video and audio obtained through a camera attached to glasses can be provided to workers, thereby reducing the workload of construction workers through automated document processing. Furthermore, it is possible to establish a virtuous cycle system, such as identifying vulnerabilities and promoting work improvement through feedback via the analysis of big data provided through the camera attached to glasses. Additionally, it is possible to reduce implementation costs by enabling the construction of a system using cameras while utilizing existing systems and equipment as they are. It is also possible to increase the usability and utility of smart equipment by allowing workers and managers to easily attach and detach the equipment, and to minimize the workload of facility managers by enhancing performance while improving usability. Moreover, it has the effect of acquiring audio along with video that matches the worker's gaze in the form of a camera aligned with eye level, and enabling data classification and document creation through AI without separate editing of the acquired video and audio information.

[0013] FIG. 1 is a configuration diagram illustrating a construction project management platform utilizing big data acquired from smart glasses according to an embodiment of the present invention.

[0014] FIG. 2 is a configuration diagram illustrating smart glasses in a construction project management platform utilizing big data acquired from smart glasses according to an embodiment of the present invention.

[0015] The present invention is capable of various modifications and may have various embodiments, and specific embodiments are illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to specific embodiments, but should be understood to include all modifications, equivalents, and substitutions that fall within the technical spirit and scope of the present invention, and may be modified in various other forms, and the scope of the present invention is not limited to the following embodiments.

[0016] Hereinafter, embodiments according to the present invention will be described in detail with reference to the attached drawings. Identical or corresponding components are assigned the same reference number regardless of the drawing symbols, and redundant descriptions thereof will be omitted.

[0017] FIG. 1 is a configuration diagram illustrating a construction project management platform utilizing big data acquired from smart glasses according to an embodiment of the present invention.

[0018] Referring to FIG. 1, a construction project management platform (30) utilizing big data acquired from smart glasses according to one embodiment of the present invention is a construction project management platform utilizing smart glasses (10) equipped with a camera (10) to provide images and voice acquired from the camera (13) through communication, and may include a connection unit (31), a monitoring unit (32), a documentation unit (33), and a database unit (34).

[0019] For the smart glasses (10) to be worn on the user's face, a pair of foldable temples (12) for wearing on the ears are provided on a frame (11) that basically corresponds to the frame, and a camera (13) can be installed on the frame (11), more specifically on the temples (12). Also, referring to FIG. 2, the smart glasses (10) may have a built-in rechargeable battery to supply power required for operation or may be provided with a power connector (14) for connecting an external power source, an operating unit (15) such as a button or switch for turning the operation on, off, or selecting a function, a display unit (16) for outputting the operation status or input information, and a control unit (17) for controlling the operation of the camera (13), etc., according to an operation signal of the operating unit (15) or a predetermined process.

[0020] The connection unit (31) allows video and audio to be provided from the smart glasses (10) using a communication terminal (20). Here, the communication terminal (20) serves as a medium for communication of the smart glasses (10), and various information processing and communication devices such as smartphones, tablet PCs, laptops, or desktops that use a specific application or program can be used.

[0021] The connection unit (31) enables the terminal (2) of a person involved in construction project management, as well as the terminal of a worker manager, the terminal of a senior manager, the terminal of a construction site manager, etc., which will be described later, to connect via a communication network. To this end, various connection means may be used, such as a web server that provides a web page that allows the terminal to connect using various communication methods including Wi-Fi, 3G, LTE, 5G, etc., an app server that enables the execution of functions provided by a web application in a web browser, or a communication server that enables other communication. For identity verification upon connection, the provision of an ID and password, etc., or the use of a credit card, mobile phone, or public certificate may be used. The connection unit (31) may perform a procedure to verify identity. Furthermore, the person involved in construction project management may include, for example, the building owner, designer, contractor, supervisor, manager, supervisor, worker, etc., as well as all persons involved in the construction project.

[0022] The monitoring unit (32) provides the video and audio received through the connection unit (31) to the terminal (2) of a construction project management official in real time for monitoring, and the video and audio are stored in the database unit (34) to be described later. Accordingly, the construction project management official can check the video of the construction site in real time through their terminal (2), and may request the wearer of the smart glasses (10) to monitor the parts requiring focused monitoring as needed.

[0023] The documentation unit (33) receives information regarding voice from the monitoring unit (31), converts it into text, statistically documents work instructions, inspection details, supplementary items, input equipment, materials, and personnel, and provides the documented content to the terminal (2) of a construction project management related person. The documentation unit (33) converts the voice into text and documents it by matching the converted text with keyword information allowed in the corresponding fields configured in the work daily report, inspection report, material delivery order, etc., and pasting the text matched in the corresponding field. The documented content can be matched with keyword information included in the category by purpose or use of the document, so that work instructions, inspection details, supplementary items, input equipment, materials, personnel, etc. are statistically displayed according to the corresponding purpose or use. The documentation unit (33) may use an artificial intelligence algorithm or a machine learning algorithm for matching or judgment for documentation.

[0024] The database unit (34) stores the video and audio provided by the monitoring unit (32) and the documents provided by the documentation unit (33) for each user, respectively. The video and audio can be stored separately, and the video and audio can be combined as needed. The database unit (34) can store various applications, programs, or information necessary for providing the service of the present invention.

[0025] A construction project management platform (30) utilizing big data acquired from smart glasses according to one embodiment of the present invention may further include a safety management unit (35), a control linkage unit (37), a specification calculation unit (38), and an access control unit (36).

[0026] The safety management unit (35) can determine whether a worker is wearing a safety helmet and safety shoes, whether a worker is wearing a safety belt at a height above a set height, and can determine whether flames or smoke are generated by image processing of the image received through the connection unit (31), and can provide the determined result to the terminal (2) of a construction project management person.

[0027] The safety management unit (35) extracts an image corresponding to a worker from the video provided through the connection unit (31), and compares the extracted information regarding the parts corresponding to the worker's head, feet, and chest with pre-stored image information regarding a safety helmet, safety shoes, and safety belt to determine whether the worker is wearing a safety helmet, safety shoes, or safety belt. At this time, the safety management unit (35) calculates the height at which the worker is located from the ground using standardized objects that can be checked in advance in the surroundings, and through this, determines whether the worker is located at a currently defined height, for example, a height at which there is a risk of falling. Meanwhile, a known image dimension calculation algorithm may be used for calculating the worker's height.

[0028] The control linkage unit (37) can provide information on video and audio stored in the database unit (34) upon request from the smart supervision and construction project management system (1). The smart supervision and construction project management system (1) may include various systems required for construction control.

[0029] The specification calculation unit (38) can identify reinforcing bars in an image through an image processing of an image provided through the connection unit (31), calculate the thickness and spacing of the reinforcing bars using an image dimension measurement algorithm, and provide the calculated information to a terminal (2) of a construction project management personnel.

[0030] The access control unit (36) identifies the number of workers determined to be located within the construction site in real time through image processing of the video provided through the connection unit (31), and provides the number of workers in real time to the terminal (2) of the construction project management personnel. It also receives information regarding the hourly scheduled number of workers at the construction site from the terminal (2) of the personnel manager, and if the number of workers exceeds the hourly scheduled number of workers corresponding to the identified time, it checks whether the construction site is registered as an access control area from the terminal of the personnel manager. If the construction site is registered as an access control area, it notifies the terminal of the personnel manager to submit details regarding the current excess number of workers within a set time, and provides the details received or the fact that no notification was received within the set time to the terminal of a senior manager who is registered in advance. Accordingly, the access control unit (36) enables verification of whether an appropriate number of workers has been deployed to the access control area, and enables easy verification of whether the purpose of the access control area is properly observed when the appropriate number of workers is exceeded.

[0031] In addition, the access control unit (36) may notify the terminal of the personnel manager to submit details regarding the current shortage of personnel within the set time if the number of workers is less than the number of scheduled workers per hour corresponding to the time identified, and may also have the terminal of the construction site manager registered in advance check whether the shortage of personnel affects the current process, and provide the details received and whether there is an impact to the terminal of the senior manager. Accordingly, the access control unit (36) may perform process management so that if there is a shortage of personnel, it can check whether there is a problem with the process while the appropriate number of personnel required for the work is notified in advance, and take measures regarding this quickly.

[0032] According to the construction project management platform utilizing big data acquired by the smart glasses according to the present invention, video and audio obtained through a camera attached to glasses can be provided to workers, and the workload of construction workers can be reduced through automated document processing. Furthermore, it is possible to establish a virtuous cycle system, such as identifying vulnerabilities and promoting work improvement through feedback, by analyzing the big data provided through the camera attached to glasses.

[0033] In addition, according to the present invention, it is possible to build a system using a camera while utilizing existing systems and equipment as they are, thereby reducing implementation costs. Furthermore, since the equipment can be easily attached and detached by workers and managers, the usability and utility of the smart equipment can be increased, and by enhancing usability while increasing performance, the workload of facility managers can be minimized.

[0034] In addition, according to the present invention, audio can be acquired along with video that matches the worker's gaze in the form of a camera aligned with eye level, and data classification and document creation can be performed using AI without separate editing of the acquired video and audio information.

[0035] Although the present invention has been described with reference to the attached drawings, it is understood that various modifications and variations may be made within the scope of the technical spirit of the invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the claims set forth below as well as equivalents thereof.

[0036] [Explanation of the symbol]

[0037] 1 : Smart Supervision and Construction Project Management System

[0038] 2: Construction project management terminal 10: Smart glasses

[0039] 11: Eyeglass frame 12: Temple

[0040] 13 : Camera 14 : Power connector

[0041] 15: Control panel 16: Display panel

[0042] 17 : Control unit 20 : Communication terminal

[0043] 31 : Connection section 32 : Monitoring section

[0044] 33: Documentation Department 34: Database Department

[0045] 35 : Safety Management Department 36 : Access Control Department

[0046] 37 : Control Interlock Unit 38 : Specification Calculation Unit

[0047]

[0048] The present invention can be used in industrial fields that manage sites, such as construction management and safety monitoring at construction sites, and quality control, remote technical support, and work manual sharing at manufacturing sites.

Claims

1. A construction project management platform utilizing smart glasses equipped with a camera to provide video and audio acquired from the camera via communication, wherein A connection unit that enables video and audio to be provided from the smart glasses using a communication terminal; A monitoring unit that provides video and audio received through the above connection unit in real time to a terminal of a construction project management personnel for monitoring, and stores the video and audio; A documentation unit that receives voice information from the monitoring unit, converts it into text, statistically documents work instructions, inspection details, supplementary matters, input equipment, materials, and personnel, and provides the documented content to the terminal of the construction project management personnel; and A construction project management platform utilizing big data acquired from smart glasses, comprising: a database unit that stores the video and audio provided by the monitoring unit and the document provided by the documentation unit, respectively, for each user.

2. In Claim 1, A construction project management platform utilizing big data acquired from smart glasses, further comprising a safety management unit that determines whether a worker is wearing a safety helmet and safety shoes, whether a worker located above a predetermined height is wearing a safety belt, and determines the occurrence of flames or smoke through image processing of a video provided through the connection unit, and provides the determined result to a terminal of a construction project management related person.

3. In Claim 1, A construction project management platform utilizing big data acquired from smart glasses, further comprising a control linkage unit that provides information regarding the video and voice stored in the database unit upon request from a smart supervision and construction project management system.

4. In Claim 1, A construction project management platform utilizing big data acquired from smart glasses, further comprising a specification calculation unit that identifies reinforcing bars in an image through image processing of an image provided through the connection unit, calculates the thickness and spacing of the reinforcing bars using an image dimension measurement algorithm, and provides the calculated information to a terminal of a construction project management related person.

5. In Claim 1, By image processing of the video provided through the aforementioned connection unit, the number of workers determined to be located within the construction site is identified in real time, and the number of workers is provided in real time to the terminal of the construction project management related person; the hourly scheduled number of workers at the relevant construction site is received as information from the terminal of the personnel manager, and if the number of workers exceeds the hourly scheduled number of workers corresponding to the identified time, the terminal of the personnel manager checks whether the relevant construction site is registered as an access control area; if the construction site is registered as an access control area, the terminal of the personnel manager is notified to submit details regarding the current excess personnel within a set time, and the received details or the fact that no notification was received within the set time is provided to the terminal of a pre-registered senior manager; and if the number of workers is less than the hourly scheduled number of workers corresponding to the identified time, the terminal of the personnel manager is notified to submit details regarding the current shortage of personnel within a set time, and the terminal of a pre-registered construction site manager is instructed to check whether the personnel shortage affects the current process, and the received details and whether there is an impact are provided to the terminal of the senior manager A construction project management platform utilizing big data acquired from smart glasses, further comprising an access control unit provided to a terminal.

Images