Work evidence collection system and program

The work evidence collection system simplifies the wearable device by eliminating communication, ensuring reliable work evidence through a portable terminal displaying work instructions and time, capturing the display screen for proof of work performance.

JP2026019561APending Publication Date: 2026-02-05MITSUBISHI ELECTRIC BUILDING SOLUTIONS CORP
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
JP2024121221
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2026-02-05

AI Technical Summary

Technical Problem

Existing work evidence collection systems become complex and cumbersome due to the need for communication between control devices and wearable imaging devices, increasing the weight and complexity of the wearable devices.

Method used

A work evidence collection system utilizing a portable information terminal device with a display that displays work instructions and time information, and a wearable camera that records imaging data without communication, allowing for reliable work evidence collection by capturing the display screen with time information.

Benefits of technology

Enables highly reliable work evidence collection without increasing system complexity or device weight, as the time display on the display screen serves as proof of work performance, making it difficult to tamper with.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026019561000001_ABST
    Figure 2026019561000001_ABST
Patent Text Reader

Abstract

To collect highly reliable work evidence without performing communication at a work site in a system for collecting work evidence to be evidence of work date and time.SOLUTION: A work evidence collection system for collecting work evidence as evidence of a work date and time of a worker includes an information terminal including a display, and an imaging device. The information terminal is a portable terminal, acquires current time information, generates a display screen including a time display of the time information, and displays the generated display screen on a display apparatus. The imaging device is carried by a worker, and captures an image of the display of the information terminal at a work site. The imaging device is, for example, a wearable camera, and records imaging data obtained by imaging the field of view of the worker.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a technology for a work evidence collection system that collects work evidence that serves as evidence of the date and time of work performed by workers. [Background technology]

[0002] Patent Document 1 discloses technology related to a system that provides work support and acquires evidence records of each task performed. The system of this technology includes a wearable imaging device that acquires image data corresponding to the worker's line of sight, and a control device that acquires process information managed chronologically in a database. The control device includes a communication unit that performs data communication with the wearable imaging device. The image data acquired by the imaging device is imported into the control device via the communication unit, and is recorded in a recording unit in association with process information corresponding to the image data from the work information acquired by the control device and metadata including information on the time of shooting. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-79144 Summary of the Invention [Problem to be solved by the invention]

[0004] In the system of Patent Document 1, it is necessary to connect the control device and the wearable imaging device via communication, which may lead to the system becoming more sophisticated and complicated, and the weight of the wearable imaging device increasing.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to collect reliable work evidence without communication at the work site in a system that collects work evidence that serves as evidence of the date and time of work. [Means for solving the problem]

[0006] The present disclosure relates to a work evidence collection system that collects work evidence that serves as evidence of the date and time of work performed by workers, and includes a portable information terminal device having a display device that displays information referenced by workers, and an imaging device that has a recording unit that records imaging data captured from the display device of the information terminal device and does not use communication with the information terminal device, and the information terminal device includes a processor and a storage device that stores an application program for collecting work evidence, and when the application is started by executing the program, the processor is configured to execute a time information acquisition process that acquires current time information, a display screen generation process that generates a display screen including a time display of the time information, and a display process that displays the display screen on the display device.

[0007] The present disclosure also provides an application program that is installed on an information terminal device carried by a worker wearing a wearable camera that acquires imaging data in the field of view, and collects work evidence that serves as proof of the worker's work date and time.The program is configured so that when the application is launched, it acquires current time information, generates a display screen that includes a time display of the time information, and displays the display screen on the display device of the information terminal device. [Effects of the Invention]

[0008] According to the technology of the work evidence collection system disclosed herein, when an information terminal device enters the imaging range of an imaging device, the imaging device records imaging data of the display screen of the information terminal device. Because the display screen includes a time display, the time display can be used as work evidence indicating the time when the worker actually performed the work. This makes it possible to collect highly reliable work evidence at the work site without communication. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram for explaining an overview of a work evidence collection system according to an embodiment. [Figure 2] 1 is a block diagram showing a functional configuration of a work evidence collection system according to an embodiment. [Figure 3] 2 is a diagram for explaining various functions of a control device of an information terminal device 20 according to an embodiment. FIG. [Figure 4] 10 is a flowchart for explaining the flow of a work evidence collection method. [Figure 5] FIG. 10 is a diagram illustrating a modification of the hardware resources of the control device. [Figure 6] FIG. 10 is a diagram for explaining a modified example of a display screen. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment will be described with reference to the drawings. Note that elements common to the various drawings are given the same reference numerals and redundant explanations will be omitted.

[0011] Embodiment 1. Overview of the work evidence collection system in the embodiment FIG. 1 is a diagram illustrating an overview of a work evidence collection system according to an embodiment. Work evidence collection system 100 is a system that collects work evidence that serves as evidence of the date and time that a worker performed work at a work site. Work evidence collection system 100 is applied to, for example, maintenance and inspection work on elevators, escalators, and other lifts. Work evidence collection system 100 mainly comprises a wearable camera 10, an information terminal device 20, and a management device 60.

[0012] Wearable camera 10 is an imaging device worn by a worker. Wearable camera 10 is configured to be wearable, for example, near the worker's head, and has an imaging function that captures images in the worker's field of view and acquires imaging data. Wearable camera 10 also has a recording function that records the captured imaging data internally. Note that wearable camera 10 does not communicate with information terminal device 20.

[0013] The information terminal device 20 is a portable terminal device such as a smartphone equipped with a display device 24 that displays information. The information terminal device 20 is carried by a worker performing work at a work site. An application program used by the worker when performing work is installed in the information terminal device 20. The application has functions for performing a time information acquisition process that acquires current time information, a work instruction acquisition process that acquires work instruction information regarding the work content to be performed by the worker, a display screen generation process that generates a display screen to be provided to the worker performing the work, and a display process that displays the generated display screen on the display device 24. When the application of the information terminal device 20 is started, the above-mentioned various processes are executed, and the generated display screen is displayed on the display device 24 of the information terminal device 20. Here, the displayed display screen includes a work instruction display that shows the work instruction content, a time display that shows the current time, and an ornamental display that emphasizes the time display.

[0014] Management device 60 is an information processing device operated by a worker in the office. Management device 60 is also called a management server. Management device 60 has a database in which work instruction information for various tasks is stored. Management device 60 communicates with information terminal device 20 to download work instruction information requested by information terminal device 20 to information terminal device 20. Management device 60 also communicates with wearable camera 10 to upload imaging data recorded in wearable camera 10. Furthermore, management device 60 analyzes the uploaded imaging data to extract a timestamp.

[0015] 2. Functional configuration of the work evidence collection system according to the embodiment 2 is a block diagram showing the functional configuration of a work evidence collection system according to an embodiment. Work evidence collection system 100 includes wearable camera 10 described above and information terminal device 20. Wearable camera 10 includes imaging unit 12 with an imaging function and recording unit 14 with a recording function. Recording unit 14 is, for example, a non-volatile or volatile semiconductor memory such as a flash memory, or a magnetic disk. Note that a general-purpose video camera with imaging and recording functions can be used as wearable camera 10.

[0016] The information terminal device 20 includes a control device 22 and a display device 24 for displaying a display screen. The control device 22 is a microcomputer including at least one processor 30 and at least one storage device 32.

[0017] The storage device 32 stores an application program 34 and various data 36 related to the program 34. The processor 30 includes a CPU (Central Processing Unit). The processor 30 reads and executes the program 34 to realize various functions of the control device 22. The program 34 may be recorded on a computer-readable recording medium.

[0018] The display device 24 is a display having a display function for displaying information to the worker. The display device 24 may be configured as a touch panel display having the above display function and an operation function for receiving input from the worker.

[0019] 3 is a diagram illustrating various functions of the control device of the information terminal device 20 according to the embodiment. As shown in this diagram, the control device 22 includes, as its functional blocks, a time information acquisition processing unit 41, a work instruction information acquisition processing unit 42, a display screen generation processing unit 43, and a display processing unit 44.

[0020] The time information acquisition processing unit 41 is a functional block for executing the time information acquisition process. In the time information acquisition process, the time information acquisition processing unit 41 acquires the current time information from a clock function built into the information terminal device 20. Alternatively, the time information acquisition processing unit 41 may be configured to acquire the current time information through a standard radio wave of time information.

[0021] The work instruction information acquisition processing unit 42 is a functional block for executing work instruction information acquisition processing. In the work instruction information acquisition processing, the work instruction information acquisition processing unit 42 stores the work instruction information downloaded from the management device 60 in the data 36 area of ​​the storage device 32. Note that in the work instruction information acquisition processing, the work instruction information acquisition processing unit 42 may be configured to acquire the work instruction information from the management device 60 via a LAN line in an office or the like, or may be configured to acquire the work instruction information from the management device 60 via a communication network such as the Internet at a work site or the like.

[0022] The display screen generation processing unit 43 is a functional block for executing the display screen generation processing. In the display screen generation processing, the display screen generation processing unit 43 generates a display screen including a work instruction display including the acquired work instruction information and a time display including the acquired time information. There are no limitations on the font, size, layout, etc. of the work instruction display and the time display. In the example of the display screen shown in Figure 1, a decorative display is added to the time display to emphasize the time display and improve its visibility. There are no limitations on the shape, color, etc. of the decorative display. Figure 1 shows a decorative display surrounded by a thick rectangular frame.

[0023] The display processing unit 44 is a functional block for executing display processing. In the display processing, the display processing unit 44 causes the display device 24 to display the display screen generated by the display screen generation processing.

[0024] 3. Work evidence collection method using the work evidence collection system of the embodiment Next, we will explain how workers collect highly reliable information on work dates and times as work evidence when performing elevator maintenance management work. Figure 4 is a flowchart for explaining the flow of the work evidence collection method. Below, we will explain the flow of the work evidence collection method, also referring to Figure 1.

[0025] 4, a worker performs a preparatory step in the office. Here, the worker downloads work instruction information including instructions for the planned work from the database of the management device 60 and records it in the information terminal device 20 via the communication network. After downloading, the worker moves to the work site.

[0026] In the next step S102, the worker wears wearable camera 10 on his head at the work site and starts recording, whereby wearable camera 10 captures an image in the worker's field of view.

[0027] In the next step S104, the worker starts an application on the information terminal device 20 to display the display screen. The display screen includes, for example, a work instruction display, a time display, and a decoration display as shown in FIG.

[0028] In the next step S106, the worker performs the work while referring to the display screen displayed on information terminal device 20. As a result, the image data captured by wearable camera 10 worn by the worker includes an image of the display screen displayed on information terminal device 20.

[0029] In the next step S108, the worker returns to the office and performs post-processing, where the worker uploads the image data recorded in wearable camera 10 and stores the image data in management device 60 via the communication network.

[0030] In the next step S110, the management device 60 uses a known image analysis method to detect frames including the display screen of the information terminal device 20 from images in the stored imaging data. The management device 60 then extracts the time display on the display screen in the detected frame. In the next step S112, the time information obtained from the extracted time display is collected as work evidence.

[0031] According to this method for collecting work evidence, when a worker refers to the work instruction display on the display screen of information terminal device 20, the display screen will be captured by wearable camera 10. Because the display screen includes a time display, the time display can be used as work evidence indicating the time when the worker actually performed the work. This makes it possible to collect highly reliable work evidence that is difficult to tamper with.

[0032] Furthermore, since wearable camera 10 does not use communication with information terminal device 20, it is possible to prevent the system from becoming more sophisticated and complex, and the weight of wearable camera 10 from increasing.

[0033] The display screen also includes decorative displays to emphasize the time display and improve visibility, which can increase the success rate when extracting the time display from the image data.

[0034] 4. Variations The work evidence collection system 100 according to the embodiment may be modified as follows.

[0035] 4-1.Control device 22 Fig. 5 is a diagram showing a modified example of the hardware resources of the control device. In the example shown in Fig. 5, the control device 22 includes, for example, a processor 30, a storage device 32, and a processing circuit 52 including dedicated hardware 50. Fig. 5 shows an example in which some of the functions of the control device 22 are realized by the dedicated hardware 50. All of the functions of the control device 22 may also be realized by the dedicated hardware 50. The dedicated hardware 50 may be a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

[0036] There is no limitation on the functional arrangement of the control device 22. That is, some of the functions of the control device 22 may be arranged inside the management device 60. When some of the functions of the control device 22 are arranged in the management device 60, the control device 22 may be connected to the management device 60 via a communication network such as a LAN line or the Internet line.

[0037] 4-2. Display screen generation processing unit 43 The display screen generated in the display screen generation process only needs to include at least a time display, and the work instruction display and decoration display are not necessarily required display contents. Note that if the work instruction display is not included in the display screen, the configuration of the work instruction information acquisition processing unit 42 is not required.

[0038] On the display screen generated in the display screen generation process, the time display may be displayed as an encrypted code. FIG. 6 is a diagram illustrating a modified example of the display screen. In the modified example shown in FIG. 6, a code obtained by encrypting the time display is displayed on the display device 24. In this configuration, for example, the acquired time information may be subjected to a known encryption process in the display screen generation process to generate the code. Note that there is no limitation on the encryption method for the time display. For example, the code may be a two-dimensional barcode such as a QR code (registered trademark), or may be a code generated by combining identifiable numbers, pictograms, etc. With this modified configuration, it becomes difficult for workers to infer the time information from the code, making it even more difficult to falsify or tamper with the work evidence, thereby further improving the reliability of the work evidence.

[0039] 4-3. Display processing unit 44 The time displayed on the display screen during the display process may be displayed in a display format that is difficult for humans to see but can be captured by wearable camera 10. Such a display format may be a format that momentarily displays the time, such as a blinking display that is synchronized with the video recording cycle or a specific frequency band of wearable camera 10. This configuration makes it even more difficult to falsify or tamper with the work evidence, further improving the reliability of the work evidence.

[0040] In the display process, the display processing unit 44 may limit the time period during which the screen display can be displayed. That is, the work instruction information acquired by the work instruction information acquisition process includes information defining the available work time range. In the display screen generation process, the display screen generation processing unit 43 generates a display screen associated with information on the available work time range. Then, in the display process, the display processing unit 44 restricts the display of the display screen if the current time is not included in the available work time range. With this configuration, the display screen for a work instruction that has passed the available work period is not displayed, making it possible to limit the available work times, thereby improving the reliability of the time display displayed on the display device 24.

[0041] 5.Other Although the preferred embodiments have been described in detail above, the present disclosure is not limited to the above-described embodiments, and various modifications and substitutions can be made to the above-described embodiments without departing from the scope of the claims.

[0042] Various aspects of the present disclosure are summarized below as appendices.

[0043] (Appendix 1) A work evidence collection system that collects work evidence that serves as evidence of the work date and time of a worker, a portable information terminal device having a display device that displays information referenced by the worker; an imaging device having a recording unit that records imaging data obtained by imaging the display device of the information terminal device, the imaging device not using communication with the information terminal device; The information terminal device a processor; a storage device in which a program for an application for collecting the work evidence is stored; When the application is started by executing the program, the processor a time information acquisition process for acquiring current time information; a display screen generation process for generating a display screen including a time display of the time information; a display process for displaying the display screen on the display device; a work evidence collection system configured to: (Appendix 2) the imaging device is a wearable camera that acquires imaging data in the field of view of the worker, When the application is launched, the processor The system is further configured to execute a work instruction information acquisition process for acquiring work instruction information for instructing the worker on work content, In the display screen generation process, the processor generating the display screen further including a work instruction display representing the work instruction information; 2. The work evidence collection system of claim 1, configured as follows: (Appendix 3) The work evidence collection system according to claim 1 or 2, further comprising a management device that extracts the time information contained in the imaged display screen from the image data. (Appendix 4) In the display screen generation process, the processor generating the display screen further including a decorative display for emphasizing the visibility of the time display; The work evidence collection system according to any one of Supplementary Note 1 to Supplementary Note 3, configured as follows: (Appendix 5) In the display screen generation process, the processor An encrypted representation of the time information is generated as the time display. The work evidence collection system according to any one of Supplementary Note 1 to Supplementary Note 4, configured as follows: (Appendix 6) In the display processing, the processor Instantaneous display of the time The work evidence collection system according to any one of Supplementary Note 1 to Supplementary Note 5, configured as follows: (Appendix 7) The work instruction information includes information defining a time range in which the work can be performed for the work content, In the display processing, the processor When the current time is not included in the available work time range, the display on the display screen is restricted. 3. The work evidence collection system of claim 2, configured as follows: (Appendix 8) An application program that is installed on an information terminal device carried by a worker wearing a wearable camera that acquires imaging data in the field of view, and collects work evidence that serves as evidence of the worker's work date and time, When the application is started, the program Get the current time information, generating a display screen including a time display of the time information; The display screen is displayed on a display device of the information terminal device. A program that is structured as follows. [Explanation of symbols]

[0044] 10 wearable camera, 12 imaging unit, 14 recording unit, 20 information terminal device, 22 control device, 24 display device, 30 processor, 32 storage device, 34 program, 36 data, 41 time information acquisition processing unit, 42 work instruction information acquisition processing unit, 43 display screen generation processing unit, 44 display processing unit, 50 dedicated hardware, 52 processing circuit, 60 management device, 100 work evidence collection system

Claims

1. A work evidence collection system that collects work evidence that serves as evidence of the work date and time of a worker, a portable information terminal device having a display device that displays information referenced by the worker; an imaging device having a recording unit that records imaging data obtained by imaging the display device of the information terminal device, the imaging device not using communication with the information terminal device; The information terminal device a processor; a storage device in which a program for an application for collecting the work evidence is stored; When the application is started by executing the program, the processor a time information acquisition process for acquiring current time information; a display screen generation process for generating a display screen including a time display of the time information; a display process for displaying the display screen on the display device; a work evidence collection system configured to:

2. the imaging device is a wearable camera that acquires imaging data in the field of view of the worker, When the application is launched, the processor The system is further configured to execute a work instruction information acquisition process for acquiring work instruction information for instructing the worker on work content, In the display screen generation process, the processor generating the display screen further including a work instruction display representing the work instruction information; The work evidence collection system according to claim 1 , configured to:

3. The work evidence collection system according to claim 1 or 2, further comprising a management device that extracts the time information included in the captured image of the display screen from the captured image data.

4. In the display screen generation process, the processor generating the display screen further including a decorative display for emphasizing the visibility of the time display; 3. The work evidence collection system according to claim 1 or 2, configured as follows:

5. In the display screen generation process, the processor An encrypted representation of the time information is generated as the time display.

3. The work evidence collection system according to claim 1 or 2, configured as follows:

6. In the display processing, the processor Instantaneous display of the time 3. The work evidence collection system according to claim 1 or 2, configured as follows:

7. The work instruction information includes information defining a time range in which the work can be performed for the work content, In the display processing, the processor When the current time is not included in the available work time range, the display on the display screen is restricted. The work evidence collection system according to claim 2 , configured as follows:

8. An application program that is installed on an information terminal device carried by a worker wearing a wearable camera that acquires imaging data in the field of view, and collects work evidence that serves as evidence of the worker's work date and time, When the application is started, the program Get the current time information, generating a display screen including a time display of the time information; The display screen is displayed on a display device of the information terminal device. A program that is structured as follows.

Citation Information

Patent Citations

  • Clock with image pickup function

    JP2000354182A

  • Construction photograph cooperation auxiliary device, construction photograph cooperation server, construction photograph cooperation auxiliary program, and construction photograph cooperation program

    JP2013073561A

  • Campaign application authentication device

    JP2018101189A

  • Construction management system

    JP2019175132A

  • Work selection system and method for selecting work

    JP2019191735A