Information processing system, information processing method, and program

Abstract

To provide a mechanism that can accurately measure working hours for workers.SOLUTION: Information about a tool and a worker obtained by acquiring identification codes is controlled to be recorded, and the time during which the identification codes are acquired is controlled to be recorded as the time spent by the worker using the tool.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] Techniques for measuring the working time of a worker have been known for some time.

[0003] Patent document 1 discloses that a work time measurement device such as a smartphone is installed in the location where a worker places a work instruction sheet while working, and the time that the work instruction sheet is visible on the reading section of the work time measurement device is measured as the work time. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2021-144439 DISCLOSURE OF THE INVENTION [Problem to be solved by the invention]

[0005] The method of Patent Document 1 measures the time that the work instructions are displayed as work time, which can lead to discrepancies with the time that the worker actually spends working, making it difficult to measure work time appropriately.

[0006] Therefore, an object of the present invention is to provide a mechanism that can more appropriately measure the working time of a worker. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention provides: Controlling to record information about the tool and the worker obtained by acquiring the identification code; a recording control means for controlling the recording of the time during which the identification code is acquired as the work time by the worker using the tool; The present invention is characterized by comprising: [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a mechanism that enables detailed analysis of workers by visualizing their working hours. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 illustrates an example of a configuration of an information processing system. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing apparatus. [Figure 3] 10 is a flowchart illustrating an example of a process for measuring a task time. [Figure 4] 10 is a flowchart showing an example of a warning process when a tool is lost. [Figure 5] 10A and 10B are diagrams illustrating an example of acquisition of identification information according to the presence or absence of a tool. [Figure 6] 10A and 10B are diagrams illustrating an example of PTZ adjustment of the imaging device B. FIG. [Figure 7] FIG. 10 is a diagram illustrating an example of a screen that visualizes work time. [Figure 8] FIG. 10 is a diagram illustrating an example of a search screen. [Figure 9] 10 is a table showing an example of data included in a two-dimensional code and data managed by a server 105. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0011] First, with reference to FIG. 1, an example of the configuration of an information processing system according to an embodiment of the present invention will be described.

[0012] In the information processing system of the present invention, an imaging device A102, an imaging device B104, a server 105, and a client terminal 106 are communicably connected via a network 110. The imaging device A102 is installed above the workbench 103 in a position where it can read the two-dimensional code 100 placed on the workbench 103.

[0013] The imaging device A102 is a device capable of reading two-dimensional codes, such as a smartphone, a tablet, or a two-dimensional code reader.

[0014] Tools 101 such as screwdrivers, drill bits, hammers, pliers, wrenches, spanners, and screws are arranged on a workbench 103. The tools 101 are arranged on the workbench 103 so as to overlap the two-dimensional code 100 (so as not to be recognized by the imaging device A 102). Therefore, it is assumed that the placement locations of the tools 101 are predetermined and the situation is somewhat organized. The tools may be arranged on one workbench, or each workbench may be assigned to a worker.

[0015] 9(a), the two-dimensional code 100 includes an identification number 901 for unique identification, a worker's name 902, a tool name 903, a name 904 of the image capture device B 104, and information on pan, tilt, and zoom (hereinafter, PTZ) of the image capture device B 104. The two-dimensional code 100 and each tool 101 are arranged so as to correspond to each other. Therefore, by attaching a tag to each tool and installing a sensor that reads the attached tag near the two-dimensional code 100, it is possible to determine whether the tool has been returned to a location different from the location where it was taken out.

[0016] The image capturing device B 104 is a camera that can be connected to a network. When the worker brings out the tool 101 and the two-dimensional code 100 is read by the image capturing device A 102, the image capturing device B 104 is controlled to become the PTZ included in the two-dimensional code 100.

[0017] The server 105 acquires and analyzes information sent from the imaging device A 102, records the time the worker and tool were used, issues instructions to change the PTZ of the imaging device B 104, and controls the display of the work time recording screen, etc. on the display 212 of the client terminal 106.

[0018] The client terminal 106 is an information processing device equipped with a display 212, such as a personal computer (hereinafter referred to as a PC) or a smartphone. A work time recording screen, a search screen, etc. are displayed on the display 212, and instructions from the user are accepted. In this embodiment, the display destination when displaying is the display 212.

[0019] FIG. 2 is a block diagram showing an example of the hardware configuration of the information processing device (server 105, client terminal 106) of the present invention.

[0020] As shown in FIG. 2, the information processing device is connected to a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a storage device 204, an input controller 205, an audio controller 206, a video controller 207, a memory controller 208, and a communication I / F controller 209 via a system bus 200.

[0021] The CPU 201 controls all devices and controllers connected to the system bus 200 .

[0022] ROM202 or external memory 213 stores the BIOS (Basic Input / Output System) and OS (Operating System), which are control programs executed by CPU201, computer-readable and executable programs for realizing this information processing method, and various necessary data (including data tables).

[0023] The RAM 203 functions as a main memory, a work area, etc. for the CPU 201. The CPU 201 loads programs and the like required for executing processing from the ROM 202 or the external memory 213 into the RAM 203, and executes the loaded programs to realize various operations.

[0024] The input controller 205 controls input from input devices such as a keyboard 210 and a pointing device such as a mouse (not shown). If the input device is a touch panel, the user can issue various instructions by pressing (touching with a finger or the like) icons, cursors, or buttons displayed on the touch panel.

[0025] The touch panel may also be a touch panel capable of detecting positions touched by multiple fingers, such as a multi-touch screen.

[0026] The video controller 207 controls the display on an external output device such as a display 212. The display also includes the display of a notebook computer integrated with the main body. Note that the external output device is not limited to a display, and may be, for example, a projector. In addition, for devices capable of receiving the above-mentioned touch operation, an input device is also provided.

[0027] The video controller 207 can control a video memory (VRAM) for display control, and can use part of the RAM 203 as a video memory area, or can provide a separate dedicated video memory.

[0028] The memory controller 208 controls access to the external memory 213. The external memory may be an external storage device (hard disk) that stores a boot program, various applications, font data, user files, edited files, and various data, a flexible disk (FD), or a CompactFlash (registered trademark) memory connected to a PCMCIA card slot via an adapter.

[0029] The communication I / F controller 209 connects and communicates with external devices via a network, and executes communication control processing on the network. For example, communication using TCP / IP, telephone lines such as ISDN, and 4G and 5G mobile phone lines are possible.

[0030] The CPU 201 enables display on the display 212 by, for example, executing a process of expanding (rasterizing) an outline font into a display information area in the RAM 203. The CPU 201 also enables user instructions using a mouse cursor (not shown) on the display 212.

[0031] Next, the basic processing of visualizing work time in the embodiment of the present invention will be described with reference to the flowchart of FIG.

[0032] 3 is a flowchart showing the overall processing when the system is executed. The processing of each step is executed by the CPU 201 of each device. When the system is constructed and each device is started, the processing of FIG. 3 begins.

[0033] In S301, the CPU 201 acquires an image captured by the imaging device A102. Specifically, an image of the top of a workbench captured by the imaging device A102 is acquired. When capturing images with the imaging device A102, the imaging device may continue capturing images all the time, or may start capturing images when a moving object is detected within the capturing range.

[0034] In S302, the CPU 201 determines whether a two-dimensional code has been read from the acquired image. If a two-dimensional code has been read, the process proceeds to S303; if not, the process proceeds to S306. Here, whether the tool has been removed from the workbench (whether the tool is in use) is determined based on whether the two-dimensional code has been read.

[0035] This will be explained in detail using Figure 5. Figure 5(a) shows a state in which the tool is unused. The two-dimensional code overlaps the tool, so it cannot be recognized by the imaging device A102 provided above. In contrast, Figure 5(b) shows a state in which the tool on the right is in use, so the two-dimensional code can be recognized by the imaging device A102. In this embodiment, the two-dimensional code cannot be recognized by arranging the two-dimensional code and the tool so that they overlap, but any method can be used as long as it can change the reading status of the two-dimensional code depending on whether the tool is in use or not, such as completely covering the two-dimensional code with some kind of object and then shifting the object when the tool is removed to make the two-dimensional code readable.

[0036] In S303, the CPU 201 records the worker and the tool use start time in the RAM 203 or the external memory 213. Specifically, the information acquired from the two-dimensional code 100 is recorded in the registration data table of FIG. 9(b). The registration data table records a registration number 908 for uniquely identifying each record, a tool use start time 909, and each piece of information acquired from the two-dimensional code 100. As each piece of information obtained by reading the two-dimensional code, the worker name 902, the tool name 903, the name of the imaging device B 104, and the PTZ information of the imaging device B 104 are recorded. In addition, the date and time when the two-dimensional code was read is recorded as the tool use start time 909.

[0037] In S304, the CPU 201 instructs the imaging device B104 corresponding to the tool to change its PTZ. Specifically, the CPU 201 instructs the identified imaging device B104 to control the PTZ in accordance with the name of the imaging device B104 and the PTZ information of the imaging device B104 obtained by reading the two-dimensional code 100. The PTZ value may be set, for example, to capture the entire production process A, or may be set to capture a specific point in the production process A (i.e., to capture a person in a specific working position).

[0038] This will be explained using the factory image diagram in Figure 6. Assume that the two-dimensional code 100 contains PTZ information for camera α 603, which is set to capture images of worker A 601, driver 602, and production process A. In production process A, work is carried out on part 604 using driver 602. When the two-dimensional code 100 is read by driver 602 being removed from workbench 103, camera α 603 controls the PTZ so that it can capture images of production process A, and records how worker A 601 is working. The recorded images are displayed on the screens in Figures 7 and 8, which will be described later.

[0039] Meanwhile, in S305, the CPU 201 determines whether there is a tool for which the tool use start time has been recorded but the tool use end time 910 has not been recorded. Specifically, after the tool use start time 909 has been recorded due to the tool 101 being taken out once, the CPU 201 determines whether the tool use end time 910 has not been recorded. If the tool use end time has not been recorded, the process proceeds to S306; if not, the process proceeds to S307.

[0040] In S306, the CPU 201 records the worker and the tool use end time in the RAM 203 or the external memory 213. Specifically, the CPU 201 records the worker name 902, tool name 903, name of imaging device B 104, and PTZ information of imaging device B 104, which are obtained by reading the two-dimensional code 100. The CPU 201 also records the current time as the tool use end time 910. As a result, the tool 101 is recorded as being in use while the two-dimensional code 100 is being read by imaging device A 102, and when the tool 101 is returned to its original position and the two-dimensional code 100 can no longer be read, it can be determined that the use of the tool 101 has ended.

[0041] In S307, the CPU 201 determines whether or not it has received a stop instruction for the server 105. If a stop instruction has been received, the process ends, and if not, the process returns to S301 and repeats the process of the flowchart until a stop instruction is received.

[0042] Examples of screens for displaying and searching measurement results will be described using FIGS. 7 and 8. Regarding the tool-specific usage time filter 701, the operator-specific usage time filter 706, and the search shown in FIG. 8, the registered data table shown in FIG. 9(b) is referenced to identify the data to display. First, the display of measurement results will be described using the example screen shown in FIG. 7. First, the tool-specific usage time filter 701 is used to specify a period 702 and a tool 703. For the period 702, both the start and end dates may be specified, or only one of them may be specified. Registered tools are displayed as tools 703, and the tool for which tool usage time is to be displayed can be selected using a checkbox or similar method. The time during which the specified tool was used within the period specified by the filter is displayed as a bar graph 704. The example screen shows that drill bit A was used for 150 hours from September 1, 2024 to September 15, 2024. Furthermore, for the specified tool 703, a line graph 705 displays the average annual usage time of each tool. The average usage time for the specified period 702 can be displayed, or a period can be specified to display the average for the past few years. When displaying the average usage time for the specified period 702, it is calculated by multiplying the average usage time per day for the past few years by the specified period 702. The example screen shows that the drill bit was used for an average of approximately 130 hours in the specified period 702. This makes it possible to compare by tool and check whether a particular tool is taking too long to perform the task. In other words, checking whether there are any tools that are used for too long can serve as a starting point for considering ways to improve work time efficiency.

[0043] Next, a specific date 707 and / or worker 708 are specified using the worker usage time filter 706. Registered workers are displayed as worker 708, and the worker for whom usage time is to be displayed can be selected using a checkbox or other method. A bar graph 709 displays which tools the specified worker used for how long on the specified date. The graph may display all registered tools, or it may display only the tools selected by the user. In the example screen, this shows that Person A used Drill Bit A from 8:15 to 9:50 and Drill Bit B from 10:50 to 11:50. This allows for analysis of work time efficiency, such as comparing the work time of skilled workers to consider ways to reduce the work time of other workers or identifying workers who need training.

[0044] When a selection of the bar graph 709 is accepted, a corresponding video preview 710 is displayed. For example, when a selection of the bar graph 709 for drill bit A by person A is accepted, a video preview 710 recording that state is displayed. Detailed information related to the video preview 710 is displayed as work information 711. For example, the worker, work content, work time, and average work time are displayed. The work time is the time taken by person A to work using drill bit A, and the average work time is the time taken by all workers to work using drill bit A in the year up to the specified date 707.

[0045] Next, an example of searching for measurement results will be described using the example screen in FIG. 8. A search filter 801 is used to specify a period 802 and a camera selection 803. The period 802 can be used to narrow down the period you want to search, including the time and date. The camera selection 803 allows you to select which camera was used to capture images of the work being done by the imaging device B 104, in order to display the images. If no camera is selected, all images within a specified period may be displayed. Furthermore, the bookmark 804 function may be used to display search results narrowed down by keyword. For example, if you want to search for images of a specific worker, enter the worker's name as a keyword and perform a search. When the search button 805 is pressed, the search results are displayed in a search result display area 806.

[0046] The search result display area 806 displays images 807 taken by a specified camera within a specified period. Here, still images are displayed in units of seconds. When the selection of an image 807 is accepted, video within a range of several seconds before and after the selected image, or video up to several seconds after the time of the selected image, is displayed in the video display area 809. The selected image 807 is displayed so that it can be identified as having been selected, for example by surrounding it with a thick frame or adding color to the frame. In addition, the specified period is displayed with a bar 808, and by moving the bar 808, the period you want to display can be easily selected.

[0047] For example, video recorded around 14:00:06 on 2024 / 9 / 15 or from 14:00:06 to a few seconds later is displayed in the video display area 809. Detailed information related to the video is displayed as work information 810. For example, the camera name, work content, and work time are displayed.

[0048] By recording the work as video in this way, it is possible to use the video as a teaching material for the work methods of skilled workers or to explain the points to be improved to personnel who need training. In addition, the video can be recorded as evidence in case any problems occur, and can be extracted using the search function as needed.

[0049] This concludes the explanation of Figure 3.

[0050] Next, the basic processing of a tool loss warning in the embodiment of the present invention will be described with reference to the flowchart of FIG.

[0051] 4 is a flowchart showing the overall processing when the system is executed. Note that the processing of each step is executed by the CPU 201 of each device. Once the system is constructed and each device is started, the processing of FIG. 4 begins.

[0052] In S401, the CPU 201 determines whether the current time is outside of working hours, such as a break time or after regular working hours. If it is outside of working hours, the process proceeds to S402; if not, the process proceeds to S406. By registering working hours in the system in advance, it is possible to determine whether it is outside of working hours. Note that even if an employee works overtime or during hours other than normal working hours, by registering these hours as well, the system can be set up so that the employee is determined to be within working hours.

[0053] In S402, the CPU 201 acquires an image captured by the imaging device A102. Specifically, an image of the top of a workbench captured by the imaging device A102 is acquired. When capturing images with the imaging device A102, the imaging device may continue capturing images all the time, or may start capturing images when a moving object is detected within the capturing range.

[0054] In S403, CPU 201 determines whether a two-dimensional code has been read from the acquired image. If a two-dimensional code has been read, the process proceeds to S404; if not, the process proceeds to S406. Here, it is determined whether the tool has been removed from the workbench (whether the tool is in use) based on whether the two-dimensional code has been read. The reading of the two-dimensional code is the same as that described above with reference to FIG. 5.

[0055] In S404, the CPU 201 records the worker and the time of the lost tool in the RAM 203 or the external memory 213. The time when the two-dimensional code is read outside of working hours may be recorded as the time of the lost tool, or the time when the two-dimensional code is read a certain time after the start of working hours may be recorded as the time of the lost tool.

[0056] In S405, the CPU 201 controls to issue a tool loss warning. When the lost tool time is recorded in S404, a warning indicating that the tool is lost or not returned to its designated location is sent to the client terminal 106. The warning may be sent until the tool is returned, or the warning may stop after a certain period of time has elapsed. Any method of notification may be used, such as displaying a warning screen or notifying by voice, as long as it notifies the user that the tool has not been returned. This allows for proper management of whether tools are returned to their original locations after work is completed, and whether any tools are missing, since a user may not realize that a tool has been lost if the tools are managed in a complicated manner. Furthermore, since the working environment cannot be considered appropriate if tools are used outside of working hours, it is possible to determine whether tools are being used outside of working hours.

[0057] In S406, the CPU 201 determines whether or not it has received a stop instruction for the server 105. If a stop instruction has been received, the process ends, and if not, the process returns to S401 and repeats the process of the flowchart until a stop instruction is received.

[0058] This concludes the explanation of Figure 4.

[0059] As described above, according to this embodiment, it is possible to provide a mechanism that enables detailed analysis of workers by visualizing their working time.

[0060] The present invention can be embodied as, for example, a system, an apparatus, a method, a program, a recording medium, etc. Specifically, the present invention may be applied to a system consisting of multiple devices, or may be applied to an apparatus consisting of a single device.

[0061] The various controls described above as being performed by CPU 201 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0062] Furthermore, although the present invention has been described in detail based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0063] (Other embodiments) The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the storage media storing the program constitute the present invention. [Explanation of symbols]

[0064] 100 QR Code 101 Tools 102 Imaging device A 103 Workbench 104 Imaging Device B 105 Server 106 client terminals 110 Network

Claims

1. Controlling to record information about the tool and the worker obtained by acquiring the identification code; a recording control means for controlling the recording of the time during which the identification code is acquired as the work time by the worker using the tool; An information processing system comprising:

2. The information processing system according to claim 1, characterized in that the recording control means records the time when the identification code was acquired as the tool use start time, and if the identification code can no longer be acquired, controls the recording means to record the time when the last identification code was acquired as the tool use end time.

3. The information processing system according to claim 2, characterized in that the recording control means controls the recording of the tool use end time when the identification code cannot be obtained after the tool use start time has been recorded and the tool use end time has not been recorded.

4. The information processing system according to claim 1, further comprising a control means for controlling the PTZ of the imaging device so that the worker is within a range where he or she can be photographed, based on information regarding the worker and the PTZ of the imaging device obtained by acquiring the identification code.

5. 2. The information processing system according to claim 1, further comprising a display control means for controlling the display of tool usage times based on the work times recorded by said recording control means.

6. 6. The information processing system according to claim 5, wherein the display control means controls the display of the usage time of each of a plurality of tools by worker based on the work time recorded by the recording control means.

7. a search means for searching for images captured by the imaging device within a specified period; 5. The information processing system according to claim 4, further comprising a display control means for controlling, when a selection of an image retrieved by said retrieval means is accepted, to display a video relating to said image.

8. The information processing system according to claim 1, further comprising a notification means for controlling the recording control means to issue a warning when the tool use start time is recorded by the recording control means within a predetermined time period but the tool use end time is not recorded.

9. An information processing system including at least a first imaging device, a second imaging device, and an information processing device, the first imaging device, an acquisition means for acquiring an identification code; a transmitting means for transmitting information obtained by acquiring the identification code by the acquiring means to an information processing device; Equipped with The information processing device includes: a recording control means for receiving and recording the information transmitted by the transmitting means; a control means for controlling the PTZ of the second image capture device based on information relating to the PTZ of the second image capture device included in the information recorded by the recording control means; An information processing system comprising:

10. 10. The information processing system according to claim 1, wherein the identification code includes information about at least the tool, the worker, and the PTZ of the imaging device.

11. Controlling to record information about the tool and the worker obtained by acquiring the identification code; a recording control step of controlling the recording of the time during which the identification code is acquired as work time by the worker using the tool; 1. A method for controlling an information processing system, comprising:

12. A program for causing at least one computer to function as each of the means of the information processing system according to claims 1 to 6, 8 and 9.

Images