Wearable devices

CN115022580BActive Publication Date: 2025-02-11SHIMADZU SEISAKUSHO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202210175375.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-03-05
Filing Date
2022-02-25
Publication Date
2025-02-11
Estimated Expiration
2042-02-25

Smart Images

  • Figure CN115022580B_ABST
    Figure CN115022580B_ABST
Patent Text Reader

Abstract

The present invention provides a wearable device capable of keeping a log of a desired operation without increasing the burden on an operator. The wearable device comprises: a display unit (13) which displays instruction information for indicating the operation content according to the process; a camera unit (14) which photographs the operation of the operator; and a receiving unit which receives process information that can identify the process of the imaging object. When the process corresponding to the instruction information displayed on the display unit (13) is the process of the imaging object determined by the process information received by the receiving unit, the camera unit (14) photographs the operation of the operator.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a wearable device. Background Art

[0002] In recent years, wearable devices have been used at various work sites as tools for workers to confirm the content of their work.

[0003] Japanese Patent Application Laid-Open No. 2020-47298 discloses a technology for displaying a work checklist on a screen of a wearable terminal. Summary of the invention

[0004] According to the technology disclosed in Japanese Patent Application Publication No. 2020-47298, workers can perform work while viewing a work checklist displayed on the screen of a wearable terminal, thereby reducing work errors. However, it is highly desired to not only reduce work errors at the work site but also keep a log of the desired work.

[0005] The present disclosure has been made in view of the relevant actual situation, and one of its purposes is to provide a wearable device that can keep a log of desired work without increasing the burden on workers.

[0006] The wearable device disclosed in the present invention comprises: a display unit that displays instruction information for indicating the content of work by process; a camera unit that captures the work of a worker; and a receiving unit that receives process information that can identify the process of the imaged object. When the process corresponding to the instruction information displayed on the display unit is the process of the imaged object identified by the process information received by the receiving unit, the camera unit captures the work of the worker.

[0007] The above-mentioned objects, features, aspects and advantages and other objects, features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 This is a diagram for explaining the outline of the recording system in the embodiment.

[0009] Figure 2 This is a diagram showing an example of a control structure of a recording system in an embodiment.

[0010] Figure 3 It is a diagram showing an example of instruction information and process information of each process in the embodiment.

[0011] Figure 4 This is a flowchart showing an example of display processing of smart glasses in an embodiment.

[0012] Figure 5 This is a flowchart showing an example of video recording processing by smart glasses in an embodiment.

[0013] Figure 6 This is a sequence diagram showing an example of a recording flow of the recording system in the embodiment. DETAILED DESCRIPTION

[0014] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, the same reference numerals are used for the same or corresponding parts in the drawings, and their description will not be repeated. The embodiments and modifications described below may also be appropriately and selectively combined.

[0015] (Overview of the video recording system)

[0016] Reference Figure 1 The following describes an overview of the video recording system. Figure 1 1 is a diagram for explaining an overview of a recording system 500 in the embodiment. In a scenario where a worker performs a work according to a predetermined procedure, the recording system 500 is used to record the worker's work.

[0017] The recording system 500 includes smart glasses 100 and a PC (Personal Computer) 200. The smart glasses 100 are an example of a "wearable device." The PC 200 is an example of an "information processing device." The smart glasses 100 and the PC 200 can communicate with each other through wired communication or wireless communication.

[0018] The smart glasses 100 include a main body 10, a controller 20, and an input device 30. Transparent protective glasses 11 for protecting eyes are embedded in the main body 10, and a worker can visually recognize the front while wearing the main body 10.

[0019] In addition, the main body 10 is provided with a projection unit 12 and a display unit 13. The display unit 13 is mounted on the protective glasses 11 via a mounting unit 15. The display unit 13 is a glass plate, and displays an image projected by the projection unit 12 (for example, instruction information for indicating the content of work generated by the PC 200). The display unit 13 includes a display 13a on the right eye side and a display 13b on the left eye side. The display 13a on the right eye side is mounted on the protective glasses 11 via a mounting unit 15a on the right eye side, and the display 13b on the left eye side is mounted on the protective glasses 11 via a mounting unit 15b on the left eye side.

[0020] Furthermore, the main body 10 is provided with an imaging unit 14 so as to be able to capture a working situation of a worker who is wearing the main body 10 and performing the work.

[0021] In addition, Figure 1In the example shown, the display unit 13 is a binocular display, but it may be a single-eye display. When the display unit 13 is a binocular display, it is possible to reduce eye fatigue of the user even when viewing a high-resolution image. On the other hand, when the display unit 13 is a single-eye display, the main body 10 can be made lighter. In addition, the display unit 13 may be attachable to or detachable from the protective glasses 11, or it may be a display unit that cannot be removed from the protective glasses 11.

[0022] In the recording system 500, the smart glasses 100 are configured to record the process specified by the process information registered from the PC 200. Therefore, if the manager registers in advance the information that can specify the process for which the log is to be kept as the process information, it is possible to prevent the required scene from being missed, and thus the log of the desired operation can be kept without increasing the burden on the operator. In addition, if the manager registers the process information in advance, the operator does not need to determine whether it is a process to be recorded during the operation and perform the operation for recording (operation to instruct the camera unit 14 to record), so the operator can concentrate on the operation.

[0023] (Detailed structure of the video recording system)

[0024] Reference Figure 1 and Figure 2 To illustrate the control structure of the video recording system. Figure 2 This is a diagram showing an example of a control structure of the recording system 500 in the embodiment.

[0025] The video recording system 500 includes smart glasses 100 and a PC 200 .

[0026] The smart glasses 100 include a main body 10, a controller 20, and an input device 30. The main body 10 includes a projection unit 12, a display unit 13, and an imaging unit 14.

[0027] The projection unit 12 projects instruction information for indicating the work content onto the display unit 13 according to the process according to the instruction of the control unit 21. Thus, instruction information is displayed on the display unit 13 according to the process. The instruction information displayed on the display unit 13 may be a still image or a moving image. The instruction information is generated according to the process using the PC 200. The control unit 21 receives instruction information of each process from the PC 200 via the communication unit 22, and stores the received instruction information of each process in the storage unit 23. The control unit 21 determines instruction information corresponding to the work process from the instruction information stored in the storage unit 23 based on the signal from the input device 30, and causes the projection unit 12 to project the determined instruction information.

[0028] The display unit 13 is a screen (display) that allows the user to visually recognize the instruction information of each process projected by the projection unit 12. The display unit 13 is provided on at least a portion of the protective glasses 11. When the projection unit 12 does not project the instruction information, the display unit 13 is transparent, and the operator can visually recognize the front through the display unit 13.

[0029] Furthermore, the display unit 13 may be configured so that the operator can visually recognize the front through the display unit 13 even when the projection unit 12 is projecting instruction information.

[0030] The camera unit 14 captures the scene of the destination of the operator's sight according to the instruction of the control unit 21. In this way, the working situation of the operator who is wearing the main body 10 and performing the work can be captured. The image captured by the camera unit 14 can be a still image or a moving image. The control unit 21, which serves as a "receiving unit", receives process information that can determine the process that is the object to be captured by the camera unit 14 (hereinafter also referred to as "process of the camera object") from the PC 200 via the communication unit 22, and when the process corresponding to the instruction information displayed on the display unit 13 is the process of the camera object determined by the process information, the camera unit 14 captures the working situation of the operator. The control unit 21 sends the data of the image captured by the camera unit 14 to the PC 200 via the communication unit 22.

[0031] The controller 20 includes a control unit 21, a communication unit 22, and a storage unit 23. The control unit 21 controls the operation of the smart glasses 100. The control unit 21 includes a processor such as a CPU (Central Processing Unit), and memories such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The processor expands the control program stored in the ROM into the RAM and executes it. The ROM stores a control program that records the processing process of the smart glasses 100. The RAM is an operating area when the processor executes the control program, and temporarily stores the control program, data when the control program is executed, etc. The processor controls the operation of the smart glasses 100 by executing the control program.

[0032] The communication unit 22 can communicate with the PC 200 by wired communication or wireless communication. The communication unit 22 receives instruction information of each process and process information that can identify the process of the imaging target from the PC 200, and transmits the data of the image captured by the imaging unit 14 to the PC 200. The instruction information of each process and process information that can identify the process of the imaging target received by the communication unit 22 are received by the control unit 21 as a "receiving unit".

[0033] The storage unit 23 is a nonvolatile storage device for storing various information, such as an SSD (Solid State Drive), an HDD (Hard Disk Drive), etc. The storage unit 23 stores various information such as instruction information of each process received from the PC 200, process information that can identify the process of the imaging object received from the PC 200, and data of the image captured by the imaging unit 14.

[0034] The input device 30 is a device for inputting instructions to the control unit 21 and the progress of the operation, and is equivalent to an "input unit". The input device 30 is operated by an operator wearing the main body 10. The input device 30 can be, for example, a switch (a push-button switch, a rotary switch, etc.), a touchpad and / or a microphone. The input device 30 only needs to be equipped with at least one of a switch, a touchpad and a microphone. In the case where the input device 30 is a switch or a touchpad, instructions to the control unit 21 and the progress of the operation are input by pressing, rotating, touching, and other operations performed by the operator. In the case where the input device 30 is a microphone, instructions to the control unit 21 and the progress of the operation are input by sound.

[0035] As an instruction to the control unit 21, for example, an instruction to start displaying instruction information to the display unit 13 is input by the operator to the input device 30. As the progress of the work, for example, the start and end of the work of each process is input by the operator to the input device 30. The instructions to the control unit 21 and the progress of the work input to the input device 30 are received by the control unit 21 as a "receiving unit".

[0036] The main body 10 and the controller 20 can communicate with each other through wired communication or wireless communication. In addition, the input device 30 and the controller 20 can communicate with each other through wired communication or wireless communication. As an example, the main body 10 and the controller 20 can communicate through wired communication, and the input device 30 and the controller 20 can communicate through wireless communication.

[0037] The PC 200 includes a control unit 201, a storage unit 202, an input device 203, an output device 204, and a communication unit 205. The control unit 201, the storage unit 202, the input device 203, the output device 204, and the communication unit 205 are connected via a bus.

[0038] The control unit 201 controls the operation of the PC 200. The control unit 201 includes a processor such as a CPU and a memory such as a ROM and a RAM. The processor expands the control program stored in the ROM into the RAM and executes it. The ROM stores the control program that records the processing process of the PC 200. The RAM is an operating area when the processor executes the control program, and temporarily stores the control program, data when the control program is executed, etc. The processor controls the operation of the PC 200 by executing the control program.

[0039] The storage unit 202 is a non-volatile storage device for storing various information, such as an SSD, HDD, etc. The storage unit 202 stores various information such as instruction information of each process input to the input device 203, process information that can identify the process of the imaging object input to the input device 203, and data of the image captured by the imaging unit 14 received from the smart glasses 100.

[0040] The input device 203 is a device for inputting instruction information of each process and process information that can identify the process to be imaged. The input device 203 can be a keyboard, a mouse, or the like.

[0041] The output device 204 is a device for outputting various information such as instruction information of each process input to the input device 203, process information that can identify the process of the imaging target input to the input device 203, and data of the image captured by the imaging unit 14 received from the smart glasses 100. The output device 204 can be a display.

[0042] The communication unit 205 can communicate with the smart glasses 100 through wired communication or wireless communication. The communication unit 205 sends the instruction information of each process input to the input device 203 and the process information of the process that can identify the imaging object input to the input device 203 to the smart glasses 100, and receives the data of the image captured by the imaging unit 14 from the smart glasses 100.

[0043] (Instruction information and process information)

[0044] Reference Figure 1 , Figure 2 as well as Figure 3 The instruction information of each process displayed on the display unit 13 and the process information capable of specifying the process to be imaged will be described. Figure 3 It is a diagram showing an example of instruction information and process information of each process in the embodiment.

[0045] exist Figure 3Column A of shows instruction information for each step of a certain analysis work. The instruction information for each step is information for indicating the content of work that a worker should perform in each step, and is displayed on the display unit 13 of the smart glasses 100. The manager uses the PC 200 to create the instruction information.

[0046] exist Figure 3 In the example shown, the instruction information for each process is only text information, but it may also include images. The instruction information created by the manager is sequentially displayed on the display unit 13 in synchronization with the operation process of the operator starting from the first process. As an example, when the operation process of the operator is the first process, a message such as "Please take out lot number AA123 from the storage and return to room temperature" is displayed on the display unit 13.

[0047] exist Figure 3 Column B of the table shows information indicating whether each process is a process to be recorded. Specifically, in a series of operation processes, "R" is marked for processes to be recorded, and "NR" is marked for processes not to be recorded. The process to be recorded is a process to be recorded by the camera unit 14, and the process not to be recorded is a process not to be recorded by the camera unit 14.

[0048] Figure 3 The information shown in the column B of FIG. 1 is an example of “process information” that can identify the process of the imaging object. Figure 3 The information shown in column B of the table indicates the first process of the series of work processes to be recorded (in Figure 3 In the example shown, the first process) and the process to be recorded (in the example shown, the first process) indicating that the previous process is a process not to be recorded Figure 3 In the example shown, the information of the 12th step and the 24th step is an example of the "first information" that can determine the step for the imaging unit 14 to start imaging. Figure 3 The information shown in the column B of FIG. 1 indicates that the next process is a process not to be recorded. Figure 3 In the example shown, the information of the 9th process and the 13th process) and the process of the last recording object in a series of operation processes (in Figure 3 In the example shown, the information of the 25th step) is an example of the "second information" that can determine the step that causes the camera unit 14 to end shooting. Hereinafter, the step that starts shooting will also be referred to as the "shooting start step", and the step that ends shooting will be referred to as the "shooting end step".

[0049] Managers in a series of work processes (in Figure 3In the example shown, the first to the 26th processes are selected to record the operation of the operator and the processes that do not record the operation, and process information that can identify the process to be recorded, that is, the process to be photographed is created. In the smart glasses 100, when the process corresponding to the instruction information displayed on the display unit 13 is a process to be photographed using the process information, the camera unit 14 is used to shoot, thereby photographing the operation of the operator.

[0050] In addition, the process information may also be information indicating the recording start process and the recording end process in a series of operation processes. The recording start process is the process for causing the camera unit 14 to start shooting, and the recording end process is the process for causing the camera unit 14 to end shooting. Therefore, the information indicating the recording start process in a series of operation processes is equivalent to the "first information", and the information indicating the recording end process in a series of operation processes is equivalent to the "second information". Figure 3 In the example shown, information associating the first step, the twelfth step, and the 24th step as recording start steps and information associating the ninth step, the thirteenth step, and the 25th step as recording end steps are process information.

[0051] The manager can arbitrarily select the process to be recorded, but from the perspective of the work log, it is preferable to select the process that does not automatically record the work log as the process to be recorded. The process that does not automatically record the work log refers to the work that is not recorded in the device used during the work (such as an analyzer, centrifuge, PC, etc.), such as preparing the specimen, diluting the specimen, and dispensing the sample into the vial. On the other hand, the process that automatically records the work log refers to the work that is recorded in the device used during the work, such as creating a method file in the PC, preparing the device to be used, and taking out the sample from the device used.

[0052] By selecting the process for which the work log is not automatically recorded as the process to be recorded, it is possible to store the work log for the process for which the work log is not automatically recorded without cumbersome work by the workers.

[0053] In addition, by recording only the process of the recording object selected by the administrator, the amount of data of the image captured by the camera unit 14 can be suppressed compared to the case where a series of work processes are all recorded, thereby shortening the time for sending image data to PC 200 and reducing the load on the storage units 23 and 202.

[0054] Furthermore, by recording only the process to be recorded selected by the manager, the burden on the manager and the operator when reviewing the images captured by the imaging unit 14 is reduced compared to a case where all of a series of work processes are recorded.

[0055] In addition, Figure 3 In the example shown, a series of operation steps is composed of 26 steps, but a series of operation steps may be composed of one or more steps, and more preferably, a series of operation steps may be composed of a plurality of steps.

[0056] In addition, the process to be recorded can be arbitrarily selected by the manager from a series of work processes, and is not limited to Figure 3 The manager can select one or more processes from a series of work processes as the process to be recorded.

[0057] (Display Processing of Smart Glasses 100)

[0058] Reference Figure 1 , Figure 2 as well as Figure 4 The display processing of the smart glasses 100 will be described. Figure 4 1 is a flowchart showing an example of display processing by the smart glasses 100 according to the embodiment. Figure 4 The shown processing is executed by the control unit 21 .

[0059] In step S405, the control unit 21 receives instruction information about each step of a job consisting of N (N is an integer greater than or equal to 1) steps from the PC 200. In step S405, the manager registers the instruction information of each step created using the PC 200 in the smart glasses 100.

[0060] In step S410, the control unit 21 determines whether the input of the start display instruction information is accepted. When the instruction to start the display instruction information is input to the input device 30, the control unit 21 determines that the input of the start display instruction information is accepted. When the input of the start display instruction information is accepted ("Yes" in step S410), the control unit 21 advances the process to step S415.

[0061] In step S415 , the control unit 21 sets the value of the variable n to 1.

[0062] In step S420, the control unit 21 causes the projection unit 12 to project the instruction information of the n-th step onto the display unit 13. As a result, the instruction information of the n-th step is displayed on the display unit 13.

[0063] In step S425, the control unit 21 determines whether an input to end the nth process is received. When an operation to end the nth process is input to the input device 30, the control unit 21 determines that an input to end the nth process is received. When an input to end the nth process is received ("Yes" in step S425), the control unit 21 advances the process to step S430.

[0064] In step S430 , the control unit 21 determines whether the value of the variable n is N or greater.

[0065] When the value of variable n is smaller than N (No in step S430), control unit 21 increments variable n (adds 1 to the value of variable n) (step S435). Then, control unit 21 returns the process to step S420.

[0066] On the other hand, when the value of the variable n is greater than or equal to N (YES in step S430 ), the control unit 21 causes the projection unit 12 to end the projection of the instruction information (step S440 ). Thus, the display of the instruction information on the display unit 13 ends.

[0067] After step S440, the control unit 21 ends Figure 4 A series of processing is shown.

[0068] pass Figure 4 The series of processes shown are displayed on the display unit 13 in synchronization with the work steps of the workers in order from the first step by the instruction information created by the manager.

[0069] (Video Processing of Smart Glasses 100)

[0070] Reference Figure 1 , Figure 2 as well as Figure 5 The video recording process of the smart glasses 100 will be described. Figure 5 1 is a flowchart showing an example of a video recording process performed by the smart glasses 100 according to the embodiment. Figure 5 The shown processing is executed by the control unit 21 .

[0071] In step S505, the control unit 21 receives process information about a job consisting of N (N is an integer greater than or equal to 1) processes from the PC 200. In step S505, the manager registers the process information created using the PC 200 in the smart glasses 100.

[0072] In step S510 , the control unit 21 sets the value of the variable n to 1.

[0073] In step S515, the control unit 21 determines whether an input to start the nth process is received. When an operation to start the nth process is input to the input device 30, the control unit 21 determines that an input to start the nth process is received. When an input to start the nth process is received ("Yes" in step S515), the control unit 21 advances the process to step S520.

[0074] In step S520 , the control unit 21 determines whether the n-th step is a photographing start step based on the step information registered in step S505 .

[0075] If the nth step is a photographing start step ("Yes" in step S520), the control unit 21 causes the camera unit 14 to start photographing (step S525). Thus, the scene of the destination of the sight line of the worker wearing the main body 10 and performing the work is photographed, and thus the work situation of the worker is photographed. After that, the control unit 21 causes the processing to proceed to step S530.

[0076] On the other hand, when the n-th step is not the imaging start step (NO in step S520 ), the control unit 21 advances the processing to step S530 .

[0077] In step S530, the control unit 21 determines whether an input to end the nth process is received. When an operation to end the nth process is input to the input device 30, the control unit 21 determines that an input to end the nth process is received. When an input to end the nth process is received ("Yes" in step S530), the control unit 21 advances the process to step S535.

[0078] In step S535 , the control unit 21 determines whether the n-th step is a photographing end step based on the step information registered in step S505 .

[0079] When the n-th step is a photographing end step (YES in step S535), the control unit 21 causes the imaging unit 14 to end photographing (step S540). Thereafter, the control unit 21 advances the processing to step S545.

[0080] On the other hand, when the n-th step is not the imaging end step (NO in step S535 ), the control unit 21 advances the processing to step S545 .

[0081] In step S545 , the control unit 21 determines whether the value of the variable n is N or greater.

[0082] When the value of the variable n is smaller than N (No in step S545), the control unit 21 increments the variable n by 1 (adds 1 to the value of the variable n) (step S550). Thereafter, the control unit 21 returns the process to step S515.

[0083] On the other hand, when the value of variable n is greater than or equal to N (YES in step S545), control unit 21 transmits the image data captured by imaging unit 14 to PC 200 (step S555). Thus, image data including the worker's work is transmitted to PC 200.

[0084] After step S555, the control unit 21 ends Figure 5 A series of processing is shown.

[0085] pass Figure 5 In the series of processing shown, only the steps designated by the manager among a series of work steps are photographed, and the data of the photographed images are transmitted to the PC 200 .

[0086] (Video Recording Process of Video Recording System 500)

[0087] Reference Figure 1 , Figure 2 , Figure 3 as well as Figure 6 The recording process of the recording system 500 will be described. Figure 6 1 is a sequence diagram showing an example of a recording flow of the recording system 500 according to the embodiment. Figure 6 Shows the implementation of the operator Figure 3 The recording flow of the recording system 500 in the case of the series of operations shown.

[0088] In step S605 , the manager inputs instruction information of each process and process information that can identify the process to be imaged into the PC 200 .

[0089] In step S610, the PC 200 converts the input information into data (registration data) that can be registered in the smart glasses 100. The registration data is, for example, a csv (Comma-Separated Values) file or the like.

[0090] In step S615 , the PC 200 transmits registration data to the smart glasses 100 .

[0091] In step S620 , the smart glasses 100 receive the registration data and register the instruction information and process information of each process included in the registration data. As a result, the instruction information and process information of each process are stored in the storage unit 23 .

[0092] In step S625 , the operator inputs an instruction to start displaying instruction information.

[0093] When an instruction to start displaying instruction information is input, the smart glasses 100 display the instruction information of the first step on the display unit 13 in step S630 .

[0094] In step S635, when starting the work of the first process, the operator inputs the work of starting the first process. In this example, the processes to be photographed are the first to ninth processes, the twelfth to thirteenth processes, and the twenty-fourth to twenty-fifth processes, and the first process is the first process to be photographed.

[0095] When the input of starting the first step is received, the smart glasses 100 starts shooting in step S640, and continues shooting until the input of ending the first shooting end step (in this example, the ninth step) is received (step S670). Thus, the working conditions of the workers in the first to ninth steps are captured.

[0096] When the work of the first step is completed, in step S645, the operator inputs the completion of the work of the first step.

[0097] When the instruction to end the work of the first step is input, the smart glasses 100 display instruction information of the second step on the display unit 13 in step S650 .

[0098] In step S655, when starting the work of the second step, the operator inputs the start of the work of the second step.

[0099] When the work of the second step is completed, in step S660, the operator inputs the completion of the work of the second step.

[0100] When the operation to end the second step is input, in step S665, the smart glasses 100 displays the instruction information of the third step on the display unit 13. The smart glasses 100 displays the instruction information of the n+1th step on the display unit 13 when the operation to end the nth step (n is an integer greater than 1) is input, until the operation to end the last step (in this example, the 26th step) is input (step S680).

[0101] When the work of the 9th step is completed, in step S670, the operator inputs the completion of the work of the 9th step. In this example, the 9th step is the first step to complete the shooting.

[0102] When the operation of ending the 9th step is input, the smart glasses 100 ends the shooting in step S675. When the operation of starting the second shooting start step (the 12th step in this example) is input, the smart glasses 100 starts shooting again. Thereafter, the smart glasses 100 continue shooting until the operation of ending the second shooting end step (the 13th step in this example) is input, and when the operation of ending the second shooting end step is input, the shooting ends.

[0103] The smart glasses 100 repeat the following actions until the input is received to end the last shooting end step (the 25th step in this example): shooting starts when the input is received to start the mth (m is an integer greater than 1) shooting start step, and shooting ends when the input is received to end the mth shooting end step.

[0104] When the work of the 26th process is completed, in step S680, the operator inputs the completion of the work of the 26th process. In this example, the 26th process is the last process of a series of work processes.

[0105] When the work of finishing the last process is input, in step S685, the smart glasses 100 transmit the data of the image captured by the imaging unit 14 to the PC 200. Thus, the image data including the work status of the worker is transmitted to the PC 200.

[0106] In step S690 , the PC 200 stores the image data received from the smart glasses 100 in the storage unit 202 .

[0107] In step S695, the PC 200 outputs the image data received from the smart glasses 100 to the output device 204 according to the instruction of the administrator. Thus, the administrator or the operator can view the image captured by the imaging unit 14.

[0108] Furthermore, the PC 200 may write the image data received from the smart glasses 100 to a recording medium (e.g., an optical recording medium such as a DVD (Digital Versatile Disc) or a USB (Universal Serial Bus) memory) that can be connected to the PC 200. Furthermore, the PC 200 may output the image data received from the smart glasses 100 from a printer connected to the PC 200.

[0109] In this way, the smart glasses 100 are configured to shoot the process of the object of shooting (recording) determined by the process information. Therefore, if the manager registers in advance the information that can identify the process for which the log is to be kept as the process information, it is possible to prevent the required scene from being missed, so that the log of the desired operation can be kept without increasing the burden on the operator. In addition, if the manager registers the process information in advance, the operator does not need to determine whether it is a process to be recorded and perform the operation for recording (the operation of instructing the camera unit 14 to shoot) during the operation, so the operator can focus on the operation.

[0110] Furthermore, the process to be recorded can be arbitrarily selected by the manager, but by selecting the process for which the work log is not automatically recorded as the process to be recorded, the work log can be saved for the process for which the work log is not automatically recorded without cumbersome for the workers.

[0111] In addition, since only the process of the recording object selected by the administrator is recorded, the amount of data of the image captured by the camera unit 14 can be suppressed compared to the case where a series of operation processes are all recorded. Therefore, the time for sending image data to PC200 is shortened and the load on the storage units 23 and 202 is reduced.

[0112] Furthermore, since only the process to be recorded selected by the manager is recorded, the burden on the manager and the operator when reviewing the images captured by the camera unit 14 is reduced compared to a case where all a series of work processes are recorded.

[0113] The PC 200 may be a general-purpose PC. Therefore, the recording system 500 can be easily constructed by connecting a PC owned by a user who has purchased the smart glasses 100 to the smart glasses 100 .

[0114] In addition, the smart glasses 100 are configured so that the instruction information created by the manager is sequentially displayed on the display unit 13 from the first step in synchronization with the work steps of the operator. Therefore, meaningful information can be provided to the operator.

[0115] [Modifications]

[0116] The present invention is not limited to the above-described embodiment, and various modifications and applications are possible. Next, modifications applicable to the present invention will be described.

[0117] (Variant 1)

[0118] In the above-described embodiment, only the process to be recorded selected by the manager is recorded, but the worker may be able to record any work situation in the middle of the work.

[0119] As an example, the smart glasses 100 may be configured such that the operator can instruct the camera unit 14 to start and end shooting by operating the input device 30. Specifically, when an instruction to start shooting of the camera unit 14 is input to the input device 30, the control unit 21 causes the camera unit 14 to start shooting, and when an instruction to end shooting of the camera unit 14 is input to the input device 30, the control unit 21 causes the camera unit 14 to end shooting.

[0120] This allows the worker who is working while wearing the main body 10 to record the work as desired. After a series of work steps are completed, the image data captured by the camera 14 is sent to the PC 200 together with the image data of the process to be recorded selected by the manager.

[0121] (Variant 2)

[0122] In the above-described embodiment, the process information is registered in the smart glasses 100 before a series of operations are started and is not changed during the series of operations. However, the process information may be changed during the series of operations.

[0123] As an example, the process information registered in the smart glasses 100 can be rewritten during the period from the start of a series of operations to the end of a series of operations. Specifically, the administrator uses the PC 200 to edit the registration data (see Figure 6 ), the PC 200 sends the edited registration data to the smart glasses 100. When the smart glasses 100 (control unit 21) receive the edited registration data, they control the imaging unit 14 based on the process information included in the received registration data.

[0124] This makes it possible to change the process to be recorded in the middle of a series of operations.

[0125] (Variant 3)

[0126] In the above embodiment, when the process of the object of recording is continuous in a series of operation processes, the camera unit 14 is made to continuously record during the period from the start to the end of the continuous process of the object of recording, but the continuous process of the object of recording may be recorded by process. As an example, during the continuous process of the object of recording, the control unit 21 causes the camera unit 14 to start recording when the operation start for each process is input to the input device 30, and causes the camera unit 14 to stop recording when the operation end for each process is input to the input device 30.

[0127] Thereby, the continuous process of recording object can be recorded step by step.

[0128] (Variant 4)

[0129] In the above-mentioned embodiment, when the user inputs the operation of starting each process, it is determined whether the process is a shooting start process, and when the process is a shooting start process, the shooting of the camera unit 14 is started. In addition, when the user inputs the operation of ending each process, it is determined whether the process is a shooting end process, and when the process is a shooting end process, the shooting of the camera unit 14 is ended. Alternatively, it may be set as follows: when the camera unit 14 reads a code attached to a procedure manual or the like used in each process, it is determined whether the process associated with the code is a shooting start process, and when the process is a shooting start process, the shooting of the camera unit 14 is started. In addition, it may be set as follows: when the camera unit 14 reads a code attached to a procedure manual or the like used in each process, it is determined whether the process associated with the code is a shooting end process, and when the process is a shooting end process, the shooting of the camera unit 14 is ended.

[0130] That is, the "input" may be to attach a code to a procedure manual used in each process in advance, and to photograph (read) the code using the camera unit 14. For example, the code is printed on a paper procedure manual, and when the user reads the procedure manual, the code is read by the camera unit 14, and if the process associated with the code is a photographing start process, the photographing of the camera unit 14 is started. In addition, when the user reads the procedure manual, the code is read by the camera unit 14, and if the process associated with the code is a photographing end process, the photographing of the camera unit 14 is ended. In such a case, the camera unit 14 can serve as the input device 30. The code is, for example, a barcode, a QR code (registered trademark), or a DataMatrix (registered trademark).

[0131] This eliminates the need for the operator to perform input work at the start and end of work, thereby reducing the burden on the operator and allowing the operator to concentrate on the work.

[0132] (Variant 5)

[0133] In the above embodiment, the wearable device is a glasses-type (including goggles-type) wearable device (smart glasses), but it can also be a helmet-type wearable device. In addition, the wearable device is not limited to a head-worn type such as glasses or helmets, and can also be a wristband type or pendant type wearable device.

[0134] (Variant 6)

[0135] In the above-mentioned embodiment, the information processing device is a desktop type, but it may also be a notebook type. In addition, the information processing device may also be a tablet terminal or a mobile terminal.

[0136] (Variant 7)

[0137] In the above embodiment, the instruction information and process information of each process are registered from the PC 200 to the smart glasses 100, but they may be stored in advance in the storage unit 23. In addition, when the controller 20 has an external drive, the instruction information and process information of each process may be registered from a recording medium (for example, an optical recording medium such as a DVD, a USB memory) to the smart glasses 100. In addition, it may be configured such that the manager or the operator can specify the process of the imaging object from the processes for which the instruction information is stored in the storage unit 23 by operating the input device 30.

[0138] (Variant 8)

[0139] In the above embodiment, the controller 20 is provided in a housing different from the main body 10, but may be provided in the same housing as the main body 10. In addition, in the above embodiment, the input device 30 is provided in a housing different from the main body 10, but may be provided in the same housing as the main body 10.

[0140] [Way]

[0141] It should be understood by those skilled in the art that the above-mentioned exemplary embodiments are specific examples of the following aspects.

[0142] (Item 1) A wearable device according to one embodiment includes: a display unit that displays instruction information for indicating the content of a work process by process; an imaging unit that captures images of a worker's work; and a receiving unit that receives process information that can identify a process to be imaged. When the process corresponding to the instruction information displayed on the display unit is a process to be imaged that is identified by the process information received by the receiving unit, the imaging unit captures images of the worker's work.

[0143] According to the wearable device described in the first item, if the manager registers in advance the information that can identify the process for which the log is desired to be kept as process information, it is possible to prevent the required scene from being missed, and thus the log of the desired operation can be kept without increasing the burden on the operator. In addition, if the manager registers the process information in advance, the operator does not need to determine whether it is a process to be recorded during the operation and perform the operation for recording (operation to instruct the camera unit 14 to shoot), so the operator can concentrate on the operation. In addition, since not all processes are recorded but only the required processes are recorded, it is possible to prevent the video data from becoming a huge amount. In addition, when confirming the log, there is no need to perform the complicated operation of extracting the required scene from the huge amount of video data.

[0144] (Item 2) The wearable device according to Item 1 further includes a communication unit that communicates with an information processing device connected to the wearable device. The receiving unit receives the process information from the information processing device via the communication unit.

[0145] According to the wearable device described in the second item, process information can be acquired from other devices.

[0146] (Item 3) In the wearable device described in Item 2, the receiving unit receives instruction information of each process from the information processing device via the communication unit.

[0147] According to the wearable device described in the third item, it is possible to obtain instruction information of each process from other devices.

[0148] (Item 4) The communication unit of the wearable device according to Item 2 or Item 3 transmits data of an image captured by the imaging unit to the information processing device.

[0149] According to the wearable device described in the fourth item, the working situation of the worker captured by the camera unit can be viewed.

[0150] (Item 5) In the wearable device described in any one of Items 1 to 4, the process information includes first information that can determine the process for causing the camera unit to start photographing and second information that can determine the process for causing the camera unit to end photographing. The camera unit starts photographing when the process determined by the first information starts, and ends photographing when the process determined by the second information ends.

[0151] According to the wearable device described in the fifth item, since the image is taken based on the process information, it is possible to prevent the necessary scene from being missed. In addition, the operator can concentrate on the work.

[0152] (Item 6) The wearable device described in Item 5 further includes an input unit that receives input of starting and ending operations according to the process. When the input unit receives input of starting an operation of a process determined by the first information, the camera unit starts photographing, and when the input unit receives input of ending an operation of a process determined by the second information, the camera unit ends photographing.

[0153] According to the wearable device described in the sixth item, the shooting is started based on the process information and the input operation performed by the operator at the beginning of the operation of each process, and the shooting is ended based on the process information and the input operation performed by the operator at the end of the operation of each process, so that the required scene can be prevented from being missed. In addition, the operator can concentrate on the operation.

[0154] (Item 7) In the wearable device described in Item 6, the input unit receives an input of a shooting start instruction for the camera unit and a shooting end instruction for the camera unit. When the shooting start instruction is input to the input unit, the camera unit starts shooting, and when the shooting end instruction is input to the input unit, the camera unit ends shooting.

[0155] According to the wearable device described in the seventh item, the operator can arbitrarily record the working situation during the work.

[0156] Although the embodiments of the present invention have been described, it should be understood that the embodiments disclosed this time are illustrative in all aspects and are not restrictive. The scope of the present invention is indicated by the claims, and is intended to include all modifications within the meaning and scope equivalent to the claims.

Claims

1. A wearable device comprising: a storage unit storing instruction information for indicating the content of work for each of a plurality of processes and process information capable of specifying a process to be imaged among the plurality of processes; A display unit, which displays the instruction information according to the process; The camera department, which films the workers' work; and a control unit that receives an input of a start of work and an input of a stop of work for a process corresponding to the instruction information displayed on the display unit, in, The process information indicates a photographing start process for causing the photographing unit to start photographing among the plurality of processes and a photographing end process for causing the photographing unit to end photographing among the plurality of processes, When the control unit receives the input of starting the operation, in response to the process corresponding to the instruction information displayed on the display unit being the photographing start process, the control unit causes the photographing unit to start photographing. When receiving the input of the completion of the work, the control unit causes the imaging unit to terminate imaging in response to the step corresponding to the instruction information displayed on the display unit being the imaging termination step.

2. The wearable device according to claim 1, characterized in that: further comprising a communication unit for communicating with an information processing device connected to the wearable device, The control unit receives the process information from the information processing device via the communication unit.

3. The wearable device according to claim 2, characterized in that: The control unit receives the instruction information of each process from the information processing device via the communication unit.

4. The wearable device according to any one of claims 1 to 3, characterized in that: The control unit further receives an instruction to start photographing from the imaging unit and an instruction to end photographing from the imaging unit. The control unit causes the imaging unit to start imaging when the start instruction is input, and causes the imaging unit to end imaging when the end instruction is input.

5. The wearable device according to claim 2 or 3, characterized in that: The communication unit transmits data of an image captured by the imaging unit to the information processing device.

6. The wearable device according to claim 5, characterized in that: The control unit further receives an instruction to start photographing from the imaging unit and an instruction to end photographing from the imaging unit. The control unit causes the imaging unit to start imaging when the start instruction is input, and causes the imaging unit to end imaging when the end instruction is input.

Citation Information

Patent Citations

  • Wearable terminal, system, and display method

    JP2020047298A

  • Operation monitoring system

    JP2008003781A

  • Work support system, work support method, and program

    JP2020149142A