Recording system, server device, worker device, and recording method
The recording system efficiently records worker tasks and item information in parallel, addressing the limitations of existing systems by associating identifiers with time stamps, ensuring seamless workflow and quality control in research and analysis.
Patent Information
- Application Number
- JP2021194363
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-11-30
- Publication Date
- 2025-09-09
- Estimated Expiration
- 2041-11-30
AI Technical Summary
Existing systems fail to efficiently record multiple tasks using many items in research and analysis settings, which are often performed in parallel and require speed and accuracy, impacting the quality of results.
A recording system, server device, and worker device that utilize a photographing unit to capture work, extract identifiers from video data, and associate item information and time stamps to create log-attached and work video data, enabling efficient recording without burdening the worker.
Enables the recording of worker tasks alongside item information, facilitating quality control and history management, allowing for effective continuation of research and analysis without interrupting the workflow.
Smart Images

Figure 0007735826000001 
Figure 0007735826000002 
Figure 0007735826000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a recording system, a server device, a worker device, and a recording method. [Background technology]
[0002] In research institutes such as universities and companies, as well as medical institutions such as hospitals and health centers, various items such as samples, reagents, and equipment are used for research, analysis, etc. Managing the usage history, inventory information, and work information of these items is important for ensuring that the items are used and stored correctly, that there are no problems with the work, and for ensuring the quality of data obtained from research, analysis, etc. Meanwhile, with the development of science and technology, the number of items used in research, analysis, etc. is steadily increasing.
[0003] Japanese Patent Laid-Open Publication No. 2002-082120 (Patent Document 1) discloses a system that assigns two-dimensional codes to sample containers and reads these two-dimensional codes to appropriately manage sample information. Japanese Patent Laid-Open Publication No. 2020-052602 (Patent Document 2) discloses a system that records the usage history of equipment and can search for experiments related to specific materials. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-082120 [Patent Document 2] Japanese Patent Publication No. 2020-052602 Summary of the Invention [Problem to be solved by the invention]
[0005] In the fields of research and analysis, a variety of tasks using many items are performed through trial and error. Because these diverse tasks may contribute to the quality of the results, it is desirable to record all tasks. Meanwhile, depending on the nature of the research or analysis, speed is often required, and workers must perform multiple tasks in parallel. However, the systems disclosed in Patent Documents 1 and 2 were unable to properly record multiple tasks using many items while they were being performed.
[0006] The present disclosure has been made to solve such problems, and its purpose is to provide a recording system, a server device, a worker device, and a recording method that can record worker work along with information on many items, thereby enabling future work to be carried out effectively. [Means for solving the problem]
[0007] The present disclosure relates to a recording system for recording work using items with identifiers attached, and the recording system includes a photographing unit that photographs the work, a storage unit that records image data photographed by the photographing unit as video data, an extracting unit that extracts an identifier from the video data stored in the storage unit, an identifying unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes a process of adding, to the video data, the item information identified by the identifying unit and time information indicating the time the identifier was read in association with each other.
[0008] The server device according to the present disclosure is a server device that acquires video data of work using an item with an identifier. The server device includes a receiving unit that receives the identifier, time information indicating the time when the identifier was read, and video data, an identifying unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes a process of adding the item information identified by the identifying unit and the time information to the video data in association with each other.
[0009] The worker device according to the present disclosure relates to a worker device that records work using items with identifiers. The worker device includes a photographing unit that photographs the work, an extracting unit that extracts identifiers from video data photographed by the photographing unit, an identifying unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes a process of adding, to the video data, the item information identified by the identifying unit and time information indicating the time the identifier was read in association with each other.
[0010] The recording method according to the present disclosure relates to a recording method for recording work using an item with an identifier attached thereto, and includes the steps of: filming the work, extracting the identifier from the filmed video data, specifying item information that can identify the item based on the identifier, and adding the item information and time information indicating the time the identifier was read to the video data in association with each other.
[0011] The recording system, server device, worker device, and recording method disclosed herein make it possible to record the work of a worker together with information on many items without placing a burden on the worker. [Brief explanation of the drawings]
[0012] [Figure 1] 1 is a diagram showing the overall configuration of a recording system according to a first embodiment. [Figure 2] FIG. 2 is a diagram for explaining the flow of the recording system according to the first embodiment. [Figure 3] 4 is a diagram for explaining the process of creating log-attached video data in the recording system according to the first embodiment. FIG. [Figure 4] 4 is a diagram for explaining a process for creating work video data in the recording system according to the first embodiment. FIG. [Figure 5] 10 is a flowchart illustrating a worker device setting process. [Figure 6] 10 is a flowchart showing a server device setting process. [Figure 7] FIG. 10 is a diagram showing the overall configuration of a recording system according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0013] The present embodiment will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals, and their description will not be repeated in principle. <First Embodiment> A recording system 1000 according to the first embodiment will be described with reference to Figs. 1 to 4. Fig. 1 is a diagram showing the overall configuration of the recording system 1000 according to the first embodiment. Fig. 2 is a diagram for explaining the flow of the recording system according to the first embodiment. Fig. 3 is a diagram for explaining the process of creating log-attached video data in the recording system according to the first embodiment. Fig. 4 is a diagram for explaining the process of creating work video data in the recording system according to the first embodiment.
[0014] 1, recording system 1000 includes an operator device 1 and a server device 2. In recording system 1000, operator device 1 and server device 2 are connected via a network 4. Recording system 1000 is a system used, for example, in research institutions such as universities and companies, or in medical institutions such as hospitals and health centers.
[0015] The worker device 1 includes a small terminal device 10, a camera 31, a speaker 32, and a display 33. The small terminal device 10 is configured according to a general-purpose computer architecture. The small terminal device 10 may be a desktop computer, a laptop computer, a tablet computer, a mobile terminal such as a smartphone, or the like.
[0016] The small terminal device 10 includes a processor 11, a main memory 12, a communication interface 13, an input / output interface 14, and a storage 15. These components are connected via a bus. A camera 31, a speaker 32, and a display 33 are connected to the input / output interface 14.
[0017] The processor 11 is a computing entity (computer) that executes various processes according to various programs. The processor 11 is configured with at least one of a CPU (Central Processing Unit), an FPGA (Field Programmable Gate Array), a GPU (Graphics Processing Unit), and an MPU (Multi-Processing Unit), for example. The processor 11 may also be configured with a processing circuitry. The processor 11 reads out programs stored in the storage 15, expands them into the main memory 12, and executes them.
[0018] The main memory 12 is composed of, for example, a volatile storage device such as a random access memory (RAM), a dynamic RAM (DRAM), or a static random access memory (SRAM), or a non-volatile device such as a read only memory (ROM).
[0019] The communication interface 13 transmits and receives data (information) to and from other devices via a wired or wireless connection. In this embodiment, the communication interface 13 transmits and receives data (information) to and from the communication interface 23 of the server device 2 via wireless communication via a network 4 using a wireless LAN (Local Area Network).
[0020] The input / output interface 14 accepts input signals from the user via input devices such as a mouse, keyboard, button, and / or touch panel, identifier information such as a two-dimensional code input from the camera 31, and video data, and outputs output signals from the processor 11 to the speaker 32 and display 33.
[0021] The camera 31 functions as a photographing unit that photographs a series of tasks performed by a worker in research, analysis, etc. as multiple image data. A worker is someone who manually performs research, analysis, etc. using many items. The camera 31 is, for example, a wearable camera, such as a glasses-type camera that can be worn on the worker's head. The camera 31 transmits a collection of multiple image data to the input / output interface 14 as video data. The video data obtained by the camera 31 is transmitted to the server device 2 via the network 4.
[0022] The speaker 32 notifies the user by sound that the identifier has been read. The display 33 is a display device such as a liquid crystal display, a plasma display, or an organic EL (Electro Luminescence) display. The display 33 displays video data and the like on the screen under the control of the processor 11.
[0023] The storage 15 is configured by a nonvolatile storage device such as a hard disk drive (HDD) or a solid state drive (SSD), etc. The storage 15 stores time information 151 when the identifier is read, identifier information 152 such as a two-dimensional code, video data 153 of a worker's work, etc.
[0024] The server device 2 is configured according to a general-purpose computer architecture. In this embodiment, the server device 2 is a server device owned by a research institute such as a university or a company, or a medical institution such as a hospital or a health center. The server device 2 is preferably installed in a building of the research institute or a building of the medical institution in order to satisfy the user's unique security requirements. However, the server device 2 may also exist on a cloud via a network.
[0025] The server device 2 includes a processor 21, a main memory 22, a communication interface 23, an input / output interface 24, and a storage 25. These components are connected via a bus.
[0026] The processor 21 is a computing entity (computer) that executes various processes according to various programs. The processor 21 is configured with at least one of a CPU, an FPGA, a GPU, and an MPU, for example. The processor 21 may also be configured with an arithmetic circuit. The processor 21 reads out programs stored in the storage 25, expands them into the main memory 22, and executes them.
[0027] The main memory 22 is configured by, for example, a volatile storage device such as RAM, DRAM, or SRAM, or a non-volatile device such as ROM. The communication interface 23 transmits and receives data (information) to and from other devices via a wired or wireless connection. In this embodiment, the communication interface 23 transmits and receives data (information) to and from the communication interface 13 of the worker device 1 via wireless communication via the network 4 using a wireless LAN. The input / output interface 24 receives input signals from a user via a button, touch panel, or the like, and outputs output signals from the processor 21 to various devices (not shown).
[0028] The storage 25 is configured, for example, with a nonvolatile storage device such as an HDD or SSD. The storage 25 stores sample information 251, reagent information 252, device information 253, time information 254, identifier information 255, video data 256, work information 257, log-attached video data 258, and work video data 259. The sample information 251 is information about a sample used as a material or specimen for research or analysis. The reagent information 252 is information about a reagent manufactured for the purpose of causing a reaction in an experiment. The device information 253 is information about a device used for research or analysis. The time information 254 is information indicating the time at which an identifier transmitted from the worker device 1 was read. The identifier information 255 is information about an identifier such as a two-dimensional code attached to an item. The video data 256 is data obtained by filming the work of a worker. The work information 257 is information obtained by classifying the video data 256 by the work of the worker. Log-attached video data 258 is data in which time information and product information of the item corresponding to the identifier are added to work video data 259 and video data 256. Work video data 259 is data in which work tags are added to the video data using work information 257.
[0029] Next, the flow of the recording system will be described with reference to Fig. 2. As shown in Fig. 2, a two-dimensional code 61 corresponding to the sample 51 is attached to the surface of a petri dish containing a sample 51 used for culturing. A two-dimensional code 62 corresponding to the reagent 52 is attached to the surface of a test tube containing a reagent 52 used for culturing. The two-dimensional codes 61 and 62 are printed on a sealant and then attached to each item. The two-dimensional codes 61 and 62 may also be printed directly on each item. Two-dimensional codes are also attached to devices such as analytical equipment (not shown).
[0030] The worker first activates the small terminal device 10 and the camera 31. The small terminal device 10 may be activated by turning on the switch of the camera 31. After the camera 31 is activated, shooting starts automatically. The worker may start shooting by operating the camera 31 or the small terminal device 10. The worker's work captured by the camera 31 is stored as video data 153 in the storage 15 of the worker device 1. The stored video data 153 is formed from a plurality of image data. For example, 30 frames of image data are stored in the storage 15 as one second of video data 153.
[0031] The video data 153 is transmitted from the worker device 1 to the server device 2 at regular intervals. The small terminal device 10 reads the two-dimensional codes 61, 62 when image data relating to the two-dimensional codes 61, 62 has been continuously stored in the video data 153 for more than a predetermined period of time. The predetermined period is, for example, one second. The two-dimensional codes 61, 62 are read when the worker stares at the two-dimensional codes 61, 62 for one second or more. The two-dimensional codes 61, 62 may be read based on video data captured by the fixed camera 310. The two-dimensional codes 61, 62 are converted into identifier information 152 and stored in the storage 15. The storage 15 also stores time information 151 indicating when the two-dimensional codes 61, 62 were read. The two-dimensional codes 61, 62 may be recognized in real time.
[0032] Time information 151 and identifier information 152 are transmitted from the operator apparatus 1 to the server apparatus 2. The server apparatus 2 stores time information 254 and identifier information 255 corresponding to the time information 151 and identifier information 152 transmitted from the operator apparatus 1. The server apparatus 2 executes a process of associating a log formed by the time information 254 and the identifier information 255 with an ID list formed by the sample information 251, the reagent information 252, and the apparatus information 253, and adding the log to the video data 256.
[0033] Specifically, each of the item information specifying an item, that is, sample information 251, reagent information 252, and device information 253, is assigned an ID corresponding to identifier information 255. The server device 2 collates the identifier information 255 with the ID list to specify which item was used in the work.
[0034] The server device 2 stores the video data 153 transmitted from the worker device 1 in the storage 25 as video data 256. The server device 2 creates log-attached video data 258 in which item information is identified from the video data 256. The server device 2 creates work video data 259, based on the log-attached video data 258, to which work tags classifying each work are added.
[0035] The process of creating log-attached video data 258 will be specifically described with reference to Fig. 3. As shown in Fig. 3, video data 153 captured using camera 31 or fixed camera 310 is transmitted to server device 2. Video data 153 is stored as video data 256 in storage 25 of server device 2. Server device 2 stores time information 151 and identifier information 152 transmitted from worker device 1 in storage 25 as time information 254 and identifier information 255 indicating a log.
[0036] Identifier information 255 is identified as any one of item information from sample information 251, reagent information 252, and device information 253 in the ID list stored in storage 25. The identified item information and time information 254 are associated and added to video data 256. Display 33 displays log-attached video data 258 created in this manner. As shown in FIG. 3, the screen of display 33 displays the captured video as well as the item information corresponding to the identifiers read at each time.
[0037] The process of creating work video data 259 will be specifically described with reference to Fig. 4. As shown in Fig. 4, the worker displays log-attached video data 258 saved for the day the work was performed, based on calendar image 331 displayed on display 33. Specifically, when the worker aligns the mouse pointer with a date on calendar image 331 and clicks, log-attached video data 258 corresponding to that date is read out.
[0038] While playing back the log-attached video data 258, the worker inputs task information into the log-attached video data 258 and adds task tags. For example, a progress bar 71 that changes from left to right in accordance with the time axis of one piece of log-attached video data 258 is displayed. A triangular image that allows the worker to determine the start time and end time of a task is displayed on the progress bar 71. The worker determines the start time and end time of a task by moving the triangular image with a mouse or the like. This creates a video bar 72 in which the start time and end time of a task have been determined from the log-attached video data 258.
[0039] The worker further inputs work information 257 such as the experiment name and work content. As a result, the start time, end time, and work content are added as work information 257 to video data showing one work in log-attached video data 258. The worker repeats this process, classifying log-attached video data 258 by work and inputting work information to create work video data 259 with work tags.
[0040] The work video data 259 created in this way can be displayed on the display 33. As shown in Fig. 4, work information 257, in which a number is assigned to each work, is displayed on the screen of the display 33. The worker can select any of the numbered works with a mouse or the like to display a video bar 72 and work video data 259 for the period corresponding to the video bar 72.
[0041] Next, the processing executed in the worker device 1 will be described. FIG. 5 is a flowchart showing the worker device setting processing set in the worker device 1. The worker device setting processing is executed by the processor 11 of the worker device 1 executing a program. The processor 11 functions as a processing unit that executes each process. The processor 11 calls the worker device setting processing, which is a subroutine, from the main routine at regular intervals. Below, each step in the flowchart will be simply represented as "S".
[0042] In the worker device setting process, the processor 11 determines whether or not a power-off signal has been received from the camera 31 (S101). If the processor 11 has not received a power-off signal from the camera 31 (NO in S101), the processor 11 proceeds to processing in S102. If the processor 11 has received a power-off signal from the camera 31 in S101 (YES in S101), the processor 11 notifies the server device 2 of work stoppage (S111) and proceeds to processing in S112. In S112, the processor 11 determines whether or not there is unsent video data 153 in the storage 15. If there is video data 153 (YES in S112), the processor 11 transmits the video data 153 to the server device 2 (S110). If there is no video data 153 (NO in S112), the processor 11 returns the process to the main routine.
[0043] In S102, the processor 11 determines whether or not the camera 31 is currently capturing an image. Whether or not the camera 31 is currently capturing an image can be determined by whether or not image data (video data 153) is being received. If the processor 11 determines that the camera 31 is currently capturing an image (YES in S102), the processor 11 proceeds to processing in S106. If the processor 11 determines that the camera 31 is not currently capturing an image (NO in S102), the processor 11 determines whether or not a power-on signal from the camera 31 has been received (S103). If the processor 11 has not received a power-on signal from the camera 31 in S103 (NO in S103), the processor 11 returns processing to the main routine.
[0044] If the processor 11 receives a power-on signal from the camera 31 in S103 (YES in S103), it notifies the server device 2 of the start of work (S104). Next, the processor 11 records the image data captured by the camera 31 as video data 153 in the storage 15 (S105). Next, the processor 11 determines whether or not multiple image data including the identifier are consecutive for one second or more (S106).
[0045] Specifically, processor 11 determines whether multiple pieces of image data recognized as image data containing identifiers such as two-dimensional codes 61 and 62 have been extracted continuously for one second or more from video data 153 being recorded. If multiple pieces of image data containing identifiers have been extracted continuously for one second or more, processor 11 executes a process to read identification data indicated by the identifiers. On the other hand, even if multiple pieces of image data recognized as image data containing identifiers have been extracted continuously for less than one second, processor 11 does not read identification data indicated by the identifiers. In this way, identifiers will not be read in for a time shorter than one second, and reading unnecessary identifiers can be avoided.
[0046] If the processor 11 determines that the plurality of image data including the identifier are not consecutive for one second or more (NO in S106), the process proceeds to S109. If the processor 11 determines that the plurality of image data including the identifier are consecutive for one second or more (YES in S106), the processor 11 transmits time information 151 indicating the time when the identifier was read and identifier information 152 to the server device 2 (S107). Next, the processor 11 transmits a signal to the speaker 32 to notify that the identifier has been read successfully with a sound (S108). This allows the worker to reliably recognize that the identifier has been read successfully by the sound.
[0047] Note that the successful reading of the identifier may be communicated to the worker by means other than sound. For example, the successful reading of the identifier may be communicated by the light emitting means attached to the camera 31 emitting light, by an image being displayed on a screen displayed within the field of view of the eyeglass-type wearable camera, or by the vibration of a vibration element. The successful reading of the identifier may be communicated by a combination of two or more of sound, light, screen display, and vibration.
[0048] Next, processor 11 determines whether a certain period of time has elapsed since receiving video data 153 (S109). The certain period of time is a period of several minutes to several tens of minutes. For example, processor 11 determines in S109 whether video data 153 has been stored continuously for 10 minutes. If processor 11 determines in S109 that the certain period of time has not elapsed (NO in S109), the process returns to the main routine.
[0049] If it is determined in S109 that the certain period has elapsed (YES in S109), processor 11 transmits video data 153 to server device 2 (S110) and returns the process to the main routine. By the processes of S109 and S110, video data 153 is recorded for a certain period and then transmitted to server device 2, which reduces the processing load on the worker device 1 compared to transmitting video data 153 to server device 2 at any time. Note that if worker device 1 is capable of high-speed processing, it may be configured to transmit video data 153 to server device 2 at any time. Video data 153 may be recorded by filming the entire worker's work from start to finish.
[0050] Next, a description will be given of the processing executed in the server device 2. Fig. 6 is a flowchart showing the server device setting processing set in the server device 2. The server device setting processing is executed by the processor 21 of the server device 2 executing a program. The processor 21 functions as a processing unit that executes each process. The processor 21 calls the server device setting processing, which is a subroutine, from the main routine at regular intervals.
[0051] In the server device setting process, the processor 21 determines whether or not it has received a work stop signal transmitted by turning off the camera 31 from the worker device 1, thereby confirming whether or not the camera 31 has been turned off and the worker has stopped work (S201). When the processor 21 confirms that work has stopped in S201 (YES in S201), it registers the work end time (S209) and returns the process to the main routine.
[0052] If processor 21 does not confirm that work has stopped in S201 (NO in S201), it determines whether it has received a work start signal transmitted by turning on camera 31 from worker device 1, thereby confirming whether camera 31 has turned on and the worker has started work (S202).If processor 21 confirms that work has started in S202 (YES in S202), it registers the work start time (S210) and returns the process to the main routine.
[0053] If the processor 21 does not confirm the start of work in S202 (NO in S202), it determines whether or not it has received the time information 151 and the identifier information 152 transmitted from the worker apparatus 1 (S203). If the processor 21 has not received the time information 151 and the identifier information 152 in S203 (NO in S203), it proceeds to the process of S205. If the processor 21 has received the time information 151 and the identifier information 152 in S203 (YES in S203), it identifies the item information by comparing the sample information 251, the reagent information 252, and the apparatus information 253 with the recorded identifier information 255 (S204).
[0054] Next, the processor 21 determines whether or not the video data 153 has been received (S205). If the processor 21 has not received the video data 153 in S205 (NO in S205), the processor 21 proceeds to the processing of S207. If the processor 21 has received the video data 153 in S205 (YES in S205), the processor 21 creates log-attached video data 258 using the recorded video data 256 (S206). The log-attached video data 258 is video data in which time information 254 when the identifier was read and product information corresponding to identifier information 255 are attached to the video data 256 as a log, for the video data 256 stored in the storage 25.
[0055] Next, processor 21 determines whether or not work information 257 has been received (S207). If processor 21 has not received work information 257 in S207 (NO in S207), it returns the process to the main routine. If processor 21 has received work information 257 in S207 (YES in S207), it creates work video data 259 (S208) and returns the process to the main routine. Work video data 259 is video data in which work tags, such as work content categorized by work, are added to log-attached video data 258 stored in storage 25.
[0056] Conventionally, video recording and identifier reading have been performed separately. For example, consider a case where an experiment uses reagents stored in a refrigerator and samples cultured in an incubator. In such a case, if the operator's work and identifier reading are performed separately, the work must be interrupted. Furthermore, if the reagents and samples remain removed from the refrigerator or incubator for a long period of time, performance and the like will deteriorate. According to this embodiment, the operator can read the identifier during the work process, and can obtain identifier information without burdening himself or herself while avoiding deterioration in the performance and the like of the reagents and samples.
[0057] According to this embodiment, it is possible to create log-attached video data 258 and work video data 259. Therefore, by checking the work video data 259 categorized by work, a worker can always confirm what items were used and when, enabling quality control and history management, as well as effectively proceeding with work in future research and analysis. <Embodiment 2> A recording system 2000 according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a diagram showing the overall configuration of the recording system 2000 according to the second embodiment. As shown in Fig. 2, compared to the recording system 1000 according to the first embodiment, the recording system 2000 is configured with only an operator device 1A, and does not include a server device 2 or a network 4.
[0058] As shown in FIG. 7, the worker apparatus 1A is different from the worker apparatus 1 of the first embodiment in that the storage 25 is the same as the storage 25 included in the server apparatus 2 of the first embodiment. In other words, the worker apparatus 1A of the second embodiment is configured to realize the functions of the server apparatus 2 of the first embodiment in a single apparatus. The processor 11 of the worker apparatus 1A also has the functions of the processor 21 included in the server apparatus 2. The other components are the same as those of the first embodiment, and therefore description thereof will be omitted.
[0059] According to recording system 2000 including worker device 1A, it is possible to record the work of a worker together with information on many items using a single device without using network 4, without imposing a burden on the worker. <Modification> In the above-described embodiment, the items include samples, reagents, and devices. The items may also be materials, equipment, specimens, instruments, incubators, or any other items that can be used in the work.
[0060] In the above-described embodiment, the camera for capturing video and the camera for reading two-dimensional codes are the same. However, the camera for capturing video and the camera for reading two-dimensional codes may be provided separately.
[0061] In the above-described embodiment, the identifier is a two-dimensional code. However, the identifier may be a one-dimensional code such as a barcode, an AR marker, or the like.
[0062] In the above-described embodiment, when creating the work video data 259, it may be possible to edit out incorrect work, etc., when editing the log-attached video data.
[0063] In the above-described embodiment, the task information 257 has been described as being provided by the worker. However, the task information 257 may be provided by the worker device 1 or the server device 2. Specifically, the worker device 1 or the server device 2 may determine a change in task from the log-attached video data 258 and classify the tasks. Alternatively, the task information 257 may be provided by the worker via the network 4 from a small terminal device (desktop computer, laptop computer, tablet computer, smartphone, etc.) other than the small terminal device 10 constituting the worker device 1.
[0064] [Aspect] It will be appreciated by those skilled in the art that the exemplary embodiments described above are examples of the following aspects.
[0065] (Item 1) A recording system according to one embodiment relates to a recording system for recording work using an item with an identifier attached. The recording system includes a photographing unit that photographs the work, a storage unit that records image data photographed by the photographing unit as video data, an extracting unit that extracts an identifier from the video data stored in the storage unit, an identifying unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes a process of adding, to the video data, the item information identified by the identifying unit and time information indicating the time the identifier was read, in association with each other.
[0066] According to the recording system described in paragraph 1, the work of the worker can be recorded together with information on many items without placing a burden on the worker.
[0067] (Clause 2) The device further includes a display unit that displays the associated item information and time information.
[0068] According to the recording system described in paragraph 2, the worker can easily check on the display unit when an item was used during work.
[0069] (Clause 3) The processing unit receives data for adding task tags classified for each task, and executes a process for adding the task tags to the video data.
[0070] According to the recording system described in paragraph 3, by adding a task tag to video data, video data can be managed and stored for each task.
[0071] (Clause 4) The extraction unit extracts the identifier when image data indicating the identifier is recorded continuously within the video data for more than a predetermined period of time.
[0072] According to the recording system described in paragraph 4, even if an identifier is photographed unintentionally by a worker during work, the identifier will not be extracted unless it has been continuously recorded for more than a specified period of time, thereby avoiding the extraction of unnecessary identifiers.
[0073] (Section 5) The items include at least one of a sample, a reagent, and an apparatus.
[0074] According to the recording system described in paragraph 5, the work of the worker can be recorded together with information on the samples, reagents, and devices contained in many items without placing a burden on the worker.
[0075] (Item 6) The system further includes a notification unit that notifies the worker that an item identifier has been extracted.
[0076] According to the recording system described in paragraph 6, it is possible to easily notify the worker that the identifier of the item has been extracted.
[0077] (Clause 7) The recording system includes a worker device and a server device. The worker device includes a photographing unit and an extracting unit. The server device includes an identifying unit and a processing unit.
[0078] According to the recording system described in paragraph 7, the worker's work can be recorded together with information on many items without imposing a burden on the worker, using the worker device and the server device.
[0079] (Item 8) A server device according to one aspect acquires video data of work using an item with an identifier. The server device includes a receiving unit that receives the identifier, time information indicating the time when the identifier was read, and video data, an identifying unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes a process of adding the item information identified by the identifying unit and the time information to the video data in association with each other.
[0080] According to the server device described in paragraph 8, it is possible to record the work of the worker together with information on many items without placing a burden on the worker.
[0081] (Item 9) One embodiment of a worker device relates to a worker device that records work using an item with an identifier. The worker device includes a photographing unit that photographs the work, an extracting unit that extracts an identifier from video data photographed by the photographing unit, an identifying unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes a process of adding, to the video data, the item information identified by the identifying unit and time information indicating the time the identifier was read, in association with each other.
[0082] According to the worker device described in paragraph 9, it is possible to record the worker's work together with information on many items without imposing a burden on the worker.
[0083] (Clause 10) A recording method according to one aspect relates to a recording method for recording work using an item with an identifier attached thereto, the recording method includes the steps of: filming the work; extracting the identifier from the filmed video data; specifying item information that can identify the item based on the identifier; and adding the item information and time information indicating the time the identifier was read to the video data in association with each other.
[0084] According to the recording method described in paragraph 10, the work of the worker can be recorded together with information on many items without imposing a burden on the worker.
[0085] The embodiments disclosed herein should be considered to be illustrative in all respects and not restrictive. The scope of the present disclosure is defined by the claims, not by the description of the above embodiments, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]
[0086] 1,1A Operator device, 2 Server device, 4 Network, 10 Small terminal device, 11,21 Processor, 12,22 Main memory, 13,23 Communication interface, 14,24 Input / output interface, 15,25 Storage, 31 Camera, 32 Speaker, 33 Display, 51 Sample, 52 Reagent, 61,62 Two-dimensional code, 71 Progress bar, 72 Video bar, 151,254 Time information, 153,256 Video data, 251 Sample information, 252 Reagent information, 253 Device information, 255 Identifier information, 257 Work information, 258 Video data with log, 259 Work video data, 310 Fixed camera, 331 Calendar image, 1000,2000 Recording system.
Claims
1. A recording system for recording work using items with identifiers in the field of research and analysis, comprising: A photography department that photographs the work, a storage unit that records image data captured by the imaging unit as video data; an extracting unit that extracts an identifier from the video data stored in the storage unit; an identification unit that identifies item information that can identify the item based on the identifier; a processing unit that executes a process of adding, to the video data, the item information identified by the identification unit and time information indicating the time when the identifier was read in association with each other; a display unit that displays the video data on a screen together with the item information and the time information added by the processing unit.
2. The recording system according to claim 1 , wherein the processing unit receives data for adding task tags classified for each task, and executes a process for adding the task tags to the video data.
3. 3. The recording system according to claim 1, wherein the extracting section extracts the identifier when the image data indicating the identifier has been continuously recorded in the video data for more than a predetermined period of time.
4. The recording system according to claim 1 , wherein the item includes at least one of a sample, a reagent, and an apparatus.
5. The recording system according to claim 1 , further comprising a notification unit that notifies an operator that the identifier of the item has been extracted.
6. the recording system includes a worker device and a server device; the worker device includes the photographing unit and the extraction unit, The recording system according to claim 1 , wherein the server device includes the specifying unit and the processing unit.
7. A server device that acquires video data of work using items with identifiers in the field of research and analysis, a receiving unit that receives the identifier, time information indicating the time when the identifier was read, and the video data; an identification unit that identifies item information that can identify the item based on the identifier; a processing unit that executes a process of adding the item information identified by the identification unit and the time information to the video data in association with each other; a storage unit that records the video data that is displayed together with the item information and the time information that are added by the processing unit.
8. A worker device for recording work using an item with an identifier in the field of research or analysis, comprising: A photography department that photographs the work, an extraction unit that extracts an identifier from video data captured by the imaging unit; an identification unit that identifies item information that can identify the item based on the identifier; a processing unit that executes a process of adding, to the video data, the item information identified by the identification unit and time information indicating the time when the identifier was read in association with each other; a display unit that displays the video data on a screen together with the item information and the time information added by the processing unit.
9. A recording method for recording work using an item with an identifier in the field of research or analysis, comprising: Photographing the work; extracting an identifier from the captured video data; Identifying product information that can identify the product based on the identifier; adding the item information and time information indicating the time when the identifier was read to the video data in association with each other; and recording the video data displayed together with the item information and the time information.
Citation Information
Patent Citations
Automatic information-readable container for living organism / biological and automatic information reading system
JP2002082120A
Device, method and program for identifying task being performed
JP2011233046A
Image management system, image management method, and image management program
JP2018116572A
Research and development support system
JP2020052602A
Process information acquisition system, process information acquisition method, and process information acquisition program
JP2020129287A