Timeline system for monitoring culture medium protocols
The system addresses the lack of interactive culture medium protocol data presentation by generating a timeline with real-time updates and image alignment, improving the management and monitoring of culture medium protocols.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- BECTON DICKINSON & CO
- Filing Date
- 2022-02-22
- Publication Date
- 2026-07-02
- Estimated Expiration
- Not applicable · inactive patent
Smart Images
Figure 0007883862000001 
Figure 0007883862000002 
Figure 0007883862000003
Abstract
Description
Technical Field
[0001] This application claims priority to U.S. Provisional Patent Application No. 62 / 420,466, filed on November 10, 2016, the entire disclosure of which is hereby incorporated by reference.
[0002] The present invention relates to media analysis, and more particularly, to software for presenting and reviewing media information.
Background Art
[0003] Methods and systems for capturing an image of a culture medium and displaying it on a display are known. Such systems and methods are described, for example, in International Publication No. 2013 / 147610 to Botma et al., the disclosure of which is hereby incorporated by reference.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Means for Solving the Problems
[0005] Aspects of the present invention include systems, devices, and methods for presenting and manipulating cell culture protocol data elements of a culture medium using a timeline presented on a user interface.
[0006] One embodiment is a system for providing a timeline representing a culture medium protocol for a culture medium. The system includes a computer system. The computer system includes a user interface configured to display a timeline and fields for displaying arbitrary culture medium images, and a processor. The processor is configured to receive a culture medium protocol for a culture medium, generate a timeline on the user interface based on the culture medium protocol, monitor the time on the timeline, receive one or more culture medium images associated with the culture medium protocol, associate each of the one or more culture medium images with a position on the timeline correlated with the time the culture medium image was taken, and generate and display selectable markers for each culture medium image associated with the timeline, arranged at the positions on the timeline correlated with the time the culture medium image was taken.
[0007] Another embodiment is a method for providing a timeline representing a culture medium protocol for a culture medium. This method includes the steps of: receiving a culture medium protocol for a culture medium; generating a timeline on a user interface based on the culture medium protocol; monitoring time on the timeline; receiving one or more culture medium images associated with the culture medium protocol; associating each of the one or more culture medium images with a position on the timeline that correlates with the time the culture medium image was taken; and generating selectable markers for each culture medium image associated with the timeline, arranged at the positions on the timeline that correlate with the time the culture medium image was taken. [Brief explanation of the drawing]
[0008] [Figure 1] This is a schematic diagram of a timeline control system according to an exemplary embodiment of the present invention. [Figure 2] This is a flowchart of an embodiment providing a timeline control system according to an exemplary embodiment of the present invention. [Figure 3] This is a flowchart of an embodiment of the present invention that captures and processes images of a culture medium. [Figure 4] This is a flowchart of an embodiment of the present invention that indicates which culture medium image to display on the timeline. [Figure 5] This is a flowchart of an embodiment of generating a video of a culture medium according to an exemplary embodiment of the present invention. [Figure 6] This figure shows an example of a timeline according to an exemplary embodiment of the present invention. [Figure 7] This figure shows another embodiment of the timeline according to an exemplary embodiment of the present invention. [Figure 8] This figure shows an example of a timeline on a timeline display screen according to an exemplary embodiment of the present invention. [Figure 9] This figure shows an example of a timeline on a timeline display screen according to an exemplary embodiment of the present invention. [Figure 10] This figure shows an example of a timeline on a timeline display screen according to an exemplary embodiment of the present invention. [Figure 11] This figure shows an example of a timeline on a timeline display screen according to an exemplary embodiment of the present invention. [Figure 12] This figure shows an example of a timeline on a timeline display screen according to an exemplary embodiment of the present invention. [Figure 13] This figure shows an example of a timeline on a timeline display screen according to an exemplary embodiment of the present invention. [Modes for carrying out the invention]
[0009] As those skilled in the art will understand, there are many ways to implement the embodiments, improvements, and configurations for timeline control according to the embodiments of the present invention disclosed herein. While the exemplary embodiments shown in the drawings and the following description are referenced, these embodiments are not intended to exhaust the various other designs and embodiments included in the disclosed invention. Those skilled in the art will readily understand that various modifications and combinations can be made without departing from the present invention.
[0010] The embodiments relate to a system and method for presenting and manipulating cell culture protocol data elements for a culture medium using a timeline presented on a user interface. In one embodiment, the system generates a timeline on the user interface based on a culture medium protocol for a specific culture medium. During the execution of the culture medium protocol, the timeline can be continuously or semi-continuously updated to reflect the passage of time throughout the protocol and the occurrence of protocol-related events, such as the acquisition of culture medium images. The system can generate markers on the timeline representing protocol-related events that are expected to occur during the execution of the protocol and / or protocol events that actually occur during the execution of the protocol. The user interface allows the user to select markers and provides further data about those markers in response to the selection.
[0011] In one embodiment, the system acquires multiple culture medium images throughout the culture protocol. Each culture medium image is associated with a position on a timeline representing the time the image was acquired. A marker can be generated for each culture medium image at its position on the timeline representing the time the image was acquired. The user interface allows the user to select one of these markers and display the associated culture medium image in the user interface. In some embodiments, image processing software analyzes each culture medium image related to the culture protocol and aligns the culture medium images so that when a marker associated with each image is selected, the image is presented in the same orientation. This feature allows the user to navigate between culture medium images and monitor growth on the medium.
[0012] Figure 1 is a schematic diagram of an exemplary embodiment of the timeline control system 100. The timeline control system 100 includes a culture reading system 110 and an incubation system 120.
[0013] The incubation system 120 includes an incubator 122 and an imaging device 124. The incubator 122 can be configured to accommodate and culture one or more media containing microorganisms and a culture medium for culturing the growing microorganisms. This medium can be a culture plate such as a Petri dish. The imaging device 124 can be configured to capture and store an image of the medium housed within the incubator 122. In some embodiments, the incubation system 120 is a ReadA compact incubator.
[0014] The incubation system 120 can be configured to communicate with the culture reading system 110 via wired or wireless communication, cellular communication, Bluetooth®, ZigBee®, LAN, WLAN, RF, IR, or any other communication method or system well-known in the art. For example, the incubation system 120 can be configured to transmit an image of the culture plate housed within the incubator 122 to the culture reading system 110.
[0015] The culture reading system 110 includes a processor 102, a memory 104, an input unit 106, a display 108, and a clock or timer 114. The memory 104, which can include both read-only memory (ROM) and random access memory (RAM), can be configured to provide instructions and data to the processor 102. For example, the memory 104 can store one or more modules storing data values that define instructions that configure the processor 102 to perform the functions of the culture reading system 110. As shown in FIG. 1, the memory 104 includes a timeline control module 112 that includes instructions that configure the processor 102 to perform the timeline control functions described herein. The memory 104 can also be configured to store the medium image received from the incubation system 120.
[0016] The display 108 can be configured to display data from the memory 104 and data received from the input unit 106. The input unit 106 can include one or more devices that enable a user to input data into the culture reading system 110. For example, the input unit 106 can include a keyboard, a mouse, and / or a touch screen associated with the display 108. The input unit 106 and the display 108 can operate to form a user interface presented on the display 108. The user interface can include one or more interactive display screens that provide medium data to the user and enable selection and manipulation of the data.
[0017] In an exemplary embodiment of the present invention, the culture reading system 110 can be configured to display an interactive timeline display screen on the display 108. The timeline display screen can facilitate presentation and manipulation of medium protocol data elements related to the medium based on instructions stored in the timeline control module 112. In some embodiments, the timeline display screen can be displayed in response to a timeline start event, such as a command from the user via the input unit 106.
[0018] In some embodiments, the timeline control module 112 is configured to cause the culture reading system 110 to provide a timeline in a timeline display screen representing events of a given culture protocol for the culture medium. This timeline can provide a relative time scale of the culture protocol, where the expected duration of the culture protocol correlates to the length of the timeline, and each point on the timeline represents a specific time within the culture protocol. This timeline can include one or more markers representing events of the culture protocol. In some embodiments, markers are provided to represent events that are expected to occur within the culture protocol but have not yet occurred. Such markers can be arranged at positions on the timeline that correlate to the time within the culture protocol in which the event is expected to occur. This timeline can also be updated to include markers representing events of the culture protocol that have occurred during or after the completion of the culture protocol. Such markers can be arranged at positions on the timeline that correlate to the time within the culture protocol in which the event occurred. Typical events in a culture medium protocol include, for example, the start of the culture medium protocol, the end of the culture medium protocol, acquisition of a culture medium image, removal of the culture medium from the incubator 122 or incubation system 120, placement of the culture medium in the incubator 122 or incubation system 120, and data collection or processing related to the culture medium, such as processing of the culture medium image by a digital image analysis algorithm. In some embodiments, markers can be arranged at positions on the timeline that correlate with intermediate results provided by a data processing algorithm such as a digital image analysis algorithm. In some embodiments, markers can be arranged at positions on the timeline that correlate with the final result provided by a data processing algorithm such as a digital image analysis algorithm.
[0019] The timeline display screen can provide various information related to the timing of culture medium protocol events. For example, the timeline display screen can show the date and / or time of a culture medium protocol event, the expected date and / or time of a culture medium protocol event, the relative time difference between a culture medium protocol event and the current time, a message indicating that a culture medium protocol event was not performed, the date and / or time the culture medium protocol started, the expected date and / or time the culture medium protocol started, the date and / or time the culture medium protocol ended, the expected date and / or time the culture medium protocol ended, the relative time difference between the start of the culture medium protocol and the current time, and the relative time difference between the current time and the expected end time of the culture medium protocol.
[0020] As described herein, a typical culture medium protocol event may include the acquisition of an image of the culture medium on which the culture medium protocol is being executed. The timeline display screen may be configured to display one or more culture medium images acquired as part of the culture medium protocol. Culture medium images may be retrieved from memory 104, received from incubation system 120, and / or received from another external device. In some embodiments, the timeline display screen may also be configured to provide additional information about culture medium images that have been acquired or are expected to be acquired as part of the culture medium protocol. For example, in addition to timing information of culture medium protocol events, the timeline display screen may indicate which culture medium images are currently displayed on the timeline display screen when multiple culture medium images have been acquired, the number of culture medium images currently acquired in the culture medium protocol, and whether no culture medium images have been acquired in the culture medium protocol at this time.
[0021] In some embodiments, the timeline display screen can enable selection and / or operation of data presented on the timeline display screen via an input unit 106 or the like. In some embodiments, markers can be associated with links that provide further information about the culture medium protocol event represented by the marker when selected. For example, a culture plate image can be linked to a marker representing the capture of the corresponding culture plate image. The results of a data processing algorithm, such as an image analysis algorithm, can be linked to a marker representing the result of the corresponding algorithm. In some embodiments, when a marker is selected, the corresponding culture medium image can be retrieved from memory 104 and displayed on the timeline display screen on display 108.
[0022] In some embodiments, the timeline display screen may allow modification of the culture medium protocol, for example, via the input unit 106. The timeline display screen may include one or more selectable options that, when selected, allow the culture reading system to modify the culture medium protocol. For example, in some embodiments, the timeline display screen may include an option to capture additional culture medium images when selected. In some embodiments, the timeline display screen may include an option to terminate the culture medium protocol when selected. In some embodiments, the timeline display screen may include an option to extend the culture medium protocol when selected. In some embodiments, the extension time of the culture medium protocol can be entered on the timeline display screen.
[0023] The timeline display screen can also be configured to display instructions for modifying the culture medium protocol. For example, the timeline display screen can be configured to provide instructions that the culture medium has been physically discarded, that the culture medium protocol has ended, and / or that the culture medium protocol has been extended.
[0024] In some embodiments, the timeline generated by the culture reading system 110 can follow a predetermined width. The timeline can provide a relative time scale between events in the culture medium protocol. In other words, the physical distance between markers representing events on the timeline correlates to the length of time between events represented by the indicators.
[0025] In some embodiments, the timeline control module 112 is configured to cause the culture reading system 110 to update the timeline in real time or near real time. For example, in some embodiments, the culture reading system 110 can provide a visual indication of the elapsed time from the start of the culture protocol to the current time. This visual indication can be a change in the appearance of the timeline over a length of timeline correlated with the period between the start of the culture protocol and the current time. The timeline can be updated in real time or near real time to change its appearance to indicate the elapsed time from the start of the culture protocol. The culture reading system 110 can also update the timeline in response to receiving data related to events of the culture protocol, such as receiving a culture image, removing the culture from the incubator 122 or incubation system 120, placing the culture into the incubator 122 or incubation system 120, or collecting or processing data about the culture. In response to receiving a culture image, the timeline control module 112 can be configured to cause the culture reading system 110 to associate the culture image with a position on the timeline representing the time the culture image was taken. The culture reading system can also be configured to generate markers on a timeline that relate to the culture medium image. In some embodiments, the culture reading system can be configured to generate markers on a timeline that relate to one or more of the following: removal of the culture medium from the incubator 122 or incubation system 120, placement of the culture medium into the incubator 122 or incubation system 120, and collection or processing of data related to the culture medium.
[0026] In some embodiments, the culture reading system 110 can provide visual indications of the elapsed time between two events in the culture medium protocol, or the elapsed time after an event in the culture medium protocol has occurred. For example, in some embodiments, this visual indication can be a change in the appearance of the timeline over a length of time that correlates with the period between the placement of the culture medium into the incubator 122 or incubation system 120 and the removal of the culture medium from the incubator 122 or incubation system 120. In some embodiments, this visual indication can be a change in the appearance of the timeline over a length of time that correlates with the period between the removal of the culture medium from the incubator 122 or incubation system 120 and the placement of the culture medium into the incubator 122 or incubation system 120. In some embodiments, this visual indication can be a change in the appearance of the timeline over a length of time that correlates with the period after the culture medium has been removed from the incubator 122 or incubation system 120. In some embodiments, this visual indication can be a change in the appearance of the timeline over a length of time that correlates with the period after the culture medium has been placed in the incubator 122 or incubation system 120.
[0027] In some embodiments, the timeline control module 112 can be configured to align these images in the culture reading system 110 so that the culture medium is shown in the same orientation in each culture medium image associated with the culture medium protocol. The culture reading system 110 can be configured to determine the orientation of each image using image processing software, for example, to detect and analyze indicators on the culture medium. The culture reading system 100 can then orient each image so that the indicators on the culture medium are shown in the same position in each image. For example, in a culture medium protocol including a culture plate with divisions, the culture reading system 110 can be configured to orient the culture medium images so that the culture medium on each side of the divisions is shown on the same side of each culture medium image.
[0028] The clock 114 can enable the association of dates and / or times with events in the culture medium protocol. For example, the clock can be configured to associate dates and / or times with culture medium images. In some embodiments, the imaging device 124 can be configured to record the date and / or time when an image was acquired and provide this date and / or time to the culture reading system 110. The clock 114 can also enable the determination of the duration between events in the culture medium protocol and / or the current time within the culture medium protocol.
[0029] The timeline control module 112 can also be configured to initiate animation mode in the culture reading system 110. In animation mode, a video or animation is generated from a series of acquired images, displaying all culture images acquired during the culture protocol in chronological order. These videos or animations can show the progression of bacterial growth on the culture medium over time.
[0030] In some embodiments, the timeline display screen can display multiple timelines, each representing a different culture medium protocol. The timeline display screen can also display multiple culture medium images related to the same culture medium protocol.
[0031] Figure 2 is a flowchart of process 200 of an exemplary embodiment of a method for providing a timeline control system using a culture reading system such as reading system 110. Process 200 begins with step 210, which receives a culture protocol for the culture medium. The culture protocol may include the planned duration of the culture protocol, the planned number of culture images to be captured during the protocol, the date and / or time when each culture image is scheduled to be captured, the identification of one or more organisms on the culture medium, and the identification of one or more culture types on the culture plate. The culture protocol can be received as an entry or selection from the user via an input unit such as input unit 106. The culture protocol can also be received from a database or memory such as memory 104. The culture protocol can be a custom protocol, a common protocol, or a protocol retrieved from a list of previously received protocols.
[0032] Process 200, after receiving the culture medium protocol, proceeds to step 220 to generate a timeline. The timeline can be generated by a processor, such as processor 102, executing a software application. The timeline can include information about the culture medium protocol. For example, the timeline can include an expected start time, an expected end time, one or more times when one or more images are expected to be acquired according to the culture medium protocol, and / or one or more times when any other culture medium protocol event is expected to occur. In some embodiments, the culture medium protocol event may include the collection or processing of data related to the culture medium, such as the removal of the culture medium from the incubator or incubation system, the placement of the culture medium into the incubator or incubation system, and the processing of the culture medium image by a digital image analysis algorithm. Markers can also be used on the timeline to indicate the scheduled dates and / or scheduled times of one or more protocol events, such as the acquisition of culture medium images. Markers can be positioned on the timeline according to a relative time scale such that the physical distance between markers on the timeline represents the length of time between the events represented by the markers.
[0033] Process 200 proceeds to step 230 after the timeline is generated, initiating monitoring of the plate culture time on the timeline. Time can be monitored on the timeline using a clock or timer, such as clock 114. For example, a processor, such as processor 102 running a software application, can receive time data from the clock and use this time data to monitor time on the timeline. The culture reading system can be configured to update the visual timeline in real time or near real time while monitoring time to show the elapsed time from the start of the protocol. In some embodiments, graphic or numerical indicators are provided to show the elapsed time from the start of the protocol. In some embodiments, graphic or numerical indicators are provided to show the expected remaining time in the protocol. In some embodiments, graphic or numerical indicators can be provided to show the expected remaining time to the next event in the protocol. In some embodiments, graphic or numerical indicators can be provided to show the time from the previous event in the protocol. In some embodiments, the appearance of the timeline is configured to change to show the elapsed time from the start of the culture medium protocol. For example, a portion of the timeline representing the period between the start time of the culture medium protocol and the current time in the culture medium protocol can be indicated using a different color and / or size than the rest of the timeline. In some embodiments, the appearance of the timeline is configured to change to indicate the elapsed time between events in the culture medium protocol, or the elapsed time since an event occurred in the culture medium protocol.
[0034] Process 200 proceeds to processing step 240 after time monitoring begins, where it acquires and processes the culture medium image. The processed culture medium image can be associated with markers added to the timeline, as illustrated in Figure 3.
[0035] Process 200 proceeds to the determination step 250 after the culture medium images have been acquired and processed, to determine whether the acquisition of culture medium images according to the culture medium protocol is complete. If no further images are scheduled as part of the culture medium protocol, a processor such as the processor 102 running the software application may determine that the acquisition of culture medium images is complete. Culture medium images can be scheduled in the protocol initially received, or added at a later point via user input, etc. If culture medium images are added after the initial timeline generation, the timeline can be modified to include markers representing the expected acquisition time of the images. If the acquisition of images is not complete, process 200 returns to step 240.
[0036] If image acquisition is complete, process 200 proceeds to determination step 260 to determine whether the culture reading system has completed time tracking. The culture reading system may terminate time tracking when it reaches the estimated end time of the culture protocol. In some embodiments, the protocol end time can be modified in response to one or more events. The culture protocol may also terminate early in response to user input or errors, for example. The culture protocol may also be extended in response to user input, for example. The timeline may be modified to add an additional timeline length representing the extension time of the protocol. In some embodiments, instead of changing the length of the timeline, the timeline scale is adjusted to correspond to the adjusted total time length represented by the timeline. The culture protocol can be extended at any time throughout process 200. The culture reading system may be configured to modify the protocol end time and determine whether time tracking can be stopped at this modified end time. A processor, such as processor 102, may be configured to determine that the incubation system has completed time tracking. If the culture reading system determines that time tracking has not completed, process 200 returns to step 250. If it is determined that time tracking has ended, process 200 terminates in the termination step.
[0037] Figure 3 is a flowchart of an exemplary embodiment of process 240 for acquiring and processing culture medium images. This process begins with step 310, which involves acquiring a culture medium image. The culture medium image can be acquired by an imaging device, such as imaging device 124. In some embodiments, the culture reading system is configured to acquire the culture medium image at an estimated acquisition time indicated by the culture protocol received in step 210 of process 200. A processor, such as processor 102, which runs a software application, can cause the culture reading system to instruct the imaging device to acquire the image at the estimated time. The culture reading system can also instruct the imaging device to send the acquired image to the culture reading system for further processing. In some embodiments, the imaging device can acquire the image in response to an instruction from a processor running a software program, regardless of the estimated acquisition time of the image. In some embodiments, the user can also modify the scheduled image acquisition time. In some embodiments, the user can give an instruction to acquire the culture medium image at any point in the culture protocol. In some embodiments, the user can manually acquire the image using the imaging device.
[0038] Process 240 proceeds to step 320 after the culture medium image has been acquired, associating the culture medium image with a position on a timeline representing the time the image was acquired. In some embodiments, the imaging device is configured to record the date and time the culture medium image was acquired and to transmit this date and time to the culture reading system. In some embodiments, a processor such as processor 102, which runs a software application in conjunction with a clock or timer such as clock 114, can correlate the date and time the image was acquired with a position on a timeline representing this time. In some embodiments, each point on the timeline can be assigned the date and / or time on which the timeline was generated according to the start time of the culture medium protocol and the expected duration of the culture medium protocol. The corresponding date and / or time assigned to a point on the timeline can be correlated with an image taken on a specific date and / or time. Alternatively, the culture reading system can be configured to determine the time difference between the start time of the culture medium protocol and the time the culture medium image was acquired. Subsequently, the culture reading system can determine the physical length of the timeline that starts at the beginning of the timeline, corresponding to the time difference between the start time of the culture protocol and the time the culture image was acquired, and associate the endpoint of the determined physical length of the timeline with the image.
[0039] Process 240 proceeds to step 330 after associating the image with a position on the timeline, generating a marker on the timeline associated with this image. A processor, such as processor 102 running a software application, can cause the culture reading system to generate the marker. This marker can be arranged at a position on the timeline associated with the acquired image. In some embodiments, the marker can provide a link to the acquired image. For example, the associated image can be displayed in response to the selection of a marker on the timeline display screen.
[0040] Process 240 proceeds to step 340 after associating an image with an indicator on the timeline, aligning this image with previously acquired culture medium images. The culture medium images can be aligned by a processor, such as processor 102, running image processing software. The culture reading system can be configured to determine the orientation of each image using image processing software, for example, to detect and analyze reference points on the culture plate. The culture reading system can then orient each image so that all reference points on the culture plate are presented in the same position in each image, for example, by rotating the culture medium images according to the arrangement of previously acquired culture medium images. Process 240 terminates after the culture plate images have been aligned.
[0041] Figure 4 is a flowchart of process 400 of an exemplary embodiment of a method for displaying a culture medium image on a timeline display screen. Process 400 begins with step 410, which receives a selection of a marker on the timeline related to the culture medium image. This selection can be received from an input unit, such as an input unit 106 operated by the user.
[0042] Process 400 proceeds to step 420 after receiving the marker selection, where it displays an image associated with the marker on a timeline display screen of a display such as display 108. In some embodiments, the associated image may also be displayed on a separate screen of the user interface.
[0043] The process proceeds to step 430 after the culture medium images are displayed, and instructions on the timeline regarding which images are being displayed may be provided. For example, the appearance of markers associated with an image may be modified to distinguish them from markers associated with other culture medium images. The process ends after instructions on which images are being displayed are provided.
[0044] Figure 5 is a flowchart of process 500 of an exemplary embodiment of a method for providing a video of a culture protocol related to a timeline using a culture reading system, such as culture reading system 110. Process 500 begins with step 510, which starts the animation mode. The animation mode may be part of the timeline display screen on the user interface of the culture reading system, or it may be displayed on a separate display screen. The animation mode may be started, for example, in response to receiving a selection on the timeline display screen. In some embodiments, the selection may be made using an input unit, such as input unit 106.
[0045] Process 500 proceeds to step 520 after the animation mode has started, to retrieve a culture medium image related to the timeline associated with the culture medium protocol. The culture medium image can be retrieved from memory such as memory 104 or from an imaging device such as imaging device 124.
[0046] Process 500 proceeds to step 530 after retrieving the images related to the timeline, and retrieves the time data for each image. The time data can be retrieved from memory such as memory 104 or from the imaging device.
[0047] Process 500 proceeds to step 540 after extracting the time data for each image to generate a video or animation. The video may include each image related to the timeline. In some embodiments, the video may include images based on the time data associated with each image. For example, in some embodiments, the video may include each image in chronological order. This video may show the progression of bacterial growth on a culture medium over time.
[0048] In some embodiments, the video or animation can be generated by an external image processor service that receives data from a culture reading system, generates a video or animation, and transmits the generated video or animation to the culture reading system. In some embodiments, the external video processor service can generate a video in response to a user command using a process similar to that described with respect to Figure 5.
[0049] In some embodiments, a video or animation can be generated by including each image related to the timeline in a new video each time an image is captured, or by adding the latest image to a previously generated video. The video or animation generated each time an image is captured can be stored in the culture reading system, or in an external video processor service in embodiments where an external video processor service generates the animation or video. The video or animation can be accessed on the culture reading system, or it can be sent from the external video processor service to the culture reading system in response to a command from the user.
[0050] Figure 6 shows an embodiment of a timeline 600 representing a culture medium protocol and associated data. The timeline 600 can be displayed on a timeline display screen. The timeline 600 includes a line 604. The line 604 provides a relative time scale in which the expected time length from the start to the end of the culture medium protocol is directly proportional to the physical length of the line 604, such that the distance between points on the line is proportional to the time length between the times represented by these points. The timeline 600 includes a field 603 that displays the date and time the culture medium protocol was started. The timeline 600 also shows one or more markers, including a marker 605, that represent the time when the culture medium image is expected to be acquired according to the culture medium protocol. As indicated by marker 605, the marker representing the time when the culture medium image is expected to be acquired can be a circle or other shape located on the line 604. The marker representing the time when the culture medium image is expected to be acquired can include a numerical indication of the time length from the start of the protocol in which the image is expected to be taken. As shown in Figure 6, the expected times when images are acquired include 24 hours, 48 hours, and 72 hours. Timeline 600 also includes one or more markers, including markers 606 and 607, which indicate the times when the culture medium images were acquired. Each marker representing the time when the culture medium images were acquired may be located below the timeline, aligned with the position on the timeline representing the time when the culture medium images were acquired.
[0051] In some embodiments, markers such as markers 606 and 607, which represent the time when a culture medium image was acquired, can be configured to provide links to the associated culture medium image. For example, the associated culture medium image can be displayed in response to the selection of a marker representing the time when a culture medium image was acquired via an input unit such as input unit 106. The timeline 600 can also provide visual indication on the timeline of which culture medium image is currently displayed, for example, by modifying the appearance of the marker associated with the culture medium image being displayed. Figure 6 shows a configuration of the timeline 600 that indicates that a culture medium image associated with marker 607 is displayed, although the associated culture medium image is not shown. As shown in Figure 6, marker 607 has a different appearance from the other markers representing the time when a culture medium image was acquired. For example, marker 607 is a different color from the other markers. A circular border is also shown around marker 607 to indicate that a culture medium image associated with marker 607 is displayed.
[0052] The timeline 600 also includes a field 601 that displays the date and time the display image was captured. The timeline 600 also includes a field 602 that displays the relative time between the time the display image was taken and the current time. In some embodiments, for example, when no image is currently displayed, field 602 may provide the relative time between the time the most recent image was captured and the current time.
[0053] Figure 7 shows an embodiment of a timeline 700 representing a culture medium protocol and associated data. The timeline 700 can be displayed on a timeline display screen. The timeline 700 includes a line 704. The line 704 provides a relative time scale in which the expected time length from the start to the end of the culture medium protocol is directly proportional to the physical length of the line 704, such that the distance between points on the line is proportional to the time length between the times represented by these points. The timeline 700 also shows one or more markers, including a marker 705, which represents the time when a culture medium image is expected to be acquired according to the culture medium protocol. As indicated by the marker 705, the marker representing the time when a culture medium image is expected to be acquired can be a circle or other shape located on the line 704. The timeline 700 also includes a field 702 that displays the relative time between the time when the most recent image was acquired and the current time. In some embodiments, the field 702 can provide the relative time between the time when the displayed image was acquired and the current time. The timeline 700 includes a visual indicator 708 on line 704 indicating the time elapsed since the start of the protocol. Thus, the visual indicator 708 also indicates the current time within the culture medium protocol. As shown in Figure 7, the visual indicator 708 can be a change in the color and / or width of line 704 from the start of line 704 to a position on the timeline related to the current time. In some embodiments, the visual indicator 708 can include a change in the size and / or shape of line 704. The timeline 700 may also include a visual indicator 709 indicating the disposal of the culture medium and / or the end of the culture medium protocol. As shown in Figure 7, the indicator 709 is the shape of a trash can or other graphic representation. In Figure 7, the indicator 709 is shown beyond the end of the timeline. However, in some embodiments, the indicator 709 can also be positioned at a location on the timeline that represents the time of disposal of the culture medium or the end of the protocol.
[0054] The timeline 700 further includes a visual indicator 712 that shows the number of culture medium images actually captured by the imaging device. In some embodiments, the indicator 712 can be made selectable to display a different display screen on the user interface to display the relevant culture medium images, or to enable navigation between and / or selection of one of the culture medium images indicated by the indicator 712. In some embodiments, the display screen displaying the timeline 700 can enable navigation to a second display screen having a timeline such as the timeline 600 in Figure 6, which contains other information or more detailed information.
[0055] Figures 8 to 10 show examples of timeline display screens. The timeline display screens shown in Figures 8 to 10 represent different stages of the culture medium protocol.
[0056] Figure 8 shows an embodiment of a timeline display screen having a timeline 800 representing a culture medium protocol and relevant data at stages of the culture medium protocol where images have not yet been acquired. The timeline 800 includes a line 804. Line 804 provides a relative time scale in which the expected time length from the start to the end of the culture medium protocol is directly proportional to the physical length of line 804, such that the distance between points on the line is proportional to the time length between the times represented by these points. The timeline 800 also shows one or more markers, including a marker 805, which represent the time when culture medium images are expected to be acquired according to the culture medium protocol. Markers representing the time when culture medium images are expected to be acquired, as indicated by marker 805, can be circular or other shapes located on line 804. The timeline display screen also includes a culture medium image field 814. The culture medium image field 814 can be configured to display culture medium images acquired during the culture medium protocol. In some embodiments, the culture medium image field 814 can be configured to display the most recent culture medium image acquired during the protocol. In the timeline of Figure 8, the culture medium image field 814 displays a graphic indicator 816 indicating that the culture medium image is unavailable. The indicator 816 includes a symbol with a diagonal line extending across it. The timeline 800 also includes a field 802 that displays the relative time between the time the latest image was captured and the current time. In the example of Figure 8, no image has been taken, so the indicator 802 displays text indicating that the image is unavailable.
[0057] The timeline 800 also includes a visual indicator 808 on line 804 indicating the time elapsed since the start of the protocol. Thus, the visual indicator 808 also indicates the current time in the culture medium protocol. As shown in Figure 8, the visual indicator 808 can be a change in the color and / or width of line 804 from the start of line 804 to a position on the timeline related to the current time. The timeline 800 further includes a visual indicator 812 that indicates the number of culture medium images actually captured by the imaging device. In the example in Figure 8, no images have been captured, so the indicator 812 indicates that the number of captured images is 0.
[0058] The timeline 800 includes graphic representations of an image acquisition button 818, a culture medium transfer button 819, and an end button 820. Selecting the image acquisition button 818 allows the culture reading system to instruct the imaging device to acquire an image at the current time. In some embodiments, automated equipment, such as an automated tracking system that moves the culture medium to various locations within the laboratory environment, may be provided. The culture medium transfer button 819 can be configured to trigger the removal of the culture medium from the incubator instrument and its delivery to a destination at a specific location or associated workbench in relation to the culture medium protocol. Selecting the end button 820 allows the culture reading system to terminate the protocol. Once the protocol is terminated, the culture reading system can instruct the imaging device to stop acquiring images. In some embodiments, once the protocol is terminated, the culture reading system can stop time tracking.
[0059] Figure 9 shows an embodiment of a timeline display screen having a timeline 900 representing a culture medium protocol and relevant data at the stage of the protocol in which the culture medium protocol is completed and three images have been acquired. The timeline 900 includes a line 904. The line 904 provides a relative time scale in which the expected time length from the start to the end of the culture medium protocol is directly proportional to the physical length of the line 904, such that the distance between points on the line is proportional to the time length between the times represented by these points. The timeline 900 also shows one or more markers, including a marker 905, which represent the time when the culture medium images are expected to be acquired according to the culture medium protocol. As indicated by the marker 905, the markers representing the time when the culture medium images are expected to be acquired can be circular or other shapes located on the line 904. The timeline display screen also includes a culture medium image field 914. The culture medium image field 914 can be configured to display culture medium images acquired during the culture medium protocol. In some embodiments, the culture medium image field 914 can be configured to display the most recent culture medium image acquired during the protocol. In the timeline of Figure 9, the culture medium image 922 is displayed in the culture medium image field 914. Timeline 900 also includes field 902, which shows the relative time between the time the latest image was acquired and the current time. Field 902 indicates that the latest image was acquired 4 hours and 32 minutes ago.
[0060] Timeline 900 also includes a visual indicator 908 on line 904 indicating the time elapsed since the start of the protocol. Thus, the visual indicator 908 also indicates the current time within the medium protocol. As shown in Figure 9, the visual indicator 908 can be a change in the color and / or width of line 904 from the start of line 904 to its position on the timeline related to the current time. As shown in Figure 9, the entire protocol is completed. Timeline 900 further includes a visual indicator 912 indicating the number of medium images actually captured by the imaging device. As shown in Figure 9, the indicator 912 indicates that three images have been captured.
[0061] The timeline 900 includes an image acquisition button 918, a culture medium transfer button 919, and an end button 920. Selecting the image acquisition button 918 allows the culture reading system to instruct the imaging device to acquire an image at the current time. In embodiments with an automatic tracking system, the culture medium transfer button 919 can be configured to trigger the removal of the culture medium from the incubator instrument related to the culture medium protocol and its delivery to a destination at a specific location or associated workbench of the incubator instrument. Selecting the end button 920 allows the culture reading system to terminate the protocol. Once the protocol is terminated, the culture reading system can instruct the imaging device to stop acquiring images. In some embodiments, once the protocol is terminated, the culture reading system can stop time tracking.
[0062] Figure 10 shows an embodiment of a timeline display screen having a timeline 1000 representing a culture medium protocol and relevant data at a stage of the culture medium protocol after three culture medium images have been acquired and before the expected end time of the culture medium protocol. As shown in Figure 10, the culture medium protocol represented by timeline 1000 has ended. The end of the protocol is indicated by indicator 1009. Timeline 1000 includes line 1004. Line 1004 provides a relative time scale in which the expected time length from the start to the end of the culture medium protocol is directly proportional to the physical length of line 1004, such that the distance between points on the line is proportional to the time length between the times represented by these points. Timeline 1000 also shows one or more markers, including marker 1005, which represent the time when culture medium images are expected to be acquired according to the culture medium protocol. As indicated by marker 1005, the marker representing the time when culture medium images are expected to be acquired can be circular or other shape located on line 1004. The timeline includes a culture medium image field 1014. The culture medium image field 1014 can be configured to display culture medium images taken during the culture medium protocol. In some embodiments, the culture medium image field 1014 can be configured to display the most recent culture medium image taken during the protocol.
[0063] In the timeline of Figure 10, the culture medium image 1022 is displayed in the culture medium image field 1014. Timeline 1000 includes a field 1002 that shows the relative time between the time the latest image was acquired and the current time. Field 1002 indicates that the latest image was acquired 4 hours and 36 minutes ago.
[0064] Timeline 1000 also includes a visual indicator 1008 on line 1004 indicating the time elapsed since the start of the protocol. Thus, the visual indicator 1008 also indicates the current time in the culture medium protocol. As shown in Figure 10, the visual indicator 1008 can be a change in the color and / or width of line 1004 from the start of line 1004 to a position on the timeline related to the current time. Timeline 1000 further includes a visual indicator 1012 indicating the number of culture medium images actually captured by the imaging device. As shown in Figure 10, the indicator 1012 indicates that three images have been captured.
[0065] The timeline 1000 includes an image acquisition button 1018, a culture transfer button 1019, and an exit button 1020. When the image acquisition button 1018 is selected, the culture reading system can instruct the imaging device to acquire an image at the current time. In embodiments having an automatic tracking system, the culture transfer button 1019 can be configured to cause the removal of the culture medium from the incubator instrument related to the culture protocol and its delivery to a destination at a specific location or associated workbench of the incubator instrument. When the exit button 1020 is selected, the culture reading system can terminate the protocol. Once the protocol is terminated, the culture reading system can instruct the imaging device to stop acquiring images. In some embodiments, once the protocol is terminated, the culture reading system stops tracking time and removes the image acquisition button 1018 and the exit button 1020 from view, modifying their selectability by disabling their functions, or by changing their appearance to indicate they are unavailable, thereby rendering them unselectable.
[0066] Figures 11-13 show examples of timeline display screens showing a timeline 1100 and an image field 1114. The timeline 1100 includes line 1104. Line 1104 provides a relative time scale in which the expected time length from the start to the end of the culture medium protocol is directly proportional to the physical length of line 1104, such that the distance between points on the line is proportional to the time length between the times represented by these points. The timeline 1100 includes field 1103 which displays the date and time the culture medium protocol was started. The timeline 1100 also includes one or more markers, including markers 1132, 1134, and 1136, which represent the time when the culture medium image is expected to be acquired according to the culture medium protocol. Markers 1132, 1134, and 1136 can be circular or other shapes located on line 1104. Markers 1132, 1134, and 1136 may also include numerical indications of the time length from the start of the protocol in which the image is expected to be taken. As shown in Figures 11 to 13, the expected times when images are acquired include 24 hours, 48 hours, and 72 hours. Timeline 1100 also includes one or more markers, including markers 1138, 1140, and 1142, which indicate the times when the culture medium images were acquired. Each marker representing the time when the culture medium images were acquired can be located below the timeline, aligned with the position on the timeline representing the time when the culture medium images were acquired. As shown in Figures 11 to 13, the images corresponding to markers 1138, 1140, and 1142 were acquired at the expected times represented by markers 1132, 1134, and 1136.
[0067] As shown in Figures 11 to 13, one of the markers 1138, 1140, and 1142 on the timeline 1100 can be selected to display the culture medium image associated with image field 1114. The timeline 1100 can also provide visual indication on the timeline of which culture medium image is currently displayed, for example, by modifying the appearance of the markers 1138, 1140, or 1142 associated with the culture medium image. Figure 11 shows the timeline display screen when marker 1138 is selected to display image 1144 associated with marker 1138. Culture medium images can be selected via an input section operated by the user. In some embodiments, a cursor 1150 on the display screen can be operated to select a marker associated with a culture medium image. As shown in Figure 11, marker 1138 has a different appearance from markers 1140 and 1142. Markers can change their appearance in response to selection to indicate the image currently displayed on the timeline display screen. For example, the color of marker 1138 is different from the colors of markers 1140 and 1142. A circular border is shown around marker 1138 to indicate that the culture medium image associated with marker 1138 is displayed. Figure 12 shows the timeline display screen when marker 1140 is selected to display image 1146 associated with marker 1140. Figure 13 shows the timeline display screen when marker 1142 is selected to display image 1148 associated with marker 1142.
[0068] The timeline 1100 also includes a field 1101 that can display the date and time the display image was captured. The timeline 1100 also includes a field 1102 that indicates the relative time between the time the display image was captured and the current time.
[0069] Figures 6 to 13 show various embodiments of a timeline that includes markers indicating the expected time when a culture medium image is captured according to the culture medium protocol, and markers indicating the time when the culture medium image is captured. As described with respect to Figure 1, it is intended that similar markers can be used for other events related to the culture medium protocol that are expected to occur or have occurred. Typical examples of events include the collection or processing of data related to the culture medium, such as the removal of the culture medium from the incubator or incubation system, the placement of the culture medium into the incubator or incubation system, and the processing of the culture medium image by a digital image analysis algorithm. In some embodiments, markers can be arranged at certain points on the timeline that correlate with intermediate results provided by a data processing algorithm, such as a digital image analysis algorithm. In some embodiments, markers can be arranged at certain points on the timeline that correlate with the final result provided by a data processing algorithm, such as a digital image analysis algorithm. Each marker can be associated with data relating to the culture medium protocol event that the marker represents. In some embodiments, a display field can be configured to display data related to the most recent event of the culture medium protocol, or data related to a selected marker on the timeline.
[0070] In some embodiments, the timeline may include markers associated with several different types of media protocol events, such as the start of a media protocol, the end of a media protocol, acquisition of media images, removal of media from an incubator or incubation system, placement of media in an incubator or incubation system, and collection or processing of media data, such as processing of media images by a digital image analysis algorithm. In some embodiments, the timeline described herein may also be used for media protocols in which the media is not digitally imaged. For example, the timeline according to the embodiments described herein may also be used for blood culture bottle protocols or broth culture protocols in which digital imaging is not always performed. As described herein, the timeline may also include one or more markers associated with one or more imaging events of a media protocol.
[0071] The implementations disclosed herein provide systems, methods, and apparatus for timeline control. Those skilled in the art will recognize that these embodiments can be implemented in hardware, software, firmware, or a combination thereof.
[0072] The functions described herein can be stored as one or more instructions on processor-readable or computer-readable media. The term “computer-readable media” means any available media accessible to a computer or processor. Such media, but not limited to, include RAM, ROM, EEPROM, flash memory, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other media accessible to a computer that can be used to store desired program code in the form of instructions or data structures. As used herein, disks and discs include compact discs ("CD"), laserdiscs (registered trademark), optical discs, digital multipurpose discs ("DVD"), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically and discs reproduce data optically using a laser. Computer-readable media can also be tangible and non-temporary. The term “computer program product” means a combination of a computer device or processor and code or instructions (e.g., “programs”) that they can execute, process, or calculate. As used herein, the term “code” means software, instructions, code, or data that a computer device or processor can execute.
[0073] Software or instructions can also be transmitted via a transmission medium. For example, when transmitting software from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line ("DSL"), or wireless technologies such as infrared, radio, and microwave, these coaxial cables, fiber optic cables, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are also included in the definition of a transmission medium.
[0074] The methods disclosed herein include one or more steps or actions to achieve the described method. The steps and / or actions of the method can be replaced with one another without departing from the claims. In other words, unless a particular order of steps or actions is required for the proper operation of the described method, the order and / or use of any particular steps and / or actions can be modified without departing from the claims.
[0075] The terms "couple," "coupling," and "coupled" as used herein, and other forms of this word, can refer to either indirect or direct connection. For example, when a first component is "coupled" to a second component, the first component can be connected to the second component either indirectly or directly. The term "plurality" as used herein refers to two or three or more. For example, "plurality" refers to two or three or more components.
[0076] The term "determining" encompasses a variety of actions, and therefore can include calculating, computing, processing, deriving, investigating, looking up (e.g., looking up tables, databases, or other data structures), and ascertaining. Furthermore, "determining" can also include receiving (e.g., receiving information) and accessing (e.g., accessing data in memory). Additionally, "determining" can include resolving, selecting, choosing, and establishing.
[0077] The expression "based on" does not mean "based only on" unless otherwise specified. In other words, the expression "based on" can mean both "based only on" and "based on at least."
[0078] The above description provides certain details to ensure a complete understanding of the embodiments. However, those skilled in the art will understand that the embodiments can be carried out without these specific details. For example, electrical components / devices may be shown in block diagrams to avoid obscuring these embodiments with unnecessary details. In other cases, such components, other structures, and techniques may be shown in detail to further illustrate the embodiments.
[0079] This specification includes headings for reference and to help locate the various sections. These headings are not intended to limit the scope of the concepts described herein. Such concepts may be applicable throughout this specification.
[0080] Furthermore, the embodiments can also be described as processes shown in flowcharts, flow diagrams, finite state diagrams, structural diagrams, or block diagrams. While flowcharts may describe operations as sequential processes, many operations can be performed in parallel or simultaneously, and processes can be repeated. The order of operations can also be rearranged. A process terminates when its operations are completed. A process can correspond to a method, function, procedure, subroutine, or subprogram. If a process corresponds to a software function, the termination of that process corresponds to the function returning to the calling function or main function.
[0081] The above description of the disclosed implementations is provided so that the invention can be implemented or utilized by any person skilled in the art. Various modifications of these implementations will be readily apparent to those skilled in the art, and the general principles set forth herein can be applied to other implementations without departing from the spirit or scope of the invention. Accordingly, the invention is not intended to be limited to the implementations shown herein, but rather should allow for the broadest range consistent with the principles and novel features disclosed herein. [Explanation of symbols]
[0082] 900 Timeline 902 Field 904 Line 905 Marker 908 Visual Instructions 912 Visual Indicators 914 Culture medium image field 918 Image Import Button 919 Medium Transfer Button 920 Exit button 922 Culture medium image
Claims
1. A system for providing a timeline representing a culture medium protocol for a culture medium, A user interface configured to display a timeline of culture medium images and fields for displaying arbitrary culture medium images, Processor and Includes, The aforementioned processor, Upon receiving the medium protocol for the aforementioned medium, Based on the culture medium protocol, the timeline is generated on the user interface. Monitor the time on the aforementioned timeline, One or more culture medium images related to the culture medium protocol are received, Each of the one or more culture medium images is associated with a position on the timeline that correlates with the time the culture medium image was captured. Generate and display selectable markers for each culture medium image associated with the timeline, arranged at the position on the timeline corresponding to the time when the culture medium image was captured. It is configured in such a way, The selectable marker changes its appearance in response to a selection to indicate the currently displayed image. A system characterized by the following features.
2. The aforementioned processor, The system receives a selection from one of the selectable markers, Display an image of the culture medium associated with the selected marker. The system according to claim 1, further configured as follows.
3. The incubation system further comprises, An incubator containing at least one culture medium having multiple microorganisms, An imaging device configured to capture an image of at least one culture medium, Includes, The timeline includes one or more scheduled times for acquiring a culture medium image, and the computer system is configured to transmit a command to the imaging device to acquire a culture medium image at each scheduled time for acquiring the culture medium image. The system according to claim 1.
4. The aforementioned processor, We received multiple culture medium images. Based on the plurality of culture medium images, one or more reference points on the culture medium are detected. The culture medium images are oriented such that the one or more reference points are in the same position in each culture medium image. The system according to claim 1, further configured as follows.
5. The aforementioned timeline provides a relative time scale for the culture medium protocol, wherein the expected duration of the culture medium protocol correlates with the length of the timeline. The system according to claim 1.
6. The processor is configured to modify the timeline in response to an unexpected event. The system according to claim 1.
7. The timeline includes one or more predicted times when the culture medium image is acquired, and the processor is configured to generate markers on the timeline for each predicted time when the culture medium image is acquired. The system according to claim 1.
8. The processor is configured to update the timeline in real time or near real time in response to the occurrence of an event. The system according to claim 1.
9. A method for providing a timeline representing a culture medium protocol for a culture medium, Upon receiving the medium protocol for the aforementioned medium, Based on the culture medium protocol, the timeline is generated on the user interface. Monitor the time on the aforementioned timeline, The steps include receiving one or more culture medium images related to the culture medium protocol, The steps include associating each of the one or more culture medium images with a position on the timeline that correlates with the time the culture medium image was captured, A step of generating selectable markers for each culture medium image associated with the timeline, which are arranged at the position on the timeline that correlates with the time at which the culture medium image was captured. Includes, The method is characterized in that the selectable marker changes its appearance in response to a selection in order to indicate the currently displayed image.
10. A step of receiving a selection of one of the selectable markers, The steps include displaying the culture medium image associated with the selected marker, The method according to claim 9, further comprising:
11. The steps include: acquiring an image of the culture medium from the incubation system using an imaging device; A step of generating one or more scheduled times for acquiring culture medium images, The steps include: transmitting a command to the imaging device to acquire the culture medium image at each scheduled time for acquiring the culture medium image; The method according to claim 9, further comprising:
12. The steps include receiving multiple culture medium images, A step of detecting one or more reference points on the culture medium based on the plurality of culture medium images, The steps include orienting each culture medium image so that the one or more reference points are in the same position in each culture medium image, The method according to claim 9, further comprising:
13. The aforementioned timeline provides a relative time scale for the culture medium protocol, and the expected duration of the culture medium protocol correlates with the length of the timeline. The method according to claim 9.
14. The step further includes modifying the timeline in response to an unexpected media protocol event, The method according to claim 9.
15. The timeline includes one or more predicted times in which a culture medium image is acquired, and the method further includes the step of generating markers on the timeline for each predicted time in which a culture medium image is acquired. The method according to claim 9.
16. The step further includes updating the timeline in real time or near real time in response to the occurrence of an event, The method according to claim 9.
17. A system for providing a timeline representing a culture medium protocol for a culture medium, A user interface configured to display a timeline of multiple culture medium images, a video, and a field for displaying any culture medium image, Processor and Includes, The aforementioned processor, Upon receiving the medium protocol for the aforementioned medium, Based on the culture medium protocol, the timeline is generated on the user interface. Monitor the time on the aforementioned timeline, The plurality of culture medium images related to the culture medium protocol are received, Based on the time data associated with each of the plurality of culture medium images, a video of the plurality of culture medium images is generated. Each of the plurality of culture medium images is associated with a position on the timeline that correlates with the time the culture medium image was captured. A selectable marker is generated for each culture medium image associated with the timeline, arranged at the position on the timeline that correlates with the time at which the culture medium image was captured. It is configured in such a way, The selectable marker changes its appearance in response to a selection to indicate the currently displayed image. A system characterized by the following features.
18. The system according to claim 17, wherein the plurality of culture medium images are presented in chronological order based on the time the plurality of culture medium images were acquired.
19. After the processor generates a video of the multiple culture medium images, Received additional culture medium images, The system according to claim 17, which generates a video of the plurality of culture medium images and the additional culture medium images based on time data associated with each of the plurality of culture medium images and the additional culture medium images.
20. After the processor generates a video of the multiple culture medium images, Received additional culture medium images, The system according to claim 17, wherein the additional culture medium images are added to a video of the plurality of culture medium images based on time data associated with the additional culture medium images.