Three-dimensional displacement determination method and apparatus, electronic device, and storage medium
By capturing optical images of cells engulfing microspheres, the three-dimensional coordinates of the microspheres and cells are determined, solving the problem that the cell movement position is limited to two or one dimension in the existing technology, and realizing a true reflection of cell response in three-dimensional space.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI
- Filing Date
- 2024-12-23
- Publication Date
- 2026-06-23
Smart Images

Figure CN122265385A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of medical microscope image processing technology, and in particular to a three-dimensional displacement determination method, device, electronic device and storage medium. Background Technology
[0002] When cells are stimulated by external factors, they will produce corresponding responses, which can be reflected by changes in the cell's position.
[0003] Currently, position measurement devices such as atomic force microscopy, traction force microscopy, microcolumn arrays, or microcantilever can be used to determine the position of cells during cell movement. However, the cell position determined by these devices is limited to two-dimensional or one-dimensional space, failing to accurately reflect the response of cells in three-dimensional space to external stimuli. Therefore, how to accurately reflect the response of cells in three-dimensional space to external stimuli is a problem that urgently needs to be solved. Summary of the Invention
[0004] This invention provides a method, device, electronic device, and storage medium for determining three-dimensional displacement, which can solve the problem that the movement position of cells is limited to two-dimensional or one-dimensional space and cannot truly reflect the response of cells in three-dimensional space when stimulated by external stimuli.
[0005] According to a first aspect of the present invention, a method for determining three-dimensional displacement is provided, the method comprising:
[0006] Optical image information of the microspheres engulfed by the cells is obtained by using an imaging device;
[0007] Acquire a first time and a second time, and determine the first two-dimensional coordinates of the microsphere at the first time and the second two-dimensional coordinates of the microsphere at the second time based on the optical image information, the first time, and the second time;
[0008] Based on the first two-dimensional coordinates and the optical image information, the first three-dimensional coordinates of the microsphere at the first time point are determined;
[0009] The second three-dimensional coordinates of the microsphere at the second time are determined based on the second two-dimensional coordinates and the optical image information;
[0010] Based on the first three-dimensional coordinates and the second three-dimensional coordinates, the target three-dimensional displacement of the cell from the first time to the second time is determined.
[0011] According to a second aspect of the present invention, a three-dimensional displacement determining apparatus is provided, the apparatus comprising:
[0012] An object imaging module is used to capture optical image information of microspheres phagocytosed by the cells using an imaging device;
[0013] The first determining module is used to acquire a first time and a second time, and determine the first two-dimensional coordinates of the microsphere at the first time and the second two-dimensional coordinates of the microsphere at the second time based on the optical image information, the first time, and the second time.
[0014] The second determining module is used to determine the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and the optical image information;
[0015] The third determining module is used to determine the second three-dimensional coordinates of the microsphere at the second time based on the second two-dimensional coordinates and the optical image information;
[0016] The fourth determining module is used to determine the target three-dimensional displacement of the cell from the first time to the second time based on the first three-dimensional coordinates and the second three-dimensional coordinates.
[0017] According to a third aspect of the present invention, an electronic device is provided, comprising a processor and a memory.
[0018] The memory is used to store code and related data;
[0019] The processor is configured to execute code in the memory to implement the three-dimensional displacement determination method as described in any of the embodiments of the present invention.
[0020] According to a fourth aspect of the present invention, a storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the three-dimensional displacement determination method as described in any of the embodiments of the present invention.
[0021] The present invention has the following beneficial effects and advantages:
[0022] In this embodiment of the invention, an imaging device is used to capture optical image information of microspheres phagocytosed by cells; a first time and a second time are acquired, and based on the optical image information, the first time, and the second time, the first two-dimensional coordinates of the microspheres at the first time and the second two-dimensional coordinates of the microspheres at the second time are determined; based on the first two-dimensional coordinates and the optical image information, the first three-dimensional coordinates of the microspheres at the first time are determined; based on the second two-dimensional coordinates and the optical image information, the second three-dimensional coordinates of the microspheres at the second time are determined; based on the first three-dimensional coordinates and the second three-dimensional coordinates, the target three-dimensional displacement of the cell from the first time to the second time is determined. This invention utilizes an imaging device to photograph cells, obtaining optical image information of microspheres phagocytosed by the cells. Since the cells have phagocytosed the microspheres, the microspheres can effectively track and reproduce the cell's movement changes; therefore, the position of the microspheres is the position of the cells. Thus, based on the optical image information of the microspheres, the first two-dimensional coordinates of the microspheres at a first time and the second two-dimensional coordinates of the microspheres at a second time can be determined. Because the coordinates of the lowest point of the light curve obtained by dividing the optical image with the center coordinates of the microsphere's optical image as the origin have a certain correlation with the three-dimensional coordinates of the microspheres in three-dimensional space, the first three-dimensional coordinates of the microspheres at a first time can be determined based on the first two-dimensional coordinates and the optical image information; and the second three-dimensional coordinates of the microspheres at a second time can be determined based on the second two-dimensional coordinates and the optical image information. This method uses three-dimensional coordinates to determine the three-dimensional coordinates of a cell based on two-dimensional optical image information. The cell's movement position is no longer limited to two-dimensional or one-dimensional space, but is elevated to three-dimensional space. This allows for the determination of the cell's target three-dimensional displacement from one time point to another based on the cell's first and second three-dimensional coordinates. By observing the cell's target three-dimensional displacement from one time point to another, the method more realistically reflects the changes in the cell's movement position in three-dimensional space when stimulated by external stimuli. Furthermore, by observing the changes in the cell's movement position in three-dimensional space, the method more realistically reflects the cell's response to external stimuli, increasing the realism of the cell's response to external stimuli as reflected by changes in its movement position. Attached Figure Description
[0023] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0024] Figure 1 This is a flowchart illustrating a three-dimensional displacement determination method provided in an embodiment of the present invention;
[0025] Figure 2This is a schematic diagram of the shooting device provided in an embodiment of the present invention;
[0026] Figure 3 This is another flowchart illustrating the three-dimensional displacement determination method provided in this embodiment of the invention;
[0027] Figure 4 This is a schematic diagram of a three-dimensional displacement determining device provided in an embodiment of the present invention;
[0028] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation
[0029] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0030] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” and “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0031] The technical solution of the present invention will be described in detail below with reference to specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.
[0032] Figure 1 This is a flowchart illustrating a three-dimensional displacement determination method provided in an embodiment of the present invention. This method can be executed by a three-dimensional displacement determination device, which can be implemented using software and / or hardware. In a specific embodiment, the device can be integrated into an electronic device, such as a computer or server. The following embodiments will illustrate this using the integration of the device into an electronic device as an example. Figure 1 The method may specifically include the following steps:
[0033] Step 101: Use an imaging device to capture optical images of the microspheres phagocytosed by the cells.
[0034] Among them, the shooting equipment such as Figure 2 As shown, the device may include an XYZ stage, a laser, a filter, and a camera. The XYZ stage is used to move a culture dish containing cells that have engulfed microspheres to a preset position. The laser is used to emit laser light to irradiate the cells in the culture dish at the preset position. The filter is used to filter the laser light irradiating the cells in the culture dish. When the laser light filtered by the filter irradiates the cells, due to interference effects, the microspheres engulfed by the cells produce diffraction rings. The camera captures the diffraction rings produced by the microspheres at different positions along the axis of the microscope's focal plane, obtaining optical images of the microspheres engulfed by the cells. Finally, the data (optical image information) stored in the camera is acquired by a computer. A cell can be understood as a cell capable of engulfing microspheres. Optical image information can be understood as information obtained by capturing images of the diffraction rings produced by the microspheres engulfed by the cells at different positions along the axis of the microscope's focal plane using an imaging device; optical image information may include multiple optical images and the corresponding capture time for each optical image. An optical image can be understood as an image of the diffraction rings produced by the microspheres at different positions along the axis of the microscope's focal plane using an imaging device. The capture time can be understood as the time it takes for the imaging device to capture images of the cells.
[0035] In one alternative implementation, the cells that have engulfed the microspheres can be placed in a culture dish, and then the culture dish can be placed in a container such as... Figure 2 The XYZ displacement stage shown is used to... Figure 2 When the laser irradiates the cells using the filter in the middle, it utilizes Figure 2 The camera in the middle takes pictures of the cells in the culture dish, which is equivalent to using Figure 2 The camera in the microscope captured images of microspheres being engulfed by cells in a culture dish, and obtained diffraction rings produced by the microspheres at different positions along the axis of the microscope's focal plane, thus obtaining optical image information.
[0036] For example, cells that have engulfed microspheres can be placed in a culture dish, and then the culture dish can be placed in a container such as... Figure 2 The XYZ displacement stage shown; in passing through Figure 2 When the laser irradiates the cells using the filter in the middle, it utilizes Figure 2 The camera in the middle takes pictures of the cells in the culture dish, which is equivalent to using Figure 2 The camera in the microscope captures images of microspheres engulfed by cells in a culture dish, obtaining images of diffraction rings produced by the microspheres at different positions along the axis of the microscope's focal plane, thus obtaining optical image information.
[0037] Step 102: Obtain the first time and the second time, and determine the first two-dimensional coordinates of the microsphere at the first time and the second two-dimensional coordinates of the microsphere at the second time based on the optical image information, the first time and the second time.
[0038] Here, "first time" can be understood as the preset start time of the cell's movement and changes. "Second time" can be understood as the preset end time of the cell's movement and changes. "First two-dimensional coordinates" can be understood as the coordinates of the microsphere in two-dimensional space at the first time. "Second two-dimensional coordinates" can be understood as the coordinates of the microsphere in two-dimensional space at the second time.
[0039] Since the center coordinates of the optical image of the microsphere, i.e., the center coordinates of the diffraction rings in the optical image of the microsphere, are the coordinates of the microsphere in two-dimensional space, the center coordinates of the diffraction rings generated by the microsphere can be determined based on the optical image of the microsphere, and then the center coordinates of the diffraction rings can be used as the coordinates of the microsphere in two-dimensional space. Therefore, in an optional embodiment, the optical image corresponding to the shortest shooting time among multiple optical images can be determined as the current optical image; the initial two-dimensional center coordinates of the diffraction rings in the current optical image are obtained, and the pixels of the current optical image corresponding to the initial two-dimensional center coordinates of the diffraction rings are enlarged to obtain multiple enlarged pixels; the current optical image is divided with the multiple enlarged pixels as the dividing origin, resulting in multiple optical segmented images corresponding to the multiple enlarged pixels; based on the multiple optical segmented images corresponding to the multiple enlarged pixels, the target two-dimensional center coordinates of the diffraction rings in the current optical image are determined. In this way, the target two-dimensional center coordinates of the diffraction rings in the current optical image can be determined based on the current optical image, and the target two-dimensional center coordinates of the diffraction rings are the coordinates of the microsphere in two-dimensional space, thus achieving the purpose of determining the coordinates of the microsphere in two-dimensional space based on the optical image of the microsphere. Here, "enlarged pixels" can be understood as the pixels in the current optical image corresponding to the enlarged initial two-dimensional center coordinates of the diffraction ring; the number of enlarged pixels can be multiple. The initial two-dimensional center coordinates of the diffraction ring can be understood as the preset two-dimensional center coordinates of the diffraction ring. The optically segmented image can be understood as the image obtained by segmenting the current optical image with the enlarged pixels as the segmentation origin. The target two-dimensional center coordinates of the diffraction ring can be understood as the two-dimensional center coordinates of the current optical image determined based on multiple optically segmented images.
[0040] Then, when the current optical image capture time equals the first time, the two-dimensional center coordinates of the target diffraction ring are determined as the first two-dimensional coordinates of the microsphere at the first time, triggering the step of determining the target two-dimensional center coordinates of the current optical image as the initial two-dimensional center coordinates of the diffraction ring of the optical image corresponding to the next capture time of the current optical image; when the current optical image capture time equals the second time, the two-dimensional center coordinates of the target diffraction ring are determined as the second two-dimensional coordinates of the microsphere at the second time, triggering the step of determining the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and the optical image corresponding to the first two-dimensional coordinates; when the current optical image capture time is greater than the first time and less than the second time, the target diffraction ring two-dimensional center coordinates of the current optical image are determined as the initial two-dimensional center coordinates of the diffraction ring of the microsphere at the second time, triggering the step of determining the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and the optical image corresponding to the first two-dimensional coordinates; when the current optical image capture time is greater than the first time and less than the second time, the target diffraction ring two-dimensional center coordinates of the current optical image are determined as the initial two-dimensional center coordinates of the microsphere at the next capture time of the current optical image. The two-dimensional center coordinates of the diffraction ring are determined as the initial two-dimensional center coordinates of the optical image corresponding to the next shooting time of the current optical image. The optical image corresponding to the next shooting time of the current optical image is determined as the current optical image. The process of obtaining the initial two-dimensional center coordinates of the diffraction ring of the current optical image and expanding the pixels of the current optical image corresponding to the initial two-dimensional center coordinates of the diffraction ring to obtain multiple expanded pixels is triggered. In this way, after determining the target two-dimensional center coordinates of the diffraction ring of the current optical image, the first two-dimensional coordinates of the microsphere in the first time and the second two-dimensional coordinates of the microsphere in the second time can be quickly determined according to the shooting time, thereby improving the speed of determining the coordinates (first two-dimensional coordinates and second two-dimensional coordinates) of the microsphere in the two-dimensional space.
[0041] Specifically, a coordinate acquisition interface can be displayed so that the user can input the initial two-dimensional center coordinates of the diffraction ring on the coordinate acquisition interface, and then obtain the initial two-dimensional center coordinates of the diffraction ring of the current optical image input by the user.
[0042] For example, multiple optical images include S1, S2, and S3, where the shooting time of S1 is t1, the shooting time of S2 is t2, and the shooting time of S3 is t3, where t1 < t2 < t3. The first time is t1, and the second time is t3. The optical image S1, corresponding to the smallest shooting time among the multiple optical images, is determined as the current optical image. The initial two-dimensional center coordinates of the diffraction ring of the current optical image are obtained, and the pixels of the current optical image corresponding to the initial two-dimensional center coordinates of the diffraction ring are enlarged to obtain multiple enlarged pixels. The current optical image is segmented using the multiple enlarged pixels as the segmentation origin, resulting in multiple segmented optical images corresponding to the multiple enlarged pixels. Based on the multiple segmented optical images corresponding to the multiple enlarged pixels, the target two-dimensional center coordinates (l1, m1) of the diffraction ring of the current optical image are determined.
[0043] Then, when the current optical image capture time t1 is equal to the first time t1, the two-dimensional center coordinates of the target diffraction ring are determined as the first two-dimensional coordinates of the microsphere at the first time. The two-dimensional center coordinates of the target diffraction ring in the current optical image are determined as the initial two-dimensional center coordinates of the diffraction ring of the optical image S2 corresponding to the next capture time of the current optical image. The optical image corresponding to the next capture time of the current optical image is determined as the current optical image S2, and the initial two-dimensional center coordinates of the diffraction ring of the current optical image S2 are obtained. The process of determining the two-dimensional center coordinates of the target diffraction ring of the current optical image S2 is the same as that of the optical image S1, and will not be repeated here.
[0044] When the current optical image capture time t2 is greater than the first time t1 and less than the second time t3, the two-dimensional center coordinates (l2, m2) of the target diffraction ring in optical image S2 are determined as the initial two-dimensional center coordinates of the diffraction ring in optical image S3 corresponding to the next capture time of the current optical image. The optical image corresponding to the next capture time of the current optical image is determined as the current optical image S3, and the initial two-dimensional center coordinates of the diffraction ring in the current optical image S3 are obtained. The process of determining the two-dimensional center coordinates (l3, m3) of the target diffraction ring in the current optical image S3 is the same as that of optical image S1, and will not be repeated. When the current optical image capture time t3 is equal to the second time t3, the first two-dimensional coordinates (l1, m1) of the microsphere at the first time and the second two-dimensional coordinates (l3, m3) of the microsphere at the second time are obtained, and step 103 is executed.
[0045] Step 103: Determine the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and optical image information.
[0046] The first three-dimensional coordinate can be understood as the three-dimensional spatial coordinate of the microsphere at the first moment.
[0047] By dividing an optical image with a certain point as the dividing origin, the optical curve of the optical image can be obtained. If the dividing origin is the center point of the optical image, that is, the dividing origin is the center point of the diffraction ring, then under ideal conditions, the ordinate corresponding to the lowest point of the optical curve of the optical image is the vertical coordinate in the three-dimensional space of the microsphere, the abscissa in the two-dimensional center coordinate of the target diffraction ring of the optical image is the abscissa in the three-dimensional space of the microsphere, and the ordinate in the two-dimensional center coordinate of the target diffraction ring of the optical image is the ordinate in the three-dimensional space of the microsphere. Therefore, in one optional implementation, the abscissa in the first two-dimensional coordinate system can be determined as the first three-dimensional abscissa of the microsphere at the first time; the ordinate in the first two-dimensional coordinate system can be determined as the first three-dimensional ordinate of the microsphere at the first time; the optical image corresponding to the same shooting time as the first time can be segmented with the first two-dimensional coordinate system as the origin to obtain the light curve of the optical image corresponding to the first time; the ordinate of the lowest point in the light curve of the optical image corresponding to the first time can be determined as the first three-dimensional ordinate of the microsphere at the first time; and the three-dimensional coordinate system composed of the first three-dimensional abscissa, the first three-dimensional ordinate, and the first three-dimensional ordinate can be determined as the first three-dimensional coordinate of the microsphere at the first time.
[0048] For example, the optical image corresponding to the first time t1 is S1, and the two-dimensional center coordinates of the target diffraction ring in the optical image S1 are (l1, m1). The abscissa in the first two-dimensional coordinate is determined as the first three-dimensional abscissa (l1) of the microsphere at the first time; the ordinate in the first two-dimensional coordinate is determined as the first three-dimensional ordinate (m1) of the microsphere at the first time; the optical image corresponding to the same shooting time as the first time is divided with the first two-dimensional coordinate as the dividing origin to obtain the light curve of the optical image corresponding to the first time; the ordinate (n1) of the lowest point in the light curve of the optical image corresponding to the first time is determined as the first three-dimensional ordinate of the microsphere at the first time; the three-dimensional coordinate (l1, m1, n1) composed of the first three-dimensional abscissa, the first three-dimensional ordinate, and the first three-dimensional ordinate is determined as the first three-dimensional coordinate of the microsphere at the first time.
[0049] Step 104: Determine the second three-dimensional coordinates of the microsphere at the second time based on the second two-dimensional coordinates and optical image information.
[0050] The second three-dimensional coordinate can be understood as the three-dimensional spatial coordinate of the microsphere at the second time.
[0051] In one optional implementation, the abscissa in the second two-dimensional coordinate system can be determined as the second three-dimensional abscissa of the microsphere at the second time; the ordinate in the second two-dimensional coordinate system can be determined as the second three-dimensional ordinate of the microsphere at the second time; the optical image corresponding to the same shooting time as the second time can be segmented with the second two-dimensional coordinate system as the origin to obtain the light curve of the optical image corresponding to the second time; the ordinate of the lowest point in the light curve of the optical image corresponding to the second time can be determined as the second three-dimensional ordinate of the microsphere at the second time; and the three-dimensional coordinate system composed of the second three-dimensional abscissa, the second three-dimensional ordinate, and the second three-dimensional ordinate can be determined as the second three-dimensional coordinate of the microsphere at the second time.
[0052] For example, the optical image corresponding to the second time t3 is S3, and the two-dimensional center coordinates of the target diffraction ring in the optical image S3 are (l3, m3). The abscissa in the second two-dimensional coordinate is determined as the second three-dimensional abscissa (l3) of the microsphere at the second time; the ordinate in the second two-dimensional coordinate is determined as the second three-dimensional ordinate (m3) of the microsphere at the second time; the optical image corresponding to the same shooting time as the second time is divided with the second two-dimensional coordinate as the dividing origin to obtain the light curve of the optical image corresponding to the second time; the ordinate (n3) of the lowest point in the light curve of the optical image corresponding to the second time is determined as the second three-dimensional ordinate of the microsphere at the second time; the three-dimensional coordinate (l3, m3, n3) composed of the second three-dimensional abscissa, the second three-dimensional ordinate, and the second three-dimensional ordinate is determined as the second three-dimensional coordinate of the microsphere at the second time.
[0053] Step 105: Determine the target three-dimensional displacement of the cell from the first time point to the second time point based on the first three-dimensional coordinates and the second three-dimensional coordinates.
[0054] The target three-dimensional displacement can be understood as the distance the cell moves in three-dimensional space from the first time to the second time.
[0055] Since the cell engulfs the microspheres, the three-dimensional spatial coordinates of the microspheres are the same as the three-dimensional spatial coordinates of the cell, and the distance the microspheres travel in three-dimensional space is the same as the distance the cell travels in three-dimensional space. Therefore, in one optional embodiment, the first three-dimensional coordinates can be determined as the first target three-dimensional coordinates of the cell at a first time, and the second three-dimensional coordinates can be determined as the second target three-dimensional coordinates of the cell at a second time. Then, the first and second target three-dimensional coordinates are substituted into the displacement calculation formula to obtain the target three-dimensional displacement of the cell from the first time to the second time. The displacement calculation formula is as follows:
[0056]
[0057] Where D represents the three-dimensional displacement of the microsphere from the first time to the second time, x1 represents the abscissa of the first target in the three-dimensional coordinate system, y1 represents the ordinate of the first target in the three-dimensional coordinate system, z1 represents the ordinate of the first target in the three-dimensional coordinate system, x2 represents the abscissa of the second target in the three-dimensional coordinate system, y2 represents the ordinate of the second target in the three-dimensional coordinate system, and z2 represents the ordinate of the second target in the three-dimensional coordinate system.
[0058] For example, the first three-dimensional coordinates are (l1, m1, n1), and the second three-dimensional coordinates are (l3, m3, n3). The first three-dimensional coordinates are determined as the cell's first target three-dimensional coordinates (l1, m1, n1) at the first time step, and the second three-dimensional coordinates are determined as the cell's second target three-dimensional coordinates (l3, m3, n3) at the second time step. Then, substituting the first and second target three-dimensional coordinates into the displacement calculation formula, the target three-dimensional displacement of the cell from the first time step to the second time step is obtained as follows:
[0059]
[0060] In this embodiment of the invention, an imaging device is used to photograph cells to obtain optical image information of microspheres phagocytosed by the cells. Since the cells have phagocytosed the microspheres, the microspheres can effectively track and reproduce the movement changes of the cells. Therefore, the position of the microspheres is the position of the cells. Thus, based on the optical image information of the microspheres, the first two-dimensional coordinates of the microspheres at the first time and the second two-dimensional coordinates of the microspheres at the second time can be determined. Since the coordinates of the lowest point of the light curve obtained by dividing the optical image with the center coordinates of the optical image of the microspheres as the origin have a certain correlation with the three-dimensional coordinates of the microspheres in three-dimensional space, the first three-dimensional coordinates of the microspheres at the first time can be determined based on the first two-dimensional coordinates and the optical image information. Based on the second two-dimensional coordinates and the optical image information, the third three-dimensional coordinates of the microspheres at the second time can be determined. Two-dimensional and three-dimensional coordinates enable the determination of the three-dimensional coordinates of a cell based on two-dimensional optical image information. The cell's movement position is no longer limited to two-dimensional or one-dimensional space, but is elevated to three-dimensional space. Thus, based on the cell's first and second three-dimensional coordinates, the target three-dimensional displacement of the cell from the first time to the second time can be determined. Through the target three-dimensional displacement of the cell from the first time to the second time, the changes in the cell's movement position in three-dimensional space when stimulated by external stimuli are more realistically reflected. In turn, through the changes in the cell's movement position in three-dimensional space, the response of the cell to external stimuli in three-dimensional space is more realistically reflected, increasing the realism of the cell's response to external stimuli as reflected by the changes in the cell's movement position.
[0061] In some embodiments, the cells are cells, and the microspheres are coated with a layer of mucin. During the process of co-culturing with the cells in a static environment, the microspheres are autonomously phagocytosed into the cells, and the cells can maintain a certain level of activity. In this way, the microspheres can be subject to the dual constraints of the cytoskeleton and cell membrane of the active cells, allowing for good tracking and reproduction of cell movement changes. Therefore, the three-dimensional spatial coordinates of the microspheres can be determined as the three-dimensional spatial coordinates of the cells. By determining the changes in the three-dimensional spatial position of the cells through the three-dimensional spatial coordinates, the changes in the three-dimensional spatial position of the cells can be accurately reflected, thereby increasing the realism of the cell's response to external stimuli as reflected by the changes in the cell's spatial position.
[0062] The following further illustrates the three-dimensional displacement determination method provided by the embodiments of the present invention, such as... Figure 3 As shown, Figure 3 This is another flowchart illustrating the three-dimensional displacement determination method provided in this embodiment of the invention, which may specifically include the following steps:
[0063] Step 201: Use an imaging device to capture optical images of the microspheres phagocytosed by the cells.
[0064] Step 202: Obtain the first and second time.
[0065] In one alternative implementation, a time acquisition interface can be displayed so that the user can input a first time and a second time on the time acquisition interface, and then obtain the first time and the second time.
[0066] Step 203: Determine the optical image with the shortest shooting time among the multiple optical images as the current optical image.
[0067] Step 204: Obtain the initial two-dimensional center coordinates of the diffraction ring of the current optical image, and expand the pixels of the current optical image corresponding to the initial two-dimensional center coordinates of the diffraction ring to obtain multiple expanded pixels.
[0068] Step 205: Divide the current optical image using multiple enlarged pixels as the dividing origin, and obtain multiple optical segmented images corresponding to multiple enlarged pixels.
[0069] In one optional implementation, the current optical image can be divided into a preset number of optical segmentation images along 360°, using the expanded pixel as the segmentation origin. The preset number is a positive integer, such as 8. A larger preset number results in more equally divided optical segmentation images, leading to higher accuracy in determining the two-dimensional center coordinates of the target diffraction ring in the current optical image based on multiple optical segmentation images. The number of optical segmentation images is the same as the preset number.
[0070] Step 206: Determine the two-dimensional center coordinates of the target diffraction ring in the current optical image based on multiple optical segmentation images corresponding to multiple enlarged pixel points.
[0071] If the origin of the optical image segmentation is the point where the two-dimensional center coordinates of the target diffraction ring in the optical image are located, then the light curves of each optical segmentation image coincide. Ideally, the multiple ordinates corresponding to the same abscissa of the light curves of multiple optical segmentation images are the same, and the variance of the multiple ordinates corresponding to the same abscissa of the light curves of multiple optical segmentation images is zero. Therefore, when the variance of the multiple ordinates corresponding to the same abscissa of the light curves of multiple optical segmentation images is zero, the origin of the optical image segmentation corresponding to the multiple optical segmentation images is the center point of the optical image, which is also the center point of the diffraction ring generated by the microsphere. However, since noise in the image cannot be avoided, the two-dimensional coordinates of the origin of the optical image segmentation corresponding to the smallest ordinate variance can be determined as the two-dimensional center coordinates of the target diffraction ring in the optical image. Therefore, in one optional implementation, optical curves from multiple optically segmented images can be acquired. Each optical curve includes the ordinates of multiple points, with the same abscissa for each ordinate. Based on the ordinates of these multiple points, the variance of the ordinates of the multiple optically segmented images corresponding to multiple enlarged pixel points is determined. Based on the variance of the ordinates of the multiple optically segmented images corresponding to the multiple enlarged pixel points, the two-dimensional center coordinates of the target diffraction ring in the current optical image are determined. Here, the optical curve can be understood as a curve formed by each point in the optical image and the light intensity corresponding to each point. The ordinates of the multiple points can be understood as the ordinates of the two-dimensional space of each point on the optical curve. The abscissas of the multiple points can be understood as the abscissas of the two-dimensional space of each point on the optical curve. The variance of the ordinates of the optically segmented images can be understood as the variance of multiple ordinates corresponding to the same abscissa in the optical curves of multiple optically segmented images.
[0072] Specifically, the mean ordinate of the multiple optical segmentation images corresponding to each enlarged pixel can be determined based on the ordinates of multiple points. The variance of the ordinates of the multiple optical segmentation images corresponding to each enlarged pixel can be determined based on the mean ordinate and the ordinates of multiple points on the light curves of the multiple optical segmentation images corresponding to each enlarged pixel. The optical segmentation image corresponding to the smallest ordinate variance is then determined as the target optical segmentation image. The two-dimensional coordinates of the segmentation origin corresponding to the target optical segmentation image are then determined as the two-dimensional center coordinates of the target diffraction ring in the current optical image.
[0073] Furthermore, the mean of the ordinates of multiple optically segmented images, and the multiple ordinates corresponding to the same abscissa in the light curves of multiple optically segmented images, can be substituted into the formula for calculating the ordinate variance to obtain the ordinate variance of multiple optically segmented images. The formula for calculating the ordinate variance is:
[0074]
[0075] Where D represents the variance of the ordinate of the light curve of the segmented image, Y represents the mean of the ordinate of the segmented image, and y i The vertical coordinates of points on each light curve are represented by N, where N represents the number of vertical coordinates.
[0076] For example, the current optical image is S1. Expanding the pixels of the current optical image corresponding to the two-dimensional center coordinates of the initial diffraction ring yields 5 expanded pixels. The current optical image is then segmented using these 5 expanded pixels as the origin, resulting in multiple segmented optical images corresponding to each expanded pixel. The number of segmented optical images corresponding to each expanded pixel is 3. The multiple segmented optical images corresponding to the first expanded pixel include: F1, F2, and F3. The light curve for F1 is R1, the light curve for F2 is R2, and the light curve for F3 is R3. Light curve R1 includes point A, with coordinates (l1, ak1); light curve R2 includes point B, with coordinates (l1, bk1); and light curve R3 includes point C, with coordinates (l1, ck1). Here, l1 is the x-coordinate of points A, B, and C; ak1 is the y-coordinate of point A; bk1 is the y-coordinate of point B; and ck1 is the y-coordinate of point C. Determine the mean ordinate of the segmented image F1 as Y = (ak1 + bk1 + ck1) / 3. Substitute the mean ordinate of F1 and the multiple ordinates corresponding to the same abscissa of multiple segmented images into the formula for calculating the ordinate variance, and calculate the ordinate variance of F1. This yields the ordinate variance D1 of the multiple optical segmented images corresponding to the first enlarged pixel. The process for determining the ordinate variance of the multiple optical segmented images corresponding to the remaining four enlarged pixels is the same and will not be repeated here. In this case, assuming that among the 5 sets of optical segmentation images corresponding to the 5 enlarged pixels, the smallest ordinate variance is the ordinate variance D3 of the multiple optical segmentation images obtained by segmenting with the third enlarged pixel as the segmentation origin, then the segmentation origin of the optical segmentation image corresponding to the smallest ordinate variance D3, i.e., the two-dimensional coordinates (l1, k1) of the third enlarged pixel, can be determined as the center point of the current optical image, and the two-dimensional coordinates (l1, k1) of the center point of the current optical image can be determined as the target two-dimensional center coordinates (l1, k1) of the current optical image (S1).
[0077] Step 207: Determine whether the current optical image capture time is equal to the first time. If yes, proceed to step 208; otherwise, proceed to step 211.
[0078] Step 208: Determine the two-dimensional center coordinates of the target diffraction ring as the first two-dimensional coordinates of the microsphere at the first time.
[0079] Step 209: Determine the two-dimensional center coordinates of the target diffraction ring of the current optical image as the initial two-dimensional center coordinates of the diffraction ring of the optical image corresponding to the next shooting time of the current optical image.
[0080] Step 210: Determine the optical image corresponding to the next shooting time after the current optical image shooting time as the current optical image.
[0081] After executing step 210, return to execute step 204.
[0082] Step 211: Determine whether the current optical image capture time is greater than the first time and less than the second time. If yes, return to step 209; otherwise, proceed to step 212.
[0083] Step 212: Determine whether the current optical image capture time is equal to the second time. If yes, proceed to step 213; otherwise, return to step 201.
[0084] Step 213: Determine the two-dimensional center coordinates of the target diffraction ring as the second two-dimensional coordinates of the microsphere at the second time.
[0085] Step 214: Determine the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and optical image information.
[0086] Step 215: Determine the second three-dimensional coordinates of the microsphere at the second time based on the second two-dimensional coordinates and optical image information.
[0087] Step 216: Determine the target three-dimensional displacement of the cell based on the first three-dimensional coordinates and the second three-dimensional coordinates.
[0088] In this embodiment of the invention, an imaging device is used to photograph cells to obtain optical image information of microspheres phagocytosed by the cells. Since the cells have phagocytosed the microspheres, the microspheres can effectively track and reproduce the movement changes of the cells. Therefore, the position of the microspheres is the position of the cells. Thus, based on the optical image information of the microspheres, the first two-dimensional coordinates of the microspheres at the first time and the second two-dimensional coordinates of the microspheres at the second time can be determined. Since the coordinates of the lowest point of the light curve obtained by dividing the optical image with the center coordinates of the optical image of the microspheres as the origin have a certain correlation with the three-dimensional coordinates of the microspheres in three-dimensional space, the first three-dimensional coordinates of the microspheres at the first time can be determined based on the first two-dimensional coordinates and the optical image information. Based on the second two-dimensional coordinates and the optical image information, the third three-dimensional coordinates of the microspheres at the second time can be determined. Two-dimensional and three-dimensional coordinates enable the determination of the three-dimensional coordinates of a cell based on two-dimensional optical image information. The cell's movement position is no longer limited to two-dimensional or one-dimensional space, but is elevated to three-dimensional space. Thus, based on the cell's first and second three-dimensional coordinates, the target three-dimensional displacement of the cell from the first time to the second time can be determined. Through the target three-dimensional displacement of the cell from the first time to the second time, the changes in the cell's movement position in three-dimensional space when stimulated by external stimuli are more realistically reflected. In turn, through the changes in the cell's movement position in three-dimensional space, the response of the cell to external stimuli in three-dimensional space is more realistically reflected, increasing the realism of the cell's response to external stimuli as reflected by the changes in the cell's movement position.
[0089] Figure 4 This is a schematic diagram of a three-dimensional displacement determination device provided in an embodiment of the present invention. This device is suitable for executing the three-dimensional displacement determination method provided in an embodiment of the present invention. Figure 4 As shown, the device may specifically include:
[0090] The object imaging module 301 is used to capture optical image information of the microspheres phagocytosed by the cells using an imaging device;
[0091] The first determining module 302 is used to acquire a first time and a second time, and determine the first two-dimensional coordinates of the microsphere at the first time and the second two-dimensional coordinates of the microsphere at the second time based on the optical image information, the first time, and the second time.
[0092] The second determining module 303 is used to determine the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and the optical image information;
[0093] The third determining module 304 is used to determine the second three-dimensional coordinates of the microsphere at the second time based on the second two-dimensional coordinates and the optical image information;
[0094] The fourth determining module 305 is used to determine the target three-dimensional displacement of the cell from the first time to the second time based on the first three-dimensional coordinates and the second three-dimensional coordinates.
[0095] Optionally, the optical image information includes multiple optical images and the shooting time corresponding to each optical image. The first determining module 302 is specifically used for:
[0096] The optical image with the shortest shooting time among the multiple optical images is determined as the current optical image;
[0097] Obtain the initial two-dimensional center coordinates of the diffraction ring of the current optical image, and enlarge the pixels of the current optical image corresponding to the initial two-dimensional center coordinates of the diffraction ring to obtain multiple enlarged pixels;
[0098] The current optical image is segmented using the multiple enlarged pixels as the segmentation origin, resulting in multiple optical segmented images corresponding to the multiple enlarged pixels;
[0099] Based on the multiple optical segmentation images corresponding to the multiple enlarged pixels, determine the two-dimensional center coordinates of the target diffraction ring in the current optical image;
[0100] When the current optical image capture time is equal to the first time, the two-dimensional center coordinates of the target diffraction ring are determined as the first two-dimensional coordinates of the microsphere at the first time, triggering the execution of the step of determining the target two-dimensional center coordinates of the current optical image as the initial two-dimensional center coordinates of the diffraction ring of the optical image corresponding to the next capture time of the current optical image capture time;
[0101] When the current optical image capture time is equal to the second time, the two-dimensional center coordinates of the target diffraction ring are determined as the second two-dimensional coordinates of the microsphere at the second time, triggering the execution of the step of determining the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and the optical image corresponding to the first two-dimensional coordinates;
[0102] When the shooting time of the current optical image is greater than the first time and the shooting time of the current optical image is less than the second time, the two-dimensional center coordinates of the target diffraction ring of the current optical image are determined as the initial two-dimensional center coordinates of the diffraction ring of the optical image corresponding to the next shooting time of the current optical image.
[0103] The optical image corresponding to the next shooting time after the current optical image is captured is determined as the current optical image. The process of obtaining the initial two-dimensional center coordinates of the diffraction ring of the current optical image and expanding the pixels of the current optical image corresponding to the initial two-dimensional center coordinates of the diffraction ring to obtain multiple expanded pixels is then triggered.
[0104] Optionally, the first determining module 302 determines the two-dimensional center coordinates of the target diffraction ring in the current optical image based on multiple optical segmentation images corresponding to the multiple enlarged pixels, including:
[0105] Obtain the optical curves of the multiple optically segmented images, wherein the optical curves include the ordinates of multiple points, and the abscissas of each ordinate are the same;
[0106] Based on the ordinates of the multiple points, determine the variance of the ordinates of the multiple optically segmented images corresponding to the multiple enlarged pixel points;
[0107] Based on the variance of the ordinate of the multiple optical segmentation images corresponding to the multiple enlarged pixels, the two-dimensional center coordinates of the target diffraction ring of the current optical image are determined.
[0108] Optionally, the first determining module 302 determines the two-dimensional center coordinates of the target diffraction ring in the current optical image based on the variance of the ordinate coordinates of the multiple optical segmentation images corresponding to the multiple enlarged pixels, including:
[0109] The multiple optical segmentation images corresponding to the smallest ordinate variance are determined as the target optical segmentation image;
[0110] The two-dimensional coordinates of the origin of the segmentation corresponding to the target optical segmentation image are determined as the two-dimensional center coordinates of the target diffraction ring of the current optical image.
[0111] Optionally, the first determining module 302 determines the variance of the ordinate of the multiple optically segmented images corresponding to the multiple enlarged pixel points based on the ordinate of the multiple points, including:
[0112] Based on the ordinates of the multiple points, determine the average ordinate of the multiple optically segmented images corresponding to each enlarged pixel point;
[0113] Based on the mean of the ordinate and the ordinates of multiple points on the light curves of the multiple optical segmentation images corresponding to each enlarged pixel, the variance of the ordinate of the multiple optical segmentation images corresponding to each enlarged pixel is determined.
[0114] Optionally, the second determining module 303 is specifically used for:
[0115] The abscissa in the first two-dimensional coordinate system is determined as the first three-dimensional abscissa of the microsphere at the first time.
[0116] The ordinate in the first two-dimensional coordinate system is determined as the first three-dimensional ordinate of the microsphere at the first time.
[0117] Using the first two-dimensional coordinates as the origin of the segmentation, the optical image corresponding to the same shooting time as the first time is segmented to obtain the light curve of the optical image corresponding to the first time.
[0118] The ordinate of the lowest point in the light curve of the optical image corresponding to the first time is determined as the first three-dimensional ordinate of the microsphere at the first time.
[0119] The three-dimensional coordinates composed of the first three-dimensional horizontal coordinate, the first three-dimensional vertical coordinate, and the first three-dimensional vertical coordinate are determined as the first three-dimensional coordinates of the microsphere at the first time.
[0120] Optionally, the third determining module 304 is specifically used for:
[0121] The abscissa in the second two-dimensional coordinate system is determined as the second three-dimensional abscissa of the microsphere at the second time.
[0122] The ordinate in the second two-dimensional coordinate system is determined as the second three-dimensional ordinate of the microsphere at the second time.
[0123] Using the second two-dimensional coordinates as the origin of the segmentation, the optical image corresponding to the same shooting time as the second time is segmented to obtain the light curve of the optical image corresponding to the second time.
[0124] The vertical coordinate of the lowest point in the light curve of the optical image corresponding to the second time is determined as the second three-dimensional vertical coordinate of the microsphere at the second time.
[0125] The three-dimensional coordinates composed of the second three-dimensional horizontal coordinate, the second three-dimensional vertical coordinate, and the second three-dimensional vertical coordinate are determined as the second three-dimensional coordinates of the microsphere at the second time.
[0126] Optionally, the fourth determining module 305 is specifically used for:
[0127] The first three-dimensional coordinates are determined as the first target three-dimensional coordinates of the cell at the first time, and the second three-dimensional coordinates are determined as the second target three-dimensional coordinates of the cell at the second time;
[0128] Substituting the three-dimensional coordinates of the first target and the three-dimensional coordinates of the second target into the displacement calculation formula, the target three-dimensional displacement of the cell from the first time to the second time is obtained. The displacement calculation formula is as follows:
[0129]
[0130] Wherein, D represents the three-dimensional displacement of the microsphere from the first time to the second time, x1 represents the abscissa of the first target in the three-dimensional coordinate system, y1 represents the ordinate of the first target in the three-dimensional coordinate system, z1 represents the ordinate of the first target in the three-dimensional coordinate system, x2 represents the abscissa of the second target in the three-dimensional coordinate system, y2 represents the ordinate of the second target in the three-dimensional coordinate system, and z2 represents the ordinate of the second target in the three-dimensional coordinate system.
[0131] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional modules is merely an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the functional modules described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0132] The three-dimensional displacement determination device provided in this embodiment of the invention can use an imaging device to photograph cells and obtain optical image information of microspheres phagocytosed by the cells. Since the cells have phagocytosed the microspheres, the microspheres can effectively track and reproduce the movement changes of the cells, so the position of the microspheres is the position of the cells. Therefore, the first two-dimensional coordinates of the microspheres at a first time and the second two-dimensional coordinates of the microspheres at a second time can be determined based on the optical image information of the microspheres. Since the coordinates of the lowest point of the light curve obtained by dividing the optical image with the center coordinates of the optical image of the microspheres as the origin have a certain correlation with the three-dimensional coordinates of the microspheres in three-dimensional space, the first three-dimensional coordinates of the microspheres at a first time can be determined based on the first two-dimensional coordinates and the optical image information; the second two-dimensional coordinates of the microspheres at a second time can be determined based on the second two-dimensional coordinates and the optical image information. The second three-dimensional coordinates at the second time point enable the determination of the three-dimensional coordinates of the cell in three-dimensional space based on two-dimensional optical image information. The cell's movement position is no longer limited to two-dimensional or one-dimensional space, but is elevated to three-dimensional space. Thus, based on the cell's first and second three-dimensional coordinates, the target three-dimensional displacement of the cell from the first time point to the second time point can be determined. Through the target three-dimensional displacement of the cell from the first time point to the second time point, the change in the cell's movement position in three-dimensional space when stimulated by external stimuli is more realistically reflected. Furthermore, through the change in the cell's movement position in three-dimensional space, the response of the cell in three-dimensional space to external stimuli is more realistically reflected, increasing the realism of the cell's response to external stimuli as reflected by the change in the cell's movement position.
[0133] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention.
[0134] Please refer to Figure 5An electronic device 50 is provided, comprising:
[0135] Processor 51; and,
[0136] Memory 52 is used to store the executable instructions of the processor;
[0137] The processor 51 is configured to execute the methods described above by executing the executable instructions.
[0138] The processor 51 can communicate with the memory 52 via the bus 53.
[0139] This invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the methods described above.
[0140] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.
[0141] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for determining three-dimensional displacement, characterized in that, The method includes: Optical image information of the microspheres engulfed by the cells is obtained by using an imaging device; Acquire a first time and a second time, and determine the first two-dimensional coordinates of the microsphere at the first time and the second two-dimensional coordinates of the microsphere at the second time based on the optical image information, the first time, and the second time; Based on the first two-dimensional coordinates and the optical image information, the first three-dimensional coordinates of the microsphere at the first time point are determined; The second three-dimensional coordinates of the microsphere at the second time are determined based on the second two-dimensional coordinates and the optical image information; Based on the first three-dimensional coordinates and the second three-dimensional coordinates, the target three-dimensional displacement of the cell from the first time to the second time is determined.
2. The method according to claim 1, characterized in that, The optical image information includes multiple optical images and the corresponding shooting time for each optical image. Determining the first two-dimensional coordinates of the microsphere at the first time and the second two-dimensional coordinates of the microsphere at the second time based on the optical image information, the first time, and the second time includes: The optical image with the shortest shooting time among the multiple optical images is determined as the current optical image; Obtain the initial two-dimensional center coordinates of the diffraction ring of the current optical image, and enlarge the pixels of the current optical image corresponding to the initial two-dimensional center coordinates of the diffraction ring to obtain multiple enlarged pixels; The current optical image is segmented using the multiple enlarged pixels as the segmentation origin, resulting in multiple optical segmented images corresponding to the multiple enlarged pixels; Based on the multiple optical segmentation images corresponding to the multiple enlarged pixels, determine the two-dimensional center coordinates of the target diffraction ring in the current optical image; When the current optical image capture time is equal to the first time, the two-dimensional center coordinates of the target diffraction ring are determined as the first two-dimensional coordinates of the microsphere at the first time, triggering the execution of the step of determining the target two-dimensional center coordinates of the current optical image as the initial two-dimensional center coordinates of the diffraction ring of the optical image corresponding to the next capture time of the current optical image capture time; When the current optical image capture time is equal to the second time, the two-dimensional center coordinates of the target diffraction ring are determined as the second two-dimensional coordinates of the microsphere at the second time, triggering the execution of the step of determining the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and the optical image corresponding to the first two-dimensional coordinates; When the shooting time of the current optical image is greater than the first time and the shooting time of the current optical image is less than the second time, the two-dimensional center coordinates of the target diffraction ring of the current optical image are determined as the initial two-dimensional center coordinates of the diffraction ring of the optical image corresponding to the next shooting time of the current optical image. The optical image corresponding to the next shooting time after the current optical image is captured is determined as the current optical image. The process of obtaining the initial two-dimensional center coordinates of the diffraction ring of the current optical image and expanding the pixels of the current optical image corresponding to the initial two-dimensional center coordinates of the diffraction ring to obtain multiple expanded pixels is then triggered.
3. The method according to claim 2, characterized in that, The step of determining the two-dimensional center coordinates of the target diffraction ring in the current optical image based on multiple optical segmentation images corresponding to the multiple enlarged pixels includes: Obtain the optical curves of the multiple optically segmented images, wherein the optical curves include the ordinates of multiple points, and the abscissas of each ordinate are the same; Based on the ordinates of the multiple points, determine the variance of the ordinates of the multiple optically segmented images corresponding to the multiple enlarged pixel points; Based on the variance of the ordinate of the multiple optical segmentation images corresponding to the multiple enlarged pixels, the two-dimensional center coordinates of the target diffraction ring of the current optical image are determined.
4. The method according to claim 3, characterized in that, Determining the two-dimensional center coordinates of the target diffraction ring in the current optical image based on the variance of the ordinate coordinates of the multiple optically segmented images corresponding to the multiple enlarged pixels includes: The multiple optical segmentation images corresponding to the smallest ordinate variance are determined as the target optical segmentation image; The two-dimensional coordinates of the origin of the segmentation corresponding to the target optical segmentation image are determined as the two-dimensional center coordinates of the target diffraction ring of the current optical image.
5. The method according to claim 3, characterized in that, The step of determining the variance of the ordinates of multiple optically segmented images corresponding to multiple enlarged pixel points based on the ordinates of the multiple points includes: Based on the ordinates of the multiple points, determine the average ordinate of the multiple optically segmented images corresponding to each enlarged pixel point; Based on the mean of the ordinate and the ordinates of multiple points on the light curves of the multiple optical segmentation images corresponding to each enlarged pixel, the variance of the ordinate of the multiple optical segmentation images corresponding to each enlarged pixel is determined.
6. The method according to claim 2, characterized in that, Determining the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and the optical image information includes: The abscissa in the first two-dimensional coordinate system is determined as the first three-dimensional abscissa of the microsphere at the first time. The ordinate in the first two-dimensional coordinate system is determined as the first three-dimensional ordinate of the microsphere at the first time. Using the first two-dimensional coordinates as the origin of the segmentation, the optical image corresponding to the same shooting time as the first time is segmented to obtain the light curve of the optical image corresponding to the first time. The ordinate of the lowest point in the light curve of the optical image corresponding to the first time is determined as the first three-dimensional ordinate of the microsphere at the first time. The three-dimensional coordinates composed of the first three-dimensional horizontal coordinate, the first three-dimensional vertical coordinate, and the first three-dimensional vertical coordinate are determined as the first three-dimensional coordinates of the microsphere at the first time.
7. The method according to claim 2, characterized in that, Determining the second three-dimensional coordinates of the microsphere at the second time based on the second two-dimensional coordinates and the optical image information includes: The abscissa in the second two-dimensional coordinate system is determined as the second three-dimensional abscissa of the microsphere at the second time. The ordinate in the second two-dimensional coordinate system is determined as the second three-dimensional ordinate of the microsphere at the second time. Using the second two-dimensional coordinates as the origin of the segmentation, the optical image corresponding to the same shooting time as the second time is segmented to obtain the light curve of the optical image corresponding to the second time. The vertical coordinate of the lowest point in the light curve of the optical image corresponding to the second time is determined as the second three-dimensional vertical coordinate of the microsphere at the second time. The three-dimensional coordinates composed of the second three-dimensional horizontal coordinate, the second three-dimensional vertical coordinate, and the second three-dimensional vertical coordinate are determined as the second three-dimensional coordinates of the microsphere at the second time.
8. The method according to claim 1, characterized in that, Determining the target three-dimensional displacement of the cell from the first time point to the second time point based on the first three-dimensional coordinates and the second three-dimensional coordinates includes: The first three-dimensional coordinates are determined as the first target three-dimensional coordinates of the cell at the first time, and the second three-dimensional coordinates are determined as the second target three-dimensional coordinates of the cell at the second time; Substituting the three-dimensional coordinates of the first target and the three-dimensional coordinates of the second target into the displacement calculation formula, the target three-dimensional displacement of the cell from the first time to the second time is obtained. The displacement calculation formula is as follows: Wherein, D represents the three-dimensional displacement of the microsphere from the first time to the second time, x1 represents the abscissa of the first target in the three-dimensional coordinate system, y1 represents the ordinate of the first target in the three-dimensional coordinate system, z1 represents the ordinate of the first target in the three-dimensional coordinate system, x2 represents the abscissa of the second target in the three-dimensional coordinate system, y2 represents the ordinate of the second target in the three-dimensional coordinate system, and z2 represents the ordinate of the second target in the three-dimensional coordinate system.
9. A three-dimensional displacement determining device, characterized in that, The device includes: An object imaging module is used to capture optical image information of microspheres phagocytosed by the cells using an imaging device; The first determining module is used to acquire a first time and a second time, and determine the first two-dimensional coordinates of the microsphere at the first time and the second two-dimensional coordinates of the microsphere at the second time based on the optical image information, the first time, and the second time. The second determining module is used to determine the first three-dimensional coordinates of the microsphere at the first time based on the first two-dimensional coordinates and the optical image information; The third determining module is used to determine the second three-dimensional coordinates of the microsphere at the second time based on the second two-dimensional coordinates and the optical image information; The fourth determining module is used to determine the target three-dimensional displacement of the cell from the first time to the second time based on the first three-dimensional coordinates and the second three-dimensional coordinates.
10. An electronic device, characterized in that, Including processor and memory, The memory is used to store code and related data; The processor is configured to execute code in the memory to implement the three-dimensional displacement determination method according to any one of claims 1 to 8.
11. A storage medium having a computer program stored thereon, which, when executed by a processor, implements the three-dimensional displacement determination method according to any one of claims 1 to 8.