Information processing method and related device

By placing markers in the lungs and using CT technology to obtain coordinates and determining the reference coordinates in combination with the change of breathing amplitude, the problems of low accuracy and long time due to breathing during puncture are solved, and higher accuracy and shorter Puncture time.

CN115399839BActive Publication Date: 2025-02-18SHENZHEN WEIDE PRECISION MEDICAL TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111599307.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-24
Publication Date
2025-02-18
Estimated Expiration
2041-12-24

AI Technical Summary

Technical Problem

When performing lung puncture, the patient's breathing leads to low accuracy and long puncture time due to the patient's breathing.

Method used

By placing at least two markers in the lungs, CT images are collected using a computed tomography (CT) instrument, the coordinates of the markers are obtained, and the reference coordinates are determined based on the changes in the breathing amplitude are output, and prompt information is output to assist the puncture tool to improve accuracy and reduce accuracy Puncture time.

Benefits of technology

It improves the accuracy of the puncture, saves the time of the puncture, and reduces the error caused by breathing actions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115399839B_ABST
    Figure CN115399839B_ABST
Patent Text Reader

Abstract

This application provides an information processing method and related apparatus. The method includes: using the first coordinate of each of at least two markers at a first moment as a first reference coordinate; the first reference coordinate corresponds to the marker, and the first moment is any moment when a user acquires a lung CT image using a computed tomography (CT) scanner in a first state; obtaining the second coordinate of each of the at least two markers at a second moment; the first moment is earlier than the second moment, and the user corresponds to a second state at the second moment; and outputting a first prompt message when the relationship between the second coordinate of each of the at least two markers and the corresponding first reference coordinate satisfies a preset condition. The method provided by this application can assist puncture tools in puncture, thereby improving accuracy and saving puncture time.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of medical image-guided percutaneous puncture of the human body, and specifically to information processing methods and related devices. Background Art

[0002] A biopsy is a diagnostic technique that involves inserting a needle into a body cavity to extract secretions for testing, or injecting gas or contrast agents into the body cavity for imaging examination, or injecting drugs into the body cavity. A biopsy is a typical operation for lung lesions, where the disease is concentrated or the main site of a complex disease or infection.

[0003] At present, the method used clinically mainly relies on the doctor's experience. For example, first, the doctor sticks some auxiliary positioning markers on the human body based on experience to perform computed tomography (CT) to obtain a scanned image. Then, according to the distance and angle relationship between the marker on the scanned image and the lesion, the appropriate needle insertion point is determined on the skin. Then, after marking the puncture needle insertion position, the puncture needle is inserted into the human body through the skin according to the angle between the needle insertion point and the position of the lesion. A CT scan is required for each puncture position after each insertion distance, and the scanned image is used to determine whether the needle insertion angle and the needle insertion position can be aligned with the position of the lesion. If the needle insertion angle and the needle insertion position cannot align with the position of the lesion, the puncture needle needs to be pulled out and the needle insertion angle needs to be readjusted until the puncture needle is seen to have reached the position of the lesion from the scanned image.

[0004] However, the patient's breathing will cause the location of the lesion and the movement of important organs. When using the above method, the accuracy rate is low and the puncture takes a long time. Summary of the invention

[0005] The embodiment of the present application provides an information processing method and related devices, which can assist a puncture tool in puncturing, thereby improving the accuracy and saving the time spent on puncturing.

[0006] In a first aspect, an embodiment of the present application provides an information processing method, including:

[0007] The first coordinate of each marker of at least two markers at the first moment is used as the first reference coordinate; the first reference coordinate corresponds to the marker, the first moment is any moment when the user uses a computed tomography (CT) scanner to collect a lung CT image in the first state, and the first coordinates corresponding to the first moments are related to the breathing amplitude of the user at the first moments;

[0008] Acquire a second coordinate of each of the at least two markers at a second moment; the first moment is earlier than the second moment, and the user corresponds to a second state at the second moment, and a plurality of the second coordinates corresponding to the plurality of the second moments are related to the breathing amplitude of the user at the plurality of the second moments;

[0009] When the relationship between the second coordinate of each of the at least two markers and the corresponding first reference coordinate meets a preset condition, the first prompt information is output.

[0010] In a possible implementation manner, before taking the first coordinate of each marker of the at least two markers at the first moment as the first reference coordinate, the method further comprises:

[0011] Acquire third coordinates corresponding to the first marker at multiple third moments; the third moment belongs to a moment when the user performs CT, and the first marker is one of the at least two markers;

[0012] Determine a first breathing curve according to the third coordinates corresponding to the first marker at the plurality of third moments; the abscissa of the first breathing curve is used to represent the plurality of third moments, and the ordinate of the first breathing curve is used to represent the breathing amplitude of the user at the plurality of third moments;

[0013] The method uses the first coordinate of each marker of at least two markers at the first moment as the first reference coordinate, comprising:

[0014] Determine a first time period according to the first breathing curve; if the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to a first threshold, and if the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to the first threshold, the user is in the first state;

[0015] The third coordinate of each of the at least two markers at any time within the first time period is used as the first reference coordinate.

[0016] In a possible implementation, determining the first respiratory curve according to the third coordinates corresponding to the first marker at the plurality of third moments includes:

[0017] Using a third coordinate corresponding to any one of the plurality of third moments as a second reference coordinate;

[0018] respectively calculating the displacement between the third coordinates corresponding to other moments among the plurality of third moments and the second reference coordinates, the displacement corresponding to the third moment;

[0019] According to the sequence of the plurality of third moments, the displacement is plotted into a first curve;

[0020] A curve obtained by normalizing the first curve is used as the first breathing curve.

[0021] In a possible implementation, the outputting the first prompt information includes:

[0022] Acquire a fourth coordinate of the first device; the fourth coordinate is a coordinate of the first structure of the first device, and a coordinate system adopted by the fourth coordinate is the same as a coordinate system adopted by the marker;

[0023] When the distance between the fourth coordinate and the third reference coordinate is less than or equal to the second threshold, the first prompt information is output, and the third reference coordinate is determined according to the lung CT image acquired by the user in the first state.

[0024] In a possible implementation manner, before outputting the first prompt information, the method further includes:

[0025] Acquire a first model; the first model is obtained by modeling the lung CT image acquired by the user in the first state using an image segmentation algorithm; the first model is used to reconstruct the internal organs of the user and the position of the first target;

[0026] The coordinates corresponding to the first position in the first model are used as the third reference coordinates; the first position is determined according to the internal organs of the user and the position of the first target, and the first model and the marker use the same coordinate system.

[0027] In a possible implementation, the method further includes:

[0028] Acquire a first angle of the first device;

[0029] When the first angle points to the position of the first target, the second prompt information is output.

[0030] In a second aspect, an embodiment of the present application provides an information processing device, including:

[0031] a determining unit, configured to use a first coordinate of each marker of at least two markers at a first moment as a first reference coordinate; the first reference coordinate corresponds to the marker, the first moment is any moment when the user acquires a lung CT image using a computed tomography (CT) scanner in a first state, and a plurality of first coordinates corresponding to a plurality of the first moments are related to the breathing amplitude of the user at the plurality of the first moments;

[0032] an acquisition unit, configured to acquire a second coordinate of each of the at least two markers at a second moment; the first moment is earlier than the second moment, and the user corresponds to a second state at the second moment, and a plurality of the second coordinates corresponding to the plurality of the second moments are related to the breathing amplitude of the user at the plurality of the second moments;

[0033] The output unit is used to output the first prompt information when the relationship between the second coordinate of each marker of the at least two markers and the corresponding first reference coordinate meets the preset condition.

[0034] In a possible implementation, the acquisition unit is further used to acquire third coordinates corresponding to the first marker at multiple third moments; the third moment belongs to a moment when the user performs CT, and the first marker is one of the at least two markers;

[0035] The determination unit is further used to determine a first breathing curve according to the third coordinates corresponding to the first marker at the multiple third moments; the abscissa of the first breathing curve is used to represent the multiple third moments, and the ordinate of the first breathing curve is used to represent the breathing amplitude of the user at the multiple third moments;

[0036] The determining unit is specifically configured to determine a first time period according to the first breathing curve; when the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to a first threshold, and when the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to the first threshold, the user is in the first state;

[0037] The determination unit is specifically configured to use the third coordinate of each of the at least two markers at any time within the first time period as the first reference coordinate.

[0038] In a possible implementation manner, the determining unit is specifically configured to use a third coordinate corresponding to any one of the plurality of third moments as a second reference coordinate;

[0039] The device also includes a calculation unit for respectively calculating the displacement between the third coordinates corresponding to other moments among the plurality of third moments and the second reference coordinates, the displacement corresponding to the third moment;

[0040] The device also includes a drawing unit, which is used to draw the displacement into a first curve according to the sequence of the plurality of third moments;

[0041] The determining unit is specifically configured to obtain a curve by normalizing the first curve as the first breathing curve.

[0042] In a possible implementation manner, the acquisition unit is further used to acquire a fourth coordinate of the first device; the fourth coordinate is a coordinate of the first structure of the first device, and a coordinate system adopted by the fourth coordinate is the same as a coordinate system adopted by the marker;

[0043] The output unit is specifically used to output first prompt information when the distance between the fourth coordinate and the third reference coordinate is less than or equal to a second threshold, and the third reference coordinate is determined according to the lung CT image acquired by the user in the first state.

[0044] In a possible implementation, the acquisition unit is further used to acquire a first model; the first model is obtained by modeling the lung CT image acquired by the user in the first state using an image segmentation algorithm; the first model is used to reconstruct the internal organs of the user and the position of the first target;

[0045] The determination unit is specifically used to use the coordinates corresponding to the first position in the first model as the third reference coordinates; the first position is determined according to the position of the user's internal organs and the first target, and the first model and the marker use the same coordinate system.

[0046] In a possible implementation manner, the acquisition unit is further used to acquire a first angle of the first device;

[0047] The output unit is further configured to output second prompt information when the first angle points to the position of the first target.

[0048] In a third aspect, an embodiment of the present application discloses an electronic device, comprising: a processor and a memory, wherein the memory stores a computer program, and the processor calls the computer program stored in the memory to execute a method as in the first aspect or any possible implementation of the first aspect.

[0049] In a fourth aspect, the present application also provides another electronic device, comprising: a processor, a sending device, an input device, an output device and a memory, wherein the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device executes the method in the first aspect or any possible implementation manner of the first aspect.

[0050] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on one or more processors, the method in the first aspect or any possible implementation of the first aspect is executed.

[0051] In a sixth aspect, an embodiment of the present application provides a computer program product, which includes program instructions, and when the program instructions are executed by a processor, the processor executes a method as in the first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background technology, the following is a brief introduction to the drawings required for use in the embodiments of the present application or the background technology.

[0053] Figure 1 It is a flowchart of an information processing method provided by an embodiment of the present application;

[0054] Figure 2 is a schematic diagram of a scenario for determining the coordinates of a marker provided in an embodiment of the present application;

[0055] Figure 3 is a schematic diagram of a breathing curve provided in an embodiment of the present application;

[0056] Figure 4 is a schematic diagram of a puncture needle provided in an embodiment of the present application;

[0057] Figure 5 It is a flow chart of a method for determining respiratory gating reference data provided by an embodiment of the present application;

[0058] Figure 6 It is a flowchart of another information processing method provided by an embodiment of the present application;

[0059] Figure 7 is a structural diagram of an information processing device provided in an embodiment of the present application;

[0060] Figure 8 It is a structural diagram of another information processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear contrary indication in its context. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items. The terms "first" and "second" etc. in the specification, claims and drawings of the present application are used to distinguish different objects, rather than to describe a specific order.

[0062] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the above claims.

[0063] Lung disease is a common disease in daily life. The lesion, that is, the location where the disease is concentrated or the main location of the syndrome or infection, is often located inside or near the lungs, requiring doctors to insert a puncture needle into the user's body to extract secretions for testing, or inject drugs into the body for treatment.

[0064] At present, the method used clinically mainly relies on the doctor's experience. For example, first, the doctor sticks some auxiliary positioning markers on the human body based on experience to perform CT and obtain a scanned image. Then, according to the distance and angle relationship between the marker on the scanned image and the lesion, the appropriate needle insertion point is determined on the skin. Then, after marking the puncture needle insertion position, the puncture needle is inserted into the human body through the skin according to the angle between the needle insertion point and the position of the lesion. A CT scan is required for each insertion distance of the puncture position, and the scanned image is used to determine whether the needle insertion angle and the needle insertion position can be aligned with the position of the lesion. If the needle insertion angle and the needle insertion position cannot align with the position of the lesion, the puncture needle needs to be pulled out and the needle insertion angle needs to be readjusted until the puncture needle reaches the position of the lesion as seen from the scanned image.

[0065] However, the lungs are one of the organs necessary for human breathing. The ups and downs of breathing can cause the location of the lesion and the movement of internal organs of the body. When using the above method, the accuracy is low and the puncture takes a long time.

[0066] Based on the above problems, the embodiments of the present application provide an information processing method and related devices. Through some embodiments of the present application, the puncture tool can be assisted in puncture to improve the accuracy and save the time spent on puncture. It can be understood that the information processing method provided in the embodiments of the present application can be executed by an information processing device, wherein the information processing device can be any electronic device that can execute the technical solution disclosed in the embodiments of the method of the present application. Exemplarily, the information processing device can be a computer, a tablet computer, a desktop computer, etc.

[0067] It should be understood that the method embodiments provided in the present application can also be implemented by a processor executing a computer program code. The embodiments of the present application are described below in conjunction with the accompanying drawings in the embodiments of the present application. Figure 1 , Figure 1 is a flowchart of an information processing method provided by an embodiment of the present application, such as Figure 1 As shown, the method includes:

[0068] 101: The first coordinate of each marker of at least two markers at a first moment is used as a first reference coordinate; the first reference coordinate corresponds to the marker, the first moment is any moment when the user uses a computed tomography (CT) scanner to collect a lung CT image in a first state, and the first coordinates corresponding to the first moments are related to the breathing amplitude of the user at the first moments.

[0069] In the embodiment of the present application, the marker may be referred to as an optical marker ball, or a reflective marker, or a reflective marker point (mark point), etc. The marker is arranged on the target object, and the coordinates of the marker can be obtained by means of an electronic device. It is understood that the coordinates can be referred to as spatial coordinates, or three-dimensional coordinates.

[0070] For example, in one implementation, the marker is connected to a power source to actively emit light, and then the spatial position, i.e., the coordinates, of the marker can be obtained by an optical camera. In another implementation, a reflective material can be applied to the surface of the marker, and the reflective material can reflect infrared light. When the infrared light reflected by the marker is received by a sensor matrix on multiple lenses, the coordinates of the marker can be obtained.

[0071] In the embodiment of the present application, the number of markers is at least two, and the markers are arranged on the user's body surface, such as the lungs. For ease of understanding, please refer to Figure 2 , Figure 2 This is a schematic diagram of a scene for determining the coordinates of a marker provided in an embodiment of the present application.

[0072] like Figure 2 As shown, part 201 is the user, and part 202 is a marker attached to the lung surface of the user 201. Figure 2 12 markers are shown as an example. Part 203 is an optical marker tracking system, which can scan the markers to determine the three-dimensional coordinate data of the markers. For example, the optical marker tracking system 203 can use its own scanning port as the coordinate origin to determine the three-dimensional coordinate data of each scanned marker.

[0073] In the embodiment of the present application, the first moment is any moment when the user uses a computerized tomography (CT) device to collect a lung CT image in the first state. It can be understood that the CT device is a device that uses the intensity difference after the rays pass through different tissues to obtain a CT image. When performing CT, the user will hold his breath for a period of time in order to obtain a clear CT image. The first state can be understood as the state of the user holding his breath. In addition, since holding the breath is not instantaneous but continuous, and the user has almost no breathing amplitude during the breath holding period, it can be considered that the state of the user in the first state is the same. Therefore, the first moment can be understood as any moment when the user is in the first state.

[0074] In the embodiment of the present application, the information processing device uses the first coordinate of each marker at the first moment as the first reference coordinate, and the first reference coordinate corresponds to the marker. It can be understood that the coordinates of different markers at the first moment are used as the first reference coordinates, so any first reference coordinate is associated with the marker whose first reference coordinate is collected at the first moment, that is, the first reference coordinate corresponds to the marker.

[0075] Taking at least two markers as three markers as an example, the three markers are marker A, marker B and marker C. At the first moment, the coordinates of marker A are [A1, A2, A3], the coordinates of marker B are [B1, B2, B3] and the coordinates of marker C are [C1, C2, C3]. Therefore, the coordinates [A1, A2, A3], [B1, B2, B3] and [C1, C2, C3] are all first reference coordinates, and the first reference coordinates [A1, A2, A3] correspond to marker A, the first reference coordinates [B1, B2, B3] correspond to marker B, and the first reference coordinates [C1, C2, C3] correspond to marker C.

[0076] In the embodiment of the present application, the multiple first coordinates corresponding to the multiple first moments are related to the breathing amplitude of the user at the multiple first moments. It is understandable that the user's breathing is carried out over time, and the user has different breathing amplitudes at different moments, and different breathing amplitudes will cause the coordinates of the marker to change. In addition, even if the user is in the first state, the coordinates of the marker may change slightly. Therefore, the multiple first coordinates corresponding to the multiple first moments can reflect the breathing amplitude of the user at the multiple first moments.

[0077] 102: Obtain a second coordinate of each of the at least two markers at a second moment; the first moment is earlier than the second moment, and the user corresponds to a second state at the second moment, and a plurality of second coordinates corresponding to a plurality of the second moments are related to the breathing amplitude of the user at the plurality of the second moments.

[0078] In the embodiment of the present application, the second moment is a moment after the first moment. Since the first moment can be understood as any moment when the user is in the first state, the first state can be understood as a state in which the user is holding his breath, and the second moment can be understood as any moment in a free breathing state after the user ends holding his breath, the second state can be understood as a state in which the user is breathing freely.

[0079] In the embodiment of the present application, similar to step 101, the plurality of second coordinates corresponding to the plurality of second moments are related to the breathing amplitude of the user at the plurality of second moments. It is understandable that, in a free breathing state, the user's breathing is carried out over time, and the user has different breathing amplitudes at different moments, and different breathing amplitudes will cause the coordinates of the marker to change. Therefore, the plurality of second coordinates corresponding to the plurality of second moments can reflect the breathing amplitude of the user at the plurality of second moments.

[0080] 103: When the relationship between the second coordinate of each marker of the at least two markers and the corresponding first reference coordinate meets a preset condition, output first prompt information.

[0081] It can be understood that each first reference coordinate corresponds to a marker in step 101, and each marker corresponds to a second coordinate in step 102. Therefore, for any marker, the first reference coordinate of the marker can be determined from step 101, and the second coordinate at the second moment can be determined from step 102.

[0082] In an implementation method for determining whether the relationship between the second coordinate of each marker and the corresponding first reference coordinate meets a preset condition, an information processing device can calculate the distance between the second coordinate corresponding to each marker and the first reference coordinate corresponding to the marker, and determine that the preset condition is met when the distance between the second coordinate corresponding to each marker and the first reference coordinate corresponding to the marker is less than a first threshold.

[0083] It can be understood that the first threshold value can be determined according to actual conditions. For example, the first threshold value can be 1 cm, 0.5 cm, etc., and this application does not limit this.

[0084] In another implementation method of determining whether the relationship between the second coordinate of each marker and the corresponding first reference coordinate satisfies a preset condition, the information processing device may calculate the distance between the second coordinate corresponding to each marker and the first reference coordinate corresponding to the marker, and determine that the preset condition is met when the distances between the second coordinates corresponding to markers exceeding a first ratio among at least two markers and the first reference coordinates corresponding to the marker are both less than a first threshold.

[0085] It can be understood that the first ratio can be determined according to actual conditions. For example, the first ratio can be 85%, 90%, etc., and the present application does not limit this.

[0086] In the embodiment of the present application, the method of outputting the first prompt information is not limited. For example, the information processing device can output a prompt sound in the form of voice; it can also display the prompt information on the display screen in the form of an image; it can also be used as a prompt by controlling the vibration of other electronic devices. For example, the prompt information can be used to prompt the user that the state meets the preset conditions and the puncture operation can be performed.

[0087] In summary, in the embodiment of the present application, the first coordinate of each marker of at least two markers at the first moment is used as the first reference coordinate; the first reference coordinate corresponds to the marker, and the first moment is any moment when the user uses a CT device to collect a lung CT image in the first state. Since the multiple first coordinates corresponding to the multiple first moments are related to the breathing amplitude of the user at the multiple first moments, that is, the coordinates of the marker at the multiple first moments are used to reflect the breathing amplitude of the user at the multiple first moments, the above-mentioned use of the first coordinate of each marker at the first moment as the first reference coordinate can be understood as taking the breathing amplitude of the user at the first moment as a reference.

[0088] Obtain the second coordinates of each of the at least two markers at a second moment; the first moment is earlier than the second moment, and the user corresponds to the second state at the second moment. Since the multiple second coordinates corresponding to the multiple second moments are related to the breathing amplitude of the user at the multiple second moments, that is, the coordinates of the marker at the multiple second moments are used to reflect the breathing amplitude of the user at the multiple second moments, the above-mentioned acquisition of the second coordinates of each of the at least two markers at the second moment can be understood as determining the breathing amplitude of the user in the second state.

[0089] When the relationship between the second coordinate of each marker and the first reference coordinate of the marker in the first state meets the preset condition, that is, when the breathing amplitude of the user is close to the breathing amplitude corresponding to the first moment, the first prompt information is output. At this time, the state of the user is close to the breathing state at the first moment of acquiring the CT image, and outputting the first prompt information to assist puncture can reduce the error caused by breathing, thereby improving the accuracy.

[0090] In addition, compared with puncture based on experience, using a CT device to determine whether the user's current state is close to the state at the first moment, calculating the coordinates of the markers, and outputting prompt information when the preset conditions are met can save time spent on puncture.

[0091] In some embodiments, before taking the first coordinate of each marker of the at least two markers at the first moment as the first reference coordinate, the information processing method further includes:

[0092] Acquire third coordinates corresponding to the first marker at multiple third moments; the third moment belongs to a moment when the user performs CT, and the first marker is one of the at least two markers;

[0093] Determine a first breathing curve according to the third coordinates corresponding to the first marker at the plurality of third moments; the abscissa of the first breathing curve is used to represent the plurality of third moments, and the ordinate of the first breathing curve is used to represent the breathing amplitude of the user at the plurality of third moments;

[0094] The method of using the first coordinate of each marker of the at least two markers at the first moment as the first reference coordinate includes:

[0095] Determine a first time period according to the first breathing curve; if the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to a first threshold, and if the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to the first threshold, the user is in the first state;

[0096] The third coordinate of each of the at least two markers at any time within the first time period is used as the first reference coordinate.

[0097] In this embodiment, the first marker is one of the at least two markers, and the third moment belongs to the moment when the user is undergoing CT. It can be understood that it takes a period of time to obtain the CT image of the user through the CT apparatus, and the third moment is a moment within the period of time. A third coordinate is collected at each third moment, and it can be understood that each third moment corresponds to a third coordinate.

[0098] This embodiment does not limit the number of the third moments, that is, the information processing device collects 100, 200, or 500 third coordinates of the third moments according to actual conditions. It is understandable that, when the number of the third moments is small, the information processing device can collect the third coordinates when the user is in the first state as much as possible, so as to analyze the breathing changes of the user in the first state. In some embodiments, the information processing device can collect the third coordinates during the CT process of the user, so as to analyze the breathing changes of the user throughout the process.

[0099] In some embodiments, determining the first respiratory curve according to the third coordinates corresponding to the first marker at the plurality of third moments includes:

[0100] Using a third coordinate corresponding to any one of the plurality of third moments as a second reference coordinate;

[0101] respectively calculating the displacement between the third coordinates corresponding to other moments among the plurality of third moments and the second reference coordinates, the displacement corresponding to the third moment;

[0102] According to the sequence of the plurality of third moments, the displacement is plotted into a first curve;

[0103] A curve obtained by normalizing the first curve is used as the first breathing curve.

[0104] For easier understanding, see Figure 3 , Figure 3 is a schematic diagram of a breathing curve provided in an embodiment of the present application. Figure 3 As shown, Figure 3 The curve in can be understood as the first breathing curve, where the abscissa of the rectangular coordinate system represents time and the ordinate represents the breathing amplitude.

[0105] In a possible implementation, the information processing device can Figure 2 The coordinates of a marker in part 202 at any time are used as the second reference coordinates. Then, the displacement between the coordinates of the marker at other times and the second reference coordinates is calculated, so each displacement is associated with a third moment, that is, the displacement corresponds to the third moment. Finally, a curve is drawn according to the displacement size, and the curve can be normalized to be used as the first respiratory curve.

[0106] Optionally, the information processing device may use the marker that is more affected by the user's breathing among at least two markers as the first marker, so that the first breathing curve is clearer and more intuitive. Exemplarily, the information processing device may obtain the third coordinates corresponding to each marker at multiple third moments, calculate the first displacement corresponding to each marker, and the first displacement is the maximum displacement between the third coordinates of the first marker within multiple third moments. Finally, the information processing device uses the marker with the largest first displacement as the first marker.

[0107] It is understandable that the ups and downs of the lungs will cause the location of the lesion and the movement of the internal organs of the body. If the user breathes normally during CT, the image data obtained will often contain artifacts, which is not conducive to determining the exact location of the lesion. Therefore, the user will hold his breath for a period of time during CT. When holding his breath, the internal organs of the user are basically stable, and the image data obtained is clearer.

[0108] like Figure 3 As shown, time t a and time t bThe time period t1 between the two moments can be understood as the user being in the first state, that is, the time period when the user is holding his breath, or it can be understood as the above-mentioned first time period, in which the absolute value of the difference in breathing amplitude corresponding to any two moments in the first time period is less than or equal to the first threshold.

[0109] It is understandable that the first threshold value can be set according to actual conditions. Since the first curve is a normalized curve, illustratively, the first threshold value can be 0.1, or 0.15, or 0.2, etc., which is not limited in the present application.

[0110] It can be seen that the user's breathing amplitude remains basically unchanged during the time period t1, and the user's breathing amplitude during the breath-holding time period can be considered to be a fixed value. Therefore, the third coordinate of each of the at least two markers at any moment in the first time period can be used as the first reference coordinate.

[0111] In this embodiment, the user's breathing amplitude and breathing changes are determined by the coordinates of the markers attached to the user's lung surface at different times. This is more accurate and stable than determining the user's breathing amplitude through a breathing mask. Since the determined user's breathing state (or it can be understood as a breathing curve) is more accurate, the accuracy of puncture by the auxiliary puncture tool can be further improved.

[0112] In some further embodiments, the outputting of the first prompt information includes:

[0113] Acquire a fourth coordinate of the first device; the fourth coordinate is a coordinate of the first structure of the first device;

[0114] When the distance between the fourth coordinate and the third reference coordinate is less than or equal to the second threshold, the first prompt information is output, and the third reference coordinate is determined according to the lung CT image acquired by the user in the first state.

[0115] In this embodiment, the first device can be understood as a puncture needle or other puncture tools. It can be understood that the first device is often composed of multiple structures. Taking the puncture needle as an example, the puncture needle may include a handle and a needle. In this embodiment, the first structure can be understood as the structure that first contacts the user's body surface in actual operation, so that the puncture operation of the information processing device-assisted puncture tool is more accurate. For example, when the first device is a puncture needle, the first structure is the needle tip of the puncture needle.

[0116] In this embodiment, the information processing device determines the third reference coordinate according to the lung CT image acquired by the user in the first state. The third reference coordinate can be understood as the puncture point of the puncture tool.

[0117] Since the output of the first prompt information includes: outputting the first prompt information when the distance between the fourth coordinate and the third reference coordinate is less than or equal to the second threshold value, it can be understood that the first prompt information is output when the relationship between the second coordinate of each marker of the at least two markers and the corresponding first reference coordinate meets the preset condition and the distance between the fourth coordinate and the third reference coordinate is less than or equal to the second threshold value.

[0118] In this embodiment, in one implementation method, the information processing device can process the coordinates of the marker and the coordinates of the first device respectively at the same time, and then determine whether the relationship between the second coordinate of each marker of at least two markers and the corresponding first reference coordinate meets the preset conditions, and the distance between the fourth coordinate and the third reference coordinate is less than or equal to the second threshold value. When both conditions are met at the same time, the first prompt information is output.

[0119] In another implementation, the information processing device may first process the coordinates of the first device, and when the distance between the fourth coordinate and the third reference coordinate is less than or equal to the second threshold, further process the coordinates of the marker to determine whether the relationship between the second coordinate of each of at least two markers and the corresponding first reference coordinate meets a preset condition, and output a first prompt message when the relationship between the second coordinate of each of at least two markers and the corresponding first reference coordinate meets the preset condition.

[0120] It is understandable that the second threshold value can be set according to actual conditions. Since the second threshold value is the distance between the coordinates, for example, the first threshold value can be 1 cm, or 1.5 cm, etc., which is not limited in this application.

[0121] Through the above method, the information processing device can also assist the puncture tool in locating the third reference position, further improving the accuracy of the puncture performed by the auxiliary puncture tool.

[0122] In some embodiments, before outputting the first prompt information, the information processing method further includes:

[0123] Acquire a first model; the first model is obtained by modeling the lung CT image acquired by the user in the first state using an image segmentation algorithm; the first model is used to reconstruct the internal organs of the user and the position of the first target;

[0124] The coordinates corresponding to the first position in the first model are used as the third reference coordinates; the first position is determined according to the positions of the internal organs of the user and the first target.

[0125] In this embodiment, after the user completes the CT, the information processing device needs to obtain the three-dimensional reconstruction result of the CT image.

[0126] In one implementation, the information processing device may obtain the first model from other devices, such as a CT machine or other processing devices. In another implementation, the information processing device may obtain the lung CT image acquired by the user in the first state, and then use an image segmentation algorithm to perform three-dimensional reconstruction to obtain the first model.

[0127] In this embodiment, the first target may be a lesion tissue or other target that needs to be obtained by puncture operation, and this application does not limit this. After the information processing device obtains the first model, the first position on the user's body surface can be determined according to the reconstructed organ in the first model and the position of the first target. The first position can be used for the puncture operation of the first device, and then the coordinates corresponding to the first position are used as the third reference coordinates.

[0128] It can be understood that when the information processing device determines the first position according to the internal organs of the user and the position of the first target, in one implementation, the first position is the position on the user's body surface that is closest to the first target.

[0129] In another implementation, the distance between the first position and the first target is less than a first distance threshold, and the number of organs or tissues contacted by the path formed between the first position and the first target is less than a first quantity threshold. It can be understood that the first distance threshold and the first quantity threshold can be set according to actual conditions, and the present application does not limit this.

[0130] In another implementation, the information processing device may also receive a first instruction, which is used to indicate the first position. That is, when the user's internal condition is more complicated, for example, some tissues are fragile and not suitable for contact, the information processing device may determine the first position according to the first instruction. For example, the information processing device may include an input device, through which the information of the first position is received; or the information processing device may include a touchable display screen, which determines the first position in response to a touch or click operation.

[0131] In some further embodiments, the information processing method further includes:

[0132] Acquire a first angle of the first device;

[0133] When the first angle points to the position of the first target, the second prompt information is output.

[0134] In this embodiment, after the information processing device outputs the first prompt information, the first angle of the first device is also obtained. For ease of understanding, take the puncture needle as an example, please refer to Figure 4 , Figure 4 It is a schematic diagram of a puncture needle provided in an embodiment of the present application.

[0135] like Figure 4 As shown, part 401 is a puncture needle, which is connected to a bracket 402 , and four markers, namely marker 403 , marker 404 , marker 405 and marker 406 , are attached to the bracket 402 .

[0136] According to mathematical knowledge, two points can determine a straight line, and three points on different straight lines can determine a plane. The information processing device can select any three markers from the above four markers, obtain the planes they are located on through the three-dimensional coordinates of the three markers, and then determine the angle of the puncture needle 401.

[0137] In this embodiment, when the first angle points to the position of the first target, the second prompt information is output. The second prompt information can be used to prompt the propulsion direction of the first device. In the embodiment of the present application, the method of outputting the second prompt information is not limited. Exemplarily, the information processing device can output the prompt sound in the form of voice; or it can display the prompt information on the display screen in the form of an image.

[0138] In this embodiment, the information processing device further prompts the angle of the first device, further improving the accuracy of the auxiliary puncture tool for puncture and saving the time spent on puncture. In addition, because the information processing device assists in prompting the angle of the puncture tool during advancement, the number of medical image scans during the puncture process can be reduced.

[0139] To facilitate understanding of the information processing method provided in the embodiment of the present application, the following takes the marker as an optical marker ball and the first device as a puncture needle as an example. Figure 5 and Figure 6 The information processing method proposed in this application is explained.

[0140] For example, see Figure 5 , Figure 5 1 is a flow chart of a method for determining respiratory gating reference data provided by an embodiment of the present application. Figure 5 As shown, the method includes:

[0141] 501: Detecting connection with an optical marking system.

[0142] In this step, the information processing device detects the connection with the optical marking system so that the coordinates of the optical marking balls can be obtained through the optical marking system later. It can be understood that the optical marking balls are attached to the user's body surface, such as the lungs and chest. In addition, the number of optical marking balls is at least two.

[0143] 502: Detect the connection with the CT apparatus.

[0144] In this step, the information processing device detects the connection with the CT apparatus so as to obtain CT images and other data through the CT apparatus. It is understandable that before the CT apparatus starts working, the scanning bed where the user is located needs to be within the CT scanning window.

[0145] In the embodiment of the present application, the above steps 501 and 502 can be understood as the preparatory work before determining the respiratory gating reference data.

[0146] After step 501 and step 502, the information processing device executes step 5031: acquiring a CT image of the lungs.

[0147] In this step, the information processing device can obtain the user's lung CT image, that is, CT image data, through the CT machine. It is understandable that the ups and downs of the lungs will cause the location of the lesion and the movement of the internal organs of the body. If the user breathes normally during CT, the image data obtained will often contain artifacts, which is not conducive to determining the exact location of the lesion. Therefore, the user will hold his breath for a period of time when undergoing CT. When holding his breath, the internal organs of the user's body are basically stable, and the image data obtained is clearer.

[0148] It is understandable that the user can hold his breath after exhaling a breath, or after inhaling a breath, etc. In other words, the user can hold his breath at different breathing levels.

[0149] Therefore, in this step, the information processing device collecting the lung CT image can be understood as collecting the lung CT image when the user holds his breath.

[0150] 5041: Record the current acquisition time of the CT image.

[0151] In this step, the current acquisition time of the CT image can be understood as the time when the user holds his breath to acquire the CT image. It can be understood that since the user holds his breath for a period of time when performing CT (which can be called the breath-holding time period, such as Figure 3 The breathing amplitude of the user in the breath-holding time period remains basically unchanged, and it can be considered that the breathing amplitude of the user in the breath-holding time period is a fixed value. Therefore, in the embodiment of the present application, the current acquisition moment can be understood as any moment in the breath-holding time period.

[0152] On the other hand, the information processing device executes step 5032: detecting the spatial coordinate data of the optical marker ball in real time.

[0153] In this step, the information processing device detects the spatial coordinate data of each optical marker ball in real time, and the spatial coordinate data can also be called three-dimensional coordinate data.

[0154] 5042: Obtain the spatial coordinate data of the optical marker ball within a continuous time period.

[0155] In this step, the information processing device obtains the spatial coordinate data of the optical marker ball in a continuous time period. It is understandable that the continuous time period includes the breath-holding time period.

[0156] 505: Using the spatial coordinate data of the optical marker ball corresponding to the CT acquisition time as respiratory gating reference data.

[0157] In this step, the information processing device uses the optical marker coordinate data corresponding to the CT acquisition time as respiratory gating reference data.

[0158] For example, the information processing device can obtain the spatial coordinate data of the optical marker ball. Figure 3 The respiratory curve shown in FIG. 1 is a respiratory curve in which the horizontal axis of the respiratory curve is time and the vertical axis is the respiratory amplitude. a and time t b The time t1 between the two can be understood as the breath-holding time period, such as Figure 3 As shown, during time period t1, the user's breathing amplitude is almost 0.

[0159] In this step, the respiratory gating reference data can be understood as the spatial coordinate data of the optical marker ball at any time in the time period t1. In the embodiment of the present application, since the number of the optical marker ball is at least one. In a possible implementation, the information processing device uses the spatial coordinate data corresponding to any one of the at least one optical marker ball at the CT acquisition time as the respiratory gating reference data.

[0160] In another possible implementation, the information processing device uses the spatial coordinate data corresponding to each optical marker ball of at least one optical marker ball at the CT acquisition moment as the respiratory gating reference data.

[0161] 506: Determine the needle entry point and the target point according to the acquired CT image.

[0162] In this step, the information processing device can use an image segmentation algorithm to perform three-dimensional modeling on the above CT image to obtain a three-dimensional model. The three-dimensional model is used to display the location of the internal organs and lesions of the user's body. Then, according to the location of the internal organs and lesions of the body, the needle entry point and the puncture target point are determined on the three-dimensional model. The puncture target point can be understood as the location of the lesion, and the needle entry point can be understood as the location on the human body surface for inserting the puncture needle.

[0163] Exemplarily, the information processing device may mark the determined puncture needle entry point and puncture target point on the three-dimensional model.

[0164] It is understandable that in the embodiment of the present application, the execution order of step 505 and step 506 is not limited, and step 505 may be executed first, or step 506 may be executed first.

[0165] After determining the respiratory gating reference data in step 505 and determining the needle insertion point and the target point in step 506, the information processing device further performs the following steps. Figure 6 , Figure 6 FIG. 1 is a flow chart of another information processing method provided by an embodiment of the present application. Figure 6 As shown, the method includes:

[0166] 601: Confirm that the user's scanning bed exits the CT scanning window.

[0167] 602: Confirm to start the auxiliary puncture operation.

[0168] In the embodiment of the present application, the above steps 601 and 602 can be understood as the preparation work before puncture.

[0169] 603: Acquire the spatial coordinate data of the optical marker ball on the user in real time.

[0170] In this step, the information processing device obtains the spatial coordinate data of the optical marker ball on the user in real time. It is understandable that human breathing is continuous, and the user's breathing state, that is, the user's breathing amplitude, needs to be determined in real time through the spatial coordinate data of the optical marker.

[0171] 604: align and compare the spatial coordinate data of the optical marker ball collected in real time with the respiratory gating reference data.

[0172] In this step, the information processing device calculates the displacement between the spatial coordinate data of the optical marker ball at the current moment and the respiratory gating reference data, so as to determine whether the spatial coordinate data and the respiratory gating reference data are aligned.

[0173] According to step 505, in one implementation, when the spatial coordinate data corresponding to any optical marker ball at the time of CT acquisition is used as the respiratory gating reference data, the information processing device calculates the displacement between the spatial coordinate data of any optical marker ball at the current moment and the respiratory gating reference data, so as to determine whether the spatial coordinate data and the respiratory gating reference data are aligned.

[0174] In another implementation, when the spatial coordinate data corresponding to each optical marker ball at the time of CT acquisition is used as the respiratory gating reference data, the information processing device calculates the displacement between the spatial coordinate data of each optical marker ball at the current moment and the corresponding optical marker ball in the respiratory gating reference data, so as to determine whether the spatial coordinate data and the respiratory gating reference data are aligned.

[0175] 605: Determine whether the spatial coordinate data and the respiratory gating reference data are aligned.

[0176] In this step, the information processing device can determine whether the spatial coordinate data and the respiratory gating reference data are aligned through displacement.

[0177] Exemplarily, when the spatial coordinate data corresponding to any optical marker ball at the CT acquisition moment is used as the respiratory gating reference data, the information processing device determines whether the displacement between the spatial coordinate data corresponding to the CT acquisition moment and the respiratory gating reference data is less than a threshold.

[0178] Exemplarily, when the spatial coordinate data corresponding to each optical marker ball at the CT acquisition moment is used as the respiratory gating reference data, the information processing device determines whether the displacement between each spatial coordinate data corresponding to the CT acquisition moment and the corresponding spatial coordinate data in the respiratory gating reference data is less than a threshold.

[0179] If the judgment result of step 605 is negative, the information processing device executes step 606: prompting that it is unsafe and suspending the puncture.

[0180] In this step, the information processing device may prompt the operator (eg, doctor) to suspend the puncture by means of voice broadcast or image warning that it is unsafe.

[0181] If the result of the determination in step 605 is yes, that is, if it is determined that the breathing amplitude of the user meets the requirement, the information processing device executes step 607: determining the position of the puncture needle.

[0182] It is understandable that the puncture needle is connected to a bracket, and an optical marker ball is attached to the bracket, such as Figure 4As shown. The information processing device can determine the position of the puncture needle through the optical marker ball. Exemplarily, the position of the puncture needle can be the spatial coordinates of the puncture needle.

[0183] After step 607, the information processing device executes step 608: determining whether the puncture needle reaches the needle insertion point.

[0184] In this step, the information processing device can determine whether the puncture needle has reached the needle insertion point based on the displacement between the spatial coordinates of the puncture needle and the spatial coordinates of the needle insertion point. For example, if the displacement is less than a threshold, it is determined that the puncture needle has reached the needle insertion point; if the displacement is greater than the threshold, it is determined that the puncture needle has not reached the needle insertion point.

[0185] If the judgment result of step 608 is no, step 609 is executed: the position of the puncture needle is re-acquired.

[0186] After executing step 609 , the information processing device re-executes step 608 .

[0187] If the judgment result of step 608 is yes, step 610 is executed: determining the angle of the puncture needle.

[0188] In this step, if Figure 4 As shown, the information processing device can determine the angle of the puncture needle through the optical marking ball on the bracket.

[0189] 611: Determine whether the angle of the puncture needle is pointing to the target.

[0190] If the judgment result of step 611 is no, the information processing device re-executes steps 610 and 611.

[0191] If the judgment result of step 611 is yes, the information processing device executes step 612: prompting to perform puncture.

[0192] In this step, the information processing device may prompt the user to perform puncture by means of voice broadcast or image warning.

[0193] After the information processing device determines that the target puncture guidance is completed, another CT scan can be performed on the user who has completed the puncture. When the information processing device obtains the CT image data and the calculation accuracy of the CT image data meets the requirements, it is determined that the puncture sampling is completed.

[0194] The method of the embodiment of the present application is described in detail above, and the device of the embodiment of the present application is provided below.

[0195] See also Figure 7 , Figure 7is a schematic diagram of the structure of an information processing device provided in an embodiment of the present application. The information processing device 70 is used to execute the above-mentioned information processing method. It should be understood that any device that can implement the information processing method provided in this application belongs to the protection scope of this application. Exemplarily, the information processing device 70 can be a mobile phone, a desktop computer, a portable notebook, etc., and this embodiment of the present application does not limit it. Figure 7 As shown, the information processing device 70 includes a determination unit 701, an acquisition unit 702, and an output unit 703. The description of each unit is as follows:

[0196] The determining unit 701 is configured to use a first coordinate of each marker of at least two markers at a first moment as a first reference coordinate; the first reference coordinate corresponds to the marker, the first moment is any moment when the user uses a computed tomography (CT) scanner to acquire a lung CT image in a first state, and the first coordinates corresponding to the first moments are related to the breathing amplitude of the user at the first moments;

[0197] an acquisition unit 702, configured to acquire a second coordinate of each of the at least two markers at a second moment; the first moment is earlier than the second moment, and the user corresponds to a second state at the second moment, and a plurality of the second coordinates corresponding to the plurality of the second moments are related to the breathing amplitude of the user at the plurality of the second moments;

[0198] The output unit 703 is used to output first prompt information when the relationship between the second coordinate of each marker of the at least two markers and the corresponding first reference coordinate meets a preset condition.

[0199] In a possible implementation, the acquisition unit 702 is further configured to acquire third coordinates corresponding to the first marker at multiple third moments; the third moment belongs to a moment when the user performs CT, and the first marker is one of the at least two markers;

[0200] The determining unit 701 is further configured to determine a first breathing curve according to the third coordinates corresponding to the first marker at the plurality of third moments; the abscissa of the first breathing curve is used to represent the plurality of third moments, and the ordinate of the first breathing curve is used to represent the breathing amplitude of the user at the plurality of third moments;

[0201] The determining unit 701 is specifically configured to determine a first time period according to the first breathing curve; when the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to a first threshold, and when the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to the first threshold, the user is in the first state;

[0202] The determination unit 701 is specifically configured to use the third coordinate of each of the at least two markers at any time within the first time period as the first reference coordinate.

[0203] In a possible implementation, the determining unit 701 is specifically configured to use a third coordinate corresponding to any one of the plurality of third moments as a second reference coordinate;

[0204] The device further includes a calculation unit 704, which is used to respectively calculate the displacement between the third coordinates corresponding to other moments in the plurality of third moments and the second reference coordinates, the displacement corresponding to the third moment;

[0205] The device further includes a drawing unit 705, which is used to draw the displacement into a first curve according to the sequence of the plurality of third moments;

[0206] The determining unit 701 is specifically configured to perform normalization processing on the first curve and obtain a curve as the first breathing curve.

[0207] In a possible implementation, the acquisition unit 702 is further configured to acquire a fourth coordinate of the first device; the fourth coordinate is a coordinate of the first structure of the first device, and a coordinate system used by the fourth coordinate is the same as a coordinate system used by the marker;

[0208] The output unit 703 is specifically used to output a first prompt message when the distance between the fourth coordinate and the third reference coordinate is less than or equal to a second threshold, and the third reference coordinate is determined according to the lung CT image acquired by the user in the first state.

[0209] In a possible implementation, the acquisition unit 702 is further used to acquire a first model; the first model is obtained by modeling the lung CT image acquired by the user in the first state using an image segmentation algorithm; the first model is used to reconstruct the internal organs of the user and the position of the first target;

[0210] The determination unit 701 is specifically configured to use the coordinates corresponding to the first position in the first model as the third reference coordinates; the first position is determined according to the position of the user's internal organs and the first target, and the first model and the marker use the same coordinate system.

[0211] In a possible implementation manner, the acquiring unit 702 is further configured to acquire a first angle of the first device;

[0212] The output unit 703 is further configured to output second prompt information when the first angle points to the position of the first target.

[0213] See also Figure 8 , Figure 880 is a schematic diagram of the structure of another information processing device provided in an embodiment of the present application. The information processing device 80 can be used to implement the above information processing method. Exemplarily, the information processing device 80 can be a mobile phone, a desktop computer, a portable notebook or other devices.

[0214] like Figure 8 As shown. The information processing device 80 includes at least one processor 802, a transceiver 801 for communicating with other devices / devices through a transmission medium, and an output module 805 for outputting prompt information. The processor 802 can use the transceiver 801 to send and receive data and / or signaling, and can also control the output module 805 to output prompt information, so as to implement the method in the above method embodiment. Exemplarily, the output module 805 can be a display screen, or a speaker, etc., wherein the display screen can be used to display pictures or videos, etc., and the speaker can output prompt sounds, etc. through vibration.

[0215] Optionally, the information processing device 80 may further include at least one memory 803 for storing program instructions and / or data. The memory 803 is coupled to the processor 802. The coupling in the embodiment of the present application is an indirect coupling or communication connection between devices, units or modules, which may be electrical, mechanical or other forms, and is used for information exchange between devices, units or modules. The processor 802 may operate in coordination with the memory 803. The processor 802 may execute program instructions stored in the memory 803. At least one of the at least one memory may be included in the processor.

[0216] The specific connection medium between the transceiver 801, the processor 802, the memory 803 and the output module 805 is not limited in the embodiment of the present application. Figure 8 In the embodiment, the memory 803, the processor 802, the transceiver 801 and the output module 805 are connected via a bus 804. Figure 8 The connection between other components is only for illustration and is not intended to be limiting. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0217] In the embodiments of the present application, the processor may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0218] It can be understood that when the information processing device 80 is the above-mentioned information processing device 70, the action performed by the determination unit 701 can be performed by the processor 802, the action performed by the acquisition unit 702 can be performed by the transceiver 801, and the action performed by the output unit 703 can be performed by the output module 805.

[0219] The present application also provides a computer-readable storage medium, in which computer codes are stored. When the computer codes are executed on a computer, the computer executes the method of the above embodiment.

[0220] The present application also provides a computer program product, which includes a computer code or a computer program. When the computer code or the computer program runs on a computer, the method in the above embodiment is executed.

[0221] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the above claims.

Claims

1. An information processing method, characterized in that: The method comprises: Acquire third coordinates corresponding to a first marker of at least two markers at a plurality of third moments; the third moments belong to moments during a CT process of the user; Determine a first breathing curve according to the third coordinates corresponding to the first marker at the plurality of third moments; the abscissa of the first breathing curve is used to represent the plurality of third moments, and the ordinate of the first breathing curve is used to represent the breathing amplitude of the user at the plurality of third moments; The first coordinate of each marker of at least two markers at the first moment is used as a first reference coordinate; the first reference coordinate corresponds to the marker, the first moment is any moment when the user uses a computed tomography (CT) scanner to acquire a lung CT image in the first state, and the first coordinates corresponding to the first moments are related to the breathing amplitude of the user at the first moments; Acquire a second coordinate of each marker of the at least two markers at a second moment; the first moment is earlier than the second moment, and the user corresponds to a second state at the second moment, and a plurality of the second coordinates corresponding to a plurality of the second moments are related to the breathing amplitude of the user at the plurality of the second moments; When the relationship between the second coordinate of each marker of the at least two markers and the corresponding first reference coordinate meets a preset condition, outputting first prompt information; The method of using the first coordinate of each marker of at least two markers at the first moment as the first reference coordinate comprises: determining a first time period according to the first breathing curve; when an absolute value of a difference between breathing amplitudes corresponding to any two moments in the first time period is less than or equal to a first threshold, and when an absolute value of a difference between breathing amplitudes corresponding to any two moments in the first time period is less than or equal to the first threshold, the user is in the first state; The third coordinate of each of the at least two markers at any time within the first time period is used as the first reference coordinate.

2. The method according to claim 1, characterized in that: The determining of the first respiratory curve according to the third coordinates corresponding to the first marker at the plurality of third moments comprises: Using a third coordinate corresponding to any one of the plurality of third moments as a second reference coordinate; respectively calculating the displacement between the third coordinates corresponding to other moments among the plurality of third moments and the second reference coordinates, the displacement corresponding to the third moment; According to the sequence of the plurality of third moments, plotting the displacement into a first curve; A curve obtained by normalizing the first curve is used as the first breathing curve.

3. The method according to claim 1 or 2, characterized in that: The outputting of the first prompt information includes: Acquire a fourth coordinate of the first device; the fourth coordinate is a coordinate of the first structure of the first device; When the distance between the fourth coordinate and the third reference coordinate is less than or equal to the second threshold, a first prompt information is output, and the third reference coordinate is determined according to the lung CT image acquired by the user in the first state.

4. The method according to claim 3, characterized in that: Before outputting the first prompt information, the method further includes: Acquire a first model; the first model is obtained by modeling the lung CT image acquired by the user in the first state using an image segmentation algorithm; the first model is used to reconstruct the internal organs of the user and the position of the first target; The coordinates corresponding to the first position in the first model are used as the third reference coordinates; the first position is determined according to the positions of the internal organs of the user and the first target.

5. The method according to claim 4, characterized in that The method further comprises: Acquire a first angle of the first device; When the first angle points to the position of the first target, second prompt information is output.

6. An information processing device, characterized in that: The device comprises: An acquisition unit, used for acquiring third coordinates corresponding to a first marker of at least two markers at a plurality of third moments; the third moments are moments during a CT process of the user; a determining unit, configured to determine a first breathing curve according to third coordinates corresponding to the first marker at the plurality of third moments; the abscissa of the first breathing curve is used to represent the plurality of third moments, and the ordinate of the first breathing curve is used to represent the breathing amplitude of the user at the plurality of third moments; The determination unit is further configured to use a first coordinate of each marker of at least two markers at a first moment as a first reference coordinate; the first reference coordinate corresponds to the marker, the first moment is any moment when the user acquires a lung CT image using a computed tomography (CT) scanner in the first state, and the plurality of first coordinates corresponding to the plurality of first moments are related to the breathing amplitude of the user at the plurality of first moments; The acquisition unit is further used to acquire a second coordinate of each marker of the at least two markers at a second moment; the first moment is earlier than the second moment, and the user corresponds to a second state at the second moment, and a plurality of second coordinates corresponding to a plurality of second moments are related to the breathing amplitude of the user at the plurality of second moments; An output unit, configured to output first prompt information if a relationship between the second coordinate of each of the at least two markers and the corresponding first reference coordinate meets a preset condition; The determining unit is specifically configured to determine a first time period according to the first breathing curve; when the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to a first threshold, and when the absolute value of the difference between the breathing amplitudes corresponding to any two moments in the first time period is less than or equal to the first threshold, the user is in the first state; The determining unit is specifically configured to use the third coordinate of each of the at least two markers at any time within the first time period as the first reference coordinate.

7. An electronic device, characterized in that: include: A processor and a memory, wherein the memory stores a computer program, and the processor calls the computer program stored in the memory to execute the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program runs on one or more processors, the method according to any one of claims 1 to 5 is executed.

Citation Information

Patent Citations

  • Puncture operation navigation and locating system and method

    CN106859742A

  • Respiration monitoring device based on RGBD camera and respiration monitoring method of device

    CN110269624A