Nursing Interaction Processing Method and System Based on Digital Twin Model

Abstract

The present invention provides a nursing interaction processing method and system based on a digital twin model, belonging to the field of data processing technology. Specifically, it includes binding the patient and the visit position identifier in the twin model, recording the initial position of the drug flow rate and the flow regulator, and calculating the infusion time in combination with the drug volume; determining the type of the patient's hand movement, and determining the flow rate change trend according to the type of hand movement, where the type of hand movement includes an increased flow input type and a decreased flow input type; updating the drug flow rate according to the flow rate change trend, and recalculating the infusion time according to the updated drug flow rate and the current drug volume; when the type of the patient's hand movement is not recognized, obtaining the current position of the flow regulator according to the mobile device, and recalculating the infusion time according to the drug flow rate corresponding to the current position, and sending a reminder message to the nursing terminal when the infusion time is less than a threshold value. It can monitor the real-time infusion situation of patients, improve the nursing efficiency and accuracy.

Description

Technical Field

[0001] The present invention relates to digital processing technology, and in particular to a nursing interaction processing method and system based on a digital twin model. Background Art

[0002] In the modern medical system, the infusion rooms and wards in hospitals are extremely common treatment places. A large number of patients receive infusion treatment here every day. Especially when the number of patients is large, the management of the infusion process becomes extremely complex. Due to different patient conditions, the medication situations of different patients are different, which requires nursing staff to be able to perform operations such as drug replacement in a timely manner according to the specific infusion process of the patient.

[0003] The existing technical means mainly rely on the regular inspections of nursing staff. Nursing staff need to go to each infusion position regularly to check and perform corresponding nursing operations. However, when the number of patients is large, the frequency of manual inspections is limited, and it is difficult to achieve real-time monitoring, reducing the efficiency of the nursing process.

[0004] Therefore, how to monitor the infusion process of patients in real time and improve the nursing efficiency has become an urgent problem to be solved today. Summary of the Invention

[0005] The present invention provides a nursing interaction processing method and system based on a digital twin model, which can monitor the infusion process of patients in real time and improve the nursing efficiency.

[0006] In the first aspect of the present invention, a nursing interaction processing method based on a digital twin model is provided, including:

[0007] Binding the patient and the visit position identifier in the twin model, recording the initial position of the drug flow rate and the flow regulator, and calculating the infusion time in combination with the drug volume;

[0008] Determining the type of the patient's hand movement, and determining the flow rate change trend according to the type of hand movement, where the type of hand movement includes an increased flow input type and a decreased flow input type;

[0009] Updating the drug flow rate according to the flow rate change trend, and recalculating the infusion time according to the updated drug flow rate and the current drug volume;

[0010] When the type of the patient's hand movement is not recognized, obtaining the current position of the flow regulator according to the mobile device, recalculating the infusion time according to the drug flow rate corresponding to the current position, and sending a reminder message to the nursing terminal when the infusion time is less than the threshold.

[0011] Optionally, in a possible implementation of the first aspect, determine the type of the patient's hand movement, and determine the flow rate change trend according to the type of hand movement, where the type of hand movement includes an increasing flow input type and a decreasing flow input type, including:

[0012] Collect a real-time image of the area corresponding to the visit position identifier, and determine the region of interest corresponding to the flow regulator in the real-time image;

[0013] When the hand contour of the patient is recognized in the region of interest, obtain the movement trajectory of the key points in the hand contour. When the coordinates of the movement trajectory in the vertical direction show an increasing trend, it is determined as the increasing flow input type. When the coordinates of the movement trajectory in the vertical direction show a decreasing trend, it is determined as the decreasing flow input type;

[0014] Determine the increasing speed trend corresponding to the increasing flow input type, and determine the decreasing speed trend corresponding to the decreasing flow input type. The flow rate change trend includes an increasing speed trend and a decreasing speed trend.

[0015] Optionally, in a possible implementation of the first aspect, collecting a real-time image of the area corresponding to the visit position identifier and determining the region of interest corresponding to the flow regulator in the real-time image includes:

[0016] Extract the infusion device in the real-time image and identify the infusion tube area in the infusion device;

[0017] Traverse the infusion tube area in the order from top to bottom, and determine the pixel points whose pixel values are outside the preset pixel interval corresponding to the infusion tube area in the infusion tube area as target pixel points;

[0018] Generate a regulator contour based on adjacent target pixel points, and after magnifying the regulator contour according to a preset magnification factor, determine the corresponding area as the region of interest.

[0019] Optionally, in a possible implementation of the first aspect, when the hand contour of the patient is recognized in the region of interest, obtain the movement trajectory of the key points in the hand contour. When the coordinates of the movement trajectory in the vertical direction show an increasing trend, it is determined as the increasing flow input type. When the coordinates of the movement trajectory in the vertical direction show a decreasing trend, it is determined as the decreasing flow input type, including:

[0020] Obtain the fingertip contour points in the hand contour as key points, record the position coordinates of the key points in consecutive frames according to the time sequence, and connect the position coordinates in sequence to obtain the movement trajectory;

[0021] Select adjacent key points in the movement trajectory in sequence according to the time sequence, and calculate the coordinate difference in the vertical direction between them;

[0022] If the coordinate differences within the preset time period are all greater than the reference constant, it is determined that the coordinates on the movement trajectory are increasing, and it is determined as the increasing flow input type;

[0023] If the coordinate differences within the preset time period are all less than the reference constant, it is determined that the coordinates on the movement trajectory are decreasing, and it is determined as the decreasing flow input type.

[0024] Optionally, in a possible implementation manner of the first aspect, before obtaining the movement trajectory of the key points in the hand contour, it further includes:

[0025] Obtain the palm contour points and fingertip contour points in the hand contour as judgment points, and calculate the point-to-point distances between the judgment points;

[0026] Calculate the difference in the point-to-point distances of the corresponding judgment points in adjacent frames. When the differences in the point-to-point distances corresponding to the preset frames are all less than the reference constant, respond to the trajectory record information and start obtaining the movement trajectory.

[0027] Optionally, in a possible implementation manner of the first aspect, updating the drug flow rate according to the flow rate change trend, and recalculating the infusion time according to the updated drug flow rate and the current drug volume, includes:

[0028] Obtain the adjustment duration of the patient, and obtain the predicted distance according to the product of the adjustment duration and the reference speed;

[0029] When the flow rate change trend is an increasing trend, determine the position at the predicted distance from the initial position in the preset increasing direction as the predicted increasing position, and update the flow rate corresponding to the predicted increasing position to the drug flow rate;

[0030] When the flow rate change trend is a decreasing trend, determine the position at the predicted distance from the initial position in the preset decreasing direction as the predicted decreasing position, and update the flow rate corresponding to the predicted decreasing position to the drug flow rate;

[0031] Recalculate the infusion time according to the ratio of the current drug volume and the updated drug flow rate.

[0032] Optionally, in a possible implementation manner of the first aspect, calculating the flow rate corresponding to the predicted increasing position or the predicted decreasing position through the following steps, includes:

[0033] Retrieve the preset model corresponding to the flow regulator, determine multiple preset positions corresponding to the preset model, and each preset position is configured with a corresponding preset flow rate;

[0034] Obtain the preset position interval where the predicted increasing position or the predicted decreasing position is located, and determine the interval length of the preset position interval;

[0035] Calculate the predicted length from the predicted acceleration position or the predicted deceleration position to the left end point of the preset position interval, and obtain the interval proportion according to the ratio of the predicted length to the interval length;

[0036] Obtain the flow velocity difference corresponding to the preset position interval, and add the product of the interval proportion and the flow velocity difference to the preset flow velocity corresponding to the left end point of the preset position interval to obtain the flow velocity corresponding to the predicted acceleration position or the predicted deceleration position.

[0037] Optionally, in a possible implementation manner of the first aspect, when the hand movement type of the patient is not recognized, obtain the current position of the flow regulator according to the mobile device, and recalculate the infusion time according to the drug flow velocity corresponding to the current position, including:

[0038] When the hand movement type of the patient is not recognized, record the first moment, and control the mobile device to go to the position corresponding to the visit position identifier to collect image data, and record the second moment at the time of collection;

[0039] Invoke the preset model corresponding to the flow regulator. The preset model includes scale lines, and there are multiple preset positions on the scale lines;

[0040] Obtain the span line of the flow regulator in the infusion tube flow direction in the collected image, and determine the position point of the adjustment element on the span line. According to the proportional relationship between the scale line and the span line, determine the target position point of the position point on the scale line;

[0041] Calculate the remaining drug amount at the first moment according to the historical drug flow velocity, calculate the drug consumption amount from the first moment to the second moment according to the drug flow velocity at the target position point, and recalculate the infusion time by dividing the value obtained by subtracting the drug consumption amount from the remaining drug amount by the drug flow velocity corresponding to the target position point.

[0042] Optionally, in a possible implementation manner of the first aspect, obtain the span line of the flow regulator in the infusion tube flow direction in the collected image, and determine the position point of the adjustment element on the span line. According to the proportional relationship between the scale line and the span line, determine the target position point of the position point on the scale line, including:

[0043] Extract the current contour corresponding to the flow regulator in the collected image, obtain the two end points of the current contour in the infusion tube flow direction, and connect the two end points to obtain the span line;

[0044] Obtain the center point of the multiple contour intersection points of the adjustment element and the span line as the finally selected position point, and determine the first distance between the position point and the left end point of the span line;

[0045] Determine the length ratio of the scale line and the span line according to the proportional relationship between the scale line and the span line, and multiply the first distance by the length ratio to obtain the second distance;

[0046] Determine the position point at the second distance from the left end point of the distance scale line as the target position point.

[0047] In a second aspect of the present invention, there is provided a nursing interaction processing system based on a digital twin model, including:

[0048] An initial module for binding the patient and the visit position identifier in the twin model, recording the initial position of the drug flow rate and the flow regulator, and calculating the infusion time in combination with the drug volume;

[0049] A judgment module for determining the type of the patient's hand movement, and determining the flow rate change trend according to the type of the hand movement, wherein the type of the hand movement includes an increased flow input type and a decreased flow input type;

[0050] A calculation module for updating the drug flow rate according to the flow rate change trend, and recalculating the infusion time according to the updated drug flow rate and the current drug volume;

[0051] A warning module for, when the type of the patient's hand movement is not recognized, obtaining the current position of the flow regulator according to the mobile device, recalculating the infusion time according to the drug flow rate corresponding to the current position, and sending a reminder message to the nursing terminal when the infusion time is less than a threshold value.

[0052] The beneficial effects of the present invention are as follows:

[0053] The present invention can continuously collect images of the patient's visit area at a certain frequency by using a camera, and by using image recognition technology, it can accurately identify the type of the patient's hand movement, and determine whether it is an increased flow input type or a decreased flow input type. By tracking the movement trajectory of the key points in the hand contour and judging the type of movement based on the vertical coordinate change, the accuracy of the judgment is greatly improved. At the same time, when the type of the patient's hand movement is not recognized, a mobile device monitoring mechanism is started. The mobile device goes to the patient's visit position to collect image data of the flow regulator, and through the processing and analysis of the image, accurately obtains the current position of the flow regulator, and determines the drug flow rate corresponding to the current position in combination with a preset model. For example, when determining the target position point of the flow regulator, by extracting the contour of the flow regulator in the image, obtaining the span line, determining the position point of the adjusting element, and then accurately determining the target position point according to the proportional relationship between the scale line and the span line, so as to accurately calculate the infusion time. Thus, real-time and accurate monitoring of the infusion process is realized, the accuracy of the infusion parameters is ensured, and the efficiency of the nursing process is improved. Description of the Drawings

[0054] Figure 1 It is a schematic flowchart of a nursing interaction processing method based on a digital twin model provided by an embodiment of the present invention;

[0055] Figure 2It is a schematic diagram of a twin model corresponding to a nursing hall provided by an embodiment of the present invention;

[0056] Figure 3 It is a schematic diagram of the display of a reminder message provided by an embodiment of the present invention;

[0057] Figure 4 It is a schematic structural diagram of a nursing interaction processing system based on a digital twin model provided by an embodiment of the present invention Detailed implementation manners

[0058] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, rather than all of them. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0059] See Figure 1 , which is a schematic flowchart of a nursing interaction processing method based on a digital twin model provided by an embodiment of the present invention, Figure 1 The execution subject of the method shown can be a software and / or hardware device. The execution subject of the present application may include, but is not limited to, at least one of the following: user equipment, network equipment, etc. Among them, the user equipment may include, but is not limited to, a computer, a smart phone, a personal digital assistant (Personal Digital Assistant, abbreviated as: PDA), and the above-mentioned electronic equipment, etc. The network equipment may include, but is not limited to, a single network server, a server group composed of multiple network servers, or a cloud composed of a large number of computers or network servers based on cloud computing. Among them, cloud computing is a type of distributed computing, which is composed of a group of loosely coupled computers to form a super virtual computer. This embodiment does not make any restrictions. It includes steps S101 to S104, specifically as follows:

[0060] S101, bind the patient and the visit position identifier in the twin model, record the initial positions of the drug flow rate and the flow regulator, and calculate the infusion time in combination with the drug volume.

[0061] This embodiment is applicable to scenarios such as the infusion room and ward of a hospital that need to monitor the infusion process, and is particularly suitable for use when the number of patients is large and the nursing resources are relatively tense. This embodiment can realize the real-time monitoring of the patient's infusion situation, accurately adapt to the medication needs of different patients, and optimize the allocation of medical staff resources.

[0062] Since the medication conditions of each patient are different, in order to enable medical staff to change medicines in time according to the infusion progress of each patient and improve the safety and efficiency of the nursing process, this embodiment will calculate the patient's infusion time, so that the medical staff can be reminded when the infusion time is less than the threshold. When reminding, this embodiment will show the medical staff the specific location of the patient through the twin model of the corresponding area, so that the medical staff can quickly find the patient and perform nursing operations.

[0063] See also Figure 2 , which is a schematic diagram of a twin model corresponding to a nursing hall provided in an embodiment of the present invention. The twin model corresponds to a nursing hall, such as an infusion hall. The infusion area includes multiple consultation positions corresponding to the infusion. The consultation position identifier is a virtual position identifier corresponding to the patient position in the twin model. Medical staff can enter patient information in the system and establish a binding relationship with the consultation position identifier in the digital twin model. Medical staff can enter the parameters of the infusion pump, including the initial drug flow rate, the position of the regulator, and the drug capacity, and then calculate the initial infusion time based on the ratio of the drug capacity to the initial flow rate. The flow regulator is an infusion speed regulating roller, which controls the infusion speed by changing the position of the roller on the track.

[0064] S102, determining the patient's hand movement type, and determining the flow rate change trend according to the hand movement type, wherein the hand movement type includes a flow increase input type and a flow decrease input type.

[0065] During the infusion process, the patient may adjust the infusion flow rate, causing the infusion time to change. Therefore, in order to more accurately monitor the patient's infusion process, this embodiment will also recalculate the infusion time when the patient adjusts the infusion flow rate. Specifically, the flow rate change information will be quickly obtained through the patient's hand movements.

[0066] Understandably, in a large infusion room, the camera needs to cover a large area, and it is difficult for the camera to clearly capture the specific position of the roller after it is turned. However, the hand movement amplitude is relatively large, which is easier to be captured by the camera. By analyzing the direction of the hand movement, the direction of the roller can be indirectly inferred, and then the flow rate change can be determined.

[0067] Specific cameras can collect images of the patient's treatment area at a certain frequency, recognize the patient's hand movements, determine whether the patient's hand movement is upward (i.e., the hand movement corresponding to the flow-increasing input type) or downward (i.e., the hand movement corresponding to the flow-decreasing input type), and determine the increasing speed trend corresponding to the flow-increasing input type. In this case, the roller will slide towards the wide end of the track, the catheter is less compressed, and the flow rate increases. Determine the decreasing speed trend corresponding to the flow-decreasing input type. In this case, the roller slides towards the narrow end of the track, squeezing the catheter more significantly, resulting in a slower liquid flow rate. The flow rate change trend includes an increasing speed trend and a decreasing speed trend.

[0068] In some embodiments, based on the above embodiments, the specific implementation manner of step S102 may be:

[0069] Collect the real-time image of the area corresponding to the treatment position identifier, and determine the region of interest corresponding to the flow regulator in the real-time image.

[0070] The region of interest is the area for detecting the patient's hand movements. When determining the region of interest, the area including the infusion roller and the surrounding areas that may be operated by the hand can be determined as the region of interest.

[0071] In some embodiments, a fixed area can be pre-calibrated in the image as the region of interest, and this area can cover various possible action ranges of the patient's hand operating the roller to ensure that no operating actions are missed.

[0072] In some other embodiments, the region of interest can be determined in the following manner:

[0073] Extract the infusion device in the real-time image and identify the infusion tube region in the infusion device.

[0074] In practical applications, according to the shape and color characteristics of the infusion device, algorithms such as threshold segmentation and edge detection can be used to extract the contour of the infusion device. Since the flow regulator is generally installed on the infusion tube and is a component of the infusion tube, after extracting the corresponding contour of the infusion device, the region corresponding to the infusion tube in the infusion device can be identified.

[0075] Traverse the infusion tube region in the order from top to bottom, and determine the pixel points whose pixel values are outside the preset pixel interval corresponding to the infusion tube region in the infusion tube region as the target pixel points.

[0076] Under normal circumstances, after imaging, the corresponding set of pixel points of the flow regulator is within the set of pixel points in the corresponding area of the infusion tube. Since the flow regulator exists attached to the infusion tube, the area occupied by the flow regulator in the image is a part of the overall area of the infusion tube. For example, in the image, the infusion tube appears as a long and thin strip area, and the flow regulator is a specific part of this strip area. The pixel points corresponding to the roller are completely contained within the area formed by the pixel points representing the infusion tube. Generally, the pixel values corresponding to the flow regulator and the infusion tube are different. Therefore, pixel points located within the infusion tube area and whose pixel values are not within the preset pixel range can be selected to determine the area corresponding to the flow regulator.

[0077] Generate a regulator contour based on adjacent target pixel points, and after magnifying the regulator contour according to a preset magnification factor, determine the corresponding area as the region of interest.

[0078] Among them, the preset magnification factor can be set in advance to cover a certain area around the flow regulator. After magnifying the regulator contour, the center point of the magnified contour can be aligned with the center point of the contour before magnification, and the corresponding area is used as the region of interest.

[0079] When the hand contour of the patient is recognized in the region of interest, obtain the movement trajectory of the key points in the hand contour. When the coordinates of the movement trajectory in the vertical direction show an increasing trend, it is determined as the type of increasing flow input. When the coordinates of the movement trajectory in the vertical direction show a decreasing trend, it is determined as the type of decreasing flow input.

[0080] After determining the region of interest, continuous monitoring of this region can be carried out. When the hand contour of the patient is recognized in this region, subsequent analysis steps will be triggered. Specifically, it will be combined with the movement trajectory of the key points in the hand contour to determine whether it moves upward or downward.

[0081] Among them, the key point refers to the reference point for determining the hand movement trajectory, which can be the contour point of the fingertip or other hand parts. The movement trajectory is generated by the key points of consecutive frames.

[0082] When turning the roller upward, the fingertip usually moves upward first, driving the roller to rotate. Therefore, the coordinates of the movement trajectory corresponding to its key point may show an increasing trend in the vertical direction, that is, the Y-axis coordinate values on the movement trajectory increase in sequence; when turning downward, it is the opposite. Therefore, tracking the movement trajectory of the key point corresponding to the fingertip helps to judge the adjustment direction of the roller. Among them, the coordinate origin can be the center point of the image.

[0083] Specifically, in some embodiments, the type of hand movement can be determined through the following steps:

[0084] The fingertip contour points in the hand contour are obtained as key points, the position coordinates of the key points in consecutive frames are recorded according to the time sequence, and the position coordinates are connected in sequence to obtain the movement trajectory.

[0085] From the perspective of finger positions, the tip of the index finger is an important reference point. The index finger is often at the forefront of the action when turning the scroll wheel, and its motion trajectory can intuitively reflect the direction and amplitude of the turning. Therefore, the fingertip contour point can be the contour point of the index fingertip. In some embodiments, it can also be other fingertip contour points. The movement trajectory can intuitively present the movement path and direction of the key points of the hand in space.

[0086] Adjacent key points in the moving trajectory are selected in chronological order, and their vertical coordinate differences are calculated.

[0087] Calculate the coordinate difference in the vertical direction, that is, calculate the Y-axis coordinate value difference of adjacent key points. You can subtract the Y-axis coordinate value at the previous moment from the Y-axis coordinate value at the next moment.

[0088] If the coordinate differences within the preset time period are all greater than the reference constant, it is determined that the coordinates on the moving trajectory are increasing and are determined to be an increasing flow input type.

[0089] In practical applications, the reference constant can be 0. If the coordinate differences within the preset time period are all greater than 0, it means that the Y-axis coordinate differences in consecutive corresponding frames are all greater than 0, and the Y-axis coordinate value is continuously increasing. Therefore, it can be determined that its coordinates are increasing and it is determined to be an upward flow-increasing input type.

[0090] If the coordinate differences within the preset time period are all smaller than the reference constant, it is determined that the coordinates on the moving trajectory are decreasing and it is determined to be a flow reduction input type.

[0091] If the coordinate differences within the preset time period are all less than 0, it means that the Y-axis coordinate differences in the consecutive corresponding frames are all less than 0, and the Y-axis coordinate values ​​are continuously decreasing. Therefore, it can be determined that the coordinates are decreasing and it is determined to be a downward flow reduction input type.

[0092] Determine that the flow increase input type corresponds to the increasing trend, determine that the flow reduction input type corresponds to the decelerating trend, and the flow velocity change trend includes the increasing trend and the decelerating trend.

[0093] In addition, when the patient has no intention of operating, there may be various involuntary movements, tremors, or natural posture adjustments of the hand. If an attempt is made to determine the dialing direction in these situations, misjudgment is likely to occur. For example, the patient may just inadvertently place the hand near the infusion device, and the slight movement of the hand is not intended to adjust the roller. Therefore, before determining the movement trajectory, it can also be determined whether the patient has the intention of dialing operation. When it is determined that the patient has this intention, and then the dialing direction is determined, the accuracy of judgment can be greatly improved, and the probability of misjudgment can be reduced.

[0094] Therefore, in some embodiments, before obtaining the movement trajectory of the key points in the hand contour, the following solutions are also included:

[0095] Obtain the palm contour point and fingertip contour point in the hand contour as judgment points, and calculate the point distance between the judgment points.

[0096] In order to screen out the hand movements with the intention of operation, the system calculates the difference in the point distances of the corresponding judgment points in adjacent frames. The judgment points refer to the reference points used to determine the change of hand movements. Calculating the difference in the point distances between the palm and fingertip contour points in adjacent frames can highlight the change of hand movements in a very short time.

[0097] Calculate the difference in the point distances of the corresponding judgment points in adjacent frames. When the difference in the point distances corresponding to the preset frames is less than the reference constant, respond to the trajectory recording information and start obtaining the movement trajectory.

[0098] When the difference in the point distances corresponding to the preset frames is less than the reference constant (0), it indicates that the distance between the palm contour point and the fingertip contour point shows a gradually decreasing trend. The gradually decreasing distance is likely to mean that the hand is making a closing movement, which is very likely to be preparing to grasp the infusion roller or perform a dialing operation. By closely monitoring this distance change trend, combined with the analysis of the difference in adjacent frame point distances and the judgment rules of preset frames and reference constants, the operation intention of the patient can be determined more accurately, and sufficient preparation can be made in advance for obtaining an accurate movement trajectory, further improving the timeliness and accuracy of the judgment of the infusion adjustment action, and providing more solid support for ensuring the smooth and safe progress of the infusion process. Among them, the trajectory recording information is the response information for starting to record the movement trajectory.

[0099] S103, update the drug flow rate according to the flow rate change trend, and recalculate the infusion time according to the updated drug flow rate and the current drug volume.

[0100] After determining the flow rate change trend, this embodiment will update the drug flow rate in combination with this trend, and then recalculate the infusion time based on the updated flow rate. If it is an increasing trend, the drug flow rate will be increased; if it is a decreasing trend, the drug flow rate will be decreased. When increasing or decreasing the flow rate, the corresponding relationship between the preset position and the flow rate can be combined to determine the position adjusted by the flow regulator under the corresponding trend, and the drug flow rate will be updated in combination with the flow rate corresponding to this position. After updating the drug flow rate, the system will combine the current remaining drug volume and use the calculation method of dividing the current drug volume by the updated drug flow rate to recalculate the infusion time again. This recalculation process can ensure that the infusion time always conforms to the actual infusion situation and provide accurate infusion process information for medical staff.

[0101] Based on the above embodiment, the specific implementation manner of step S103 can be:

[0102] Obtain the adjustment duration of the patient, and obtain the predicted distance according to the product of the adjustment duration and the reference speed.

[0103] It can be understood that in order to predict the roller position after the patient's adjustment, and then determine the flow rate after the patient's adjustment in combination with the corresponding relationship between the roller position and the flow rate, the roller position can be predicted based on the duration of the patient's adjustment.

[0104] The adjustment duration of the patient can be determined in combination with the movement trajectory corresponding to the contour of the patient's hand. The movement duration of the movement trajectory can be determined as the adjustment duration. When determining the movement trajectory, if the change values of the corresponding coordinate point positions within the preset time are all less than the preset change threshold, it indicates that the operation may have stopped, and it can be used as the end point of the movement trajectory. Then, the adjustment duration can be determined through the duration from the starting point to the end point of the movement trajectory.

[0105] The reference speed can be a speed set in advance. Through the reference speed and the adjustment duration, the displacement data adjusted by the patient, that is, the predicted distance, can be predicted.

[0106] When the flow rate change trend is an increasing trend, determine the position at the predicted distance from the initial position in the preset increasing speed direction as the predicted increasing speed position, and update the flow rate corresponding to the predicted increasing speed position as the drug flow rate.

[0107] In actual application, the roller of the infusion device controls the flow rate of the liquid by squeezing the infusion tube. When the roller is adjusted upward, the degree of squeezing of the infusion tube by the roller is reduced, the lumen of the infusion tube becomes relatively larger, the resistance to liquid flow is reduced, and more liquid can pass through the infusion tube per unit time, thereby speeding up the infusion speed. On the contrary, when the roller is adjusted downward, the roller will further squeeze the infusion tube, the lumen becomes narrower, the resistance to liquid flow increases, and the infusion speed will slow down. Therefore, the preset speed-up direction can be from bottom to top, and the predicted speed-up position is the roller position predicted in combination with the distance of the upward dial. Different positions have corresponding flow rates, so after determining the position, the corresponding drug flow rate can be known.

[0108] When the flow velocity variation trend is a deceleration trend, a position at a predicted distance from an initial position in a preset deceleration direction is determined as a predicted deceleration position, and the flow velocity corresponding to the predicted deceleration position is updated to the drug flow velocity.

[0109] The preset deceleration direction may be from top to bottom, and the predicted deceleration position is the predicted roller position in combination with the downward movement distance.

[0110] In some embodiments, the flow velocity corresponding to the predicted speed-up position or the predicted speed-down position may be calculated by the following steps:

[0111] The preset model corresponding to the flow regulator is retrieved, and a plurality of preset positions corresponding to the preset model are determined, each preset position being configured with a corresponding preset flow rate.

[0112] In practical applications, a flow regulator can be pre-configured with a corresponding model, which includes multiple preset positions, and each preset position is configured with a corresponding preset flow rate. These preset positions and flow rates are pre-set and calibrated, providing basic data for subsequent calculations. For example, the preset model may include flow rate values ​​corresponding to different scale positions of the roller.

[0113] A preset position interval where the predicted speed-up position or the predicted speed-down position is located is obtained, and an interval length of the preset position interval is determined.

[0114] The preset position interval is the scale interval where the predicted acceleration position or the predicted deceleration position is located. For example, assuming that the predicted acceleration position is between two scale positions in the preset model, these two scale positions constitute a preset position interval, and the difference between them is the interval length.

[0115] Calculate the predicted length from the predicted speed-up position or the predicted speed-down position to the left end point of the preset position, and obtain the interval proportion based on the ratio of the predicted length to the interval length.

[0116] The left endpoint of the preset position interval can be the critical point of the scale with a small value, and the prediction length is the distance from the predicted acceleration position or the predicted deceleration position to this critical point. The relative position of the predicted position within the preset position interval can be reflected by the interval ratio. For example, if the prediction length is half of the interval length, then the interval ratio is 0.5.

[0117] Obtain the flow velocity difference corresponding to the preset position interval, add the product of the interval ratio and the flow velocity difference to the preset flow velocity corresponding to the left endpoint of the preset position interval, and obtain the flow velocity corresponding to the predicted acceleration position or the predicted deceleration position.

[0118] Obtain the flow velocity difference corresponding to the preset position interval, that is, the difference between the preset flow velocity corresponding to the right endpoint of this interval and the preset flow velocity corresponding to the left endpoint. Then multiply the interval ratio by the flow velocity difference, and add the preset flow velocity corresponding to the left endpoint of the preset position interval, and the flow velocity corresponding to the predicted acceleration position or the predicted deceleration position can be obtained. Through such a calculation method, the drug flow velocity corresponding to the predicted position can be determined more accurately, so as to achieve precise control and adjustment of the infusion flow velocity.

[0119] For example, the flow velocity at the left endpoint of the preset position interval is 50 ml / h, the flow velocity at the right endpoint is 70 ml / h, the flow velocity difference is 20 ml / h, and the interval ratio is 0.5. Then the flow velocity corresponding to the predicted position is 50 + 0.5×20 = 60 ml / h.

[0120] Recalculate the infusion time according to the ratio of the current drug volume to the updated drug flow velocity.

[0121] Through the above method, when the patient adjusts the infusion flow velocity, the new flow velocity can be accurately determined, improving the accuracy during monitoring.

[0122] S104, when the hand movement type of the patient is not recognized, obtain the current position of the flow regulator according to the mobile device, recalculate the infusion time according to the drug flow velocity corresponding to the current position, and send a reminder message to the nursing terminal when the infusion time is less than the threshold.

[0123] To improve the accuracy of monitoring, when the hand movement type of the patient is not recognized within a period of time, another set of monitoring mechanisms will be activated. Specifically, the mobile device can be controlled to go to the location marked with the patient's visit position. The image acquisition device equipped on the mobile device will collect the image data of the flow regulator. Process and analyze the collected images, obtain the current position of the flow regulator, and determine the drug flow velocity corresponding to the current position according to the pre-set corresponding relationship between the position and the flow velocity. Based on this, the infusion time can be recalculated again according to the remaining drug volume and this flow velocity.

[0124] When the infusion time is less than a pre-set threshold value, it means that the infusion is about to end or an abnormal situation may occur. At this time, a reminder message can be immediately sent to the nursing terminal (such as an electronic device like a computer). After receiving the reminder at the nursing terminal, the nursing staff can timely know the patient's infusion status and make corresponding preparations in advance, such as preparing to replace the medicine, handling the subsequent matters after the infusion is completed, etc., to ensure the smooth progress of the infusion process. Refer to Figure 3 , which is a schematic diagram showing the display of a reminder message provided by an embodiment of the present invention. When the patient's infusion time is less than the threshold value, the position corresponding to the patient in the twin model can be quickly determined by combining the position information bound to the patient, and then the corresponding position is displayed using different pixel values. For example Figure 3 the gray pixel value shown in

[0125] Based on the above embodiments, the specific implementation manner of step S104 may be:

[0126] When the hand movement type of the patient is not recognized, record the first moment, and control the mobile device to go to the position corresponding to the visit position identifier to collect image data, and record the second moment when collecting.

[0127] When the hand movement type of the patient is not recognized, first record the first moment, and then control the mobile device such as a mobile robot to go to the preset position corresponding to the patient's visit position identifier. The image acquisition device (such as a camera) equipped on the mobile device will collect the image data of the flow regulator and record the second moment when collecting. This step ensures that the state information of the flow regulator at a specific moment can be obtained. The reason for recording the first moment and the second moment is to be able to determine the time period when the mobile device goes to the corresponding position of the patient, so that when recalculating the infusion time, the consumption capacity during this period can be combined with the adjusted flow rate for calculation, thereby improving the accuracy of flow rate calculation.

[0128] Retrieve the preset model corresponding to the flow regulator. The preset model includes scale lines, and there are multiple preset positions on the scale lines.

[0129] The preset model contains scale lines, and there are multiple preset positions on the scale lines. Each preset position corresponds to a specific flow rate. The preset model is an important reference for position and flow rate judgment. Through it, the actual position of the flow regulator can be converted into corresponding flow rate information.

[0130] Obtain the span line of the flow regulator in the infusion tube flow direction in the collected image, and determine the position point of the adjustment element on the span line. According to the proportional relationship between the scale line and the span line, determine the target position point of the position point on the scale line.

[0131] The span line is the range line within which the adjustment element can move. The adjustment element is the roller in the flow regulator, and the flow direction of the infusion tube can correspond to the orientation of the infusion tube. The position point of the adjustment element on the span line can be used to indicate its specific adjustment position.

[0132] Based on the proportional relationship between the scale line and the span line, calculate the target position point of this position point on the scale line. For example, if the length of the span line is 10 cm, the adjustment element is at a position 3 cm from one end on the span line, and the total length of the scale line is 50 scale units. Through proportional calculation (50 / 10 = x / 3), it can be determined that the target position point corresponding to the position point on the scale line is the 15th scale unit.

[0133] Specifically, in some embodiments, the target position point can be determined through the following steps:

[0134] Extract the current contour corresponding to the flow regulator in the captured image, obtain the two endpoints of the current contour in the flow direction of the infusion tube, and connect the two endpoints to obtain the span line.

[0135] In the image of the infusion scenario, the flow regulator has unique shapes and features. Through image recognition techniques (such as edge detection, contour extraction algorithms, etc.), its contour can be separated from the complex background. Then, obtain the two endpoints of the current contour in the flow direction of the infusion tube. The adjustment element generally moves in the direction corresponding to the flow direction of the infusion tube, and the position change of the adjustment element in this direction directly affects the infusion flow rate.

[0136] Obtain the center point of the multiple contour intersection points of the adjustment element and the span line as the finally selected position point, and determine the first distance between the position point and the left endpoint of the span line.

[0137] Since there may be multiple intersection points between the adjustment element and the span line, these intersection points reflect the relative position of the adjustment element on the span line. By calculating the center point of these intersection points, it is used as the finally selected position point. Selecting the center point as the position point is to more accurately represent the position of the adjustment element on the span line and avoid inaccurate position judgment caused by the deviation of a single intersection point.

[0138] The first distance represents the positional relationship of the position point relative to the left endpoint of the span line. By measuring this distance, the specific position of the adjustment element on the span line can be quantified. For example, if the length of the span line is 100 pixels and the first distance between the position point and the left endpoint is 30 pixels, it indicates that the adjustment element is located at the 30% position of the span line starting from the left endpoint.

[0139] Determine the length ratio of the scale line and the span line according to the proportional relationship between the scale line and the span line, and multiply the first distance by the length ratio to obtain the second distance.

[0140] The scale line is an important part of the preset model of the flow regulator, and the scales on it correspond to different flow rates. The span line is the actual range line determined from the acquired image. By comparing the lengths of the two, the proportional relationship between them is obtained. Multiply the first distance by the length ratio to get the second distance. This second distance is a key step in converting the position information of the span line based on the image into the position information based on the scale line. Through this calculation, the distance of the position point on the span line is converted into the equivalent distance on the scale line.

[0141] Determine the position point at the second distance from the left end point of the scale line as the target position point.

[0142] Through the previous calculation, a distance value (the second distance) on the scale line is obtained. Starting from the left end point of the scale line and along the direction of the scale line, find the position point that is at the second distance from the left end point. This position point is the target position point. After the target position point is determined, the infusion time can be accurately recalculated according to the flow rate corresponding to the target position point in the preset model, combined with other relevant information (such as the remaining amount of the drug, etc.), so as to provide accurate infusion status information for the nursing staff and ensure the smooth progress of the infusion process.

[0143] Calculate the remaining amount of the drug at the first moment according to the historical drug flow rate, calculate the drug consumption from the first moment to the second moment according to the drug flow rate at the target position point, and recalculate the infusion time by dividing the value obtained by subtracting the drug consumption from the remaining amount of the drug by the drug flow rate corresponding to the target position point.

[0144] Calculate the remaining amount of the drug at the first moment according to the historical drug flow rate (i.e., the previously recorded drug flow rate information). For example, if the previous flow rate is 50 ml / h and 2 hours have passed from the start of the infusion to the first moment, and the initial drug volume is 300 ml, then the remaining amount of the drug at the first moment is 300 - 50×2 = 200 ml. Then, calculate the drug consumption from the first moment to the second moment according to the drug flow rate at the target position point. Assume that the flow rate corresponding to the target position point is 60 ml / h and 0.5 hours have passed from the first moment to the second moment, then the drug consumption is 60×0.5 = 30 ml. Finally, divide the value obtained by subtracting the drug consumption from the remaining amount of the drug (200 - 30 = 170 ml) by the drug flow rate corresponding to the target position point (60 ml / h), and the recalculated infusion time is 170÷60 ≈ 2.83 hours.

[0145] Through the above method, the efficiency and accuracy of drug management in the nursing process can be improved.

[0146] See Figure 4, which is a schematic structural diagram of a nursing interaction processing system based on a digital twin model provided by an embodiment of the present invention. The nursing interaction processing system based on the digital twin model includes:

[0147] An initial module for binding a patient to a visit position identifier in the twin model, recording the initial position of the drug flow rate and the flow regulator, and calculating the infusion time in combination with the drug volume;

[0148] A judgment module for determining the type of the patient's hand movement and determining the flow rate change trend according to the type of hand movement. Among them, the type of hand movement includes an increased flow input type and a decreased flow input type;

[0149] A calculation module for updating the drug flow rate according to the flow rate change trend and recalculating the infusion time according to the updated drug flow rate and the current drug volume;

[0150] A warning module for, when the type of the patient's hand movement is not recognized, obtaining the current position of the flow regulator according to the mobile device, recalculating the infusion time according to the drug flow rate corresponding to the current position, and sending a reminder message to the nursing terminal when the infusion time is less than a threshold.

[0151] Figure 4 The device in the illustrated embodiment can correspondingly be used to execute Figure 1 The steps in the illustrated method embodiment, and its implementation principle and technical effects are similar, which will not be elaborated here.

[0152] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A nursing interaction processing method based on a digital twin model, characterized in that: include: Bind the patient and the treatment location in the twin model, record the drug flow rate and the initial position of the flow regulator, and calculate the infusion time based on the drug volume; Determine the patient's hand movement type, and determine the flow rate change trend according to the hand movement type, wherein the hand movement type includes a flow increase input type and a flow decrease input type, including: Acquire a real-time image of the area corresponding to the diagnosis position mark, and determine the region of interest corresponding to the flow regulator in the real-time image; When the hand contour of the patient is identified in the region of interest, the moving trajectory of the key points in the hand contour is obtained. When the coordinates of the moving trajectory in the vertical direction are increasing, it is determined to be an increasing flow input type. When the coordinates of the moving trajectory in the vertical direction are decreasing, it is determined to be a decreasing flow input type. Determine that the flow increase input type corresponds to the increasing trend, and determine that the flow reduction input type corresponds to the decreasing trend. The flow velocity change trend includes the increasing trend and the decreasing trend. Update the drug flow rate according to the flow rate change trend, and recalculate the infusion time according to the updated drug flow rate and the current drug volume; When the patient's hand movement type is not recognized, the current position of the flow regulator is obtained according to the mobile device, and the infusion time is recalculated according to the drug flow rate corresponding to the current position. When the infusion time is less than the threshold, a reminder message is sent to the nursing terminal.

2. The method according to claim 1, characterized in that Collect a real-time image of the area corresponding to the patient position identification, and determine the area of ​​interest corresponding to the flow regulator in the real-time image, including: Extract the infusion device in the real-time image and identify the infusion tube area in the infusion device; Traversing the infusion tube area in sequence from top to bottom, determining a pixel point in the infusion tube area whose pixel value is outside a preset pixel interval corresponding to the infusion tube area as a target pixel point; The regulator contour is generated based on adjacent target pixel points, and the region corresponding to the regulator contour is determined as the region of interest after the regulator contour is magnified according to a preset magnification.

3. The method according to claim 1, characterized in that When the hand contour of the patient is identified in the region of interest, the moving trajectory of the key points in the hand contour is obtained. When the coordinates of the moving trajectory in the vertical direction are increasing, it is determined to be an increasing flow input type. When the coordinates of the moving trajectory in the vertical direction are decreasing, it is determined to be a decreasing flow input type, including: The fingertip contour points in the hand contour are obtained as key points, the position coordinates of the key points in consecutive frames are recorded according to the time sequence, and the position coordinates are connected in sequence to obtain the movement trajectory; Select adjacent key points in the moving trajectory in chronological order and calculate their vertical coordinate differences; If the coordinate differences within the preset time period are all greater than the reference constant, it is determined that the coordinates on the moving trajectory are increasing, and it is determined to be an increasing flow input type; If the coordinate differences within the preset time period are all smaller than the reference constant, it is determined that the coordinates on the moving trajectory are decreasing and it is determined to be a flow reduction input type.

4. The method according to claim 1, characterized in that: Before obtaining the moving trajectory of the key points in the hand contour, it also includes: Obtain the palm contour points and fingertip contour points in the hand contour as judgment points, and calculate the point distance between the judgment points; The point distance difference of the corresponding judgment points in adjacent frames is calculated. When the point distance difference corresponding to the preset frame is less than the reference constant, the trajectory recording information is responded to and the moving trajectory is started to be obtained.

5. The method according to claim 1, characterized in that Update the drug flow rate according to the flow rate change trend, and recalculate the infusion time based on the updated drug flow rate and the current drug volume, including: The patient's adjustment time is obtained, and the predicted distance is obtained according to the product of the adjustment time and the reference speed; When the flow velocity change trend is an increasing trend, a position at a predicted distance from the initial position in a preset increasing direction is determined as a predicted increasing position, and the flow velocity corresponding to the predicted increasing position is updated as the drug flow velocity; When the flow velocity change trend is a deceleration trend, a position at a predicted distance from the initial position in the preset deceleration direction is determined as a predicted deceleration position, and the flow velocity corresponding to the predicted deceleration position is updated as the drug flow velocity; The infusion time is recalculated based on the ratio of the current drug volume and the updated drug flow rate.

6. The method according to claim 5, characterized in that The flow velocity corresponding to the predicted speed-up position or the predicted speed-down position is calculated by the following steps, including: Retrieving a preset model corresponding to the flow regulator, determining a plurality of preset positions corresponding to the preset model, each preset position being configured with a corresponding preset flow rate; Obtaining a preset position interval where the predicted speed-up position or the predicted speed-down position is located, and determining the interval length of the preset position interval; Calculate the predicted length from the predicted speed-up position or the predicted speed-down position to the left end point of the preset position, and obtain the interval proportion according to the ratio of the predicted length to the interval length; The flow velocity difference corresponding to the preset position interval is obtained, and the product of the interval proportion and the flow velocity difference is added to the preset flow velocity corresponding to the left endpoint of the preset position interval to obtain the flow velocity corresponding to the predicted acceleration position or the predicted deceleration position.

7. The method according to claim 1, characterized in that When the patient's hand motion type is not identified, the current position of the flow regulator is obtained according to the mobile device, and the infusion time is recalculated according to the drug flow rate corresponding to the current position, including: When the hand motion type of the patient is not identified, the first moment is recorded, and the mobile device is controlled to go to the position corresponding to the diagnosis position mark to collect image data, and the second moment of the collection is recorded; Retrieving a preset model corresponding to the flow regulator, the preset model includes a scale line, and the scale line has a plurality of preset positions; Obtaining the span line of the flow regulator in the flow direction of the infusion tube in the collected image, and determining the position point of the regulating element on the span line, and determining the target point position of the position point on the scale line according to the proportional relationship between the scale line and the span line; The remaining amount of medicine at the first moment is calculated according to the historical drug flow rate, the drug consumption from the first moment to the second moment is calculated according to the drug flow rate at the target point, and the infusion time is recalculated by dividing the value obtained by subtracting the drug consumption from the remaining amount of medicine by the drug flow rate corresponding to the target point.

8. The method according to claim 7, characterized in that Obtain the span line of the flow regulator in the flow direction of the infusion tube in the captured image, determine the position point of the regulating element on the span line, and determine the target point position of the position point on the scale line according to the proportional relationship between the scale line and the span line, including: Extract the current contour corresponding to the flow regulator in the acquired image, obtain two endpoints of the current contour in the flow direction of the infusion tube, and connect the two endpoints to obtain a span line; Obtaining the center point of multiple contour intersections of the regulating element and the span line as the finally selected position point, and determining a first distance between the position point and the left end point of the span line; Determine the length ratio of the scale line and the span line according to the proportional relationship between the scale line and the span line, and multiply the first distance and the length ratio to obtain the second distance; Determine the position point at the second distance from the left end point of the scale line as the target point.

9. A system corresponding to the nursing interaction processing method based on the digital twin model according to claim 1, characterized in that: include: The initial module is used to bind the patient and the treatment location identification in the twin model, record the drug flow rate and the initial position of the flow regulator, and calculate the infusion time based on the drug volume; The judgment module is used to judge the hand movement type of the patient and determine the flow rate change trend according to the hand movement type, wherein the hand movement type includes a flow increase input type and a flow decrease input type, including: Acquire a real-time image of the area corresponding to the diagnosis position mark, and determine the region of interest corresponding to the flow regulator in the real-time image; When the hand contour of the patient is identified in the region of interest, the moving trajectory of the key points in the hand contour is obtained. When the coordinates of the moving trajectory in the vertical direction are increasing, it is determined to be an increasing flow input type. When the coordinates of the moving trajectory in the vertical direction are decreasing, it is determined to be a decreasing flow input type. Determine that the flow increase input type corresponds to the increasing trend, and determine that the flow reduction input type corresponds to the decreasing trend. The flow velocity change trend includes the increasing trend and the decreasing trend. A calculation module, used to update the drug flow rate according to the flow rate change trend, and recalculate the infusion time according to the updated drug flow rate and the current drug volume; The warning module is used to obtain the current position of the flow regulator according to the mobile device when the patient's hand movement type is not recognized, recalculate the infusion time according to the drug flow rate corresponding to the current position, and send a reminder message to the nursing terminal when the infusion time is less than the threshold.

Images