Nursing interaction method and device and medium
Through the nursing interaction method on the VR side, patients adjust the nursing area on the VR device, generate adjustment indicators, and medical staff obtain needs in real time, solving the problem of lagging nursing response for patients with reduced mobility, and achieving efficient allocation of nursing resources and immediate response to patient needs.
Patent Information
- Application Number
- CN202510540657.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-27
- Publication Date
- 2025-07-25
AI Technical Summary
The real-time needs of patients with reduced mobility are difficult to be grasped by medical staff in a timely manner, resulting in lagging nursing response and affecting medical experience and condition treatment.
Through the VR-side-based nursing interaction method, patients perform nursing area adjustment operations on VR devices to generate adjustment indicators. Medical staff obtain and confirm needs in real time through the second VR end, supporting a two-way interactive feedback mechanism to achieve efficient allocation of nursing resources.
It significantly improves the real-time and accuracy of nursing services, reduces communication delays, avoids the deterioration of the condition, reduces the burden on medical staff, and improves the patients' active participation ability and medical experience.
Smart Images

Figure CN120376090A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to data processing technologies, and in particular to a nursing interaction method, device, and medium. Background Art
[0002] In a modern medical environment, a hospital admits a large number of patients every day, and among them, the group of patients with limited mobility faces many difficulties.
[0003] On the one hand, medical staff are burdened with heavy tasks such as diagnosis and treatment, dispensing medicine, and ward rounds, and have limited energy, making it difficult to accompany patients with limited mobility one-on-one for a long time. Taking a general comprehensive hospital as an example, a medical staff member often has to be responsible for the care of a dozen or more patients, shuttling between various wards from early morning until late at night.
[0004] On the other hand, due to physical limitations, patients with limited mobility may have daily needs such as drinking water, getting items, and adjusting body positions at any time, and they cannot solve them quickly by themselves; the past nursing models mostly relied on regular inspections, and even if patients had urgent needs during non-inspection periods, it was very difficult for medical staff to be immediately aware; for example, some patients needed to adjust the analgesia pump urgently due to increased postoperative pain, but because the medical staff were dealing with other matters and could not arrive in time, they had to endure the discomfort, which not only reduced the patients' medical experience but also might delay the treatment of the condition and cause many potential risks.
[0005] Therefore, how to enable medical staff to grasp the real-time needs of patients in real time to ensure accurate and timely nursing effects has become an urgent problem to be solved. Summary of the Invention
[0006] Based on the above problems, the present invention is proposed to provide a nursing interaction method, device, and medium that overcome the above problems or at least partially solve the above problems.
[0007] According to one aspect of the present invention, there is provided a nursing interaction method, including the following steps:
[0008] Displaying image data of a corresponding nursing area based on a first VR terminal;
[0009] Responding to an adjustment operation of any nursing element located in the image data by a patient based on the first VR terminal as a valid operation, and creating an adjustment indicator corresponding to the nursing element;
[0010] Displaying the image data including the adjustment indicator based on a second VR terminal, and deleting the adjustment indicator after determining that the nursing element has completed the element adjustment based on the adjustment indicator.
[0011] Optionally, in the method according to the present invention, displaying image data of a corresponding nursing area based on a first VR terminal includes:
[0012] Determine the nursing floor where the nursing area is located, and perform area extraction on the three-dimensional display map corresponding to the nursing floor to obtain all floor areas corresponding to the same nursing attribute as the nursing area and all floor areas corresponding to the daily attributes;
[0013] In the three-dimensional display map, remove all floor areas corresponding to other nursing attributes except the nursing area, and sequentially fill the remaining nursing area and all floor areas corresponding to the daily attributes into the area display layer to obtain image data corresponding to the nursing area;
[0014] Send the image data to the first VR terminal for display.
[0015] Optionally, in the method according to the present invention, sequentially filling the remaining nursing area and all floor areas corresponding to the daily attributes into the area display layer to obtain image data corresponding to the nursing area includes:
[0016] Taking the nursing area as the center, perform circular division of the corresponding adjacent relationships on all areas corresponding to the daily attributes located around the nursing area to obtain each circular division group;
[0017] Create an area display layer, where the area display layer includes a central display area and each edge display area corresponding to each circular division group that is surrounded zone by zone starting from the central display area;
[0018] Based on the three-dimensional display map, establish a central connection line that connects the first center point of the nursing area to the second center point of each floor area corresponding to the daily attributes;
[0019] Fill the nursing area into the central display area, and create area slots in the edge display areas corresponding to the same circular division group based on the line segment direction of each central connection line;
[0020] Sequentially fill each floor area into each area slot, and form an interaction layer on the area display layer to obtain image data corresponding to the nursing area.
[0021] Optionally, in the method according to the present invention, the method further includes:
[0022] Respond to the patient triggering any area slot in the image data based on the first VR terminal, and generate a replacement guide line pointing from the area slot to the central display area;
[0023] Determine that the patient performs a forward-based sliding operation on the replacement guide wire, replace the floor area located in the area slot with the nursing area located in the central display area, and remove the layer part corresponding to the central display area based on the interactive layer to obtain an updated interactive layer;
[0024] Respond to the patient's reverse-based sliding operation on the replacement guide wire based on the updated interactive layer, replace the nursing area with the floor area located in the central display area, and restore the updated interactive layer.
[0025] Optionally, in the method according to the present invention, in response to an adjustment operation performed by the patient on any nursing element located in the image data based on the first VR end being an effective operation, create an adjustment indicator corresponding to the nursing element, including:
[0026] Based on the image data, determine each nursing element indicating different nursing items located in the nursing area and the patient element indicating the patient, and determine the association attribute based on the positional relationship between each nursing element and the patient element;
[0027] Summarize each nursing element with a direct association attribute into a direct association group, and summarize each nursing element with an indirect association attribute into an indirect association group;
[0028] Determine that the patient performs an adjustment operation on any nursing element located in the direct association group based on the first VR end, and in response to determining that the adjustment operation is an effective operation based on the direct association judgment strategy, create an adjustment indicator corresponding to the nursing element;
[0029] Determine that the patient performs an adjustment operation on any nursing element located in the indirect association group based on the first VR end, and in response to determining that the adjustment operation is an effective operation based on the indirect association judgment strategy, create an adjustment indicator corresponding to the nursing element.
[0030] Optionally, in the method according to the present invention, determining the association attribute based on the positional relationship between each nursing element and the patient element includes:
[0031] Determine the association ratio based on the nursing type of each nursing element;
[0032] In response to the adjacent ratio between the nursing pixel points of any nursing element and the patient pixel points of the patient element being greater than the association ratio corresponding to the nursing element, determine the association attribute as a direct attribute, otherwise summarize the nursing element into a secondary determination group;
[0033] If the adjacent ratio between the care pixel points corresponding to any care element in the secondary determination group and the care pixel points of the care element with the corresponding associated attribute being the direct attribute is greater than the associated ratio of the care element corresponding to the secondary determination group, the associated attribute is determined as the direct attribute; otherwise, it is determined as the indirect attribute.
[0034] Optionally, in the method according to the present invention, it is determined that the patient makes an adjustment operation on any care element located in the direct association group based on the first VR terminal, and in response to determining that the adjustment operation is an effective operation based on the direct association judgment strategy, an adjustment indicator for the corresponding care element is created, including:
[0035] After determining that the patient triggers any care pixel point of any care element located in the direct association group based on the first VR terminal, the care pixel point is determined as the trajectory starting point, and the lower-level amplitude trajectory established by the patient based on the trajectory starting point is obtained;
[0036] Based on the care item corresponding to the trajectory starting point, the current adjustment amplitude and the adjustment amplitude range are obtained, and the adjustment amplitude range is divided based on the current adjustment amplitude to obtain an ascending amplitude range and a descending amplitude range;
[0037] Based on the trajectory end point of the corresponding lower-level amplitude trajectory, an upper-level amplitude trajectory connected to the lower-level amplitude trajectory is generated, and the ascending amplitude range and the descending amplitude range are respectively associated with the upper-level amplitude trajectory and the lower-level amplitude trajectory at the back end;
[0038] In response to the patient adjusting the current adjustment amplitude along any amplitude trajectory based on the trajectory end point, it is determined that the adjustment operation is an effective operation, and the operation trajectory obtained based on the adjustment operation is determined as the adjustment indicator.
[0039] Optionally, in the method according to the present invention, it is determined that the patient makes an adjustment operation on any care element located in the indirect association group based on the first VR terminal, and in response to determining that the adjustment operation is an effective operation based on the indirect association judgment strategy, an adjustment indicator for the corresponding care element is created, including:
[0040] After determining that the patient triggers any care pixel point of any care element located in the indirect association group based on the first VR terminal, the care pixel point is determined as the trajectory starting point, and the adjustment operation of the patient establishing an element association trajectory with the trajectory starting point as the starting point is obtained;
[0041] In response to the trajectory end point of the element association trajectory being located at any patient pixel point of any patient element of the patient element, or at any care pixel point of any care element in the direct association group, it is determined that the adjustment operation is an effective operation, and the element association trajectory is determined as the adjustment indicator.
[0042] Optionally, in the method according to the present invention, after displaying the image data including the adjustment indicator based on the second VR terminal, the method further includes:
[0043] Determining that a medical staff modifies the adjustment indicator based on the second VR terminal, performing pixel identification of a corresponding preset pixel value on a modified part corresponding to the modification operation of the adjustment indicator, and obtaining a modification description voice of the medical staff corresponding to the modification operation;
[0044] Displaying the image data including the modified part based on the first VR terminal, and performing voice broadcast of the corresponding modification description voice to the patient based on the first VR terminal;
[0045] Responding to the patient triggering the modified part based on the first VR terminal within a preset time period, and removing the pixel identification corresponding to the modified part.
[0046] According to another aspect of the present invention, there is provided a nursing interaction device, including:
[0047] A display module configured to display image data corresponding to a nursing area based on the first VR terminal;
[0048] An adjustment module configured to create an adjustment indicator corresponding to a nursing element in response to an adjustment operation of any nursing element located in the image data by a patient based on the first VR terminal being an effective operation;
[0049] A deletion module configured to display the image data including the adjustment indicator based on the second VR terminal, and delete the adjustment indicator after determining that the nursing element has completed element adjustment based on the adjustment indicator.
[0050] According to still another aspect of the present invention, there is provided a readable storage medium storing program instructions, which when read and executed by a computing device, cause the computing device to execute the above method
[0051] According to the solution of the present invention, the real-time performance and accuracy of nursing services are significantly improved, effectively solving the problem of lagging demand response for patients with mobility difficulties. First, patients can intuitively adjust any nursing element located in the nursing area through the first VR terminal, and the server can intelligently judge the effectiveness of the adjustment operation based on the spatial association attributes between the nursing elements and the patients, and generate an adjustment indicator in real time and synchronize it to the second VR terminal of the medical staff, enabling the medical staff to quickly locate the needs and remotely confirm the adjustment plan, greatly shortening the response time and avoiding the deterioration of the condition caused by communication delays. Second, the present invention can also transform complex nursing scenarios into visual spatial models by dividing floor areas, corresponding different adjacent relationship circle-level groupings, and dynamically updating interactive layers, assisting medical staff to accurately understand the needs and operation intentions of patients and reducing the risk of misjudgment. In addition, the present invention also supports a two-way interactive feedback mechanism. Medical staff can modify the adjustment indicator and annotate it with voice, and the patient terminal synchronously receives the modified information and voice guidance, forming a closed-loop communication, which not only reduces the high-frequency inspection burden of medical staff, but also endows patients with the ability to actively participate in nursing decisions, significantly improving the medical experience. Through an intelligent and visual real-time interaction system, the efficient allocation of nursing resources and the instant response to patient needs are realized. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] Figure 1 FIG. shows a flowchart of a nursing interaction method according to an embodiment of the present invention;
[0053] Figure 2 FIG. shows an upper view of a corresponding nursing floor determined based on a three-dimensional display diagram in this embodiment;
[0054] Figure 3 FIG. shows a structural block diagram of a nursing interaction device according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0055] Hereinafter, exemplary embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided so that the present disclosure can be more thoroughly understood and the scope of the present disclosure can be completely conveyed to those skilled in the art.
[0056] To solve the problems existing in the above-mentioned background technology, the inventor proposed the solution of the present invention. An embodiment of the present invention provides a nursing interaction method, which can be executed in a computing device, where the computing device can be understood as a terminal with data processing functions, such as a mobile phone or a computer.
[0057] Figure 1The flowchart of the nursing interaction method of this embodiment is shown. As Figure 1 shown, the method starts from step S101, and in step S101, it includes the following contents:
[0058] Display the image data of the corresponding nursing area based on the first VR terminal.
[0059] For example, in this embodiment, the first VR terminal can be understood as a VR device worn by the corresponding patient, such as a VR glasses. The nursing area can be understood as the nursing ward where the patient is located. That is, based on the content of this step method, during the nursing process of the patient, the patient can wear the first VR terminal to obtain the image data of the corresponding nursing area, so as to understand the overall situation of the nursing area. Among them, the image data is the overall three-dimensional schematic diagram of the corresponding nursing area. Here, the acquisition of the image data can be carried out based on multiple camera units with different shooting orientations preset in the nursing ward. After shooting the nursing ward by the camera unit, multiple two-dimensional images corresponding to different shooting orientations can be obtained. By splicing the multiple two-dimensional images, the three-dimensional schematic diagram corresponding to the nursing, that is, the corresponding image data, can be obtained.
[0060] Furthermore, in this embodiment, the above-mentioned "display the image data of the corresponding nursing area based on the first VR terminal" may further include the following steps:
[0061] Determine the nursing floor where the nursing area is located, and perform area extraction on the three-dimensional display diagram corresponding to the nursing floor to obtain all floor areas corresponding to the same nursing attribute as the nursing area and all floor areas corresponding to the daily attribute;
[0062] Remove all floor areas corresponding to other nursing attributes except the nursing area in the three-dimensional display diagram, and sequentially fill the remaining nursing area and all floor areas corresponding to the daily attribute into the area display layer to obtain the image data corresponding to the nursing area;
[0063] Send the image data to the first VR terminal for display.
[0064] For example, in this embodiment, it can be illustrated that when a patient is being cared for in a care area, in order to determine whether the patient has a need to leave the care area for other outdoor activities (such as going to the bathroom or taking a walk), when acquiring the corresponding image data, all floor areas corresponding to the same care floor as the care area can be acquired correspondingly, and the corresponding image data can be displayed to the patient based on the first VR terminal, so that in subsequent steps, it can be determined whether the patient's real-time needs are generated based on the care area or other floor areas, thereby further improving the comprehensiveness of obtaining the patient's real-time needs. It can be illustrated that in this embodiment, only the image data of all floor areas corresponding to the same care floor as the care area is acquired to avoid the patient having too far a distance for outdoor activities, so as not to impose a greater burden on the patient's body; based on the above content, the corresponding implementation method can be as follows:
[0065] First, the server can respond to the patient's interaction request for the care area, determine the care floor where the care area is located (such as the cardiovascular ward area on the 8th floor of the inpatient department), and retrieve the corresponding three-dimensional building information model (BIM) or preset three-dimensional display diagram of this floor, and extract the floor areas with the same care attributes as the care area (such as medical functional areas such as the nurse station, treatment room, and medicine dispensing room in the same ward area) and the floor areas with corresponding daily attributes (such as patient wards, rest areas, corridors, etc., which are life-related areas);
[0066] Then, the server can further, based on the three-dimensional display diagram (i.e., the floor plan from a top-down perspective), hide or remove other floor areas with the same care attributes except the care area (such as the treatment rooms in other ward areas on the 8th floor), and only retain the care area (such as the 805 ward area where the patient is located) and all care areas with corresponding daily attributes (such as the corridors and restrooms around the 805 ward). This operation filters out irrelevant medical functional areas, focuses on the core scene where the patient is located, and avoids information overload;
[0067] Next, the server creates a regional display layer, and according to the logical hierarchy of "care core - daily association", fills the remaining floor areas with corresponding care attributes and floor areas with corresponding daily attributes into the layer in sequence: that is, the care area (i.e., the patient's ward) can be first placed as the core content in the center of the layer, and then the floor areas with corresponding daily attributes are arranged around it in sequence according to the spatial distance or functional relevance (such as the nurse station adjacent to the ward and the elevator farther away), forming a hierarchical visual layout. Through this structured filling, image data containing the patient's real-time surrounding environment and surrounding associated areas is generated, which not only completely presents the spatial relationship of the care scene but also highlights the core area directly related to the patient;
[0068] Finally, the server transmits the above image data to the first VR device worn by the patient (such as a medical head-mounted display device) in real time for immersive display, enabling the patient to intuitively view the nursing area and its surrounding environment from a three-dimensional perspective. In relevant application scenarios, when the patient needs to adjust nursing items (such as the height of the hospital bed, the infusion rate) or give feedback on needs, the image data provides an accurate interaction carrier for them. That is, based on the clear area division, the patient can quickly locate and operate the corresponding nursing elements in the subsequent method steps, and enable medical staff to synchronously obtain the corresponding information through the second VR device, and grasp the specific needs location and content of the patient in real time.
[0069] Based on the above technical solutions, it can be seen that this method effectively filters redundant information through area extraction and hierarchical display, improving the clarity of the patient's interaction goals; at the same time, the structured image data lays a foundation for the accurate positioning and transmission of subsequent adjustment indicators, ensuring that medical staff can capture the patient's spatial needs in real time and accurately, reducing communication errors and response delays, significantly improving the demand transmission efficiency and the pertinence of nursing operations in clinical nursing, and providing visual and interactive technical support for precise medical care.
[0070] Furthermore, in this embodiment, the above "filling the remaining nursing area and all floor areas corresponding to the daily attributes into the area display layer in sequence to obtain the image data corresponding to the nursing area" may further include the following steps:
[0071] Taking the nursing area as the center, making a circular-level division of the corresponding adjacent relationship for all areas corresponding to the daily attributes around the nursing area to obtain each circular-level grouping;
[0072] Creating an area display layer, where the area display layer includes a central display area and each edge display area corresponding to each circular-level grouping that surrounds the central display area one by one starting from the central display area;
[0073] Based on the three-dimensional display map, establishing a central connection line connecting the first center point of the nursing area and the second center point of each floor area corresponding to the daily attributes;
[0074] Filling the nursing area into the central display area, and creating area slots in the edge display areas corresponding to the same circular-level grouping based on the line segment direction of each central connection line;
[0075] Filling each floor area into each area slot in sequence, and forming an interaction layer above the area display layer to obtain the image data corresponding to the nursing area.
[0076] For example, in this embodiment, after obtaining all corresponding floor areas, in order to improve the display effect and display priority of the nursing area and the floor area, the following content can be used for implementation:
[0077] First, taking the nursing area (such as Ward 302 where the patient is located) as the spatial origin, the floor areas (such as the ward corridor, nurse station, washroom, etc.) around its corresponding daily attributes are divided into circle levels according to the proximity relationship, that is, the floor areas adjacent to the nursing area are divided into the first circle level, the next adjacent floor areas are divided into the second circle level, and so on, forming each circle level grouping, so that the patient can have an intuitive understanding of the spatial relationship of the surrounding environment. For example, Figure 2 shows the top view of the floor of the corresponding nursing floor determined based on the three-dimensional display diagram. Among them, the top view of the floor includes the nursing area and the floor areas with corresponding daily attributes, that is, Area A, Area B, Area C, Area D, Area E, and Area F. Based on Figure 2 it can be known that among them, Area A, Area C, and Area D are all adjacent (that is, directly adjacent) to the nursing area. Therefore, Area A, Area C, and Area D can be divided into the first circle level, while Area B, Area E, and Area F are all in the state of being next adjacent (that is, indirectly adjacent, with another floor area in the middle) to the nursing area. Therefore, Area B, Area E, and Area F can be divided into the second circle level;
[0078] Then, the server creates an area display layer. It should be noted that this layer contains two major functional areas: the central display area is used to focus on the core nursing area (such as the nursing area where the patient is currently located), and the edge display area starts from the central display area and surrounds layer by layer from the inside out according to the circle level grouping (for example, the edge display area corresponding to the first circle level surrounds the central display area, and the edge display area corresponding to the second circle level surrounds the edge display area corresponding to the first circle level), constructing a hierarchical spatial display structure;
[0079] Next, based on the coordinate data of the three-dimensional display diagram, a central connection line is established between the first central point (such as the geometric center of the ward) of the nursing area and the second central point (such as the center of the nurse station) of each corresponding floor area with daily attributes. The layout orientation of each floor area in the edge display area is determined by the line segment direction of this connection line (such as the northeast direction, southwest direction). For example, for the nurse station located 5 meters in the northeast direction of the nursing area, the center connection line points to the northeast, so a corresponding area slot is created in the northeast orientation of the edge display area corresponding to the first circle level;
[0080] Furthermore, fill the nursing area into the central display area, and according to the orientation guidance of the central connection line, fill the floor areas within each circle-level grouping into the corresponding area slots of the edge display areas in sequence (for example, fill the nurse station into the northeast slot of the first circle level, and fill the restroom into the southwest slot of the first circle level), forming a visual layout of "central core area - peripheral circle area";
[0081] Finally, the server can further overlay an interaction layer on top of the area display layer. It should be noted that this layer supports operations such as touch and drag by the patient through the first VR terminal, that is, the real-time needs of the patient can be determined based on the interaction operations of the patient, so as to help medical staff obtain the real-time needs of the patient based on a long distance in the subsequent process, achieve real-time response to precise nursing operations, effectively shorten the demand processing time in clinical nursing, and improve the timeliness and pertinence of nursing services.
[0082] In addition, in order to help medical staff quickly determine whether the real-time needs of the patient are generated based on the nursing area or other floor areas in the subsequent process, in this embodiment, the following method steps can further be included:
[0083] Respond to the patient's trigger on any area slot of the image data based on the first VR terminal, and generate a replacement guide line pointing from this area slot to the central display area;
[0084] Determine that the patient performs a forward sliding operation on the replacement guide line, replace the floor area in the area slot with the nursing area in the central display area, and remove the layer part corresponding to the central display area based on the interaction layer to obtain an updated interaction layer;
[0085] Respond to the patient's reverse sliding operation on the replacement guide line based on the updated interaction layer, replace the nursing area with the floor area in the central display area, and restore the updated interaction layer.
[0086] For example, in this embodiment, when the patient needs to select a specific associated area to accurately transmit the demand, it can be achieved based on the following method steps:
[0087] First, the server can respond to the patient's touch or gesture trigger operation on any area slot in the image data based on the first VR terminal. The server can automatically generate a replacement guide line pointing from this area slot to the central display area, which is presented in a highlighted color or a dynamic arrow form, clearly indicating the interactive spatial path;
[0088] Then, when it is detected that the patient performs a forward sliding operation along the replacement guide line based on the first VR terminal (such as sliding from the area slot towards the central display area), the server immediately executes the area replacement logic: replaces the floor area located in the area slot to the central display area, so as to ensure that the patient can determine the corresponding real-time needs based on the floor area of the selected area slot in the subsequent process. And considering the processing efficiency of data processing, in this embodiment, after any floor area replaces the nursing area located in the central display area, the layer part of the corresponding nursing area located in the central display area can also be removed synchronously based on the interactive layer, that is, the patient cannot interact with the floor area located in the central display area based on the interactive layer in the subsequent process, thereby reducing the corresponding data processing volume. And when the patient selects other floor areas to replace the nursing area located in the central display area, it can also synchronously represent that the patient wants to move from the current nursing area to the corresponding floor area for the medical staff to obtain real-time needs in the subsequent process;
[0089] Finally, if the patient wants to determine the real-time needs based on the current nursing area, the patient can perform a reverse sliding operation along the replacement guide line (such as sliding from the central display area to the slot), and the server can also automatically execute the corresponding restoration logic: relocate the floor area of the current central display area back to the original area slot and restore the layer display of the initial nursing area in the central display area, so that the interactive layer is restored to the state before the operation, thereby supporting the patient to dynamically switch the core display content as needed and satisfying the focusing and reset operations under different nursing needs.
[0090] In step S102, the following contents are included:
[0091] In response to the adjustment operation of any nursing element located in the image data by the patient based on the first VR terminal being an effective operation, create an adjustment indicator for the corresponding nursing element.
[0092] For example, in this embodiment, after the patient obtains the image data of the corresponding nursing area based on the first VR terminal, if the patient has corresponding real-time needs, the patient can use the first VR terminal to perform adjustment operations on the corresponding nursing elements in the image data to indicate the real-time needs. It should be noted that the nursing elements can be understood as various nursing items located in the nursing area. For example, bedding, patient clothing, etc. When the patient wants to adjust the covering method of the bedding, the patient can perform adjustment operations based on the corresponding nursing elements. Similarly, when the patient wants to adjust the wearing method of the patient clothing, the patient can also perform adjustment operations based on the corresponding nursing elements. After determining that the patient has completed the adjustment operation of the corresponding nursing element, the server can further determine whether the adjustment operation is effective, and create an adjustment indicator for the corresponding nursing element based on the effective situation, so that medical staff can obtain the patient's real-time needs based on the creation of the adjustment indicator in the subsequent process.
[0093] Further, in this embodiment, the above "responding to the adjustment operation of any nursing element located in the image data by the patient based on the first VR terminal as an effective operation and creating an adjustment indicator for the corresponding nursing element" may further include the following steps:
[0094] Based on the image data, determine each nursing element indicating different nursing items located in the nursing area and the patient element indicating the patient, and determine the association attribute based on the positional relationship between each nursing element and the patient element;
[0095] Summarize each nursing element with a corresponding association attribute of a direct attribute into a direct association group, and summarize each nursing element with a corresponding association attribute of an indirect attribute into an indirect association group;
[0096] Determine that the patient performs an adjustment operation on any nursing element located in the direct association group based on the first VR terminal, and respond to determining that the adjustment operation is an effective operation based on the direct association judgment strategy, and create an adjustment indicator for the corresponding nursing element;
[0097] Determine that the patient performs an adjustment operation on any nursing element located in the indirect association group based on the first VR terminal, and respond to determining that the adjustment operation is an effective operation based on the indirect association judgment strategy, and create an adjustment indicator for the corresponding nursing element.
[0098] For example, in this embodiment, generating a corresponding adjustment indicator based on the patient's real-time needs can be specifically implemented based on the following content:
[0099] First, two types of core elements can be identified based on the image data of the corresponding nursing area displayed on the first VR terminal. Specifically, it includes nursing elements (such as virtual identifiers of nursing items like hospital beds, infusion pumps, call buttons, etc.) and patient elements (virtual identifiers representing the real-time position of the patient). Here, the corresponding identification method can be based on OpenCV;
[0100] Then, by calculating the spatial position relationship (such as geometric distance) between each nursing element and the patient element, the associated attribute of each nursing element is determined. For example, the infusion pump adjacent to the patient's hospital bed, which directly serves the patient's treatment, is defined as a "direct attribute"; the magazine on the seat at the door, since it has no direct contact with the patient, is thus positioned as an "indirect attribute";
[0101] Next, the server can summarize the nursing elements with the associated attribute of "direct attribute" into the direct association group, and summarize the nursing elements with the associated attribute of "indirect attribute" (such as the medicine cabinet at the nurse station, the icon of remote inspection equipment) into the indirect association group to form a hierarchical demand processing queue;
[0102] Then, for the direct association group, when it is detected that the patient makes adjustment operations such as touching and dragging on the nursing elements (such as adjusting the flow rate of the infusion pump) in the direct association group based on the first VR terminal, the server triggers the direct association judgment strategy to determine whether the adjustment operation is a valid demand. If it is determined to be valid, an adjustment indicator for the corresponding nursing element (such as a red flashing arrow pointing to the infusion pump icon) is immediately created, and this indicator is synchronously displayed on the second VR terminal of the medical staff, so that the medical staff can obtain the real-time needs of the corresponding patient based on the second VR terminal;
[0103] For the indirect association group, when it is detected that the patient makes adjustment operations such as touching and dragging on the nursing elements (the magazine on the seat) in the indirect association group based on the first VR terminal, the server triggers the direct association judgment strategy to determine whether the adjustment operation is a valid operation. If it is determined to be a valid operation, a corresponding adjustment indicator is created, and this indicator is synchronously displayed on the second VR terminal of the medical staff, so that the medical staff can obtain the real-time needs of the corresponding patient based on the second VR terminal;
[0104] It can be explained that in this embodiment, for nursing elements with different associated attributes, different association judgment strategies are simultaneously preset in this embodiment to perform targeted operation judgments to determine whether the adjustment operation of each corresponding nursing element is a valid operation, and the adjustment indicators generated based on different associated attributes can, for example, have different pixel values, so as to differentially prompt the medical staff of the real-time needs corresponding to different associated attributes that need to be coordinated and processed.
[0105] Further, in this embodiment, the above "determining the association attribute based on the positional relationship between each nursing element and the patient element" may further include the following steps:
[0106] Determine the association ratio based on the nursing type of each nursing element;
[0107] In response to the adjacent ratio between the nursing pixel points of any nursing element and the patient pixel points of the patient element being greater than the association ratio corresponding to the nursing element, determine the association attribute as the direct attribute; otherwise, summarize the nursing element into the secondary determination group.
[0108] In response to the adjacent ratio between the nursing pixel points of any nursing element located in the secondary determination group and the nursing pixel points of the nursing element with a direct attribute as the association attribute being greater than the association ratio corresponding to the nursing element located in the secondary determination group, determine the association attribute as the direct attribute; otherwise, determine it as the indirect attribute.
[0109] For example, in this embodiment, for the determination of the association attribute of each nursing element, it can be specifically carried out based on the following implementation method:
[0110] First, for each obtained nursing element, the corresponding association ratio can be determined according to its nursing type. It should be noted that the association ratio can be understood as being set in advance, and it specifically represents the ratio of the area where the nursing element is in contact with the patient. For example, when the beddings cover the patient (i.e., in the contact state), the corresponding area ratio should be relatively high, while when the beddings are not covering the patient (i.e., in the separated state) and are only placed beside the patient, the corresponding area ratio should be relatively small. Therefore, based on this, the area ratio for distinguishing different element states can be set for each nursing type.
[0111] Then, the server can perform spatial position analysis at the corresponding pixel level through the image data, that is, calculate the adjacent ratio between the nursing pixel points (representing the display area of the nursing element in the VR interface) of any nursing element and the patient pixel points (representing the display area of the patient element in the VR interface) of the patient element, that is, the ratio of the number of adjacent pixels of the two to the total number of pixels of the nursing element. If the adjacent ratio of a certain nursing element is greater than its association ratio, it is directly determined as the direct attribute, indicating that the element is in contact with the patient; if the adjacent ratio is less than the association ratio, it indicates that the nursing element is in a separated state from the patient. At this time, it needs to be summarized into the secondary determination group and enter the secondary determination process.
[0112] Finally, for the nursing elements within the secondary determination group, the server further calculates the secondary adjacent ratio between the nursing pixel points of a nursing element and those of the nursing elements whose direct attributes have been determined. If the secondary adjacent ratio of a certain nursing element is greater than its own association ratio, it indicates that the nursing element is in contact with the nursing elements whose direct attributes have been determined. At this time, this nursing element is determined as a direct attribute; if it is less than its own association ratio, it indicates that the nursing element is not in a separated state from the nursing elements whose direct attributes have been determined, and at this time, this nursing element is determined as an indirect element.
[0113] Here, based on the above content, it can be known that after completing the determination of the associated attributes, corresponding judgment strategies can be further configured based on the differences in the associated attributes to determine whether the adjustment operation of the patient is an effective operation, and the corresponding judgment process can be described as follows:
[0114] On the one hand, for the nursing elements whose associated attributes are direct attributes, the above-mentioned "determine that the patient makes an adjustment operation on any nursing element located in the direct association group based on the first VR terminal, and respond to determine that the adjustment operation is an effective operation based on the direct association judgment strategy, and create an adjustment indicator for the corresponding nursing element" can include the following steps:
[0115] After determining that the patient triggers any nursing pixel point of any nursing element located in the direct association group based on the first VR terminal, determine this nursing pixel point as the starting point of the trajectory, and obtain the lower-level amplitude trajectory established by the patient based on this starting point of the trajectory;
[0116] Obtain the current adjustment amplitude and the adjustment amplitude interval based on the nursing item corresponding to the starting point of the trajectory, and divide the adjustment amplitude interval based on the current adjustment amplitude to obtain an ascending amplitude interval and a descending amplitude interval;
[0117] Generate a higher-level amplitude trajectory connected to the lower-level amplitude trajectory based on the ending point of the lower-level amplitude trajectory, and perform back-end association of the ascending amplitude interval and the descending amplitude interval with the higher-level amplitude trajectory and the lower-level amplitude trajectory respectively;
[0118] Respond to the patient's adjustment operation on the current adjustment amplitude along any amplitude trajectory based on the ending point of the trajectory, determine that the adjustment operation is an effective operation, and determine the operation trajectory obtained based on the adjustment operation as the adjustment indicator.
[0119] For example, in this embodiment, the technical solution of determining whether the adjustment operation is an effective operation based on the direct association judgment strategy and generating an adjustment indicator in the case of a corresponding effective operation can be based on the following content:
[0120] First, in response to the patient's touch or gesture trigger operation on the nursing pixel points of any nursing element within the directly associated group based on the first VR terminal (such as the flow rate adjustment button area corresponding to the infusion pump), the server determines the trigger position as the starting point of the trajectory and real-time obtains the subordinate amplitude trajectory established by the patient starting from this point (such as the initial operation trajectory sliding horizontally, representing the direction trend of parameter adjustment);
[0121] Then, based on the nursing item corresponding to the starting point of the trajectory (such as the "flow rate adjustment" function corresponding to the infusion pump), the server retrieves its current adjustment amplitude (such as the current flow rate is 50 ml / h) and the preset adjustment amplitude range (such as 0 - 100 ml / h). Taking the current amplitude as the demarcation point, the amplitude range is divided into an ascending amplitude range (50 - 100 ml / h, corresponding to speed increase adjustment) and a descending amplitude range (0 - 50 ml / h, corresponding to speed decrease adjustment), providing a quantitative reference for subsequent operations;
[0122] Next, based on the end point of the subordinate amplitude trajectory (such as the position where the patient's finger stops sliding), a superior amplitude trajectory connected to the subordinate amplitude trajectory is generated (such as a virtual trajectory extending upward / downward from the end point, representing the adjustable amplitude range), and the ascending amplitude range is logically associated with the superior trajectory, and the descending amplitude range is logically associated with the subordinate trajectory, so that the trajectory direction corresponds one-to-one with the parameter increase or decrease (such as sliding upward corresponds to the ascending range, and sliding downward corresponds to the descending range);
[0123] Finally, when it is detected that the patient continues to slide along any amplitude trajectory (such as the superior amplitude trajectory or the subordinate amplitude trajectory) from the end point of the trajectory to adjust the current amplitude (such as sliding upward from the 50 ml / h position to 70 ml / h), the server determines that this adjustment operation is a valid operation, and simultaneously determines the operation trajectory (such as a trajectory line with an arrow, where the arrow direction indicates the adjustment direction and the trajectory length corresponds to the adjustment amplitude) reflecting the operation path and adjustment parameters as the adjustment indicator, and synchronizes it to the second VR terminal of the medical staff in real time to prompt the real-time demand of the corresponding direct attribute.
[0124] Based on the above technical solutions, it can be seen that in this embodiment, by deeply integrating the physical operation trajectory with the parameter adjustment logic, a quantitative judgment basis is provided for the interaction of directly associated nursing elements, effectively reducing the information error in nurse-patient communication. It is particularly applicable to the nursing scenarios of patients with language communication disorders or severe patients, providing key technical support for realizing the intelligent nursing closed-loop of "real-time demand - instant response".
[0125] On the other hand, for the nursing elements whose associated attribute is an indirect attribute, the above "determine that the patient makes an adjustment operation on any nursing element located in the directly associated group based on the first VR terminal, and in response to determining that the adjustment operation is a valid operation based on the direct association judgment strategy, create an adjustment indicator for the corresponding nursing element" may include the following steps:
[0126] After determining that the patient triggers any nursing pixel point of any nursing element in the indirect association group based on the first VR terminal, determine this nursing pixel point as the trajectory starting point, and obtain the adjustment operation of the patient to establish an element association trajectory with this trajectory starting point;
[0127] In response to the trajectory end point of the element association trajectory being located at any patient pixel point of any patient element of the patient element, or at any nursing pixel point of any nursing element in the direct association group, determine that this adjustment operation is a valid operation, and determine this element association trajectory as an adjustment indicator.
[0128] For example, in this embodiment, the technical solution for determining whether the adjustment operation is a valid operation based on the indirect association judgment strategy and generating an adjustment indicator in the case of corresponding valid operation can be based on the following content
[0129] First, the server can respond to the touch or gesture trigger operation of the patient on the nursing pixel point of any nursing element in the indirect association group based on the first VR terminal, determine this trigger position as the trajectory starting point, and obtain in real time the adjustment operation of the patient to establish an element association trajectory with this point as the starting point (such as a continuous action of dragging, representing an attempt to establish a demand association);
[0130] Next, the server verifies the spatial position of the trajectory end point of the element association trajectory: If this end point falls within the range of the patient pixel points of the patient element, or within the range of the nursing pixel points of any nursing element in the direct association group, then determine that this adjustment operation is a valid operation, that is, it indicates that the patient has established a clear association between the indirect nursing element and his own needs through the trajectory operation, representing that the patient wants to obtain this nursing element; And after confirming that the operation is valid, the server can determine the complete element association trajectory as an adjustment indicator, and this indicator is synchronously displayed on the second VR terminal of the medical staff, and at the same time, it can also prompt the real-time demand of the corresponding indirect attribute in a differentiated form (such as a dotted line trajectory + text annotation).
[0131] In step S103, the following content is included:
[0132] Based on the second VR terminal, display the image data including this adjustment indicator, and after determining that the nursing element has completed the element adjustment based on this adjustment indicator, delete this adjustment indicator.
[0133] For example, in this embodiment, the second VR terminal can be understood as the VR device used by the corresponding medical staff. Similar to the first VR terminal, it can also be a VR glasses. Among them, the first VR terminal and the second VR terminal can be interconnected based on the communication protocol. When the patient completes the corresponding adjustment operation on a certain nursing element based on the first VR terminal, the image data including the adjustment indicator can be sent to the second VR terminal for display. Thus, the medical staff can quickly obtain the real-time needs of the patient based on the adjustment indicator, so as to provide off-line demand assistance. After meeting the real-time needs of the patient, that is, after determining that the corresponding nursing element has completed the element adjustment based on the adjustment indicator, the adjustment indicator can be deleted accordingly to indicate that the corresponding real-time need has been solved. Here, it can be manually determined by the patient whether the nursing element has been adjusted accordingly based on the adjustment indicator. For example, the patient can generate a corresponding demand completion signal based on the first VR terminal to delete the adjustment indicator.
[0134] In addition, in some cases, when the medical staff obtains the image data including the adjustment indicator based on the second VR terminal, if the medical staff believes that the real-time needs of the patient cannot be realized (for example, the patient feels hot and wants to remove the bedding covering him, but in the current situation, the patient has a fever and it is not suitable to completely remove the bedding, there is a risk of aggravating the condition), the medical staff needs to modify the real-time needs of the patient based on the actual situation, and the corresponding modification process can be realized based on the following steps:
[0135] Determine that the medical staff performs a modification operation on the adjustment indicator based on the second VR terminal, perform pixel identification of the modified part of the modification operation of the adjustment indicator with a corresponding preset pixel value, and obtain the modification instruction voice of the medical staff corresponding to the modification operation;
[0136] Based on the first VR terminal, display the image data including the modified part, and perform voice broadcast of the corresponding modification instruction voice to the patient based on the first VR terminal;
[0137] Respond to the trigger of the modified part by the patient based on the first VR terminal within the preset time period, and remove the pixel identification corresponding to the modified part.
[0138] For example, in this embodiment, the specific process of the medical staff modifying the adjustment indicator based on the second VR terminal can be described as follows:
[0139] First, when medical staff modify the adjustment indicator based on the second VR terminal, the server will identify the modified part of the corresponding modification operation of the adjustment indicator with the corresponding preset pixel values. At the same time, the server will obtain the modification description voice of the medical staff for this modification operation. For example, the patient requests to adjust the infusion rate through the first VR terminal, and an adjustment indicator is generated and displayed on the second VR terminal. The medical staff modifies the indicator based on professional judgment, such as adjusting the infusion rate to a more appropriate value. The server will mark this modified part with a specific color or symbol (corresponding to the preset pixel value), and record the description voice of the medical staff for this modification, such as "Considering your physical condition, the infusion rate is appropriately reduced";
[0140] Then, based on the first VR terminal, the image data containing the above-mentioned modified part is displayed, and the corresponding modification description voice of the medical staff is broadcasted to the patient through the first VR terminal. In this way, the patient can intuitively see the modified content and clearly understand the reason for the modification through the voice. For example, in the above example of adjusting the infusion rate, the patient sees the modification display of the infusion rate on the first VR terminal and hears the voice explanation of the medical staff at the same time, so as to better understand the decision-making of the medical staff;
[0141] Next, if the patient triggers the modified part based on the first VR terminal within the preset time period, the server will remove the pixel identification of the corresponding modified part. This operation means that the patient has viewed and understood the modified content, completing the confirmation and interaction of information. For example, within a few minutes (preset time period) after hearing the voice broadcast, the patient clicks on the modified infusion rate part on the first VR terminal, and the server will remove the pixel identification of this part.
[0142] Based on the above content, it can be seen that in this embodiment, by identifying the modified part with pixel values and obtaining the modification description voice of the medical staff, the accuracy and professionalism of information transmission can be ensured, avoiding misunderstandings of the modified content by the patient. And by synchronizing the modified content and the description voice to the first VR terminal, the patient can timely understand the decision-making of the medical staff, enhancing the trust between the patient and the medical staff. The mechanism of removing the pixel identification after the patient triggers the modified part can effectively confirm whether the patient has received and understood the information, realizing the closed-loop management of information interaction, improving the efficiency and quality of the nursing process, and ensuring accurate and timely nursing effects.
[0143] In summary, this embodiment significantly improves the real-time performance and accuracy of nursing services, effectively solving the problem of lagging demand response for patients with limited mobility. First, patients can intuitively adjust any nursing element in the nursing area through the first VR terminal, and the server can intelligently judge the effectiveness of the adjustment operation based on the spatial association attributes between the nursing elements and the patients, and generate an adjustment indicator in real time and synchronize it to the second VR terminal of the medical staff, enabling the medical staff to quickly locate the demand and remotely confirm the adjustment plan, greatly shortening the response time and avoiding the deterioration of the condition caused by communication delays. Second, this embodiment can also transform complex nursing scenarios into visual spatial models by dividing floor areas, circle-level grouping based on proximity relationships, and dynamic updating of interactive layers, assisting medical staff in accurately understanding patients' needs and operation intentions and reducing the risk of misjudgment. In addition, this embodiment also supports a two-way interactive feedback mechanism. Medical staff can modify the adjustment indicator and voice annotate it, and the patient terminal synchronously receives the modification information and voice guidance, forming a closed-loop communication, which not only reduces the high-frequency inspection burden on medical staff but also endows patients with the ability to actively participate in nursing decisions, significantly improving the medical experience. Through an intelligent and visual real-time interaction system, the efficient allocation of nursing resources and the instant response to patients' needs are realized.
[0144] Another embodiment of the present invention provides a nursing interaction device. Figure 3 The corresponding device block diagram is as follows. The device includes:
[0145] A display module configured to display image data of the corresponding nursing area based on the first VR terminal;
[0146] An adjustment module configured to create an adjustment indicator for the corresponding nursing element in response to an adjustment operation of any nursing element located in the image data by the patient based on the first VR terminal being an effective operation;
[0147] A deletion module configured to display image data including the adjustment indicator based on the second VR terminal, and delete the adjustment indicator after determining that the nursing element has completed the element adjustment based on the adjustment indicator.
[0148] Another embodiment of the present invention provides a readable storage medium storing program instructions. When the program instructions are read and executed by a computing device, the computing device is caused to execute the nursing interaction method as described above.
[0149] In the specification provided herein, the algorithms and displays are not inherently related to any particular computer, virtual system, or other device. Various general-purpose systems can also be used in conjunction with the examples of the present invention. Based on the above description, the structure required to construct such systems will be apparent. Additionally, the present invention is not directed to any particular programming language. It should be understood that the content of the present invention described herein can be implemented using various programming languages, and the description of a particular language above is for the purpose of disclosing the preferred embodiments of the present invention.
[0150] In the specification provided herein, a number of specific details are set forth. However, it will be understood that embodiments of the present invention may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this specification.
[0151] Similarly, it should be understood that, in order to streamline this disclosure and assist in understanding one or more of the various inventive aspects, in the description of the exemplary embodiments of the present invention above, the various features of the present invention are sometimes grouped together in a single embodiment, figure, or description thereof.
[0152] Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in the devices as described in that embodiment, or alternatively may be located in one or more devices different from those of the example. The modules in the foregoing examples may be combined into one module or further divided into multiple sub-modules.
[0153] Those skilled in the art can understand that the modules in the devices of the embodiments can be adaptively changed and arranged in one or more devices different from that embodiment. The modules or units or components in the embodiments can be combined into one module or unit or component, and furthermore can be divided into multiple sub-modules or sub-units or sub-components.
[0154] In addition, those skilled in the art will appreciate that, although some of the embodiments described herein include certain features included in other embodiments but not others, the combination of the features of different embodiments is meant to be within the scope of the present invention and forms different embodiments.
[0155] In addition, some of the embodiments described herein are described as methods or combinations of method elements that can be implemented by a processor of a computer system or by other devices performing the functions. Accordingly, a processor having the necessary instructions for implementing the method or method elements forms a device for implementing the method or method elements. In addition, the elements described herein in the device embodiments are examples of the following devices: the devices for implementing the functions performed by the elements for the purpose of implementing the invention.
[0156] As used herein, unless otherwise specified, use of the ordinal numbers "first", "second", "third", etc. to describe a common object merely indicates different instances of similar objects and is not intended to imply that the objects so described must be in a given order, whether temporally, spatially, in ranking, or in any other manner.
[0157] Although the invention has been described based on a limited number of embodiments, those skilled in the art of the present technology will appreciate that other embodiments can be conceived within the scope of the invention as thus described. In addition, it should be noted that the language used in this specification has been primarily selected for readability and teaching purposes rather than for the purpose of interpreting or limiting the subject matter of the invention.
Claims
1. A nursing interaction method, characterized in that, Including the following steps: Based on the first VR terminal, display the image data of the corresponding nursing area; In response to the patient's adjustment operation on any nursing element located in the image data on the first VR terminal being an effective operation, create an adjustment indicator for the corresponding nursing element; Based on the second VR terminal, display the image data including the adjustment indicator, and after determining that the nursing element has completed the element adjustment based on the adjustment indicator, delete the adjustment indicator.
2. The nursing interaction method according to claim 1, wherein: Based on the first VR terminal, displaying the image data of the corresponding nursing area includes: Determine the nursing floor where the nursing area is located, and perform area extraction on the three-dimensional display map corresponding to the nursing floor to obtain all floor areas corresponding to the same nursing attribute as the nursing area and all floor areas corresponding to the daily attribute; Remove all other floor areas corresponding to the nursing attribute except the nursing area in the three-dimensional display map, and sequentially fill the remaining nursing area and all floor areas corresponding to the daily attribute into the area display layer to obtain the image data of the corresponding nursing area; Send the image data to the first VR terminal for display.
3. The nursing interaction method according to claim 2, wherein: Sequentially filling the remaining nursing area and all floor areas corresponding to the daily attribute into the area display layer to obtain the image data of the corresponding nursing area includes: Centering on the nursing area, perform circular division of the corresponding proximity relationship on all areas corresponding to the daily attribute around the nursing area to obtain each circular division group; Create an area display layer, where the area display layer includes a central display area and each edge display area corresponding to each circular division group that surrounds the central display area zone by zone starting from the central display area; Based on the three-dimensional display map, establish a central connection line connecting the first center point of the nursing area and the second center point of each floor area corresponding to the daily attribute; Fill the nursing area into the central display area, and create area slots in the edge display areas corresponding to the same circular division group based on the line direction of each central connection line; Sequentially fill each floor area into each area slot, and form an interaction layer above the area display layer to obtain the image data of the corresponding nursing area.
4. The nursing interaction method according to claim 3, wherein: The method further includes: In response to the patient triggering any area slot in the image data on the first VR terminal, generate a replacement guiding line pointing from the area slot to the central display area; Determine that the patient performs a forward sliding operation on the replacement guiding line, replace the floor area in the area slot with the nursing area in the central display area, and remove the layer part corresponding to the central display area based on the interaction layer to obtain an updated interaction layer. In response to the patient's reverse sliding operation on the replacement guiding line based on the updated interaction layer, the nursing area replaces the floor area in the central display area, and the updated interaction layer is restored.
5. The nursing interaction method according to claim 1, wherein: In response to the adjustment operation of any nursing element located in the image data by the patient based on the first VR end being an effective operation, an adjustment indicator corresponding to the nursing element is created, including: Based on the image data, each nursing element indicating different nursing items and the patient element indicating the patient located in the nursing area are determined, and the association attribute is determined based on the positional relationship between each nursing element and the patient element; Each nursing element with the corresponding association attribute being the direct attribute is summarized into the direct association group, and each nursing element with the corresponding association attribute being the indirect attribute is summarized into the indirect association group; It is determined that the patient adjusts any nursing element located in the direct association group based on the first VR end, and in response to determining that the adjustment operation is an effective operation based on the direct association judgment strategy, an adjustment indicator corresponding to the nursing element is created; It is determined that the patient adjusts any nursing element located in the indirect association group based on the first VR end, and in response to determining that the adjustment operation is an effective operation based on the indirect association judgment strategy, an adjustment indicator corresponding to the nursing element is created.
6. The nursing interaction method according to claim 5, wherein: Determining the association attribute based on the positional relationship between each nursing element and the patient element includes: Determining the association ratio based on the nursing type of each nursing element; In response to the adjacent ratio between the nursing pixel points of any nursing element and the patient pixel points of the patient element being greater than the association ratio corresponding to the nursing element, the association attribute is determined as the direct attribute, otherwise, the nursing element is summarized into the secondary determination group; In response to the adjacent ratio between the nursing pixel points of any nursing element located in the secondary determination group and the nursing pixel points of the nursing element with the corresponding association attribute being the direct attribute being greater than the association ratio corresponding to the nursing element located in the secondary determination group, the association attribute is determined as the direct attribute, otherwise, it is determined as the indirect attribute.
7. The nursing interaction method according to claim 5, wherein: Determining that the patient adjusts any nursing element located in the direct association group based on the first VR end, and in response to determining that the adjustment operation is an effective operation based on the direct association judgment strategy, creating an adjustment indicator corresponding to the nursing element, including: After determining that the patient triggers any nursing pixel point of any nursing element located in the direct association group based on the first VR end, the nursing pixel point is determined as the trajectory starting point, and the subordinate amplitude trajectory established by the patient based on the trajectory starting point is obtained; Based on the nursing item corresponding to the trajectory starting point, the current adjustment amplitude and the adjustment amplitude range are obtained, and the adjustment amplitude range is divided based on the current adjustment amplitude to obtain the ascending amplitude range and the descending amplitude range; Generate a superior amplitude trajectory that connects to the inferior amplitude trajectory based on the trajectory end point corresponding to the inferior amplitude trajectory, and perform a back-end association between the ascending amplitude interval and the descending amplitude interval with the superior amplitude trajectory and the inferior amplitude trajectory respectively; In response to the patient adjusting the current adjustment amplitude along any amplitude trajectory based on the trajectory end point, determine that the adjustment operation is a valid operation, and determine the operation trajectory obtained based on the adjustment operation as an adjustment indicator.
8. The nursing interaction method according to claim 5, wherein: Determine that the patient performs an adjustment operation on any nursing element located in the indirect association group based on the first VR terminal, and in response to determining that the adjustment operation is a valid operation based on the indirect association judgment strategy, create an adjustment indicator for the corresponding nursing element, including: After determining that the patient triggers any nursing pixel point of any nursing element located in the indirect association group based on the first VR terminal, determine the nursing pixel point as the trajectory start point, and obtain the adjustment operation of the patient to establish an element association trajectory with the trajectory start point as the starting point; In response to the trajectory end point of the element association trajectory being located at any patient pixel point of any patient element of the patient element, or at any nursing pixel point of any nursing element located in the direct association group, determine that the adjustment operation is a valid operation, and determine the element association trajectory as an adjustment indicator.
9. The nursing interaction method according to claim 1, wherein: After displaying the image data including the adjustment indicator based on the second VR terminal, further include: Determine that the medical staff performs a modification operation on the adjustment indicator based on the second VR terminal, perform pixel identification of the modified part corresponding to the modification operation of the adjustment indicator with a corresponding preset pixel value, and obtain the modification description voice of the medical staff corresponding to the modification operation; Display the image data including the modified part based on the first VR terminal, and perform voice broadcast of the corresponding modification description voice to the patient based on the first VR terminal; In response to the patient triggering the modified part based on the first VR terminal within a preset time period, remove the pixel identification corresponding to the modified part.
10. A nursing interaction device, characterized in that, Including: A display module configured to display image data corresponding to a nursing area based on the first VR terminal; An adjustment module configured to create an adjustment indicator for a corresponding nursing element in response to a valid adjustment operation of the patient on any nursing element located in the image data based on the first VR terminal; A deletion model configured to display the image data including the adjustment indicator based on the second VR terminal, and delete the adjustment indicator after determining that the nursing element has completed element adjustment based on the adjustment indicator.
11. A readable storage medium storing program instructions, which when read and executed by a computing device, cause the computing device to execute the method according to any one of claims 1-9.
Citation Information
Patent Citations
Virtual intelligent doctor inquiry system based on VR technology
CN114613522A
Multi-terminal diagnosis and treatment interaction method and device based on mobile internet
CN117352118A
Interaction method and device, equipment, storage medium and program product
CN118672403A
Augmented reality computing system for displaying patient data
US10910096B1