A method of data acquisition and interaction

Abstract

The present application relates to the technical field of interactive data processing, in particular to a data acquisition and interaction method, comprising video taking of the whole operation process corresponding to each self-service function of medical personnel on a medical self-service interactive terminal device; capturing and extracting all video frames of page information change; video division processing of each standard operation video sequence based on each video frame; extracting each operation implemented by the medical personnel on the corresponding feature display page in sequence to obtain an operation set corresponding to each standard operation video segment; information integration of the feature operation information corresponding to each standard operation video segment in each standard operation video sequence; constructing a feature operation chain corresponding to each self-service function to generate a standard database; and monitoring all operations implemented by each user within a unit period in real time.

Description

Technical Field

[0001] This invention relates to the field of interactive data processing technology, specifically a method for data acquisition and interaction. Background Technology

[0002] With social development and the continuous deployment of medical self-service terminals, a convenient and intelligent mobile medical service has been provided to patients. This has improved the efficiency of outpatient services, shortened patients' waiting time in hospitals, relieved patients of the trouble of queuing and traveling, alleviated hospital congestion, reduced the workload of some medical staff, and improved patients' medical experience.

[0003] However, the use of medical self-service terminals is, after all, a technology that uses machines to replace people. When users are not familiar with operating the equipment, or when some elderly people do not know how to use the equipment, if timely assistance cannot be provided to patients, it will also lead to a decrease in the patient's medical experience. Summary of the Invention

[0004] The purpose of this invention is to provide a method for data acquisition and interaction to solve the problems mentioned in the background art.

[0005] To address the aforementioned technical problems, this invention provides the following technical solution: a method for data acquisition and interaction, the method comprising:

[0006] Step S100: Capture the entire operation process of medical personnel when performing various self-service functions on the medical self-service interactive terminal device, and use it as a standard operation video sequence when performing various self-service functions.

[0007] Step S200: Capture and extract all video frames in each standard operation video sequence where page information changes occur; perform video segmentation processing on each standard operation video sequence based on each video frame to obtain several standard operation video segments;

[0008] Step S300: In each standard operation video segment, extract the various operations performed by the medical personnel on the corresponding feature display page in sequence to obtain the operation set for each standard operation video segment.

[0009] Step S400: Integrate the feature operation information corresponding to each standard operation video segment in each standard operation video sequence to obtain each feature operation node in each standard operation video sequence corresponding to each self-service function;

[0010] Step S500: When implementing various self-service functions, construct the feature operation chain corresponding to each self-service function for all feature operation nodes in the standard operation video sequence, store all feature operation chains, and generate a standard database.

[0011] Step S600: Real-time capture of each user appearing in front of the medical self-service interactive terminal device, monitoring all operations performed by each user within a unit cycle, extracting feature information from the display page that appears after the user completes each operation, capturing and extracting all feature operation nodes that appear for each user within a unit cycle, constructing the feature operation chain presented by each user within a unit cycle, and setting it as the target analysis operation chain.

[0012] Step S700: Perform similarity matching between the target analysis operation chain and each feature operation chain in the standard database. When the similarity matching value between the target analysis operation chain and each feature operation chain in the standard database is less than the threshold, lock the feature operation chain with the highest similarity matching value with the target analysis operation chain. In the target analysis operation chain, mark the feature operation nodes that deviate from the locked feature operation chain and feed them back to the management personnel port.

[0013] Feedback to administrators is intended to provide timely guidance and assistance to users, improve their medical experience, increase outpatient efficiency, and shorten waiting times at hospitals.

[0014] Furthermore, step S200 includes:

[0015] Step S201: Let the standard operation video sequence corresponding to the implementation of self-service function A be as follows: in, These represent the 1st, 2nd, ..., kth video frames in the standard operation video sequence that implements self-service function A; and extract the feature display page presented in each video frame.

[0016] Step S202: If the i-th video frame With the (i+1)th video frame The extracted features are displayed on different pages, determining the (i+1)th video frame. Standard operating video sequence A dividing node in the standard operating video sequence; In this process, all partitioning nodes are marked and extracted, and the corresponding standard operation video sequence is divided into several standard operation video segments based on each partitioning node.

[0017] Furthermore, the various operations performed by medical personnel on the corresponding feature display page include: touch screen movement, touch screen clicking, and button operation.

[0018] Furthermore, step S300 includes:

[0019] Step S301: Assume that the standard operation video sequence corresponding to the implementation of self-service function A is... The standard operating video segments obtained after video segmentation include in, These represent the standard operating video sequences. The first, second, ..., nth standard operation video segments are obtained after video segmentation; each standard operation video segment corresponds to a feature display page, and the feature display pages corresponding to any two adjacent standard operation video segments are different.

[0020] Step S302: For each Extract several operations from each standard operation video segment in chronological order; obtain the corresponding... operation set

[0021] Furthermore, step S400 includes:

[0022] Step S401: Set the standard operation video segment corresponding to self-service function A. In the j-th standard operation video segment The corresponding set of operations is And from Extract the set of page feature information from the corresponding feature display page.

[0023] Step S402: For the j-th standard operation video segment By integrating the corresponding operation set and page feature information set, the j-th feature operation node of the standard operation video sequence corresponding to self-service function A is constructed.

[0024] Furthermore, step S500 includes:

[0025] Step S501: Sort all feature operation nodes appearing in the standard operation video sequences corresponding to each self-service function in order;

[0026] Step S502: Denote the sequence of feature operation nodes corresponding to self-service function A as follows: in, These represent the 1st, 2nd, ..., mth feature operation nodes that implement the corresponding self-service function A;

[0027] Step S503: Construct the feature operation chain corresponding to self-service function A as follows:

[0028] Furthermore, the method includes a system for implementing data acquisition and interaction, which includes: a video data acquisition module, a video segmentation and processing module, a feature operation node capture module, a standard database construction module, a real-time capture module, and a feedback module;

[0029] The video data acquisition module is used to capture video of the entire operation process of medical personnel performing various self-service functions on medical self-service interactive terminal devices, and to serve as a standard operation video sequence when performing various self-service functions.

[0030] The video segmentation and processing module is used to capture and extract all video frames in each standard operation video sequence where page information changes occur; and to perform video segmentation processing on each standard operation video sequence based on each video frame to obtain several standard operation video segments.

[0031] The feature operation node capture module is used to extract the various operations performed by medical personnel on the corresponding feature display page in each standard operation video segment, and obtain the operation set corresponding to each standard operation video segment; it is also used to integrate the feature operation information corresponding to each standard operation video segment in each standard operation video sequence, and obtain the feature operation nodes in each standard operation video sequence corresponding to each self-service function.

[0032] The standard database construction module is used to construct the feature operation chain corresponding to each self-service function from all the feature operation nodes in the standard operation video sequence when implementing various self-service functions, store the information of all feature operation chains, and generate a standard database.

[0033] The real-time capture module is used to capture each user appearing in front of the medical self-service interactive terminal device in real time, monitor all operations performed by each user within a unit period, extract feature information from the display page that appears after the user completes each operation, capture and extract all feature operation nodes that appear for each user within a unit period, and construct the feature operation chain presented by each user within a unit period, which is set as the target analysis operation chain.

[0034] The feedback module is used to perform similarity matching between the target analysis operation chain and each feature operation chain in the standard database. When the similarity matching value between the target analysis operation chain and each feature operation chain in the standard database is less than the threshold, the feature operation chain with the highest similarity matching value with the target analysis operation chain is locked. In the target analysis operation chain, the feature operation nodes that deviate from the locked feature operation chain are marked and fed back to the management personnel port.

[0035] Furthermore, the feature operation node capture module includes an operation extraction unit and a page feature information extraction unit;

[0036] The operation extraction unit is used to extract each operation performed by the medical personnel on the corresponding feature display page in each standard operation video segment in turn.

[0037] The page feature information extraction unit is used to extract page feature information from the feature display pages presented in each standard operation video segment.

[0038] Compared with the prior art, the beneficial effects achieved by the present invention are as follows: The present invention can generate a standard operation chain for various service functions completed on medical self-service interactive terminal devices, monitor the operation process of users who have performed a series of operations on the terminal devices in real time, promptly capture users with operational difficulties, provide feedback to management personnel to provide users with usage guidance and assistance, improve users' medical experience, improve outpatient medical efficiency, and shorten users' waiting time in the hospital. Attached Figure Description

[0039] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:

[0040] Figure 1 This is a flowchart illustrating a data acquisition and interaction method according to the present invention;

[0041] Figure 2 This is a schematic diagram of the system structure in a data acquisition and interaction method according to the present invention. Detailed Implementation

[0042] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0043] Please see Figures 1-2 The present invention provides a technical solution: a method for data acquisition and interaction, the method comprising:

[0044] Step S100: Capture the entire operation process of medical personnel using the medical self-service interactive terminal device to perform various self-service functions, and use this as a standard operation video sequence for performing each self-service function; wherein, the various operations performed by medical personnel on the corresponding feature display page include: touch screen movement operation, touch screen click operation, and button operation.

[0045] Step S200: Capture and extract all video frames in each standard operation video sequence where page information changes occur; perform video segmentation processing on each standard operation video sequence based on each video frame to obtain several standard operation video segments;

[0046] Step S200 includes:

[0047] Step S201: Let the standard operation video sequence corresponding to the implementation of self-service function A be as follows: in, These represent the 1st, 2nd, ..., kth video frames in the standard operation video sequence that implements self-service function A; and extract the feature display page presented in each video frame.

[0048] Step S202: If the i-th video frame P i A With the (i+1)th video frame The extracted features are displayed on different pages, determining the (i+1)th video frame. Standard operating video sequence A dividing node in the standard operating video sequence; In this process, all partitioning nodes are marked and extracted, and the corresponding standard operation video sequence is divided into several standard operation video segments based on each partitioning node.

[0049] For example, when using a medical self-service interactive terminal device to complete online appointment services, the corresponding standard operation video sequence is {p1, p2, p3, p4, p5}; p1, p2, p3, p4, and p5 represent the 1st, 2nd, 3rd, 4th, and 5th video frames corresponding to the online appointment service; the feature display pages presented in each video frame are extracted respectively.

[0050] For example, the feature display page extracted from the p3 video frame is different from the feature display page extracted from the p1 video frame;

[0051] For example, the feature display page extracted from P5 video frames is different from the feature display page extracted from P3 video frames;

[0052] Determine that video frames p3 and p5 are the first and second partitioning nodes in the standard operation video sequence {p1, p2, p3, p4, p5}, respectively.

[0053] Based on p3 video framing and p5 video framing, {p1, p2, p3, p4, p5} is divided into standard operating video segments p1~p2, p3~p4, and p5; this means that the corresponding feature display pages in p1~p2 and p3~p4 are different, and the corresponding feature display pages in p3~p4 and p5 are also different.

[0054] Step S300: In each standard operation video segment, extract the various operations performed by the medical personnel on the corresponding feature display page in sequence to obtain the operation set for each standard operation video segment.

[0055] Step S300 includes:

[0056] Step S301: Assume that the standard operation video sequence corresponding to the implementation of self-service function A is... The standard operating video segments obtained after video segmentation include in, These represent the standard operating video sequences. The first, second, ..., nth standard operation video segments are obtained after video segmentation; each standard operation video segment corresponds to a feature display page, and the feature display pages corresponding to any two adjacent standard operation video segments are different.

[0057] Step S302: For each Extract several operations from each standard operation video segment in chronological order; obtain the corresponding... operation set

[0058] Step S400: Integrate the feature operation information corresponding to each standard operation video segment in each standard operation video sequence to obtain each feature operation node in each standard operation video sequence corresponding to each self-service function;

[0059] Furthermore, step S400 includes:

[0060] Step S401: Set the standard operation video segment corresponding to self-service function A. In the j-th standard operation video segment The corresponding set of operations is And from Extract the set of page feature information from the corresponding feature display page.

[0061] Step S402: For the j-th standard operation video segment By integrating the corresponding operation set and page feature information set, the j-th feature operation node of the standard operation video sequence corresponding to self-service function A is constructed.

[0062] Step S500: When implementing various self-service functions, construct the feature operation chain corresponding to each self-service function for all feature operation nodes in the standard operation video sequence, store all feature operation chains, and generate a standard database; wherein, step S500 includes:

[0063] Step S501: Sort all feature operation nodes appearing in the standard operation video sequences corresponding to each self-service function in order;

[0064] Step S502: Denote the sequence of feature operation nodes corresponding to self-service function A as follows: in, These represent the 1st, 2nd, ..., mth feature operation nodes that implement the corresponding self-service function A;

[0065] Step S503: Construct the feature operation chain corresponding to self-service function A as follows:

[0066] Step S600: Real-time capture of each user appearing in front of the medical self-service interactive terminal device, monitoring all operations performed by each user within a unit cycle, extracting feature information from the display page that appears after the user completes each operation, capturing and extracting all feature operation nodes that appear for each user within a unit cycle, constructing the feature operation chain presented by each user within a unit cycle, and setting it as the target analysis operation chain.

[0067] Step S700: Perform similarity matching between the target analysis operation chain and each feature operation chain in the standard database. When the similarity matching value between the target analysis operation chain and each feature operation chain in the standard database is less than the threshold, lock the feature operation chain with the highest similarity matching value with the target analysis operation chain. In the target analysis operation chain, mark the feature operation nodes that deviate from the locked feature operation chain and report them to the administrator port.

[0068] The method includes a system for implementing data acquisition and interaction, which includes: a video data acquisition module, a video segmentation and processing module, a feature operation node capture module, a standard database construction module, a real-time capture module, and a feedback module.

[0069] The video data acquisition module is used to capture video of the entire operation process of medical personnel performing various self-service functions on medical self-service interactive terminal devices, and to serve as a standard operation video sequence when performing various self-service functions.

[0070] The video segmentation and processing module is used to capture and extract all video frames in each standard operation video sequence where page information changes occur; and to perform video segmentation processing on each standard operation video sequence based on each video frame to obtain several standard operation video segments.

[0071] The feature operation node capture module is used to extract the various operations performed by medical personnel on the corresponding feature display page in each standard operation video segment, and obtain the operation set corresponding to each standard operation video segment; it is also used to integrate the feature operation information corresponding to each standard operation video segment in each standard operation video sequence, and obtain the feature operation nodes in each standard operation video sequence corresponding to each self-service function.

[0072] The feature operation node capture module includes an operation extraction unit and a page feature information extraction unit.

[0073] The operation extraction unit is used to extract each operation performed by the medical personnel on the corresponding feature display page in each standard operation video segment in turn.

[0074] The page feature information extraction unit is used to extract page feature information from the feature display pages presented in each standard operation video segment.

[0075] The standard database construction module is used to construct the feature operation chain corresponding to each self-service function from all the feature operation nodes in the standard operation video sequence when implementing various self-service functions, store the information of all feature operation chains, and generate a standard database.

[0076] The real-time capture module is used to capture each user appearing in front of the medical self-service interactive terminal device in real time, monitor all operations performed by each user within a unit period, extract feature information from the display page that appears after the user completes each operation, capture and extract all feature operation nodes that appear for each user within a unit period, and construct the feature operation chain presented by each user within a unit period, which is set as the target analysis operation chain.

[0077] The feedback module is used to perform similarity matching between the target analysis operation chain and each feature operation chain in the standard database. When the similarity matching value between the target analysis operation chain and each feature operation chain in the standard database is less than the threshold, the feature operation chain with the highest similarity matching value with the target analysis operation chain is locked. In the target analysis operation chain, the feature operation nodes that deviate from the locked feature operation chain are marked and fed back to the management personnel port.

[0078] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.

[0079] Finally, it should be noted that the above descriptions are merely preferred embodiments of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the technical features. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

Claims

1. A method for data acquisition and interaction, characterized in that, The method includes: Step S100: Capture the entire operation process of medical personnel performing various self-service functions on the medical self-service interactive terminal device, and use it as a standard operation video sequence when performing the various self-service functions. Step S200: Capture and extract all video frames in each of the standard operation video sequences where page information changes occur; perform video segmentation processing on each of the standard operation video sequences based on each of the video frames to obtain several standard operation video segments; Step S300: In each standard operation video segment, extract the various operations performed by the medical personnel on the corresponding feature display page in sequence to obtain the operation set corresponding to each standard operation video segment; Step S400: Integrate the feature operation information corresponding to each standard operation video segment in each standard operation video sequence to obtain each feature operation node in each standard operation video sequence corresponding to each self-service function; Step S500: When implementing various self-service functions, construct a feature operation chain corresponding to each self-service function for all feature operation nodes in the standard operation video sequence, store all feature operation chains, and generate a standard database. Step S600: Real-time capture of each user appearing in front of the medical self-service interactive terminal device, monitoring all operations performed by each user within a unit cycle, extracting feature information from the display page that appears after the user completes each operation, capturing and extracting all feature operation nodes that appear for each user within a unit cycle, constructing the feature operation chain presented by each user within the unit cycle, and setting it as the target analysis operation chain. Step S700: Perform similarity matching between the target analysis operation chain and each feature operation chain in the standard database. When the similarity matching value between the target analysis operation chain and each feature operation chain in the standard database is less than the threshold, lock the feature operation chain with the highest similarity matching value between the target analysis operation chain and the target analysis operation chain. In the target analysis operation chain, mark the feature operation nodes that deviate from the locked feature operation chain and feed them back to the management personnel port.

2. The data acquisition and interaction method according to claim 1, characterized in that, Step S200 includes: Step S201: Let the standard operation video sequence corresponding to the implementation of self-service function A be as follows: ;in, These respectively represent the 1st, 2nd, and 3rd steps in the standard operation video sequence corresponding to the implementation of self-service function A.

1.

2.

3.

4.

5.

6.

7.

8.

9.

10.

11.

12.

13.

14.

15.

16.

17.

18.

19. 10 ... Step S202: If the i-th video frame With the (i+1)th video frame The extracted features are displayed on different pages, thus determining the (i+1)th video frame. For the standard operating video sequence A dividing node in the standard operating video sequence; All partitioning nodes are marked and extracted, and the corresponding standard operation video sequence is divided into several standard operation video segments based on each partitioning node.

3. The data acquisition and interaction method according to claim 1, characterized in that, The various operations performed by medical personnel on the corresponding feature display page include: touch screen movement, touch screen clicking, and button operation.

4. The data acquisition and interaction method according to claim 2, characterized in that, Step S300 includes: Step S301: Assume that the standard operation video sequence corresponding to the implementation of self-service function A is... The standard operating video segments obtained after video segmentation include ;in, These represent the standard operating video sequences. The first and second parts were obtained after video segmentation. There are n standard operation video segments; each standard operation video segment corresponds to a feature display page, and the feature display pages corresponding to any two adjacent standard operation video segments are different. Step S302: For each Extract several operations from each standard operation video segment in chronological order; obtain the corresponding... operation set .

5. The data acquisition and interaction method according to claim 4, characterized in that, Step S400 includes: Step S401: Set the standard operation video segment corresponding to self-service function A. In the j-th standard operation video segment The corresponding set of operations is And from Extract the set of page feature information from the corresponding feature display page. ; Step S402: For the j-th standard operation video segment By integrating the corresponding operation set and page feature information set, the j-th feature operation node of the standard operation video sequence corresponding to self-service function A is constructed. .

6. The data acquisition and interaction method according to claim 5, characterized in that, Step S500 includes: Step S501: Sort all feature operation nodes appearing in the standard operation video sequences corresponding to each self-service function in order; Step S502: Denote the sequence of feature operation nodes corresponding to self-service function A as follows: ;in, These represent the 1st, 2nd, and 3rd steps in implementing the corresponding self-service function A. m feature operation nodes; Step S503: Construct the feature operation chain corresponding to self-service function A as follows: .

Images