Program control equipment, program control page recording method and device and storage medium

Abstract

The invention discloses program control equipment, a program control page recording method and device and a storage medium. The program control device is connected and communicated with an implantable device of a controlled object, and the program control device comprises a control interface which is configured to at least comprise a display interface used for displaying the real-time state of the controlled object and an operation interface used for controlling the object to input program control parameters. And the processor is configured to record the real-time dynamic state of the control interface according to the preset acquisition frequency and the preset page acquisition mode under the condition that the start of the medical program-controlled conference is detected, generate a page recording file and record a program-controlled page in the form of a text file, so that screens with various resolutions can be compatible, the size of the recording file is reduced, and the recording efficiency is improved. Meanwhile, the part, needing to be played back, of the recorded file can be disassembled individually, privacy of a control object is protected, and use experience is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of web page processing, and in particular to a program-controlled device, a program-controlled page recording method, a device and a storage medium. Background Art

[0002] When doctors and patients are performing remote implantable medical control, recording the process of the medical remote control operation is beneficial for doctors to review and summarize, as well as for regulatory authorities to conduct inspections and evaluations, and it also helps resolve conflicts between doctors and patients.

[0003] In the prior art, the recording of the doctor's remote control interface is usually achieved based on the screen recording of the doctor's operating interface, that is, the doctor's computer screen is recorded in real time. After the screen recording is completed, the video file is transmitted to the server for storage, and downloaded and played back when needed.

[0004] However, the recording method based on the screen recording method generates very large recorded video files, which will occupy network bandwidth and cause application lag during storage. At the same time, the packet loss rate of screen recording video files is high during upload, which is easy to cause file defects. In addition, recorded video files cannot be personalized and disassembled, and the playback process must be watched in full, which has a poor user experience. Summary of the invention

[0005] The present disclosure provides a program-controlled device, a program-controlled page recording method, an apparatus and a storage medium, which record program-controlled pages in the form of text files, are compatible with screens of various resolutions, reduce the size of recorded files, and can personalize and disassemble the parts of the recorded files that need to be played back, thereby protecting the privacy of the control end and improving the user experience.

[0006] According to one aspect of the present disclosure, a program-controlled device is provided. The program-controlled device is connected and communicated with an implantable device of a controlled object, and the device comprises:

[0007] A control interface, configured to include at least a display interface for displaying the real-time status of the controlled object and an operation interface for inputting program control parameters of the control object;

[0008] The processor is configured to record the real-time dynamics of the control interface and generate a page recording file according to a preset collection frequency and a preset page collection method when detecting the start of a medical program control conference.

[0009] According to another aspect of the present invention, a program-controlled page recording method is provided, the method being applied to a program-controlled device, the program-controlled device comprising a control interface and a processor, the control interface comprising a display interface and an operation interface; the method comprising:

[0010] When the start of a medical program-controlled conference is detected, the processor records the real-time dynamics of the control interface according to a preset collection frequency and a preset page collection method, and generates a page recording file.

[0011] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the program-controlled page recording method described in any embodiment of the present invention when executed.

[0012] The technical solution of the embodiment of the present disclosure is to obtain a first page snapshot of the operation interface in the medical program-controlled conference through the processor in the program-controlled device when the start of the medical program-controlled conference is detected. The first page snapshot is subjected to page parsing processing to determine the initial page information corresponding to the first page snapshot. When a change is detected in the operation interface, a second page snapshot of the operation interface is obtained, and the structural change information of the operation interface is determined through the second page snapshot. A page recording file with a time sequence is generated based on the initial page information, structural change information and change time, and the real-time operation of the control interface in the program-controlled device is recorded in a preset text format, thereby reducing the size of the recording file, and only recording the medical program-controlled conference, avoiding the leakage of other software information content on the control object side, and improving the user experience.

[0013] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0015] Figure 1 is a structural diagram of a program-controlled device provided according to Embodiment 1 of the present disclosure;

[0016] Figure 2 is a schematic diagram of a control interface provided according to the first embodiment of the present disclosure;

[0017] Figure 3 is a flow chart of a medical program-controlled page recording method provided according to the second embodiment of the present disclosure;

[0018] Figure 4 It is a structural diagram of a medical program-controlled page recording device provided according to Embodiment 3 of the present disclosure;

[0019] Figure 5 It is a structural schematic diagram of an electronic device that implements the medical program-controlled page recording method of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0020] In order to enable those skilled in the art to better understand the scheme of the present disclosure, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without creative work should fall within the scope of protection of the present disclosure.

[0021] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0022] Embodiment 1

[0023] Below, one of the application fields of the embodiment of the present invention (i.e., implantable devices) is first briefly described. The implantable neural stimulation system (an implantable medical system) mainly includes a stimulator implanted in the patient's body and a programmable device arranged outside the patient's body. The existing neural regulation technology mainly implants electrodes in specific structures (i.e., target points) in the body through stereotactic surgery, and the stimulator implanted in the patient's body sends discharge pulses to the target point through the electrodes, regulates the electrical activity and function of the corresponding neural structure and network, thereby improving symptoms and relieving pain. Among them, the stimulator can be any one of an implantable neural electrical stimulation device, an implantable cardiac electrical stimulation system (also known as a pacemaker), an implantable drug delivery system (Implantable Drug Delivery System, referred to as IDDS) and a lead switching device. Implantable neural stimulation devices include, for example, deep brain stimulation system (DBS), implantable cortical nerve stimulation system (CNS), implantable spinal cord stimulation system (SCS), implantable sacral nerve stimulation system (SNS), implantable vagus nerve stimulation system (VNS), etc.

[0024] In some embodiments, the stimulator may include an implantable pulse generator (IPG), an electrode wire, and an extension wire disposed between the pulse generator and the electrode wire, and data interaction between the pulse generator and the electrode wire is realized through the extension wire, and the pulse generator is disposed in the patient's body. In response to the program-controlled instructions sent by the program-controlled device, the sealed battery and the circuit are used to provide controllable electrical stimulation energy to the tissue in the body, and one or two controllable specific electrical stimulations are delivered to specific areas of the tissue in the body through the implanted extension wire and the electrode wire. The extension wire is used in conjunction with the pulse generator as a transmission medium for the electrical stimulation signal, and transmits the electrical stimulation signal generated by the pulse generator to the electrode wire. The electrode wire delivers electrical stimulation to specific areas of the tissue in the body through the electrode contacts thereon. The stimulator is provided with one or more electrode wires on one side or both sides, and a plurality of electrode contacts are provided on the electrode wire.

[0025] In other embodiments, the stimulator may only include a pulse generator and an electrode wire, wherein the pulse generator may be embedded in the patient's skull and the electrode wire may be implanted in the patient's skull, in which case the pulse generator is directly connected to the electrode wire without extending the wire.

[0026] The electrode wire can be a nerve stimulation electrode, and the electrode wire delivers electrical stimulation to a specific area of ​​the tissue in the body through a plurality of electrode contacts. The stimulator is provided with one or more electrode wires on one side or both sides, and a plurality of electrode contacts are provided on the electrode wire, and the electrode contacts can be arranged uniformly or non-uniformly on the circumference of the electrode wire. As an example, the electrode contacts can be arranged in an array of 4 rows and 3 columns (a total of 12 electrode contacts) on the circumference of the electrode wire. The electrode contacts may include stimulation contacts and / or collection contacts. The electrode contacts may be in the shape of sheets, rings, dots, etc., for example.

[0027] In some possible ways, the stimulated in vivo tissue may be the patient's brain tissue, and the stimulated site may be a specific site of the brain tissue. When the patient's disease type is different, the stimulated site is generally different, and the number of stimulation contacts (single source or multiple sources), the use of one or more (single channel or multiple channels) of specific electrical stimulation signals, and the stimulation parameter data are also different. It can be considered that when the stimulation contacts used are multi-source, multi-channel (multi-channel), a larger amount of data will be generated compared to a single source, single channel.

[0028] The embodiments of the present invention do not limit the types of diseases that can be used, and they can be diseases that deep brain stimulation (DBS), spinal cord stimulation (SCS), pelvic stimulation, gastric stimulation, peripheral nerve stimulation, and functional electrical stimulation can be used for. Among them, the types of diseases that DBS can be used to treat or manage include, but are not limited to: spastic diseases (e.g., epilepsy), pain, migraine, mental illness (e.g., major depressive disorder (MDD)), bipolar disorder, anxiety, post-traumatic stress disorder, minor depression, obsessive-compulsive disorder (OCD), behavioral disorders, mood disorders, memory disorders, mental state disorders, movement disorders (e.g., essential tremor or Parkinson's disease), Huntington's disease, Alzheimer's disease, drug addiction, autism, or other neurological or psychiatric diseases and injuries.

[0029] Stimulation parameters may include: frequency (for example, the number of electrical stimulation pulse signals within a unit time of 1s, in Hz), pulse width (duration of each pulse, in μs), amplitude (generally expressed in voltage, that is, the intensity of each pulse, in V), timing (for example, it can be continuous or triggered), stimulation mode (including one or more of current mode, voltage mode, timed stimulation mode and cyclic stimulation mode), one or more of the upper and lower limits controlled by the doctor (the range adjustable by the doctor) and the upper and lower limits controlled by the patient (the range adjustable by the patient).

[0030] Figure 1 A structural diagram of a program-controlled device is provided for the first embodiment of the present disclosure. Figure 1 As shown, the device at least includes a control interface and a processor.

[0031] A control interface, configured to include at least a display interface for displaying the real-time status of the controlled object and an operation interface for inputting control of the object;

[0032] The processor is configured to record the real-time dynamics of the control interface and generate a page recording file according to a preset collection frequency and a preset page collection method when detecting the start of a medical program control conference.

[0033] It should be noted that the programmable device can be an important part of the implantable medical system, or it can be said to be the remote control end of the implantable medical system. The programmable device can refer to the device end of the remote control object, such as the doctor end. For example, the doctor can send program parameters to the implantable device implanted in the patient's body through the programmable device, so that the implantable device delivers corresponding electrical stimulation to the patient's body.

[0034] The implantable medical system also includes a remote controlled terminal. The remote controlled terminal may refer to a controlled object terminal, such as a patient terminal. The remote controlled terminal is directly connected and communicated with the implanted device of the controlled object. The program-controlled device is remotely connected and communicated with the implanted device of the controlled object by means of the remote controlled terminal.

[0035] An implantable device may refer to an implantable neural electrical stimulation system, which includes a stimulator (i.e., an implantable neural stimulator) implanted in a patient's body. Electrodes (e.g., in the form of electrode wires) are implanted in a specific part of the tissue of the organism (i.e., the target site) through stereotactic surgery, and discharge pulses are sent to the target site through the electrodes. Doctors can use programmable devices to regulate the electrical activity and function of the corresponding neural structures and networks, thereby improving the patient's symptoms.

[0036] Figure 2 is a schematic diagram of a control interface provided according to an embodiment of the present disclosure, such as Figure 2 As shown, the control interface is configured to include at least a display interface for displaying the real-time state of the controlled object (such as Figure 2 left frame) and the operation interface for controlling object input (such as Figure 2 The display interface can be used to display the real-time status of the controlled object, such as the real-time image of the controlled object or the real-time three-dimensional brain model of the controlled object. The operation interface can be used to display the input operation information of the controlled object, such as IPG program control operation information, AI-assisted diagnosis operation information and LFP acquisition operation information.

[0037] The processor can pre-configure a computer program to enable the execution of program-controlled page recording. When the start of a medical program-controlled conference is detected, the real-time dynamics of the control interface are recorded according to a preset collection frequency and a preset page collection method, and a page recording file is generated. By collecting the real-time operation of the control interface according to the preset page collection method in a preset page collection method, the size of the recording file is reduced, and only the medical program-controlled conference is recorded, thereby avoiding the leakage of information content of other software on the control object side and improving the user experience.

[0038] Exemplarily, the process of the processor recording the real-time dynamics of the control interface in a preset text format based on a preset acquisition frequency strategy and generating a page recording file includes:

[0039] According to the preset page acquisition method, the real-time dynamics of the display interface are recorded based on the first acquisition frequency, and the real-time dynamics of the operation interface are collected based on the second acquisition frequency to generate a page recording file.

[0040] The preset acquisition frequency includes a first acquisition frequency and a second acquisition frequency, and the first acquisition frequency is higher than the second acquisition frequency.

[0041] It should be noted that when recording the real-time dynamics of the control interface, different acquisition or monitoring frequencies can be set due to the different contents presented by the display interface and the operation interface. For example, since the display interface displays real-time video images, such as collecting the patient's limb or facial reactions during the programming process, or the real-time changes in the patient's brain electrical signals during the programming process, in order to enable the doctor to understand the patient's reaction to the programming in real time, so as to adjust the programming parameters or strategies in time, the display interface requires a higher first acquisition frequency for acquisition, so that the programming parameters can be more consistent during subsequent video playback. The operation interface displays the control object input programming parameter operation. In fact, when the doctor enters the programming parameters, it is adjusted according to the patient's reaction, not real-time input. Therefore, a lower second acquisition frequency can be used for recording, thereby reducing the processor usage requirements. By setting corresponding acquisition or monitoring frequencies for different areas, targeted monitoring is achieved, and the computing resources for recording can also be reduced.

[0042] In some other embodiments, the operation interface may also include multiple sub-interfaces, such as an IPG programming interface, an AI-assisted diagnosis interface, an LFP acquisition interface, etc. Different acquisition frequencies may also be set for different interfaces. For example, they may be set according to factors such as the importance of different interfaces, the frequency of data or page updates, etc., so that different interfaces can reduce the workload of the processor on the basis of ensuring the reliability and accuracy of interface acquisition, thereby improving the efficiency and reliability of interface recording during the entire programming process.

[0043] Exemplarily, the process of the processor recording the real-time dynamics of the control interface and generating a page recording file includes:

[0044] Step 1: When it is detected that a medical program-controlled conference has started, a first page snapshot of an operation interface in the medical program-controlled conference is obtained.

[0045] The operation interface may refer to the operation page corresponding to the medical program control software running in the program control device. The first page snapshot is a DOM tree structure snapshot corresponding to the operation interface in the developer mode. The DOM tree represents a structured representation of a web document. Specifically, the DOM tree is a tree-like data structure used to describe the logical structure of an HTML or XML document.

[0046] It should be noted that, in fact, the view state of the application software page can be described in the form of a DOM tree in the developer mode. When you want to record a software page, you can record the state of the DOM tree at each time point to record the DOM tree state of the page at each moment. When replaying, you can display the DOM tree state according to the time point. Introducing the rrweb (record and replay the web) plug-in in the medical program control software can record the DOM tree state of the page at each moment. Among them, rrweb is a web page recording technology, and its core function is to record the changes of the web page in real time and store these changes in the form of a text file. The rrweb plug-in records in the background, and the recording process is imperceptible. It can be set to a mode without notifying the doctor to reduce interference with the medical process. Secondly, the rrweb plug-in technology is mature and has good platform compatibility. It can be applied to different platform encodings (such as Windows and Mac OS).

[0047] Specifically, when the start of the medical program control conference is detected, the rrweb plug-in is silently started in the background. The rrweb plug-in monitors all HTML tag elements in the operation interface and obtains a first page snapshot.

[0048] Step 2: performing page parsing processing on the first page snapshot to determine initial page information corresponding to the first page snapshot.

[0049] The initial page information may refer to the initial information in the operation interface at the start time of the medical program control conference, wherein the initial page information may include a page structure, and the page structure includes at least page elements and page nodes, etc.

[0050] Specifically, the rrweb plug-in performs page parsing processing on the first page snapshot, analyzes the content and attributes of the first page snapshot, determines the page structure of the first page snapshot and the page elements and page nodes in the page structure, and then obtains the initial page information.

[0051] It should be noted that the DOM tree structure is hierarchical, similar to the directory structure of a file system. Each node can have a parent node, child nodes, and sibling nodes.

[0052] Step three: when a change in the operation interface is detected, obtaining a second page snapshot of the operation interface, and determining structural change information of the operation interface according to each of the second page snapshots.

[0053] Changes to the operation interface may include interface changes (such as page switching, page refreshing and page closing, etc.), as well as all operations of the control object in the control page (including but not limited to click, input and scrolling, etc.).

[0054] The second page snapshot may refer to a snapshot of the DOM tree structure change in the operation interface in the developer mode. The structure change information may refer to the change information of the DOM tree structure in the operation interface. The structure change information may include but is not limited to the change structure, the change time corresponding to the change structure, and the change type and content.

[0055] Specifically, when a change in the operation interface is detected, the processor obtains a second page snapshot of the operation interface, determines incremental data of each page structure based on the page structure identifier in the second page snapshot, and forms structure change information according to the incremental data.

[0056] Exemplarily, the process of the processor determining the structural change information of the operation interface according to each of the second page snapshots includes:

[0057] For each page structure in each of the second page snapshots, compare the page structure with the page structure at the previous moment to determine the target page structure that has changed and the structure change time corresponding to the target page structure;

[0058] The structural change information of the operation interface is formed according to the target page structure and the structural change time corresponding to the target page structure.

[0059] The target page structure may refer to a page structure that has been changed. The structure change time may refer to the time when the change has occurred.

[0060] Specifically, for each page structure, based on the structure ID of the page structure, the processor compares the page structure at the current moment with the page structure at the previous moment, determines the changed page structure as the target page structure, and determines the structure change time corresponding to the target page structure. The target page structure and the structure change time are sorted and processed to obtain the structure change information of the operation interface.

[0061] It should be noted that the processor determines the monitoring process of the structural change information, including monitoring the incremental change data of the operation interface in real time throughout the entire medical program control meeting to form the structural change information of the operation interface.

[0062] Step 4: Generate a page recording file in a preset text format according to the initial page information, the structure change information and the change time.

[0063] Among them, the preset text format can be selected according to actual needs, and the present disclosure does not specifically limit this. Exemplarily, the preset text format may include .txt format, .doc format, .docx format and .rtf format, etc. Preferably, the .txt format is used as the preset text format in the embodiment of the present disclosure.

[0064] Specifically, the processor converts the initial page information, the structural change information, the change time and other information into JSON data, starts time interface polling, periodically converts the generated JSON data into a preset text format file to form a page recording file, and uploads it to the server for storage after compression processing.

[0065] The processor obtains a first page snapshot of the operation interface in the medical program control conference when it detects that the medical program control conference has started. The first page snapshot is subjected to page parsing processing to determine the initial page information corresponding to the first page snapshot. When it is detected that the operation interface has changed, a second page snapshot of the operation interface is obtained, and the structural change information of the operation interface is determined through the second page snapshot. A page recording file with a time sequence is generated based on the initial page information, structural change information and change time, and the real-time operation of the medical program control interface is recorded in a preset text format, thereby greatly reducing the size of the recording file and saving a lot of server disk space. Real-time uploading does not occupy network bandwidth and will not cause the control end application to freeze.

[0066] It should be noted that in the present disclosure, based on the time interface, multiple page recording files are generated regularly or in real time according to the initial page information and / or structural change information and the change time, and the page recording files are uploaded to the server until the doctor completes the consultation, ends the recording, and uploads the last page recording file. In this way, the uploaded page recording files can be played back in real time on the playback end while recording, without having to wait until the end of the program-controlled meeting, which is truly seamless, real-time, and efficient.

[0067] Exemplarily, the processor may also record the medical imaging video in the display interface for displaying the real-time status of the controlled object, and upload the medical imaging video to the server for storage.

[0068] The display interface can display the real-time status of the controlled object, such as the real-time image of the controlled object or the real-time three-dimensional brain model of the controlled object. The processor can record the medical image video in the display interface, upload the medical image video to the server for storage, and download and replay it from the server when needed. It should be noted that since rrweb does not support video recording in the web interface, conventional video recording technology can be used for recording.

[0069] Exemplarily, the process of the processor generating a page recording file in a preset text format according to the initial page information, the structure change information and the change time includes:

[0070] Sorting the change times to obtain a change time sequence;

[0071] Based on the change time sequence, converting the structure change information and the initial page information into page recording data;

[0072] The page recording file in a preset text format is generated according to the page recording data. Specifically, the processor sorts the change time according to the order of generation, and a change time sequence can be obtained. The structural change information and the initial page information corresponding to the time point in the change time sequence are processed by data conversion, and the page recording data with a time sequence can be obtained, and the page recording data is converted into a page recording file in a preset text format.

[0073] Exemplarily, the process of converting the structure change information and the initial page information into page recording data in a preset data format based on the change time sequence by the processor includes:

[0074] Performing format conversion processing on the initial page information to obtain first format conversion data, and performing format conversion processing on the structure change information to obtain second format conversion data;

[0075] Based on the change time sequence, sorting the second format conversion data to obtain third format conversion data;

[0076] The first format conversion data is determined as initial recording data of the page recording data, and the third format conversion data is determined as subsequent recording data of the page recording data.

[0077] Among them, the page recording data includes initial recording data and subsequent recording data. The initial recording data may refer to the initial data of the recording operation interface. The subsequent data may refer to the page data after the change based on the initial recording data. The first format conversion data, the second format conversion data and the third format conversion data may all refer to JSON data. The first format conversion data may refer to the format data corresponding to the initial page information. The second format conversion data may refer to the format data corresponding to the structural change information. The third format conversion data may refer to the second format conversion data sorted based on the change time series.

[0078] Specifically, the processor performs format conversion processing on the initial page information to obtain first format conversion data, and determines the first format conversion data as the initial recording data of the page recording data. The structure change information is format converted to obtain second format conversion data. Each second format conversion data is sorted according to the change time sequence to obtain third format conversion data, and is determined as the subsequent recording data of the page recording data. Then, the initial recording data and the subsequent recording data are sorted to obtain the page recording data.

[0079] Exemplarily, the processor is further configured to:

[0080] After generating a page recording file in a preset text format, in response to a playback request for the control interface, acquiring the page recording file;

[0081] The page recording file is reconstructed into a page playback video of the control interface based on the timestamp in the page recording file, and the page playback video is displayed.

[0082] The playback request may refer to a request instruction for playback of the operation interface. The playback request may be triggered by the control object, or by the assessment team or the visiting learning team.

[0083] Specifically, the page playback request of the control object is parsed and processed, the storage address information corresponding to the page playback request is determined, and the page recording file corresponding to the page playback request is obtained based on the storage address information. The downloaded page recording file is reconstructed in the order of timestamps, so that the page playback video of the control interface can be obtained, and the page playback video is displayed on the playback device.

[0084] The web page element tags and web page node information are obtained by parsing the page recording file. Based on the timestamp in the page recording file and the web page node information, the web page element tags are inserted into the HTML file to obtain the page playback video of the control interface. Since the page playback video is restored according to the text file, the video resolution of the page playback video can be dynamically adjusted and is compatible with screens of various resolutions, solving the problem of frame loss and deformation during the playback of the existing screen recording, and improving the playback viewing experience.

[0085] Exemplarily, the process of the processor reconstructing the page recording file into a page playback video of the control interface based on the timestamp in the page recording file includes:

[0086] Performing web page element parsing processing on the page recording file to obtain web page element tags and web page node information;

[0087] Based on the timestamp in the page recording file and the web page node information, the web page element tag is inserted into the HTML file to obtain the page playback video of the control interface.

[0088] Specifically, the processor can parse the downloaded page recording file to obtain web page element tags and web page node information, etc. First, the DOM snapshot is rebuilt, and the DOM structure is rebuilt by mapping the custom type to different node construction methods while traversing the JSON product. The specific method can be to insert the web page element tag into the HTML file according to the timestamp in the page recording file and the web page node information, so that the page playback video on the doctor's side can be obtained.

[0089] Exemplarily, the processor is further configured to:

[0090] After inserting the web page element tag into the HTML file, obtaining the medical image video corresponding to the page recording file, and determining the web page video tag in the page recording file;

[0091] Insert the uniform resource locator of the medical imaging video into the web page video tag to construct a page playback video of the control interface.

[0092] It should be noted that since the page recording file does not contain the conversation video, when playing back the doctor's interface on the playback end, the URL address of the conversation video is inserted into the HTML web page video tag, so that a complete page playback video is restored.

[0093] Based on the above embodiments, the process of the processor acquiring the page recording file in response to the playback request for the operation interface includes:

[0094] Displaying a playback function panel corresponding to the operation interface;

[0095] In response to a selection operation on a playback function module, a page playback video corresponding to the selected playback function module is determined in the page recording file.

[0096] The playback function module may refer to each control module obtained by splitting the page recording file. Figure 2 As shown in FIG. 1 , the remote control interface includes a program parameter adjustment section, a patient restriction section, an AI-assisted diagnosis section, an LFP acquisition section, a real-time measurement section, a timed stimulation section, and a parameter overview section, etc. Correspondingly, the playback function section can be a control operation recorded for each of the above sections.

[0097] Specifically, the processor can split and parse each downloaded page recording file to obtain the playback function module corresponding to the operation interface. According to the viewer's selection operation, the page recording file corresponding to the selected playback function module is reconstructed into a page playback video to facilitate the viewer to view the module of interest and improve the user's viewing experience.

[0098] Embodiment 2

[0099] Figure 3 This is a flow chart of the program-controlled page recording method provided in the second embodiment of the present disclosure. This embodiment can be applied to the case of recording the control operation of the medical remote control page, and in particular, can be applied to the case of implementing the recording control interface. The method can be executed by a program-controlled page recording device, which can be implemented in the form of hardware and / or software, and the program-controlled page recording device can be configured in the processor of the program-controlled device. Figure 3 As shown, the method includes:

[0100] S101. When it is detected that a medical program control conference has started, the processor records the real-time dynamics of the control interface according to a preset collection frequency and a preset page collection method, and generates a page recording file.

[0101] Exemplarily, the preset acquisition frequency includes at least a first acquisition frequency and a second acquisition frequency, and the method further includes:

[0102] According to the preset page collection method, the real-time dynamics of the display interface are collected based on the first collection frequency, and the real-time dynamics of the operation interface are collected based on the second collection frequency to generate a page recording file, wherein the first collection frequency is higher than the second collection frequency.

[0103] Exemplarily, when the start of a medical program control conference is detected, the processor records the real-time dynamics of the control interface according to a preset collection frequency and a preset page collection method, and generates a page recording file, including:

[0104] Step 1: When it is detected that a medical program control conference has started, a first page snapshot of the operation interface is obtained, wherein the first page snapshot is a DOM tree structure snapshot corresponding to the operation interface.

[0105] Step 2: performing page parsing processing on the first page snapshot to determine initial page information corresponding to the first page snapshot, wherein the initial page information includes a page structure, and the page structure includes at least page elements and page nodes.

[0106] Step three: when a change is detected in the operation interface, obtain a second page snapshot of the operation interface, and determine the structural change information of the operation interface based on each second page snapshot, wherein the structural change information includes at least the changed structure and the change time corresponding to the changed structure.

[0107] Step 4: Generate a page recording file in a preset text format according to the initial page information, the structure change information and the change time.

[0108] The technical solution of the embodiment of the present disclosure is to record the real-time dynamics of the control interface and generate a page recording file according to a preset collection frequency and a preset page collection method when the start of a medical program-controlled meeting is detected. Specifically, the processor obtains a first page snapshot of the operation interface in the medical program-controlled meeting when the start of the medical program-controlled meeting is detected. The first page snapshot is subjected to page parsing processing to determine the initial page information corresponding to the first page snapshot. When a change is detected in the operation interface, a second page snapshot of the operation interface is obtained, and the structural change information of the operation interface is determined through the second page snapshot. A page recording file with a time sequence is generated based on the initial page information, the structural change information and the change time, and the real-time operation of the control interface is recorded in a preset text format, thereby reducing the size of the recording file, and only recording the medical program-controlled meeting, avoiding the leakage of other software information content on the control object side, and improving the user experience.

[0109] Embodiment 3

[0110] Figure 4 This is a schematic diagram of the structure of a program-controlled page recording device provided in the fourth embodiment of the present disclosure. Figure 4 As shown, the device comprises:

[0111] A first page snapshot acquisition module 301 is used to acquire a first page snapshot of the operation interface when the start of the medical program control conference is detected, wherein the first page snapshot is a DOM tree structure snapshot corresponding to the operation interface;

[0112] The initial page information determination module 302 is used to perform page parsing processing on the first page snapshot to determine the initial page information corresponding to the first page snapshot, wherein the initial page information includes a page structure, and the page structure includes at least page elements and page nodes;

[0113] The structure change information determination module 303 is used to obtain a second page snapshot of the operation interface when a change is detected in the operation interface, and determine the structure change information of the operation interface according to each of the second page snapshots, wherein the structure change information at least includes a changed structure and a change time corresponding to the changed structure;

[0114] The page recording file generating module 304 is used to generate a page recording file in a preset text format according to the initial page information, the structure change information and the change time.

[0115] The technical solution of the disclosed embodiment is to obtain a first page snapshot of the operation interface in the medical programming conference when the start of the medical programming conference is detected. The first page snapshot is subjected to page parsing processing to determine the initial page information corresponding to the first page snapshot. When a change is detected in the operation interface, a second page snapshot of the operation interface is obtained, and the structural change information of the operation interface is determined through the second page snapshot. A page recording file with a time sequence is generated based on the initial page information, structural change information and change time, and the real-time operation of the control interface is recorded in a preset text format, thereby reducing the size of the recording file, and only recording the medical programming conference, avoiding the leakage of other software information content on the control object side, and improving the user experience.

[0116] Optionally, the structure change information determination module 303 is specifically used to:

[0117] For each page structure in each of the second page snapshots, compare the page structure with the page structure at the previous moment to determine the target page structure that has changed and the structure change time corresponding to the target page structure;

[0118] The structural change information of the operation interface is formed according to the target page structure and the structural change time corresponding to the target page structure.

[0119] Optionally, the page recording file generating module 304 includes:

[0120] A change time sequence determination unit, used to sort the change times to obtain a change time sequence;

[0121] a page recording data generating unit, configured to convert the structure change information and the initial page information into page recording data based on the change time sequence;

[0122] The page recording file generating unit is used to generate the page recording file in a preset text format according to the page recording data.

[0123] Optionally, the page recording data includes initial recording data and subsequent recording data. The page recording data generating unit is specifically used to:

[0124] Performing format conversion processing on the initial page information to obtain first format conversion data, and performing format conversion processing on the structure change information to obtain second format conversion data;

[0125] Based on the change time sequence, sorting the second format conversion data to obtain third format conversion data;

[0126] The first format conversion data is determined as initial recording data of the page recording data, and the third format conversion data is determined as subsequent recording data of the page recording data.

[0127] Optionally, the device further comprises a remote video recording module, which is used to:

[0128] When the start of a medical program-controlled conference is detected, a medical image video of a display interface in the operation interface is recorded, and the medical image video is uploaded to a server for storage.

[0129] Optionally, the device further comprises:

[0130] A page recording file acquisition module, used for acquiring the page recording file in response to a playback request for the operation interface;

[0131] The page playback video generation module is used to reconstruct the page recording file into a page playback video of the operation interface based on the timestamp in the page recording file, and display the page playback video.

[0132] Optionally, the page playback video generation module includes:

[0133] A page recording file parsing unit, used for parsing the page recording file to perform web page element parsing to obtain web page element tags and web page node information;

[0134] The page playback video generating unit is used to insert the web page element tag into the HTML file based on the timestamp in the page recording file and the web page node information to obtain the page playback video of the operation interface.

[0135] Optionally, the page playback video generation unit is further used to:

[0136] Acquire the medical imaging video corresponding to the page recording file, and determine the webpage video tag in the page recording file;

[0137] The uniform resource locator of the medical imaging video is inserted into the web page video tag to construct a page playback video of the operation interface.

[0138] Optionally, the page playback video generation unit is further specifically used for:

[0139] Displaying a playback function panel corresponding to the operation interface, wherein the playback function panel includes at least one of a program-controlled parameter adjustment panel, a patient restriction panel, an AI-assisted diagnosis panel, an LFP acquisition panel, a real-time measurement panel, a timed stimulation panel, and a parameter overview panel;

[0140] In response to a selection operation on a playback function module, a page playback video corresponding to the selected playback function module is determined in the page recording file.

[0141] The program-controlled page recording device provided in the embodiments of the present disclosure can execute the program-controlled page recording method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0142] Embodiment 4

[0143] Figure 5 A schematic diagram of an electronic device 10 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0144] like Figure 5As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0145] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0146] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as method program-controlled page recording.

[0147] In some embodiments, the method of program-controlled page recording can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the method of program-controlled page recording described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to perform the method of program-controlled page recording in any other appropriate manner (for example, by means of firmware).

[0148] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0149] Computer programs for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0150] In the context of the present disclosure, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device, or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0151] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0152] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0153] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0154] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of this disclosure can be achieved, and this document is not limited here.

[0155] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A program-controlled device, characterized in that: The program-controlled device is connected and communicated with an implantable device of a controlled object, and the program-controlled device comprises: A control interface, configured to include at least a display interface for displaying the real-time status of the controlled object and an operation interface for inputting program control parameters of the control object; The processor is configured to record the real-time dynamics of the control interface and generate a page recording file according to a preset collection frequency and a preset page collection method when detecting the start of a medical program control conference.

2. The device according to claim 1, characterized in that The preset acquisition frequency includes at least a first acquisition frequency and a second acquisition frequency; The process of the processor recording the real-time dynamics of the control interface according to the preset acquisition frequency and the preset page acquisition mode and generating a page recording file includes: According to the preset page collection method, the real-time dynamics of the display interface are collected based on the first collection frequency, and the real-time dynamics of the operation interface are collected based on the second collection frequency to generate a page recording file, wherein the first collection frequency is higher than the second collection frequency.

3. The device according to claim 1, characterized in that The process of the processor recording the real-time dynamics of the control interface and generating a page recording file includes: When the start of the medical program control conference is detected, a first page snapshot of the operation interface is obtained, wherein the first page snapshot is a DOM tree structure snapshot corresponding to the operation interface; Performing page parsing processing on the first page snapshot to determine initial page information corresponding to the first page snapshot, wherein the initial page information includes a page structure, and the page structure includes at least page elements and page nodes; When a change in the operation interface is detected, obtaining a second page snapshot of the operation interface, and determining structural change information of the operation interface according to each of the second page snapshots, wherein the structural change information at least includes a changed structure and a change time corresponding to the changed structure; A page recording file in a preset text format is generated according to the initial page information, the structure change information and the change time.

4. The device according to claim 3, characterized in that The process of the processor determining the structural change information of the operation interface according to each of the second page snapshots includes: For each page structure in each of the second page snapshots, compare the page structure with the page structure at the previous moment to determine the target page structure that has changed and the structure change time corresponding to the target page structure; The structural change information of the operation interface is formed according to the target page structure and the structural change time corresponding to the target page structure.

5. The device according to claim 3, characterized in that The process of the processor generating a page recording file in a preset text format according to the initial page information, the structure change information and the change time includes: Sorting the change times to obtain a change time sequence; Based on the change time sequence, converting the structure change information and the initial page information into page recording data; The page recording file in a preset text format is generated according to the page recording data.

6. The device according to claim 5, characterized in that The page recording data includes initial recording data and subsequent recording data; The process of converting the structure change information and the initial page information into page recording data in a preset data format based on the change time sequence by the processor includes: Performing format conversion processing on the initial page information to obtain first format conversion data, and performing format conversion processing on the structure change information to obtain second format conversion data; Based on the change time sequence, sorting the second format conversion data to obtain third format conversion data; The first format conversion data is determined as initial recording data of the page recording data, and the third format conversion data is determined as subsequent recording data of the page recording data.

7. The device according to claim 3, characterized in that The processor is further configured to: After generating a page recording file in a preset text format, in response to a playback request for the control interface, acquiring the page recording file; The page recording file is reconstructed into a page playback video of the control interface based on the timestamp in the page recording file, and the page playback video is displayed.

8. The device according to claim 7, characterized in that The process of the processor reconstructing the page recording file into a page playback video of the control object page based on the timestamp in the page recording file includes: Performing web page element parsing processing on the page recording file to obtain web page element tags and web page node information; Based on the timestamp in the page recording file and the web page node information, the web page element tag is inserted into the HTML file to obtain the page playback video of the control interface.

9. The device according to claim 8, characterized in that The processor is further configured to: After inserting the web page element tag into the HTML file, obtaining the medical image video corresponding to the page recording file, and determining the web page video tag in the page recording file; Insert the uniform resource locator of the medical imaging video into the web page video tag to construct a page playback video of the control interface.

10. The device according to claim 8, characterized in that The process of the processor acquiring the page recording file in response to a playback request for the control object page includes: Displaying a playback function panel corresponding to the operation interface, wherein the playback function panel includes at least one of a program-controlled parameter adjustment panel, a patient restriction panel, an AI-assisted diagnosis panel, an LFP acquisition panel, a real-time measurement panel, a timed stimulation panel, and a parameter overview panel; In response to a selection operation on a playback function module, a page playback video corresponding to the selected playback function module is determined in the page recording file.

11. A program-controlled page recording method, characterized in that: The method is applied to a program-controlled device, the program-controlled device includes a control interface and a processor, the control interface includes a display interface and an operation interface; the method includes: When the start of a medical program-controlled conference is detected, the processor records the real-time dynamics of the control interface according to a preset collection frequency and a preset page collection method, and generates a page recording file.

12. The method according to claim 11, characterized in that The preset acquisition frequency includes at least a first acquisition frequency and a second acquisition frequency, and the method further includes: According to the preset page collection method, the real-time dynamics of the display interface are collected based on the first collection frequency, and the real-time dynamics of the operation interface are collected based on the second collection frequency to generate a page recording file, wherein the first collection frequency is higher than the second collection frequency.

13. The method according to claim 11, characterized in that When the start of a medical program control conference is detected, the processor records the real-time dynamics of the control interface according to a preset collection frequency and a preset page collection method, and generates a page recording file, including: When the start of the medical program control conference is detected, a first page snapshot of the operation interface is obtained, wherein the first page snapshot is a DOM tree structure snapshot corresponding to the operation interface; Performing page parsing processing on the first page snapshot to determine initial page information corresponding to the first page snapshot, wherein the initial page information includes a page structure, and the page structure includes at least page elements and page nodes; When a change in the operation interface is detected, obtaining a second page snapshot of the operation interface, and determining structural change information of the operation interface according to each of the second page snapshots, wherein the structural change information at least includes a changed structure and a change time corresponding to the changed structure; A page recording file in a preset text format is generated according to the initial page information, the structure change information and the change time.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the program-controlled page recording method described in any one of claims 11-13 when executed.

Images