Methods, systems, devices, and media for debriefing on multi-signal source interactions

Abstract

The present application relates to the method, system, equipment and medium for the method for the method, system, equipment and medium for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for the method for

Description

Technical Field

[0001] This application relates to the field of retrospective analysis technology, and more particularly to methods, systems, devices, and media for retrospective analysis of interactions between multiple signal sources. Background Technology

[0002] In existing technologies, when an interactive terminal can operate on multiple other signal sources, in order to facilitate the later review of the interactive terminal's operation on each signal source, the screen content of the interactive terminal is recorded by software. All the screen content displayed on the interactive terminal is recorded throughout the process. During the later review, the screen recording content also needs to be reviewed throughout the process, which is very inefficient and occupies a lot of memory resources. Summary of the Invention

[0003] To address the deficiencies or shortcomings in the existing technology, this application proposes a method for reviewing interactions between multiple signal sources, wherein an interactive terminal is used to interact with each signal source, and the method includes:

[0004] The interactive terminal receives user interaction operations on various signal sources at different times;

[0005] The interactive terminal determines the signal source being operated on at each moment;

[0006] The interactive terminal will associate the original input actions of each signal source with each signal source at each time to form a set of original input actions corresponding to each signal source;

[0007] The interactive terminal receives a review request for the target signal source and responds with the set of original input actions corresponding to the target signal source.

[0008] This application also proposes a method for reviewing interactions between multiple signal sources, wherein an interactive terminal is used to interact with each signal source, and the method includes:

[0009] The interactive terminal receives user interaction operations on various signal sources at different times;

[0010] The interactive terminal determines the signal source being operated on at each moment;

[0011] The interactive terminal will associate the original input actions of each signal source with each signal source at each time to form a set of original input actions corresponding to each signal source;

[0012] The interactive terminal sends the set of original input actions corresponding to each signal source to the corresponding signal source, so that each signal source can respond to the set of original input actions; or, the interactive terminal receives a review request for the target signal source and sends the set of original input actions corresponding to the target signal source to the target signal source, so that the target signal source can respond to the set of original input actions.

[0013] This application also proposes a method for reviewing interactions between multiple signal sources, wherein an interactive terminal is used to interact with each signal source, and the method includes:

[0014] The interactive terminal receives user interaction operations on various signal sources at different times;

[0015] The interactive terminal determines the signal source being operated on at each moment;

[0016] The interactive terminal will associate the original input actions of each signal source with each signal source at each time to form a set of original input actions corresponding to each signal source;

[0017] The interactive terminal receives a review request from an additional terminal for the target signal source and sends the original set of input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the corresponding set of original input actions; or, the interactive terminal actively sends the original set of input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the corresponding set of original input actions.

[0018] According to some embodiments of the present invention, the original input actions include keyboard actions, mouse actions, touch actions, voice input, or any combination thereof; mouse actions include single-click, double-click, and drag actions; touch actions include single-finger or multi-finger single-click, single-finger or multi-finger double-click, single-finger or multi-finger drag actions, or any combination thereof.

[0019] According to some embodiments of the present invention, the interactive terminal associates the original input actions of the interactive terminal to each signal source at each time with each signal source to form a set of original input actions corresponding to each signal source. This includes merging the original input actions of the interactive terminal to each signal source at each time at a single time according to the signal source to form a set of original input actions corresponding to each signal source, or merging the original input actions of the interactive terminal to each signal source at each time in real time according to the signal source.

[0020] According to some embodiments of the present invention, the merging includes trimming time periods that did not generate original input actions, so that when responding to the corresponding set of original input actions, the time periods that did not generate original input actions are skipped.

[0021] According to some embodiments of the present invention, the method further includes the interactive terminal copying the original input action sets corresponding to each signal source, and pasting, exporting or sending them to other interactive terminals; or, the interactive terminal responding to the corresponding original input action set, or the target signal source responding to the corresponding original input action set, or the additional terminal responding to the corresponding original input action set, directly sending the screen corresponding to the response result to one or more other interactive terminals.

[0022] According to some embodiments of the present invention, the method further includes statistically analyzing or plotting each input action along a timeline based on the type of the original input action.

[0023] This application also proposes a system for reviewing interactions between multiple signal sources. The system includes an interactive terminal, which is used to interact with each signal source and execute the method described thereon.

[0024] According to some embodiments of the present invention, the system further includes the aforementioned additional terminal.

[0025] According to some embodiments of the present invention, the additional terminal includes a server.

[0026] This application also proposes an apparatus for reviewing interactions of multiple signal sources, including a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor performing the aforementioned method based on the computer program stored in the memory.

[0027] This application also proposes a computer-readable storage medium storing a computer program that, when executed by a processor, performs the aforementioned method.

[0028] Through the embodiments of the present invention, the original input process can be directly reconstructed, thereby providing a richer reconstruction of the interactive terminal's operation process for each signal source. Furthermore, since the actions of each signal source are processed separately throughout the process, only the original input action set of one target signal source needs to be retrieved for rapid review of that target signal source, without needing to intersperse the review process with reviews of other signal sources. Moreover, the entire process does not require recording the screen content generated by interactions with all signal sources, thus consuming minimal storage space. Attached Figure Description

[0029] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. It should be noted that, unless otherwise specified, the embodiments and features in the embodiments of this application can be combined with each other.

[0030] Figure 1a A flowchart illustrating a method for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown.

[0031] Figure 1b A schematic block diagram of a system for reviewing interactions between multiple signal sources according to some embodiments of the present invention is shown.

[0032] Figure 1c A flowchart illustrating a method for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown.

[0033] Figure 2 A flowchart illustrating a method for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown.

[0034] Figure 3 A schematic block diagram of a system for reviewing interactions between multiple signal sources according to some embodiments of the present invention is shown.

[0035] Figures 4a-4d A schematic structural block diagram of an apparatus for reviewing interactions of multiple signal sources according to further embodiments of the present invention is shown.

[0036] Figure 5 A schematic structural diagram of an apparatus for reviewing interactions between multiple signal sources according to some embodiments of the present invention is shown. Detailed Implementation

[0037] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are some embodiments of the present invention, but not all embodiments.

[0038] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other.

[0039] Figure 1a A flowchart illustrating a method for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown, as illustrated, the method comprising steps S11, S12, S13, and S14:

[0040] S11. The interactive terminal receives user interaction operations on each signal source at various times.

[0041] refer to Figure 1b , Figure 1bThis diagram illustrates a system for reviewing interactions between multiple signal sources according to some embodiments of the present invention. The interactive terminal can display the screens of various signal sources (11, 21, 31, and 41 on the interactive terminal represent the windows containing signal sources 11, 21, 31, and 41, respectively). The user interacts with each signal source (11, 21, 31, and 41) through the interactive terminal 10. The interactive terminal receives user interactions with each signal source at various times. For example, when the user operates on the window containing signal sources 11, 21, 31, and 41, the corresponding signal sources 11, 21, 31, and 41 are operated. Since the position of the signal source output can be preset according to existing technology, when the touch is applied to the corresponding position, the interactive terminal can determine which signal source is being used. Each signal source can access the interactive terminal via a network or other various means. The interactive terminal can be a computing device such as a computer, laptop, PDA, or cloud server, or a part thereof.

[0042] The interactive operations can be generated via a graphical keyboard, or via a mouse or touch panel.

[0043] S12. The interactive terminal determines the signal source operated at each time.

[0044] Depending on the different access methods of each signal source and the interactive terminal, the interactive terminal can determine the signal source being operated on at each moment in a corresponding manner. In some embodiments of the present invention, each signal source can connect its screen to the interactive terminal via a video cable. The interactive terminal presents each signal source according to a certain layout. When the mouse is applied to the interactive terminal, the user can determine the signal source to which the mouse is applied based on the layout and the mouse's position (i.e., the signal source being operated on at each moment), and convert the mouse position into coordinates in the signal source space and send it to the signal source, thereby realizing interaction with the signal source. For example, refer to... Figure 1b If the mouse is applied to the position of the signal source 11 on the interactive terminal 10, the interactive terminal can determine that the signal source being operated is 11 based on the layout position of the signal source 11 and the position of the mouse.

[0045] S13. The interactive terminal will associate the original input actions of each signal source with each signal source at each time to form a set of original input actions corresponding to each signal source.

[0046] In this application, the original input action includes keyboard actions, mouse actions, touch actions, voice input, or any combination thereof; that is, it is not a string of input commands. Mouse actions include single-click, double-click, and drag actions; touch actions include single-finger or multi-finger single-click, single-finger or multi-finger double-click, single-finger or multi-finger drag actions, or any combination thereof. The original input action for each signal source can be, for example, the action of opening a program for the signal source, the action of interacting with program content, etc.

[0047] According to some embodiments of the present invention, the interactive terminal associates the original input actions of the interactive terminal to each signal source at each time with each signal source to form a set of original input actions corresponding to each signal source. This includes merging the original input actions of the interactive terminal to each signal source at each time at a given time, based on the signal source, to form a set of original input actions corresponding to each signal source. For example, refer to... Figure 1b The original input action of the interactive terminal to signal source 11 at time t1 will be associated with signal source 11, the original input action to signal source 21 at time t2 will be associated with signal source 21, and so on. The original input action to signal source 11 at subsequent time tn will also be associated with signal source 11. The interactive terminal can merge all original input actions belonging to signal source 11 to form a set of original input actions corresponding to signal source 11 when the interaction completely ends (e.g., when an interaction termination input is received); and merge all original input actions belonging to signal source 21 to form a set of original input actions corresponding to signal source 21, and so on.

[0048] According to some embodiments of the present invention, the interactive terminal associates the original input actions of each signal source at each time with each signal source to form a set of original input actions corresponding to each signal source, including merging the original input actions of the interactive terminal to each signal source at each time in real time according to the signal source. For example, refer to Figure 1b The original input action of the interactive terminal to signal source 11 at time t1 will be associated with signal source 11, the original input action to signal source 21 at time t2 will be associated with signal source 21, and so on. The original input action to signal source 11 at subsequent time tn will also be associated with signal source 11. At this time, the original input actions of the interactive terminal to each signal source at each time begin to be merged according to the signal source; that is, the original input actions of the interactive terminal to each signal source at each time are merged according to the signal source in real time.

[0049] According to some embodiments of the present invention, the merging process includes trimming time periods during which no original input actions were generated, so that when the target signal source responds to the corresponding set of original input actions, the time periods during which no original input actions were generated are skipped. For example, from time t1 to time tn, the interactive terminal does not perform any interactive operations on signal source 11; therefore, the operation during this period is zero. Thus, during the merging process, this period can be trimmed, so that during later review, only the actions at times t1 and tn need to be executed, without the execution time spanning the entire time period from t1 to tn.

[0050] S14. The interactive terminal receives a review request for the target signal source and responds with the set of original input actions corresponding to the target signal source.

[0051] The interactive terminal can further receive a review request from the user to review the operation of a target signal source, such as signal source 11. The interactive terminal receives the review request for the target signal source and responds to the original set of input actions corresponding to the target signal source. Since the original set of input actions is a set of keyboard and mouse actions, the interactive terminal does not display the operation result at this time, but rather each operation process. For example, when a keyboard action corresponds to inputting a phrase, the interactive terminal will reproduce the multiple options that appeared with each keystroke, rather than directly displaying the final phrase on the screen.

[0052] According to some embodiments of the present invention, the method further includes: the interactive terminal copying the sets of original input actions corresponding to each signal source, and pasting, exporting, or sending them to other interactive terminals; or, the interactive terminal responding to the corresponding set of original input actions, or the target signal source responding to the corresponding set of original input actions, or an additional terminal responding to the corresponding set of original input actions, directly sending the screen corresponding to the response result to one or more other interactive terminals. The other interactive terminals include interactive terminals with the same or different functions as the interactive terminal.

[0053] According to some embodiments of the present invention, the method further includes statistically analyzing or plotting each input action along a timeline based on the type of the original input action.

[0054] For example, you can count the number of mouse clicks at a certain moment, or draw the mouse action types such as single click or double click directly on the timeline. For example, the mouse click action is above time t1, and the mouse double click action is above time t2.

[0055] Figure 1c A flowchart illustrating a method for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown. The method includes:

[0056] S21, the interactive terminal receives user interaction operations on each signal source at various times;

[0057] S22, the interactive terminal determines the signal source operated at each moment;

[0058] S23, the interactive terminal will associate the original input actions of each signal source at each time with each signal source to form a set of original input actions corresponding to each signal source;

[0059] S24, the interactive terminal sends the set of original input actions corresponding to each signal source to each corresponding signal source so that each signal source can respond to the set of original input actions; or, the interactive terminal receives a review request for the target signal source and sends the set of original input actions corresponding to the target signal source to the target signal source so that the target signal source can respond to the set of original input actions.

[0060] The transmission to the target signal source or signal source includes direct transmission to the target signal source or signal source, or indirect transmission to the target signal source or signal source via a server.

[0061] At this point, a review can be performed directly at each signal source or target signal source to reconstruct the interactive terminal's operation on the target signal source.

[0062] Figure 2 A flowchart illustrating a method for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown. The method includes:

[0063] S31, the interactive terminal receives user interaction operations on each signal source at various times;

[0064] S32, the interactive terminal determines the signal source operated at each time;

[0065] S33, the interactive terminal will associate the original input actions of each signal source with each signal source at each time to form a set of original input actions corresponding to each signal source;

[0066] S34, the interactive terminal receives a review request from an additional terminal for the target signal source, and sends the set of original input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the set of original input actions; or, the interactive terminal actively sends the set of original input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the set of original input actions.

[0067] At this point, the signal source can be invoked again at the additional terminal to directly review each signal source or target signal source, restoring the interactive terminal's operation on the signal source or target signal source. The additional terminal can also resend the original set of input actions to each signal source.

[0068] Figure 3 A schematic block diagram of a system for reviewing interactions between multiple signal sources according to some embodiments of the present invention is shown.

[0069] As shown in the figure, the system includes an interactive terminal 10 and a server 101. For a description of the interactive terminal, please refer to the preceding text. Figures 1a-2 The interactive terminal can respond to the server's review request for the target signal source by sending the set of original input actions corresponding to the target signal source to the server, so that the server can respond with the corresponding set of original input actions.

[0070] At this point, the server can recall the signal source again, and directly review each signal source or target signal source at the server to restore the interactive terminal's operation on the signal source or target signal source. Alternatively, the server can resend the original set of input actions to each signal source.

[0071] Previous reference Figures 1a-1b The description may also be applied to, or adapted accordingly to, the application of. Figures 1c-3 For the sake of simplicity, the specific implementation examples will not be described in detail here.

[0072] Figure 4a A schematic structural block diagram of an apparatus for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown. Figure 4a As shown, the device 400 may include: a receiving unit 410, a judging unit 420, an association unit 430, and a replay unit 440.

[0073] The receiving unit 410 receives user interaction operations on each signal source at various times.

[0074] The judgment unit 420 judges the signal source operated at each time.

[0075] The association unit 430 associates the original input actions of each signal source at each time with each signal source to form a set of original input actions corresponding to each signal source.

[0076] The replay unit 440 receives a replay request for the target signal source and responds with the set of original input actions corresponding to the target signal source.

[0077] Figure 4b A schematic structural block diagram of an apparatus for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown. Figure 4b As shown, the device 1400 may include: a receiving unit 1410, a judging unit 1420, an association unit 1430, and a replay unit 1440.

[0078] The receiving unit 1410 receives user interaction operations on each signal source at various times.

[0079] The judgment unit 1420 judges the signal source operated at each time.

[0080] The association unit 1430 associates the original input actions of each signal source at each time with each signal source to form a set of original input actions corresponding to each signal source.

[0081] The replay unit 1440 sends the collection of each original input action corresponding to each signal source to each corresponding signal source so that each signal source can respond to the corresponding collection of original input actions.

[0082] Figure 4c A schematic structural block diagram of an apparatus for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown. Figure 4c As shown, the device 2400 may include: a receiving unit 2410, a judging unit 2420, an association unit 2430, and a replay unit 2440.

[0083] The receiving unit 2410 receives user interaction operations on each signal source at various times.

[0084] The judgment unit 2420 judges the signal source operated at each time.

[0085] The association unit 2430 associates the original input actions of each signal source at each time with each signal source to form a set of original input actions corresponding to each signal source.

[0086] The replay unit 2440 receives a replay request for the target signal source and sends the set of original input actions corresponding to the target signal source to the target signal source so that the target signal source can respond to the set of original input actions.

[0087] Figure 4d A schematic structural block diagram of an apparatus for reviewing interactions of multiple signal sources according to some embodiments of the present invention is shown. Figure 4d As shown, the device 3400 may include: a receiving unit 3410, a judging unit 3420, an association unit 3430, and a replay unit 3440.

[0088] The receiving unit 3410 receives user interaction operations on each signal source at various times.

[0089] The judgment unit 3420 judges the signal source operated at each time.

[0090] The association unit 3430 associates the original input actions of each signal source at each time with each signal source to form a set of original input actions corresponding to each signal source.

[0091] The replay unit 3440 receives a replay request from an additional terminal for the target signal source and sends the set of original input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the set of original input actions.

[0092] In this application, the units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of the present invention, depending on actual needs.

[0093] The device used for reviewing interactions between multiple signal sources can be the one mentioned above. Figures 1a-3 The described interactive terminal may include or be a part of the interactive terminal, as previously referred to. Figures 1a-3 The relevant details of the interactive terminal described are also included here by reference, and will not be repeated here.

[0094] Figure 5 A schematic structural diagram of a device 500 for reviewing interactions between multiple signal sources according to some embodiments of the present invention is shown. Figure 5 As shown, the device includes a processor 51, a memory 52, and a bus 53.

[0095] In some instances, the device may further include an input device 501, an input port 502, an output port 503, and an output device 504. The input port 502, processor 51, memory 52, and output port 503 are interconnected via a bus 53. The input device 501 and output device 504 are connected to the bus 53 via input port 502 and output port 503, respectively, and thus connected to other components of the device. It should be noted that the output and input interfaces here can also be represented by I / O interfaces. Specifically, the input device 501 receives input information from the outside and transmits the input information to the processor 51 via the input port 502. The processor 51 processes the input information based on computer-executable instructions stored in the memory 52 to generate output information, temporarily or permanently storing the output information in the memory 52, and then transmitting the output information to the output device 504 via the output port 503. The output device 504 outputs the output information to the outside of the device.

[0096] The aforementioned memory 52 includes a large-capacity memory for data or instructions. For example, and not limitingly, memory 52 may include an HDD, floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or Universal Serial Bus (USB) drive, or a combination of two or more of these. Where suitable, memory 52 may include removable or non-removable (or fixed) media. Where suitable, memory 52 may be internal or external to a device. In a particular embodiment, memory 52 is a non-volatile solid-state memory. In a particular embodiment, memory 52 includes read-only memory (ROM). Where suitable, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or flash memory, or a combination of two or more of these.

[0097] Bus 53 includes hardware, software, or both, that couples multiple components together. For example, and not limitingly, bus 53 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. While specific buses are described and illustrated in embodiments of the invention, the invention contemplates any suitable bus or interconnect.

[0098] The processor 51 performs the following actions based on the computer program stored in the memory 52:

[0099] It receives user interaction operations on each signal source at various times.

[0100] Determine the signal source being operated on at each time point.

[0101] The original input actions to each signal source at each time point will be associated with each signal source to form a set of original input actions corresponding to each signal source.

[0102] Receive a review request for the target signal source and respond with the set of original input actions corresponding to the target signal source.

[0103] According to some embodiments of the present invention, the processor 51 performs the following actions based on a computer program stored in the memory 52:

[0104] It receives user interaction operations on each signal source at various times.

[0105] Determine the signal source being operated on at each time point.

[0106] The original input actions to each signal source at each time point will be associated with each signal source to form a set of original input actions corresponding to each signal source.

[0107] The collection of each original input action corresponding to each signal source is sent to the corresponding signal source so that each signal source can respond to the corresponding collection of original input actions.

[0108] According to some embodiments of the present invention, the processor 51 performs the following actions based on a computer program stored in the memory 52:

[0109] It receives user interaction operations on each signal source at various times.

[0110] Determine the signal source being operated on at each time point.

[0111] The original input actions to each signal source at each time point will be associated with each signal source to form a set of original input actions corresponding to each signal source.

[0112] Receive a review request for the target signal source, and send the set of original input actions corresponding to the target signal source to the target signal source so that the target signal source can respond to the set of original input actions.

[0113] According to some embodiments of the present invention, the processor 51 performs the following actions based on a computer program stored in the memory 52:

[0114] It receives user interaction operations on each signal source at various times.

[0115] Determine the signal source being operated on at each time point.

[0116] The original input actions to each signal source at each time point will be associated with each signal source to form a set of original input actions corresponding to each signal source.

[0117] Receive an additional terminal's review request for the target signal source, and send the original set of input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the corresponding set of original input actions.

[0118] According to further embodiments of the present invention, the computer program may be divided into one or more units in various ways and stored in the memory, and executed by the processor to perform the present invention. The one or more units may be a series of computer program instruction segments capable of performing a specific function, the instruction segments describing the execution process of the computer program in the device. The computer program may be based on the foregoing reference... Figures 4a-4d The functions of each unit in the various embodiments described are used to divide the system into multiple units, or include those referenced above. Figures 4a-4d The various units in the described embodiments are not repeated here for the sake of simplicity.

[0119] The processor referred to may be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor is the control center of the device, connecting various parts of the device via various interfaces and lines. The device may be a desktop computer, laptop, handheld computer, cloud server, or other computing devices or a part thereof. The device may include, but is not limited to, a processor and memory. Those skilled in the art will understand that the schematic diagrams are merely examples of the device and do not constitute a limitation on the device.

[0120] Previous reference Figures 1a-3 The relevant details are included here by reference and will not be repeated here.

[0121] This application also proposes a computer-readable storage medium storing a computer program that, when executed by a processor, performs the following steps:

[0122] It receives user interaction operations on each signal source at various times.

[0123] Determine the signal source being operated on at each time point.

[0124] The original input actions to each signal source at each time point will be associated with each signal source to form a set of original input actions corresponding to each signal source.

[0125] Receive a review request for the target signal source and respond with the set of original input actions corresponding to the target signal source.

[0126] According to some embodiments of the present invention, when the computer program is executed by a processor, it performs the following steps:

[0127] It receives user interaction operations on each signal source at various times.

[0128] Determine the signal source being operated on at each time point.

[0129] The original input actions to each signal source at each time point will be associated with each signal source to form a set of original input actions corresponding to each signal source.

[0130] The collection of each original input action corresponding to each signal source is sent to the corresponding signal source so that each signal source can respond to the corresponding collection of original input actions.

[0131] According to some embodiments of the present invention, when the computer program is executed by a processor, it performs the following steps:

[0132] It receives user interaction operations on each signal source at various times.

[0133] Determine the signal source being operated on at each time point.

[0134] The original input actions to each signal source at each time point will be associated with each signal source to form a set of original input actions corresponding to each signal source.

[0135] Receive a review request for the target signal source, and send the set of original input actions corresponding to the target signal source to the target signal source so that the target signal source can respond to the set of original input actions.

[0136] According to some embodiments of the present invention, when the computer program is executed by a processor, it performs the following steps:

[0137] It receives user interaction operations on each signal source at various times.

[0138] Determine the signal source being operated on at each time point.

[0139] The original input actions to each signal source at each time point will be associated with each signal source to form a set of original input actions corresponding to each signal source.

[0140] Receive an additional terminal's review request for the target signal source, and send the original set of input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the corresponding set of original input actions.

[0141] Previous reference Figures 1a-3 The relevant details are included here by reference and will not be repeated here.

[0142] The computer program includes computer program code, which may be in the form of source code, object code, executable file, or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc.

[0143] Through the embodiments of the present invention, the original input process can be directly reconstructed, thereby providing a richer reconstruction of the interactive terminal's operation process for each signal source. Furthermore, since the actions of each signal source are processed separately throughout the process, only the original input action set of one target signal source needs to be retrieved for rapid review of that target signal source, without needing to intersperse the review process with reviews of other signal sources. Moreover, the entire process does not require recording the screen content generated by interactions with all signal sources, thus consuming minimal storage space.

[0144] It should be noted that although the structure of the apparatus of the present invention and the method of its operation are described in a specific order in the accompanying drawings, this does not require or imply that the operations must be performed in that specific order, or that all the operations shown must be performed to achieve the desired result. On the contrary, the steps depicted in the flowcharts may be performed in a different order. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step, and / or one step may be broken down into multiple steps.

[0145] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. For those skilled in the art, the present invention can have various modifications and variations. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention. It should be noted that although the structure of the device and its operation method are described in a specific order in the accompanying drawings, this does not require or imply that these operations must be performed in that specific order, or that all the operations shown must be performed to achieve the desired result. On the contrary, the steps depicted in the flowchart can be executed in a different order. Additionally or alternatively, certain steps can be omitted, multiple steps can be combined into one step, and / or one step can be broken down into multiple steps.

[0146] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for reviewing interactions between multiple signal sources, wherein an interactive terminal is used to interact with each signal source, the signal sources are connected to the interactive terminal, and the interactive terminal presents each signal source according to a certain layout, the method comprising: The interactive terminal receives user interaction operations on various signal sources at different times; The interactive terminal determines the signal source being operated on at each moment based on the layout and the position of the interactive operation, and converts the position of the interactive operation into coordinates in the signal source space and sends them to the signal source, thereby realizing the interaction with the signal source; The interactive terminal will associate the original input actions of each signal source with each signal source at each time to form a set of original input actions corresponding to each signal source; The interactive terminal receives a review request for the target signal source and responds with the set of original input actions corresponding to the target signal source.

2. The method according to claim 1 further includes the interactive terminal copying the original input action sets corresponding to each signal source, and pasting, exporting or sending them to other interactive terminals; or, the interactive terminal responding to the corresponding original input action set directly sending the screen corresponding to the response result to one or more other interactive terminals.

3. A method for reviewing interactions between multiple signal sources, wherein an interactive terminal is used to interact with each signal source, the signal sources are connected to the interactive terminal, and the interactive terminal presents each signal source according to a certain layout, the method comprising: The interactive terminal receives user interaction operations on various signal sources at different times; The interactive terminal determines the signal source being operated on at each moment based on the layout and the position of the interactive operation, and converts the position of the interactive operation into coordinates in the signal source space and sends them to the signal source, thereby realizing the interaction with the signal source; The interactive terminal will associate the original input actions of each signal source with each signal source at each time to form a set of original input actions corresponding to each signal source; The interactive terminal sends the set of original input actions corresponding to each signal source to each corresponding signal source, so that each signal source can respond to the set of original input actions. Alternatively, the interactive terminal receives a review request for the target signal source and sends the set of original input actions corresponding to the target signal source to the target signal source so that the target signal source can respond to the set of original input actions.

4. The method according to claim 3 further includes the interactive terminal copying the original input action sets corresponding to each signal source, and pasting, exporting or sending them to other interactive terminals; or, the target signal source responding to the corresponding original input action set directly sending the screen corresponding to the response result to one or more other interactive terminals.

5. A method for reviewing interactions between multiple signal sources, wherein an interactive terminal is used to interact with each signal source, the signal sources are connected to the interactive terminal, and the interactive terminal presents each signal source according to a certain layout, the method comprising: The interactive terminal receives user interaction operations on various signal sources at different times; The interactive terminal determines the signal source being operated on at each moment based on the layout and the position of the interactive operation, and converts the position of the interactive operation into coordinates in the signal source space and sends them to the signal source, thereby realizing the interaction with the signal source; The interactive terminal will associate the original input actions of each signal source with each signal source at each time to form a set of original input actions corresponding to each signal source; The interactive terminal receives a review request from an additional terminal for the target signal source and sends the set of original input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the set of original input actions. Alternatively, the interactive terminal may proactively send the set of original input actions corresponding to the target signal source to the additional terminal, so that the additional terminal can respond to the set of original input actions.

6. The method according to claim 5 further includes the interactive terminal copying the original input action sets corresponding to each signal source, and pasting, exporting or sending them to other interactive terminals; or, an additional terminal responding to the corresponding original input action set directly sending the screen corresponding to the response result to one or more other interactive terminals.

7. The method according to claim 1, 3, or 5, wherein, The original input actions include keyboard actions, mouse actions, touch actions, voice input, or any combination thereof; mouse actions include single-click, double-click, and drag actions; touch actions include single-finger or multi-finger single-click, single-finger or multi-finger double-click, single-finger or multi-finger drag actions, or any combination thereof.

8. The method according to claim 1, 3 or 5, wherein, The interactive terminal associates the original input actions of each signal source at each time with each signal source to form a set of original input actions corresponding to each signal source. This includes merging the original input actions of the interactive terminal at each time according to the signal source at a single time to form a set of original input actions corresponding to each signal source, or merging the original input actions of the interactive terminal at each time according to the signal source in real time.

9. The method according to claim 8, wherein, The merging process includes trimming time periods that did not generate any original input actions, so that when responding to the corresponding set of original input actions, the time periods that did not generate any original input actions are skipped.

10. The method according to claim 1, 3 or 5 further includes, according to the type of the original input action, statistically analyzing or plotting each input action along a time axis.

11. A system for reviewing interactions between multiple signal sources, the system comprising an interactive terminal, wherein the interactive terminal is used to interact with each signal source and execute the method described in any one of claims 1-10.

12. The system according to claim 11 further includes an additional terminal, wherein the interactive terminal receives the review request of the additional terminal for the target signal source and sends the original set of input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the corresponding set of original input actions; or, the interactive terminal actively sends the original set of input actions corresponding to the target signal source to the additional terminal so that the additional terminal can respond to the corresponding set of original input actions.

13. The system of claim 12, wherein the additional terminal includes a server.

14. An apparatus for reviewing interactions of multiple signal sources, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor performing the method of any one of claims 1-10 based on the computer program stored in the memory.

15. A computer-readable storage medium storing a computer program that, when executed by a processor, performs the method described in any one of claims 1-10.

Images