Information interaction method and device suitable for terminal, and computing equipment

Abstract

The invention discloses an information interaction method and device suitable for a terminal and electronic equipment, relates to an information interaction technology of communication application, and aims to solve the problem that an existing communication and cooperation application program is inconvenient to operate during user communication. The method comprises the following steps: displaying an image intercepted from a first file; editing of the image is accepted, the original editing process is stored, a second file is formed, and editing comprises one or more operations of character insertion, image insertion, sound insertion and paintbrush graffiti; sending the second file to a server; at the other terminal, receiving and opening a second file from the server; the modification process of the second file is saved, a third file is formed, and modification comprises one or more operations of character insertion, image insertion, sound insertion, brush graffiti and modification of the original editing process; and uploading the third file to the server. The method and the device are suitable for communication between users in conferences, teaching and other scenes.

Description

Technical Field

[0001] The present application relates to information interaction technology for communication applications, and specifically to an information interaction method, device, system and computing equipment. Background Art

[0002] Communication and collaboration applications can realize functions such as remote meetings and online teaching, and are increasingly widely used in enterprises, schools and other places. This type of application allows a terminal to display / share files with other terminals. Some applications allow users to communicate with each other through voice or text in the process of displaying / sharing files with other terminals. Some applications allow users to edit files in the sharing interface in the process of displaying / sharing files with other terminals. However, in some cases where users are not allowed to discuss freely, if users need to raise questions or express opinions on certain contents of the file, they can only wait until the file display is over and the user who displays or shares the file re-displays or shares the corresponding content for other users to view. This method is not only cumbersome to operate, but once the meeting / class is over, users can no longer communicate through the above applications, but can only use other applications (such as WeChat, QQ, etc.) for discussion. The discussion involves the files displayed in the meeting / class, and usually the file or part of the file needs to be sent to other applications to improve communication efficiency. This cumbersome communication method cannot bring a good experience to users. Summary of the invention

[0003] In order to solve or alleviate the above problems, the present application proposes an information interaction method, device and system suitable for a terminal.

[0004] An information interaction method applicable to a terminal of the present application includes: displaying an image captured from a first file; accepting editing of the image and saving the editing process of the image to form a second file, wherein the editing process is an original editing process, and the editing includes one or more operations of inserting text, inserting images, inserting sounds, and brush graffiti; and sending the second file, the image, and the position / time information of the image in the first file to a server.

[0005] Optionally, the saving of the editing process of the image includes: decomposing the editing process into a number of stages in chronological order; saving the image obtained after editing each stage; and forming a second file with the images obtained after editing the several stages.

[0006] Optionally, the saving of the editing process of the image includes: saving a complete editing process of the image.

[0007] Optionally, the method further comprises: when a deletion operation occurs, saving / not saving the deletion process according to a selected method.

[0008] Optionally, the second file is a video file.

[0009] Another information interaction method applicable to a terminal of the present application includes: receiving and opening a second file from a server; accepting editing of the second file, and saving the editing process of the second file to form a third file, wherein the editing process is a modification process, and the modification process includes inserting text, inserting images, inserting sounds, brush graffiti, and modifying one or more operations of the original editing process; and uploading the third file to the server so that the server sends the third file to the corresponding terminal.

[0010] Optionally, the modifying the original editing process includes: copying, moving, and / or deleting operations of the original editing process.

[0011] An information interaction device suitable for a terminal of the present application includes: a first display unit, suitable for displaying an image captured from a first file; an original editing unit, suitable for accepting editing of the image and saving the editing process of the image to form a second file, wherein the editing process is an original editing process, and the editing includes one or more operations of inserting text, inserting images, inserting sounds, and brush graffiti; and a second file uploading unit, suitable for sending the second file, the image, and the position / time information of the image in the first file to a server.

[0012] Another information interaction device suitable for a terminal of the present application includes: a second display unit, which receives and opens a second file from a server; a modification unit, which is suitable for accepting editing of the second file and saving the editing process of the second file to form a third file, wherein the editing process is a modification process, and the modification process includes one or more operations of inserting text, inserting images, inserting sounds, brush graffiti, and modifying the original editing process; and a third file uploading unit, which is suitable for uploading the third file to the server, so that the server sends the third file to the corresponding terminal.

[0013] A computing device of the present application includes: at least one processor and a memory storing program instructions; when the program instructions are read and executed by the processor, the computing device executes the above method.

[0014] The information interaction method, device, and computing device applicable to the terminal of the present application are applied in communication and collaboration applications. Users can use the terminal to take screenshots of the content presented in a meeting or classroom and perform personalized editing. The resulting file can be sent to other users, and other users can make personalized modifications to the file. The personalized modifications include modifications to text, pictures, and sounds, so that the communication between the two parties is more efficient, thereby providing users with a better experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] To achieve the above and related purposes, certain illustrative aspects are described herein in conjunction with the following description and accompanying drawings, which indicate various ways in which the principles disclosed herein can be practiced, and all aspects and their equivalents are intended to fall within the scope of the claimed subject matter. The above and other purposes, features and advantages of the present disclosure will become more apparent by reading the following detailed description in conjunction with the accompanying drawings. Throughout the present disclosure, the same reference numerals generally refer to the same parts or elements.

[0016] Figure 1 A schematic diagram showing the principle of an information interaction method according to an embodiment of the present application is shown;

[0017] Figure 2 A flow chart of an information interaction method according to an embodiment of the present application is shown;

[0018] Figure 3 A flowchart of another information interaction method according to an embodiment of the present application is shown;

[0019] Figure 4 A schematic diagram of the structure of an information interaction device according to an embodiment of the present application is shown;

[0020] Figure 5 A schematic diagram showing the structure of another information interaction device according to an embodiment of the present application is shown;

[0021] Figure 6 A schematic diagram of a computing device according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0022] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0023] In order to solve or alleviate the problem that existing communication and collaboration applications are inconvenient to operate during user communication, resulting in poor user experience, the present application proposes an information interaction method suitable for terminals, which allows users to edit and upload the content of the shared interface at any time, and allows other users to view and modify the uploaded content, thereby facilitating communication between users.

[0024] Figure 1 FIG. 1 is a schematic diagram showing the principle of the information interaction method according to an embodiment of the present application. Figure 1 As shown, in the embodiment of the present application, an interactive scene involves at least two terminals, wherein the terminal that displays or shares files to other terminals is called the first terminal 110, and the other terminals are called the second terminal 120. The first terminal 110 and the second terminal 120 need to communicate through the server, that is, the process of one terminal sending a file to another terminal is actually as follows: one terminal sends the file to the server, and then the server sends the storage address of the file on the server to another terminal, and the other terminal downloads the file from the address of the server. Any user can create an interactive scene (for example, create a classroom or a meeting) through the terminal, and the other users can join the interactive scene through their respective terminals. It should be noted that in the embodiment of the present application, for any interactive scene, each user can only log in to one terminal at any time, and a terminal only allows one user to log in, that is, the user corresponds to the terminal one by one.

[0025] It should be noted that the device with the first terminal 110 should be connected to a display device so that the first file can be displayed on the display device. Preferably, the device with the first terminal 110 should be connected to a display device with a large screen display function such as a projector or a television, so that the system 100 is suitable for scenes such as meetings and classrooms. The device with the second terminal 120 should also be connected to a display device so that the second file can be edited on the display device. For example, the device with the second terminal 120 can be a terminal device such as a computer, a tablet computer, a mobile phone, etc. with a display screen.

[0026] In the embodiment of the present invention, the first terminal 110 and the second terminal 120 are adapted to execute an information interaction method applicable to the terminal. The information interaction method applicable to the terminal of the present invention will be described in detail below.

[0027] In one embodiment, the terminal is arranged on a computing device, so that the information interaction method applicable to the terminal of the present invention can be executed in the computing device.

[0028] The principle of the information interaction method applicable to the terminal of the present invention is as follows Figure 1In an interactive scenario, a first terminal 110 (corresponding to a first user) and a plurality of second terminals 120 (corresponding to second users) are included. First, the first user displays a file through the first terminal 110. This file is called a first file. The first file can be in various forms such as a document, a picture, or a video.

[0029] In one implementation, the first file is shared with each second terminal 120 while being displayed. The second user can view the second file through a display device connected to the second terminal 120, or can view the first file through a display device connected to the first terminal. The second user can take a screenshot of the display interface of the second terminal 120, edit the image, send the image to a specific terminal, and perform other operations.

[0030] In another implementation, the first file is not shared with each second terminal 120, and the second user views the first file through a display device connected to the first terminal, but can take screenshots, edit images, and send images to specific terminals on the second terminal 120.

[0031] During the display of the first file, the second user can take a screenshot on the second terminal 120 at any time, and then edit the captured image, such as adding annotations, inserting other images, inserting sounds, or using a brush to doodle, etc. The image obtained after editing is called a second file. Next, the second user sends the second file to the first terminal 110.

[0032] After the first terminal 110 receives the second file, the first user can modify the second file, such as adding or deleting annotations, adding or deleting inserted images, adding or deleting inserted sounds, adding or deleting graffiti, etc. The file obtained after editing is called a third file. Next, the first user sends the third file back to the second terminal 120.

[0033] Based on the above principles, the embodiments of the present application provide two information interaction methods suitable for terminals.

[0034] Figure 2 FIG. 2 is a flow chart of an information interaction method 200 according to an embodiment of the present application. For an interaction scenario, the method 200 is applicable to the second terminal 120 and provides the user with an interaction function in the form of an application. Figure 2 As shown, the method 200 starts at step S210 .

[0035] In step S210, the image captured from the first file is displayed.

[0036] Next, in step S220, the editing of the image is accepted and the editing process of the image is saved to form a second file. The editing process is the original editing process, and the editing includes one or more operations of inserting text, inserting images, inserting sounds, and brush graffiti.

[0037] The second user edits the captured image (also called the original image), and the editing process is called the original editing process. The original editing process may include only one operation or multiple operations. The user can insert text, images, and sounds at any position of the original image, or select a suitable brush to doodle at any position. When inserting sound, the user selects the insertion position on the image, and then the application turns on the microphone of the device where the terminal is located, obtains audio data through the microphone, stores the audio data as an audio file, and forms an icon at the position where the audio is inserted on the image. When a touch screen operation occurs in the area covered by the icon, the application starts playing the audio file.

[0038] In one implementation, the editing process is decomposed into several stages in time sequence, each stage corresponds to one or more operations, and then the final image obtained in each stage is saved, and the final images obtained in each stage are merged into a second file. For example, each time the user completes an operation, the application saves the current image to form an independent image. After the original image is edited, a total of several images are formed. The application makes these several images into a file in the order of editing, that is, the second file. After the user opens the second file on the terminal, the application automatically displays all the images contained in the second file. The second file can be a video or a document. Since only the final image of each stage is saved, the second file occupies a small storage space, and the upload and download time is relatively short. During the editing process, if a deletion operation occurs, for example, the user draws a pattern with a brush and then deletes the pattern, the second terminal should prompt the user whether to save the deletion operation. Not saving the deletion operation is equivalent to the operation of drawing the image not occurring; saving the deletion operation is equivalent to the pattern appearing and then disappearing. Saving the deletion operation is suitable for describing the dynamic change process of things.

[0039] In another implementation, the complete editing process of the image is saved to form a second file, and the second file is preferably a file in video form. Generally speaking, saving the complete editing process can be achieved by screen recording. The editing process reflects the second user's thinking. Since the complete editing process is saved, the first user can clearly understand the second user's ideas when viewing the second file, thereby improving communication efficiency.

[0040] Next, in step S230, the second file, the image, and the position / time information of the image in the first file are sent to the server.

[0041] The image here refers to the original image. The second file is a file edited from the original image. After being uploaded to the server, the server classifies the second file according to the content of the original image, the location information of the original image in the first file, or the time information of the original image in the first file. During the process of the first user displaying the first file, there may be multiple second users taking screenshots, and accordingly, multiple second files will be uploaded to the server. The server classifies these second files and classifies the second files generated for the same part of the content into one category. If in a meeting or class, the first user can select a part of the second files for display according to the category to answer the second user's questions or communicate with the second user. For example, if the number of second files under a certain category is very large, then the first user will give priority to selecting several second files under this category for display, and complete the communication with the first user during the display process.

[0042] There are several ways to classify the second file: (1) Perform target recognition on the original image. If two original images have the same target and the number of the same targets reaches a preset threshold, the second files corresponding to the two original images are considered to belong to the same category. (2) When the first file is a document, the original image can be classified according to its position in the first file. For example, if the two original images both correspond to page 9 of the first file, the second files corresponding to the two original images are considered to belong to the same category. (3) When the first file is a video file, if the two original images both correspond to the same playback progress of the video file, the second files corresponding to the two original images are considered to belong to the same category. For example, the first user A takes a screenshot when the first file is played to 3 minutes and 13 seconds, and obtains the original image. The first user B takes a screenshot when the first file is played to 3 minutes and 14 seconds, and obtains another original image. The time difference between the two original images is 1 second, which is less than the preset threshold. It is considered that the playback progress of the first files corresponding to the two original images is the same, so the second files corresponding to the two original images belong to the same category.

[0043] In addition, when the server sends the second file to the first terminal 110, the original image corresponding to the second file, the position information of the original image in the first file, or the time information of the original image in the first file will be sent to the first terminal 110. When the user opens the second file on the first terminal 110, the first terminal 110 automatically opens the first file and automatically adjusts the display progress of the first file to the position of the original image according to the position information or time information of the original image in the first file, so as to facilitate the user to refer to the first file while viewing the second file.

[0044] The method 200 is suitable for editing the original image on the second terminal to form a second file. The second file is uploaded to the server, which sends it to the first terminal. The user can modify the second file on the first terminal.

[0045] Figure 3 FIG. 3 is a flow chart of another information interaction method 300 according to an embodiment of the present application. For any interaction scenario, the method 300 is applicable to the first terminal 110 and provides the user with an interaction function in the form of an application. Figure 3 As shown, the method 300 starts at step S310 .

[0046] In step S310, a second file from a server is received and opened.

[0047] Next, in step S320, the editing of the second file is accepted, and the editing process of the second file is saved to form a third file. The editing process is a modification process, and the modification process includes one or more operations of inserting text, inserting images, inserting sounds, brush graffiti, and modifying the original editing process.

[0048] The first user downloads and opens the second file on the first terminal 110, and can edit the second file or choose to edit on the original image, and obtain the third file after the editing is completed. Editing the second file can be inserting text, inserting images, inserting sounds, or brush graffiti. The specific method is referred to method 200. In addition, it can also be to modify the original editing process. If the user does not obtain the second file by screen recording, the second file retains the traces of the original editing. After the user opens the second file on the first terminal 110, he can choose to enter the editing state. In the editing state, all editing traces will be displayed. The editing traces can be in various forms, such as rectangular boxes. Specifically, the inserted image is located in a rectangular box, and the pattern formed by a graffiti is located in another rectangular box. The user selects the rectangular box corresponding to a certain operation, and the editing content in the rectangular box can be modified, such as modifying the text, deleting the inserted image, erasing a part of the graffiti pattern, etc. The sound inserted in the original editing process can also be modified, such as segmenting the rectangular box (modification trace) corresponding to the sound, deleting the entire rectangular box or the small rectangular box after segmentation, moving the entire rectangular box or the small rectangular box after segmentation, etc.

[0049] Next, in step S330, the third file is uploaded to the server, so that the server sends the third file to the corresponding terminal.

[0050] The corresponding terminal here refers to the terminal that uploaded the second file corresponding to the third file. For example, the second terminal A uploaded the second file A, the first terminal modified the second file A to obtain the third file A, and uploaded the third file A to the server, then the server sends the storage address of the third file A to the second terminal A, so that the second terminal A can download the third file A from the storage address of the third file A on the server.

[0051] For a certain first file, the server will classify all second files associated with the first file, classify second files with the same or similar content into one category, and send the classification to the first terminal. When the first user selects a second file A under a certain category and modifies the second file A to obtain a third file, and sends the third file to the user who uploaded the second file A, the server can also select other users who have second files in the same category as the second file A, and send the second file A to these users, so as to help these users understand the first file.

[0052] As a preferred embodiment of the present application, after step S310, method 300 further includes step S340 and step S350.

[0053] In step S340 , the first terminal 110 identifies the content of the second file.

[0054] The first terminal 110 can identify the content of the second file in the following manner: identify the text in the second file, extract keywords from the identified text, and perform semantic analysis on the keywords using a neural network. Specifically, a recurrent neural network (RNN) is used for semantic analysis. The recurrent neural network includes an input layer, a hidden layer, and an output layer, wherein the hidden layer uses ReLU as an activation function.

[0055] The input of the input layer is keywords.

[0056] The hidden layer ht can be described by the following formula:

[0057] ht=ReLU(W{hh}\cdot h{t-1}+W{ih}\cdot x_t+b_h)

[0058] The output layer yt can be described by the following formula:

[0059] yt=W{ho}\cdot h_t+b_o

[0060] In the above formula, h_t is the current hidden state, x_t is the current input, yt is the current output, W{hh}, W{ih}, and W{ho} are weights, and b_h and b_o are biases.

[0061] The output of the output layer is the result of semantic analysis of the keywords.

[0062] As a preferred embodiment of the present application, semantic analysis is performed on the content of the second file based on the editing traces retained in the second file and the content in the first file corresponding to the editing traces.

[0063] It should be noted that this step is not only to perform semantic analysis on the edited content, but also to perform semantic analysis on the content of the first file covered by the second file, and the analysis process is carried out crosswise.

[0064] For example, the second file contains n editing traces, namely traces B1 to Bn, and the contents in the first file corresponding to traces B1 to Bn are A1 to An, that is, trace B1 is for content A1, trace B2 is for content A2, ..., trace Bn is for content An, and contents A1 to An are arranged in sequence in the first file. When performing semantic analysis, the editing content contained in content A1 and trace B1 is first analyzed, and then the editing content contained in content A2 and trace B2 is analyzed, ..., and so on, and finally the editing content contained in content An and trace Bn is analyzed. The advantage of this method is that the analysis results can reflect the user's thinking process when editing the second file, and the analysis results given will be more logically coherent. Accordingly, in the subsequent steps, the related files found will also be more targeted.

[0065] Next, in step S350, the first terminal 110 obtains relevant files from the history database according to the recognition result (i.e., semantic analysis result) of the previous step, and sends the relevant files to the corresponding terminal. The relevant files refer to files containing content that is the same or similar in meaning to the semantic analysis result, and these files may be second files uploaded by other users, first files, or reference files related to the content of the first file, etc.

[0066] In one implementation, the history database is located at the server. The first terminal 110 sends the semantic analysis result to the server, which searches for relevant files and sends the found files to the first terminal 110, and then the first terminal 110 sends these files to the second terminal 120. Usually, the storage space of the terminal 110 is small, and the data processing capability of the terminal device is usually low. Therefore, searching for relevant files by the server can reduce the data processing tasks of the first terminal 110, so that the first terminal 100 can allocate computing resources to the editing task of the second file.

[0067] In another implementation, the history database is located in the first terminal 110. The first terminal 110 searches for relevant files from the history database based on the semantic analysis result, and sends the found files to the second terminal 120. For teaching scenarios, the users of the first terminal 110 are usually teachers, and the lectures of each teacher are different. For any teacher, the files of other teachers (including the first file, the related second file, the third file, and other reference files, etc.) have almost no reference value. Therefore, there is no need to upload these files to the server, and the speed of searching for relevant files locally in the first terminal 110 will be faster.

[0068] As a preferred embodiment of the present application, if there is an inserted sound in the second file, the sound needs to be converted into text and then semantic recognition is performed according to the method of step S340.

[0069] As a preferred embodiment of the present application, if the second file is a file obtained by editing a picture, it is necessary to identify the text in the picture and divide the text into several paragraphs according to the text layout. If the editing trace fails to indicate the content in the corresponding picture, it is necessary to first filter out several keywords from the editing content corresponding to the editing trace, and then search for these keywords from the text in the identified picture, and use the paragraph of text (or sentence) with the largest number of these keywords as the content of the first file corresponding to the editing trace. For example, four keywords W1, W2, W3, and W4 are filtered out from the editing content corresponding to the editing trace. There are three paragraphs of text in the picture, among which the keyword W1 appears in the first paragraph of text, the keywords W1, W2, and W3 appear in the second paragraph of text, and the keywords W and W3 appear in the third paragraph of text, then the second paragraph of text is used as the content of the first file corresponding to the editing trace. This embodiment can more accurately determine the content corresponding to the editing trace, so that the structure of subsequent semantic analysis is more reasonable.

[0070] The present application embodiment also provides an information interaction device applicable to a terminal, which can implement the processing of each step of method 200. Figure 4 As shown, the device 400 includes a first display unit 410 , an original editing unit 420 , and a second file uploading unit 430 .

[0071] The first display unit 410 is adapted to display the image captured from the first file.

[0072] The original editing unit 420 is suitable for accepting the editing of the image and saving the editing process of the image to form a second file. The editing process is the original editing process, and the editing includes one or more operations of inserting text, inserting image, inserting sound, and brush graffiti.

[0073] The second file uploading unit 430 is adapted to send the second file, the image and the position / time information of the image in the first file to the server.

[0074] As a preferred embodiment of the present application, the original editing unit 420 implements the process of saving the editing of the image through the following steps:

[0075] Decomposing the editing process into several stages in chronological order;

[0076] Save the resulting images after each stage of editing; and

[0077] The image obtained after the editing in several stages is formed into a second file.

[0078] As a preferred embodiment of the present application, the original editing unit 420 implements the process of saving the editing of the image through the following steps:

[0079] The complete editing process of the image is saved.

[0080] As a preferred embodiment of the present application, the device 400 further includes:

[0081] The deleting unit is adapted to save / not save the deleting process according to a selected method when a deleting operation occurs.

[0082] As a preferred embodiment of the present application, the second file is a video file.

[0083] The device 400 has the same principles and technical effects as the method 200, and will not be described in detail here.

[0084] The present application embodiment also provides another information interaction device applicable to a terminal, which can implement the processing of each step of method 300. Figure 5 As shown, the device 500 includes a second display unit 510 , a modification unit 520 , and a third file upload unit 530 .

[0085] The second display unit 510 receives and opens the second file from the server.

[0086] The modification unit 520 is suitable for accepting the editing of the second file and saving the editing process of the second file to form a third file. The editing process is a modification process, and the modification process includes one or more operations of inserting text, inserting images, inserting sounds, brush graffiti, and modifying the original editing process.

[0087] The third file uploading unit 530 is adapted to upload the third file to the server, so that the server sends the third file to a corresponding terminal.

[0088] As a preferred embodiment of the present application, the modification unit 520 implements the modification of the original editing process in the following manner:

[0089] The operations of the original editing process are copied, moved, and / or deleted.

[0090] As a preferred embodiment of the present application, the device 500 further includes an identification unit 540 and a related file search unit 550 .

[0091] The identification unit 540 is adapted to identify the content of the second file.

[0092] The related file search unit 550 is adapted to obtain the related files from the history database according to the recognition result (ie, the semantic analysis result), and send the related files to the corresponding terminal.

[0093] The device 500 has the same principle and technical effect as the method 300, and will not be described in detail here.

[0094] Figure 6 FIG. 6 is a schematic diagram showing the structure of a computing device 600 according to an embodiment of the present invention. Figure 6 As shown, the computing device 600 typically includes a memory 610, one or more processors 620, and a communication module 630. The memory 610 stores a plurality of program instructions for executing an information interaction method applicable to a terminal, and these program instructions can instruct the processor 620 to execute the information interaction method of the present invention, and the communication module 630 enables the terminal arranged on the computing device 600 to communicate with the server.

[0095] The various techniques described herein may be implemented in combination with hardware or software, or a combination thereof. Thus, the method and apparatus of the present invention, or some aspects or parts of the method and apparatus of the present invention may be in the form of program codes (i.e., instructions) embedded in a tangible medium, such as a removable hard disk, a USB flash drive, a floppy disk, a CD-ROM, or any other machine-readable storage medium, wherein when the program is loaded into a machine such as a computer and executed by the machine, the machine becomes a device for practicing the present invention.

[0096] In the case where the program code is executed on a programmable computer, the computing device generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device. The memory is configured to store the program code; the processor is configured to execute the information interaction method applicable to the terminal of the present invention according to the instructions in the program code stored in the memory.

[0097] By way of example and not limitation, readable media include readable storage media and communication media. Readable storage media stores information such as computer readable instructions, data structures, program modules or other data. Communication media generally embody computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and include any information transfer medium. Any combination of the above is also included within the scope of readable media.

[0098] In the description provided herein, algorithms and displays are not inherently related to any particular computer, virtual system or other device. Various general purpose systems can also be used together with examples of the present invention. According to the above description, it is obvious that the structure required for constructing such systems. In addition, the present invention is not directed to any specific programming language either. It should be understood that various programming languages ​​can be utilized to implement the content of the present invention described herein, and the above description of specific languages ​​is for disclosing preferred embodiments of the present invention.

[0099] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0100] Similarly, it should be understood that in order to streamline the present disclosure and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, this disclosed method should not be interpreted as reflecting the following intention: that the claimed invention requires more features than the features explicitly recited in each claim. More specifically, as reflected in the claims below, inventive aspects lie in less than all the features of the individual embodiments disclosed above. Therefore, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, with each claim itself serving as a separate embodiment of the present invention.

[0101] Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in the devices described in the embodiment, or alternatively may be located in one or more devices different from the devices in the examples. The modules in the foregoing examples may be combined into one module or may be divided into multiple submodules.

[0102] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and in addition they may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive, all features disclosed in this specification (including the accompanying claims, abstracts and drawings) and all processes or units of any method or device disclosed in this manner may be combined in any combination. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstracts and drawings) may be replaced by an alternative feature providing the same, equivalent or similar purpose.

[0103] In addition, those skilled in the art will appreciate that, although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features of different embodiments is meant to be within the scope of the present invention and form different embodiments. For example, in the claims below, any one of the claimed embodiments may be used in any combination.

[0104] In addition, some of the embodiments are described herein as methods or combinations of method elements that can be implemented by a processor of a computer system or by other devices that perform the functions. Therefore, a processor with necessary instructions for implementing the method or method elements forms a device for implementing the method or method elements. In addition, the elements described herein of the device embodiments are examples of devices for implementing the functions performed by the elements for the purpose of implementing the invention.

[0105] As used herein, unless otherwise specified, the use of ordinal numbers "first," "second," "third," etc. to describe common objects merely indicates that different instances of similar objects are involved, and is not intended to imply that the objects so described must have a given order in time, space, order, or in any other manner.

[0106] Although the present invention has been described according to a limited number of embodiments, it will be apparent to those skilled in the art, with the benefit of the above description, that other embodiments may be envisioned within the scope of the invention thus described. In addition, it should be noted that the language used in this specification is selected primarily for readability and teaching purposes, rather than for explaining or defining the subject matter of the present invention. Therefore, many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the appended claims. The disclosure of the present invention is illustrative and not restrictive with respect to the scope of the present invention, and the scope of the present invention is defined by the appended claims.

Claims

1. An information interaction method applicable to a terminal, characterized in that: include: Displaying the image captured from the first file; Accepting the editing of the image, and saving the editing process of the image to form a second file, wherein the editing process is an original editing process, and the editing includes one or more operations of inserting text, inserting images, inserting sounds, and brush graffiti; as well as The second file, the image, and the position / time information of the image in the first file are sent to the server.

2. The method according to claim 1, characterized in that The process of saving the edited image comprises: Decomposing the editing process into several stages in chronological order; Save the resulting images after each stage of editing; and The image obtained after the editing in several stages is formed into a second file.

3. The method according to claim 1, characterized in that The process of saving the edited image comprises: The complete editing process of the image is saved.

4. The method according to claim 2, characterized in that: Also includes: When a deletion operation occurs, the deletion process is saved / not saved according to the selected method.

5. The method according to any one of claims 1 to 4, characterized in that The second file is a video file.

6. An information interaction method applicable to a terminal, characterized in that: include: Receive and open the second file from the server; Accepting the editing of the second file, and saving the editing process of the second file to form a third file, wherein the editing process is a modification process, and the modification process includes one or more operations of inserting text, inserting images, inserting sounds, drawing with a brush, and modifying the original editing process; as well as The third file is uploaded to the server, so that the server sends the third file to the corresponding terminal.

7. The method according to claim 6, characterized in that The modifying of the original editing process includes: copying, moving, and / or deleting the operations of the original editing process.

8. An information interaction device suitable for a terminal, characterized in that: include: A first display unit, adapted to display the image captured from the first file; An original editing unit, adapted to accept editing of the image and save the editing process of the image to form a second file, wherein the editing process is an original editing process, and the editing includes one or more operations of inserting text, inserting image, inserting sound, and brush graffiti; as well as The second file uploading unit is adapted to send the second file, the image and the position / time information of the image in the first file to the server.

9. An information interaction device suitable for a terminal, characterized in that: include: The second display unit receives and opens the second file from the server; a modification unit, adapted to accept the editing of the second file, and save the editing process of the second file to form a third file, wherein the editing process is a modification process, and the modification process includes one or more operations of inserting text, inserting images, inserting sounds, drawing with a brush, and modifying the original editing process; as well as The third file uploading unit is adapted to upload the third file to the server, so that the server sends the third file to the corresponding terminal.

10. A computing device comprising: at least one processor and a memory storing program instructions; When the program instructions are read and executed by the processor, the computing device is caused to perform the method according to any one of claims 1 to 5 or the method according to any one of claims 6 to 7.

Images