Manage messages between users to collaboratively edit electronic documents
By storing and synchronizing user message data in active data streams, the problem of user message management complexity in collaborative editing is solved, and the system's collaborative editing efficiency and user experience are improved.
Patent Information
- Application Number
- CN202210328891.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2016-03-04
- Filing Date
- 2017-02-27
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2037-02-27
AI Technical Summary
In collaborative editing of electronic documents, the complexity of managing messages and comments between users increases the difficulty of the system, especially in terms of data synchronization and access control between different end-user applications and communication applications, resulting in a lack of user experience good.
By storing message data between users in the active data stream, including document identifiers, user identifiers of senders and receivers, and message content, and synchronizing and accessing data between communication applications and end user applications, ensuring that Relevance and access control of messages to electronic documents.
Simplifies users' switching between different applications, improves the efficiency and consistency of collaborative editing, reduces user memory burden, and ensures the accuracy and security of messages and comments.
Smart Images

Figure CN114706519B_ABST
Abstract
Description
[0001] This application is a divisional application of a Chinese patent application with an application date of February 27, 2017, application number 201780004621.9, and invention name “Managing messages between users to collaboratively edit electronic documents”. Background Art
[0002] The availability of shared storage systems for electronic documents has increased the ability of computer end users to share and collaborate in creating various electronic documents. End users can cause electronic documents to be stored in shared storage systems on a computer network such as the Internet. End users can instruct such shared storage systems to allow sharing of electronic documents with other end users of the shared storage system. Generally speaking, a shared storage system has an access control component in the file system that tracks, for each electronic document, the access rights that different users have to the electronic document.
[0003] After an electronic document has been shared between two or more end users, a shared storage system manages access to the shared electronic document to ensure consistency of the electronic document, especially in the case of collaborative editing, i.e., collaborative modification of the electronic document. The collaborative system manages collaborative modification by tracking which end users are currently accessing the same electronic document using end-user applications on client computers. Typically, the collaborative system is implemented as one or more computer programs that execute on a server computer, and in some implementations, may have components that execute on a client computer.
[0004] In some cases, electronic documents are shared via email or other communication channels rather than via shared storage. In such an environment, generally speaking, the end user is responsible for tracking the versions of the electronic document and maintaining the consistency of the electronic document.
[0005] Generally speaking, end-user applications allow users to modify electronic documents. For collaborative editing, a typical feature in end-user applications is the ability for users to attach comments to electronic documents. Generally speaking, the comment is associated with a specific location in the document or in the general comment section of the electronic document.
[0006] Generally speaking, users also communicate about their work through communication channels outside the context of electronic documents edited in end-user applications. For example, users can send messages about electronic documents to each other through communication applications, such as chat messages, instant messages, text messages, electronic messages, etc.
[0007] Distributing comments and messages about electronic documents in electronic documents and in several communication channels using different end-user applications and communication applications increases the complexity of managing the collaborative efforts of these users. In addition, it is not beneficial for users to switch from an end-user application to a communication application because it involves stopping the task of one application and changing the context to work with another application, which may disrupt the user's chain of thought. In addition, with some devices, only one application can be seen at a time, which may make it difficult for users to remember what the message was about after switching from an end-user application to an electronic document to a communication application. Summary of the invention
[0008] This Summary is provided to introduce a selected group of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key or essential features, nor is it intended to limit the scope of the claimed subject matter.
[0009] In order to manage the complexity related to messages and comments about collaborative editing of electronic documents, electronic documents have associated activity data and comment data, wherein one type of activity data includes messages between users. Message data is stored in an activity data stream in a format that is available to both communication applications outside the electronic document and terminal user applications for editing electronic documents. Message data may include a document identifier, a user identifier for the sender and / or the receiver, and the content of the message. Given a user identifier, a communication application may access document messages for the user from a single electronic document or on multiple electronic documents. In addition, when a new document message associated with a user identifier is added to one or more electronic documents, the communication application may be notified. In addition, given a document identifier, a terminal user application may access document messages associated with the document identifier to be included in the activity data for the document.
[0010] In the following description, reference is made to the accompanying drawings which form a part hereof, and in which are shown by way of illustration specific examples of implementations. Other implementations may be made without departing from the scope of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Figure 1 A block diagram of an exemplary computing system configured to support collaborative editing of electronic documents by end-user applications on multiple client computers.
[0012] Figure 2 The diagram illustrates a data structure for storing comment data and activity data for an electronic document.
[0013] Figure 3An illustration of an exemplary graphical user interface for displaying review data and activity data in an end-user application is provided.
[0014] Figure 4 A data flow diagram of an exemplary client computer configured to edit a document using document messages.
[0015] Figure 5 A flow chart describing an exemplary implementation of the operation of a service for accessing document messages.
[0016] Figure 6 A flow chart describing an exemplary implementation of operations for generating and displaying an active pane using a document message.
[0017] Figure 7 is a block diagram of an exemplary computer. DETAILED DESCRIPTION
[0018] Figure 1 A block diagram of an exemplary computer system configured to support collaborative editing of an electronic document by multiple end users through end-user applications on multiple client computers.
[0019] A computing system configured to support sharing and collaborative modification of electronic documents by multiple end-user applications may include a shared storage system 100. In general, the shared storage system 100 includes a storage device 102 in which data is stored in data files accessible through a file system 104 as part of the shared storage system. The file system configures a server computer 108 to maintain information about each file stored in the storage device 102. The shared storage system 100 may be implemented using one or more general-purpose computers, such as in conjunction with a server computer 108. Figure 7 The shared storage system 100 responds to requests over the computer network 112 for access to files on the storage device 102 through the file system 104 .
[0020] A plurality of end-user computers 110-1 to 110-N, also referred to herein as client computers, are connected to the shared storage system to communicate over one or more computer networks 112, such as the Internet or a dedicated computer network. The end-user computers 110 may be, for example, a computer system that is coupled to a server. Figure 7 The computer described herein is configured to be a client computer that runs one or more applications 120. Examples of such computers include, but are not limited to, tablet computers, slate computers, notebook computers, desktop computers, virtual desktop computers hosted on server computers, handheld computers, and mobile phones that include computers and applications.
[0021] Computer network 112 can be any computer network that supports interaction between end-user computers and shared storage systems, such as a local area network or a wide area network, private and / or publicly accessible, and can include wired and / or wireless connections. The computer network can be implemented using any of a number of available network communication protocols, including but not limited to Ethernet and TCP / IP.
[0022] The end-user computer 110 may include one or more end-user applications 120. In this context, an end-user application is a computer program executed on an end-user computer that configures the computer to respond to user input 154 to allow the end-user to interactively modify an electronic document 124. An electronic document may include any type of data, such as text, static images, video, or audio, and combinations of these, and generally, data having a structure defining the electronic document and data defining the content of the electronic document in the defined structure. The end-user application processes the electronic document in response to user input received from an input device. For example, the application combines the data to create the structure and content of the electronic document. The application also displays or otherwise presents display data 156 to the end-user through an output device (not shown), such as a graphical user interface including content according to the structure of the electronic document. The application also stores the electronic document in a memory and / or in a local storage device of the end-user computer and / or in a data file in a shared memory.
[0023] A variety of end-user applications may be used on the end-user computer. Examples of end-user applications include, but are not limited to, word processing applications, slide presentation applications, note-taking applications, text editing applications, drawing applications, image editing applications, spreadsheet applications, desktop publishing applications, painting applications, video editing applications, and audio editing applications. The end-user application may allow a variety of operations on the electronic document, such as, but not limited to, viewing and commenting without content editing, viewing and content editing, or just viewing.
[0024] The end-user application generates an electronic document that is stored in a data file. Such a data file may be stored in the local storage device 122 and / or the shared storage system 100. The electronic document, while being modified by the end-user on the end-user computer, is also temporarily stored in memory on the end-user computer. The end-user application may also temporarily store the electronic document in a cache on the local memory before committing modifications to the electronic document to the data file.
[0025] The end-user computer 110 may also include one or more communication applications 150. A communication application is a computer program executed on an end-user computer that configures the computer to respond to user input to allow the end-user to interactively receive and read, or compose and send electronic messages; display data, such as a graphical user interface including electronic messages, may be presented to the end-user via an output device (not shown). An electronic message may include any type of data, such as text, still images, video, or audio, and combinations of these, and generally includes an identifier for a sender of the electronic message and one or more recipients.
[0026] A variety of communication applications can be used on the end-user computer. Examples of communication applications include, but are not limited to, email applications, instant messaging applications, chat applications, real-time voice and / or video communication applications, and notification applications.
[0027] The communication application 152 can access a corresponding service 150 on the server computer 108 of the shared storage system 100 to access document messages associated with an electronic document stored on the shared storage system 100. Given a user identifier of a user, the service 150 can identify an electronic document that allows the user to access the document message through the file system 104. Given the document identifier, the service 150 can access the document message corresponding to the electronic document from the storage device 102. The service 150 can be any type of communication service, such as an email server, a notification service, a chat service, a real-time voice and / or video communication service, an instant messaging service, or other communication service.
[0028] In an exemplary configuration, the service is a notification service and the communication application is an application on a mobile phone that handles notifications. The user can configure the notification service through the application to notify the user if any new document messages are added to a document shared with the user.
[0029] For electronic documents stored in data files in the shared storage system 100, the file system 104 of the shared storage system may include information indicating the sharing status of the electronic document. Such information may be in the form of access controls indicating which end users are authorized to access the email and its associated data. The file system may also be configured to respond to queries to provide this information to another application, such as the end-user application 120 or the communication application 152 on the end-user computer. The shared storage system may provide information about the sharing status of electronic files to applications on the end-user computer in a variety of ways, and allow modification of the sharing status.
[0030] In some implementations, electronic documents can be shared by users by distributing copies of the electronic document through various distribution channels between multiple users. Each user can modify the electronic document, possibly add comments or document messages to the electronic document, and then, can share the modified electronic document with other users.
[0031] In some implementations, an electronic document is stored in a data file in a shared storage system 100, and the data file is shared with at least one other end user with modification permissions. In such a case, two or more end-user applications on two or more client computers may access through the shared storage system 100 and may attempt to modify the electronic document. To handle such a case, the shared storage system may include a collaboration system 106. The collaboration system 106 is a computer program that configures a server computer to manage simultaneous access to a shared electronic file in the shared storage system 100. The collaboration system 106 is configured to store information about the end-user application currently accessing the electronic document, and the associated end user.
[0032] Using information about the terminal user application and the terminal user currently accessing the electronic document, the collaborative system can implement any one of a plurality of different technologies for coordinating access to the electronic document to ensure the consistency of the electronic document. For example, the collaborative system can avoid that when the data file is opened for writing by another terminal user application, a terminal user application causes the modification to be written to the data file for the electronic document. As another example, when such modifications are being collaboratively performed by multiple terminal applications, the collaborative system can interactively merge the changes into the electronic document. In such a case, as an example, the collaborative system can merge the changes received from the terminal user computer into the local memory of the collaborative system, and then, each terminal user computer with the application currently accessing the document can be sent a modified version of the electronic document. Such modifications can include modifications to the structure and / or content of the electronic document, changes to the comment data associated with the electronic document, and / or updates to the activity data associated with the electronic document.
[0033] Data representing an electronic document may be stored in a computer storage device in a variety of different formats. In one aspect, there may be a file format for one or more data files used to store data for an electronic document in a persistent storage device. In another aspect, there may be one or more data structures stored in a memory for providing access to the data for an electronic document by an end-user application during editing or viewing of the electronic document. The file format may or typically will be different from the data structure stored in the memory, although both store essentially the same data.
[0034] Reference now Figure 2In general, and whether a data file in a persistent storage device or a data structure in memory, data 200 for an electronic document includes data 202 representing the structure and content of the document, and comment data 204 representing the structure and content of a comment. To assist in managing the complexity of multiple comments and document messages from multiple users, the data for an electronic document also includes data defining activity data 208 associated with the electronic document. The activity data may include, among other things, one or more document messages.
[0035] With respect to the exemplary document format, in one implementation, the structure and content data 202 and the comment data 204 for a document may be stored in one data file, and the activity data 208 may be stored in a separate second data file or database. For example, actions such as document messages may be stored as records in a database and may be accessed by a document identifier. In another implementation, the structure and content data 202, the comment data 204, and the activity data 208 for a document may all be stored in a single data file. In another implementation, the structure and content data 202, the comment data 204, and the activity data 208 for an electronic document may each be stored in a separate data file or in other data stores such as a database. When such data is read by an end-user application, or a communication application accessing a document message, the end-user application may generate a corresponding data structure in a memory, which is then processed and stored in a data file at periodic intervals and / or in response to instructions received from an end-user.
[0036] In general, data 202 for an electronic document includes a document identifier 216, data 210 defining the structure of the electronic document, and data 212 defining the content in the structure of the electronic document. There are various formats for electronic documents, including various markup languages, such as Hypertext Markup Language (HTML), Standard Generalized Markup Language (SGML), Extensible Markup Language (XML), and proprietary document formats. The present invention is not limited to any specific format for the structure and content of an electronic document. Data for an electronic document may include references 214 to other data related to the electronic document, such as files storing comment data, activity data, style sheets, templates, macros, etc. for formatting electronic documents. Data for an electronic document may also include various metadata 218 about the electronic document.
[0037] The comment data 204 defining a series of comments may include a document identifier 206 indicating the electronic document to which the series of comments is associated. For each comment, the comment data may include a reference 220 to a location in the electronic document, a user identifier 222 of the end user who added the comment, and the content 224 of the comment, which is typically text but not limited to text. The reference 220 to the location in the document may be, for example, an offset in the electronic document, such as an offset in the content associated with a structural element of the electronic document. The user identifier may be any indication of the user, such as an email, a user name, etc., such as a user name for the user to access a shared system storing electronic documents. Status information 226 may also be associated with the comment, such as data indicating whether the comment has been resolved. The comment may also have an associated date and time stamp 228 indicating when the comment was added to the electronic document. The comment may also have a comment identifier 230 that distinguishes the comment from other comments associated with the electronic document.
[0038] Comments can be threaded so that a comment refers to another comment, most likely in the form of a reply. There are various ways to implement comment threading, such as using a reference 220 of a first comment to mention a comment identifier 230 of another comment, or using a linked list to represent a comment and any answer comments associated with it.
[0039] In one implementation, the data defining the review can be stored in the electronic document data file, for example as a data stream in the data file. In this implementation, the data defining the structure and content of the data file can be stored as a separate stream in the data file.
[0040] Activity data 208 defining a series of actions associated with an electronic document may include a document identifier 209 indicating the electronic document to which the series of actions are associated. The activity data may include, for an action 240, action identifier 241 data indicating an action type 242, a user identifier 244 of an end user associated with the action, and a date and time stamp 246 indicating when the action occurred. As in comment data, the user identifier may be any indication of a user, such as an email address, a user name, etc., such as a user name for a user to access a shared storage system storing electronic documents. The action type 242 may indicate whether the action is a document message, or an action type regarding an electronic document, or an action type regarding a comment. Other data 248, such as text or other information, may be stored as part of the data describing the action 240.
[0041] Activity data may represent various different types of actions performed by a user and associated with an electronic document. Such actions may include actions on electronic documents, such as opening, saving, or closing an electronic document, or sharing an electronic document, etc. Actions may also be actions on comments, such as adding, editing, or deleting a comment, replying to a comment, or marking a comment as resolved or unresolved.
[0042] In addition, actions can also include document messages. A document message is a message between or among users associated with an electronic document. In terms of content, a document message can be similar to a comment, because in general, comments and document messages can include any type of content. In addition, document messages can be threaded, similar to comments. However, the structure of a document message is such that the data for the document message is stored in the active data as an action, and the data can be read and processed by the communication application as a traditional message. A document message has a sender (the user who creates the document message) and one or more recipients (e.g., all users authorized to access the electronic document or a subset of selected recipients).
[0043] Unlike comments in documents, document messages are not associated with any specific location in an electronic document and are only displayed to users through end-user applications when presenting active data. In addition, unlike comments, document messages are also access-controlled, so that only users with access rights who have shared the electronic document in a shared storage system can access document messages. Specifically, document messages are stored separately from electronic documents in a shared storage system. For example, document messages (and data for other action types) can be stored in a database, such as in JSON format.
[0044] exist Figure 3 , an exemplary graphical user interface for an end-user application is shown. In the exemplary graphical user interface, a document pane 300 is a primary display area in which an electronic document is presented on a display. The end-user computer receives user input through one or more input devices, and such input may be associated with operations on the electronic document in the document pane 300, or with operations on other graphical elements in the graphical user interface. The end-user computer processes some user input to implement modifications to the structure and / or content of the electronic document currently being accessed in the document pane 300.
[0045] The graphical user interface for the end-user application may include an activity pane 302 in which the end-user application displays one or more actions associated with the electronic document. In response to user input, various settings for controlling the display of activity data may be provided. For example, the activity pane may include one or more selection elements 304. In response to user input about the selection element, the end-user application may display actions from the activity data for the electronic document currently presented in the document pane 300. For example, the selection element 304 may provide a mechanism by which the end-user application receives input specifying how to search, filter, sort, and / or view any displayed actions in the activity pane 302. In response to selecting the control, one or more user interface elements may be used to provide user input for various settings. For example, a user may select to view all actions for a document message. As another example, a selection element may allow an end-user to create a new document message. In response to user input about such a selection element, the end-user application may display a new action in the activity pane 302 and allow the user to complete information for the document message.
[0046] In the activity pane, the action is displayed by generating a graphical representation 306 of the action. The graphical representation may include an indication 308 of the user performing the action, which may include a name, username, and / or a photo of the user, and a body 310 of the action, which is typically text. The graphical representation of the action may include other data describing the action and having visual appearance parameters associated with the action. The graphical representation 306 of the action may be generated using various data accessible through the data for the action. For example, a user identifier may be used to access profile information of a user from a shared storage system.
[0047] Given one or more displayed actions in an active pane, the end-user application is configured to respond to user input associated with the active pane to select one or more actions, and to respond to user input regarding the selected one or more actions. For example, the system may respond to user input associated with a document message in the active pane to generate a reply to the document message. As another example, the system may respond to user input associated with an action selected in the active pane to generate a document message to a user associated with the selected action.
[0048] For example, a graphical element in the graphical representation of an action may include one or more controls 312, such as buttons, that allow an end user to provide input regarding the displayed action. For example, for an action that is a document message, a button may be provided to allow the user to reply to the message, thereby creating another document message in the thread of the document message. In response to the user manipulating the control, an interface may be presented to the user to enter the body of the document message, and after the data entry is completed by the user, the application may add the corresponding document message as an action to the active data. As another example, for any action displayed to the user, a button may be created around a user identifier or image to allow the user to generate a document message to the user. In response to the user manipulating the button, an interface may be presented to the user to enter the body of the document message, and after the data entry is completed by the user, the application may add the corresponding document message as an action to the active data.
[0049] The activity pane can be programmed to support a variety of operations on the activity data. For example, the actions can be screened and / or classified based on the user, action type, keyword and / or date or other data, and then displayed in the activity pane. The user of the application can specify how to screen and / or classify the actions displayed in the activity pane. In response to such a specification, the application generates a corresponding display of the action. A scroll bar (not shown) can be provided in the activity pane to allow scrolling of the displayed action. When the activity pane is displayed, the activity pane can also include a closing element (not shown). The manipulation of the closing element in response to user input causes the end user application to close the activity pane.
[0050] Regarding document messages, each document message is an action for which data is stored in the activity data as an action of the user and is associated with the electronic document. Thus, using various filtering and sorting operations, for example, the user can locate all document messages of a document, all document messages added by a selected individual or multiple individuals, all document messages including specific keywords, etc.
[0051] exist Figure 3In the example shown in , the graphical user interface for the terminal for the application may also include a comment pane 320, in which the terminal user application displays one or more comments associated with the electronic document. It should be understood that various techniques can be used to display and input comments, and the present invention is not limited thereto. In response to user input, various settings for controlling the display of comment data can be provided. For example, the comment pane may include a selection element 322. In response to user input about the selection element, the terminal user application displays comments for the electronic document currently displayed in the document pane 300. For example, the selection element 322 may provide a mechanism by which the terminal user application receives input specifying how to view comments in the comment pane 320. For example, the terminal user application may have a setting for indicating whether to show all comments or only open comments, and whether to show all comments in a thread or only the first comment, or other display settings related to the possible status of each comment.
[0052] In general, the data displayed in the comment pane is a representation of a series of comments, typically starting with a first comment associated with the portion of the document currently displayed. The display can be interactively updated based on the current cursor position in the document or the portion of the document currently displayed. The comment view can also have a scroll bar. In response to manipulating the scroll bar, different portions of the comment list can be viewed. The present invention is not limited to any particular type of display of comment data. The display of comment data can also be integrated with the display of the structure and content of the electronic document in the document pane.
[0053] exist Figure 3 In the comment pane of the application, the comment is displayed by generating a graphical representation 324 of the comment including an indication 326 of the user who created the comment, which may include a name, a user name and / or a photo of the user, and a body 328 of the comment, which is typically text but may include other data and other visual appearance parameters related to the comment. This graphical representation 324 of the comment can be generated using various data accessible through the data for the comment. For example, the user identifier can be used to access the profile information of the user from the shared storage system. Given one or more displayed comments, the end-user application is configured to respond to user input associated with the comment to select one or more comments, and to respond to user input for the selected one or more comments. For example, other graphical elements in the graphical representation of the comment may include one or more controls 330 that allow the end user to provide input for the displayed comment, such as buttons, such as input for adding, editing or deleting comments, replying to comments, marking comments when resolved, showing or hiding threads related to comments, etc. In response to manipulating such controls, corresponding actions can be performed.
[0054] exist Figure 3In the example shown in FIG. 1 , the end-user application displays the active pane and the comment pane in the context of the currently accessed electronic document. Specifically, in this example, the document pane 300, the active pane 302, and the comment pane 320 are displayed simultaneously in the graphical user interface. Figure 3 In this example, the interface is shown as a pane of a graphical user interface that does not overlap with other panes of the interface and is non-modal. Other graphical user interface technologies can also be used to implement the active pane and the comment pane. Modal dialog boxes, call-out interfaces, or small pop-up windows are also examples of a type of interface that can be shown in the context of the currently accessed electronic document.
[0055] Figure 4 is a data flow diagram of an exemplary implementation of an end-user application 400 running on a client computer, including, for example, Figure 3 The end-user application 400 has an input for receiving one or more files 402 and / or other data defining an electronic document. The end-user application generates a representation of a series of actions 404 and a series of comments 406 in a memory based on the received one or more files.
[0056] File 402 may be stored in local storage device 460 and / or from a shared storage system (e.g., Figure 1 100) received. In many shared storage systems, files in local storage device 460 are synchronized with copies of files on server computers in the shared storage system. For example, an end-user computer may include a client application 470 for shared storage that periodically sends updated files 472 of electronic documents from local storage device 460 to the server computer. The server computer then sends a backup of the electronic document received from one client computer to other client computers that are using the electronic document. The client application 470 for shared storage receives updated files 476 of the electronic document from the server computer and then updates the copy in the local storage device 460.
[0057] The end-user application also processes the structure and content of the electronic document into memory to generate a representation of the electronic document 408, which is edited by an editing component 410. The editing component has outputs for receiving user and system inputs 412 involved in editing and storing the electronic document, and for providing display data 420 representing the electronic document being edited, and for providing the modified electronic document back to a storage device after saving as file 402. The end-user application displays the display data 420 via a graphical user interface, which may include one or more displays and / or other output devices.
[0058] The comment component 440 manages interaction with the series of comments 406. For example, the comment component generates display data 442 for a comment pane to be displayed in the graphical user interface 416 using the series of comments 406. In addition, the comment component can respond to user actions 444, such as adding a comment, deleting a comment, editing a comment, replying to a comment, and resolving a comment, to update the data in the series of comments 406. The comment component can also interactively update the display of the comments in response to updates to the data in the series of comments.
[0059] The activity component 450 manages the interaction with the series of actions 404. For example, the activity component uses the series of actions 404 to generate display data 452 for the activity pane to be displayed in the graphical user interface, as described below in conjunction with Figure 5 In addition, the activity component responds to user actions 454 on the electronic document, such as opening, saving or closing the electronic document, and other actions related to comments, and other actions related to document messages, such as creating or replying to document messages, to update data for the actions in the activity data.
[0060] Now turn to Figure 5 , describing a service application (e.g., Figure 1 A flowchart of an exemplary implementation of the operation of 150) in FIG.
[0061] The service application receives 500 an identifier of a user from a communication application. The service application queries 502 a document database maintained by a file system of a shared storage system for documents for which the user can access document messages, and prepares 504 a set of document identifiers. The service application accesses 506 a storage device to retrieve, for each document identifier, a set of document messages stored in association with an electronic document corresponding to the document identifier. For example, if the document messages are stored in a database in JSON format, the database may be accessed to retrieve the document messages. The service application then sends 508 the document messages to the communication application.
[0062] Figure 6 The present invention is a flow chart describing an exemplary implementation of operations for generating and displaying an active pane for an end-user application. Figure 3 The operation is described in the context of a series of actions displayed in an activity pane such as . This implementation is merely an example; there are other ways in which a series of actions can be displayed in association with an electronic document.
[0063] The end-user application receives 600 an instruction to display actions from the active data in the active pane. The end-user application queries 602 display settings for the active pane. Such display settings may include any of a variety of settings, such as which actions to display, how to categorize the selected actions for display, and format information to display the actions, such as font type and size, color, background, etc. As shown in Figure 6 As shown in , the end-user application can select, for example, to view the action as a document message.
[0064] If the action to be displayed is a document message, as determined at 604, a displayed representation of the document message is generated 606, which may include one or more controls, such as a control for replying to the document message. Otherwise, a graphical representation of the action is generated 608, depending on the type of action being displayed. If more actions remain from the selected group, as determined at 610, the processing of steps 604-608 is repeated. Otherwise, then, the generated representation of the selected action is displayed 612. The actions to be displayed may be displayed in any selected order, such as chronologically, or in order with respect to any associated locations in the document, or in order with respect to the terminal users who performed the actions, etc. For document messages, exemplary orders are chronologically and / or by thread.
[0065] By allowing users to create document messages that are stored in a manner associated with an electronic document and using the same access controls as the electronic document, the message can be accessed by and delivered to a communication application for a user that does not currently have access to the electronic document. At the same time, such a document message can still be associated with and viewed in the electronic document.
[0066] Now that an exemplary implementation has been described, Figure 7 An example of a computer with which such techniques may be implemented is shown. This is merely one example of a computer and is not intended to imply any limitation as to the scope of use or functionality of such a computer.
[0067] The computer can be any of a variety of general or special computing hardware configurations. Some examples of computer types that can be used include, but are not limited to, personal computers, effective joysticks, set-top boxes, handheld or laptop devices (e.g., media players, notebook computers, tablet computers, cellular phones, personal digital assistants, voice recorders), server computers, multiprocessor systems, microprocessor-based systems, programmable consumer electronics, networked personal computers, minicomputers, mainframe computers, and distributed computing environments that include any of the above computer or device types, etc.
[0068] refer to Figure 7, the computer 700 includes at least one processing unit 702 and a memory 704. The computer may have multiple processing units 702 and multiple devices implementing the memory 704. The processing unit 702 may include one or more processing cores (not shown) that operate independently of each other. Additional co-processing units may also be present in the computer. The memory 704 may include volatile devices (such as dynamic random access memory (DRAM) or other random access memory devices), and non-volatile devices (such as read-only memory, flash memory, etc.) or some combination of the two. Other storage devices such as dedicated memory or registers may also be present in one or more processors. The computer 700 may include additional storage devices, such as storage devices (whether removable or non-removable), which include but are not limited to disks or tapes for magnetic or optical recording. The removable storage device 708 and the non-removable storage device 710 may be used to store and retrieve data from the computer 700. Figure 7 Such additional memory is described in . Figure 7 The various components in are typically interconnected by an interconnection mechanism such as one or more buses 730 .
[0069] Computer storage media is any medium in which data can be stored and retrieved by a computer from an addressable physical storage location. Thus, computer storage media can be volatile or non-volatile memory, or removable or non-removable storage devices. Memory 704, removable storage device 708, and non-removable storage device 710 are all examples of computer storage media. Some examples of computer storage media are RAM, ROM, EEPROM, flash memory or other storage technology, CD-ROM, digital versatile disc (DVD) or other optically or magneto-optically recorded storage devices, cassettes, magnetic tapes, disk storage or other magnetic storage devices. Computer storage media and communication media are mutually exclusive media categories.
[0070] The computer 700 may also include a communication connection 712 that allows the computer to communicate with other devices through a communication medium. Communication media typically transmit computer program instructions, data structures, program modules or other data over a wired or wireless material by propagating a modulated data signal, such as a carrier wave or other transport mechanism over the material. The term "modulated data signal" refers to a signal that has one or more of its characteristics set or changed in a manner that encodes information into the signal, thereby changing the configuration or state of a receiving device of the signal. By way of example, and not limitation, communication media include wired media such as metallic or other electrically conductive wires that propagate electrical signals or optical fibers that propagate optical signals, and wireless media such as any non-wired communication medium that allows propagation of signals such as acoustic, electromagnetic, electrical, optical, infrared, radio frequency and other signals. The communication connection 712 is a device such as a wired network interface, a wireless network interface, a radio frequency transceiver, such as WiFi 770, cellular 774, Long Term Evolution (LTE) or Bluetooth 772, etc., a transceiver, a navigation transceiver, such as a Global Positioning System (GPS) or a Global Navigation Satellite System (GLONASS), etc., or other device 776 that interfaces with the communication medium to send data on the communication medium and receive data from the communication medium.
[0071] The computer 700 may have various input devices 714 such as a pointer device, a keyboard, a touch-based input device, a pen, a camera, a microphone, sensors such as an accelerometer, a thermometer, a light sensor, etc. The computer 700 may have various output devices 716 such as a display, a speaker, etc. Such devices are well known in the art and are not discussed in detail herein. The various input and output devices may implement a natural user interface (NUI), which is any interface technology that enables a user to interact with a device in a "natural" manner, free from the artificial constraints imposed by input devices such as a mouse, keyboard, remote control, etc.
[0072] Examples of NUI approaches include those that rely on voice recognition, touch and stylus recognition, gesture recognition on and adjacent to the screen, hover gestures, head and eye tracking, voice and language, vision, touch, gestures, and machine intelligence, and may include the use of touch-sensitive displays, voice and language recognition, intent and goal understanding, motion gesture detection using depth cameras (e.g., stereo camera systems, infrared camera systems, and other camera systems and combinations of these), motion gesture detection using accelerometers or gyroscopes, facial recognition, three-dimensional displays, head, eye and gaze tracking, immersive augmented reality and virtual reality systems, all of which provide a more natural interface, and techniques for detecting brain activity using electric field detection electrodes (EEG and related methods).
[0073] The various storage devices 710, communication connections 712, output devices 716, and input devices 714 may be integrated into the housing with the rest of the computer, or may be connected via various input / output interface devices on the computer, in which case the reference numerals 710, 712, 714, and 716 may indicate interfaces for connecting to the devices or the devices themselves as appropriate.
[0074] Generally speaking, a computer includes an operating system, which is a computer program that manages access to the various resources of the computer by applications. There may be multiple applications. The various resources include memory, storage, input devices, and output devices, such as display devices and input devices, as in Figure 7 As shown in .
[0075] Figure 1-4 Various modules and data structures in Figure 5-6 , and any operating system, file system, and Figure 7 An application on a computer may be implemented using one or more processing units of one or more computers, wherein one or more computer programs are processed by the one or more processing units. A computer program includes computer-executable instructions and / or computer-interpreted instructions, such as program modules, which are processed by one or more processing units in a computer. Generally speaking, such instructions define routines, programs, objects, components, data structures, etc., which, when processed by a processing unit, direct or configure the computer to perform operations on the world, or configure the computer to implement various components, modules, or data structures.
[0076] Alternatively, or in addition, the functionality of one or more of the various components described in the present application may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that may be used include field programmable gate arrays (FPGAs), program-specific integrated circuits (ASICs), program-specific standard products (ASSPs), system-on-chip systems (SOCs), complex programmable logic devices (CPLDs), and the like.
[0077] Thus, in one aspect, a computer configured as a local client computer includes a computer configured to connect the computer to a network interface of a computer network. The computer network is connected to a shared storage system. The shared storage system includes a file system configured to store multiple electronic documents and make the multiple electronic documents accessible to multiple users. The computer includes a processing system including one or more units and a storage device, the storage device including a computer program that configures the processing system when executed by the processing system. As configured by the computer program code, the processing system includes an application configured to process user input to modify an electronic document. The application includes a document pane configured to display an electronic document and a graphical user interface that displays actions from activity data associated with the electronic document. The action includes at least a document message, wherein the document message includes content, an identifier of a sender, and an identifier of a recipient. The application is further configured to process the user input to at least create a document message associated with a currently opened electronic document.
[0078] In another aspect, a computer-implemented process includes processing user input to modify an electronic document, including presenting an application including a document pane configured to display the electronic document and a graphical user interface displaying actions from activity data associated with the electronic document. The actions include at least a document message, wherein the document message includes content, an identifier of a sender, and an identifier of a recipient. The application processes the user input to create at least a document message associated with a currently open electronic document.
[0079] In another aspect, a computer system includes a shared storage system and a client computer. The client computer includes an application having a graphical user interface configured to display a document pane of an electronic document. The graphical user interface also displays actions associated with electronic document management. The actions are from activity data associated with the electronic document. The application includes a module for generating one or more document messages associated with a currently opened electronic document in response to an input operation associated with the displayed action.
[0080] In any of the foregoing aspects, the application may display comments associated with locations in the electronic document.
[0081] In any of the foregoing aspects, the application may process the user input to at least create a reply to the document message as a further document message associated with the currently opened electronic document.
[0082] In any of the foregoing aspects, data defining a document message associated with a currently opened electronic document may be stored separately from data defining a structure and content of the electronic document.
[0083] In any of the foregoing aspects, the communication application may be configured to access data defining a document message associated with the electronic document in accordance with access controls associated with the electronic document. The communication application may be associated with a user and may be configured to access document messages associated only with electronic documents to which the user has access rights. The communication application may be associated with a first user and may be configured to receive a document message from a second user in response to the second user posting a document message in an electronic document authorized for access by the first user.
[0084] In another aspect, an application on a computer includes a module operative in response to input associated with a displayed action for generating a document message.
[0085] In any of the foregoing aspects, the electronic document may include data defining the structure and content of the electronic document, data defining comments associated with the electronic document, and actions associated with the electronic document.
[0086] In any of the foregoing aspects, the action may include data describing an action performed by a user and associated with the electronic document.
[0087] In any of the preceding aspects, the action may include a document message.
[0088] In any of the foregoing aspects, the action may include an action on an electronic document. Such an action may include, but is not limited to, opening, saving or closing a document, sharing a document, and changing permissions on a document.
[0089] In any of the foregoing aspects, the action may include an action on a comment in an electronic document. Such an action may include, but is not limited to, adding, editing or deleting a comment, replying to a comment, marking a comment as resolved, and marking a comment as unresolved.
[0090] In any of the preceding aspects, the actions may be displayed in an activity pane associated with a document pane in a graphical user interface.
[0091] In any of the foregoing aspects, the comments may be displayed in a comments pane associated with the document pane in the graphical user interface.
[0092] In any of the foregoing aspects, the activity pane, the comment pane, and the document pane may be non-overlapping panes in the graphical user interface.
[0093] In any of the foregoing aspects, the application is configured to provide a plurality of controls associated with the displayed actions to allow filtering and sorting of the actions.
[0094] In any of the preceding aspects, the application is configured to filter the actions by action type.
[0095] In any of the preceding aspects, the application is configured to filter actions by users associated with the actions.
[0096] In any of the preceding aspects, the shared storage system is configured to update an action associated with the electronic document.
[0097] In another aspect, an article of manufacture includes at least one computer storage medium and computer program instructions stored on the at least one computer storage medium. The computer program instructions, when processed by a processing system of a computer, the processing system including one or more processing units and storage devices, configure the computer to give any of the above aspects and / or perform processing as given in any of the foregoing aspects.
[0098] Any of the foregoing aspects may be implemented as a computer system, as any individual component of such a computing system, as a process performed by such a computer system or any individual component of such a computer system, or as an article of manufacture comprising a computer memory having computer program instructions stored therein which, when processed by one or more computers, configure one or more computers to provide such a computer system or any individual component of such a computer system.
[0099] It should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific implementations described above.The specific implementations described above are disclosed as examples only.
Claims
1. A computer system consisting of one or more computers, the computer system comprising: A processing system comprising a storage device and one or more processing units, the storage device comprising computer program code which, when executed by the processing system, configures the processing system to: Storing electronic documents; Providing the electronic document to a first application via a network, the first application being configured to: processing user input to modify the electronic document, and processing user input to store a document message associated with the electronic document in a document database separate from the electronic document, wherein the first application includes a graphical user interface including a display of content of the electronic document and a display of one or more actions from activity data associated with the electronic document, and wherein the one or more actions include the document message associated with the electronic document; receiving a user identifier from a device on the network; querying the document database for one or more document identifiers associated with the user identifier, wherein at least one of the one or more document identifiers corresponds to the electronic document; accessing the document database to retrieve one or more document messages associated with the one or more document identifiers, wherein the one or more document messages include the document message associated with the electronic document; as well as The one or more document messages are sent via the network to a second application that is configured differently than the first application and is associated with the user identifier. 2 . The computer system of claim 1 , wherein the first application is further configured to display comments associated with locations in the electronic document.
3. The computer system of claim 1, wherein the first application is further configured to process user input to create a reply to the document message as a further document message associated with the electronic document.
4. The computer system of claim 1, wherein data defining a document message associated with the electronic document is stored separately from data defining a structure and content of the electronic document.
5. The computer system of claim 1, wherein the second application is a communication application configured to access the data defining the document message associated with the electronic document in accordance with an access control associated with the electronic document.
6. The computer system of claim 5, wherein the second application is associated with a second user and is configured to access a document message associated with an electronic document accessible only to the second user, and to receive the document message from the first user in response to the first user posting the document message in an electronic document authorized to be accessed by the second user.
7. The computer system according to claim 1, wherein the document message includes message content and further includes an identification of a first user who is a sender of the document message and an identification of a second user who is a receiver of the document message.
8. A computer system consisting of one or more computers, the computer system comprising: A processing system comprising a storage device and one or more processing units, the storage device comprising computer program code which, when executed by the processing system, configures the processing system to: Storing electronic documents; Providing the electronic document to a first application via a network, the first application being configured to: processing user input to modify the electronic document, and processing user input to store a document message associated with the electronic document in a document database separate from the electronic document, wherein the first application includes a graphical user interface, the graphical user interface including a document pane configured to display content of the electronic document, a comment pane configured to display a plurality of comments associated with a particular area of the electronic document, and an activity pane different from the comment pane and configured to display one or more actions from activity data associated with the electronic document, and wherein the one or more actions include the document message associated with the electronic document; receiving a user identifier from a device on the network; querying the document database for one or more document identifiers associated with the user identifier, wherein at least one of the one or more document identifiers corresponds to the electronic document; accessing the document database to retrieve one or more document messages associated with the one or more document identifiers, wherein the one or more document messages include the document message associated with the electronic document; as well as The one or more document messages are sent via the network to a second application that is configured differently than the first application and is associated with the user identifier.
9. The computer system of claim 8, wherein the first application is further configured to display comments associated with locations in the electronic document.
10. The computer system of claim 8, wherein the first application is further configured to process user input to create a reply to the document message as a further document message associated with the electronic document.
11. The computer system of claim 8, wherein data defining a document message associated with the electronic document is stored separately from data defining a structure and content of the electronic document.
12. The computer system of claim 8, wherein the second application is a communication application configured to access the data defining the document message associated with the electronic document in accordance with an access control associated with the electronic document.
13. The computer system of claim 12, wherein the second application is associated with a second user and is configured to access document messages associated only with electronic documents accessible to the second user.
14. The computer system of claim 12, wherein the second application is associated with a second user and is configured to receive the document message from the first user in response to the first user posting the document message in an electronic document authorized for access by the second user.
15. A computer-implemented method comprising: Storing electronic documents; Providing the electronic document to a first application via a network, the first application being configured to: receiving user input on a graphical user interface, the graphical user interface including a display of content of the electronic document and a display of one or more actions from activity data associated with the electronic document, processing user input to modify the electronic document, and processing user input to store a document message associated with the electronic document in a document database separate from the electronic document, wherein the one or more actions include the document message associated with the electronic document; receiving a user identifier from a device on the network; accessing the document database to retrieve one or more document messages associated with one or more document identifiers, wherein the one or more document messages include the document message associated with the electronic document; as well as The one or more document messages are sent via the network to a second application that is configured differently than the first application and is associated with the user identifier.
16. The computer-implemented method of claim 15, wherein the first application is further configured to display comments associated with locations in the electronic document.
17. The computer-implemented method of claim 15, wherein the first application is further configured to process user input to create a reply to the document message as a further document message associated with the electronic document.
18. The computer-implemented method of claim 15, wherein data defining a document message associated with the electronic document is stored separately from data defining a structure and content of the electronic document.
19. The computer-implemented method of claim 15, wherein the second application is a communication application configured to access the data defining the document message associated with the electronic document in accordance with an access control associated with the electronic document.
20. The computer-implemented method of claim 19, wherein the communication application is associated with a second user and is configured to receive the document message from the first user in response to the first user posting the document message in an electronic document authorized for access by the second user.
