Navigational assistance for articulated devices via semantic abstraction
Through the combination of semantic abstraction technology and hinge manipulation, the problem of difficult user-generated content in hinge-type devices is solved, and more efficient content navigation and user experience is achieved.
Patent Information
- Application Number
- CN202210968690.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2017-01-30
- Filing Date
- 2018-01-22
- Publication Date
- 2025-02-11
- Estimated Expiration
- 2038-01-22
AI Technical Summary
When using hinged devices, it is difficult for users to effectively organize and locate large amounts of user-generated content, resulting in low content search efficiency and poor user experience.
Through semantic abstraction technology, navigational assistance for hinged devices is provided, allowing users to navigate through different segments of semantic abstract content, and control navigation speed and abstract granularity through hinges' manipulation.
It improves users' quick search and positioning capabilities in content browsing, simplifies the content organization and search process, and improves the user experience.
Smart Images

Figure CN115220616B_ABST
Abstract
Description
[0001] This application is a divisional application of the invention patent application with application number 201880009190.X filed on January 22, 2018 and named “Navigation assistance for hinged devices via semantic abstraction”. Background Art
[0002] Mobile devices provide a variety of different functions to today's users, and in many instances, allow users to directly interact with objects displayed via touch-sensitive display devices. However, devices with multiple display surfaces connected by hinges introduce complexities that are generally not addressed using traditional gesture input modalities. Such devices may include two parts of the device, where each part includes a display screen and is connected by a physical hinge that can be manipulated by the user. For example, in the context of a book or journal, a user can view two pages in a manner similar to a paper book or notebook.
[0003] In an example, a user may use an articulated device to generate content such as notes, journal entries, documents, and the like. Some users may generate a large amount of content, such as by creating journal entries every day for many years. Some users may not organize the content they create, and therefore finding specific content within the content they create is challenging and time consuming. This may reduce the user's enjoyment when using these types of devices and lead to user frustration. Summary of the invention
[0004] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
[0005] Described is a technique for navigational assistance to hinged devices via semantic abstraction. Generally speaking, the techniques described herein improve the user experience when a user navigates through content (e.g., user-generated content in an electronic document). For example, the techniques described herein semantically abstract content created in an electronic document to provide abstracted content. In implementation, the abstracted content includes abstracted pages, each of which represents a different section of the created content. When a user browses an electronic document instead of browsing page by page, the techniques described herein navigate on the display of the abstracted pages instead. In addition, the hinges between different displays can be used as an input mechanism for controlling the speed of navigating through the abstracted pages, thereby allowing the user to more easily locate a specific section of the created content. BRIEF DESCRIPTION OF THE DRAWINGS
[0006] The detailed description is described with reference to the accompanying drawings. In the drawings, the leftmost digit in a reference number identifies the figure in which the reference number first appears. The same reference numbers used in different instances in the description and the drawings may indicate similar or identical items. An entity represented in a figure may indicate one or more entities, and therefore, singular or plural forms of entities in the following discussion are referenced in an interchangeable manner.
[0007] Figure 1 is an illustration of an environment in an example implementation that is operable to employ the techniques described herein, in accordance with one or more embodiments.
[0008] Figure 2 A more detailed description of the Figure 1 An example implementation of a navigational assistance module.
[0009] Figure 3 Depicted are example implementation scenarios for navigational assistance for an articulated device via semantic abstraction in accordance with one or more embodiments.
[0010] Figure 4 Depicted are example implementation scenarios for an example user interface that displays navigational tools based on navigational assistance for an articulated device via semantic abstraction in accordance with one or more embodiments.
[0011] Figure 5 is a flow diagram describing steps in a method for providing navigational assistance on a hinged device via semantic abstraction, in accordance with one or more embodiments.
[0012] Figure 6 is a flowchart describing steps in a method for controlling browsing speed based on a hinged device according to one or more embodiments.
[0013] Figure 7 is a flow diagram describing steps in a method for providing navigational tools based on navigational assistance on a hinged device via semantic abstraction in accordance with one or more embodiments.
[0014] Figure 8 An example system including various components of an example device is illustrated, which may be implemented as described in reference Figure 1-Figure 7 Any type of computing device described may be used to implement embodiments of the techniques described herein. DETAILED DESCRIPTION
[0015] Overview
[0016] Techniques for navigational assistance for hinged devices via semantic abstraction are described. Generally speaking, the techniques described herein provide semantic abstractions of content during rifling operations for browsing content. The semantic abstractions can be generated based on a variety of different information (e.g., metadata) associated with the content, the user, and / or other users viewing or co-authoring the content. For example, these techniques interpret the meaning of the content and perform various types of analysis on the subject matter of the content. In addition, through user manipulation of the physical hinge to provide input to the hinged device, the speed of the rifling operation can be controlled and the level of granularity of the abstraction can be changed.
[0017] In the following discussion, an example environment operable to employ the techniques described herein is first described. Next, a section entitled "Example Implementation Scenarios" describes some example implementation scenarios according to one or more embodiments. Thereafter, a section entitled "Example Procedures" describes some example procedures according to one or more embodiments. Finally, a section entitled "Example Systems and Devices" describes example systems and devices operable to employ the techniques discussed herein according to one or more embodiments.
[0018] Having presented an overview of example implementations in accordance with one or more embodiments, consider now an example environment in which the example implementations may be employed.
[0019] Example Environment
[0020] Figure 1 1 is an illustration of an environment 100 in an example implementation that is operable to employ the techniques for navigational assistance to hinged devices via semantic abstraction discussed herein. Environment 100 includes a client device 102 that can be configured for mobile use, such as a mobile phone, a tablet computer, a wearable device, a handheld gaming device, a media player, and the like. Client device 102 includes a display device 104 and a display device 106 connected to each other via a hinge 108. Display device 104 includes a touch surface 110, and display device 106 includes a touch surface 112. Client device 102 also includes an input module 114 that is configured to process input received via one of touch surfaces 110, 112 and / or via hinge 108.
[0021] Hinge 108 is configured to be rotationally movable about a longitudinal axis 116 of hinge 108 to allow the angle between display devices 104, 106 to change. In this way, hinge 108 allows display devices 104, 106 to be connected to each other, but can be oriented at different angles and / or planar orientations relative to each other. In at least some implementations, touch surfaces 110, 112 can represent different portions of a single integrated and continuous display surface that can be bent along hinge 108.
[0022] Although the implementations presented herein are discussed in the context of mobile devices, it is to be understood that a variety of other types and form factors of devices may be utilized in accordance with the claimed implementations. Thus, client devices 102 may range from full resource devices with large amounts of memory and processor resources to low resource devices with limited memory and / or processing resources. Figure 8 Example implementations of client device 102 are discussed below.
[0023] The client device 102 includes a variety of different functions that enable various activities and tasks to be performed. For example, the client device 102 includes an operating system 118, applications 120, and a communication module 122. Generally speaking, the operating system 118 represents functions for abstracting various system components (e.g., hardware, kernel-level modules, and services, etc.) of the client device 102. For example, the operating system 118 can abstract various components (e.g., hardware, software, and firmware) of the client device 102 to enable interaction between the components and applications running on the client device 102.
[0024] Application 120 represents functionality for performing various tasks via client device 102. In one particular implementation, application 120 represents a web browser, web platform, or other application that can be used to browse websites over a network.
[0025] The communication module 122 represents functionality for enabling the client device 102 to communicate via a wired and / or wireless connection. For example, the communication module 122 represents hardware and logic for transmitting data via a variety of different wired and / or wireless technologies and protocols.
[0026] According to various implementations, the display devices 104, 106 generally represent functionality for visual output of the client device 102. Additionally, the display devices 104, 106 represent functionality for receiving various types of inputs, such as touch inputs, stylus inputs, non-touch proximity inputs, etc., via one or more of the touch surfaces 110, 112, which can be used as the visual output portion of the display devices 104, 106. The input module 114 represents functionality that enables the client device 102 to receive inputs and process and route the inputs in various ways.
[0027] The input mechanisms 124 generally represent different functions for receiving input to the client device 102, and include a digitizer 126, a touch input device 128, and an analog input device 130. Examples of input mechanisms 124 include gesture-sensitive sensors and devices (e.g., touch-based sensors), a stylus, a touchpad, an accelerometer, a microphone with voice recognition software, etc. The input mechanisms 124 can be separate from or integrated with the display devices 104, 106; examples of integration include a gesture-sensitive display with an integrated touch-sensitive sensor.
[0028] The digitizer 126 represents functionality for converting various types of input to the display devices 104, 106, the touch input device 128, and the analog input device 130 into digital data that can be used in various ways by the client device 102. The analog input device 130 represents a hardware mechanism (e.g., hinge 108) that can be used to generate different physical quantities representing data. For example, the hinge 108 represents a mechanism that can be used to generate input data through the measurement of a physical variable (e.g., the hinge angle of the hinge 108). For example, one or more sensors 132 can measure the hinge angle, and the digitizer 126 can convert such a measurement into digital data that can be used by the client device 102 to perform operations on the content displayed via the display devices 104, 106.
[0029] Generally speaking, the sensors 132 represent functionality for detecting different input signals received by the client device 102. For example, the sensors 132 may include one or more hinge sensors configured to detect the angle of the hinge between the display devices 104, 106. Additionally, the sensors 132 may also include a grip sensor (e.g., a touch sensor) configured to detect how a user holds the client device 102. Thus, a variety of different sensors 132 may be implemented to detect various different types of digital and / or analog inputs. These and other aspects will be discussed in more detail below.
[0030] In at least some implementations, the application 120 includes or otherwise utilizes a navigational assistance module 134. For example, the navigational assistance module 134 represents an independent application. In other implementations, the navigational assistance module 134 is included as part of another application or system software (e.g., operating system 118). Generally speaking, the navigational assistance module 134 is configured to semantically abstract the content in the electronic document to provide abstracted content used when navigating on the document. In addition, for user-generated content, the navigational assistance module 134 is configured to explain which words the user has used in the content and perform various types of analysis on the subject of the user's writing. The navigational assistance module 134 can also utilize a variety of different types of information (e.g., metadata associated with the content or the user) to abstract the meaning of the content and dynamically create temporary content (referred to herein as "abstracted content") that shows transient information during a quick search operation of browsing the document. Additional discussion of this feature and other features is provided below.
[0031] Having described an example environment in which the techniques described herein may operate, consider now a discussion of some example implementation scenarios according to one or more implementations.
[0032] Example Implementation Scenario
[0033] This section describes some example implementation scenarios of navigation assistance for hinged devices via semantic abstraction according to one or more implementations. The implementation scenarios can be implemented in the environment 100 described above, Figure 8 The system 800 of EMBODIMENTS and / or any other suitable environment may be implemented. For example, the implementation scenarios and processes describe example operations of the client device 102.
[0034] Figure 2 In more detail, the Figure 1 An example implementation 200 of the navigation assistance module 134 of the present invention. In the example shown, the navigation assistance module 134 includes an abstraction module 202, a content generator module 204, and a display module 206. These modules can be implemented in hardware, software, firmware, or a combination thereof. In addition, although these modules are described as separate components, any of these modules can be combined into a single component to perform the functions described in this article.
[0035] The abstraction module 202 is implemented at least in part in the hardware of the computing device to analyze source content 208 (also referred to herein as "authored content"), such as user-generated content, and semantically abstract the source content 208 based on a variety of factors 210. Some example factors 210 include spatial layout 212, visual landmarks 214, hierarchy 216, viewing history 218, behavior of other users 220, content meaning 222, metadata 224, and search speed 226, each of which is described in detail below.
[0036] The abstraction module 202 is configured to provide the abstracted content to the content generator module 204, which is configured to generate the abstracted output content 228 for display via the display module 206. As discussed further below, the abstracted output content 228 includes abstracted versions of the source content 208 that are used as reference points within the source content 208. In addition, when an input signal 230 is received to initiate a search operation to browse the source content 208, the abstracted output content 228 is displayed during the search operation, rather than the source content 208 itself. In this way, the user can quickly browse the abstracted output content 228 and understand the subject matter of different sections of the source content 208 without having to sift through the entire source content 208 page by page.
[0037] The input signal 230 may be detected from a variety of different input mechanisms, such as touch input or stylus input to the touch surface 110 or touch surface 112 of the client device 102, the pressing of a hardware button, the bending of the hinge 108 of the client device 102, a voice command via an audio sensor, or any combination of input mechanisms. As discussed in more detail below, user interaction with the hinge 108 may affect the search speed 226, which in turn may affect the level of granularity associated with abstracting the source content 208 and / or the level of abstraction relative to the source content 208. Thus, the input signal 230 may represent a signal generated via a variety of different input mechanisms.
[0038] Spatial layout 212 may refer to the relative position of objects on a page of source content 208. For example, when a user creates content, the user may remember inserting a particular paragraph in the lower right corner of a page, but may not remember the exact page number of the page. In another example, the user may remember inserting a figure that spans two adjacent pages, similar to a magazine spread, but the user may not remember which page included the figure. In another example, a spread may include the greatest density of information on the right side rather than on the left side, or vice versa.
[0039] The abstraction module 134 at least considers the spatial layout information 212 related to the source content 208 because the user may be interested in the spatial information. For example, there may be a specific reason why the user placed the figure in the specific location. Thus, the spatial layout 212 can be used when creating the abstracted output content 228 that is displayed when the search operation is performed, so as to present the information in the same or similar spatial location where the information was originally created. The abstracted output content 228 can include an abstracted view of a portion of the source content 208 in a specific location on the page, which can remind the user that the segment currently being searched is a segment with a specific spatial layout.
[0040] Visual markers 214 refer to objects that appear within the content that may be visually interesting to the user. Visual markers 214 may include a variety of different objects, such as titles, images, content cut or linked from another source, multimedia (e.g., video) embedded in a document, and the like. In an example, when creating an electronic log, a user may capture an image using the user's camera, and then add the captured image to the log. In another example, a user may take notes via a touch surface of a display device (e.g., display device 104), wherein the notes are related to the application context displayed via another display device (e.g., display device 106). For example, a user may be planning a trip and use an open web browser on a display device of a client device 102 to cut content (similar to clipping in the physical world), and then add the cut content to the log displayed via display device 106. In these examples, the weight of visual markers 214 may be relatively higher than plain text, so that they are more likely to be included in the abstracted output content 228 than text. Similarly, if a user enters text in a particular color, such as an entire paragraph in red (e.g., a different color than other text in source content 208), the text may be considered a visual marker based on the combination of the text being red and some large block of content being created. Alternatively or additionally, if the text color is known to convey some meaning (e.g., importance) within source content 208, the text color may be considered a visual marker.
[0041] The hierarchy 216 factor may refer to content that is interpreted as a section boundary. For example, if a user underlines text that appears to be a title, the text may be interpreted as indicating that the user is actually naming a specific section of the content. The underlined text may not be explicitly a chapter title, but the underlining of the text may be considered as a clue to how the content is created and organized. Other examples include bolding, highlighting, or surrounding an object or text. This type of information may be used as a useful label that is used to represent a specific section of the content and essentially reminds the user of the topic about the specific section. Thus, in terms of the existence and / or inference of a hierarchy (e.g., a title or bookmark that a user has created, or an object that a user has marked as a favorite using other features present in the system), this type of hierarchy information may be considered and essentially prompted to appear in the abstracted output content 228.
[0042] The viewing history 218 of the source content 208 may refer to the frequency with which a user views a particular section of the source content 208. For example, suppose a user returns to a particular section of the content to edit or reread the section, or to view a drawing previously created by the user. The viewing history 218 may indicate the frequency with which a user views a particular content, the time when the user last viewed the particular content, the time when the particular content was last edited, and the like. Thus, when dynamically creating the abstracted output content 228, information related to content that has been recently created and / or more frequently interacted with may be prioritized. Recently viewed information may also be prioritized. Therefore, by including such content in the abstracted output content 228, recently accessed content may be more easily located again.
[0043] The viewing history 218 may also indicate the time spent by the user viewing a portion of the source content 208. In an example, if the user navigates to a particular page or a set of consecutive pages, the time spent on the particular page or set of consecutive pages may be tracked and used to infer that the viewed content is content that the user may wish to revisit again. In implementations, the viewing history 218 may also be combined with the metadata 224 described below to identify which segments the user tends to view at particular times of the day, when near particular physical locations or social environments, and the like. For example, such segments of the source content 208 may be considered important to the user at those particular time periods or physical locations or environments.
[0044] Additionally, viewing history 218 may indicate the user's behavior when browsing pages of source content 208, for example, whether the user quickly browsed certain sections of source content 208, while slowly browsing other sections of source content 208. This type of behavior can be used to infer that the topics contained within the other sections that were browsed slowly may be of interest to the user, and the user may be interested in revisiting those other sections. In this case, the importance of those other sections may be increased compared to the sections that were browsed quickly, and additional pages of abstracted output content 228 may be created to abstractly represent the topics within those other sections that were browsed slowly. Thus, viewing history 218 can be used to identify sections of content that may be of greater interest to the user.
[0045] When abstracting the source content 208, the behavior of other users 220 may also be considered. In at least some scenarios, a user may create content that is relevant to other users. Some examples include notes recorded at a meeting, notes from a brainstorming session in which other people participate, collaborative content creation projects, and the like. Alternatively, the content may be created by a user alone, but other users are permitted to view the content. In these and other scenarios, a user may wish to share his notes with others. The behavior of other people when accessing the content may be tracked to identify which parts of the content may be more interesting to others, for example, by how much time other users spend viewing specific sections of the source content 208. Portions of the source content 208 that have been recently edited by other users may also be identified and used when abstracting the source content 208.
[0046] Content meaning 222 can refer to the concept of representing words, phrases, or other objects in source content 208. In the example, abstract module 202 is configured to analyze which words are written or input, and index such information. If a word is frequently repeated in a certain section of source content 208, the section is likely to be related to or about the concept represented by the repeated word, which can be interpreted as the content meaning 222 of the section. A search can be performed to locate and obtain a graphical representation of the concept. For example, consider a user who writes a note about a cat. Based on, for example, several instances of the word "cat" included in the note, or several cat breeds mentioned in the note, the content meaning 222 of the note is determined to be related to the cat. This information can be used to generate a page of abstracted output content 228, which prominently features the word "cat". Alternatively or additionally, an image of a cat can be included in a page of abstracted output content 228, even if no such image is included in the note. If an image succinctly captures the essence of the subject matter and content meaning 222 of that particular section of the note, the image may be included in the abstracted output content 228 .
[0047] In the example, if the source content 208 includes images, audio, or videos that are cut or linked from a source on the network, the source can be identified in that way. In addition, image recognition or similar techniques can be used, for example, to determine the subject and corresponding content meaning 222 of the image, audio, or video. In addition, any notes or annotations corresponding to the image, audio, or video can be used to determine which part of the image, audio, or video is likely to be important to the user. In the example, the user records notes about football, and as a part of the note record, the user inserts a video or a link to a video on YouTubeTM into the notes. The video can span across a variety of different themes, but can also include a subset of the themes related to football. Then, it can be inferred that the part of the video related to football is a specific part of the video that the user is interested in, because it is related to the notes. Then, the information (e.g., still frame) from the specific section of the video can be used as a description of the content meaning 222 of the video to be shown on the associated page of the abstracted output content 228.
[0048] Metadata 224 may also be used when abstracting source content 208. Metadata 224 may include a variety of information associated with a user or client device 102. For example, metadata 224 may include: the time and date when the user created source content 208, the people with whom the user was when the user created source content 208, the geographic location when the user created source content 208, and so on. In addition, metadata 224 may associate the created content with the user's schedule. For example, from a combination of the user's calendar and social graph, it may be determined that the user is attending a particular meeting, in a particular city or building, or with particular people, or any combination thereof. This information may be used to determine the meaning of any notes recorded during the meeting, in the particular city or building, or while with the certain people. Often, a user's notes may be ambiguous or formed in a mysterious shorthand that only the user knows. Therefore, metadata 224 may be used to understand what the notes may mean, even when the notes are not particularly clear on the surface.
[0049] Search speed 226 refers to the speed at which pages of source content 208, and more particularly, pages of abstracted output content 228, are searched (e.g., browsed). Search speed 226 can also be used to help select between competing information views. For example, if a user browses source content 208 slowly (e.g., at a rate below a threshold speed), more granularity (e.g., more detailed information) can be provided in abstracted output content 228 because it is assumed that the user has more time to view more information.
[0050] However, if the user begins browsing the source content 208 more quickly, for example at a rate higher than a threshold speed, it can be assumed that the user has less time to view information. In this case, by further abstracting the source content 208, less granularity is provided in the abstracted output content 228. For example, assume that the user has a page of notes about cats. The notes can be abstracted into a group of images of cats. As the search speed 226 increases, a group of images of cats can be further abstracted into photos or portrait line drawings of cats, or several cats can be further abstracted into a single cat. On the contrary, if the search speed decreases, the title and / or other text can be included with the group of images of cats to provide additional information for the user to view. Thus, the granularity of the abstraction can be dynamically adjusted according to the change in the search speed 226.
[0051] Thus, factors 210 can be used to identify topics to use when abstracting source content. In addition, the granularity of content defined as abstracted output content 228 can be controlled based on one or more of factors 210 such as viewing history 218 or search speed 226. For example, abstraction module 202 is configured to abstract a single page or a single pull-down page into a page of abstracted output content 228, or to abstract a series of pages with similar topics into a single page of abstracted output content 228. Abstracting a series of pages together into a single page of abstracted output content 228 can facilitate efficient browsing of content at a high speed rate.
[0052] Figure 3 An example implementation scenario 300 of navigational assistance for an articulated device via semantic abstraction is shown. Scenario 300 represents an input form that allows a user to interact with a client device 102 to browse an abstracted view of content. In scenario 300, client device 102 is used in a standard state 302 to display a portion of a user's note 304. The displayed portion of note 304 includes a note about a family dog via display device 104 and display device 106. The user includes a hyperlink 306 in note 304, which links to a video about a dog to correspond to note 304. The note 304 displayed for viewing in this example scenario 300 is only a portion of the user's note, in which sections related to other topics (e.g., cats, cars, cowboys, houses, vacations, sailing, etc.) may be included. Thus, note 304 may include any topic entered by the user and may include any number of pages.
[0053] In scene 300, a user initiates a search operation for browsing notes 304 to locate a specific section of notes 304. In at least one example, this is accomplished via hinge input 308 (e.g., bending hinge 108), similar to bending the binding of a book with a thumb on one side to search for pages of the book. For example, in the upper portion of scene 300, client device 102 is initially in a flat state 310, wherein both display devices 104 and 106 are placed side by side and face the same direction, i.e., are coplanar. Next, the user transitions client device 102 from flat state 310 to bent state 312 by applying a force to at least one of display devices 104, 106 to bend hinge 108, which further "opens" client device 102, thereby causing touch surfaces 110, 112 to move away from each other.
[0054] In the bent state 312, the display devices 104, 106 face at least partially in opposite directions from each other so that the touch surfaces 110, 112 (also at least partially used as viewing surfaces for the display devices 104, 106) are rotated away from each other. This particular hinge input 308 is described only as an example and is not to be construed as limiting. For example, the hinge 108 can be bent in any direction to initiate a search operation. In another example, the client device 102 can be initially in a bent state so that the hinge angle between the display devices 104, 106 is less than 180 degrees, and the hinge input 308 can include manipulation of the hinge to further "open" the client device 102 toward a nearly flat state.
[0055] In at least one implementation, a search operation may be initiated via a combination of hinge input 308 and another input signal, such as a touch input via a touch surface of one or both of display devices 104, 106. For example, if a user touches a location on the right side of display device 106 while moving hinge 108, a search operation may browse through notes 304 in a forward direction (e.g., to the right). Conversely, if a user touches a location on the left side of display device 104 in conjunction with hinge input 308, a search operation may browse through notes 304 in a reverse direction (e.g., to the left).
[0056] Continuing with scenario 300, rotational motion (e.g., bending) of hinge 108 is detected by sensor 130 and used as at least a portion of input signal 230 for initiating or controlling a search operation. In response, note 304 is semantically abstracted to present an abstracted view of note 304 to the user in search state 314 and enable the user to quickly understand the subject matter of a particular section of note 304. For example, a portion of note 304 describing a domestic dog may be abstracted into an abstracted view 316 that includes a title 318 entitled "Dog." Abstracted view 316 may also include an image 320 of a dog, even though the portion of note 304 describing the dog does not include any such image 320.
[0057] In addition, the abstracted view 316 may include a still image 322 from a video linked via the hyperlink 306. In implementation, the still image 322 may be obtained from a portion of the video corresponding to the concept of a dog. Here, for example, the still image 322 includes a dog playing with a ball, which corresponds to the subject of the note 304. The abstracted view 316 is displayed for any period of time, such as 0.25 seconds, 0.5 seconds, 0.6 seconds, 0.75 seconds, 1.0 seconds, etc. In operation, the abstracted view 316 may be displayed for a relatively long period of time compared to the viewable pages of the paper book when the paper book is flipped. Here, the abstracted view 316 is displayed long enough to allow the user to learn about the subject described in a particular section of the note 304. Then, for example, by flipping the digital page 324, the display of the abstracted view 316 is changed to display the abstracted view of the next section of the note 304.
[0058] As mentioned above, the user can control the speed of the search operation (e.g., the speed of flipping the abstracted views) based on the interaction with the hinge 108. For example, the user can bend the hinge 108 to be further away from the reference position (e.g., the flat state 310), thereby increasing the speed of flipping the abstracted views. Conversely, the user can move the hinge 108 to bring the client device 102 relatively closer to the reference position, thereby reducing the speed of flipping the abstracted views. In implementation, rotating the hinge 108 in a first direction can increase the search speed, while rotating the hinge 108 in a second direction (e.g., opposite to the first direction) can reduce the search speed.
[0059] Interaction with hinge 108 may also cause client device 102 to further abstract associated content because search speed 226 has been increased so that each abstracted view is displayed for a relatively short period of time, giving the user less time to view and / or read the abstracted content. In contrast, if the user reduces the bending of hinge 108 (e.g., manipulating the orientation of client device 102 to be relatively close to flat state 310 or reference position), search speed 226 decreases and the abstracted view may be modified to include additional details because each abstracted view is displayed for a relatively long period of time and the user may have more time to view and / or read the abstracted content. Thus, based on the user's input (simulated input via hinge, touch input via touch surface 110 or 112, or other types of user input), client device 102 determines the presentation time (e.g., 0.5 seconds, 1.0 seconds, 1.25 seconds, etc.) and hierarchy level of the abstracted view to be presented to the user while navigating over the content.
[0060] Figure 4 An example implementation scenario 400 is shown for a user interface that displays navigational tools based on navigational assistance for a hinged device via semantic abstraction. In scenario 400, a user bends hinge 108 as indicated by arrow 402 to place client device 102 in bent state 312. In response, abstracted views 404 (404a, 404b, 404c, 404d, 404e, 404f) representing different sections of note 304 are displayed along one or more edges of display devices 104, 106 without triggering navigation away from the currently displayed content.
[0061] In the example shown, the abstracted view 404 includes a title 404a "Dog" representing a section of the note describing a family dog, an image 404b of a dog playing with a ball that is linked to the video in the note 304 via hyperlink 306, and a cat 404c representing a section of the note describing a cat. In addition, the scene 400 includes an image 404d of a cowboy representing another section of the note describing a cowboy, an image 404e of a house representing another section of the note that references a house, and a title 404f "Vacation" representing a section of the note that mentions a vacation. The abstracted views 404 are generated based on the subject matter of the particular sections of the content they represent, as described above. The abstracted views 404 can provide users with an understanding of relative locations within a document or within content. The abstracted views 404 can let users understand which topics are close to the left and right sides of the currently displayed content, rather than relying solely on page numbers.
[0062] When the abstracted view 404 is displayed, the abstracted view 404 can be used as a navigational tool that, when selected, navigates to the display of the corresponding section of the content. For example, if the user selects the image 404d of the cowboy, the content displayed via the display device 104, 106 can jump to the section of the note that describes the cowboy. In essence, the abstracted view 404 acts as an abstracted form of a table of content that may not necessarily be organized into clear sections.
[0063] Additionally or alternatively, a table of contents may be automatically generated and added to the content, for example, at or near the beginning of the content. Using the techniques described herein, a table of contents may be generated without explicit headers or section boundaries created by a user within the content. For example, using Figure 2 The described factors 210, the abstracted output content 228 (e.g., the abstracted view 404) is created in the form of a content table. In implementation, the content table can be generated based on an average level of abstraction. However, any suitable level of abstraction can be used to create the content table.
[0064]
[0043] Having described some example implementation scenarios, consider now some example procedures for navigational assistance for an articulated device via semantic abstraction in accordance with one or more implementations.
[0065] Example Process
[0066] The following discussion describes example processes for navigational assistance for hinged devices via semantic abstraction in accordance with one or more embodiments. The example processes may be described in Figure 1 Environment 100, Figure 8 The system 800 of , and / or any other suitable environment. For example, the process represents a process for implementing the example implementation scenario discussed above. In at least some implementations, the steps described for the various processes can be implemented automatically and independently of user interaction (e.g., by the navigational assistance module 134).
[0067] Figure 5 The invention is a flowchart that describes steps in a method for providing navigational tools on a hinged device via semantic abstraction according to one or more embodiments. For example, the method describes an example process for generating an abstracted view of content and navigating the abstracted view.
[0068] Step 500 obtains authored content from an electronic document. The authored content may include a variety of different content, examples of which are described above. In at least one implementation, the authored content includes content created (eg, authored) by a user of the client device 102.
[0069] Step 502 semantically abstracts the authored content to provide abstracted content representing the authored content. The authored content may be semantically abstracted in a variety of different ways, examples of which have been described above. When abstracting the authored content, other factors may be used to identify topics that may be of interest to the user. Example factors are described above with respect to implementation 200. In at least one example, the abstracted content is organized into abstracted pages, wherein each abstracted page represents a different section of the authored content. The abstracted pages are configured to be displayed during a search operation and are not added to the authored content of the electronic document. These abstracted pages are considered temporary pages and are modified based on the speed of the search operation, as described with respect to scenario 300.
[0070] Step 504 navigates on the display of abstracted pages of abstracted content based on the user input that initiated the search operation for browsing the electronic document. Computing device 102 alternatively navigates on abstracted pages of abstracted content rather than browsing the electronic document page by page to allow the user to quickly and easily identify sections with specific information.
[0071] Step 506 receives additional input that interrupts the search operation. For example, in scenario 300, the user may interact with hinge 108 to transition the orientation of client device 102 from bent state 312 back to flat state 310 or reference position. Sensor 132 may detect movement of hinge 108 that returns the hinge angle of hinge 108 to a previous position that approximates the hinge angle prior to initiating the search operation.
[0072] Step 508 displays a page of the electronic document corresponding to the most recently displayed abstracted page in response to the search operation being interrupted. For example, if the search operation is stopped when a particular abstracted page is displayed, the particular abstracted page is removed from view and the actual authored content of the electronic document represented by the particular abstracted page is displayed. For example, in scenario 300, if the family dog and the dog's video are displayed when the search operation ends, the client device 102 displays the portion of the note 304 corresponding to the family dog and the dog's video.
[0073] Figure 6is a flow chart describing steps in a method for controlling browsing speed based on a hinged device according to one or more embodiments. The method, for example, describes an example process for controlling the speed of a search operation that browses an abstracted view of content within a document.
[0074] Step 600 measures a first hinge angle of a hinge connecting two display devices. For example, the client device 102 uses the sensor 132 to measure a current angle formed between two display devices 104 and 106 of the client device 102 that are physically connected by the hinge 108.
[0075] Step 602 receives a user input that initiates a search operation for browsing documents displayed via at least one of the two display devices. In at least some implementations, the user input includes a touch input combined with a hinge angle movement that changes a first hinge angle to a second hinge angle. An example of this type of user input is described with respect to scenario 300.
[0076] Step 604 performs a search operation by browsing a display of an abstracted view of the content within the document. In at least some implementations, computing device 102 generates an abstracted view of the content and displays the abstracted view rather than the content itself during the search operation. An example of browsing an abstracted view is described with respect to scenario 300.
[0077] Step 606 controls the browsing speed based on the amount of change from the first hinge angle to the second hinge angle. Thus, the speed of browsing is controlled (e.g., set, increased, or decreased) based on the degree to which the user bends the hinge. An example of controlling the speed of browsing based on user interaction with the hinge is described with respect to implementation 200 and scenario 300.
[0078] Figure 7 The present invention is a flowchart that describes steps in a method for providing a navigational tool based on navigational assistance to a hinged device via semantic abstraction according to one or more embodiments. For example, the method describes an example process for providing an abstracted view of content within a document as a navigational tool.
[0079] Step 700 measures a first hinge angle of a hinge connecting two display devices. For example, the client device 102 uses the sensor 132 to measure a current angle formed between two display devices 104 and 106 of the client device 102 that are physically connected by the hinge 108.
[0080] Step 702 detects a movement of the hinge angle that changes the first hinge angle to the second hinge angle. For example, in environment 100, sensor 132 can detect the movement of hinge 108 and provide a corresponding signal to input module 114 to convert the signal into an analog input corresponding to the operation to be performed. Additional examples of this type of user input are described with respect to scenario 300.
[0081] Step 704 recognizes a hinge angle movement from a first hinge angle to a second hinge angle as input to display one or more abstracted views of content in the document along at least one edge of one or more of two display devices of the computing device. An example of displaying an abstracted view of content along an edge of a display device is described with respect to scenario 400.
[0082] Step 706, in response to selection of an abstracted view of the one or more abstracted views, navigates to a display of a section of the document represented by the selected abstracted view. Any of the abstracted views may be selected to navigate to a display of a corresponding section of content in the document. This enables a user to quickly and easily jump to different sections of a document, particularly in documents that are not well organized (e.g., notes or journals).
[0083]
[0013] Having described some example processes for navigational assistance for an articulated device via semantic abstraction, consider now some additional implementation details according to one or more implementations.
[0084] Implementation details
[0085] Generally speaking, techniques for navigational assistance for articulated devices via the semantic abstractions described herein enable:
[0086] Improved content navigation on hinged devices, such as user-generated content
[0087] Control of search speed based on interaction with a physical hinge connecting two or more parts of a mobile device
[0088] Control the level of granularity of abstraction of content based on search speed
[0089] Automatic creation of abstracted views of content that are only visible when the content is scrolled, allowing users to quickly identify the approximate location of a particular topic within the content
[0090] Navigational tools that represent an abstracted view to be revealed on one or more display device edges of a hinged device based on interaction with a physical hinge without triggering navigation away from currently displayed content
[0091] Thus, the technology described in this article provides more efficient navigation to electronic documents, particularly for content creation scenarios. Additionally, the technology described in this article improves user experience by allowing users to easily understand the abstracted concepts of different sections of electronic documents when browsing documents. In addition, users can also control the speed of browsing electronic documents by manipulating physical hinges. The technology described in this article also provides different levels of abstract granularity based on search speed and / or interaction with physical hinges. At least in some implementations, different levels of abstract granularity can be calculated before the search operation (e.g., pre-calculated) so that the abstract granularity of a specific pre-calculated level is dynamically selectable based on the search speed. Thus, such an implementation improves efficiency and reduces the time for navigation by not needing to calculate different levels of abstraction as needed, and therefore saves device resources (e.g., processor bandwidth, memory, etc.) that would otherwise be used to navigate on content that is not abstracted.
[0092] Having described some example implementation details, consider now a discussion of example systems and devices in accordance with one or more implementations.
[0093] Example Systems and Devices
[0094] Figure 8 An example system is generally shown at 800, which includes an example computing device 802 that represents one or more computing systems and / or devices that can implement the various techniques described herein. In at least some implementations, the computing device 802 represents an implementation of the client device 102 discussed above. For example, the computing device 802 can be configured as a mobile configuration using a housing formed and sized to be grasped and carried by one or more hands of a user, examples of which are shown including a mobile phone, a mobile gaming and music device, and a tablet computer, but other examples are contemplated. In at least some implementations, the client device 102 can be implemented as a wearable device, such as a smart watch, smart glasses, a dual-sided gesture input peripheral for a computing device, and the like.
[0095] As shown, the example computing device 802 includes a processing system 804, one or more computer-readable media 806, and one or more I / O interfaces 808 that are communicatively coupled to each other. Although not shown, the computing device 802 may also include a system bus or other data and command transmission system that couples various components to each other. The system bus may include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and / or a processor or local bus using any one of a variety of bus architectures. A variety of other examples may also be contemplated, such as control and data lines.
[0096] Processing system 804 represents a function for performing one or more operations using hardware. Thus, processing system 804 is shown as including hardware elements 810 that can be configured as processors, functional blocks, etc. This can include other logic devices formed by hardware as a dedicated integrated circuit or using one or more semiconductors. Hardware element 810 is not limited by the material forming it, nor by the processing mechanism adopted therein. For example, a processor can be composed of semiconductors and / or transistors (e.g., electronic integrated circuits (ICs)). In such a context, processor executable instructions can be electronic executable instructions.
[0097] Computer-readable storage media 806 is shown to include a memory / storage unit 812. The memory / storage unit 812 represents a memory / storage capacity associated with one or more computer-readable media. The memory / storage unit 812 may include volatile media (e.g., random access memory (RAM)) and / or non-volatile storage media (e.g., read-only memory (ROM), flash memory, optical disk, magnetic disk, etc.). The memory / storage unit 812 may include fixed media (e.g., RAM, ROM, fixed hard drive, etc.) and removable media (e.g., flash memory, removable hard drive, optical disk, etc.). The computer-readable medium 806 may be configured in a variety of other ways further described below.
[0098] The input / output interface 808 represents functionality that uses various input / output devices to allow a user to input commands and information to the computing device 802, and also allows information to be presented to the user and / or other components or devices. Examples of input devices include: a keyboard, a cursor control device (e.g., a mouse), a microphone, a browser, a touch function (e.g., a capacitive or other sensor configured to detect physical touch), a camera (e.g., which can use visual or non-visual wavelengths such as infrared frequencies to detect activities that do not involve touch, such as gestures), and the like. Examples of output devices include: a display device (e.g., a monitor or projector), a speaker, a printer, a network card, a tactile response device, and the like. Thus, the computing device 802 can be configured in a variety of ways to support user interaction, as further described below.
[0099] The computing device 802 is further illustrated as being communicatively and physically coupled to an input device 814 that is physically and communicatively removable from the computing device 802. In this manner, a variety of different input devices can be coupled to the computing device 802 having a variety of configurations to support a variety of functions. In this example, the input device 814 includes one or more keys 816, which can be configured as pressure-sensitive keys, mechanical switch keys, and the like.
[0100] The input device 814 is further illustrated as including one or more modules 818, which can be configured to support a variety of functions. The one or more modules 818, for example, can be configured to process analog and / or digital signals received from the key 816 to determine whether a keystroke is intended, determine whether the input indicates resting pressure, support authentication of the input device 814 to operate the computing device 802, and so on.
[0101] Various techniques can be described in this article in the general context of software, hardware elements, or program modules. Generally speaking, such modules include routines, programs, objects, elements, components, data structures, etc. that perform specific tasks or realize specific abstract data types. The terms "module", "function", and "component" as used in this article generally represent software, firmware, hardware, or a combination thereof. The feature of the technology described in this article is platform-independent, which means that the technology can be implemented on a variety of commercial computing platforms with a variety of processors.
[0102] An implementation of the described modules and techniques may be stored on or transmitted across some form of computer-readable media. The computer-readable media may include a variety of media that may be accessed by the computing device 802. By way of example and not limitation, computer-readable media may include “computer-readable storage media” and “computer-readable signal media.”
[0103] "Computer-readable storage media" may refer to media and / or devices that enable storage of information, as opposed to just signal transmission, carrier waves, or the signal itself. Computer-readable storage media do not include signal-bearing media, transient signals, or the signal itself. Computer-readable storage media include hardware, such as volatile and non-volatile, removable and non-removable media, and / or storage devices implemented in a method or technology suitable for storing information (e.g., computer-readable instructions, data structures, program modules, logical elements / circuits, or other data). Examples of computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical storage, hard disk, cassette, magnetic tape, disk storage or other magnetic storage device, or other storage device, tangible medium, or article suitable for storing desired information and accessible by a computer.
[0104] "Computer-readable signal media" may refer to signal-bearing media that is configured to send instructions to the hardware of computing device 802, for example, via a network. Computer-readable signal media may typically implement computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, a data signal, or other transport mechanism. Signal media also include any information delivery media. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in a manner that encodes information in the signal. By way of example and not limitation, computer-readable signal media include wired media (e.g., a wired network or a direct wired connection) and wireless media (e.g., acoustic, radio frequency (RF), infrared, and other wireless media).
[0105] As previously mentioned, hardware element 810 and computer readable medium 806 represent instructions, modules, programmable device logic, and / or fixed device logic that can be adopted in some embodiments, implemented in hardware form to realize at least some aspects of the technology described in this article. Hardware elements can include components of integrated circuits or systems on a chip, application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), complex programmable logic devices (CPLDs), and other implementations in silicon or other hardware devices. In this context, hardware elements can serve as processing equipment, which performs program tasks defined by instructions, modules, and / or logic units, which are implemented by hardware elements and hardware devices for storing instructions (e.g., previously described computer readable storage media) for execution.
[0106] The aforementioned combination can also be adopted to realize the various techniques and modules described in this article.Thus, software, hardware or program modules and other program modules can be implemented as one or more instructions and / or logic implemented on a certain form of computer-readable storage medium and / or by one or more hardware elements 810.Computing device 802 can be configured to realize specific instructions and / or functions corresponding to software and / or hardware modules.Thus, the realization of the module that can be executed as software by computing device 802 can be realized at least in part with hardware, such as by the use of computer-readable storage medium and / or hardware elements 810 of processing system.Instructions and / or functions can be performed / operated by one or more products (e.g., one or more computing devices 802 and / or processing system 804) to realize the techniques, modules, and examples described in this article.
[0107] In the discussion herein, various different embodiments are described. It should be understood and appreciated that each embodiment described herein can be used alone or in conjunction with one or more other embodiments described herein. Other aspects of the technology discussed herein relate to one or more of the following embodiments.
[0108] A computing device configured to display an abstracted view of content in an electronic document based on navigation through pages of the electronic document, the computing device comprising: at least one processor; and at least one computer-readable storage medium storing instructions executable by the at least one processor to: obtain authored content from the electronic document; semantically abstract the authored content to provide abstracted content representing the authored content, the abstracted content comprising a plurality of abstracted pages, each of the plurality of abstracted pages representing a different section of the authored content; and navigate through a display of the plurality of abstracted pages of the abstracted content based on user input initiating a search operation for browsing the electronic document.
[0109] In addition to the device described above, any one or combination of the following: wherein the multiple abstracted pages are not added to the authored content in the electronic document, and wherein one or more of the multiple abstracted pages are displayed during the search operation; the device also includes a first display portion and a second display portion physically connected to each other by a hinge, wherein the user input to initiate the search operation includes a change in a hinge angle of the hinge between the first display portion and the second display portion; wherein the instructions are also executable by the at least one processor to control the speed of navigation on the multiple abstracted pages based on the input associated with the movement of the hinge. The device further comprises a first display portion and a second display portion physically connected to each other by a hinge, wherein the instructions are further executable by the at least one processor to change a speed of navigating through the plurality of abstracted pages based on a change in a hinge angle of the hinge between the first display portion and the second display portion; wherein an abstracted page among the plurality of abstracted pages represents a set of authored pages from the electronic document; the device further comprises a first display portion and a second display portion physically connected to each other by a hinge, wherein the user input comprises an input to the plurality of abstracted pages in combination with a change in a hinge angle of the hinge between the first display portion and the second display portion. The device further comprises a first display portion and a second display portion that are physically connected to each other by a hinge, wherein the instructions are further executable by the at least one processor to display a visual representation of the plurality of abstracted pages based on a change in a hinge angle of the hinge between the first display portion and the second display portion, wherein the visual representation is displayed proximate to an edge of at least one of the first display portion and the second display portion; the device further comprises a first display portion and a second display portion that are physically connected to each other by a hinge, wherein the instructions are further executable by the at least one processor to display a visual representation of the plurality of abstracted pages based on a change in a hinge angle of the hinge between the first display portion and the second display portion, wherein the visual representation is displayed proximate to an edge of at least one of the first display portion and the second display portion; the device further comprises a first display portion and a second display portion that are physically connected to each other by a hinge a first display portion and a second display portion physically connected to each other, wherein the instructions are further executable by the at least one processor to display a visual representation of the plurality of abstracted pages based on a change in a hinge angle of the hinge between the first display portion and the second display portion, wherein the visual representation is enabled as a selectable navigational tool for navigating to an authored page in the electronic document corresponding to the selected visual representation; wherein the plurality of abstracted pages are generated based on at least one of: a spatial layout of authored content, one or more visual markers in the authored content, a hierarchy of sections of the authored content, or a user's viewing history of the authored content;wherein the plurality of abstracted pages are generated based on at least one of: behavior of at least one other viewer of the authored content, metadata associated with the authored content, or a search speed of the search operation;
[0110] A method implemented in a computing device, the method for displaying abstracted views of content of an electronic document based on navigation on pages of the electronic document, the method comprising: obtaining content from the electronic document; semantically abstracting the content to provide abstracted views representing the content; receiving an input signal initiating browsing of pages of the electronic document; and navigating on display of one or more of the abstracted views representing the content in response to receiving the input signal.
[0111] In addition to the method described above, any one or combination of the following: the method also includes: measuring a first angle of a hinge connecting two display portions of the computing device; detecting a hinge angle movement that changes the first hinge angle to a second hinge angle; receiving touch input via a touch surface of one of the two display portions; and identifying a combination of the touch input and the hinge angle movement as the input signal for initiating navigation on the display of one or more abstracted views in the abstracted views; and the method also includes controlling the speed of the browsing based on the amount of change from the first hinge angle to the second hinge angle.
[0112] A method for displaying an abstracted view of content based on a change in hinge angles of connected display devices, the method comprising: measuring a first angle of a hinge of two physically connected display devices, the first angle being measured relative to the two display devices; detecting a hinge angle movement that changes the first hinge angle to a second hinge angle; recognizing the hinge movement from the first hinge angle to the second hinge angle as a user input for displaying a different section representing content in an electronic document; and displaying the abstracted view based on the input.
[0113] In addition to the method described above, any one or combination of the following: wherein displaying the abstracted view comprises displaying the abstracted view along an edge of at least one of the display portions of the computing device; the method further comprises semantically abstracting the content in the electronic document to provide the abstracted view of the content for display, receiving touch input to a touch surface of one of the two display devices, and interpreting the combination of the hinge angle movement and the touch input as an input signal for navigating on the display of the abstracted view; the method further comprises controlling a speed of navigating on the abstracted view based on an amount of change from the first hinge angle to the second hinge angle; and wherein displaying the abstracted view comprises displaying at least one abstracted view along an edge of at least one of the display portions of the computing device, wherein the at least one abstracted view is selectable to navigate to display of a section of the content corresponding to the at least one abstracted view.
[0114] in conclusion
[0115] Techniques for navigational assistance for articulated devices via semantic abstraction are described. Although embodiments have been described in language specific to structural features and / or methodological acts, it should be understood that the embodiments defined in the appended claims are not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed embodiments.
Claims
1. A method for displaying an abstracted view of content in an electronic document based on navigation through pages of the electronic document, comprising: Analyzing source content of an electronic document to identify a section of the electronic document being accessed and a plurality of abstracted content portions for the section; receiving user input, the user input comprising interaction with a hinge of the computing device; In response to the receiving of the user input, performing a search operation that automatically browses one or more of the plurality of abstracted content portions of the section of the electronic document based on the interaction with the hinge; and Based on a result of the performance of the search operation, a presentation of the electronic document is updated on a display associated with the computing device to display a content portion of the electronic document.
2. The method according to claim 1, wherein: The user input is a change to a hinge angle of the hinge associated with the computing device.
3. The method according to claim 2, wherein: The user input indicates a speed of the search operation based on an amount of change detected for the hinge angle.
4. The method according to claim 1, further comprising: receiving a second user input interrupting the search operation; And wherein the updating of the presentation stops browsing of the electronic document at a particular point in the source content based on the second user input interrupting the search operation.
5. The method according to claim 1, wherein: The user input includes two or more movements of the hinge of the computing device, and wherein a predetermined number of content portions of the electronic document are searched based on receipt of the two or more movements of the hinge.
6. The method according to claim 1, wherein: The analyzing of the source content of the electronic document further includes identifying a plurality of sections of the electronic document and an abstracted content portion for each of the plurality of sections, and wherein the performing of the search operation browses the plurality of abstracted content portions of the sections to reach a second section of the electronic document.
7. The method according to claim 1, wherein: The user input comprises a touch input occurring simultaneously with the interaction with the hinge.
8. A system for displaying an abstracted view of content in an electronic document based on navigation through pages of the electronic document, comprising: at least one processor; as well as a memory operatively connected to the at least one processor, the memory storing computer executable instructions that, when executed by the at least one processor, cause the at least one processor to perform a method comprising: Analyzing source content of an electronic document to identify a section of the electronic document being accessed and a plurality of abstracted content portions for the section; receiving user input, the user input comprising interaction with a hinge of the system; In response to the receiving of the user input, performing a search operation that automatically browses one or more of the plurality of abstracted content portions of the section of the electronic document based on the interaction with the hinge; and Based on a result of the performance of the search operation, a presentation of the electronic document is updated on a display associated with the system to display a content portion of the electronic document.
9. The system according to claim 8, wherein: The user input is a change to a hinge angle of the hinge associated with the system.
10. The system according to claim 9, wherein: The user input indicates a speed of the search operation based on an amount of change detected for the hinge angle.
11. The system according to claim 8, wherein: The content includes a plurality of pages, and wherein the search operation searches two or more of the plurality of pages based on the search operation performed.
12. The system according to claim 8, wherein: The method performed by the at least one processor further includes receiving a second user input that interrupts the search operation; and wherein the updating of the presentation stops browsing of the electronic document at a particular point in the source content based on the second user input that interrupts the search operation.
13. The system according to claim 8, wherein: The user input includes two or more movements of the hinge, and wherein a predetermined number of content portions of the electronic document are searched based on receipt of the two or more movements of the hinge.
14. The system according to claim 8, wherein: The analyzing of the source content of the electronic document further includes identifying a plurality of sections of the electronic document and an abstracted content portion for each of the plurality of sections, and wherein the performing of the search operation browses the plurality of abstracted content portions of the sections to reach a second section of the electronic document.
15. A method for displaying an abstracted view of content in an electronic document based on navigation through pages of the electronic document, comprising: Analyzing source content of an electronic document to identify a section of the electronic document being accessed and a plurality of abstracted content portions for the section; receiving user input, the user input comprising an adjustment to a hinge of the computing device; In response to the receiving of the user input, performing a search operation that automatically browses one or more of the plurality of abstracted content portions of the section of the electronic document based on the adjustment of the hinge; and Based on a result of the performance of the search operation, a presentation of the electronic document is updated on a display associated with the computing device to display a content portion of the electronic document.
16. The method according to claim 15, wherein: The user input is a change to a hinge angle of the hinge associated with the computing device.
17. The method according to claim 15, wherein: The user input indicates a speed of the search operation based on an amount of change detected for the hinge angle.
18. The method according to claim 15, wherein: The performed method further includes receiving a second user input interrupting the search operation; and wherein the updating of the presentation stops browsing of the electronic document at a particular point in the source content based on the second user input interrupting the search operation.
19. The method according to claim 15, wherein: The user input includes two or more movements of the hinge of the computing device, and wherein a predetermined number of content portions of the electronic document are searched based on receipt of the two or more movements of the hinge.
20. The method according to claim 15, wherein: The analyzing of the source content of the electronic document further includes identifying a plurality of sections of the electronic document and an abstracted content portion for each of the plurality of sections, and wherein the performing of the search operation browses the plurality of abstracted content portions of the sections to reach a second section of the electronic document.
Citation Information
Patent Citations
User terminal device and displaying method thereof
CN105980955A
Display control apparatus, display method, and computer product
US20070085845A1