Annotation display method and display terminal

Abstract

To provide a display method and a display terminal capable of displaying an ink annotation according to an input operation by a user.SOLUTION: A terminal capable of displaying an electronic book executes the steps of: acquiring a book identifier that identifies the electronic book; obtaining an ink annotation associated with the book identifier and including operation identification data for identifying a type of input operation by a user; and displaying the ink annotation to which a drawing effect corresponding to a value of the operation identification data is applied in conjunction with displaying the electronic book.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The present invention relates to a method and a terminal for displaying annotations made to an electronic book, in particular ink annotations input using a pen. [Background technology]

[0002] Digital ink generated by an electronic pen is data used to reproduce the trajectory of the electronic pen, just as a conventional pen leaves handwriting on paper. Patent Document 1 discloses an example of digital ink based on object-oriented programming as an internal computer data model, and Patent Document 2 discloses an example of a serialization format for digital ink.

[0003] Furthermore, digital ink data that goes beyond the scope of data for simply reproducing handwriting and can record "when, who, where, and under what circumstances" something was written as a trace of human behavior is known. For example, Patent Document 3 discloses digital ink that makes it possible to identify who wrote stroke data that shows a trace, and Patent Document 4 discloses digital ink that acquires information such as the author, pen ID, time information, and area information acquired by a Global Positioning System (GPS) as context data when stroke data is input, and can record this information as metadata.

[0004] Incidentally, there are known electronic book terminals that can add annotations, such as highlighting portions of text included in an electronic book or adding text associated with the highlighted portions. Patent Document 1 discloses a system that allows annotations such as highlights and text added to an electronic book to be shared among members of a book group. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] U.S. Patent No. 07158675 [Patent Document 2] U.S. Patent No. 07397949 [Patent Document 3] Patent No. 5886487 [Patent Document 4] U.S. Patent No. 09251130 Summary of the Invention [Problem to be solved by the invention]

[0006] In the case of annotations made by hand with a pen (hereinafter referred to as "ink annotations"), rather than annotations inputted as text, the ink annotations themselves have a certain creative value. In other words, it is desirable to separate ink annotations from the e-book management system so that they can be shared with users who have different e-book suppliers or who do not own e-books.

[0007] Furthermore, e-books are displayed in different columns depending on the display settings of the device, such as the display resolution and font size. Even between e-book devices with different display settings, it is desirable to be able to share ink annotations in a manner that allows users to recognize that the highlights were handwritten with a pen, if the annotations are highlights. It is also desirable to be able to share ink annotations in a manner that allows users to recognize the copyrighted work, if the annotations are handwritten pictures (i.e., stroke data), regardless of the display settings or pen support type of the e-book device. [Means for solving the problem]

[0008] The ink annotation sharing method of the first invention is a method executed in a system, the system including a first terminal operated by a first user, a second terminal operated by a second user, and an ink annotation sharing system, the ink annotation including a group of stroke data indicating an annotation for an e-book and metadata corresponding to the group of stroke data, the metadata including a user identifier that identifies the user, a book identifier that identifies the e-book, and location data that indicates the location of the annotation, the first terminal executing a sending step of sending the ink annotation generated by operation of the first user to the sharing system, and the sharing system executing an identifying step of identifying a second user who is a member of a group related to the e-book formed by the first user based on the values ​​of the user identifier and the book identifier included in the ink annotation, and a supply step of supplying the ink annotation to the second terminal operated by the second user.

[0009] The system of the second invention includes a first terminal operated by a first user, a second terminal operated by a second user, and an ink annotation sharing system, wherein the ink annotation includes a group of stroke data indicating an annotation for an e-book and metadata corresponding to the group of stroke data, and the metadata includes a user identifier that identifies the user, a book identifier that identifies the e-book, and location data that indicates the location of the annotation, and the first terminal performs a sending step of sending the ink annotation generated by operation of the first user to the sharing system, and the sharing system performs an identifying step of identifying a second user who is a member of a group related to the e-book formed by the first user based on the values ​​of the user identifier and the book identifier included in the ink annotation, and a supply step of supplying the ink annotation to the second terminal operated by the second user.

[0010] The ink annotation sharing method of the third invention is a method for sharing ink annotations input using an e-book terminal, the e-book terminal including a display device capable of displaying e-books, a touch sensor for detecting a finger, a pen sensor for detecting a pen, and integrated circuits respectively connected to the touch sensor and the pen sensor, and the integrated circuit executes the following steps: a display step for displaying text that is part of the e-book using the display device; a detection step for detecting an operation that identifies the location of an annotation in the text using the touch sensor and the pen sensor; a determination step for determining which of the touch sensor or the pen sensor detected the operation; and an output step for outputting location data indicating the location of the annotation in a manner that allows the result of the determination to be identified.

[0011] A fourth system of the present invention is a system that uses an e-book terminal, which includes a display device capable of displaying e-books, a touch sensor that detects a finger, a pen sensor that detects a pen, and integrated circuits that are respectively connected to the touch sensor and the pen sensor, and the integrated circuit executes the following steps: a display step in which the display device is used to display text that is part of the e-book; a detection step in which the touch sensor and the pen sensor are used to detect an operation that identifies an annotation location in the text; a determination step in which it is determined whether the touch sensor or the pen sensor detected the operation; and an output step in which location data indicating the annotation location is output in a manner that allows the result of the determination to be identified. [Effects of the Invention]

[0012] According to the first and second aspects of the present invention, handwritten ink annotations can be shared among people who have purchased the same e-book title, even if the e-book is supplied by multiple different sources, or ink annotations including artistic handwritten figures can be shared with users who have not purchased the e-book.

[0013] According to the third and fourth aspects of the present invention, when the operation of identifying the annotation location is performed using a pen, the person who receives the annotation can determine that the annotation, such as highlighting, was entered using a handwritten pen. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is a schematic diagram of a system for sharing ink annotations. [Figure 2] 10 is a flowchart relating to the operation of the electronic book terminal. [Figure 3A] 1A and 1B are diagrams showing an electronic book terminal and a display state of annotations on the terminal. [Figure 3B] 1A and 1B are diagrams showing an electronic book terminal and a display state of annotations on the terminal. [Figure 4A] 10A and 10B are diagrams showing the display state of annotations on an electronic book terminal and a terminal. [Figure 4B] 10A and 10B are diagrams showing the display state of annotations on an electronic book reader and a terminal. [Figure 5] FIG. 10 is a diagram showing UI components related to the supply of ink annotations. [Figure 6] FIG. 1 is a diagram showing the data structure of ink annotations in accordance with a digital ink format. [Figure 7] 1 is a flowchart illustrating a method for sharing ink annotations performed in a sharing system. [Figure 8] 10 is a flowchart illustrating a method for displaying ink annotations. [Figure 9] 9A to 9C are diagrams showing ink annotations displayed on the terminal through the flowchart of FIG. 8. [Figure 10] 10A and 10B are diagrams illustrating examples of first and second drawing effects. DETAILED DESCRIPTION OF THE INVENTION

[0015] The ink annotation sharing method and system of the present invention will be described with reference to the accompanying drawings. To facilitate understanding of the description, the same components and steps in each drawing are denoted by the same reference numerals whenever possible, and redundant description may be omitted. The present invention is not limited to the following embodiments, and can be freely modified without departing from the spirit of the present invention. Alternatively, each configuration may be arbitrarily combined within the scope of no technical contradiction.

[0016] <Description of the embodiment> 1 is a schematic diagram of a system for sharing ink annotations. This system includes a first terminal (hereinafter also referred to as "electronic book terminal 101"), a second terminal (hereinafter also simply referred to as "terminals 201, 202"), and an ink annotation sharing system 300.

[0017] The electronic book terminal 101 includes a display device (not shown), a touch sensor for detecting a finger, a pen sensor for detecting a pen, and an integrated circuit for controlling these. The electronic book terminal 101 is operated by a first user u1 who subscribes to the first electronic book service 100.

[0018] Terminal 201 is configured to include the display device, touch sensor, and integrated circuit described above, but does not have a pen sensor. Terminal 201 is operated by second user u2 who subscribes to second e-book service 200. Terminal 201 also has display settings that are different from those of e-book terminal 101. These "display settings" include, for example, display resolution and display area (font size, column layout, etc.).

[0019] The terminal 202 is a general-purpose display terminal not specialized for e-books, such as a smartphone. The terminal 202 is operated by a third user u3, who is separate from the users u1 and u2 who own the e-books. The user u3 is a member of a group (g1) in the service provided by the ink annotation sharing system 300, but does not own the e-book.

[0020] The sharing system 300 is a system realized by computers that are distributed or aggregated over a network. This sharing system 300 executes an ink annotation sharing method shown in Fig. 7, which will be described later, to share a handwritten annotation A made by a first user u1 on an electronic book (e-Book #1) with a second user u2 or a third user u3, who are members of a group to which the first user u1 belongs. In other words, a group is made up of a pair of an electronic book and a user, and is managed by a system that operates an ink annotation supply service independent of the electronic book supplier.

[0021] FIG. 2 is a flowchart relating to the operation of the electronic book terminal 101.

[0022] In step S201, the electronic book terminal 101 acquires an electronic book whose book identifier BID has a value of “b1.” The book identifier BID is, for example, an ISBN (International Standard Book Number).

[0023] In step S203, the electronic book terminal 101 displays the display text dt according to the display settings in accordance with a predetermined display position (user's viewing position) of the electronic book e-Book#1. 3A and 4A show an example of the display text dt displayed on the electronic book terminal 101.

[0024] In step S205, the e-book terminal 101 determines whether or not an operation S for annotating the display text dt has been performed. If the operation S for annotating has been detected (YES in S205), in step S207, the e-book terminal 101 generates location data indicating the annotated location P. There are various methods for identifying the location P. If the e-book has an XML (eXtensible Markup Language) structure that conforms to a predetermined book format, a method may be used in which the chapter or section is identified by the position of a tag having a value corresponding to the paragraph position indicating the relevant location P within the entire e-book, and the start and end character positions of the section are identified. Furthermore, if page numbers and the like are fixed and distributed, a method may be used in which the location P is identified by the page number or coordinates within the page.

[0025] In step S209, the electronic book terminal 101 determines whether the operation S for identifying the position P has been performed by a pen sensor. If the operation S has been performed by a touch sensor or the like, the electronic book terminal 101 sets "non-pen (non-handwritten)" to the operation identification data ST (step S211). Conversely, if the operation S has been performed by a pen sensor, the electronic book terminal 101 sets "pen (handwritten or ink)" to the operation identification data ST (step S213).

[0026] 3A, 3B, and 10 (row E1) show the display states of the e-book terminal 101 and the terminal 201 when operation S is performed using a sensor other than a pen sensor (e.g., a touch sensor). FIG. 3A shows, as an example, a state in which "DEF...UVW" is specified as annotation location P using a finger. Because a finger has a larger contact area and diameter with the panel than a pen, it is difficult to specify the precise position of each character that makes up the text. Therefore, the e-book terminal 101 performs annotation A1 by applying a first drawing effect E1 using highlighting (or underlining) a line segment at the specified location, as shown in the figure, along the arrangement direction of the text characters (the direction of arrow d in FIG. 10), which is a less human-like effect.

[0027] In contrast, FIGS. 4A, 4B, and 10 (row E2) show the display states of the e-book terminal 101 and the terminal 201, respectively, when operation S is performed using a pen sensor. Because the diameter of a pen is smaller than that of a finger, it is possible to specify the precise position of a character. For example, it is possible to perform precise operations such as underlining, enclosing, or double-underlining a character. As shown in FIG. 4A, on the e-book terminal 101 side, an annotation A1 is applied by highlighting, underlining, or enclosing along the text direction at the position specified by the pen. In other words, the annotation A1 is applied faithfully to the operation S by the first user u1. However, as shown in FIG. 4B, on the terminal 201 side with different display settings, if the coordinate data set on the e-book terminal 101 is used as is, the highlighting annotation A1 is applied at a different position from the intended position due to differences in the column layout.

[0028] Therefore, in step S213, the electronic book terminal 101 generates an ink annotation IA by setting the value of the operation identification data ST to indicate that the annotation was made by hand at that position (pen) along with the annotation location P, without including the coordinate data group of the pen used for operation S. For example, the electronic book terminal 101 transmits the generated ink annotation IA in response to a contact with the "SHARE" component 503 in Fig. 5 (step S217).

[0029] Prior to executing step S217, the e-book terminal 101 may determine, in step S215, whether a condition for activating a handwriting area is met. This determination is made in order to accept a request to input additional handwritten annotation data into a portion P that has been annotated, such as highlighted. For example, the e-book terminal 101 may display the UI widget 50 of FIG. 5 and activate a "SELECT" component 501 used to copy or cut the identified portion P, and a UI widget 502 that further accepts an input of whether to "write by hand." The right side of FIG. 5 shows an example of a handwriting input window 504 that the e-book terminal 101 displays in step S219 when the first user u1 selects "write by hand" using the UI widget 50.

[0030] Returning to Fig. 2, in step S221, the electronic book terminal 101 outputs the pen coordinate data group sd input in the handwriting input window 504, together with the annotation location P and the operation identification data ST. Unlike the annotation A1 used for highlighting, the pen coordinate data group sd is not related to the column layout, and is data in which the coordinates within this coordinate system are meaningful. Therefore, unlike the specific operation of the location P where the annotation A1 was applied, this time it is necessary to share the pen coordinate group itself (or the raster data generated thereby).

[0031] To reiterate, in both steps S221 and S217, the annotated location P is transmitted, but the output does not include the pen coordinate group acquired during the pen operation to identify this location P. This makes it possible to reduce the amount of data for the ink annotation IA.

[0032] While the handwriting input window 504 is open, the coordinate data group sd entered in the handwriting input window 504 may be sent as is, or may be converted into a digital ink format as disclosed in U.S. Patent Publication No. 2016 / 0292500 and then sent.

[0033] FIG. 6 is a data structure diagram of an ink annotation IA in accordance with the digital ink format. Digital ink represents the trajectory of a series of sliding operations from pen-down to pen-up as a single stroke data (path data), and a collection of these is stored as a stroke data group SD. It is also possible to assign metadata MD to these stroke data groups SD. This metadata MD includes the user identifier UID, book identifier BID, and location P, in addition to identifying the author who handwritten the annotation A2 as the first user u1. Note that when the handwriting input window 504 is opened, the metadata MD does not need to include operation identification data ST, because it is possible to determine from the data that the annotation is handwritten.

[0034] FIG. 7 is a flowchart illustrating a method for sharing ink annotations IA executed in the sharing system 300.

[0035] In step S701, the sharing system 300 acquires an ink annotation IA composed of digital ink from the e-book terminal 101 operated by the first user u1. Next, in step S703, the sharing system 300 identifies the second user u2 and the third user u3 who are members of the e-book group in the example of Figure 1, based on the values ​​of the user identifier UID and the book identifier BID included in the ink annotation IA. Finally, in step S705, the sharing system 300 supplies the ink annotation IA to the terminals 201 and 202 operated by each member.

[0036] The above-described operation allows handwritten ink annotations IA to be shared among people who have purchased the same e-book title, even if the e-book is supplied by multiple different e-book suppliers, or allows ink annotations IA containing artistic handwritten figures to be shared with users who have not purchased the e-book.

[0037] Fig. 8 is a flowchart relating to a method for displaying ink annotation IA. Fig. 9 is a diagram showing ink annotation IA displayed on terminal 201 through the flowchart of Fig. 8.

[0038] In step S801, the terminal 201 acquires an electronic book. Here, it is assumed that "e-Book #1" corresponding to the value "b1" of the book identifier BID has been acquired. In step S803, the terminal 201 displays the display text dt according to the reading position of the user u2. Due to differences in display settings and differences in the reading position for each user, the display text dt2 of the second user u2 is not usually displayed in the same way as the display text dt1 of the first user u1 (see FIGS. 4A and 4B).

[0039] In step S805, the terminal 201 acquires the ink annotation IA. In step S807, if the ink annotation IA contains operation identification data ST whose value is "non-pen," the terminal 201 highlights the location P with the first drawing effect E1 (step S809). As described in FIGS. 3A and 3B, this first drawing effect E1 corresponds to applying a highlight, underline, or box that is uniformly aligned along the arrangement direction of the text characters (direction d in FIG. 10).

[0040] On the other hand, if the ink annotation IA contains operation identification data ST with a value of "pen" in step S807, the terminal 201 highlights the location P with the second drawing effect E2 (step S811). As shown in Fig. 10, the second drawing effect E2 is an effect of applying a randomly non-uniform highlight E21a, E21b, underline E22, or encircling line E23 to the text portion corresponding to the location P, the highlight E21a, E21b, underline E22, or encircling line E23 having at least a component that intersects at an angle of less than 90 degrees with the text character arrangement direction (d direction) so as not to be completely aligned with the character arrangement direction (d direction).

[0041] The non-uniformity of the second drawing effect E2 may be generated according to a trained model that has been trained using, for example, the shaking and trembling that occurs when a person draws a straight line as training data (learning data). Alternatively, the non-uniformity may be adjusted to match the display of the point P using a calculation that simulates 1 / f fluctuations, such as an intermittent chaos method. The display using this second drawing effect E2 adds a highlight annotation A1 even when the display is in a different column layout, so the second user u2 can easily see that handwritten input with a pen has been made at this point P.

[0042] In step S813, the terminal 201 determines whether a predetermined operation S has been performed at the location P where the second drawing effect E2 has been applied, and if an operation such as a touch has been performed (YES in S813), the terminal 201 acquires image data indicated by the stroke data group SD included in the ink annotation IA (step S815) and displays this as annotation A2 at a position surrounding the corresponding location P, as shown on the right side of Figure 9 (step S817).

[0043] In this way, when the operation S to identify the annotation location P is performed with a pen, the person who receives the shared annotation can determine that the annotation, such as highlighting, was entered with a handwritten pen. Note that by reproducing the trembling and fluctuation that occurs when a human draws a straight line as the unevenness of the second drawing effect E2, it is possible to display annotations for the same location P in a natural, human-like manner, based on a so-called "soft UI," even if the display is in different columns or fonts.

[0044] <Summary of the embodiment> 1 includes an e-book terminal 101 (first terminal) operated by a first user u1, terminals 201 and 202 (second terminals) operated by second and third users u2 and u3, and an ink annotation IA sharing system 300. The ink annotation IA includes a stroke data group SD indicating an annotation for an e-book and metadata MD corresponding to the stroke data group SD, and the metadata MD includes a user identifier UID that identifies the user, a book identifier BID that identifies the e-book, and location data that indicates a location P of the annotation.

[0045] Then, the e-book terminal 101 executes a sending step (S701) of sending the ink annotation IA generated by the operation of user u1 to the sharing system 300, and the sharing system 300 executes an identification step (S703) of identifying the members (users u2, u3) of the group related to the e-book formed by user u1 based on the values ​​of the user identifier UID and book identifier BID included in the ink annotation IA, and a supply step (S705) of supplying the ink annotation IA to the terminals 201, 202 operated by users u2, u3.

[0046] Furthermore, users u2 and u3 may be users who obtain e-books from different sources than the first user u1 or who have not obtained e-books, but may be members of a group registered in the sharing system 300. The book identifier BID may be an ISBN. In the supply step (S705), the ink annotation IA may be converted into a digital ink format and transmitted to the sharing system 300.

[0047] 1 includes a display device capable of displaying an e-book, a touch sensor for detecting a finger, a pen sensor for detecting a pen, and integrated circuits connected to the touch sensor and the pen sensor. The integrated circuit executes a display step (S203) of displaying text dt, which is a part of the e-book, using the display device, a detection step (S205) of detecting an operation S for specifying an annotation position P for the text dt using the touch sensor and the pen sensor, a determination step (S209) of determining which of the touch sensor or the pen sensor detected the operation S, and an output step (S217, S221) of outputting position data indicating the annotation position P in a manner that enables the determination result to be identified.

[0048] Furthermore, in the output steps (S217, S221), the location data may be output with operation identification data ST added thereto for identifying the result of the determination. Furthermore, the annotation may be displayed with a first drawing effect E1 applied when the operation identification data ST is a value indicating that the touch sensor has detected an operation S, and may be displayed with a second drawing effect E2 different from the first drawing effect E1 applied when the operation identification data ST is a value indicating that the pen sensor has detected an operation S. Furthermore, the second drawing effect E2 may be an effect of applying highlighting, underlining, or surrounding lines to a location P of the annotation corresponding to the location data, the effect being non-uniformed so as to include a fluctuation component in a direction perpendicular to the arrangement direction (direction d) of the text characters. Furthermore, the non-uniformization may be performed by applying a fluctuation component according to a trained model constructed through machine learning of patterns of straight lines handwritten by humans.

[0049] Furthermore, when a specific operation S is detected by the pen sensor, the e-book terminal 101 may further execute a start-up step (S219) of starting a handwriting input window 504 that allows handwriting input. The ink annotation IA includes a stroke data group SD indicating an annotation made by handwriting input in the handwriting input window 504, and metadata MD corresponding to the stroke data group SD, and the metadata MD includes location data and operation identification data ST. In an output step (S221), the ink annotation IA may be converted into a digital ink format and transmitted to the outside.

[0050] <Explanation of symbols> 101: E-book terminal (first terminal), 201, 202: Terminal (second terminal), 300: Sharing system, A1, A2: Annotation, E1: First drawing effect, E2: Second drawing effect, IA: Ink annotation

Claims

1. An annotation display method for displaying annotations input using a terminal that has a pen sensor for detecting a pen and is capable of displaying an electronic book, comprising: The terminal obtaining a book identifier that identifies the electronic book; acquiring annotation data linked to the book identifier and including at least operation identification data for identifying whether the operation detected by the pen sensor is a handwriting operation of the pen; displaying the annotation to which a drawing effect corresponding to the value of the operation identification data has been added together with the display of the electronic book; Run The drawing effect is a first drawing effect that is applied when the operation identification data has a value that indicates that the operation is not a handwriting operation; a second drawing effect that is applied when the operation identification data has a value that indicates the handwriting operation; the first drawing effect is to highlight, underline, or encircle the annotation in a uniform manner along an arrangement direction of text characters constituting the electronic book; the second drawing effect is to apply a non-uniform highlight, underline, or outline to the location of the annotation so as to include a fluctuation component in a direction perpendicular to an arrangement direction of text characters constituting the electronic book; An annotation display method in which the non-uniformization is performed by adding the fluctuation component according to a trained model constructed through machine learning on patterns of straight lines handwritten by humans.

2. An annotation display method for displaying annotations input using a terminal that has a pen sensor for detecting a pen and is capable of displaying an electronic book, comprising: The terminal obtaining a book identifier that identifies the electronic book; acquiring annotation data linked to the book identifier and including at least operation identification data for identifying whether the operation detected by the pen sensor is a handwriting operation of the pen; displaying the annotation to which a drawing effect corresponding to the value of the operation identification data has been added together with the display of the electronic book; Run The drawing effect is a first drawing effect that is applied when the operation identification data has a value that indicates that the operation is not a handwriting operation; a second drawing effect that is applied when the operation identification data has a value that indicates the handwriting operation; the first drawing effect is to highlight, underline, or encircle the annotation in a uniform manner along an arrangement direction of text characters constituting the electronic book; the second drawing effect is to apply a non-uniform highlight, underline, or outline to the location of the annotation so as to include a fluctuation component in a direction perpendicular to an arrangement direction of text characters constituting the electronic book; The annotation display method, wherein the non-uniformization is performed by adding the fluctuation component using an intermittent chaos method.

3. An annotation display method for displaying annotations input using a terminal that has a pen sensor for detecting a pen and is capable of displaying an electronic book, comprising: The terminal obtaining a book identifier that identifies the electronic book; acquiring annotation data linked to the book identifier and including at least operation identification data for identifying whether the operation detected by the pen sensor is a handwriting operation of the pen; displaying the annotation to which a drawing effect corresponding to the value of the operation identification data has been added together with the display of the electronic book; Run The drawing effect is a first drawing effect that is applied when the operation identification data has a value that indicates that the operation is not a handwriting operation; a second drawing effect that is applied when the operation identification data has a value that indicates the handwriting operation; the first drawing effect is to highlight, underline, or encircle the annotation in a uniform manner along an arrangement direction of text characters constituting the electronic book; the second drawing effect is to apply a non-uniform highlight, underline, or outline to the location of the annotation so as to include a fluctuation component in a direction perpendicular to an arrangement direction of text characters constituting the electronic book; the terminal further executes a step of, when an operation is performed to designate a location to which the second drawing effect has been applied, displaying an image indicated by a group of stroke data included in the annotation data at a position surrounding the location.

4. The electronic book is displayed in accordance with the display settings of the device. The annotation display method according to any one of claims 1 to 3.

5. A display terminal having a pen sensor for detecting a pen and displaying annotations together with an electronic book, obtaining a book identifier that identifies the electronic book; acquiring annotation data linked to the book identifier and including at least operation identification data for identifying whether the operation detected by the pen sensor is a handwriting operation of the pen; displaying the annotation to which a drawing effect corresponding to the value of the operation identification data has been added together with the display of the electronic book; Run The drawing effect is a first drawing effect that is applied when the operation identification data has a value that indicates that the operation is not a handwriting operation; a second drawing effect that is applied when the operation identification data has a value that indicates the handwriting operation; the first drawing effect is to highlight, underline, or encircle the annotation in a uniform manner along an arrangement direction of text characters constituting the electronic book; the second drawing effect is to apply a non-uniform highlight, underline, or outline to the location of the annotation so as to include a fluctuation component in a direction perpendicular to an arrangement direction of text characters constituting the electronic book; A display terminal in which the non-uniformization is performed by adding the fluctuation component according to a trained model constructed through machine learning of straight line handwritten patterns by humans.

6. A display terminal having a pen sensor for detecting a pen and displaying annotations together with an electronic book, obtaining a book identifier that identifies the electronic book; acquiring annotation data linked to the book identifier and including at least operation identification data for identifying whether the operation detected by the pen sensor is a handwriting operation of the pen; displaying the annotation to which a drawing effect corresponding to the value of the operation identification data has been added together with the display of the electronic book; Run The drawing effect is a first drawing effect that is applied when the operation identification data has a value that indicates that the operation is not a handwriting operation; a second drawing effect that is applied when the operation identification data has a value that indicates the handwriting operation; the first drawing effect is to highlight, underline, or encircle the annotation in a uniform manner along an arrangement direction of text characters constituting the electronic book; the second drawing effect is to apply a non-uniform highlight, underline, or outline to the location of the annotation so as to include a fluctuation component in a direction perpendicular to an arrangement direction of text characters constituting the electronic book; A display terminal in which the non-uniformization is performed by adding the fluctuation component using an intermittent chaos method.

7. A display terminal having a pen sensor for detecting a pen and displaying annotations together with an electronic book, obtaining a book identifier that identifies the electronic book; acquiring annotation data linked to the book identifier and including at least operation identification data for identifying whether the operation detected by the pen sensor is a handwriting operation of the pen; displaying the annotation to which a drawing effect corresponding to the value of the operation identification data has been added together with the display of the electronic book; Run The drawing effect is a first drawing effect that is applied when the operation identification data has a value that indicates that the operation is not a handwriting operation; a second drawing effect that is applied when the operation identification data has a value that indicates the handwriting operation; the first drawing effect is to highlight, underline, or encircle the annotation in a uniform manner along an arrangement direction of text characters constituting the electronic book; the second drawing effect is to apply a non-uniform highlight, underline, or outline to the location of the annotation so as to include a fluctuation component in a direction perpendicular to an arrangement direction of text characters constituting the electronic book; the display terminal further executes, when an operation is performed to designate a location to which the second drawing effect has been applied, a step of displaying an image indicated by a group of stroke data included in the annotation data at a position surrounding the location.

8. The display of the electronic book is performed according to a display setting. The display terminal according to any one of claims 5 to 7.

Images