Electronic device, display control method, and program

Abstract

To improve the freedom of choice when using a writing pen. [Solution] The electronic device according to the embodiment comprises a display unit, a determination unit, and a display control unit. The determination unit determines whether the range of handwritten data and the range of masked data among the written data displayed on the display unit overlap by a threshold or more, and determines the writing time of the handwritten data and masked data that are determined to overlap by a predetermined value or more. Based on the writing time of the handwritten data and the writing time of the masked data, the display control unit controls the display unit to display a second display mode in which the display color of the masked data in the first display mode is changed from a first display mode in which written data is created by handwritten input.

Description

Technical Field

[0003]

[0001] Embodiments of the present invention relate to an electronic device, a display control method, and a program.

Background Art

[0002] In recent years, in electronic devices such as electronic paper, a pen input function that realizes an input operation of handwritten characters using a pen-type input device (hereinafter referred to as an electronic pen) may be installed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] For example, an electronic device can input by changing the writing format such as a handwriting pen or a green marker pen. Further, the electronic device has a function of hiding the text portion traced with a green marker pen in black when the display mode is switched by tracing the portion of the text to be hidden with a green marker pen.

[0005] However, for example, not only the portion traced with a green marker pen but also all the portions written with a green marker pen may turn black. Therefore, the usage of the green marker pen by the user is limited.

[0006] One of the problems of the present invention has been made in view of the above, and is to improve the freedom of the pen for writing. <000003​​​​​An electronic device according to a first aspect of the present invention comprises a display unit, a determination unit, and a display control unit. The determination unit determines whether the range of handwritten data and the range of masked data among the written data displayed on the display unit overlap by a threshold or more, and determines the writing times of the handwritten data and masked data if it is determined that they overlap by a predetermined value or more. Based on the writing times of the handwritten data and the writing times of the masked data, the display control unit controls the display unit to change the display color of the masked data and display a second display mode in which the display color of the masked data in the first display mode is changed, from a first display mode in which written data is created by handwritten input.

[0008] A display control method according to a second aspect of the present invention determines whether the range of handwritten data and the range of masked data among the written data displayed on the display unit overlap by a threshold or more, determines the writing time of the handwritten data and masked data that are determined to overlap by a predetermined value or more, and controls the display unit to change the display color of the masked data and change the display color of the masked data to display a second display mode in which the display color of the masked data in the first display mode is changed, from a first display mode in which written data is created by handwritten input.

[0009] A program according to a third aspect of the present invention causes a computer to perform the following actions: determine whether the range of handwritten data and the range of masked data among the written data displayed on the display unit overlap by a threshold or more; determine the writing time of the handwritten data and masked data that are determined to overlap by a predetermined value or more; and control the display unit to display a second display mode in which the display color of the masked data in the first display mode is changed, from a first display mode in which written data is created by handwritten input. [Effects of the Invention]

[0010] According to the above embodiment of the present invention, it is possible to determine if mask data overlaps with handwritten data by a predetermined value or more, and to change the display color of the corresponding mask data based on the time of writing with the handwritten data. Therefore, the degree of freedom of the writing pen can be improved. [Brief explanation of the drawing]

[0011] [Figure 1] Figure 1 shows an example of the appearance of the system according to the embodiment. [Figure 2] Figure 2 shows an example of the configuration of an electronic device according to the embodiment. [Figure 3] Figure 3 shows an example of the display during mode switching according to the embodiment. [Figure 4] Figure 4 shows an example of determining duplicate data in the written data according to the embodiment. [Figure 5] Figure 5 shows an example of determining the writing time of written data according to the embodiment. [Figure 6] Figure 6 shows an example of the flow of display control by an electronic device according to the embodiment. [Modes for carrying out the invention]

[0012] Illustrative embodiments of the present invention are disclosed below. The configurations of the embodiments shown below, as well as the functions, results, and effects brought about by such configurations, are examples only. The present invention can also be realized by other configurations disclosed in the following embodiments, and it is possible to obtain at least one of the various effects and derived effects based on the basic configuration.

[0013] Figure 1 shows an example of the appearance of system 5 according to an embodiment. As shown in Figure 1, system 5 includes an electronic device 1 and an electronic pen 3.

[0014] The electronic device 1 may be various information processing devices such as a smartphone, a tablet terminal, a mobile phone, an electronic paper, a PC (Personal Computer), etc. In the present embodiment, as shown in FIG. 1, as the electronic device 1, a so-called "electronic paper", which is an information processing device that can be replaced with paper documents, is exemplified. This "electronic paper" is a portable tablet terminal that can maintain a state where the screen is displayed while keeping power consumption low.

[0015] Also, the electronic device 1 can create and edit contents such as electronic document files on its own terminal. Here, the content is, for example, a PDF-formatted electronic document file, but it may be an electronic document file in other formats, or other data such as an image or a video in an electronic document file.

[0016] Note that the editing of the content in the electronic device 1 includes a process of associating and storing the written data written in the content with the content. For example, the editing of the content may be a process of storing the written data 2 (see FIG. 3) written on the page of the electronic document file in association with the written page.

[0017] Note that the written data 2 is data representing a line, a character, or an illustration input with a selected pen when the type and thickness of the pen, the color of the electronic ink, etc. are selected. The written data 2 may be newly written data, or may be written on top of the already written data (updated).

[0018] The written data 2 is written in the content using a fingertip (living body) or an electronic pen 3. Also, the written data 2 is, for example, data in an image format, but it may be data in other formats such as a text format.

[0019] The electronic device 1 has a display 12 and an EMR (Electromagnetic Induction Transmission / Reception) (registered trademark) sensor 14. The electronic device 1 detects the movement of the tip 31 of the electronic pen 3 with respect to the display 12 by the EMR sensor 14. The electronic device 1 is configured to be able to generate writing data 2 by writing on the content by detecting the movement of the tip 31.

[0020] On the side surface or the like of the housing 110 of the electronic device 1, switches for realizing various functions such as a power switch and volume adjustment (not shown) and a speaker for outputting audio data are arranged. Also, a camera may be arranged on a part of the display surface 121 side of the electronic device 1 or a part of the back surface side of the display surface 121 (the back surface side of the housing 110, the -Z side in FIG. 1).

[0021] The camera is, for example, a digital camera incorporating an imaging device such as a CCD (Charge Coupled Device) or a CIS (CMOS Image Sensor).

[0022] The display 12 is, for example, an LCD (Liquid Crystal Display) or an OLED (Organic Light Emitting Diode). The display surface 121 of the display 12 is provided, for example, over substantially the entire surface on one side (+Z side in FIG. 1) of the thin rectangular housing 110 of the electronic device 1. The display 12 is an example of a display unit.

[0023] The EMR sensor 14 has, for example, a plurality of loop coils 141 arranged in a vertical / horizontal (X direction / Y direction in FIG. 1) alternating grid pattern. The plurality of loop coils 141 are arranged, for example, along the display surface 121 on the back surface side (-Z side in FIG. 1) of the display 12.

[0024] The EMR sensor 14 generates a magnetic field in the space on the display surface 121 of the display 12 through the display 12 by emitting a weak electromagnetic signal from each of the plurality of loop coils 141.

[0025] As an example, the EMR sensor 14 generates a magnetic field within a range of approximately 5 mm in the +Z direction from the display surface 121 or the glass plate on the display surface 121. The EMR sensor 14 also detects the magnetic flux density (electromagnetic wave intensity) or its change using each of the multiple loop coils 141, and outputs a detection signal corresponding to the detected magnetic flux density (electromagnetic wave intensity) or its change.

[0026] The electronic pen 3 is an EMR-type pen-shaped input device. The electronic pen 3 has a resonant circuit 32 and a side switch 33. The resonant circuit 32 is provided on the tip end 31 side of the electronic pen 3. The resonant circuit 32 has a coil and a capacitor (not shown).

[0027] The electronic pen 3 generates a magnetic field when the resonant circuit 32 resonates in response to the magnetic field generated by the EMR sensor 14. The side switch 33 accepts user input. The electronic pen 3 can change the frequency at which the resonant circuit 32 generates the magnetic field in response to the user pressing the side switch 33.

[0028] In this embodiment, an electronic device 1 is provided as an example that is configured to allow various operations and inputs such as writing using at least an electronic pen 3, but it is not limited to this. In addition to the electronic pen 3, or in place of the electronic pen 3, the electronic device 1 may be configured to allow various operations and inputs such as writing using the user's fingers (e.g., fingertips) or a capacitive pen-type input device (e.g., a stylus).

[0029] In other words, the electronic device 1 may further have a capacitive touch panel. For example, the electronic device 1 may be configured to allow writing on content by moving a fingertip or stylus on the touch panel. The touch panel is provided, for example, on the display surface 121 of the display 12 (on the +Z side in Figure 1).

[0030] Figure 2 shows an example of the configuration of the electronic device 1 according to the embodiment. The electronic device 1 has a hardware configuration similar to that of a general PC. As shown in Figure 2, the electronic device 1 further includes a processing circuit 11 and a memory 15. The electronic device 1 also further includes a communication interface and an input / output interface, which are not shown in the figure.

[0031] The processing circuit 11 is a circuit configured to control the entire electronic device 1. For example, the processing circuit 11 loads and executes information processing programs stored in its internal memory and memory 15 to realize the various functions of the electronic device 1, including the display control unit 111, the pen detection unit 112, and the determination unit 113.

[0032] The processing circuit 11 may also be at least one dedicated circuit configured to realize each of the functions of the electronic device 1, including the display control unit 111, the pen detection unit 112, and the determination unit 113.

[0033] The processing circuit 11 may be a combination of two or more processors. Furthermore, each function of the electronic device 1 may be implemented by two or more processors. Also, two or more functions of the electronic device 1 may be implemented by a single processor.

[0034] Furthermore, various processors such as CPU (Central Processing Unit), GPU (Graphics Processing Unit), Mux (Multiplex), MPU (Micro Processing Unit), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), and FPGA (Field Programmable Gate Array) can be used as the processing circuit 11 as appropriate.

[0035] Furthermore, the various programs executed in the electronic device 1 do not necessarily need to be stored in the internal memory or memory 15 of the processing circuit 11. For example, the processing circuit 11 may read and execute a program stored on a computer-readable recording medium.

[0036] The recording media that the processing circuit 11 can read include, for example, CD-ROMs, DVD discs, flash memory (semiconductor memory) such as USB (Universal Serial Bus) memory and SSDs (Solid State Drives), and HDDs (Hard Disc Drives).

[0037] Alternatively, various programs may be stored in devices connected to public networks, the internet, LANs, etc., and the processing circuit 11 may read and execute these programs.

[0038] The display control unit 111 controls the display 12 to display the content. For example, the display control unit 111 controls the display 12 to display the content in editing mode (first display mode) 6 and memorization mode (second display mode) 7.

[0039] Editing mode (first mode) 6 is a mode in which written data 2, which is written on the display 12 by the user's handwriting input, is created and edited. Specifically, in editing mode 6, for example, the user selects the type and color of the pen shown on the display 12, and written data 2 is created and edited using the selected pen.

[0040] Memorization Mode (the second mode) 7 is a mode in which the display color of mask data among the written data 2 written in Edit Mode 6 is changed and displayed. Specifically, Memorization Mode 7 is a mode that switches when, for example, the display color of mask data entered with a green marker pen in Edit Mode 6 meets a certain condition. Also, Memorization Mode 7 is a mode in which the display color of data entered with a green highlight pen in Edit Mode 6 is changed.

[0041] The pen detection unit 112 detects the position of the tip 31 of the electronic pen 3 relative to the display surface 121 of the display 12, for example, based on the output of the EMR sensor 14. The pen detection unit 112 also detects the writing data 2.

[0042] Furthermore, the electronic device 1 may perform control in response to changes in the pen posture, which is at least one of the position, tilt, and direction of the tip 31 of the electronic pen 3. This control in response to changes in pen posture can be combined with control in response to pressing the side switch 33.

[0043] Furthermore, control in response to changes in pen posture may include changes in pen type such as color, line type, and thickness, or changes in writing style such as selecting / deselecting markers. Also, control in response to changes in pen posture may include page turning, drag-and-drop, or selection / deselection of annotations.

[0044] For example, control in response to changes in pen posture could include page turning or page adding in response to swipe operations with the electronic pen 3.

[0045] The determination unit 113 determines whether multiple written data 2 on the displayed content overlap. The determination unit 113 also determines the order in which the multiple written data 2 that it determined to be overlapping were written, based on their writing times (date and time). The determination unit 113 also determines the percentage of the range of the multiple written data 2 that it determined to be overlapping.

[0046] Memory 15 stores each program executed by the processing circuit 11 and the parameters of each program. Memory 15 also temporarily stores data being processed when the processing circuit 11 performs arithmetic operations. Memory 15 holds information indicating pen type, such as color, line type, and thickness, which may be pre-set during manufacturing or shipping, or set or edited by the user. Memory 15 also stores, for example, the written data 2.

[0047] Various types of memory, such as ROM (Read Only Memory), HDD, and SSD, can be used as memory 15 as appropriate. In addition to non-volatile memory, volatile memory such as RAM (Random Access Memory) used as working memory can also be used as memory 15. Furthermore, memory 15 may be a combination of two or more types of circuit elements.

[0048] Figure 3 shows an example of the display when switching modes according to the embodiment. Figure 3(a) shows an example of the display in editing mode (first mode) 6. Figure 3(b) shows an example of the display in memorization mode (second mode) 7.

[0049] As shown in Figure 3(a), the written data 2 includes, for example, handwritten data 21, mask data 22, and second mask data 23. Attribute information 20 is associated with the written data 2 when it is input. The written data 2 is stored, for example, in memory 15.

[0050] Attribute information 20 includes, for example, the writing time, which is the date and time the data was written. Attribute information 20 also includes the coordinates where the data was written. Attribute information 20 also includes the type of pen, such as the color and thickness of the electronic ink.

[0051] Handwritten data 21 is data that represents lines, characters, and illustrations entered with a selected black pen, for example, when the electronic ink color is set to black (including blue, red, etc.) and the pen type is set to pen. Handwritten data 21 may contain the handwritten characters "Sakuradamon Incident" written in black pen.

[0052] Furthermore, the handwritten data 21 includes text data 24. The text data 24 is data entered using, for example, a software keyboard (touch panel) or a keyboard. The text data 24 includes, for example, the words "Sakuradamon Incident" written using a keyboard.

[0053] Mask data 22 is data that represents lines, text, fills, and illustrations entered with a selected green marker pen, for example, when the electronic ink color is set to green and the pen type is set to a marker pen.

[0054] Mask data 22 may contain, for example, handwritten text "Sakuradamon Incident" written in green marker pen. Additionally, mask data 22 may have been traced over handwritten data 21 (written in black pen) with a green marker pen. Furthermore, mask data 22 may contain, for example, an illustration drawn with a green marker pen.

[0055] The mask data 22 is stored in memory 15 as a target for memorization mode 7 if, for example, the mask data 22 satisfies the specified conditions. That is, when the system switches to memorization mode 7, the display color of the mask data 22 changes if the conditions are met. For example, the display color of the mask data 22 changes to black. Alternatively, the display color of the mask data 22 may be changed to white, for example. The mask data 22 is also referred to as the first mask data.

[0056] The second mask data 23 is, for example, data representing a line drawn with the selected green highlight pen, assuming that the electronic ink color is green and the pen type is a highlight pen (thick pen).

[0057] The second mask data 23 is stored in memory 15, for example, as the target of memorization mode 7. That is, the display color of the second mask data 23 changes when memorization mode 7 is activated. The display color is black as an example (white or other colors may also be used). The second mask data 23 covers the text data 24.

[0058] The display screens for editing mode 6 and memorization mode 7, as shown in Figures 3(a) and 3(b), show a switch button 25 and a deactivation button 26.

[0059] The toggle button 25, when selected by the user, switches the display screen from editing mode 6 shown in Figure 3(a) to memorization mode 7 shown in Figure 3(b). The toggle button 25 is displayed, for example, on the display 12.

[0060] The release button 26, when selected by the user, switches the display screen from memorization mode 7 shown in Figure 3(b) to editing mode 6 shown in Figure 3(a). The release button 26 is displayed, for example, on the display 12.

[0061] As shown in Figure 3(b), in memorization mode 7, for example, mask data 22 switches to black if the mask data 22 entered with a green marker pen in editing mode 6 satisfies the conditions. Also, in memorization mode 7, for example, second mask data 23 switches to black if the second mask data 23 entered with a green highlight pen in editing mode 6.

[0062] Figure 4 shows an example of determining duplication of written data 2 according to the embodiment. Figure 4 shows an example of the display screen of editing mode 6. Figure 4(a) shows the case where the first and second conditions for memorization mode 7 are met. Figure 4(b) shows the case where the first and second conditions for memorization mode 7 are not met.

[0063] As shown in Figure 4(a), the range of the written data 2 is defined by coordinates when it is input. For example, handwritten data 21 has a range 211 defined for handwritten data 21. Masked data 22 has a range 211 defined for masked data 22. Also, as shown in Figure 4(b), for example, text data 24 has a range 241 defined for text data 24.

[0064] Here, one example of the first condition for which memorization mode 7 is the determination by the judgment unit 113 as to whether or not the range 211 of the handwritten data 21 and the range 221 of the masked data 22 overlap by a threshold or more.

[0065] Furthermore, one example of the second condition for which memorization mode 7 is applied is the determination by the determination unit 113 as to whether the ratio of the range 211 of the handwritten data 21 to the range 221 of the masked data 22 is equal to or greater than a predetermined value.

[0066] From here, we will explain the cases where the first and second conditions are met using Figure 4(a). The determination unit 113 obtains the range 211 of the handwritten data 21 that has "written" written on it, and the range 221 of the mask data 22 that has been traced over "written" with a green marker pen, from the written data 2 of the displayed content. The determination unit 113 determines whether the range 211 of the handwritten data 21 and the range 221 of the mask data 22 overlap by a threshold or more.

[0067] The timing of the determination by the determination unit 113 is, for example, when data is written. For example, the determination unit 113 makes a determination when mask data 22 is written. Alternatively, the timing of the determination by the determination unit 113 is, for example, when the display mode is switched from editing mode 6 to memorization mode 7.

[0068] The determination unit 113 determines that the range 211 of the handwritten data 21 and the range 221 of the masked data 22 overlap by a threshold or more, because the range of "writing" is included in the range written with the green marker pen. The determination unit 113 may also determine whether the range 221 of the masked data 22 includes the range 211 of the handwritten data 21. The determination unit 113 determines that the range 221 of the masked data 22 includes the range 211 of the handwritten data 21. In other words, it determines that the first condition is met.

[0069] Next, the determination unit 113 determines whether the ratio of the range 211 of the handwritten data 21 to the range 221 of the masked data 22 is greater than or equal to a predetermined value, if it determines that the range 211 of the handwritten data 21 and the range 221 of the masked data 22 overlap by a threshold or more. That is, if the first condition is met, the determination is made regarding the second condition.

[0070] The determination unit 113 determines that the range of "writing" included in the range written with the green marker pen is larger than a predetermined value, and therefore the ratio of the range 211 of the handwritten data 21 to the range 221 of the mask data 22 is greater than or equal to a predetermined value. In other words, it determines that the second condition is met.

[0071] Next, we will explain the case where the first and second conditions are not met using Figure 4(b). We will use "write" as an example from "write" and "now," shown in Figure 4(b) to explain the case where the first condition is not met.

[0072] The determination unit 113 obtains the range 211 of the handwritten data 21 inscribed with "write" and the range 221 of the mask data 22 written to the right of "write" with a green marker pen. The determination unit 113 determines whether the range 211 of the handwritten data 21 and the range 221 of the mask data 22 overlap by a threshold or more.

[0073] The determination unit 113 determines that because a portion of the "included" area within the "written" area overlaps with the area written with the green marker pen, the range 211 of the handwritten data 21 and the range 221 of the masked data 22 do not overlap by a threshold amount. The determination unit 113 may also determine whether the range 221 of the masked data 22 includes the range 211 of the handwritten data 21. The determination unit 113 determines that the range 221 of the masked data 22 does not include the range 211 of the handwritten data 21. In other words, it determines that the first condition is not met. Since the first condition is not met, the determination of the second condition is not made.

[0074] Next, we will explain the case where the first condition is met but the second condition is not, using "Now," as an example. The determination unit 113 obtains the range 241 of the text data 24 in which "Now," is written (range 211 of the handwritten data 21) and the range 221 of the mask data 22 traced over "Now," with a green marker pen. The determination unit 113 determines whether the range 241 of the text data 24 and the range 221 of the mask data 22 overlap by a threshold or more.

[0075] The determination unit 113 determines that the range of "Now," is included in the range written with the green marker pen, and therefore the range 241 of the text data 24 and the range 221 of the mask data 22 overlap by a threshold or more. The determination unit 113 may also determine whether the range 221 of the mask data 22 includes the range 241 of the text data 24. The determination unit 113 determines that the range 221 of the mask data 22 includes the range 241 of the text data 24. In other words, it determines that the first condition is met.

[0076] Next, if the determination unit 113 determines that the range 241 of the text data 24 and the range 221 of the mask data 22 overlap by a threshold or more, it determines whether the ratio of the range 241 of the text data 24 to the range 221 of the mask data 22 is greater than or equal to a predetermined value.

[0077] The determination unit 113 determines that the range of "Now," included in the range written with the green marker pen is less than a predetermined value, and therefore the ratio of the range 241 of text data 24 to the range 221 of mask data 22 is less than a predetermined value. In other words, it determines that the second condition is not met.

[0078] Figure 5 shows an example of determining the writing time of the written data 2 according to the embodiment. Figure 5(a) shows the case where the third condition for memorization mode 7 is met. Figure 5(b) shows the case where the third condition for memorization mode 7 is not met.

[0079] In Figure 5(a), the note "Mark the marker later" is written on it, and then it is colored over with a green marker pen. In Figure 5(b), the note "Mark the marker first" is written on it, after it has been colored with a green marker pen.

[0080] Here, the third condition for which memorization mode 7 is applied is, as an example, the determination of the writing time of the handwritten data 21 and the masked data 22 by the determination unit 113.

[0081] From here, we will explain the case where the third condition is met using editing mode 6 in Figure 5(a). The determination unit 113 determines that the range 211 of the handwritten data 21 and the range 221 of the masked data 22 overlap by a threshold or more, and further determines that the ratio of the range 211 of the handwritten data 21 to the range 221 of the masked data 22 is greater than or equal to a predetermined value, and then determines the writing time of the handwritten data 21 and the masked data 22.

[0082] Furthermore, if the determination unit 113 determines that the range 211 of the handwritten data 21 and the range 221 of the masked data 22 overlap by a threshold or more, it may determine the writing times of the handwritten data 21 and the masked data 22.

[0083] The determination unit 113 determines that the time the mask data 22 was written is later than the time the handwritten data 21 was written, because the handwritten data 21 was written first and then colored over with the green marker pen of the mask data 22. In other words, it determines that the third condition is met.

[0084] The determination unit 113 determines that the mask data 22 has a later writing time than the handwritten data 21 and saves it in memory 15 as an item for memorization mode 7. Alternatively, the determination unit 113 changes the mask data 22 to a layer for memorization mode 7 and saves it as an item for memorization mode 7.

[0085] The determination unit 113, when the mask data 22 is written, determines whether the range 211 of the handwritten data 21 and the range 221 of the mask data 22 overlap by a threshold or more, whether the ratio of the range 211 of the handwritten data 21 to the range 221 of the mask data 22 is greater than or equal to a predetermined value, and determines the writing times of the handwritten data 21 and the mask data 22. The determination unit 113 may also perform the determination when the display switch (switch button 25) is selected.

[0086] As shown in memorization mode 7 in Figure 5(a), the display control unit 111 controls the system to change the display color of the mask data 22 and display memorization mode 7 from editing mode 6 when the display mode switching is selected. The display control unit 111 retrieves the target mask data 22 for memorization mode 7 stored in memory 15, for example, and controls the system to change the display color of the corresponding mask data 22 and display memorization mode 7 from editing mode 6. The display color is changed, for example, from green to black.

[0087] If the display control unit 111 determines, for example, that the writing time of the mask data 22 is later than the writing time of the handwritten data 21, it controls the display 12 to change the display color of the mask data 22 and switch from editing mode 6 to memorization mode 7.

[0088] Next, we will explain the case where the third condition is not met using editing mode 6 in Figure 5(b). Note that the determination of the first condition and the determination of the second condition in Figure 5(a) are the same. The determination unit 113 determines that the writing time of the handwritten data 21 is later than the writing time of the mask data 22 because the handwritten data 21 "paint the marker first" was written after the mask data 22 was painted with the green marker pen. In other words, it determines that the third condition is not met.

[0089] Therefore, the display control unit 111 controls the display 12 so that even when a display mode switch is selected and the display is switched from editing mode 6 to memorization mode 7, the mask data 22 and the display color (green) shown in editing mode 6 in Figure 5(b) remain unchanged.

[0090] Furthermore, as shown in memorization mode 7 in Figure 5(b), the determination unit 113 may save the mask data 22 as the target of memorization mode 7 in memory 15 if the determination of the first condition and the determination of the second condition are met. However, if the determination unit 113 determines that the writing time of the mask data 22 is earlier than the writing time of the handwritten data 21, the display control unit 111 controls to display both the handwritten data 21 and the mask data 22.

[0091] Figure 6 shows an example of the display control flow by the electronic device 1 according to the embodiment. As shown in Figure 6, the pen detection unit 112 detects, for example, writing by a pen on the content displayed on the display 12 (step S1). Specifically, the pen detection unit 112 detects the written data 2.

[0092] The determination unit 113 determines, for example, whether or not the writing was done with a green marker pen (step S2). Specifically, the determination unit 113 determines whether or not the mask data 22 was written with a green marker pen.

[0093] If the determination unit 113 determines, for example, that the writing is not done with a green marker pen (step S2; No), it then determines whether or not the writing is done with a green highlight pen (step S3). Specifically, the determination unit 113 determines whether or not the second mask data 23 was written with a green highlight pen.

[0094] If the determination unit 113 determines, for example, that the writing is not done with a green highlight pen (step S3; No), it saves the writing data 2 to the memory 15 (step S8). Specifically, it saves the writing data 2 and attribute information 20 to the memory 15.

[0095] If the determination unit 113 determines, for example, that a green highlight pen has been used (step S3; Yes), it assigns the second mask data 23 of the green highlight pen to be used in memorization mode 7 (step S7). Then, it saves the second mask data 23 to memory 15 as a target for memorization mode 7 (step S8).

[0096] Returning to step S2, the determination unit 113, for example, if it determines that the writing was done with a green marker pen (step S2; Yes), determines whether the handwritten data 21 in the displayed content and the mask data 22 for the green marker pen overlap by a threshold or more (step S4). Specifically, for example, the determination unit 113 determines whether the mask data 22 for the green marker pen encompasses the handwritten data 21 in the displayed content written with a black pen.

[0097] If the determination unit 113 determines, for example, that the handwritten data 21 and the mask data 22 do not overlap by a threshold amount (step S4; No), it saves the mask data 22 of the green marker pen to the memory 15 (step S8).

[0098] If the determination unit 113 determines, for example, that the handwritten data 21 and the mask data 22 overlap by a threshold or more (step S4; Yes), it determines whether the overlap ratio of the range 211 of the handwritten data 21 written with a black pen to the range 221 of the mask data 22 written with a green marker pen is greater than or equal to a predetermined value (step S5).

[0099] If the determination unit 113 determines, for example, that the overlap ratio between the range 221 of the mask data 22 written with a green marker pen and the range 211 of the handwritten data 21 written with a black pen is less than a predetermined value (step S5; No), it saves the mask data 22 written with the green marker pen to the memory 15 (step S8).

[0100] For example, if the determination unit 113 determines that the overlap ratio between the range 221 of the mask data 22 written with a green marker pen and the range 211 of the handwritten data 21 written with a black pen is greater than or equal to a predetermined value (step S5; Yes), it obtains the writing times of the handwritten data 21 written with a black pen and the mask data 22 written with a green marker pen, and determines whether the writing time of the mask data 22 is later than the writing time of the handwritten data 21 (step S6).

[0101] If the determination unit 113 determines, for example, that the writing time of the mask data 22 is earlier than the writing time of the handwritten data 21 (step S6; No), it saves the mask data 22 to the memory 15 (step S8).

[0102] If the determination unit 113 determines, for example, that the writing time of the mask data 22 is later than the writing time of the handwritten data 21 (step S6; Yes), it assigns the mask data 22 to be used in memorization mode 7 (step S7).

[0103] The determination unit 113, for example, saves the mask data 22 to the memory 15 as the target of memorization mode 7 (step S8). The determination unit 113 also saves the mask data 22 to the layer of memorization mode 7 as the target of memorization mode 7.

[0104] The pen detection unit 112 detects, for example, whether or not there is writing (step S9). Specifically, the pen detection unit 112 detects whether or not there is written data 2.

[0105] If the pen detection unit 112 detects writing (step S9; Yes), it returns to step S2 and performs processing by the determination unit 113.

[0106] If the pen detection unit 112 does not detect writing (step S9; No), the display control unit 111 controls the display 12 to display memorization mode 7 when the user selects to switch from editing mode 6 to memorization mode 7 (step S10). For example, the display control unit 111 changes the display color of the mask data 22 and the second mask data 23 stored in memory 15 as targets for memorization mode 7 to display memorization mode 7.

[0107] Furthermore, the processing from steps S1 to S9 described above may be performed in advance if the mask data 22 is written, or if the switch from editing mode 6 to memorization mode 7 is selected.

[0108] Step S5 may be omitted. Also, if a determination is made in advance when mask data 22 is written, step S6 may be omitted.

[0109] The electronic device of this embodiment comprises a display unit, a determination unit, and a display control unit. The determination unit determines whether the range of handwritten data and the range of masked data among the written data displayed on the display unit overlap by a threshold or more, and determines the writing time of the handwritten data and masked data if it is determined that they overlap by a predetermined value or more. Based on the writing time of the handwritten data and the writing time of the masked data, the display control unit controls the display unit to display a second display mode in which the display color of the masked data of the first display mode is changed, from a first display mode in which written data is created by handwritten input.

[0110] Previously, all data written with a green marker or green highlighter was stored in memory as part of the memorization mode. Therefore, when switching to memorization mode, all data written with a green marker or green highlighter was changed to black. This resulted in a larger amount of data being stored as part of the memorization mode, and also meant that the green marker was only used in memorization mode.

[0111] In this embodiment, the electronic device can change the display color only for mask data that overlaps with the range of handwritten data by a threshold or more and satisfies conditions based on the writing time. This improves the convenience of the writing pen. For example, since the display color does not change for mask data other than the green marker pen that satisfies the conditions, the green marker pen can be used freely for purposes other than memorization. Furthermore, by determining whether the range of handwritten data and the range of mask data overlap by a threshold or more, even if a part of the range of mask data happens to be included in the range of handwritten data, the accidentally included mask data can be excluded from the display switching target.

[0112] Electronic devices can change the display color of masked data based on the writing time of the masked data rather than the writing time of the handwritten data, thereby switching from editing mode to memorization mode. This allows for the display color to be changed only for masked data that meets certain conditions. Furthermore, since only masked data that meets the conditions is stored in memory as part of memorization mode, the amount of memory used for memorization mode can be reduced.

[0113] In the electronic device of this embodiment, for example, if the display control unit determines that the time of writing the mask data is later than the time of writing the handwritten data, it controls the display unit to change the display color of the mask data and display the second display mode.

[0114] This allows electronic devices, for example, to change the display color of mask data and switch from editing mode to memorization mode if they determine that the writing time of the mask data is later than the writing time of the handwritten data. This ensures that only mask data that meets the condition has its display color changed. Furthermore, since only mask data that meets the condition is stored in memory as part of memorization mode, the amount of memory used for memorization mode can be reduced.

[0115] In the electronic device of this embodiment, for example, the determination unit performs a determination in advance when mask data is written. This allows for faster display switching compared to, for example, determining all data at once.

[0116] In the electronic device of this embodiment, for example, the determination unit makes a determination when a switch from the first display mode to the second display mode is selected. This allows the display mode to be switched based on the user's selection of the display mode.

[0117] In the electronic device of this embodiment, for example, the determination unit determines that the range of the handwritten data and the range of the masked data overlap by a threshold or more, and that the overlap ratio of the range of the handwritten data to the range of the masked data is greater than or equal to a predetermined value, then determines the writing time of the handwritten data and the masked data.

[0118] This allows, for example, determining whether the overlap ratio between the range of the handwritten data and the range of the masked data is greater than or equal to a predetermined value. Even if the range of the masked data happens to cover the range of the handwritten data, if the overlap ratio is less than the predetermined value, the masked data that accidentally covers the handwritten data can be excluded from the display switching target.

[0119] The display control method of this embodiment determines whether the range of handwritten data and the range of masked data overlap by a threshold or more among the written data displayed on the display unit, determines the writing time of the handwritten data and masked data that are determined to overlap by a predetermined value or more, and controls the display unit to display a second display mode in which the display color of the masked data of the first display mode is changed, from a first display mode in which written data is created by handwritten input to a second display mode in which the display color of the masked data of the first display mode is changed.

[0120] The program of this embodiment causes the computer to perform the following actions: determine whether the range of handwritten data and the range of masked data among the written data displayed on the display unit overlap by a threshold or more; determine the writing time of the handwritten data and masked data that are determined to overlap by a predetermined value or more; and, based on the writing time of the handwritten data and the writing time of the masked data, control the display unit to display a second display mode in which the display color of the masked data in the first display mode is changed, from a first display mode in which written data is created by handwritten input.

[0121] In the embodiments described above, an electronic device 1 having a display 12 was used as an example, but the embodiment is not limited to this. The electronic device 1 according to the embodiment may be configured as a pen input device connected to an external display or other electronic device. In other words, the display 12 is not an essential component in the electronic device 1 according to the embodiment.

[0122] Furthermore, the program executed by the processor of the electronic device 1 in this embodiment may be configured to be provided as an installable or executable file recorded on a computer-readable recording medium such as a CD-ROM, flexible disk (FD), CD-R, or DVD (Digital Versatile Disk).

[0123] Furthermore, the program executed by the electronic device 1 of this embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Alternatively, the program executed by the electronic device 1 of this embodiment may be provided or distributed via a network such as the Internet.

[0124] While embodiments and variations of the present invention have been described, these embodiments and variations are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments and variations can be implemented in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of symbols]

[0125] 1...Electronic device, 2...Writable data, 6...Editing mode (first display mode), 7...Memorization mode (second display mode), 12...Display (display unit), 21...Handwritten data, 22...Mask data, 111...Display control unit, 113...Determination unit, 211...Range of handwritten data, 221...Range of mask data.

Claims

1. Display unit and A determination unit determines whether the range of handwritten data and the range of masked data among the written data displayed on the display unit overlap by a threshold or more, and determines the writing time of the handwritten data and the masked data if it is determined that they overlap by a predetermined value or more. A display control unit controls the display unit to display a second display mode in which the display color of the mask data in the first display mode is changed, based on the writing time of the handwritten data and the writing time of the mask data. Electronic devices equipped with these features.

2. If the display control unit determines that the writing time of the mask data is later than the writing time of the handwritten data, it controls the display unit to change the display color of the mask data and display the second display mode. The electronic device according to claim 1.

3. The determination unit makes a determination when the mask data has been written. The electronic device according to claim 1 or 2.

4. The determination unit makes a determination when a switch from the first display mode to the second display mode is selected. The electronic device according to claim 1 or 2.

5. The determination unit determines that the range of the handwritten data and the range of the masked data overlap by a threshold or more, and that the overlap ratio of the range of the handwritten data to the range of the masked data is greater than or equal to a predetermined value, and determines the writing time of the handwritten data and the masked data. The electronic device according to claim 1 or 2.

6. The system determines whether the range of handwritten data and the range of masked data in the displayed data overlap by a threshold or more, and determines the writing time of the handwritten data and the masked data if it is determined that they overlap by a predetermined value or more. Based on the writing time of the handwritten data and the writing time of the mask data, the display unit is controlled to display a second display mode in which the display color of the mask data in the first display mode is changed, from a first display mode in which the written data is created by handwritten input. Display control method.

7. On the computer, The system determines whether the range of handwritten data and the range of masked data in the displayed data overlap by a threshold or more, and determines the writing time of the handwritten data and the masked data if it is determined that they overlap by a predetermined value or more. Based on the writing time of the handwritten data and the writing time of the mask data, the display unit is controlled to display a second display mode in which the display color of the mask data in the first display mode is changed, from a first display mode in which the written data is created by handwritten input. A program to perform a task.

Images