Display device, display method, and program

Abstract

To provide a display device by which a user can indicate whether to delete an object even when handwriting data and an object are overlapped.SOLUTION: The present invention relates to a display device for showing handwriting data and an object, and the device includes: reception means for receiving a deleting operation for one of the handwriting data and the object by input means; display control means for displaying a display component that shows that it is possible to delete the object when the reception means receives the deleting operation for the object; and first deleting means for deleting the object in response to an operation on the object in which the display component is displayed. When the reception means receives the deleting operation for the handwriting data and the object while the handwriting data and the object are overlapped, the display control means displays a display component that shows that it is possible to delete the object.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a display device, a display method, and a program. [Background technology]

[0002] There are known display devices such as electronic whiteboards on which a user draws strokes using an input means such as a dedicated electronic pen or a finger on a touch panel display, and handwritten data formed from several strokes is displayed. Display devices equipped with relatively large touch panels are placed in conference rooms, public facilities, etc., and are used as electronic whiteboards by multiple users.

[0003] Since a user may wish to delete handwritten stroke data or objects such as figures, a deletion method is provided in the display device (see, for example, Patent Document 1). Patent Document 1 discloses a method for selectively deleting stroke data and objects. Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the conventional technology, when handwritten data and an object overlap, both may be deleted. For example, when a user uses an eraser tool to move a location where handwritten data and an object overlap, both are deleted. Although there are display devices that delete only handwritten data, a separate operation is required when a user wants to delete an object.

[0005] In view of the above-mentioned problems, an object of the present invention is to provide a display device that allows a user to instruct whether or not to delete an object even if handwritten data and the object overlap. [Means for solving the problem]

[0006] In view of the above problem, the present invention provides a display device for displaying handwritten data and an object, the display device comprising: a reception means for receiving a delete operation for the handwritten data or the object by an input means; and a display control means for displaying a display component indicating that the object can be deleted when the reception means receives the delete operation for the object; before a first deletion means for deleting the object, and when the reception means receives the deletion operation for the handwritten data and the object in a state where the handwritten data and the object are overlapped, the display control means displays a display component indicating that the object can be deleted. death , The first deletion means deletes the object in response to an operation on the display part or the object around which the display part is displayed. The present invention is characterized by the above. Effect of the Invention

[0007] It is possible to provide a display device that allows a user to instruct whether or not to delete an object even if handwritten data and the object overlap. [Brief description of the drawings]

[0008] [Figure 1] 11A and 11B are diagrams illustrating an example of a deletion method of a display device that allows deletion of a standard object with an eraser tool. [Diagram 2] 11A and 11B are diagrams illustrating an example of a deletion method for a display device in which a sticky note object cannot be deleted with an eraser tool. [Diagram 3] 11A to 11C are diagrams illustrating a method for deleting a display device according to the present embodiment. [Figure 4] FIG. 1 is a schematic perspective view of a display device. [Diagram 5] FIG. 2 is a diagram illustrating an example of a hardware configuration of a display device. [Figure 6] FIG. 2 is a diagram showing an example of a functional block diagram for explaining functions of the display device by dividing them into blocks. [Figure 7] FIG. 2 is a diagram showing an example of various objects displayed on a display. [Figure 8]4 is a diagram illustrating an example of object information stored in an object information storage unit. FIG. [Figure 9] 13 is a diagram showing an example of data stored in an object information storage unit when Type is an image object. FIG. [Figure 10] 11A and 11B are diagrams illustrating an example of an operation method by which a user switches between an eraser mode and a handwriting mode. [Figure 11] FIG. 2 shows an example of some objects displayed on a display. [Figure 12] 12 is a diagram showing an example of object information when the object shown in FIG. 11 is displayed. FIG. [Figure 13] FIG. 13 is a diagram showing a state in which the eraser button is pressed. [Figure 14] FIG. 13 illustrates an example of a temporarily deleted state management table. [Figure 15] FIG. 13 is a diagram showing an example of a path of movement of a user pressing an input tool against a display in eraser mode. [Figure 16] 16 is a diagram showing an example of a temporary deletion state management table when the user moves the input tool in the eraser mode as shown in FIG. 15. [Figure 17] 13 is a diagram illustrating an example of deleting a typical object by pressing a delete button. FIG. [Figure 18] FIG. 13 is a diagram illustrating an example of a state in which a tag object has been deleted. [Figure 19] 13 is a diagram illustrating an example of object information after a sticky note has been deleted. [Figure 20] 13 is a diagram illustrating an example of a temporary deletion state management table after a sticky note object is deleted. [Figure 21] 13 is a diagram illustrating an example of a state in which a user presses a handwriting button. [Figure 22] 11 is a diagram illustrating an example of a state transition of a temporarily deleted state; [Figure 23] FIG. 11 is a sequence diagram illustrating an example of a method for deleting an object displayed on the display device. [Figure 24]FIG. 13 is a diagram showing an example of overlapping standard objects. [Diagram 25] 13 is an example of a diagram showing a front sticky note object in a temporarily deleted state; [Figure 26] 13 is a diagram illustrating an example of sticky note objects remaining after the sticky note object with the largest Z coordinate has been deleted. [Figure 27] 13 is an example of a sequence diagram illustrating a method for setting a Z coordinate. [Figure 28] FIG. 13 is a diagram showing an example of a deletion dialogue displayed on the display device. [Figure 29] FIG. 11 is a sequence diagram illustrating an example of a method for deleting standard objects collectively; [Diagram 30] FIG. 13 is a diagram illustrating an example of a state in which a user selects multiple overlapping standard objects with an eraser tool. [Diagram 31] 13 is a diagram illustrating an example of a deletion dialog in which a typical object is selected. [Diagram 32] 13 is a diagram illustrating an example of a state in which a routine object selected in the deletion dialog has been deleted. [Diagram 33] 11 is a sequence diagram illustrating an example of a method for selectively deleting a routine object displayed in a deletion dialog box. FIG. [Diagram 34] 13 is a diagram illustrating an example of a typical object in which the provisional deletion state is set to True and a delete button is displayed. [Diagram 35] FIG. 13 is a diagram illustrating an example of a state in which a tag object selected with an eraser tool has been deleted. [Diagram 36] 11 is a sequence diagram illustrating an example of a method for deleting a standard object with an eraser tool. FIG. [Figure 37] FIG. 13 is a diagram showing another configuration example of the display device. [Figure 38] FIG. 13 is a diagram showing another configuration example of the display device. [Figure 39] FIG. 13 is a diagram showing another configuration example of the display device. [Diagram 40] FIG. 13 is a diagram showing another configuration example of the display device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A display device and a display method performed by the display device will be described below with reference to examples as embodiments of the present invention. EXAMPLES

[0010] <Comparative Example> First, a comparative example will be described for reference in explaining the deletion method of the present embodiment with reference to Fig. 1. Note that the comparative example is not necessarily a conventional technique.

[0011] First, the display device displays handwritten data (hereinafter, sometimes referred to as handwritten objects) written by an input means such as a pen or a finger, as well as standard objects such as figures, sticky notes, and stamps. The user can erase the handwritten data with an eraser tool, but whether standard objects can be erased with the eraser tool varies depending on the settings and the display device.

[0012] Fig. 1 is a diagram showing a deletion method of a display device capable of deleting a standardized object with an eraser tool 104. As shown in Fig. 1, when a user operates the eraser tool 104 with an input means to move an overlapping area between a handwritten object 101 and a sticky note object 102 (an example of a standardized object), both the handwritten object 101 and the sticky note object 102 are deleted. In a display device capable of deleting a sticky note object 102 with the eraser tool 104, deleting the sticky note object 102 is easy and convenient. However, when the sticky note object 102 and the handwritten object 101 overlap, for example, it is difficult to perform an operation such as deleting only the handwritten object 101 while leaving the sticky note object 102.

[0013] 2 is a diagram showing a method of deletion on a display device in which the sticky object 102 cannot be deleted with the eraser tool 104. In a display device in which the sticky object 102 cannot be deleted, the sticky object 102 cannot be deleted with the eraser tool 104, and so the user has the advantage that he or she can delete only the handwritten object 101. However, when the user wants to delete the sticky object 102, in addition to the deletion operation of the handwritten object 101, the user must once select the sticky object 102 (for example, by long pressing the object or selecting it with an object selection tool) and then perform the deletion process, which is time-consuming.

[0014] <Outline of the Deletion Method of the Present Embodiment> 3, in this embodiment, a "temporarily deleted state" is introduced for the sticky note object 102 that cannot be deleted with the eraser tool 104. The sticky note object 102 cannot be deleted with the eraser tool 104, but when selected with the eraser tool 104, it is in a temporarily deleted state. The sticky note object 102 in the temporarily deleted state can be deleted by the user with a single touch.

[0015] Fig. 3 is a diagram for explaining the deletion method of the display device of this embodiment. Fig. 3(a) shows a sticky note object 102 and a character string object 103 that have been temporarily deleted by an eraser tool 104. The sticky note object 102 and the character string object 103 (an example of a standard object) in the temporarily deleted state display a delete button 110. The delete button 110 is a display component that indicates that the object can be deleted. It is also preferable that the delete button 110 has a function of accepting the deletion of the object.

[0016] The user presses only the delete button 110 of the tag object 102 that the user wants to delete (FIG. 3(b)). This allows the user to delete only the tag object 102 whose delete button 110 was pressed (FIG. 3(c)).

[0017] Therefore, even if the handwritten object 101 and the standard object overlap, the user can delete only the handwritten object 101, and further, if the user wishes to delete the standard object, he or she can delete it with a single touch of the delete button 110.

[0018] When the handwritten object 101 and the standard object do not overlap, if the eraser tool 104 moves the standard object, the display device may directly delete the standard object.

[0019] <Terminology> The input means may be any means capable of specifying coordinates on a touch panel and writing by hand, such as a pen, a human finger or hand, or a rod-shaped member.

[0020] A stroke refers to a series of operations in which a user presses an input means against a display, moves it continuously, and then releases it from the display. Stroke data is information displayed on the display based on a trajectory of coordinates input by the input means. Stroke data may be appropriately interpolated. Handwritten data is data having one or more stroke data. Handwritten input refers to handwritten data being input by a user.

[0021] Character strings converted from handwritten data through character recognition may include, in addition to text data, data displayed based on user operations, such as stamps displayed as fixed characters such as "Done," marks, shapes such as circles, rectangles, lines, and stars, speech bubbles, and sticky notes. A character string is one or more characters handled by a computer. The actual substance of a character string is a character code. Characters include numbers, alphabets, and symbols. Character strings are also called text data.

[0022] An object displayed on a display is called an object. An object means a target, but in this embodiment it means a display target. In this embodiment, handwritten data, figures (circles, rectangles, arrows, etc.), stamps, speech bubbles, sticky notes, images, and the like are also objects. Handwritten data is represented as a handwritten object when viewed from the display device. Other objects are also represented as standard objects when viewed from the display device. There is no essential difference between handwritten data and handwritten objects, and in this embodiment, the terms will be used appropriately for explanation.

[0023] A display part is one of the display elements that make up a screen, and directly or indirectly accepts user operations. In this embodiment, an operation command is used as an example, but the display part may be a character that presents an operation, a check box, a text entry, a button, or an icon. In addition, the display part may be a target that the user can press when using an input means, and may be implemented so that a predetermined process is executed when the display part is pressed.

[0024] <Configuration example> 4 shows an example of a schematic perspective view of the display device 2. A user (user) uses the display device 2. The display device 2 of this embodiment allows the user to handwrite on the display using an input means 291 such as a hand or an electronic pen 2500.

[0025] 4 is placed horizontally, but it can also be placed vertically. The user can switch between horizontal and vertical orientations by rotating the display device 2 around the center of the display.

[0026] <Hardware configuration example> 5 is a diagram showing an example of a hardware configuration of the display device 2. The display device 2 of this embodiment includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an SSD (Solid State Drive) 204, a network controller 205, and an external device connection I / F 206 (Interface), and is a shared terminal for sharing information among a plurality of users.

[0027] Of these, the CPU 201 controls the overall operation of the display device 2. The ROM 202 stores the CPU 201 and programs used to drive the CPU 201, such as an IPL (Initial Program Loader). The RAM 203 is used as a work area for the CPU 201.

[0028] The SSD 204 stores various data such as programs for the display device 2. The programs may be applications that run on an information processing device equipped with a general-purpose OS (Windows (registered trademark), Mac OS (registered trademark), Android (registered trademark), iOS (registered trademark), etc.).

[0029] A network controller 205 controls communication with a network. An external device connection I / F 206 controls communication with a USB (Universal Serial Bus) memory 2600 and external devices (a camera 2900, a speaker 2800, and a microphone 2700).

[0030] The display device 2 also includes a capture device 211, a GPU 212, a display controller 213, a contact sensor 214, a sensor controller 215, an electronic pen controller 216, a short-range communication unit 219, and an antenna 219a of the short-range communication unit 219.

[0031] Of these, the capture device 211 displays video information as still images or moving images on the display of the PC 10. The GPU (Graphics Processing Unit) 212 is a semiconductor chip that specializes in graphics. The display controller 213 controls and manages the screen display in order to output the output image from the GPU 212 to the display 220 etc.

[0032] The contact sensor 214 detects that the electronic pen 2500, the user's hand H, or the like has come into contact with the display 220. When the electronic pen 2500 and the hand H are not distinguished from each other, they are referred to as an input means 291.

[0033] The sensor controller 215 controls the processing of the contact sensor 214. The contact sensor 214 inputs and detects coordinates by an infrared blocking method. The method of inputting and detecting coordinates may be a method in which two light receiving and emitting devices installed at both ends of the upper side of the display 220 emit a plurality of infrared rays parallel to the display 220, and receive light that is reflected by a reflecting member installed around the display 220 and returns along the same optical path as the optical path of the light emitted by the light receiving element.

[0034] The contact sensor 214 outputs the ID of the infrared rays radiated by the two light receiving and emitting devices that are blocked by the object to the sensor controller 215, and the sensor controller 215 specifies the coordinate position that is the contact position of the object. The electronic pen controller 216 communicates with the electronic pen 2500 to determine whether the pen tip or the pen tail has touched the display 220. The near field communication unit 219 is a communication circuit such as NFC or Bluetooth (registered trademark).

[0035] Furthermore, the display device 2 includes a bus line 210. The bus line 210 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 201.

[0036] The contact sensor 214 is not limited to an infrared blocking type, and may be a capacitive touch panel that identifies the contact position by detecting a change in capacitance. The contact sensor 214 may be a resistive film type touch panel that identifies the contact position by a voltage change in two opposing resistive films. The contact sensor 214 may be an electromagnetic induction type touch panel that identifies the contact position by detecting electromagnetic induction caused by a contact object touching the display unit. The contact sensor 214 may use these various detection means. The electronic pen controller 216 may determine whether or not the user is holding not only the tip and the end of the electronic pen 2500, but also the part of the electronic pen 2500 that the user holds. The electronic pen controller 216 may determine whether or not other parts of the electronic pen are touched.

[0037] <About the function> Fig. 6 is a diagram showing an example of a functional block diagram for explaining functions of the display device 2 in blocks. The display device 2 shown in Fig. 6 includes a handwriting input unit 11, a drawing data generation unit 12, an operation reception unit 13, an object management unit 14, a character recognition unit 15, a display control unit 17, a conference data storage unit 16, and a network communication unit 18.

[0038] Each function of the display device 2 is a function or means realized when any of the components shown in FIG. 5 operates in response to an instruction from the CPU 201 in accordance with an application deployed on the RAM 203.

[0039] The handwriting input unit 11 obtains coordinate data of the position where the input means 291 contacts the contact sensor 214, and accepts handwriting input by the user. Handwriting input is input using the locus of coordinates where the input means contacts the contact sensor 214. The handwriting input unit 11 obtains a coordinate data string from handwriting input (writing) by the user. The handwriting input unit 11 may obtain the coordinate data string as discrete values. Coordinate data between discrete values ​​is interpolated.

[0040] The drawing data generation unit 12 generates a handwritten object 101 from the coordinate data string obtained by the handwriting input unit 11 when the user writes by hand. The drawing data generation unit 12 also generates standard objects such as figures (circles, rectangles, arrows, etc.), stamps, speech bubbles, and sticky notes from the coordinate data or coordinate data string obtained by the handwriting input unit 11. For example, the user operates the input means to call up registered objects such as figures (circles, rectangles, arrows, etc.), stamps, speech bubbles, and sticky notes. This allows the user to generate standard objects such as figures (circles, rectangles, arrows, etc.), stamps, speech bubbles, and sticky notes.

[0041] Objects are mainly divided into handwritten data and other standard objects. Standard objects often have a fixed shape and are called standard objects. Standard objects are displayed objects such as figures (circles, rectangles, arrows, etc.), stamps, speech bubbles, sticky notes, and images.

[0042] The operation reception unit 13 receives user operations on an operation menu that receives user operations with icons and buttons. For example, when a user wants to delete an object, the user selects an eraser tool, and the operation reception unit 13 receives this selection based on the coordinates that the tip of the input means 291 touches.

[0043] The object management unit 14 manages various objects such as the objects generated by the drawing data generation unit 12. The object management unit 14 includes a handwritten object management unit 19 and a fixed object management unit 20.

[0044] The object management unit 14 stores information on each object in an object information storage unit 21, which will be described later. Details will be described with reference to Fig. 8. The handwritten object management unit 19 manages handwritten objects in the object information storage unit 21. The fixed object management unit 20 manages fixed objects in the object information storage unit 21.

[0045] Based on the handwritten data received by the handwriting input unit 11, the character recognition unit 15 performs character recognition of the data handwritten by the user by comparing it with dictionary data such as a handwriting recognition dictionary, and outputs a character string (internally, a character code).

[0046] The character recognition unit 15 recognizes characters (not only Japanese but also multiple languages ​​such as English), numbers, symbols, etc. in parallel with the user's handwriting input operation. Various algorithms have been devised for handwriting recognition methods, but details will be omitted since publicly known technology can be used.

[0047] When a predetermined time (e.g., 2 seconds) has elapsed without any further input after the end of input of a handwritten character or a handwritten character string, the character recognition unit 15 outputs a character recognition process end command. The display control unit 17 controls the display of various objects, operation menus, etc. on the display 220.

[0048] The conference data storage unit 16 stores data of materials used in the conference in the storage unit 16. The network communication unit 18 connects to a network such as a LAN or the Internet to transmit and receive data.

[0049] <Examples of various objects> Next, objects displayed in this embodiment will be described with reference to Fig. 7. Fig. 7 shows an example of various objects displayed on the display 220. In Fig. 7, objects 1002, 1004, 1006, 1008, and 1009 are displayed. Of these, objects 1002, 1004, 1006, and 1008 are standard objects. Object 1009 is a handwritten object. Standard objects are objects that can be displayed when the display device 2 specifies a character code and a display command. Handwritten objects can have any shape, so they cannot be displayed by a display command alone. In addition to these, there are various other standard objects, such as images, figures, and stamps.

[0050] Objects 1002 and 1004 are character strings converted by character recognition (character codes). Object 1006 is a speech bubble, inside which the user can display characters. Object 1008 is a sticky note, and there are sticky notes of various colors. The user can display characters, figures, handwritten data, etc. inside object 1008. Object 1009 is handwritten data, and is composed of a coordinate point sequence, color, thickness, etc.

[0051] In this embodiment, a method of deleting a handwritten object and a fixed object that overlap will be mainly described.

[0052] <Object information managed by object management unit 14> Fig. 8 shows object information stored in the object information storage unit 21. First, Fig. 8(a) shows a management table 301 for managing objects. The ID is information that identifies an object. Type is the type of object. In Fig. 8, the object types are a handwritten object, an image object, and a sticky note object. ParentID is the ID of the object to which the object belongs. For example, in the case of a handwritten object, the ID of the page object on which the handwritten object is displayed is set. {Type} is data specific to the object type. {Type} contains a value according to whether the object is a handwritten object, an image object, or a sticky note object.

[0053] FIG. 8(b) shows an example of data corresponding to {Type} of a handwritten object. ·color is the color information of the stroke data. ·Points are the coordinate points of the stroke data.

[0054] FIG. 8C shows an example of data corresponding to {Type} of an image object, which is a fixed-form object. ·X is the X coordinate of the upper left corner of the bounding rectangle of the image data. ·Y is the Y coordinate of the upper left corner of the bounding rectangle of the image data. Z is the display order of image data in the depth direction (line of sight) of the screen when standard objects overlap. For example, the larger the number, the closer it is to the user. ·Width is the width of the bounding rectangle of the image data. ·Height is the height of the bounding rectangle of the image data. ·Data is the path to the image data.

[0055] FIG. 8D shows an example of data corresponding to {Type} of a sticky note object, which is a fixed form object. ·X is the X coordinate of the upper left corner of the bounding rectangle of the sticky note. ·Y is the Y coordinate of the top left corner of the bounding rectangle of the sticky note. Z is the display order of the image data in the depth direction (line of sight) of the sticky note. For example, the larger the value, the closer it is to the user. The Z value (Z coordinate) is used to determine which standard object the user should delete when the sticky note object overlaps with other standard objects. ·Width is the width of the bounding rectangle of the sticky note. ·Height is the height of the bounding rectangle of the sticky note. ·color is the color of the sticky note.

[0056] Fig. 9 shows an example of data stored in object information storage unit 21 when Type is an image object. The ID, Type, and ParentID are as described above. When Type is image data, the data in Fig. 8(c) is stored in {Type} in Fig. 8(a). In this way, data according to the type of object is stored in the {Type} item in Fig. 8.

[0057] <Eraser mode and handwriting mode> 10 shows an example of an operation method in which the user switches between the eraser mode and the handwriting mode. The display control unit 17 displays an operation menu 130. This operation menu 130 has an eraser button 132 with which the user selects the eraser mode, and a handwriting button 131 with which the user selects the handwriting mode.

[0058] In Fig. 10(a), the user presses the eraser button 132 with the input means 291. This causes the display device 2 to transition to the eraser mode. In the eraser mode, of the coordinate points of the handwritten object, the coordinate points that are the same as the coordinates where the input means 291 touches the display 220 are deleted (a small margin may be allowed). Note that the entire handwritten object may be deleted by the user performing a specified operation.

[0059] In the eraser mode, any standard object that overlaps even a part of the coordinates where the input means 291 touches the display 220 is temporarily deleted.

[0060] 10(b), the user presses the handwriting button 131 with the input means 291. This causes the display device 2 to transition to handwriting mode. In the handwriting mode, the drawing data generating unit 12 sequentially connects the coordinate points where the input means 291 touches the display 220, thereby displaying handwritten data.

[0061] Note that the display device 2 transitions to the eraser mode when the end of the electronic pen is pressed against the display 220, even if the eraser button 132 is not pressed. When the tip or end of the electronic pen is pressed against the display 220, the electronic pen transmits a signal corresponding to the tip or end of the pen being pressed to the display device 2. Therefore, the display device 2 transitions to the eraser mode only while the end of the electronic pen is being pressed.

[0062] <Object display example> Fig. 11 shows an example of several objects displayed on the display 220. As shown in Fig. 11, a handwritten object 101, a character string object 103, and a sticky note object 102 are displayed. In Fig. 11, a part of the handwritten object 101 overlaps with the character string object 103 and the sticky note object 102.

[0063] Fig. 12 shows object information when the object shown in Fig. 11 is displayed. In a management table 301 in Fig. 12(a), data 302 of a handwritten object 101, data 304 of a character string object 103, and data 303 of a sticky note object 102 are registered.

[0064] Fig. 12(b) shows an example of data 302 of a handwritten object 101, Fig. 12(c) shows an example of data 304 of a character string object 103, and Fig. 12(d) shows an example of data 303 of a sticky note object 102. The items of each data example may be the same as those in Fig. 8.

[0065] The temporary deletion states of the character string object 103 and the tag object 102, which are fixed form objects, are managed in a temporary deletion state management table 310 that is generated when the mode is changed to the eraser mode.

[0066] 13 shows a state in which the eraser button 132 is pressed. When the user presses the eraser button 132, the display device 2 transitions to the eraser mode, and the object management unit 14 generates a temporary deletion state management table 310.

[0067] 14 is an example of the temporary deletion state management table 310. The temporary deletion state management table 310 is generated when the display device 2 transitions to the eraser mode. It is assumed that the user presses the eraser button 132 and the display device 2 transitions to the eraser mode.

[0068] Fig. 14(a) shows an example of the temporary deletion state management table 310. Fig. 14(b) is an example of data for a sticky note object 102, and Fig. 14(c) is an example of data for a character string object 103. An ID is assigned to every standard object displayed on the display 220, and the ID is registered in the temporary deletion state management table 310. The temporary deletion state management table 310 manages whether a standard object is in a temporarily deleted state.

[0069] Immediately after the temporary deletion state management table 310 is generated by switching to the eraser mode (initial state), each standard object is not in a temporary deletion state. Not in a temporary deletion state is indicated by False, and not in a temporary deletion state is indicated by True.

[0070] The IDs in the temporary deletion state management table 310 are associated with the respective standard objects stored in the object information storage unit 21.

[0071] <Delete object> Fig. 15 shows the trajectory 106 of the user pressing the input means 291 against the display 220 in eraser mode. As shown in Fig. 15, the user moves the eraser tool 104 with the input means 291. That is, the user moves the input means 291 so that it passes through an area where both the sticky note object 102 and the handwritten object 101 overlap, and further passes through the character string object 103. Therefore, the character string object 103 and the sticky note object 102 are temporarily deleted. The part of the handwritten object 101 that the eraser tool 104 passed through is deleted.

[0072] Fig. 16 shows the temporary deletion state management table 310 when the user moves the input means 291 in eraser mode as shown in Fig. 15. Because the user passes the input means 291 over both the sticky note object 102 and the character string object 103, the sticky note object 102 and the character string object 103 are in a temporary deletion state. As shown in the temporary deletion state management table 310 in Fig. 16(a), the temporary deletion state of the character string object 103 and the sticky note object 102 becomes "True". Figs. 16(b) and (c) may be the same as Figs. 14(b) and (c).

[0073] The display control unit 17 displays the delete button 110 as shown in Fig. 15 in association with a standard object whose temporary deletion state is "True". In Fig. 15, the delete button 110 is displayed in the upper right of the sticky note object 102 and the character string object 103. The display position of the delete button 110 is not limited to the upper right, but may be around the standard object, such as the upper left, lower right, lower left, or center. Also, for example, the delete button may be displayed when the input means 291 hovers over the standard object.

[0074] 17 is a diagram illustrating the deletion of a standard object by pressing the delete button 110. As shown in FIG. 17, the user presses the delete button 110 displayed in the upper right corner of the sticky note object 102. The operation accepting unit 13 accepts the press, and the display control unit 17 deletes the sticky note object 102 from the display 220.

[0075] 18 shows a state in which the tag object 102 has been deleted. In this manner, the user can delete a standard object by selecting the standard object with the eraser tool and pressing the delete button 110.

[0076] Fig. 19 shows the object information after the sticky note has been deleted. Fig. 19(a) corresponds to Fig. 12(a). Fig. 19(b) corresponds to Fig. 12(b). Fig. 19(c) corresponds to Fig. 12(c). In Fig. 19(a), data 303 of sticky note object 102 has been deleted from management table 301 in Fig. 12(a). Also, in Fig. 19, data 303 of sticky note object 102 shown in Fig. 12(d) is also gone.

[0077] Next, Fig. 20 shows the temporary deletion state management table 310 after the sticky note object 102 has been deleted. Fig. 20(a) corresponds to Fig. 16(a), and Fig. 20(b) corresponds to Fig. 12(c).

[0078] In the temporarily deleted state management table 310 in Fig. 20, the data of the sticky note object 102 has been deleted. Therefore, in Fig. 20, the association between the sticky note object 102 and the object information is also eliminated.

[0079] <Return to handwriting mode> 21, the user then presses the handwriting button 131, and the display device 2 transitions to the handwriting mode. FIG. 21 shows a state in which the user has pressed the handwriting button 131.

[0080] The operation reception unit 13 receives a press of the handwriting button 131. When the display device 2 transitions from the eraser mode to another mode, the object management unit 14 cancels the temporarily deleted state of all standard objects. That is, the object management unit 14 deletes the temporarily deleted state management table 310.

[0081] Furthermore, since the fixed form object is no longer in the temporarily deleted state, the display control unit 17 hides the delete button 110.

[0082] <State transition of temporary deletion state> Fig. 22 is a diagram for explaining the state transition of the temporary deletion state. The process in Fig. 22 starts from a state in which the user has shifted to the eraser mode.

[0083] The user operates the eraser tool 104 with the input means 291 to select an object. The operation reception unit 13 receives the selection of the object based on the coordinates of the input means 291 detected by the handwriting input unit 11 (S101).

[0084] The object management unit 14 determines whether the selected object is a handwritten object or a standard object (S102).

[0085] If the selected object is a handwritten object, the handwritten object management unit 19 deletes the portion of the handwritten object that coincides with the coordinates of the eraser tool 104 (S104).

[0086] If the selected object is a standard object, the standard object management unit 20 transitions the selected standard object to a temporarily deleted state (S103). The display control unit 17 displays a delete button 110 on the standard object in the temporarily deleted state.

[0087] The object management unit 14 periodically determines whether the eraser mode is continuing (S105).

[0088] If the eraser mode is continued, the selected standard object may remain in the temporarily deleted state, and the display control unit 17 may continue to display the delete button 110 for the standard object in the temporarily deleted state (S106).

[0089] The user presses the delete button 110 with the input means 291. The operation acceptance unit 13 accepts the pressing of the delete button 110 based on the coordinates of the input means 291 detected by the handwriting input unit 11 (S107).

[0090] The standard object management unit 20 deletes the standard object for which the delete button 110 has been pressed from the object information storage unit 21, and deletes the data of the standard object from the temporary deletion state management table 310 (S108).

[0091] When the display device 2 transitions to the handwriting mode, the object management unit 14 discards the temporary deletion state table (S109).

[0092] <Processing flow> FIG. 23 is a sequence diagram illustrating an example of a method for deleting an object displayed on the display device.

[0093] S1: In handwriting mode, the user writes by hand using the input means 291. The handwriting input unit 11 of the application detects the coordinates where the tip of the input means 291 touches the display 220, and accepts the input of the coordinate point. The drawing data generation unit 12 generates handwritten data by interpolating the coordinates, and the display control unit 17 displays the handwritten object 101.

[0094] S2: The object management unit 14 registers the object information of the handwritten object 101 in the object information storage unit 21. That is, the object management unit 14 assigns an ID, and registers the ID of the handwritten object, Type=handwritten object, ParentID, and {Type} in the management table 301.

[0095] S3: Next, the user switches to the eraser mode using the input means 291. The operation acceptance unit 13 of the application accepts the transition to the eraser mode.

[0096] S4: When the mode is changed to the eraser mode, the object management unit 14 generates the temporary deletion state management table 310.

[0097] S5: The object management unit 14 associates the object information with the temporarily deleted state management table 310. That is, the object management unit 14 registers the IDs and temporarily deleted states (False) of all displayed typical objects in the temporarily deleted state management table 310.

[0098] S6: The user moves the eraser tool 104 with the input means 291 in contact with the display 220 to select a standard object to be deleted. That is, the user moves the input means 291 so that the eraser tool 104 passes through the standard object to be deleted.

[0099] S7: In the eraser mode, the handwritten object management unit 19 deletes, from among the coordinate points of the handwritten object 101, the coordinate points that are the same as the coordinates at which the input means 291 touches the display 220.

[0100] S8: The standard object management unit 20 also detects standard objects overlapping the trajectory of the eraser tool 104. The standard object management unit 20 sets the temporary deletion state of the standard object overlapping the trajectory of the eraser tool to True. The display control unit 17 displays the delete button 110 in association with the standard object whose temporary deletion state is True.

[0101] The standard object management unit 20 may determine whether the trajectory of the eraser tool 104 on the standard object overlaps with the handwritten object 101. The standard object management unit 20 may set the provisionally deleted state of the standard object to True only if the handwritten object 101 is deleted on the standard object. The standard object management unit 20 directly deletes the standard object only if the handwritten object 101 is not deleted on the standard object.

[0102] S9: The user presses the delete button 110. The operation acceptance unit 13 accepts the fixed form object for which the delete button 110 has been pressed, based on the coordinates accepted by the handwriting input unit 11.

[0103] S10: The standard object management unit 20 deletes the standard object for which the delete button 110 has been pressed from the object information storage unit 21. The display control unit 17 deletes the standard object deleted from the object information storage unit 21 from the display 220.

[0104] S11: The standard object management unit 20 deletes the data of the standard object deleted from the object information storage unit 21 from the provisional deletion state management table 310.

[0105] S12: Next, the user switches to the handwriting mode using the input means 291. The operation acceptance unit 13 of the application accepts the transition to the handwriting mode.

[0106] S13: Since the mode has changed to the handwriting mode, the object management unit 14 discards the temporary deletion state management table 310.

[0107] <About the Z coordinate of an object> As explained in Fig. 8, objects on the display device 2 have Z coordinates. When a user overlaps an object that is already displayed, the Z coordinate of the object in front becomes one greater than the Z coordinate of the object in the back. The user can only access the object that has the largest Z coordinate among the overlapping objects.

[0108] Fig. 24 is a diagram showing an example of overlapping standard objects. In Fig. 24, two sticky note objects 102a and 102b overlap. The user selects the overlapping sticky note objects 102a and 102b with the eraser tool 104. In this case, the user can transition to a temporary deletion state only the sticky note object 102a with the largest Z coordinate.

[0109] 25 shows the sticky note object 102a on the front side that is in a temporarily deleted state. Only the sticky note object 102a with the largest Z coordinate has a delete button 110 displayed. When the user presses the delete button 110, the standard object management unit 20 deletes the sticky note object 102a.

[0110] FIG. 26 shows the sticky note object 102b remaining after the sticky note object 102a with the largest Z coordinate has been deleted.

[0111] FIG. 27 is an example of a sequence diagram illustrating a method for setting the Z coordinate.

[0112] S201: In the handwriting mode, the user adds a new sticky note object using the input means 291. The operation reception unit 13 of the application detects the coordinates where the tip of the input means 291 touches the display 220, and the standard object management unit 20 determines the display position of the sticky note object 102.

[0113] S202: The standard object management unit 20 judges whether or not another standard object is already present in the display area of ​​the sticky note object 102. The standard object management unit 20 compares the circumscribing rectangle of the newly added sticky note object 102 with the circumscribing rectangle of another standard object that is already displayed. Note that the standard object management unit 20 may also include the handwritten object 101 in the comparison, or may not include the handwritten object 101 in the comparison. If the handwritten object 101 is always displayed at the forefront, there is no need to compare, but if the handwritten object 101 is hidden by the sticky note object 102, a comparison is performed.

[0114] If there are a plurality of already-displayed standard objects that overlap the circumscribing rectangle of the newly added tag object 102, the standard object management unit 20 identifies the standard object with the largest Z coordinate.

[0115] S203: If there is already another standard object in the display area of ​​the newly added sticky note object 102, the standard object management unit 20 increments the Z coordinate of the standard object with the largest Z coordinate by +1, and adds the new sticky note object 102 to the object information storage unit 21.

[0116] S204: If there is no other standard object in the display area of ​​the newly added sticky object 102, the standard object management unit 20 sets the Z coordinate of the newly added sticky object 102 to 1 and adds the sticky object 102 to the object information storage unit 21.

[0117] The procedure for deleting overlapping standard objects may be the same as that in the sequence diagram of Fig. 23. In this case, in step S8, the standard object management unit 20 updates only the provisional deletion state of the standard object with the largest Z coordinate to True in the provisional deletion state management table 310.

[0118] In this manner, the display device 2 of this embodiment allows the user to delete the standard object in the foreground even if multiple standard objects overlap.

[0119] <Major Effects> As described above, the display device 2 of this embodiment can delete only the handwritten object 101 even if the handwritten object 101 and a standard object overlap, and further, if you want to delete the standard object, you can delete it with a single touch of the delete button 110. EXAMPLES

[0120] In this embodiment, a display device 2 having a user interface that allows a user to collectively delete multiple standard objects in a temporarily deleted state will be described.

[0121] In this embodiment, the hardware configuration diagram of FIG. 5 and the functional block diagram of FIG. 6 described in the above embodiment can be used.

[0122] Fig. 28 shows an example of the deletion dialog 120 displayed by the display device 2. As described with reference to Fig. 15 etc., when the user selects a standard object with the eraser tool 104, the standard object management unit 20 registers in the temporary deletion state management table 310 that the temporary deletion state of the standard object is True.

[0123] The display control unit 17 of this embodiment displays a delete dialog 120 instead of displaying the delete button 110 (or together with the delete button 110). The delete dialog 120 displays a delete all button 121, a list 123 of standard objects whose temporary deletion status is True, and a delete individual button 122. By pressing the delete all button 121, the user can collectively delete the standard objects whose temporary deletion status is True and displayed in the list 123 of standard objects.

[0124] The list of standard objects 123 also has thumbnails 123a, 123b and check boxes 124a, 124b of the standard objects. The user can selectively delete standard objects by pressing the check boxes 124a, 124b with the input means 291 to select them, and then pressing the individual delete button 122.

[0125] Fig. 29 is a sequence diagram of an example explaining a deletion method for deleting standard objects collectively. Note that the explanation of Fig. 29 will mainly explain the differences from Fig. 23. Steps S21 to S28 may be the same as steps S1 to S8 in Fig. 23.

[0126] S28-2: When the temporary deletion state of the standard object overlapping the trajectory of the eraser tool is set to True, the display control unit 17 displays the deletion dialog 120 including the list 123 of standard objects whose temporary deletion state is True.

[0127] S29: The user presses the delete all button 121. The operation acceptance unit 13 accepts the pressing of the delete all button 121 based on the coordinates accepted by the handwriting input unit 11. Alternatively, when the user selects a standard object using the check box 124 and presses the delete individual button 122, the operation acceptance unit 13 accepts the selected standard object based on the coordinates accepted by the handwriting input unit 11.

[0128] S30: When the Delete All button 121 is pressed, the standard object management unit 20 deletes the standard objects whose provisional deletion status is True from the object information storage unit 21. When the Delete Individual button 122 is pressed, the standard object management unit 20 deletes the standard objects selected in the check boxes 124 from the object information storage unit 21. As a result, the display control unit 17 deletes the standard objects from the display 220.

[0129] S31: The standard object management unit 20 deletes the data of the standard object deleted from the object information storage unit 21 from the temporary deletion state management table 310.

[0130] The subsequent processing may be the same as that in FIG.

[0131] <Major Effects> According to the display device 2 of the present embodiment, in addition to the effect of the first embodiment, the user can collectively delete a plurality of standard objects in a temporarily deleted state. EXAMPLES

[0132] In the first embodiment, among the fixed-form objects overlapping the coordinates of the eraser tool, only the provisionally deleted state of the fixed-form object having the largest Z coordinate is set to True.

[0133] In this embodiment, a display device 2 will be described that allows the user to delete a typical object whose Z coordinate is not the maximum.

[0134] In this embodiment, the hardware configuration diagram of FIG. 5 and the functional block diagram of FIG. 6 described in the above embodiment can be used.

[0135] 30 shows a state in which the user selects multiple overlapping standard objects with the eraser tool 104. In this embodiment, the standard object management unit 20 changes the provisional deletion state of all standard objects whose coordinates are overlapped by the eraser tool 104 to True.

[0136] As in the second embodiment, the display control unit 17 displays all standard objects whose temporary deletion status is True in the deletion dialog 120. The configuration of the deletion dialog 120 may be the same as that in FIG.

[0137] Fig. 31 shows the delete dialog in which a standard object is selected. As shown in Fig. 31, the delete dialog 120 also displays standard objects whose Z coordinates are not the maximum, so the user can select and delete standard objects whose Z coordinates are not the maximum. When the thumbnail 123c of the sticky note object 102b is selected in the delete dialog 120, the sticky note object 102b becomes half-bright.

[0138] Fig. 32 shows a state in which the routine object selected in the delete dialog 120 has been deleted. In Fig. 32, the sticky note object 102b that is not the foremost one has been deleted.

[0139] In this way, even if a plurality of standard objects are overlapped, the display device 2 displays the deletion dialogue 120, so that the user can delete the desired standard object without deleting it by mistake.

[0140] Fig. 33 is a sequence diagram of an example explaining a deletion method for selectively deleting a standard object displayed in the deletion dialog. Note that the explanation of Fig. 33 mainly explains the differences from Fig. 29. Steps S41 to S47 may be the same as steps S21 to S27 in Fig. 29.

[0141] S48: The standard object management unit 20 detects a standard object that overlaps with the path of the eraser tool. The standard object management unit 20 sets the temporary deletion state of the standard object that overlaps with the coordinates of the path of the eraser tool 104 to True regardless of the Z coordinate.

[0142] S48-2: When the temporary deletion state of the standard object overlapping the trajectory of the eraser tool 104 is set to True, the display control unit 17 displays the deletion dialog 120 including the list 123 of standard objects whose temporary deletion state is True.

[0143] S49: The user presses the check box 124 in the delete dialog 120, and then presses the delete individual button 122. The operation accepting unit 13 accepts the standard object for which the check box 124 was pressed, based on the coordinates accepted by the handwriting input unit 11. If the delete all button is pressed, the same process as in FIG. 29 may be performed.

[0144] S50: The standard object management unit 20 deletes the standard object selected in the check box 124 from the object information storage unit 21. As a result, the display control unit 17 deletes the standard object from the display 220.

[0145] S51: The standard object management unit 20 deletes the data of the standard object deleted in the object information storage unit 21 from the provisional deletion state management table 310.

[0146] The subsequent processing may be the same as that in FIG.

[0147] <Major Effects> According to the display device 2 of this embodiment, in addition to the effects of the first and second embodiments, the user can selectively delete standard objects regardless of the Z coordinate. EXAMPLES

[0148] In the first to third embodiments, a standard object is deleted by pressing the delete button 110, the delete all button 121, or the delete individual button 122. In the present embodiment, a display device 2 will be described in which a standard object in a provisionally deleted state can be deleted when the user selects it with the eraser tool 104.

[0149] In this embodiment, the hardware configuration diagram of FIG. 5 and the functional block diagram of FIG. 6 described in the above embodiment can be used.

[0150] 34 shows a typical object whose temporary deletion state is True and the Delete button 110 is displayed. The user operates the eraser tool 104 with the input means 291 to press the typical object whose temporary deletion state is True. The user does not need to press the Delete button 110. The typical object management unit 20 identifies the selected typical object based on the coordinates where the input means 291 touches the display 220. The typical object management unit 20 deletes the selected typical object from the object information storage unit 21, and therefore the display control unit 17 deletes the selected typical object from the display 220.

[0151] Fig. 35 shows a state in which the tag object 102 selected with the eraser tool 104 has been deleted. The tag object 102 selected with the eraser tool 104 in Fig. 34 has been deleted.

[0152] Fig. 36 is a sequence diagram of an example explaining a method for deleting a standard object with an eraser tool. Note that the explanation of Fig. 36 mainly explains the differences from Fig. 23. Steps S61 to S68 may be the same as steps S1 to S8 in Fig. 23.

[0153] S69: The user selects a standard object whose temporary deletion state is True with the eraser tool 104. The standard object management unit 20 accepts the pressing of the standard object based on the coordinates accepted by the handwriting input unit 11.

[0154] S70: The standard object management unit 20 deletes the standard object selected by the user, which is a standard object whose provisional deletion state is True, from the object information storage unit 21. As a result, the display control unit 17 deletes the standard object from the display 220.

[0155] S71: The standard object management unit 20 deletes from the temporary deletion state management table 310 the data of the standard object selected by the user, which is a standard object whose temporary deletion state is True.

[0156] The subsequent processing may be the same as that in FIG.

[0157] <Major Effects> According to the display device 2 of the present embodiment, in addition to the effect of the first embodiment, the user can delete a fixed form object in a temporarily deleted state with an eraser tool. EXAMPLES

[0158] In the following embodiment, another configuration example of the display device 2 will be described.

[0159] <<Another configuration example 1 of the display device>> Although the display device 2 of the present embodiment has been described as having a large touch panel, the display device 2 is not limited to having a touch panel.

[0160] Fig. 37 is a diagram showing another example of the configuration of the display device 2. In Fig. 37, a projector 411 is installed on the upper side of a normal whiteboard 413. This projector 411 corresponds to the display device 2. The normal whiteboard 413 is not a flat panel display integrated with a touch panel, but a whiteboard on which a user directly writes by hand with a marker. The whiteboard may be a blackboard, and may be any flat surface large enough to project an image.

[0161] The projector 411 has an ultra-short focal length optical system and can project an image with little distortion from a distance of about 10 cm onto the whiteboard 413. This image may be transmitted from a PC connected wirelessly or via a wire, or may be stored in the projector 411.

[0162] A user writes handwriting on the whiteboard 413 using a dedicated electronic pen 2501. The electronic pen 2501 has a light-emitting part, for example at the tip, that is switched on and emits light when the user presses it against the whiteboard 413 to write. The wavelength of the light is near-infrared or infrared, so it is invisible to the user's eyes. The projector 411 has a camera that captures the light-emitting part, analyzes the image, and identifies the direction of the electronic pen 2501. The electronic pen 2501 also emits sound waves along with the light emission, and the projector 411 calculates the distance based on the arrival time of the sound waves. The projector 411 can identify the position of the electronic pen 2501 based on the direction and distance. Handwritten data is drawn (projected) at the position of the electronic pen 2501.

[0163] Since the projector 411 projects the menu 430, when the user presses a button with the electronic pen 2501, the projector 411 identifies the position of the electronic pen 2501 and the pressed button by the ON signal of the switch. For example, when the save button 431 is pressed, the handwritten data (coordinate point sequence) handwritten by the user is saved by the projector 411. The projector 411 saves the handwritten information in a predetermined server 412 or USB memory 2600 or the like. The handwritten information is saved for each page. Since the information is saved as coordinates rather than as image data, the user can re-edit it. However, in this embodiment, the menu 430 does not need to be displayed because the operation command can be called up by handwriting. EXAMPLES

[0164] <<Another configuration example 2 of the display device>> 38 is a diagram showing another example of the configuration of the display device 2. In the example of FIG.

[0165] The terminal device 600 is connected by wire to the image projection device 700A and the pen motion detection device 810. The image projection device 700A projects image data input by the terminal device 600 onto the screen 800.

[0166] The pen operation detection device 810 communicates with the electronic pen 820 and detects the operation of the electronic pen 820 in the vicinity of the screen 800. Specifically, the electronic pen 820 detects coordinate information indicating a point pointed to by the electronic pen 820 on the screen 800 (the detection method may be the same as that in FIG. 37 ), and transmits the coordinate information to the terminal device 600.

[0167] The terminal device 600 generates image data of handwritten data input by the electronic pen 820, based on the coordinate information received from the pen operation detection device 810. The terminal device 600 causes the image projection device 700A to draw an image of the handwritten data on the screen 800.

[0168] Furthermore, the terminal device 600 generates superimposed image data indicating a superimposed image obtained by combining the background image projected by the image projection device 700A and the image of the handwritten data input by the electronic pen 820. EXAMPLES

[0169] <<Another configuration example 3 of the display device>> Fig. 39 is a diagram showing a configuration example of the display device 2. In the example of Fig. 39, the display device 2 includes a terminal device 600, a display 800A, and a pen motion detection device 810A.

[0170] The pen action detection device 810A is disposed near the display 800A, detects coordinate information indicating a point indicated by the electronic pen 820A on the display 800A (the detection method may be the same as in FIG. 37), and transmits the coordinate information to the terminal device 600. In the example of FIG. 39, the electronic pen 820A may be charged by the terminal device 600 via a USB connector.

[0171] The terminal device 600 generates image data of handwritten data input by the electronic pen 820A, based on the coordinate information received from the pen operation detection device 810. The terminal device 600 displays the image data on the display 800A. EXAMPLES

[0172] <<Another Configuration Example 4 of the Display Device>> Fig. 40 is a diagram showing a configuration example of the display device 2. In the example of Fig. 40, the display device 2 includes a terminal device 600 and an image projection device 700A.

[0173] The terminal device 600 performs wireless communication (Bluetooth (registered trademark) or the like) with the electronic pen 820B to receive coordinate information of a point indicated by the electronic pen 820B on the screen 800. The coordinate information may be obtained by the electronic pen 820B reading minute position information formed on the screen 800, or the coordinate information may be received from the screen 800.

[0174] Then, based on the received coordinate information, the terminal device 600 generates image data of the handwritten data input by the electronic pen 820B. The terminal device 600 causes the image projection device 700A to project an image of the handwritten data.

[0175] Furthermore, the terminal device 600 generates superimposed image data indicating a superimposed image obtained by combining the background image projected by the image projection device 700A and the image of the handwritten data input by the electronic pen 820B.

[0176] As described above, each of the above-described embodiments can be applied to various system configurations.

[0177] <Other application examples> The above describes the best mode for carrying out the present invention using examples, but the present invention is not limited to these examples in any way, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention.

[0178] The character string is stored as character codes, and the handwritten data is stored as coordinate data in the display device 2. The data can also be stored in various storage media or in a storage device on a network, and later downloaded from the display device 2 for reuse. The display device 2 to be reused may be any display device, or may be a general information processing device. Therefore, the user can reproduce the handwritten content on a different display device 2 and continue a meeting, etc.

[0179] For example, in the present embodiment, an electronic whiteboard has been described as an example, but the electronic whiteboard may be called an electronic whiteboard, an electronic information board, or the like. In addition, the present embodiment can be suitably applied to any information processing device having a touch panel. The information processing device equipped with a touch panel may be, for example, a PJ (Projector), an output device such as digital signage, a HUD (Head Up Display) device, an industrial machine, an imaging device, a sound collecting device, a medical device, a network home appliance, a notebook PC (Personal Computer), a mobile phone, a smartphone, a tablet terminal, a game machine, a PDA (Personal Digital Assistant), a digital camera, a wearable PC, or a desktop PC.

[0180] In addition, the display device 2 of this embodiment detects the coordinates of the pen by detecting the coordinates of the pen tip with a touch panel, but the coordinates of the pen tip may also be detected by ultrasonic waves. The pen emits light and also emits ultrasonic waves, and the display device 2 calculates the distance based on the arrival time of the ultrasonic waves. The display device 2 can identify the position of the pen based on the direction and distance. The projector draws (projects) the trajectory of the pen as stroke data.

[0181] Moreover, the configuration examples in Fig. 6 and the like are divided according to main functions in order to facilitate understanding of the processing by the display device 2. The present invention is not limited by the manner in which the processing units are divided or the names of the processing units. The processing by the display device 2 can be divided into more processing units according to the processing contents. Also, it can be divided so that one processing unit includes more processes.

[0182] Furthermore, part of the processing performed by the display device 2 may be performed by a server connected to the display device 2 via a network.

[0183] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0184] The handwriting input unit 11 is an example of a receiving means. The display control unit 17 is an example of a display control means. The standard object management unit 20 is an example of a first deleting means. The handwritten object management unit 19 is an example of a second deleting means. [Explanation of symbols]

[0185] 2 Display device [Prior art documents] [Patent documents]

[0186] [Patent Document 1] JP 2014-130422 A

Claims

1. A display device for displaying handwritten data and objects, comprising: a receiving means for receiving a delete operation for the handwritten data or the object by an input means; a display control means for displaying a display component indicating that the object can be deleted when the accepting means accepts the delete operation for the object; a first deletion means for deleting the object, When the accepting means accepts the delete operation for the handwritten data and the object in a state where the handwritten data and the object are overlapped with each other, the display control means displays a display component indicating that the object can be deleted; The display device according to claim 1, wherein the first deletion means deletes the object in response to an operation on the display component or the object displayed around the display component.

2. 2. The display device according to claim 1, further comprising a second deletion means for deleting a portion of the handwritten data for which the deletion operation has been accepted when the accepting means accepts the deletion operation for the handwritten data overlapping the object.

3. 3. The display device according to claim 1, wherein the display component is a delete button that is displayed around the object for which the accepting unit has accepted the delete operation.

4. If the objects overlap at least in part, The display device according to claim 3 , wherein the display control means displays the delete button around the foreground object.

5. 3 . The display device according to claim 1 , wherein the display component is a delete dialogue including thumbnails of one or more of the objects for which the accepting unit has accepted the delete operation, and accepting the deletion of all of the objects or an individual object.

6. If the objects overlap at least in part, The display device according to claim 5 , wherein the deletion dialog displays thumbnails of all the overlapping objects.

7. 4. The display device according to claim 3, wherein, when the delete button is pressed by the input means, the first delete means deletes the object around which the delete button is displayed.

8. 2 . The display device according to claim 1 , wherein when the object around which the display component is displayed is pressed by the input means, the first deletion means deletes the object around which the display component is displayed.

9. A display method performed by a display device that displays handwritten data and an object, comprising: a receiving means receiving a delete operation for the handwritten data or the object by an input means; a step of displaying a display component indicating that the object can be deleted when the reception means receives the delete operation for the handwritten data and the object in a state where the handwritten data and the object are overlapped with each other, by a display control means; a first deletion means for deleting the object in response to an operation on the display component or the object around which the display component is displayed; A display method having the following structure:

10. A display device for displaying handwritten data and objects, a receiving means for receiving a delete operation for the handwritten data or the object by an input means; a display control means for displaying a display component indicating that the object can be deleted when the accepting means accepts the delete operation for the object; a first deletion means for deleting the object; When the accepting means accepts the delete operation for the handwritten data and the object in a state where the handwritten data and the object are overlapped with each other, the display control means displays a display component indicating that the object can be deleted; The program, wherein a first deletion means deletes the object in response to an operation on the display component or the object displayed around the display component.

Images