Information processing apparatus, display apparatus, information processing method, and program

Abstract

To selectively perform editing operations on an image having a desired attribute even when a plurality of images having different attributes are selected.SOLUTION: An information processing apparatus comprises: a coordinate acquisition unit that acquires coordinates of a contact position of input means on a display unit; an operation detection unit that detects an operation performed on the display unit based on the coordinates acquired by the coordinate acquisition unit; a selection determination unit that determines a selected image based on the operation detected by the operation detection unit; and an edit menu generating unit that generates an edit menu including items indicating edit operations to be applied to the selected image.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device, a display device, an information processing method, and a program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, display devices such as electronic whiteboards that draw stroke images input by handwriting have been known.

[0003] Patent Document 1 discloses that after an operation to select an area in a preview display area is performed, various editing operations are performed on the selected area, that is, various editing operations are performed on strokes in the area. Summary of the Invention [Problem to be solved by the invention]

[0004] However, with conventional technology, there was a problem that when the depiction areas of multiple images with different attributes, such as a stroke image and a graphic image, overlap and multiple images with different attributes are selected by operation with a touch pen or the like, it was not possible to selectively perform editing operations on the image with the desired attribute.

[0005] The present invention has been made in view of the above, and has as its object to selectively perform editing operations on an image having a desired attribute even when a plurality of images having different attributes are selected. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the object, the display device of the present invention comprises a coordinate acquisition unit that acquires the coordinates of the contact position of an input means on a display unit, an operation detection unit that detects an operation performed on the display unit based on the coordinates acquired by the coordinate acquisition unit, a selection determination unit that determines a selected image, which is a selected image, based on the operation detected by the operation detection unit, and an edit menu generation unit that generates an edit menu including items indicating editing operations to be applied to the selected image. [Effects of the Invention]

[0007] According to the present invention, even when a plurality of images having different attributes are selected, it is possible to selectively perform editing operations on the image having the desired attribute. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an electronic whiteboard according to a first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an electronic whiteboard. [Figure 3] FIG. 3 is a diagram illustrating the functional configuration of the electronic whiteboard. [Figure 4] FIG. 4 is a diagram illustrating an operation for selecting an image included in a display image. [Figure 5] FIG. 5 is a diagram showing an example of an edit menu displayed on a display image according to the first embodiment. [Figure 6] FIG. 6 is a flowchart illustrating an example of a processing procedure for generating an edit menu according to the first embodiment. [Figure 7] FIG. 7 is a diagram illustrating layers that make up a display image. [Figure 8] FIG. 8 is a diagram illustrating an example of page data. [Figure 9] FIG. 9 is a diagram showing an example of stroke arrangement data included in each page data ID. [Figure 10] FIG. 10 is a diagram showing an example of object region information included in each page data ID. [Figure 11] FIG. 11 is a diagram showing an example of an edit menu displayed on a display image according to the second embodiment. [Figure 12] FIG. 12 is a flowchart illustrating an example of a processing procedure for generating an edit menu according to the second embodiment. [Figure 13] FIG. 13 is a diagram illustrating an example of a system configuration of an information processing system including an electronic whiteboard. [Figure 14] FIG. 14 is a first diagram showing a modified example of the information processing system. [Figure 15] FIG. 15 is a second diagram showing a modified example of the information processing system. [Figure 16] FIG. 16 is a third diagram showing a modified example of the information processing system. DETAILED DESCRIPTION OF THE INVENTION

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an information processing device, a display device, an information processing method, and a program according to embodiments of the present invention will be described with reference to the accompanying drawings.

[0010] (First embodiment) 1 is a diagram illustrating an electronic whiteboard 200 according to this embodiment. The electronic whiteboard 200 includes a short-range communication circuit 219, a power switch 222, a display 280, and a camera 260. When the power switch 222 is pressed, the electronic whiteboard 200 is a display device that causes an information processing device including a display control unit (described later) to display a display image 50 on the display 280, which is a display unit, that can be drawn on with an electronic pen or a user's finger.

[0011] Furthermore, the electronic whiteboard 200 of this embodiment displays on the display 280 stroke images and objects input by an electronic pen or a user's finger.

[0012] A stroke image is an image drawn by a user's stroke. A stroke refers to a series of operations in which the tip of an electronic pen or a user's finger is pressed against the touch panel of the electronic whiteboard 200, the tip of the pen is moved across the touch panel, and the tip of the pen is then released from the touch panel.

[0013] An object refers to an entity that is the target of operations or processing by a computer. Objects include, for example, data sets, operation elements, individual figures, etc. that are displayed as icons on the display 280. In Microsoft Office (registered trademark) applications, diagrams, word art, etc. that can be inserted into documents are also called objects. In this embodiment, objects include, for example, not only characters but also stamp images that illustrate feelings or messages.

[0014] The hardware configuration of the electronic whiteboard 200 will be described below with reference to Fig. 2. Fig. 2 is a diagram showing an example of the hardware configuration of the electronic whiteboard 200. As shown in Fig. 2, the electronic whiteboard 200 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an SSD (Solid State Drive) 204, a network I / F (Interface) 205, and an external device connection I / F 206.

[0015] Of these, the CPU 201 controls the overall operation of the electronic whiteboard 200. The ROM 202 stores the CPU 201 and programs used to drive the CPU 201, such as an IPL (Initial Program Loader). The RAM 203 is used as a work area for the CPU 201. The SSD 204 is a storage device that stores various data such as programs for the electronic whiteboard and image data. Note that a storage device such as an HDD (Hard Disk Drive) may be used instead of or together with the SSD.

[0016] The network I / F 205 controls communication with a communication network. The external device connection I / F 206 is an interface for connecting various external devices. In this case, the external devices are, for example, a USB (Universal Serial Bus) memory 230 and external devices (a microphone 240, a speaker 250, and a camera 260).

[0017] The electronic whiteboard 200 also includes a capture device 211, a GPU 212, a display controller 213, a contact sensor 214, a sensor controller 215, an electronic pen controller 216, a short-range communication circuit 219, an antenna 219a of the short-range communication circuit 219, a power switch 222, and selection switches 223.

[0018] Of these, the capture device 211 displays video information as a still image or a moving image on the display of an external PC (Personal Computer) 270. The GPU (Graphics Processing Unit) 212 is a semiconductor chip that specializes in handling graphics. The GPU 212 may be built into the CPU 201 or may be integrated with the CPU 201.

[0019] The display controller 213 controls and manages screen display to output an output image from the GPU 212 to a display 280 or the like. The contact sensor 214 detects that an input means such as an electronic pen 290 or a user's hand H has contacted the display 280. The sensor controller 215 controls the processing of the contact sensor 214. The display 280 is an example of a display unit.

[0020] The contact sensor 214 inputs and detects coordinates using an infrared blocking method. This coordinate input and coordinate detection method involves two light receiving and emitting devices installed at both ends of the upper side of the display 280 emitting multiple infrared rays parallel to the display 280, and receiving the light that is reflected by a reflecting member installed around the periphery of the display 280 and returns along the same optical path as the light emitted by the light receiving element. The contact sensor 214 outputs the ID of the infrared rays emitted by the two light receiving and emitting devices that are blocked by a contacting object (the tip of an electronic pen, a user's finger, or the like) to the sensor controller 215, and the sensor controller 215 identifies the coordinate position, which is the contact position of the object. Here, the contacting object is an example of an input means.

[0021] The electronic pen controller 216 communicates with the electronic pen 290 to determine whether the pen tip or the pen tail is touching the display 280. The short-range communication circuit 219 is a communication circuit such as NF (Near Field Communication) or Bluetooth (registered trademark). The power switch 222 is a switch for switching the power of the electronic whiteboard 200 on and off. The selection switches 223 are a group of switches for adjusting, for example, the brightness and color of the display 280.

[0022] Furthermore, the electronic whiteboard 200 includes a bus line 210. The bus line 210 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 201 shown in FIG.

[0023] The contact sensor 214 is not limited to an infrared blocking type, and various detection means may be used, such as a capacitance type touch panel that identifies the contact position by detecting a change in capacitance, a resistive film type touch panel that identifies the contact position by a voltage change between two opposing resistive films, or an electromagnetic induction type touch panel that identifies the contact position by detecting electromagnetic induction caused when a contacting object (input means) touches the display unit. Also, the electronic pen controller 216 may determine whether or not the part of the electronic pen 290 that the user holds or other parts of the electronic pen have been touched, in addition to the pen tip and pen butt.

[0024] The camera 260 captures video and acquires video data. The camera 260 also detects that the electronic pen 290 or the hand H has approached the display 280. In this case, the camera 260 is an example of a proximity sensor. The interactive whiteboard 200 may also include a projected capacitive touch panel, an infrared sensor, or the like as a proximity sensor.

[0025] Next, the functional configuration of the electronic whiteboard 200 will be described with reference to Fig. 3. Fig. 3 is a diagram illustrating the functional configuration of the electronic whiteboard 200.

[0026] The electronic whiteboard 200 has an input unit 341, a page generation unit 342, a display control unit 343, a coordinate acquisition unit 344, an operation detection unit 345, a selection determination unit 346, an edit menu generation unit 347, and a storage unit 348. That is, the electronic whiteboard 200 is an example of a display device equipped with an information processing device having these functional configurations and a display screen.

[0027] The input unit 341 acquires stroke images that indicate characters or images handwritten on the display 280, and data of objects displayed on a touch panel provided on the display 280. Hereinafter, stroke images and objects may be collectively referred to as images. Furthermore, stroke images and objects are referred to as image types. Note that the image type is one of the attributes of an image, and the image attributes include various information other than the type, as will be described later.

[0028] The input unit 341 also acquires data such as a moving image captured by the camera 260. In this embodiment, the moving image captured by the camera 260 is included in the object. The input unit 341 also acquires object data that is output from the PC 270 or the like and input to the interactive whiteboard 200. The input unit 341 also accepts various instructions for the interactive whiteboard 200.

[0029] The page generation unit 342 generates an image of one page (display image 50) to be displayed on the display 280. Specifically, the page generation unit 342 generates data of a superimposed image in which the objects, stroke images, etc. acquired by the input unit 341 are superimposed.

[0030] When the input unit 341 acquires an object and a stroke image is not input to the display 280, the page generation unit 342 generates data for the display image 50 that does not include a stroke image but includes the object.

[0031] Furthermore, when the input unit 341 does not acquire an object and a stroke image is input to the display 280, the page generating unit 342 generates data for the display image 50 that does not include the object but includes the stroke image.

[0032] The display control unit 343 causes the display image 50 to be displayed on the display 280. The display control unit 343 also controls various displays on the display 280. For example, the display control unit 343 causes an edit menu generated by an edit menu generation unit 347 (described later) to be displayed on the display 280. The display control unit 343 also causes an edit operation (delete, cut, move, copy, duplicate, enlarge, reduce, rotate, flip, etc. of an object or stroke image) designated by the user by operating the edit menu displayed on the display 280 to be reflected in the display image 50.

[0033] Here, editing is performed on an image that the selection determination unit 346 (described later) determines to be a selected image (selected image). "Delete" erases the selected image. "Cut" pastes a copy of the selected image at specified coordinates and deletes the original selected image when coordinates are subsequently specified. "Move" moves the selected image to the specified coordinates. "Copy" pastes the selected image at specified coordinates when coordinates are subsequently specified. "Duplicate" pastes a copy of the selected image at the same or nearby coordinates as the selected image. "Enlarge" enlarges the size of the selected image. "Reduce" reduces the size of the selected image. "Rotate" rotates the selected image by a specified angle within the image plane of the display image 50. "Flip" flips the selected image horizontally or vertically. Editing operations are not limited to these, and may include, for example, changing the color or brightness (brightness) of the selected image. Editing operations do not need to include all of the above, but may include at least one of the above.

[0034] The coordinate acquisition unit 344 acquires the coordinates of the point on the display 280 that is in contact with the tip of the electronic pen 290, the tip of the user's finger, or the like.

[0035] The operation detection unit 345 detects an operation performed on the display 280 based on the coordinates detected by the coordinate acquisition unit 344. Specifically, the operation detection unit 345 detects a touch-down operation, a touch-move operation, a touch-up operation, and the like.

[0036] A touchdown operation is when the tip of the electronic pen 290, the hand H, or the like is detected by the contact sensor 214. In the following description, the input means such as the tip of the electronic pen 290 or the hand H, which is the target of contact detection by the contact sensor 214, may be referred to as a detection target.

[0037] A touch-move operation is a movement of the coordinates of a detection target detected in a touch-down operation. The movement of coordinates means that the coordinates detected at time tn and the coordinates detected at time tn+1 are within a predetermined range (a predetermined distance that a detection target such as hand H can move between time tn and time tn+1).

[0038] A touch-up operation occurs when the detection object determined to be a touch-down operation or a touch-move operation is no longer detected by the contact sensor 214.

[0039] The selection determination unit 346 determines the selected image (selected image) from among the images included in the display image 50 displayed on the display 280, based on the operation detected by the operation detection unit 345. More specifically, the selection determination unit 346 determines the selected image based on the coordinates acquired by the operation detection unit 345 in response to a selection operation performed by the user through a touch-down operation or a touch-up operation, and the coordinate data of the image (object or stroke image).

[0040] FIG. 4 is a diagram illustrating a selection operation of an image included in a display image 50. In this example, as shown in FIG. 4(a), four objects (ob1 to ob4) and two stroke images (st1, st2) are displayed superimposed on the display image 50. The selection range shown in FIG. 4(b) is an area surrounded by a rectangle defined by the coordinates of the start point designated by the user with a touch-down operation and the coordinates of the end point designated by the user with a touch-up operation. The selection determination unit 346 determines, for example, that the objects and stroke images included within the selection range are selected images. In the example of FIG. 4(b), the objects ob3 and ob4 and the stroke images st1 and st2 are selected images by the user's selection operation.

[0041] The selection determination unit 346 may determine that an image is the selected image when at least a part of the coordinates of the image is included in the selection range. In this case, in the example of Fig. 4(b), the objects ob1 to ob4 and the stroke images st1 and st2 are determined to be the selected images by the user's selection operation.

[0042] The editing menu generating unit 347 generates an editing menu that allows the user to specify an editing operation to be applied to the selected image determined by the selection determining unit 346. The editing menu includes editing items (items indicating at least one of the above-mentioned editing operations) to be applied to the edited image, and is displayed in the form of, for example, a pull-down menu.

[0043] FIG. 5 shows an example of an editing menu displayed on a display image 50 according to this embodiment. FIGS. 5(a) and 5(b) are examples of an editing menu when the editing operation is deletion. Here, FIG. 5(a) shows a case where the selected image includes stroke images and objects, and options displayed include an option "Delete All" for deleting all types of the selected image and an option "Delete Stroke Images" for deleting each type of selected image. FIG. 5(b) shows an example where the selected image includes only stroke images or objects, and an option "Delete" for deleting all selected images is displayed. Also, FIGS. 5(c) and 5(d) are examples of an editing menu when the editing operation is deletion and copying. Here, FIG. 5(c) shows a case where the selected image includes stroke images and objects, and options displayed include an option "Delete All" for deleting all types of the selected image, an option "Delete Each Type of Selected Image," an option "Copy All" for copying all selected images, and an option "Copy Stroke Images" for copying each type of selected image. FIG. 5(d) shows an example in which the selected image contains only either a stroke image or an object, and options displayed include an option to delete the entire selected image and an option "copy" to copy the entire selected image.

[0044] In this way, the edit menu generation unit 347 switches the items of the edit menu depending on whether the selected image includes multiple types of images. Specifically, when the selected image includes multiple types of images, the edit menu generation unit 347 generates an edit menu that includes an item for editing all of the selected images and an item for editing the selected images for each type (each of stroke images and objects), as shown in Figures 5(a) and (c), and when the selected image does not include multiple types of images, the edit menu generation unit 347 generates an edit menu that includes only an item for editing all of the selected images, as shown in Figures 5(b) and (d).

[0045] The memory unit 348 stores data of the display image 50 generated by the page generation unit 342, page data indicating the contents of the display image 50, and data indicating the contents of the images that make up the display image 50 in a storage device such as RAM 203, SSD 204, USB memory 230, or HDD.

[0046] The above-mentioned input unit 341, page generation unit 342, display control unit 343, coordinate acquisition unit 344, operation detection unit 345, selection determination unit 346, edit menu generation unit 347, and memory unit 348 are functions or means of functioning that are realized when any of the components shown in Figure 2 operates in response to instructions from CPU 201 in accordance with the program expanded from SSD 204 onto RAM 203.

[0047] Next, the operation of the electronic whiteboard 200 of this embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of a processing procedure for generating an edit menu according to this embodiment. First, the user selects an image included in the display image 50 using the electronic pen 290 or the like, and the selection determination unit 346 determines the selected image (step S10).

[0048] Next, the edit menu generation unit 347 determines whether the selected images include multiple image types (step S11). If the selected images include multiple image types (step S11: Yes), the edit menu generation unit 347 generates an edit menu that includes an item for editing all selected images and an item for editing the selected images by type (step S12). On the other hand, if the selected images do not include multiple image types (step S11: No), the edit menu generation unit 347 generates an edit menu that includes only an item for editing all selected images (step S13).

[0049] Thus, according to this embodiment, the items in the editing menu are switched depending on whether the selected image contains multiple image attributes, so that even if multiple images with different attributes (in this embodiment, image types) are selected, editing operations can be selectively performed on the image with the desired attribute.

[0050] (Second embodiment) Next, a second embodiment will be described.

[0051] The second embodiment differs from the first embodiment in that the edit menu for editing a selected image is switched using attributes other than the image type. In the following description of the second embodiment, explanations of parts that overlap with the first embodiment will be omitted, and only parts that differ from the first embodiment will be described.

[0052] First, a layer, which is one of the attributes of an image, will be described with reference to Fig. 7. Fig. 7 is a diagram illustrating layers that make up a display image 50.

[0053] FIG. 7(a) schematically shows multiple layers constituting a display image 50. Here, layer 41 is a layer on which a UI (User Interface) image is arranged, layer 42 is a layer on which an object is arranged, layer 43 is a layer on which a stroke image is arranged, layer 44 is a layer on which an input image input from a PC is arranged, and layer 45 is a layer on which a background image is arranged. Note that a UI image is an image such as a preset icon. Also, a background image is an image that forms the backmost layer of the display image 50 and represents the background, such as a plain image or an image including grid lines. Hereinafter, a background image may also be referred to as media data.

[0054] 7(b) to 7(f) show examples in which images are arranged on layers 41 to 45. FIG. 7(g) shows an example of a display image 50 generated by the page generation unit 342 by superimposing the layers 41 to 45 of FIGS. 7(b) to 7(f). The page generation unit 342 superimposes the layers so that, when the user views the display 280, layer 41 is the first layer, layer 42 is the second layer, layer 43 is the third layer, layer 44 is the fourth layer, and layer 45 is the fifth layer. In this way, the page generation unit 342 superimposes images according to a pre-specified layout to generate the display image 50, and the display control unit 343 displays the generated display image 50 on the display 280.

[0055] Next, page data and data indicating the contents of an image will be described with reference to Figures 8 to 10. Figure 8 is a diagram showing an example of page data. The page generation unit 342 generates page data such as that shown in Figure 8, which indicates the contents of the generated display image 50, and the storage unit 348 can store the generated page data in a storage device such as the SSD 204. The page data includes, as information, a page data ID, a start time, an end time, a stroke ID, an object ID, and a media data ID.

[0056] The value of the "page data ID" indicates identification information for identifying the page data (or the display image 50). For example, a page data ID may be assigned each time an update (edit, etc.) of the display image 50 is completed after the display image 50 is displayed. In this case, the stroke ID, object ID, and media data ID corresponding to each page data ID in FIG. 8 indicate the IDs of the images constituting the display image 50 at the time when the update of the display image 50 corresponding to each page data is completed.

[0057] The value of "start time" indicates the time when the display of the display image 50 corresponding to the page data started. The value of "end time" indicates the time when updating of the display image 50 ended. The value of "stroke ID" indicates identification information for identifying stroke array data generated by inputting a stroke image. The stroke array data includes coordinate information of a point cloud that indicates a specific shape. In other words, the stroke array data is stroke information that is a point cloud that indicates the trajectory of each stroke.

[0058] The value of "object ID" indicates identification information for identifying an object. For example, an object ID may be assigned to each object each time the object is drawn. The object ID is associated with object area information that includes information indicating the drawing area of ​​the object.

[0059] The value of the "media data ID" indicates identification information for identifying media data. Media data is data corresponding to the background image that forms the background of the display image 50. Note that in FIG. 8, for page data that does not contain stroke images or objects, the values ​​of the stroke ID and object ID are indicated by "-".

[0060] In this way, each time an update of the display image 50 is completed, the storage unit 384 stores the page data ID that identifies the display image 50 in association with the IDs of the images that make up the display image 50. In the example of FIG. 8, the display image 50 of pg001 is made up of stroke images st1 and st2, objects ob1 and ob2, and media data m001, and then the media data is changed to m002 and a display image 50 of pg002 is generated in which all of the stroke images have been deleted. Furthermore, a display image 50 of pg003 is then generated in which a stroke image st3 and an object ob3 have been added.

[0061] 9 is a diagram showing an example of stroke sequence data included in each page data ID. The stroke sequence data includes information such as a stroke ID, a coordinate group, and a layer. The value of the "coordinate group" includes coordinate information for each point in a point group that indicates a specific shape.

[0062] The value of "layer" is the layer number assigned to each layer. For example, layer numbers 1 to 5 are assigned in order to layers 41 to 45 shown in FIG. 8. Since the stroke image is placed on layer 43, the layer number is indicated as 3.

[0063] 10 is a diagram showing an example of object area information included in each page data ID. The object area information includes an object ID, coordinates, width, height, and layer.

[0064] The "coordinate" value indicates the coordinates of a point that serves as a reference in the drawing area of ​​the object. Specifically, the "coordinate" value is the coordinate of the upper left vertex of the bounding rectangle of the object, the coordinate of the center of the bounding rectangle, etc.

[0065] The "width" value indicates the width of the object's drawing area, and the "height" value indicates the height of the object's drawing area. Specifically, the "width" and "height" values ​​are the width and height of the object's circumscribing rectangle, etc.

[0066] In the example shown in FIG. 10, objects ob1 and ob2 have layer number 2 and therefore belong to object layer 42, and object ob3 has layer number 4 and therefore belongs to layer 44 of the input image input from the PC.

[0067] In this embodiment, the above-mentioned layer is used as an attribute other than the type of image to switch between the items in the edit menu. The difference from the first embodiment is that the layer to which the image belongs is used to switch between the items in the edit menu instead of the type of image. The other configurations and functions are the same as those of the first embodiment, so detailed explanations will be omitted.

[0068] FIG. 11 is a diagram showing an example of an edit menu displayed on the display image 50 according to this embodiment. Here, an example of editing an image included in the page data pg003 of FIGS. 8 to 10 will be described. FIGS. 11(a) and (b) are examples of an edit menu when the edit operation is deletion. Here, FIG. 11(a) shows a case where the selected image includes images from layer 2 (ob1 and ob2), layer 3 (st3), and layer 4 (ob3). Options displayed include "Delete All," which deletes all layers of the selected image, and "Delete Layer 2," which deletes each layer included in the selected image. FIG. 11(b) shows an example where the selected image includes only images from one of the layers, and "Delete" which deletes all selected images is displayed as an option. Furthermore, FIGS. 11(c) and (d) are examples of an edit menu when the edit operation is deletion and copying. Here, Fig. 11(c) shows a case where the selected image includes images from layers 2, 3, and 4, and options are displayed, including an option to delete all layers and an option to delete each layer, as well as an option to copy all layers ("Copy All") and an option to copy each layer ("Copy Layer 2"). Fig. 11(d) shows an example where the selected image includes only images from one of the layers, and options are displayed, including an option to delete all and an option to copy all ("Copy").

[0069] In this way, the edit menu generation unit 347 switches the items in the edit menu depending on whether the selected image includes multiple layers. Specifically, when the selected image includes multiple layers, the edit menu generation unit 347 generates an edit menu that includes an item for editing all of the selected images and an item for editing the selected images for each layer, as shown in Figures 11(a) and 11(c), and when the selected image does not include multiple layers, the edit menu generation unit 347 generates an edit menu that includes only an item for editing all of the selected images, as shown in Figures 11(b) and 11(d).

[0070] 12 is a flowchart showing an example of a processing procedure for generating an edit menu according to this embodiment. First, the user selects an image included in the display image 50 using the electronic pen 290 or the like, and the selection determination unit 346 determines the selected image (step S20).

[0071] Next, the edit menu generation unit 347 determines whether the selected image includes multiple layers (whether multiple images belonging to different layers are selected) (step S21). If the selected image includes multiple layers (step S21: Yes), the edit menu generation unit 347 generates an edit menu that includes an item for editing all the selected images and an item for editing the selected images for each layer (step S22). On the other hand, if the selected image does not include multiple layers (step S21: No), the edit menu generation unit 347 generates an edit menu that includes only an item for editing all the selected images (step S23).

[0072] Thus, according to this embodiment, the items in the editing menu are switched depending on whether the selected image contains multiple image attributes, so that even if multiple images belonging to different attributes (layers in this embodiment) are selected, editing operations can be selectively performed on the image with the desired attribute.

[0073] Note that image attributes can also include image color, image size, and the like. For example, using the width information shown in FIG. 10 as the image size, attribute values ​​with a width value of 100 or more can be defined as large width, and attribute values ​​less than 100 can be defined as small width. When the selection targets include large objects (ob1 or ob3) and small objects (ob2), the edit menu generation unit 347 generates an edit menu that includes an item for editing all selected images and an item for editing the selected images for each attribute. On the other hand, when the selection targets include only large objects or only small objects (ob2), the edit menu generation unit 347 generates an edit menu that includes only an item for editing all selected images.

[0074] Furthermore, if the stroke images are colored in four colors, for example, black, red, green, and blue, these colors may be used as image attributes. When the selection includes stroke images of different colors, the edit menu generation unit 347 generates an edit menu that includes an item for editing all selected images and an item for editing the selected images for each color. On the other hand, when the selection includes only stroke images of the same color, the edit menu generation unit 347 generates an edit menu that includes only an item for editing all selected images.

[0075] The interactive whiteboard 200 described in the first and second embodiments may be included in a system that communicates with a server device.

[0076] 13 is a diagram showing an example of a system configuration of an information processing system 500 including an electronic whiteboard 200. The information processing system 500 includes an electronic whiteboard (electronic information board) 200 and a server device 550. In the information processing system 500, the electronic whiteboard 200 and the server device 550 are connected via a network.

[0077] In the information processing system 500 of this embodiment, the interactive whiteboard 200 may transmit the page data stored in the storage unit 348 to the server device 550, and store the page data in the server device 550. In this case, the edit menu generation unit 347 of the interactive whiteboard 200 may refer to the stroke arrangement data and object region information stored in the server device 550.

[0078] The interactive whiteboard 200 of this embodiment may transmit to the server device 550 the voice data collected by the microphone 240 and the date and time when various data were acquired.

[0079] The interactive whiteboard 200 can also communicate with multiple terminal devices and may acquire image data and audio data from each terminal device. In this case, the image displayed on the interactive whiteboard 200 may be shared by multiple terminal devices, and the interactive whiteboard 200 serves as a shared terminal that displays a screen shared by the multiple terminal devices.

[0080] Next, a modification of the information processing system 500 described above will be described with reference to FIGS.

[0081] 14 is a first diagram illustrating a modified example of the information processing system 500. In the example of FIG. 14, the information processing system includes a terminal device 600, an image projection device 700, and a pen motion detection device 810 instead of the interactive whiteboard 200.

[0082] The terminal device 600 is connected to the image projection device 700 and the pen motion detection device 810 by wire.

[0083] The image projection device 700 projects image data input by the terminal device 600 onto a screen 800 .

[0084] The pen operation detection device 810 communicates with the electronic pen 820 and detects the operation of the electronic pen 820 in the vicinity of the screen 800. Specifically, the electronic pen 820 detects coordinate information indicating a point indicated by the electronic pen 820 on the screen 800 and transmits the coordinate information to the terminal device 600.

[0085] The terminal device 600 detects the position of the electronic pen based on the coordinate information received from the pen operation detection device 810. Stroke image data indicating the input stroke image is generated by 820, and the stroke image is drawn on the screen 800 by the image projection device 700.

[0086] Furthermore, the terminal device 600 generates page data including superimposed image data showing the image being projected by the image projection device 700 , and transmits the page data to the server device 550 .

[0087] Fig. 15 is a second diagram showing a modified example of the information processing system 500. In the example of Fig. 15, the information processing system includes, instead of the interactive whiteboard 200, a terminal device 600, a display 800A, and a pen operation detection device 810A.

[0088] The pen operation detection device 810A is placed near the display 800A, detects coordinate information indicating a point indicated by the electronic pen 820A on the display 800A, and transmits the coordinate information to the terminal device 600. In the example of Fig. 15, the electronic pen 820A may be charged by the terminal device 600 via a USB connector.

[0089] Based on the coordinate information received from the pen operation detection device 810A, the terminal device 600 generates image data of the stroke image input by the electronic pen 820A, and displays the image data on the display 800A.

[0090] 16 is a third diagram illustrating a modified example of the information processing system 500. In the example of FIG. 16, the information processing system includes a terminal device 600 and an image projection device 700 instead of the interactive whiteboard 200.

[0091] The terminal device 600 performs wireless communication (communication via Bluetooth or the like) with the electronic pen 820B and receives coordinate information of the point indicated by the electronic pen 820B on the screen 800. Then, based on the received coordinate information, the terminal device 600 generates image data of a stroke image input by the electronic pen 820B and causes the image projection device 700 to project the stroke image onto the screen 800.

[0092] Furthermore, the terminal device 600 generates page data including superimposed image data showing the image being projected by the image projection device 700 , and transmits the page data to the server device 550 .

[0093] As described above, the above-described embodiments can be applied to various system configurations.

[0094] The programs executed by the information processing devices of the above-described embodiments are provided as files in an installable or executable format recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk).

[0095] The programs executed by the information processing apparatuses of the embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network.The programs executed by the information processing apparatuses of the embodiments may be provided or distributed via a network such as the Internet.

[0096] The programs of the embodiments may be provided in a state where they are pre-installed in a ROM or the like.

[0097] The program executed by the information processing device of each embodiment has a modular configuration including the above-mentioned units (input unit 341, page generation unit 342, display control unit 343, coordinate acquisition unit 344, operation detection unit 345, selection determination unit 346, edit menu generation unit 347, memory unit 348), and in actual hardware, the CPU (processor) reads and executes the program from the above-mentioned storage medium, thereby loading the above-mentioned units onto the main memory, and the input unit 341, page generation unit 342, display control unit 343, coordinate acquisition unit 344, operation detection unit 345, selection determination unit 346, edit menu generation unit 347, and memory unit 348 are generated on the main memory.

[0098] Each function of each of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to perform each of the above-described functions.

[0099] Note that the device to which each embodiment is applied may be any display device having a function for operating an object by touch operation, and is not limited to the electronic whiteboard 200. The device to which each embodiment is applied may be, for example, a network home appliance, a connected car, a notebook PC, a mobile phone, a smartphone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), a wearable PC, or the like.

[0100] Additionally, the devices described in each embodiment represent only one of multiple computing environments for implementing the embodiments disclosed herein.

[0101] In some embodiments, the display device includes multiple computing devices, such as a server cluster, configured to communicate with each other over any type of communications link, including a network, shared memory, etc., and to perform the processes disclosed herein.

[0102] Furthermore, the multiple computing devices can be configured to execute various combinations of the steps of the processes shown in Figures 6 and 12 and the multiple processes included in each step. For example, a predetermined process can be executed by a first computing device. Similarly, a predetermined process can be executed by a second computing device. Furthermore, the elements of the first computing device and the second computing device can be integrated into a single server device or can be separated into multiple devices.

[0103] Although the present invention has been described above based on the embodiments, the present invention is not limited to the requirements shown in the above embodiments. These requirements can be changed without departing from the spirit of the present invention, and can be appropriately determined depending on the application form.

[0104] For example, aspects of the present invention are as follows. <1> An information processing device comprising: a coordinate acquisition unit that acquires the coordinates of the contact position of an input means on a display unit; an operation detection unit that detects operations performed on the display unit based on the coordinates acquired by the coordinate acquisition unit; a selection determination unit that determines a selected image, which is a selected image, based on the operation detected by the operation detection unit; and an edit menu generation unit that generates an edit menu including items indicating editing operations to be applied to the selected image, wherein the edit menu generation unit switches the items included in the edit menu depending on whether the selected image determined by the selection determination unit includes multiple image attributes. <2> the edit menu generation unit generates an edit menu including an item for editing all of the selected images and an item for editing the selected images for each of the attributes when the selected images include a plurality of image attributes, and generates an edit menu including only an item for editing all of the selected images when the selected images do not include a plurality of image attributes; <1> The information processing device is described in the above. <3> The attributes include at least one of the type of image, the color of the image, the size of the image, and the layer to which the image belongs. <1> or <2> The information processing device is described in the above. <4> The image types include stroke images and objects. <3> The information processing device is described in the above. <5> The operation indicated by the item includes at least one of delete, cut, move, copy, duplicate, enlarge, reduce, rotate, flip, change color, and change brightness. <1> ~ <4> The information processing device according to any one of the above items. <6> The aforementioned <1> 1 to <4> and a display unit. <7> This information processing method includes a coordinate acquisition step for acquiring the coordinates of the contact position of an input means on a display unit, an operation detection step for detecting an operation performed on the display unit based on the coordinates acquired in the coordinate acquisition step, a selection determination step for determining a selected image, which is a selected image, based on the operation detected in the operation detection step, and an edit menu generation step for generating an edit menu including items indicating editing operations to be applied to the selected image, wherein the edit menu generation step switches the items included in the edit menu depending on whether the selected image determined in the selection determination step includes multiple image attributes. <8> This program causes a computer to function as a coordinate acquisition means for acquiring the coordinates of the contact position of an input means on a display unit, an operation detection means for detecting an operation performed on the display unit based on the coordinates acquired by the coordinate acquisition means, a selection determination means for determining a selected image, which is a selected image, based on the operation detected by the operation detection means, and an edit menu generation means for generating an edit menu including items indicating editing operations to be applied to the selected image, wherein the edit menu generation means switches the items included in the edit menu depending on whether the selected image determined by the selection determination means includes multiple image attributes. [Explanation of symbols]

[0105] 200 Electronic Whiteboard 341 Input section 342 Page Generation Unit 343 Display control unit 344 Coordinate Acquisition Unit 345 Operation detection unit 346 Selection Judgment Unit 347 Edit Menu Generation Unit 348 Storage section [Prior art documents] [Patent documents]

[0106] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-151502

Claims

1. a coordinate acquisition unit that acquires coordinates of a contact position of an input means on a display unit; an operation detection unit that detects an operation performed on the display unit based on the coordinates acquired by the coordinate acquisition unit; a selection determination unit that determines a selected image based on the operation detected by the operation detection unit; an edit menu generating unit that generates an edit menu including items indicating edit operations to be applied to the selected image; Equipped with The information processing apparatus is characterized in that the edit menu generating section switches items included in the edit menu depending on whether the selected image determined by the selection determining section includes a plurality of image attributes.

2. The edit menu generation unit generating an edit menu including an item for editing all of the selected images and an item for editing the selected images for each of the attributes when the selected images include a plurality of image attributes; generating an edit menu including only an item for editing all of the selected images when the selected images do not include multiple image attributes; The information processing device according to claim 1 .

3. The information processing apparatus according to claim 1 , wherein the attributes include at least one of the type of image, the color of the image, the size of the image, and the layer to which the image belongs.

4. The information processing apparatus according to claim 3 , wherein the types of images include a stroke image and an object.

5. The information processing device according to claim 1 , wherein the operations indicated by the items include at least one of delete, cut, move, copy, duplicate, enlarge, reduce, rotate, flip, change color, and change brightness.

6. An information processing device according to any one of claims 1 to 4; A display device comprising:

7. a coordinate acquisition step of acquiring coordinates of a contact position of the input means on the display unit; an operation detection step of detecting an operation performed on the display unit based on the coordinates acquired in the coordinate acquisition step; a selection determination step of determining a selected image that is a selected image based on the operation detected in the operation detection step; an edit menu generating step of generating an edit menu including items indicating edit operations to be applied to the selected image; and The information processing method, wherein the edit menu generating step switches items included in the edit menu depending on whether the selected image determined in the selection determining step includes a plurality of image attributes.

8. Computer, a coordinate acquisition means for acquiring coordinates of a contact position of the input means on the display unit; an operation detection means for detecting an operation performed on the display unit based on the coordinates acquired by the coordinate acquisition means; a selection determination means for determining a selected image, which is a selected image, based on the operation detected by the operation detection means; an edit menu generating means for generating an edit menu including items indicating edit operations to be applied to the selected image; It functions as The editing menu generating means switches items included in the editing menu depending on whether the selected image determined by the selection determining means includes a plurality of image attributes.

Images