Image editing support method and image editing support device

Abstract

To create a blank through a simple operation on an image in which at least one object has been arranged.SOLUTION: A projector 100 includes: a display device 130 which displays a display image in which a written object representing at least one of a character string and a diagram is arranged; and a processing device 110. The processing device 110 executes: obtaining a reference position to be a reference when changing a largeness of a blank in a display image; identifying a movement target object, which is a written object located in a predetermined range including the reference position out of at least one written object; and moving the movement target object in accordance with an operation when the operation for moving the movement target object is performed by a user using a pointer 500.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to an image editing support method and an image editing support device. [Background technology]

[0002] In an interactive whiteboard, when a user uses a pointer to draw a shape or the like on a projection surface onto which an image is projected, the shape or the like is recognized as an object, and an image in which the objects are arranged is projected onto the projection surface. Furthermore, in an interactive whiteboard, a drawn object can be selected using a pointer, and the selected object can be moved by a drag operation using the pointer. Various technologies for supporting the movement of objects on an interactive whiteboard have been proposed. One example is the technology disclosed in Patent Document 1. Patent Document 1 discloses a technology for rearranging objects in a manner that prevents them from overlapping each other when an object instructed to be moved by a user overlaps another object at the destination. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-238135 Summary of the Invention [Problem to be solved by the invention]

[0004] For example, when writing object C between objects A and B that have already been written, it is necessary to move objects A and B to create a space in which to write object C. With the technology disclosed in Patent Document 1, in order to create a space in which to write object C, it is necessary to move each of objects A and B separately while paying attention to the direction and amount of movement, and it is not possible to create a space with a simple operation. [Means for solving the problem]

[0005] One aspect of the image editing support method of the present disclosure is to acquire a reference position that serves as a reference when changing the width of a blank space in a first image in which one or more first objects representing at least one of a character string and a graphic are arranged, and to select one or more first objects that are located within a predetermined range including the reference position. of Object to be moved as and, when an operation for moving the object to be moved is performed by a user, moving the object to be moved in accordance with the operation.

[0006] One aspect of the image editing support device of the present disclosure includes a display device that displays a first image in which one or more first objects representing at least one of a character string and a graphic are arranged, and a processing device, wherein the processing device acquires a reference position that serves as a reference when changing the width of a blank space in the first image, and selects, from the one or more first objects, a first object that is located within a predetermined range including the reference position. of Object to be moved as and, when an operation for moving the object to be moved is performed by the user, moving the object to be moved in accordance with the operation. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a perspective view of a projection system 300 including a projector 100 according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a side view of the projection system 300. [Figure 3] FIG. 1 is a diagram illustrating an example of the configuration of a projector 100. [Figure 4] FIG. 10 is a diagram showing an example of object information 144. [Figure 5] 10 is a diagram showing an example of a display image PS projected by the projector 100. FIG. [Figure 6] 10 is a flowchart showing the flow of an editing support method executed by the processing device 110 of the projector 100 in accordance with the program 142. [Figure 7] 10A to 10C are diagrams for explaining an example of the operation of the projector 100. [Figure 8] 10A to 10C are diagrams for explaining an example of the operation of the projector 100. [Figure 9] 10A to 10C are diagrams for explaining an example of the operation of the projector 100. [Figure 10] 10A to 10C are diagrams for explaining an example of the operation of the projector 100. DETAILED DESCRIPTION OF THE INVENTION

[0008] The embodiments described below are subject to various technically preferable limitations, but the embodiments of the present disclosure are not limited to the following embodiments.

[0009] 1. Embodiment FIG. 1 is a perspective view of a projection system 300 including a projector 100, which is one embodiment of an image editing support device disclosed in the present invention. FIG. 2 is a side view of the projection system 300. The projection system 300 functions as an interactive whiteboard. As shown in FIGS. 1 and 2, the projection system 300 includes a projection panel 200 and a pointer 500 in addition to the projector 100.

[0010] The front surface of the projection board 200 is used as a projection surface SS onto which an image is projected by the projector 100. As shown in FIGS. 1 and 2 , the projector 100 is fixed in front of and vertically above the projection board 200 by a support member 210. In this embodiment, the projection board 200 is arranged to stand upright vertically, but the projection system 300 may also be configured by arranging the projection board 200 horizontally and placing the projector 100 vertically above the projection board 200. Hereinafter, as shown in FIG. 1 , the vertical coordinate axis will be referred to as the y-axis, the coordinate axis normal to the projection board 200 will be referred to as the z-axis, and the coordinate axis perpendicular to both the y-axis and the z-axis will be referred to as the x-axis.

[0011] The projector 100 projects a display image PS onto the projection surface SS of the projection board 200, thereby displaying the display image PS on the projection surface SS. The projection surface SS refers to the surface of a member onto which an image is projected. The pointer 500 has a tip 510 and a stem 520. A user of the projection system 300 can draw an object such as a character or a figure on the projection surface SS by holding the stem 520 in their hand and moving the pointer 500 while bringing the tip 510 into contact with the projection surface SS in a manner that traces the projection surface SS. The tip 510 is equipped with a light-emitting unit (not shown). The light-emitting unit emits infrared light only when in contact with the projection surface SS, and does not emit infrared light when not in contact.

[0012] The projector 100 has a built-in imaging device 120. The imaging device 120 is installed with an angle of view that allows it to capture at least the entire projection surface SS. The imaging device 120 is equipped with a visible light cut filter (not shown). More specifically, the visible light cut filter built into the imaging device 120 has the property of blocking visible light such as light projected from the projector 100, light from the lighting in the room where the projector 100 is installed, and natural light, while transmitting infrared light emitted from the tip 510 of the pointer 500. The imaging device 120 captures an image represented by light that has passed through the visible light cut filter. Therefore, images of visible light such as illumination light, natural light, and light projected from the projector 100 are not captured by the imaging device 120, but an image represented by infrared light emitted from the tip 510 of the pointer 500 is captured by the imaging device 120. For this reason, in the image captured by the imaging device 120, the area of ​​the tip 510 of the pointer 500 emits light, and the other areas do not emit light. Based on the image captured by the imaging device 120, the projector 100 detects the contact position of the pointer 500 on the projection surface SS.

[0013] FIG. 3 is a block diagram showing an example of the configuration of the projector 100. As shown in FIG. 3, the projector 100 includes a processing device 110, a display device 130, and a storage device 140 in addition to the imaging device 120. Note that the projector 100 may also include an input device provided with a plurality of controls such as a numeric keypad, and a communication device that communicates with other devices via a communication network such as a wired LAN (Local Area Network) or a wireless LAN. For example, the input device is a device that allows a user of the projector 100 to input various settings related to the operation of the projector 100. The communication device is used to receive image data transmitted from an image supply device such as a personal computer.

[0014] The processing device 110 includes a processor such as a CPU (Central Processing Unit), i.e., a computer. The processing device 110 may be configured as a single computer or multiple computers. The processing device 110 functions as the control center of the projector 100 by operating in accordance with a program 142 stored in the storage device 140.

[0015] The imaging device 120 captures an image of the projection surface SS at regular intervals, such as every few milliseconds, under the control of the processing device 110. Each time the imaging device 120 captures an image of the projection surface SS, the imaging device 120 outputs image data representing the captured image to the processing device 110. Hereinafter, the image data output from the imaging device 120 to the processing device 110 will be referred to as captured image data. The processing device 110 analyzes the captured image data sequentially output from the imaging device 120 to detect the contact position of the pointer 500 and the trajectory drawn using the pointer 500. Based on the trajectory drawn by the pointer 500, the processing device 110 detects, for each object, an object drawn by the user and the writing position of the object.

[0016] In the present embodiment, specific examples of objects written by a user using the indicator 500 include one or more character strings, one or more figures, or a combination of a character string and a figure written by a user using the indicator 500. Regarding a specific algorithm for detecting an object and the writing position of the object from captured image data sequentially output from the imaging device 120, existing technologies are appropriately adopted. For example, after the end point of a first trajectory representing a character string is detected, if handwriting of a second trajectory representing a figure is detected from a point that is a distance equal to or greater than a predetermined threshold from the end point, the processing device 110 determines that the first trajectory and the second trajectory correspond to separate objects, detects a character string object based on the first trajectory, and detects a figure object based on the second trajectory. Conversely, after the end point of the first trajectory is detected, if new handwriting of the second trajectory is detected from a point that is a distance less than a predetermined threshold from the end point, the processing device 110 detects a single object that is a combination of a character string and a figure based on the first trajectory and the second trajectory.

[0017] The display device 130 is a projection device that projects a display image PS onto a projection surface SS in accordance with an image signal provided by the processing device 110. Although detailed illustration is omitted in FIG. 3, the display device 130 includes a projection optical system including a projection lens, a liquid crystal driver, a liquid crystal panel, and a light source. The liquid crystal driver drives the liquid crystal panel in accordance with the image signal provided by the processing device 110, thereby rendering an image represented by the image signal on the liquid crystal panel. The light source includes a light source such as a halogen lamp or a laser diode. Light from the light source is modulated for each pixel by the liquid crystal panel and projected onto the projection surface SS by the projection optical system.

[0018] In this embodiment, the processing device 110 generates an image signal representing a display image PS in which objects detected by analyzing the captured image data are placed at the writing positions of the objects on a monochrome background image, such as white. Each object drawn by the user using the pointer 500 is placed at the corresponding writing position on the display image PS, thereby realizing an interactive whiteboard. Visible light constituting the background image is blocked by a visible light cut filter built into the imaging device 120, so that the visible light constituting the background image does not affect the detection of the objects. The image data representing the background image may be generated within the projector 100 or may be acquired from an image supply device via data communication using a communication device.

[0019] The storage device 140 is a recording medium readable by the processing device 110. The storage device 140 includes, for example, a nonvolatile memory and a volatile memory. The nonvolatile memory is, for example, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or an electrically erasable programmable read-only memory (EEPROM). The volatile memory is, for example, a random access memory (RAM).

[0020] The nonvolatile memory of the storage device 140 stores a program 142 for causing the processing device 110 to execute processing that prominently exhibits the features of the present disclosure. Although detailed illustration is omitted in FIG. 2, the nonvolatile memory stores various setting information that defines the operation of the projector 100. A specific example of this setting information is correction information that indicates keystone correction, etc., to be applied to the display image PS. The volatile memory of the storage device 140 is used by the processing device 110 as a work area when executing the program 142.

[0021] The volatile memory also stores information generated in the process of having the processing unit 110 execute the program 142. The information generated in the process of having the processing unit 110 execute the program 142 includes object information 144 that represents an object. The object information 144 is generated for each object. FIG. 4 is a diagram showing an example of the object information 144. As shown in FIG. 4, the object information 144 includes position information that indicates the writing position of the object, range information that indicates the range of the object, and content information that indicates the content of the object. The position information represents the coordinates of the center of the object, more specifically, the coordinates of the center of the smallest rectangle that circumscribes the object. The range information represents the size of the smallest rectangle that circumscribes the object. The content information represents an image of a character string, a figure, or a combination of a figure and a character string written within the rectangle. Hereinafter, an object whose center coordinates, range, and content are represented by the object information 144 will be referred to as a written object, and the rectangle that defines the range indicated by the object information 144 will be referred to as a written object. outer edge The written object is an example of a first object in the present disclosure.

[0022] When the projector 100 is powered on, the processing device 110 reads the program 142 from the non-volatile memory to the volatile memory and starts executing the read program 142. The processing device 110 operating in accordance with the program 142 functions as a display control unit 110a, an acquisition unit 110b, an identification unit 110c, and a movement unit 110d. The display control unit 110a, the acquisition unit 110b, the identification unit 110c, and the movement unit 110d shown in FIG. 3 are software modules realized by operating the processing device 110 in accordance with the program 142. The functions of the display control unit 110a, the acquisition unit 110b, the identification unit 110c, and the movement unit 110d are as follows:

[0023] The display control unit 110a periodically executes a process of generating an image signal representing a display image PS based on the object information 144 stored in the volatile memory of the storage device 140 and providing the generated image signal to the display device 130, for example, at intervals of several milliseconds. Note that, when no object is written on the projection surface SS, the display control unit 110a provides an image signal representing a background image to the display device 130. When an object written by the user is detected by analyzing the captured image data, the display control unit 110a writes object information 144 representing the detected object to the volatile memory of the storage device 140. Thereafter, the display control unit 110a generates an image signal representing a display image PS in which the written object is arranged based on the object information 144 stored in the volatile memory of the storage device 140, and provides the generated image signal to the display device 130. In other words, the display control unit 110a is a functional block for implementing an interactive whiteboard.

[0024] In this embodiment, the display control unit 110a provides the display image PS with a toolbar in which a plurality of objects corresponding to tools for allowing the user to specify the width of the blank space centered on a reference position specified by the user in the display image PS are arranged. Hereinafter, the objects corresponding to the tools are referred to as tool objects. and FIG. 5 is a diagram showing an example of a display image PS. In the display image PS shown in FIG. 5, written objects OB1, OB2, OB3, OB4, and a toolbar TLB are arranged. In the display image PS shown in FIG. 5, four written objects are arranged, but the number of written objects arranged in the display image PS may be one to three, or may be five or more. In short, it is sufficient that one or more written objects are arranged in the display image PS.

[0025] The written object OB1 is an object consisting of a character string and a circle. The written object OB2 is an object consisting of a character string and two triangles. The written object OB3 is an object consisting of a star-shaped figure. The written object OB4 is an object consisting of a character string. The dotted lines in Figure 5 indicate the outline of the written objects. outer edge In this embodiment, the written object outer edge In order to clearly indicate this, an image representing each rectangle drawn with dotted lines in Fig. 5 is displayed superimposed on the display image PS. The image representing each rectangle drawn with dotted lines in Fig. 5 is an example of a third image in the present disclosure.

[0026] Tool objects TL1, TL2, and TL3 corresponding to three types of tools that move written objects in different directions when enlarging a blank space are arranged on the toolbar TLB in Fig. 5. The user can drag and drop any of the tool objects TL1, TL2, and TL3 to the position where they want to enlarge the blank space and perform a predetermined operation to specify that position as the reference position that will be used as the basis for changing the size of the blank space.

[0027] The tool objects TL1, TL2, and TL3 each represent a different shape. Specifically, the tool object TL1 represents a circle, the tool object TL2 represents a rectangle with its long side aligned along the y-axis, and the tool object TL3 represents a rectangle with its long side aligned along the x-axis. In this embodiment, the movement direction of the written object when enlarging a blank space is along an axis determined by the shape of the selected tool object. The movement direction of the tool object TL1 is a direction away from the reference position along an axis passing through the reference position and the center position of the written object to be moved. In other words, by using the tool object TL1, the user can move the written object radially around the reference position. The movement direction of the tool object TL2 is a direction away from the reference position along the axis along the long side of the rectangle represented by the tool object TL2, i.e., the y-axis. The movement direction of the tool object TL3 is a direction away from the reference position along the axis along the long side of the rectangle represented by the tool object TL3, i.e., the x-axis. The tool objects are an example of a second object in the present disclosure.

[0028] The acquiring unit 110b acquires the reference position. In this embodiment, when the dragged-and-dropped tool object is continuously pressed by the indicator 500 for a time T, the acquiring unit 110b determines the center position of the tool object as the reference position and acquires the reference position. This prevents the reference position from being erroneously determined during the drag-and-drop process. Note that, to clearly indicate to the user that the reference position has been determined, the display control unit 110a may change the display color of the dragged-and-dropped tool object before and after the reference position has been determined.

[0029] The identification unit 110c determines, for each written object, whether at least a portion of the written object overlaps with a predetermined range including the reference position. Then, the identification unit 110c identifies the written object that at least a portion of the written object overlaps with the predetermined range including the reference position as an object to be moved. In this embodiment, the predetermined range is the range in the display image PS in which the tool object that was dragged and dropped to specify the reference position exists. For example, when tool object TL1 is dragged and dropped, the inside of the circle indicated by tool object TL1 becomes the predetermined range. When tool object TL2 is dragged and dropped, the inside of the rectangle indicated by tool object TL2 becomes the predetermined range. Similarly, when tool object TL3 is dragged and dropped, the inside of the rectangle indicated by tool object TL3 becomes the predetermined range.

[0030] The moving unit 110d moves the object to be moved in a direction away from the reference position along an axis corresponding to the shape of the tool object while an operation to specify the width of the blank space is being performed on the tool object that has been dragged and dropped to specify the reference position. The operation to specify the width of the blank space is called a size specifying operation. In this embodiment, the size specifying operation is an operation of continuously pressing the tool object with the indicator 500 after the reference position has been determined. That is, in this embodiment, the movement amount of the object to be moved is determined according to the length of time during which the size specifying operation is being performed. Furthermore, the moving unit 110d updates the object information 144 of the object to be moved according to the movement of the object to be moved.

[0031] Furthermore, the processing device 110 operating in accordance with the program 142 executes the image editing support method shown in Fig. 6. As shown in Fig. 6, the image editing support method of this embodiment includes a designation support process SA110, a placement process SA120, a determination process SA130, an acquisition process SA140, a specification process SA150, and a movement process SA160.

[0032] In the designation support process SA110, the processing device 110 functions as a display control unit 110a. In the designation support process SA110, the processing device 110 displays the display image PS on the projection surface SS, thereby accepting an operation to designate a reference position. As described above, the user can designate a reference position by dragging and dropping any tool object using the indicator 500 and continuing to press it for a certain period of time T.

[0033] In placement processing SA120 subsequent to the designation support processing SA110, the processing device 110 functions as a display control unit 110a. In the placement processing SA120, the processing device 110 places a tool object selected by drag-and-drop at a position specified by drag-and-drop on the display image PS.

[0034] In determination processing SA130 subsequent to placement processing SA120, the processing device 110 functions as an acquisition unit 110b. In determination processing SA130, the processing device 110 determines whether the tool object placed by drag-and-drop has been continuously pressed by the indicator 500 for a certain period of time T. If the determination result of determination processing SA130 is "No", the processing device 110 executes determination processing SA130 again. If the determination result of determination processing SA130 is "Yes", the processing device 110 executes acquisition processing SA140.

[0035] In the acquisition process SA140, the processing device 110 functions as an acquisition unit 110b. In the acquisition process SA140, the processing device 110 acquires, as a reference position, the center position of the tool object placed on the display image PS by drag-and-drop.

[0036] In identification processing SA150 subsequent to the acquisition processing SA140, the processing device 110 functions as an identification unit 110c. In the identification processing SA150, the processing device 110 identifies, as an object to be moved, a written object that at least partially overlaps with a predetermined range including the reference position.

[0037] In movement processing SA160 subsequent to identification processing SA150, processing device 110 functions as movement unit 110d. In movement processing SA160, processing device 110 moves the object to be moved identified in identification processing SA150 in a direction away from the reference position along an axis corresponding to the shape of the tool object while a size specification operation is being performed on the tool object that has been dragged and dropped to specify the reference position.

[0038] In the designation support process SA110, assume that the display image PS shown in FIG. 5 is displayed on the projection surface SS, and the tool object TL1 is selected using the pointer 500 and dragged and dropped to a position PP as indicated by the arrow DD in FIG. 7. In this case, in the placement process SA120, the processing device 110 places the tool object TL1 at a position PP in the display image PS as indicated by the dashed-dotted line in FIG. 8. If the tool object TL1 indicated by the dashed-dotted line in FIG. 8 is continuously pressed by the pointer 500 for a time T, the determination result of the determination process SA130 becomes "Yes," and the processing device 110 executes the acquisition process SA140. In the acquisition process SA140, the processing device 110 determines the center position PP of the tool object TL1 indicated by the dashed-dotted line in FIG. 8 as a reference position and acquires the reference position. Note that the dashed-dotted line in FIG. 8 indicates a predetermined range W.

[0039] In identification process SA150 subsequent to acquisition process SA140, the processing device 110 determines whether each of written object OB1, written object OB2, written object OB3, and written object OB4 is an object to be moved. In the example shown in Fig. 8, written object OB1 and written object OB2 both partially overlap with the predetermined range W, but written object OB3 and written object OB4 do not overlap with the predetermined range W. Therefore, in the example shown in Fig. 8, written object OB1 and written object OB2 are objects to be moved.

[0040] In a movement process SA160 subsequent to the identification process SA150, the processing device 110 moves the object to be moved radially away from the position PP while a size specification operation is being performed on the tool object TL1 dragged and dropped at the position PP. Specifically, the processing device 110 moves the written object OB1 in the direction indicated by the arrow M1 in FIG. 9 along an axis passing through the position PP and the center of the written object OB1 at the time the size specification operation was started. The processing device 110 also moves the written object OB2 in the direction indicated by the arrow M2 in FIG. 9 along an axis passing through the position PP and the center of the written object OB2 at the time the size specification operation was started. Note that the written objects OB1 and OB2 are not shown in FIG. 9 to avoid cluttering the drawing.

[0041] As a result of the operations described above, the display image PS is updated as shown in Fig. 10. As is clear from a comparison of Fig. 10 with Fig. 5, the space between the written object OB1 and the written object OB2 is wider in the display image PS shown in Fig. 10 compared to the display image PS shown in Fig. 5. As described above, according to this embodiment, it is possible to create a space in the display image PS with a simple operation of dragging and dropping any tool object to a position where it is desired to change the size of the space and then continuing to press the tool object.

[0042] 2. Transformation The above embodiments can be modified as follows. (1) In the above embodiment, the size specification operation was an operation for expanding the space, but it may also be an operation for narrowing the space. An operation for widening the space is an example of a first operation in the present disclosure. An operation for narrowing the space is an example of a second operation in the present disclosure. When the second operation is performed on a tool object that has been dragged and dropped onto the display image PS to specify a reference position, the processing device 110 moves the object to be moved in a direction approaching the reference position along an axis determined according to the shape of the tool object.

[0043] (2) In the above embodiment, the object to be moved is moved by an amount corresponding to the length of time during which the size designation operation is being performed. However, if the size designation operation is an operation of tapping a tool object, the amount of movement corresponding to one size designation operation may be predetermined. Furthermore, if the projector 100 is provided with operators such as a numeric keypad or cursor keys, the amount of movement may be specified for each object to be moved by operating the operators to input a numerical value indicating the amount of movement of the object to be moved. Furthermore, if the projector 100 has multiple operators, a first operator among the multiple operators may be assigned to the first operation, and a second operator different from the first operator may be assigned to the second operation. In this aspect, whether the first operation or the second operation has been performed may be identified depending on the type of the operated operator, and the movement direction of the object to be moved may be identified depending on the identified operation.

[0044] (3) The movement of the object to be moved may be stopped if the object no longer overlaps with the predetermined range due to the movement in response to the size designation operation. In other words, the upper limit of the movement amount of the object to be moved may be determined according to the length of time during which the size designation operation is being performed or the number of times the operation is performed.

[0045] (4) In the above embodiment, the reference position is specified using a tool object. However, the reference position may be specified by tapping on the display image PS, etc., and the interior of a circle or rectangle of a predetermined size centered on the reference position may be the predetermined range. In an aspect in which the interior of a circle or rectangle of a predetermined size centered on the reference position is the predetermined range, it is conceivable that the size specification operation is an operation of continuously pressing an arbitrary point within the predetermined range using the pointer 500. In other words, the tool object is not an essential component of the present disclosure and can be omitted. In an aspect in which a tool object is not used, the placement process SA120 and the determination process SA130 can be omitted. In an aspect in which a tool object is not used, the display of the toolbar TLB is also unnecessary. In an aspect in which the toolbar TLB is not displayed, the specification support process SA110 is a general process in a projector. Therefore, the editing support method of the present disclosure may include the acquisition process SA140, the identification process SA150, and the movement process SA160. Note that, when a tool object is not used, the predetermined range is clearly indicated to the user, so the position of the predetermined range is not necessarily specified. outer edge may be displayed superimposed on the display image PS.

[0046] (5) The object to be moved is clearly distinguishable from the other written objects. outer edge The image showing the object to be moved and the written object other than the object to be moved outer edge With the picture showing, outer edge At least one of the type and color of the line representing the object to be moved and the written object other than the object to be moved may be different. outer edge The display of the image showing this is not essential and may be omitted.

[0047] (6) When the distance between the object to be moved and another written object, more specifically, the distance between the center of the object to be moved and the center of the other written object, becomes less than a predetermined threshold value as a result of moving the object to be moved, the other written object may be moved together with the object to be moved. Specifically, when the distance between the object to be moved and the other written object becomes less than a predetermined threshold value as a result of moving the object to be moved, the processing device 110 integrates the object to be moved and the other written object into a single object. For example, the processing device 110 determines the range of the integrated object as the smallest rectangle that includes the object to be moved and the other written object, and sets the center of the rectangle as the center of the integrated object. Thereafter, the processing device 110 moves the integrated object as a new object to be moved.

[0048] (7) In the above embodiment, the display device 130 is a projection device that projects an image onto the projection board 200. However, the display device 130 may be a liquid crystal display or the like. In short, the display device 130 may be any device that displays a display image PS on which one or more written objects representing at least one of a character string and a graphic are arranged.

[0049] (8) In the above embodiment, the display control unit 110a, the acquisition unit 110b, the identification unit 110c, and the movement unit 110d are software modules. However, any one or more, or all of the display control unit 110a, the acquisition unit 110b, the identification unit 110c, and the movement unit 110d may be hardware modules such as an ASIC (Application Specific Integrated Circuit). Even if any one or more, or all of the display control unit 110a, the acquisition unit 110b, the identification unit 110c, and the movement unit 110d are hardware modules, the same effects as those of the above embodiment can be achieved.

[0050] (9) The program 142 may be manufactured as a standalone product or may be provided free of charge or for a fee. Specific examples of providing the program 142 include providing the program 142 by writing it to a computer-readable recording medium such as a flash ROM, or providing the program 142 by downloading it via a telecommunications line such as the Internet. Operating a general computer in accordance with the program 142 provided in these ways enables the computer to function as the editing support device of the present disclosure.

[0051] 3. Aspects grasped from at least one of the embodiments and modifications The present disclosure is not limited to the above-described embodiments and modifications, and can be realized in various forms without departing from the spirit thereof. For example, the present disclosure can also be realized in the following forms. The technical features in the above embodiments corresponding to the technical features in each form described below can be replaced or combined as appropriate to solve some or all of the problems of the present disclosure or to achieve some or all of the effects of the present disclosure. Furthermore, if a technical feature is not described as essential in this specification, it can be deleted as appropriate.

[0052] An image editing support method according to one embodiment of the present disclosure includes an acquisition process SA140, a specification process SA150, and a movement process SA160. The acquisition process SA140 is a process for acquiring a reference position that serves as a reference when changing the width of a blank space in a display image PS in which one or more written objects representing at least one of a character string and a graphic are arranged. The written object is an example of a first object in the present disclosure. The display image PS is an example of a first image in the present disclosure. The specification process SA150 is a process for acquiring a written object, of the one or more written objects, that is located within a predetermined range including the reference position. of Object to be moved asThe movement process SA160 is a process for specifying the movement target objects. When an operation for moving the movement target objects is performed by the user, the movement process SA160 moves the movement target objects in accordance with the operation. According to the image editing support method of this aspect, the movement target objects can be moved collectively in accordance with the operation for moving the movement target objects, so that it is possible to create a blank space of a desired size with a simple operation in a display image PS on which one or more handwritten objects have already been arranged.

[0053] In a more preferred embodiment of the image editing support method, the operations may include a first operation for widening the space and a second operation for narrowing the space. When the operations include the first operation and the second operation, a movement direction for moving the object to be moved may be specified depending on whether the operation is the first operation or the second operation. Specifically, the movement direction corresponding to the first operation may be a direction in which the object to be moved moves away from the reference position. Furthermore, the movement direction corresponding to the second operation may be a direction in which the object to be moved moves towards the reference position. Approaching In this embodiment, the object to be moved moves in a direction away from the reference position in response to the first operation. In addition, the object to be moved moves in a direction approaching the reference position in response to the second operation. According to this embodiment, by performing the first operation to widen the space or the second operation to narrow the space, the objects to be moved can be moved all at once, so that it is possible to create a space of a desired size with a simple operation on the display image PS on which one or more written objects have already been placed.

[0054] In another preferred embodiment of the image editing support method, outer edge An image of a dashed line indicating the predetermined range may be displayed superimposed on the written object. outer edge The image of the dashed line indicating the predetermined range is an example of the second image in the present disclosure. outer edge can be made clear to the user.

[0055] In another preferred embodiment of the image editing support method, a tool object that accepts the operation may be displayed at the reference position. The tool object is an example of a second object in the present disclosure. According to this embodiment, by performing an operation on the tool object, the objects to be moved can be moved collectively. In this embodiment, the predetermined range may be a range in which the tool object exists in the display image PS. According to this embodiment, the predetermined range can be clearly indicated to the user by displaying the tool object.

[0056] In another preferred aspect of the image editing support method, the movement direction of the object to be moved may be a direction along an axis determined according to the shape of the tool object. In this aspect, since the movement direction of the object to be moved is determined according to the shape of the tool object, it is possible to have the user specify the movement direction of the object to be moved by preparing tool objects of various shapes in advance and having the user select a tool object to be placed at a reference position.

[0057] In another preferred aspect of the image editing support method, an upper limit on the amount of movement of the object to be moved may be determined depending on the length of time the operation continues. According to this aspect, the user can specify the amount of movement of the object to be moved depending on the length of time the operation to move the object to be moved continues. Note that the movement of the object to be moved that no longer overlaps with the predetermined range may be stopped. According to this aspect, it is possible to easily create a blank space of a size corresponding to the predetermined range.

[0058] In another preferred embodiment of the image editing support method, outer edge An image showing the written object may be displayed superimposed on the display image PS. outer edge The image showing the above is an example of the third image in the present disclosure. outer edge can be made clear to the user.

[0059] In another preferred embodiment of the image editing support method, another written object representing at least one of a character string and a graphic, different from the object to be moved, may be placed in the display image PS. The other written object different from the object to be moved is an example of a third object in the present disclosure. In this embodiment, when the distance between the center of the object to be moved and the center of the other written object becomes less than a predetermined threshold as a result of moving the object to be moved, a process may be executed to move the other written object together with the object to be moved. According to this embodiment, it is possible to prevent the object to be moved in response to the first operation or the second operation from overlapping with the other written object without performing another operation.

[0060] An image editing support device according to an embodiment of the present disclosure includes a display device 130 that displays a display image PS on which one or more hand-drawn objects representing at least one of a character string and a graphic are arranged, and a processing device 110. The processing device 110 executes the acquisition process SA140, the identification process SA150, and the movement process SA160 described above. The image editing support device according to this embodiment can move the objects to be moved collectively in response to an operation for moving the objects to be moved, thereby making it possible to create a blank space of a desired size with a simple operation in a display image PS on which one or more hand-drawn objects have been arranged. [Explanation of symbols]

[0061] 300...projection system, 100...projector, 110...processing device, 110a...display control unit, 110b...acquisition unit, 110c...identification unit, 110d...movement unit, 120...imaging device, 130...display device, 140...storage device, 142...program, 144...object information, 200...projection plate, 210...support member, 500...pointer, 510...tip portion, 520...axis portion, PS...display image, SS...projection surface.

Claims

1. acquiring a reference position that serves as a reference when changing the width of a blank space in a first image in which one or more first objects representing at least one of a character string and a graphic are arranged; Identifying, as a movement target object, a first object located within a predetermined range including the reference position, among the one or more first objects; When an operation for moving the object to be moved is performed by a user, the object to be moved is moved in accordance with the operation; and displaying a second object for receiving the operation at the reference position; Including, the second object is an object that has not been written by a user, An image editing support method, wherein an upper limit of the movement amount of the object to be moved is determined according to the length of time during which the operation continues.

2. the operations include a first operation for widening the space and a second operation for narrowing the space; The method further includes specifying a movement direction in which the object to be moved is moved depending on whether the operation is the first operation or the second operation. The image editing support method according to claim 1 .

3. the movement direction corresponding to the first operation is a direction in which the object to be moved moves away from the reference position, the movement direction corresponding to the second operation is a direction in which the object to be moved approaches the reference position; The image editing support method according to claim 2 .

4. The image editing support method according to claim 1 , further comprising: displaying a second image indicating the extent of the predetermined range superimposed on the first image.

5. the predetermined range is a range in which the second object exists in the first image; The image editing support method according to any one of claims 1 to 3.

6. The image editing support method according to claim 5 , wherein the object to be moved is moved along an axis determined according to the shape of the second object.

7. The image editing support method described in claim 1, further comprising stopping the movement of the object to be moved when it no longer overlaps with the specified range.

8. An image editing assistance method described in any one of claims 1 to 7, further comprising displaying a third image indicating the extension of the first object superimposed on the first image.

9. When a third object different from the object to be moved among the one or more first objects is placed in the first image, When the distance between the center of the object to be moved and the center of the third object becomes less than a predetermined threshold value as a result of moving the object to be moved, moving the third object together with the object to be moved. The image editing support method according to any one of claims 1 to 8.

10. Obtaining a reference position that serves as a reference when changing the width of a blank space in a first image in which one or more first objects representing at least one of a character string and a figure are arranged; Identifying a target object to be moved, which is a first object located within a predetermined range including the reference position, from among the one or more first objects; and When an operation for moving the object to be moved is performed by a user, moving the object to be moved in accordance with the operation; An image editing support method, wherein an upper limit of the movement amount of the object to be moved is determined according to the length of time during which the operation continues.

11. A display device that displays a first image in which one or more first objects representing at least one of a character string and a graphic are arranged; a processing device, The processing device includes: acquiring a reference position that serves as a reference when changing the width of the blank space in the first image; Identifying a target object to be moved, which is a first object located within a predetermined range including the reference position, from among the one or more first objects; When an operation for moving the object to be moved is performed by a user, the object to be moved is moved in accordance with the operation; and displaying a second object for receiving the operation at the reference position; Run the second object is an object that has not been written by a user, an upper limit of the movement amount of the object to be moved is determined according to the length of time during which the operation is continued; Image editing support device.

Images