Electronic device and image forming apparatus

Abstract

To create moving images with high operator satisfaction from document images obtained through reading performed by a document reading unit.SOLUTION: An image forming apparatus 1 comprises: a conversion unit 101 that converts document images obtained through reading performed by a document reading unit 5 and arranged in time series into moving images; an operation unit 47 that receives operations; an editing unit 102 that edits the document images to be converted by the conversion unit 101 in accordance with an instruction from an operator through the operation unit 47; a display 473; and a display control unit 103 that forms an image display area on the display 473 and displays one frame of the document images to be converted in the image display area. The editing unit 102 performs editing for the document images with reference to a document image displayed in the image display area in accordance with the instruction from the operator, and the display control unit 103 performs scroll display for replacing a document image to be displayed in the image display area in accordance with the instruction from the operator.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an electronic device and an image forming apparatus having a function of reading an image of a document. [Background technology]

[0002] There are technologies that display images continuously on a display unit to create a slide show, and also create animation by creating movement from the continuously displayed images. The following Patent Document 1 describes how a video is created by connecting images stored in an image file storage unit in a personal computer, etc. Also, the following Patent Documents 2 to 4 describe how animation is created from images acquired by a scanning unit that scans a document. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-044451 A [Patent Document 2] Korean Patent Publication No. 10-2005-0078100 [Patent Document 3] Korean Patent Publication No. 10-2006-0021032 [Patent Document 4] Korean Patent No. 10-0374914 Summary of the Invention [Problem to be solved by the invention]

[0004] Electronic devices such as copiers and multifunction devices include a document reading unit that reads images from a document. If the document images obtained by reading the document reading unit could be continuously displayed, slide shows and animations could be realized. However, electronic devices that include a document reading unit do not have an image editing function, so that it is not possible to create videos that satisfy the operator, and even if they have an editing function, advanced editing operations are required.

[0005] The present invention has been made in consideration of the above circumstances, and has an object to enable an operator to easily create a moving image that provides a high level of satisfaction from an original image obtained by reading the original using an original reading section. [Means for solving the problem]

[0006] An electronic device according to one aspect of the present invention comprises a memory unit that stores a group of original images consisting of a plurality of original images, an editing unit that edits each original image included in the group of original images, a conversion unit that converts the group of original images, consisting of the plurality of original images arranged in chronological order, into a video, a display unit, and a display control unit that forms an image display area on the display unit and displays the original images that make up the group of original images in the image display area, wherein the editing unit performs editing processing on the original images that make up the group of original images that are the subject of conversion by the conversion unit, and the conversion unit converts the original images after editing by the editing unit into a video.

[0007] An image forming apparatus according to one aspect of the present invention comprises the above-mentioned electronic device, an image forming unit which forms an image on recording paper, and a thinning unit which performs a process of thinning out original images which constitute a group of original images after editing by the editing unit at a predetermined ratio, and the control unit causes the image forming unit to perform consolidated printing of the original images remaining after thinning by the thinning unit. Effect of the Invention

[0008] According to the present invention, each document image obtained by reading with the document reading unit can be edited before being converted into a video by the conversion unit, and each document image to be edited can be specified by a simple operation. This allows the operator to easily create a video that satisfies the operator. [Brief description of the drawings]

[0009] [Figure 1] 1 is a perspective view showing an external appearance of an image forming apparatus according to an embodiment of the electronic device of the present invention. [Diagram 2]1 is a functional block diagram illustrating an outline of a main internal configuration of an image forming apparatus according to an embodiment of an electronic device according to the present invention. [Diagram 3] 10 is a flowchart showing a process for setting a group of document images to be edited in the image forming apparatus 1. [Figure 4] 2 shows an operation screen which is a home screen of the image forming apparatus. [Diagram 5] FIG. 4 is a diagram showing an example of an operation screen displayed on a display unit. [Figure 6] FIG. 4 is a diagram showing an example of a reading setting screen as an operation screen displayed on a display unit. [Figure 7] 13A and 13B are diagrams showing an example of an operation screen displayed on a display unit. [Figure 8] FIG. 4 is a diagram showing an example of an operation screen displayed on a display unit. [Figure 9] FIG. 13 is a diagram showing an example of a conversion setting screen as an operation screen displayed on a display unit. [Figure 10] 13A and 13B are diagrams showing an example of an operation screen displayed on a display unit. [Figure 11] 13A and 13B are diagrams showing an example of an operation screen displayed on a display unit. [Figure 12] 5 is a flowchart showing an editing process for a group of document images by the image forming apparatus. [Figure 13] FIG. 4 is a diagram showing an example of an operation screen displayed on a display unit. [Figure 14] FIG. 4 is a diagram showing an example of an operation screen displayed on a display unit. [Figure 15] 13A and 13B are diagrams showing an example of an operation screen displayed on a display unit. [Figure 16] 13A and 13B are diagrams showing an example of an operation screen displayed on a display unit. [Figure 17] FIG. 4 is a diagram showing an example of an operation screen displayed on a display unit. [Figure 18] FIG. 11 is a functional block diagram illustrating a schematic main internal configuration of an image forming apparatus according to a second embodiment. [Figure 19]FIG. 2 is a diagram showing an example of a result obtained by the image forming apparatus. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] An image forming apparatus according to an embodiment of an electronic device of the present invention will be described below with reference to the drawings. Fig. 1 is a perspective view showing the appearance of an image forming apparatus according to an embodiment of an electronic device of the present invention. Fig. 2 is a functional block diagram showing a schematic main internal configuration of an image forming apparatus according to an embodiment of an electronic device of the present invention.

[0011] The image forming device 1 is a multifunction device having multiple functions, such as a copy function, a printer function, a scanner function, and a facsimile function, and is configured to include a device main body 11, a control unit 10, a document feeding section 6, a document reading section 5, an image forming section 12, a fixing section 13, a paper feeding section 14, an operation section 47, a USB (Universal Serial Bus) port 8, and a storage device 7.

[0012] The document feeder 6 is configured to be openable and closable by a hinge or the like (not shown) on the top surface of the document reading unit 5, and functions as a document pressing cover when reading a document placed on a platen glass (not shown). The document feeder 6 is called an ADF (Auto Document Feeder) or DP (Document Processor), and includes a document placement tray 61. The document feeder 6 feeds documents placed on the document placement tray 61 to the document reading unit 5 one sheet at a time.

[0013] A description will be given of a case where a document reading operation is performed by the image forming apparatus 1. The document reading unit 5 optically reads an image of a document supplied to the document reading unit 5 by the document feeding unit 6 or a document placed on the platen glass, and generates image data. The image data generated by the document reading unit 5 is stored in an image memory or the like (not shown).

[0014] The following describes an image forming operation performed by the image forming apparatus 1. Based on image data generated by a document reading operation, image data stored in an image memory or the like, image data received from a computer connected via a network, and the like, the image forming unit 12 forms a toner image on a recording paper as a recording medium fed from a paper feed unit 14.

[0015] The fixing unit 13 applies heat and pressure to the recording paper on which the toner image has been formed by the image forming unit 12, thereby fixing the toner image to the recording paper. The recording paper that has been subjected to the fixing process is discharged onto a discharge tray 151. The paper supply unit 14 includes a plurality of paper supply cassettes 141.

[0016] The operation unit 47 includes a start button, a numeric keypad, and various keys corresponding to various instructions. The operation unit 47 receives instructions from the operator regarding various operations and processes that can be executed by the image forming apparatus 1 in response to the operation of the respective keys by the operator. The operation unit 47 also includes a display unit 473 that displays operation guides and the like for the operator. The operation unit 47 also receives instructions from the operator based on the operation (touch operation) by the operator on the operation screen displayed on the display unit 473 via a touch panel included in the display unit 473.

[0017] The display unit 473 is composed of an LCD (Liquid Crystal Display) or the like. The display unit 473 is equipped with a touch panel. When the operator touches a button or key displayed on the screen, the touch panel receives an instruction associated with the touched position.

[0018] The USB port 8 is an interface to which a USB memory (not shown) can be connected. By inserting and connecting a USB memory into the USB port 8, the USB memory is connected to the control unit 10. The control unit 10 reads and writes data from and to the USB memory connected in this manner.

[0019] The storage device 7 is a large-capacity storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and stores various control programs and the like.

[0020] The control unit 10 includes a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), and a dedicated hardware circuit. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). The control unit 10 includes a control unit 100, a conversion unit 101, an editing unit 102, a display control unit 103, and a setting unit 104.

[0021] The control unit 10 functions as a control unit 100, a conversion unit 101, an editing unit 102, a display control unit 103, and a setting unit 104 by the operation of the processor in accordance with a control program stored in the storage device 7. However, the control unit 100 and the like can also be configured by hardware circuits, regardless of the operation in accordance with the control program by the control unit 10. The same applies to each embodiment below unless otherwise stated.

[0022] The control unit 100 is responsible for controlling the overall operation of the image forming apparatus 1. The control unit 100 is connected to the document feeding unit 6, the document reading unit 5, the image forming unit 12, the fixing unit 13, the paper feeding unit 14, the operation unit 47, the USB port 8, and the storage device 7, and performs drive control of each of these units.

[0023] For example, the control unit 100 controls the document reading unit 5 and the like to have the document reading unit 5 read the document placed on the DP (document placement tray 61 of the document feeding unit 6) or the document placed on the platen glass. Then, the control unit 100 creates a folder, arranges the document images obtained by reading with the document reading unit 5 in the order in which they were read, stores them in the created folder, and saves the folder in the storage device 7. That is, the document images obtained by reading with the document reading unit 5 are arranged in chronological order and stored in the folder.

[0024] The conversion unit 101 converts the document images arranged in chronological order, obtained by scanning by the document scanning unit 5, into a video in a predetermined format (for example, an AVI file or an MP4 file).

[0025] The editing unit 102 edits each document image obtained by reading with the document reading unit 5 according to an editing instruction from an operator received by the operation unit 47 .

[0026] The display control unit 103 controls the display of the display unit 473 .

[0027] Next, a process for setting a group of original images to be edited in the image forming apparatus 1 will be described. Fig. 3 is a flowchart showing a process for setting a group of original images to be edited in the image forming apparatus 1. Fig. 4 shows an operation screen SC1 which is a home screen of the image forming apparatus 1.

[0028] It is assumed that the display control unit 103 is displaying an operation screen SC1 on the display unit 473. The title name of the operation screen SC1 is "HOME SCREEN". On the operation screen SC1, an operation button B11 with a function name "Copy", an operation button B12 with a function name "Send", an operation button B13 with a function name "Fax", and an operation button B14 with a function name "Paper Animation Film Maker" are displayed. The functions described on the operation buttons B11 to B13 are existing functions, while the function described on the operation button B14 is a function according to one embodiment of the present invention.

[0029] When the operator touches the operation button B14 on the operation screen SC1 displayed on the display unit 473, and the operation unit 47 receives an instruction from the operator to create an animation film in response to that operation (YES in S1), the display control unit 103 causes the display unit 473 to display an operation screen SC2 with the title "Paper Animation Film Maker", for example, as shown in FIG. 5 (S2).

[0030] An image display area A1 for displaying one original image corresponding to one frame of an animation film is formed on the operation screen SC2, and a folder area A2 for displaying a folder for storing the original images is formed on the side of the operation screen SC2.

[0031] In FIG. 5, the image display area A1 shows a state in which no original image is displayed, and the message "Nothing to show" is displayed, and the folder area A2 shows a state in which no folders are displayed.

[0032] When the operator touches any part of the folder area A2 and a reading instruction is received via the touch panel ("Reading instruction" in S3), the display control unit 103 causes the display unit 473 to display a reading setting screen SC3 with the title "LOADING ORIGINALS (Reading Originals)" as shown in FIG. 6 (S4).

[0033] The reading settings screen SC3 displays a message M1 saying "Please input originals on either DP or table," an operation button B31 labeled "Start Scan," and an operation button B32 labeled "End Scan."

[0034] When the operation button B31 marked "Start Scan" is touched by the operator while the reading setting screen SC3 is displayed, and a reading start instruction corresponding to the button is received via the touch panel (YES in S5), the control unit 100 controls the document reading unit 5 etc. to have the document reading unit 5 read the document placed on the DP (document loading tray 61 of the document feeding unit 6) or the document placed on the platen glass, creates a folder, stores the document image obtained by reading by the document reading unit 5 in the created folder, and saves the folder in the storage device 7 (S6).

[0035] At this time, the control unit 100 performs the above process until the operator touches the operation button B32 marked "End Scan" and an instruction corresponding to the button is received via the touch panel. The control unit 100 arranges the document images obtained by the document reading unit 5 in the order in which they were read, and stores them in a folder. In other words, all document images obtained by the document reading unit 5 are arranged in chronological order and stored in a folder, and the control unit 100 stores the folder in the storage device 7.

[0036] When the above process by the control unit 100 of storing the document images in a folder and saving them in the storage device 7 ends, the process returns to S2. As shown in Fig. 7(A), the display control unit 103 causes the display unit 473 to display an operation screen SC2 (S2), and at this point, the display unit 473 displays the operation screen SC2 in which an image showing the folder FD1 storing the document images is displayed in the folder area A2. Note that when the operator operates the operation unit 47 to specify a folder stored in the storage device 7 or a USB memory connected to the USB port 8, the control unit 100 sets the specified folder as a candidate for conversion processing by the conversion unit 101, and the display control unit 103 causes the specified folder to be further displayed in the folder area A2.

[0037] In S2, when the display control unit 103 is displaying the operation screen SC2 on the display unit 473 in this way, as shown in Fig. 7(B), when the operator performs a drag-and-drop operation from the folder FD1 displayed in the folder area A2 to the image display area A1 and a conversion target specification instruction corresponding to the drag-and-drop operation is received via the touch panel ("Conversion target specification instruction" in S3), the editing unit 102 sets the original image group stored in the folder FD1 specified by the drag-and-drop operation as a conversion target by the conversion unit 101 (S31). At this time, as shown in Fig. 8, the display control unit 103 displays an arbitrary original image (an original image corresponding to one frame of an animation film; original images arranged in an order corresponding to the display position of a slider SL described later) that is one frame of the original image group in the image display area A1 (S32).

[0038] 7B, when the folder FD1 is dragged and dropped as described above and an instruction to specify the folder FD1 as a conversion target is received, the display control unit 103 switches the background color of the folder FD1 displayed in the folder area A2 to a different color, for example, bright green, at that timing. This allows the operator to immediately recognize that the folder FD1 has been specified as a conversion target by visually checking the background color of the folder FD1 displayed in the folder area A2.

[0039] Also, at this point, the display control unit 103 displays an operation button B22 marked with "Finish" in the upper right corner of the image display area A1, as shown in Fig. 8. When the operation button B22 is touched by the operator and a conversion content setting instruction corresponding to the operation button B22 is accepted via the touch panel (YES in S33), the display control unit 103 displays a conversion setting screen SC4 with the title "Conversion in Progress" on the display unit 473, as shown in Fig. 9 (S34).

[0040] The conversion setting screen SC4 displays a pull-down menu PD2 displaying options for the destination of the video file after conversion by the conversion unit 101 (e.g., USB and custom box), an input field SP1 for inputting the file name, and a pull-down menu PD3 displaying options for the file type (e.g., AVI file and MP4 file), as well as an operation button B41 marked "OK." The pull-down menu PD2, input field SP1, pull-down menu PD3, and operation button B41 displayed on this conversion setting screen SC4 are images for receiving the selection of the output destination and file format from the operator.

[0041] Here, when the operator touches the operation button B41 marked "OK" and a conversion execution instruction corresponding to that button is accepted via the touch panel (YES in S35), the conversion unit 101 converts the document image group set as the conversion target in S31 (document images arranged in chronological order to be displayed in the image display area A1) into one video file (S36). The control unit 100 stores the created video file in the storage device 7. After this, the process ends.

[0042] At this time, the conversion unit 101 converts all of the original images constituting the group of original images set as the conversion targets in S31 into a single video file in the file format selected by the operator so that each original image is played back at the playback speed set by the setting unit 104 (or a predetermined set speed if no speed is specified by the operator).

[0043] The following describes how to set the conversion contents when converting a group of document images into a video file as described above. Fig. 10(A) shows a conversion setting screen SC4 that is displayed during conversion to a video file, and Fig. 10(B) shows a conversion setting screen SC4 that is displayed after conversion to a video file is completed.

[0044] When the conversion setting screen SC4 is displayed, the conversion unit 101 and the control unit 100 accept the output destination of the video file by the operator operating the pull-down menu PD2, the file name by the operator operating the input field SP1 via the operation unit 47, and the file format by the operator operating the pull-down menu PD3. Figures 10(A) and (B) show examples of screens that are displayed when "USB" is selected as the output destination, "Video1" is set as the file name, and ".mp4" is selected as the file format.

[0045] When the output destination, file name, and file format are set in this way, conversion unit 101 converts the document image group into a video file in the set file format, and assigns the set file name to the converted video file. Then, when conversion unit 101 finishes converting images into video, control unit 100 outputs the video file obtained by conversion by conversion unit 101 to a USB memory connected to the USB port 8 via USB port 8. Then, the process ends.

[0046] In this manner, in the image forming apparatus 1, a group of document images made up of the document images obtained by reading the document reading unit 5 is converted into a moving image file.

[0047] On the other hand, after S31, when the display control unit 103 is displaying in the image display area A1 on the operation screen SC2 the original images of the original image group to be converted by the conversion unit 101 (S32), as shown in Fig. 8, a pull-down menu PD1 displaying layer hierarchical items is displayed in the upper left of the image display area A1 on the operation screen SC2. The pull-down menu PD1 has "All", "Upper Layer", and "Background Layer" as menu items. This is a menu for receiving the setting of the layer on which the original image is to be arranged from the operator. Note that in Fig. 8, only "All" is displayed, and "Upper Layer" and "Background Layer" are not displayed, showing a hidden state.

[0048] When the operator touches the symbol MK1 with a "+" design on the operation screen SC2 and an instruction to read a new document image is received through the touch panel in response to the touch (NO in S33), the control unit 100 causes the document reading unit 5 to read a new document image in accordance with the reading instruction (S37). At this time, the control unit 100 stores the document image obtained by the new reading by the document reading unit 5 in the storage device 7 (S37).

[0049] When the control unit 100 completes a series of processes for storing the document image in a folder and saving it in the storage device 7, the control unit 100 sets the document image obtained by the new reading (hereinafter referred to as the new document image) as the object to be edited (S38). After this, the process returns to S2. For example, as shown in FIG. 11(A), the display control unit 103 displays the new document image im2 vertically next to the already displayed folder FD1 in the folder area A2. At this time, the display control unit 103 sets the background color of the folder FD1 to "light green" and the background color of the new document image im2 to "gray", for example.

[0050] It should be noted that when the operation screen SC2 in S32 is displayed, if the operator operates the operation unit 47 to specify a new original image im2 stored in the storage device 7 or a USB memory connected to the USB port 8, instead of processing S37 and S38, the display control unit 103 sets the new original image im2 as the object to be edited, and displays the folder in the folder area A2.

[0051] In addition, when the operation screen SC2 is displayed in S2, the image portion showing the folder FD1 in the folder area A2 displays a symbol MK2 with a design of a "two-page document" and a symbol MK3 with a design of a "trash can."

[0052] At this time, when the operator touches the symbol MK2, which has a design of "two overlapping pages of a document," and a copy instruction corresponding to that button is accepted via the touch panel ("copy instruction" in S3), the control unit 100 creates a folder identical to the folder FD1 displaying that symbol MK2, and stores the created folder in the storage device 7 (S11). Therefore, the symbol MK2 serves as a copy button for accepting a copy instruction to copy the folder. After this, the process returns to S2.

[0053] Furthermore, when the operator touches the symbol MK3, which has a "trash can" design, and a delete instruction corresponding to that button is accepted via the touch panel ("delete instruction" in S3), the control unit 100 deletes the folder FD1 displaying that symbol MK3 from the storage device 7 (S21). The display control unit 103 hides the display indicating the folder FD1 in the folder area A2. Thus, the symbol MK3 serves as a delete button for accepting a delete instruction to delete the folder. After this, the process returns to S2.

[0054] Next, an explanation will be given of the editing process performed on the document image group that is the target of the conversion process by the conversion unit 101 in the image forming apparatus 1. Fig. 12 is a flowchart showing the editing process performed on the document image group by the image forming apparatus 1. This editing process is executed when an instruction based on an operation of the pull-down menu PD1 by the operator is received by the operation unit 47 while the operation screen SC2 is being displayed in S32 in the flowchart shown in Fig. 3.

[0055] 3, when the operation screen SC2 is displayed in S32 and the operator operates the pull-down menu PD1 to select "Upper Layer" as the layer, when a drag-and-drop operation is performed on a new original image im2 from the folder area A2 to the image display area A1, and an instruction to set the front layer corresponding to the drag-and-drop operation is received via the touch panel (YES in S51, "Front Layer" in S52), the editing unit 102 sets the new original image im2 as the front layer for each of the original images that are currently being converted by the conversion unit 101 (S53). After this, the process returns to S51.

[0056] On the other hand, when the operator operates the pull-down menu PD1 to select "Background Layer" as the layer, and then a drag-and-drop operation is performed on a new original image im2 from the folder area A2 to the image display area A1, and a back layer setting instruction corresponding to the drag-and-drop operation is accepted via the touch panel (YES in S51, "Back Layer" in S52), the editing unit 102 sets the new original image im2 as the back layer for each of the original images that are currently being converted by the conversion unit 101 (S54). After this, the process returns to S51.

[0057] Also, when the operator operates the pull-down menu PD1 to select "All" as the layer, and then performs a drag-and-drop operation on a new original image im2 from the folder area A2 to the image display area A1, a back layer setting instruction is received via the touch panel as an instruction corresponding to the drag-and-drop operation (YES in S51, "ALL" in S52), and in this case too, the editing unit 102 sets the new original image im2 as the back layer for each of the original images that are currently being converted by the conversion unit 101 (S54). After this, the process returns to S51.

[0058] In this embodiment, when the layer is selected as "Background Layer" in the pull-down menu PD1, the display control unit 103 displays the image set as the background layer in the image display area A1. FIG. 11B shows the display of the image display area A1 when no image is set as the background layer. As described above, after the editing unit 102 sets a new original image im2 as the background layer, when the operator operates the pull-down menu PD1 to select the layer as "Background Layer", the display control unit 103 displays the original image im3 as the background layer in the image display area A1 as shown in FIG. 13. In addition, when the new original image im2 is dragged and dropped from the folder area A2 to the image display area A1, the display control unit 103 switches the background color of the new original image im2 to "light orange" at this timing as shown in FIG. 11B.

[0059] Furthermore, when the operator operates the pull-down menu PD1 to select "Upper Layer" in the pull-down menu PD1, the display control unit 103 displays the image set as the foreground layer in the image display area A1. At this point, the display control unit 103 displays, as the foreground layer, an original image constituting the group of original images set as the conversion targets on the display unit 473. Furthermore, when a drag-and-drop operation is performed on a new original image im2 from the folder area A2 to the image display area A1, the display control unit 103 switches the background color of the new original image im2 to "light green" at this timing.

[0060] In this way, the background color of the new original image im2 used as the back layer is "bright orange," whereas the background color of the new original image im2 used as the front layer is "bright green." This allows the operator to know whether each folder is used as the front layer or the back layer based on the difference in background color.

[0061] Furthermore, when the operator operates the pull-down menu PD1 to select "All" as the layer, the display control unit 103 displays an image im4 in which the original image arranged in the front layer is superimposed on the original image arranged in the back layer in the image display area A1, as shown in Fig. 14. For example, the display control unit 103 displays the image im4 as an image showing the original image arranged in the back layer being transparent to the original image arranged in the front layer.

[0062] When displaying, in image display area A1 on operation screen SC2, original images of the original image group to be converted by conversion unit 101 (S32 in FIG. 3), display control unit 103 displays operation button B22 marked with "Finish" in the upper right of image display area A1. In this state, in S51, the operator touches operation button B22, and when a screen switching instruction is accepted in response to this touch operation (NO in S51), conversion setting screen SC4 is displayed on display unit 473 (S56).

[0063] When the conversion setting screen SC4 is displayed, the operator touches the operation button B41 marked "OK," and a conversion instruction is accepted via the touch panel in response to the operation of the operation button B41 (YES in S57), and if the editing unit 102 determines that a layer is set at this point (YES in S58), it creates a composite image made of multiple layers having a structure in which the original image set at this point as the front layer (upper layer) is superimposed on the original image set as the back layer (lower layer) (S59). Note that if the editing unit 102 determines that no layer is set at this point (NO in S58), the above composite image is not created, and the process proceeds to S60.

[0064] Thereafter, the conversion unit 101 converts the original image group set as the conversion target at this time into a video by treating the composite image created by the editing unit 102 as one original image constituting the original image group to be converted into a video (S60). Then, the process ends.

[0065] Next, the display in the image display area A1 of the operation screen SC2 will be further described.

[0066] In the process of S31 in Fig. 3, when the display control unit 103 is displaying in the image display area A1 the original images stored in the folder FD1 and set as the objects to be converted by the conversion unit 101, it causes a symbol MK4 with a design of "x" and a symbol MK5 with a design of "clock" to be displayed in the display portion of the folder FD1 in the folder area A2, as shown in Fig. 8. Furthermore, the display control unit 103 causes an operation button B21 to be displayed to the side (right side in Fig. 8) of the scroll bar SB and slider SL displayed at the bottom end of the image display area A1, for receiving an instruction to continuously play back each original image stored in the folder FD1.

[0067] When the operation button B21 is touched by the operator and an instruction corresponding to the operation button B21 is received via the touch panel, the display control unit 103 causes each of the original images to be converted to be continuously played back in chronological order on the display unit 473.

[0068] Furthermore, when an operator performs a slide operation on the slider SL to a position in the x direction in the image display area A1, the display control unit 103 moves and displays the display position of the slider SL in the x direction in accordance with the slide operation. At this time, the display control unit 103 displays the slider SL at a touch position (x direction position in the image display area A1) touched by the operator's finger that moves in response to the slide operation.

[0069] The display control unit 103 stores the display position of the slider SL and the order of each document image arranged in chronological order in association with each other. Then, when the operator performs a sliding operation on the slider SL, the display control unit 103 displays, as a large image im1 in the image display area A1, the document images arranged in the order corresponding to the display position of the slider SL, which is moved and displayed in accordance with the sliding operation.

[0070] Then, when an operator performs a sliding operation on the slider SL and an instruction corresponding to the sliding operation is received via the touch panel, the display control unit 103 sequentially detects original images in an order corresponding to the display position of the slider SL which is moved and displayed in accordance with the sliding operation, and sequentially replaces the detected original images with the original images to be displayed as the large image im1 in the image display area A1.

[0071] The display control unit 103 also picks up a predetermined number of other original images that are not displayed as the large image im1 in the image display area A1 (seven original images in this example), and displays the picked-up original images in chronological order on the operation screen SC2 as reduced images im5, as shown in Fig. 8. When the operator slides the slider SL, the display control unit 103 displays the reduced image im5, which is located at a position corresponding to the display position (the touch position) of the slider SL that is moved in accordance with the slide operation and displayed, as a reduced image im51 larger than the reduced image im5 of the other original image displayed in the image display area A1. That is, the display control unit 103 further displays the original image displayed as the reduced image im51 of the large size in the image display area A1.

[0072] Furthermore, the editing unit 102 performs a deletion process as the above-mentioned editing process on the original image displayed as the large image im1 in the image display area A1 in accordance with an instruction from the operator via the operation unit 47. For example, when the operator touches the button with the symbol MK4 with a design of "x" and an instruction corresponding to the button is accepted via the touch panel, the editing unit 102 performs a deletion process to delete the original image displayed as the large image im1 in the image display area A1 from the conversion target. When the above-mentioned deletion process is performed by the editing unit 102, the display control unit 103 hides the original image from the image display area A1. In other words, the deleted original image is not subject to the subsequent conversion process by the conversion unit 101 and is not included in the created video file.

[0073] Next, the setting of the playback speed of each document image constituting the document image group to be converted will be described. The setting unit 104 sets the playback speed of each document image constituting the document image group (here, the display time (playback time) of one frame) according to a speed setting instruction from the operator received by the operation unit 47. For example, when the button with the symbol MK5 of a "clock" design shown in FIG. 8 is touched by the operator and an instruction corresponding to the button is received via the touch panel, the display control unit 103 displays a speed setting screen PU1 for setting the playback speed on the operation screen SC2 as shown in FIG. 15(A). A numeric keypad is displayed on the speed setting screen PU1. This numeric keypad is a button image for receiving a designation of the playback speed from the operator.

[0074] The setting unit 104 sets the playback speed designated by the operator pressing the numeric keypad on the speed setting screen PU1 and accepted via the touch panel as the display time of the original image (one frame) displayed as the large image im1 at this point. Fig. 15(B) shows a display example in which the display time of one frame is designated as "200 msec". Note that, although the case where the setting unit 104 sets the display time of one frame as the playback speed of the original image is described here, as another embodiment, the setting unit 104 may set the time designated by the operator pressing the numeric keypad on the speed setting screen PU1 as the total playback time of all the original images to be converted by the conversion unit 101, and set the value obtained by dividing this total playback time by the number of all the original images as the display time of one frame.

[0075] Next, a process of adding an original image will be described. For example, when the operator touches the symbol MK1 with a design of "+" on the operation screen SC2 shown in Fig. 8 and an instruction to read a new original image is accepted via the touch panel in response to the button, the control unit 100 causes the original reading unit 5 to read a new original image. The control unit 100 stores the new original image obtained by reading by the original reading unit 5 in the storage device 7.

[0076] When the control unit 100 finishes the process of saving the new original image in the storage device 7, the display control unit 103 displays the new original image im6 in the folder area A2 vertically aligned with the image showing the folder FD1, as shown in Fig. 16(A), for example. At this time, the display control unit 103 sets the background color of the new original image im6 to "light green" and the background color of the folder FD1 to "gray", for example.

[0077] As shown in FIG. 16B, when the pull-down menu PD1 is in a state where the layer is not specified by the operator, the operator performs a drag-and-drop operation on a new original image im6 displayed in the folder area A2 from the folder area A2 to the image display area A1, and an image addition instruction corresponding to the drag-and-drop operation is accepted via the touch panel, the editing unit 102 adds the new original image im6 as one of the original images to be converted by the conversion unit 101 at this time, in the order immediately following the original image displayed as the large image im1 in the image display area A1. After this addition, the display control unit 103 displays the newly added original image im6 in the image display area A1 as a large image im8 in place of the large image im1 up until now, as shown in FIG. 17. Note that FIG. 17 shows the operation screen SC2 displayed when a plurality of new original images im6 are added.

[0078] Furthermore, when a new document image is dragged and dropped, the display control unit 103 switches the background color of the new document image to "bright green" at that time, as shown in FIG. 16(B).

[0079] In this way, according to the first embodiment, editing of the original image can be performed on one frame of the original image (one frame of the original image to be changed) displayed in the image display area A1. In addition, by performing the above-mentioned deletion and addition processing, it is possible to replace the original image to be converted. This allows editing of each original image constituting the original image group to be converted on a frame-by-frame basis, and allows multiple layers to be set for the original image to be converted, so that it is possible to easily create a video that satisfies the operator. Furthermore, according to the first embodiment, reading of the original to obtain the original image to be the material of the video file, and the above-mentioned editing processing and video file creation processing can be performed seamlessly, so that a video file can be easily created from a paper-based original.

[0080] Fig. 18 is a functional block diagram showing an outline of the main internal configuration of an image forming apparatus according to the second embodiment. The image forming apparatus according to the second embodiment differs from the image forming apparatus according to the first embodiment shown in Fig. 1 only in that the control unit 10 includes a thinning section 105. The control unit 10 functions as the control section 100, conversion section 101, editing section 102, display control section 103, and setting section 104, and further functions as the thinning section 105, by the operation of the processor according to the control program stored in the storage device 7.

[0081] The thinning unit 105 performs a process of thinning out the original images constituting the original image group after editing by the editing unit 102 at a predetermined ratio. That is, the thinning unit 105 performs a process of deleting a specified number of frames for every number of frames specified by the operator operating the operation unit 47. For example, the thinning unit 105 thins out the original image group by deleting 39 frames for every 40 frames. In this case, for example, if the original image group consists of 720 frames, the original image remaining after the thinning by the thinning unit 105 will be 18 frames.

[0082] When an operator operates the operation unit 47 to receive a thinning instruction to delete a specified number of frames from each specified number of frames, the thinning unit 105 thins out the original images that make up the original image group in accordance with the thinning instruction. The control unit 100 then controls the operation of the image forming unit 12 and other units to perform aggregate printing (e.g., 2-in-1, 4-in-1, or 16-in-1) of the original images remaining after the thinning out by the thinning unit 105. This results in a printed matter P1, as shown in FIG. 19, in which each scene of the video played back from the original image group is extracted. The printed matter P1 allows the operator to easily visually imagine the completed video.

[0083] In another embodiment, the editing unit 102 may further compare adjacent original images arranged in chronological order for each original image forming group using a technique such as pattern matching, and if the identity does not reach a predetermined level (e.g., 80%), extract the original image arranged later among the compared original images as an extracted image. The editing unit 102 extracts all extracted images detected from the original image group. Then, the control unit 100 controls the operation of the image forming unit 12, etc., to perform aggregate printing of the extracted images extracted by the editing unit 102. As a result, each original image in which a change has occurred in the image content is extracted from the original image forming group, and a printed matter P1 is obtained in which each scene with a large change is extracted from the video to be played.

[0084] According to the second and further embodiments, the reading of the manuscript to obtain the manuscript image that will serve as the material for the video file, and the thinning and extraction processes to obtain the printed matter P1 can be performed seamlessly, and then a video file can be easily created from the paper manuscript.

[0085] The present invention is not limited to the above-described embodiment, and various modifications are possible. Furthermore, if the present invention is equipped with a coin vending machine and opened to the public, it will be possible to establish a new business model.

[0086] In addition, in the above embodiment, the configuration and processing shown in the above embodiment using FIGS. 1 to 19 are merely one embodiment of the present invention, and it is not intended that the present invention be limited to these configurations and processing. [Explanation of symbols]

[0087] 1. Image forming device 5 Document reading section 12 Image forming section 47 Control section 100 Control section 101 Conversion unit 102 Editorial Department 103 Display control unit 104 Setting section 105 Thinning out section 473 Display section

Claims

1. A storage unit that stores a document image group consisting of a plurality of document images; a conversion unit for converting the document image group, in which the plurality of document images are arranged in chronological order, into a video; an editing unit that edits each of the document images included in the document image group that is to be converted by the conversion unit; A display unit; a display control unit that forms an image display area on the display unit and displays the document images that constitute the document image group in the image display area; and an operation unit that receives an instruction, the editing unit sets a layer selected by an instruction received by the operation unit to an original image constituting the original image group; when a layer of a hierarchy indicated by an instruction received by the operation unit is set by the editing unit for an original image constituting the original image group, and a layer of a different hierarchy indicated by an instruction received by the operation unit is set by the editing unit for a new original image associated with the original image, the display control unit causes an image in which an original image having a higher layer set is superimposed on an original image having a lower layer set among the original images in accordance with the instruction received by the operation unit, the editing unit performs editing to create a composite image having a multi-layer structure in which the original image having a lower layer set is superimposed on the original image having a higher layer set, in accordance with an instruction received from the operation unit while the superimposed image is being displayed on the display unit; The conversion unit is an electronic device that converts the group of original images into a video by treating the composite image created by the editing unit as one original image that constitutes the group of original images.

2. a document reading unit that reads an image of a document; The electronic device according to claim 1 , further comprising: a control unit configured to store, in the storage unit, a document image group consisting of a plurality of document images obtained by reading with the document reading unit.

3. The electronic device described in claim 1 or claim 2, wherein the editing unit further performs at least one of the following editing processes: a deletion process that deletes the original image displayed in the image display area from the conversion target, and an addition process that adds a new original image in a chronological order immediately following the original image displayed in the image display area. Electronic devices.

4. the display control unit forms a folder area on the display unit that displays a folder that is stored in the storage unit and that contains the document image; 4 . The electronic device according to claim 1 , further comprising: a control unit that controls a background color of a folder displayed in the folder area, the folder storing the document images specified by an instruction received by the operation unit.

5. a setting unit that sets a reproduction speed of the document image in accordance with a speed setting instruction received by the operation unit, 5. The electronic device according to claim 1, wherein the conversion section converts the original image into a video image at a playback speed set by the setting section as a playback speed at which the original image is played back.

6. A storage unit that stores a document image group consisting of a plurality of document images; an editing unit that edits each of the document images included in the document image group; a conversion unit for converting the document image group, in which the plurality of document images are arranged in chronological order, into a video; A display unit; a display control unit that forms an image display area on the display unit and displays the document images that constitute the document image group in the image display area, The editing unit performs an editing process on the document images constituting the document image group that are to be converted by the conversion unit; The conversion unit converts the document image edited by the editing unit into a video, a document reading unit that reads an image of a document; a control unit that stores a document image group consisting of a plurality of document images obtained by reading the document reading unit in the storage unit, The editing unit is an electronic device that further performs an extraction process to compare multiple document images obtained by reading by the document reading unit and arranged in chronological order, and extract document images whose identity with the document images arranged before and after them in chronological order does not meet a predetermined level.

7. an electronic device comprising: a storage unit that stores an original image group consisting of a plurality of original images; an editing unit that edits each original image included in the original image group; a conversion unit that converts the original image group, consisting of the plurality of original images arranged in chronological order, into a video; a display unit; a display control unit that forms an image display area on the display unit and displays the original images that make up the original image group in the image display area; and a control unit, wherein the editing unit performs editing processing on the original images that make up the original image group that are the subject of conversion by the conversion unit, and the conversion unit converts the original images edited by the editing unit into a video; an image forming unit that forms an image on a recording paper; a thinning unit that performs a process of thinning out the document images constituting the document image group edited by the editing unit at a predetermined ratio, The control unit causes the image forming unit to perform aggregate printing of the document images remaining after the thinning out by the thinning unit.

Images