Information processing device and image forming apparatus

Abstract

To improve the visibility of characters in a preview image during display of the preview image.SOLUTION: An image forming apparatus 1 comprises: a display 473; a controller 100 that causes the display 473 to display a preview image of an output target image indicated by image data; and a character orientation detector 101 that detects the orientation of characters in the output target image. The controller 100 sets the orientation of the preview image to an orientation in which the orientation of the characters detected by the character orientation detector 101 becomes a portrait orientation in which the characters are upright, and displaying the preview image on the display 473.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present invention relates to an information processing apparatus and an image forming apparatus. [Background technology]

[0002] Some information processing devices, such as image forming devices, are equipped with a rectangular display unit having long and short sides, and the display screen of which can be rotated between portrait and landscape orientations. Patent Document 1 listed below describes an image forming device equipped with a rectangular display unit having long and short sides and a rotation mechanism that enables the display unit to be rotated between landscape orientation, with the long side facing up and portrait orientation, with the short side facing up and down. Patent Document 1 listed below also describes a method of rotating and enlarging a preview image to match the orientation of the display unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-140504 Summary of the Invention [Problem to be solved by the invention]

[0004] Some image forming devices have a preview function that displays a preview image of the image to be output (for example, an image showing the finished print image) on a display unit. By displaying the preview image on the display unit, for example, the user can check the finished print state in advance.

[0005] However, because preview images cannot be displayed very large, it is difficult for users to check the details of the final print image. In particular, when the preview image is displayed, if the text in the preview image is not upright (portrait), but is oriented horizontally, it is difficult for users to decipher and recognize the text.

[0006] The present invention has been made in view of the above circumstances, and has as its object to improve the visibility of characters in a preview image when the preview image is displayed. [Means for solving the problem]

[0007] An information processing device according to one aspect of the present invention includes a display unit, a control unit that displays a preview image of an image to be output indicated by image data on the display unit, and a character direction detection unit that detects the orientation of characters in the image to be output, and the control unit sets the orientation of the preview image so that the orientation of the characters detected by the character direction detection unit is portrait orientation in which the characters are upright, and performs orientation-adjusted display of the preview image on the display unit.

[0008] An image forming apparatus according to one aspect of the present invention includes an information processing apparatus according to one aspect of the present invention and an image forming unit that forms an image on a recording medium, and the control unit causes the display unit to display an image that is to be the subject of image formation by the image forming unit as the preview image. [Effects of the Invention]

[0009] According to the present invention, it is possible to improve the visibility of characters in a preview image when the preview image is displayed. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a front cross-sectional view showing the structure of an image forming apparatus according to an embodiment of the present invention. [Figure 2] 1 is a functional block diagram illustrating a schematic main internal configuration of an image forming apparatus according to an embodiment of the present invention; [Figure 3] 10A to 10G are diagrams illustrating an example of rotation of the display unit. [Figure 4] 10(A) and 10(B) are diagrams illustrating changes in the signal output from the detection sensor. [Figure 5] 10A to 10D are diagrams showing examples of images to be output. [Figure 6] 10A to 10D are diagrams showing examples of preview images displayed on a display unit. [Figure 7] 10A to 10D are diagrams showing examples of preview images displayed on a display unit. [Figure 8] 10A and 10B are diagrams showing an example of an image to be output, and 10C is a diagram showing an example of an image displayed on a display unit. [Figure 9] 10A and 10B are diagrams showing an example of an image to be output, and 10C is a diagram showing an example of an image displayed on a display unit. [Figure 10] 10A and 10B are diagrams showing an example of a preview image displayed on a display unit. [Figure 11] 10 is a flowchart showing an example of a preview display process in the image forming apparatus 1. [Figure 12] FIG. 10 is a functional block diagram illustrating a main internal configuration of an image forming apparatus according to another embodiment. [Figure 13] 10A and 10B are diagrams showing an example of an image to be output, and 10C is a diagram showing an example of an image displayed on a display unit. [Figure 14] 10A and 10B are diagrams showing an example of an image to be output, and 10C is a diagram showing an example of an image displayed on a display unit. [Figure 15] 10A and 10B are diagrams showing an example of a preview image displayed on a display unit. [Figure 16] 10A and 10B are diagrams showing an example of a preview image displayed on a display unit. [Figure 17] 10A and 10B are diagrams showing an example of a preview image displayed on a display unit. [Figure 18] 10A to 10C are diagrams showing examples of preview images displayed on a display unit. DETAILED DESCRIPTION OF THE INVENTION

[0011] An information processing device according to one embodiment of the present invention will be described below with reference to the drawings. An information processing device according to one embodiment of the present invention is, for example, an image forming device. FIG. 1 is a front cross-sectional view showing the structure of an image forming device according to one embodiment of the present invention. FIG. 2 is a functional block diagram showing the main internal configuration of an image forming device according to one embodiment of the present invention. FIGS. 3(A) to 3(G) are diagrams for explaining an example of rotation of the display unit 473. Although left, right, up, and down directions may be indicated below, these directions indicate directions as examples in each drawing unless otherwise specified.

[0012] The image forming apparatus 1 is a multifunction device that combines multiple functions, such as a copy function, a printer function, a scanner function, and a facsimile function. The image forming apparatus 1 includes a control unit 10, a document feeder 6, a document reader 5, an image forming unit 12, a fixing unit 13, a paper feeder 14, an operation unit 47, a network interface unit 91, and a storage unit 8.

[0013] The document feeder 6 is configured to be openable and closable by a hinge or the like (not shown) on the top surface of the document reading unit 5, and functions as a document pressing cover when reading a document placed on a platen glass (not shown). The document feeder 6 is also an ADF (Auto Document Feeder), and includes a document placement tray 61, and supplies documents placed on the document placement tray 61 to the document reading unit 5.

[0014] The document reading unit 5 includes a scanner and the like, and reads a document fed from a document feeding unit 6, or reads a document placed on a platen glass.

[0015] The following describes the case where a document is read by the image forming apparatus 1. The document reading unit 5 optically reads an image of a document supplied to the document reading unit 5 by the document feeding unit 6 or a document placed on the platen glass, and generates image data. The image data generated by the document reading unit 5 is stored in an image memory (not shown) or the like.

[0016] The following describes an image forming operation performed by the image forming apparatus 1. The image forming unit 12 is equipped with a photosensitive drum, charging device, exposure device, developing device, and primary transfer device for each color, and is a mechanism for forming an image on recording paper as a recording medium by secondary transfer via an intermediate transfer belt. The image forming unit 12 forms a toner image on recording paper fed from the paper feed unit 14 based on image data generated by a document reading operation, image data stored in an image memory, etc., and image data received from a computer connected via a network, to create a printed matter.

[0017] The paper feed unit 14 includes a paper feed cassette, a pickup roller that picks up recording paper from the paper feed cassette and feeds it to the image forming unit 12, a transport roller, a transport path, and a rotation drive mechanism for each roller.

[0018] The fixing unit 13 is a fixing device equipped with a heat roller, a pressure roller, and a drive mechanism for rotating these rollers. The fixing unit 13 heats and presses the recording paper on which the toner image has been formed by the image forming unit 12 at the nip between the two rollers, fixing the toner image to the recording paper. The recording paper that has been fixed is then discharged to the discharge tray 151.

[0019] The operation unit 47 includes various hard keys that are operated by the user, and receives instructions from the user, such as an instruction to execute an image forming operation, regarding various operations and processes that the image forming apparatus 1 can execute in response to the operation of the hard keys.

[0020] The operation unit 47 includes a display unit 473 that displays operation guidance and the like to the operator, a rotation mechanism 474, a holding mechanism 475, and a detection sensor 476. The operation unit 47 also receives input of instructions from the user via a touch panel that the display unit 473 has, based on the user's operation (touch operation) on the screen displayed on the display unit 473.

[0021] The display unit 473 is a rectangular display having long and short sides, and is made up of an LCD (Liquid Crystal Display) or the like. When the operator touches a button or key displayed on the screen, the touch panel receives an instruction associated with the touched position. In this case, the touch panel functions as an operation unit.

[0022] The holding mechanism 475 is an arm-shaped member that attaches the display unit 473 to the device body 120 of the image forming apparatus 1. The holding mechanism 475 rotatably supports the display unit 473 relative to the holding mechanism 475, and temporarily fixes and holds the display unit 473 in both the landscape and portrait orientations. The holding mechanism 475 has engaging portions, each consisting of a recess provided opposite the display unit 473, at positions corresponding to the landscape and portrait orientation positions of the display unit 473. A protrusion that fits into the engaging portion is provided on the side of the display unit 473 facing the holding mechanism 475. When the display unit 473 is in the landscape orientation (FIGS. 3(A) and (G)) or the portrait orientation (FIG. 3(D)), these recesses and protrusions fit together, thereby fixing and holding the orientation of the display unit 473.

[0023] The rotation mechanism 474 is interposed between the holding mechanism 475 and the display unit 473. That is, the holding mechanism 475 rotatably supports the display unit 473 via the rotation mechanism 474. The rotation mechanism 474 has a rotation shaft, which is rotatably supported by the holding mechanism 475. The rotation shaft is attached to the rectangular center of the side surface of the display unit 473 facing the holding mechanism 475, in a state in which it rotates together with the display unit 473. A cam (described later) that rotates together with the rotation shaft is provided on the circumferential surface of the rotation shaft. The rotation mechanism 474 rotates the display unit 473 between a landscape orientation in which the long side of the display unit 473 faces up and down, and a portrait orientation in which the short side of the display unit 473 faces up and down.

[0024] An example of rotation of the display unit 473 will be described with reference to Figures 3(A) to 3(G). The display unit 473 in landscape orientation shown in Figure 3(A) rotates counterclockwise to become portrait orientation as shown in Figures 3(B) to 3(D). The display unit 473 in portrait orientation shown in Figure 3(D) rotates clockwise to become landscape orientation as shown in Figures 3(E) to 3(G).

[0025] 3 when viewed from the surface of display unit 473, rotation mechanism 474 is configured to switch display unit 473 from landscape to portrait. Note that the range of rotation angle of display unit 473 is not limited to 90 degrees, but here, an example is given in which the range of rotation angle is 90 degrees. However, the rotation direction of display unit 473 and the configuration for switching display unit 473 from landscape to portrait are not limited to this, and this embodiment is merely an example.

[0026] The detection sensor 476 is a switch mechanism that detects whether the display unit 473 is in a landscape orientation or a portrait orientation. The switch mechanism is provided at a position where it is pressed by a cam lobe (convex portion) of the cam attached to the rotation shaft when the display unit 473 is in a portrait orientation. When pressed by the cam lobe, the switch mechanism outputs an ON signal (Low signal) to the control unit 10. In other words, the switch mechanism is provided at a position where it is not pressed by the cam lobe when the display unit 473 is in an orientation other than portrait orientation.

[0027] The above-mentioned configuration of rotation mechanism 474, which switches display unit 473 from landscape to portrait orientation by rotating display unit 473 in the counterclockwise direction in FIG. 3 as viewed from the surface of display unit 473, employs, for example, a configuration in which the cam lobe can enter the switch mechanism only when display unit 473 is rotated in the counterclockwise direction, and is not possible when display unit 473 is rotated in the clockwise direction (such as providing a convex portion on the outer edge of the switch mechanism that engages with the cam lobe on the path of entry of the cam lobe into the switch mechanism from the clockwise direction).

[0028] 4(A) and (B) are diagrams illustrating changes in the signal output from detection sensor 476 provided at a position corresponding to the portrait orientation of display unit 473. As shown in Fig. 4(A) and (B), detection sensor 476 provided at a position corresponding to the portrait orientation of display unit 473 outputs a Low signal to control unit 10 when display unit 473 is in the portrait orientation (when the switch mechanism receives pressure from the cam lobe), and outputs a High signal to control unit 10 at other times (when the switch mechanism does not receive pressure from the cam lobe).

[0029] Therefore, when the display unit 473 is in the portrait orientation shown in Fig. 3(D), the detection sensor 476 outputs a Low signal to the control unit 10, but when the display unit 473 is in an orientation other than the portrait orientation shown in Fig. 3(D), the detection sensor 476 outputs a High signal to the control unit 10. As a result, the control unit 100, which will be described later, determines whether the display unit 473 is in the portrait orientation or an orientation other than the portrait orientation based on the signal output from the detection sensor 476. Specifically, the control unit 100 determines that the display unit 473 is in the portrait orientation when the display unit 473 is in the portrait orientation shown in Fig. 3(D), and determines that the display unit 473 is in the landscape orientation in all other orientations.

[0030] The network interface unit 91 is a communication interface for transmitting and receiving various data to and from an external device (for example, a personal computer) within a local area or on the Internet.

[0031] The storage unit 8 is a large-capacity storage device such as a hard disk drive (HDD) or a solid state drive (SSD), and stores various control programs and the like.

[0032] The control unit 10 includes a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), and a dedicated hardware circuit. The processor is, for example, a CPU (Central Processing Unit), an ASIC (Application Specific Integrated Circuit), or an MPU (Micro Processing Unit). The control unit 10 includes a control unit 100, a character direction detection unit 101, and a first calculation unit 102.

[0033] The control unit 10 functions as a control unit 100, a character direction detection unit 101, and a first calculation unit 102 through the operation of the processor in accordance with a control program stored in the storage unit 8. However, the control unit 100 and the like can also be configured by hardware circuits, without relying on the operation of the control unit 10 in accordance with a control program. Unless otherwise specified below, this applies to each embodiment.

[0034] The control unit 100 is responsible for overall operational control of the image forming apparatus 1. The control unit 100 is connected to the document feed unit 6, the document reading unit 5, the image forming unit 12, the fixing unit 13, the paper feed unit 14, the operation unit 47, the network interface unit 91, and the storage unit 8, and controls the driving of each of these units. For example, the control unit 100 executes various processes required for image formation by the image forming apparatus 1.

[0035] The control unit 100 controls the display of the display unit 473, and displays, for example, a preview image of the image to be output indicated by the image data on the display unit 473. The image data indicating the image to be output is image data obtained by reading an original by the original reading unit 5, or image data sent from a personal computer or the like via the network interface unit 91.

[0036] The character direction detection unit 101 detects the direction of characters in the image to be output. For example, the character direction detection unit 101 detects the direction of characters in the image to be output using a character direction detection technology that uses an existing OCR (Optical Character Recognition) technology. Figures 5(A) to 5(D) are diagrams showing examples of the image to be output.

[0037] In the case of the output target images TG1 and TG3 shown in Figures 5(A) and (C) to be previewed, the character orientation detection unit 101 detects that the characters in the output target images TG1 and TG3 are upright and vertically oriented, and detects that the characters in the output target images TG2 and TG4 shown in Figures 5(B) and (D) are horizontally oriented, which is 90 degrees different from the vertical orientation (the characters are leaning to the left in Figures 5(B) and (D)). That is, in this embodiment, the orientation of characters that are upright is considered to be vertical.

[0038] Control unit 100 sets the orientation of the preview image so that the orientation of the characters detected by character orientation detection unit 101 is the portrait orientation, and performs orientation-adjusted display to display the preview image on display unit 473. Control unit 100 also adjusts the size of the preview image to match the orientation of display unit 473 detected by detection sensor 476, and performs size-adjusted display to display the preview image on display unit 473. Here, the orientation of the preview image can be landscape, where the long side is upside down, or portrait, where the short side is upside down.

[0039] For example, when the control unit 100 displays previews of the output target images TG1 to TG4 shown in Figures 5(A) to (D), when the display unit 473 is in landscape orientation, the control unit 100 displays the respective preview images PV1 to PV4 on the display unit 473 as shown in the examples of Figures 6(A) to (D), and when the display unit 473 is in portrait orientation, the control unit 100 displays the respective preview images PV11 to PV14 on the display unit 473 as shown in the examples of Figures 7(A) to (D).

[0040] The characters in the image to be output TG2 shown in Fig. 5(B) are not oriented vertically, but are oriented horizontally, tilted 90 degrees counterclockwise from the vertical orientation to the left, so the control unit 100 rotates the preview image of the image to be output TG2 by 90 degrees clockwise, and displays preview images PV2 and PV12 on the display unit 473, as shown in Fig. 6(B) and Fig. 7(B). Similarly, the characters in the image to be output TG4 shown in Fig. 5(D) are not oriented vertically, but are oriented horizontally, tilted to the left, so the control unit 100 rotates the preview image of the image to be output TG4 by 90 degrees clockwise, and displays preview images PV4 and PV14 on the display unit 473, as shown in Fig. 6(D) and Fig. 7(D).

[0041] 6B and 6C, control unit 100 displays preview images PV2 and PV3 on display unit 473, enlarged to the maximum size that can be displayed on the display screen while maintaining the aspect ratio to match the size of the display area of the display screen on display unit 473 in landscape orientation. Also, when display unit 473 is in portrait orientation and the preview image is in portrait orientation, control unit 100 displays preview images PV11 and PV14 on display unit 473, enlarged to the maximum size that can be displayed on the display screen while maintaining the aspect ratio to match the size of the display area of the display screen on display unit 473 in portrait orientation, as shown in FIGS.

[0042] Based on the detection result by the character direction detection unit 101, the first calculation unit 102 calculates the size of a character area in which characters are arranged in the image to be output, for each character area with different character orientations. For example, based on the detection result by the character direction detection unit 101, the first calculation unit 102 calculates the size of a first character area indicating a character area in the image to be output for a group of characters oriented in a predetermined first direction, and the size of a second character area indicating a character area in the image to be output for a group of characters oriented in a second direction that is 90 degrees different from the first direction. Here, the size of a character area is assumed to be an area. That is, the first calculation unit 102 calculates the sum of the areas in which characters with the same character orientation are displayed as the area of the character area of the group of characters with that orientation. In this case, the areas of characters with the same orientation may be scattered, or the areas of each character may be contiguous and form a single area. Note that the first calculation unit 102 may detect a character area that does not include characters smaller than a predetermined size.

[0043] Fig. 8(A) shows an example of an image to be output in which the characters are oriented in more than one direction. For example, the first calculation unit 102 analyzes image data showing the image to be output TG5 shown in Fig. 8(A) and calculates the size (area) of a first character region A1 in the image to be output TG5 for characters facing upward and the size (area) of a second character region A2 in the image to be output TG5 for characters facing left, as shown in Fig. 8(B).

[0044] Control unit 100 sets the orientation of the preview image so that the orientation of the characters included in the largest character area calculated by first calculation unit 102 is vertical, and performs orientation adjustment display to display the preview image on display unit 473. For example, when first character area A1 is larger than second character area A2, control unit 100 sets the orientation of the preview image so that the orientation of the characters facing the first direction is vertical, and when second character area A2 is larger than first character area A1, control unit 100 sets the orientation of the preview image so that the orientation of the characters facing the second direction is vertical.

[0045] For example, as shown in Fig. 8(B), when second character area A2 is larger than first character area A1, control unit 100 sets the orientation of the preview image so that the orientation of the characters facing the second direction is portrait. Then, control unit 100 displays preview image PV5 on display unit 473, which is landscape-oriented in Fig. 8(B), enlarged to the maximum size that can be displayed on the display screen while maintaining the aspect ratio in accordance with the size of the display area of the display screen of display unit 473.

[0046] In addition, when the difference in size between the first character area A1 and the second character area A2 is within a predetermined range (for example, when the size of the first character area A1 / (the size of the first character area A1+the size of the second character area A2) is within a range of 45% to 55%), the control unit 100 sets the orientation of the preview image to an orientation in which either the orientation of the characters facing the first direction or the orientation of the characters facing the second direction, as indicated by the user's instruction received by the operation unit 47, is vertical.

[0047] 9A shows another example of an output target image in which the character orientation is not limited to one direction. As shown in FIG. 9B, when the difference in size between the first character region A1 and the second character region A2 in the output target image TG6 is within the predetermined range, control unit 100 sets the orientation of the preview image in accordance with an instruction received by operation unit 47 so that either the first character region A1, which has characters oriented in the first direction, or the second character region A2, which has characters oriented in the second direction, is oriented vertically. As shown in FIG. 9C, control unit 100 displays, as icons, preview image PV61 when processing is performed to change the first character region A1 to a vertical orientation, and preview image PV62 when processing is performed to change the second character region A2 to a vertical orientation, on display unit 473. Additionally, control unit 100 displays, on display unit 473, a message M1 stating, "Please select one of the following two preview display methods."

[0048] When operation unit 47 accepts a user selection for preview image PV61 (when the user requests execution of first direction adjustment display), control unit 100 displays preview image PV61 on display unit 473 as shown in Fig. 10(A). On the other hand, when operation unit 47 accepts a user selection for preview image PV62 (when the user requests execution of second direction adjustment display), control unit 100 displays preview image PV62 on display unit 473 as shown in Fig. 10(B). In this case as well, control unit 100 displays a preview image on display unit 473 that has been enlarged to the maximum size that can be displayed on the display screen while maintaining the aspect ratio in accordance with the size of the display area on the display screen in accordance with the orientation of display unit 473.

[0049] Next, a description will be given of a preview display process in the image forming apparatus 1. Fig. 11 is a flowchart showing an example of the preview display process in the image forming apparatus 1.

[0050] The control unit 100 determines whether or not characters exist in the image to be output using known OCR technology and / or edge detection technology, based on image data representing the image to be output (S1). If the control unit 100 determines that characters exist in the image to be output (YES in S1), the character direction detection unit 101 detects the orientation of the characters in the image to be output (S2). For example, during the processing of S1, the character orientation detection unit 101 performs character discrimination using OCR technology on the image data representing the image to be output from the top, bottom, left, and right directions, stores the orientation recognized as a character for each character, and reads the orientation of each character in S2.

[0051] Based on the detection result by character direction detection unit 101, control unit 100 determines whether characters of different orientations are mixed in the image to be output (S3). If it determines that characters of different orientations are not mixed in the image to be output (there is only one orientation) (NO in S3), control unit 100 sets the orientation of the preview image so that the orientation of the characters detected by character direction detection unit 101 is portrait, in which the characters are upright, and creates a preview image of the image to be output (S4). Then, control unit 100 displays the created preview image on display unit 473, enlarging it to the maximum size that can be displayed on the display screen while maintaining the aspect ratio, in accordance with the size of the display area on the display screen of display unit 473 in accordance with the orientation of the display unit 473 detected by detection sensor 476 (S5). After this, the processing ends.

[0052] On the other hand, if the control unit 100 determines that characters of different orientations are mixed in the image to be output (YES in S3), the first calculation unit 102 calculates the size of each character area for each character of different orientations based on the detection result by the character orientation detection unit 101 (S6).

[0053] Based on the calculation result by the first calculation unit 102, the control unit 100 determines whether the difference in size between the character regions is within the predetermined range (S7). Here, the case of determining whether the difference in size between the first character region A1, in which the character orientation is a first direction, and the second character region A2, in which the character orientation is a second direction, is within the predetermined range is taken as an example.

[0054] If control unit 100 determines that the difference in size between the two is not within the predetermined range (one is too large) (NO in S7), it creates a preview image of the image to be output so that the orientation of the characters included in the larger character area is portrait (S8), and displays the preview image, resized to match the orientation of display unit 473 detected by detection sensor 476, on display unit 473 (S5). After this, the process ends.

[0055] On the other hand, if control unit 100 determines that the difference in size between the two images is within the predetermined range (the two images are substantially the same) (YES in S7), it creates preview images of the image to be output for each different orientation so that the text orientation is portrait (S9), and displays the created preview images side by side on display unit 473, as shown in the example of Fig. 9(C), and causes display unit 473 to display message M1 prompting the user to input an instruction to select one of the preview images (S10). Control unit 100 determines the preview image in accordance with the selection instruction received by operation unit 47 (S11).

[0056] Thereafter, control unit 100 adjusts the size of the preview image indicated by the user's selection instruction received by operation unit 47 in accordance with the orientation of display unit 473 detected by detection sensor 476, and displays the adjusted preview image on display unit 473 (S5). Then, the process ends.

[0057] Furthermore, in S1, if control unit 100 determines that no text exists in the image to be output (NO in S1), it creates a preview image of the image to be output without changing the orientation of the image to be output (S12), adjusts the size of the preview image according to the orientation of display unit 473 detected by detection sensor 476, and displays the adjusted preview image on display unit 473 (S5). After this, the process ends.

[0058] According to the above embodiment, the orientation of the preview image is adjusted and the preview image is displayed on the display unit 473 so that the orientation of the text in the image to be output is portrait, making it easier for the user to check the details of the preview image. That is, the visibility of the text in the preview image is improved when the preview image is displayed. In addition, the size of the preview image can be enlarged to match the orientation of the display unit 473, further improving the visibility.

[0059] Incidentally, the image to be output may contain objects other than text (for example, photographs, graphic images, or diagrams). When the proportion of objects other than text in the image to be output is significantly lower than the proportion of text, it is preferable to adjust the orientation of the preview image to match the orientation of the text.

[0060] However, if the proportion of objects other than text is close to the proportion of text, changing the orientation of the preview image to match the orientation of the text may reduce the visibility of the objects. Therefore, as another embodiment, an embodiment will be described in which the orientation of the preview image is set taking into account the presence of the display area of objects other than text.

[0061] 12 is a functional block diagram showing a schematic diagram of the main internal configuration of the image forming apparatus according to the other embodiment. In the other embodiment, the control unit 10 functions as a second calculation unit 103 in addition to a control unit 100, a character direction detection unit 101, and a first calculation unit 102, due to the operation of the processor in accordance with the control program stored in the storage unit 8. The configuration and processing different from the embodiment shown in FIG. 2 will be described.

[0062] The second calculation unit 103 calculates the size of the display area of objects other than text within the image to be output. Figures 13(A) and 14(A) show examples of images to be output that include objects other than text. The images to be output TG7 and TG8 shown in Figures 13(A) and 14(A) include objects OB1 and OB2 other than text.

[0063] The second calculation unit 103, for example, uses a known area determination technique to distinguish objects contained in the image to be output into text areas and object areas consisting of images other than text, and detects the display area A3 of objects OB1 and OB2 other than text, as shown in Figures 13(B) and 14(B), and calculates the size (area) of the detected display area A3.

[0064] If the size of the object area A3 consisting of objects other than text calculated by the second calculation unit 103 is equal to or smaller than a predetermined threshold, the control unit 100 performs processing to set the orientation of the preview image to match the orientation of the text (the above-mentioned orientation adjustment display).

[0065] The predetermined threshold value may be the ratio of the display area A3 to the entire image to be output (e.g., 50%), or the ratio of the display area A3 to the display area of all objects (the display area consisting of the character display area A11 and the non-character display area A3) (e.g., 50%).

[0066] For example, as shown in FIG. 13(B), when the display area A3 of the object OB1 other than the text is equal to or smaller than a predetermined threshold (50% of the entire image to be output) relative to the display area of all objects, the control unit 100 sets the orientation of the preview image so that the text is oriented vertically, and displays the preview image PV7 on the display unit 473 after changing the size to match the orientation of the display unit 473, as shown in FIG. 13(C).

[0067] On the other hand, when the size of the display area for objects other than text is larger than the predetermined threshold, the control unit 100 displays the preview image while keeping the orientation of the image to be output unchanged.

[0068] Alternatively, if the size of the display area for objects other than text is larger than the predetermined threshold, the control unit 100 executes the processing indicated by the instruction from the user received by the operation unit 47, either displaying a preview image while leaving the orientation of the image to be output unchanged, or changing the orientation of the preview image to match the orientation of the text.

[0069] For example, as shown in FIG. 14(B), if the display area A3 of the object OB2 other than text is larger than 50% of the display area of all objects, the control unit 100 will iconize and display on the display unit 473 a preview image PV81 with the orientation of the image to be output unchanged and a preview image PV82 with the orientation set to match the orientation of the text, as shown in FIG. 14(C), and will also display a message M2 on the display unit 473 saying, "Please select a preview display method from the following two options."

[0070] When operation unit 47 receives an instruction from the user to select preview image PV81 (the user requests execution of normal display), control unit 100 displays preview image PV81 on display unit 473 as shown in Fig. 15(A). On the other hand, when operation unit 47 receives an instruction from the user to select preview image PV82 (the user requests execution of processing to change the orientation of the preview image to match the orientation of the text), control unit 100 displays preview image PV82 on display unit 473 as shown in Fig. 15(B).

[0071] Regarding the preview display of the image to be output, the control unit 100 may perform a preview display (normal display) with the orientation of the image to be output unchanged, and then, in accordance with instructions from the user received by the operation unit 47, display a preview image with the orientation set to match the orientation of the characters.

[0072] For example, as shown in Figures 16(A) and 17(A), the control unit 100 displays an operation button B1 marked "Detailed display" on the display unit 473 together with preview images PV21 and PV22, and then, when the operation unit 47 receives a direction adjustment instruction in response to a user operation on the operation button B1, the control unit 100 displays preview images PV2 and PV4 on the display unit 473 as shown in Figures 16(B) and 17(B).

[0073] The preview images PV21 and PV2 shown in Figures 16(A) and (B) are preview images of the output target image TG2 shown in Figure 5(B), and the preview images PV22 and PV4 shown in Figures 17(A) and (B) are preview images of the output target image TG4 shown in Figure 5(D).

[0074] Incidentally, since display unit 473 is oriented horizontally, it is possible to display horizontal preview image PV2 relatively large as shown in Fig. 16(B), but it is not possible to display vertical preview image PV4 large as shown in Fig. 17(B). Therefore, when displaying vertical preview image PV4 on display unit 473, it is preferable to orient display unit 473 vertically.

[0075] Therefore, in yet another embodiment, control unit 100 determines whether the preview image is portrait or landscape, and based on the determination result, compares the orientation of display unit 473 with the orientation of the preview image, and displays a message on display unit 473 regarding changing the orientation of display unit 473 based on whether the two match or mismatch.

[0076] For example, when control unit 100 sets the orientation of the preview image to match the orientation of the characters as an orientation adjustment display, if the orientation of display unit 473 detected by detection sensor 476 does not match the orientation of the preview image in the portrait orientation in which the characters are upright, control unit 100 causes display unit 473 to display a message urging the user to rotate display unit 473.

[0077] For example, when the operation unit 47 receives an instruction on the operation button B1 while the display unit 473 is displaying the content shown in FIG. 17(A), the control unit 100 displays a message M3 on the display unit 473 saying, "The preview image will be displayed in portrait orientation. Please rotate the operation panel," as shown in the example of FIG. 18(A). When the user rotates the display unit 473 from landscape to portrait orientation, the control unit 100 greatly enlarges and displays the preview image PV4 of the output target image TG4 on the display unit 473, as shown in FIG. 18(B). This motivates the user to rotate the display unit 473, making it easier to perform processing to improve the visibility of the preview image.

[0078] On the other hand, when control unit 100 sets the orientation of the preview image to match the orientation of the characters as an orientation adjustment display, if the orientation of display unit 473 detected by detection sensor 476 matches the orientation of the preview image in the portrait orientation in which the characters are upright, control unit 100 causes display unit 473 to display a message urging the user not to rotate display unit 473.

[0079] For example, when the operation unit 47 receives an instruction on the operation button B1 while the display unit 473 is displaying the content shown in Fig. 16(A), the control unit 100 causes the display unit 473 to display a message M4 saying, "The preview image will be displayed landscape. Do not rotate the operation panel," as shown in the example of Fig. 18(C). This prevents the user from rotating the display unit 473 despite the fact that processing to improve the visibility of the preview image is being performed, thereby preventing the processing to improve the visibility of the preview image from being performed.

[0080] The present invention is not limited to the configuration of the above embodiment, and various modifications are possible. Furthermore, in the above embodiment, the configuration and processing shown in the above embodiment using Figures 1 to 18 are merely one embodiment of the present invention, and it is not intended that the present invention be limited to these configurations and processing. [Explanation of symbols]

[0081] 1. Image forming device 12 Image forming unit 47 Control section 100 control section 101 Character direction detection unit 102 First calculation unit 103 Second Calculation Unit 473 Display section 474 Rotation Mechanism 476 Detection Sensor

Claims

1. A display unit; a control unit that displays a preview image of an image to be output, which is indicated by the image data, on the display unit; a character direction detection unit that detects the direction of characters in the image to be output, The control unit sets the orientation of the preview image so that the orientation of the characters detected by the character orientation detection unit is portrait orientation, in which the characters are upright, and performs orientation-adjusted display of the preview image on the display unit.

2. a first calculation unit that calculates a size of a character area in which characters are arranged in the image to be output, for each character area in which character orientations differ, based on a detection result by the character orientation detection unit; 2 . The information processing device according to claim 1 , wherein the control unit sets the orientation of the preview image in the orientation adjustment display so that the orientation of the characters included in the character area having the largest size calculated by the first calculation unit is portrait.

3. the first calculation unit calculates, in the image to be output, a size of a first character region that is a character region of a character that is detected by the character direction detection unit to be oriented in a predetermined first direction, and a size of a second character region that is a character region of a character that is detected by the character direction detection unit to be oriented in a second direction that is oriented 90 degrees different from the first direction; The control unit adjusts the orientation of the preview image in the orientation adjustment display. When the size of the first character area is larger than the size of the second character area, the orientation of the characters facing the first direction is set to the portrait orientation; The information processing device according to claim 2 , wherein when the size of the second character area is larger than the size of the first display area, the orientation of the characters facing the second direction is set to the portrait orientation.

4. further comprising an operation unit for receiving input of instructions from a user; 4. The information processing device according to claim 3, wherein, when a difference between the size of the first character area and the size of the second character area is within a predetermined range, the control unit sets the orientation of the preview image to an orientation in which either the orientation of characters facing the first direction or the orientation of characters facing the second direction is portrait, in accordance with an instruction received by the operation unit.

5. The information processing apparatus according to claim 2 , wherein the first calculation unit detects the character area so as not to include characters having a size equal to or smaller than a predetermined size.

6. an operation unit that accepts input of instructions from a user; a second calculation unit that calculates the size of an object area in which an object other than text is placed within the output target image, the control unit performs the direction adjustment display in accordance with an orientation of characters when the size of the object region calculated by the second calculation unit is equal to or smaller than a predetermined threshold; The information processing apparatus according to claim 1 , wherein when the size of the object region is larger than the predetermined threshold, the preview image is displayed on the display unit in the same orientation as the original.

7. 7. The information processing device according to claim 6, wherein, when the size of the object area is larger than the predetermined threshold, the preview image is displayed on the display unit in the same orientation as the original, or the orientation is adjusted to match the orientation of the characters, in accordance with instructions received by the operation unit.

8. the display unit is rectangular having long and short sides, a rotation mechanism that rotates the display unit between a landscape orientation in which the long side is the top and bottom and a portrait orientation in which the short side is the top and bottom; a detection sensor that detects whether the display unit is in a landscape orientation or a portrait orientation, the control unit performs size adjustment display by adjusting the size of the preview image to fit a display area of the display unit according to the orientation of the display unit detected by the detection sensor, and displays the preview image on the display unit; 7. The information processing device according to claim 6, wherein when the orientation adjustment display is executed, if the orientation of the display detected by the detection sensor matches the orientation of the preview image in portrait orientation with characters upright, the control unit causes the display unit to display a message urging the user not to rotate the display unit.

9. 9. The information processing device according to claim 8, wherein, when the orientation adjustment display is executed, if the orientation of the display detected by the detection sensor does not match the orientation of the preview image in portrait orientation with characters upright, the control unit causes the display unit to display a message urging the user to rotate the display unit.

10. An information processing device according to any one of claims 1 to 9; an image forming unit that forms an image on a recording medium, The control unit causes the display unit to display an image to be formed by the image forming unit as the preview image.

Images