Image processing device, control method thereof, and program

The image processing apparatus integrates reading, printing, and projecting functions to facilitate seamless transitions between projecting scanned images and printing projected content, improving user interaction and operational efficiency during presentations.

JP7610381B2Active Publication Date: 2025-01-08CANON KK
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2020161326
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-09-25
Publication Date
2025-01-08
Estimated Expiration
2040-09-25

AI Technical Summary

Technical Problem

Existing systems fail to provide a seamless operational method for combining the functions of projectors and multifunction devices, such as printing and projecting, requiring complex user interactions to switch between them during presentations.

Method used

An image processing apparatus with integrated reading, printing, and projecting capabilities, allowing for direct control of operations through a single interface to project scanned images and print projected content with simplified user instructions.

Benefits of technology

Enables flexible and efficient operation during presentations by allowing users to project and print images with a single command, enhancing user interaction and reducing operational complexity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007610381000001
    Figure 0007610381000001
  • Figure 0007610381000002
    Figure 0007610381000002
  • Figure 0007610381000003
    Figure 0007610381000003
Patent Text Reader

Abstract

To provide a mechanism for projecting an image scanned from a document by a projector in accordance with a simple operation made by a user; and also provide a mechanism for printing contents projected by a projector in accordance with a simple operation made by a user.SOLUTION: An image processing apparatus includes a scanner that reads an image in a document, and a projector that projects an image in accordance with image data. The image processing apparatus displays an operation screen that accepts a first instruction for projecting by the projector the image read by the scanner on a display unit of the image processing apparatus or a display unit of an external device. Furthermore, when accepting the first instruction, the image processing apparatus transfers image data of the image read by the scanner to the projector for projection, in accordance with an available memory space in a projector's memory. When accepting a second instruction, the image processing apparatus acquires the image data of the image being projected by the projector from the projector, converts the acquired image data into printable image data, transfers the converted printable image data to a printer, and causes the printer to execute printing of the image.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention , painting The present invention relates to an image processing device, a control method thereof, and a program. [Background technology]

[0002] In recent years, the use of PCs has become widespread, and the use of IT via networks has also progressed. In this environment, presentations are given to communicate ideas and thoughts in business, and applications that support these presentations are also becoming widespread. As a result, presentations using projectors have become commonplace. This has led to a paperless society, which has reduced costs and prevented the proliferation of paper.

[0003] On the other hand, there are also multifunction machines in offices that perform paper-based administrative tasks such as copying, faxing, and printing. These machines are sometimes used to protect against physical threats such as theft or loss of PCs, or the misuse of infrastructure such as PCs through tampering. In addition, for official documents between companies, originals are sometimes created by signing or stamping, and paper documents are also used.

[0004] To achieve both of these, a projector and a multifunction printer are necessary, and installation space for both is required. Patent Document 1 proposes a configuration in which a projector and a multifunction printer are arranged three-dimensionally, one above the other, to achieve space saving. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2017-38242 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, the above-mentioned conventional technology has the following problems: For example, in the three-dimensional configuration of the above-mentioned conventional technology, the device is arranged so as not to interfere with other functions (such as a printer), but no proposal is made regarding system operation for operating the functions mounted therein in a composite manner.

[0007] For example, there may be cases where these functions are operated in combination during a presentation. Specifically, while a presentation material input from a PC is being projected using the projector function, a user may want to print the presentation material being projected in order to write characters by hand on a manuscript material in hand. In addition, a user may want to write characters by hand on a manuscript material in hand and display an image read from the manuscript as is on the projector in order to update the projection content. If such a function could be realized, a user could flexibly respond during a presentation by printing the projection content as necessary, or by reading a handwritten manuscript to revise the projection content. However, in order to realize such a function, a user was required to perform complicated operations such as exchanging information multiple times between a PC and an image processing device, and it was difficult to realize such a function during a presentation.

[0008] The present invention has been made in consideration of at least one of the above problems, When a predetermined instruction is received, the read image is projected, and the image data of the read image is transmitted to a server for a Web conference. Provide the mechanism. [Means for solving the problem]

[0009] The present invention is an image processing apparatus, comprising: a reading means for reading an image from a document; a printing means; a projection means for projecting an image; a storage means; and an operation means for receiving a first instruction for causing the projection means to project the image read by the reading means and a second instruction for causing the printing means to print the image projected by the projection means. When the operation means receives the first instruction, the image read by the reading means is projected by the projection means, and image data of the image read by the reading means is transmitted to a server for a Web conference. and a control means for controlling the printing means to print the image being projected by the projection means when the second instruction is received by the operation means, and when the first instruction is received by the operation means, the control means determines whether or not the size of the image data of the image read by the reading means is a size that can be stored in the storage means, and if the size of the image data is a size that cannot be stored in the storage means, reduces the resolution, causes the reading means to read the original at the reduced resolution, and causes the projection means to project the image read by the reading means in place of the image being projected. Effect of the Invention

[0010] According to the present invention, When a predetermined instruction is received, the read image is projected, and the image data of the read image is transmitted to a server for a Web conference. It is possible. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing a system configuration according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an installation state of a projector extension unit 203 according to an embodiment. [Diagram 3] FIG. 2 is a diagram showing a reader function unit 201 and a printer function unit 202 according to an embodiment. [Figure 4A] FIG. 4 is a diagram showing a controller unit 400 according to an embodiment. [Figure 4B] FIG. 2 illustrates an image packet structure according to an embodiment. [Figure 4C] FIG. 4 is a diagram showing a scanner image processing unit 418 according to an embodiment. [Figure 4D] FIG. 4 is a diagram showing a printer image processing unit 432 according to an embodiment. [Diagram 5] FIG. 2 is a diagram showing a control system of a printer function unit 202 according to an embodiment. [Figure 6] FIG. 2 is a diagram showing a projector control unit according to an embodiment. [Figure 7] FIG. 4 shows a screen displayed on an operation unit 250 according to an embodiment. [Figure 8] 5A and 5B are diagrams showing job information used in the control system of the printer function unit 202 according to an embodiment. [Figure 9A] FIG. 2 is a diagram showing a remote operation unit according to an embodiment. [Figure 9B] FIG. 2 is a diagram showing a remote operation unit according to an embodiment. [Figure 10] FIG. 2 is a diagram showing an example of the configuration of a relay server and a PC according to an embodiment. [Figure 11] FIG. 2 is a diagram showing an example of the functional configuration of each device according to an embodiment. [Figure 12] 5 is a flowchart for reading an image by the reader function unit 201 and displaying it on the projector 204 according to an embodiment. [Figure 13] 6 is a flowchart when an image displayed by a projector 204 is printed by a printer function unit 202 according to an embodiment. [Figure 14] 6 is a flowchart when an image displayed by a projector 204 is printed by a printer function unit 202 according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments do not limit the invention according to the claims. Although the embodiments describe a number of features, not all of these features are essential to the invention, and the features may be combined in any manner. Furthermore, in the attached drawings, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0013] <First embodiment> <System hardware configuration> An embodiment of the present invention will be described below. First, a system configuration according to this embodiment will be described with reference to FIG. 1. This system includes a server group 110, a user environment 111 of a Web conference system, and a user environment 112 of an image processing system. These environments are connected to each other via the Internet 120 so that information can be transmitted and received. The user environment 112 of the image processing system includes a full-color MFP 101 that employs an electrophotographic method as an example of an image processing device, a file server 102, and a personal computer (PC) 103. Each device is connected to each other via a network 100 so that communication can be performed, and is connected to the Internet 120 via a firewall 108. Although a full-color MFP will be described as an example in this embodiment, it is also applicable to an MFP that reads in color and prints in black and white, or an MFP that reads in black and white and prints in black and white. Since it is applicable to any MFP, it will be simply referred to as MFP 101 below.

[0014] The MFP 101 has copy, FAX, and printer functions. The MFP 101 also has a SEND function for transmitting an image file read by a reader function unit 201 to a computer device, and an IFAX function for communicating an image read by a scanner between devices of the same type and printing the received image. The PC 103, which is an external device, converts a file generated by an application on the PC using a printer driver, transmits the file to the printer function unit 202 of the MFP 101, and causes an image to be formed on a storage medium. The file server 102 that accumulates data accumulates other files generated by the PC 103 and files generated by other PCs (not shown). The PC 103 can also transmit a file on the file server 102 to the MFP 101 and cause an image to be formed on a storage medium. The file server 102 and the MFP 101 share files using the SMB protocol and the WebDAV protocol. SMB stands for Server Message Block. WebDAV stands for Web-based Distributed Authoring and Versioning. The MFP 101 transmits image data read from an original by a reader function unit 201 to a public line 104 using a facsimile protocol. The MFP 101 also transfers image data received from the public line 104 to a printer function unit 202, which then forms an image on a storage medium.

[0015] The Web conference system is configured by a relay server 106 of a server group 110, and clients 1132 and 1112 of the Web conference system included in the MFP 101 and PC 107 installed in the user environments 111 and 112. A Web conference can be held by connecting each component via the Internet. A plurality of PCs 107, relay servers 106, and MFPs 101 may be installed. In addition, in FIG. 1, the MFP 101 is described as being installed in the user environment 112, but other information processing devices may be installed therein. Here, the other information processing devices may be, for example, a PC, a server device, a tablet terminal, or the like. A firewall 108 installed in the user environment 112 is configured to permit a connection from a terminal inside the user environment 112 to the Internet 120, but to reject a connection from the Internet 120 to a terminal inside the user environment 112.

[0016] The server group 110 is a server group consisting of server computers that provide services via the Internet 120, and the server computer may be one or more. In Fig. 1, the server group 110 is illustrated as being composed of only one relay server 106. The relay server 106 is an example of an information processing device.

[0017] <Projector expansion unit> Next, referring to FIG. 2, the projector expansion unit 203 provided in the MFP 101 according to the present embodiment will be described. As shown in FIG. 2, the MFP 101 includes a reader function unit 201 that reads an image from an original, a printer function unit 202 that forms an image, and a projector expansion unit 203. The projector expansion unit 203 is connected to the printer function unit 202. In the projector expansion unit 203, a projector 204 is installed inside the projector expansion unit 203 with a front cut 221 opened as shown in FIG. 2. The projector expansion unit 203 may also be provided with a right side cut 209. Similarly, the projector 204 may be installed with a back cut or left side cut (not shown) provided. However, it is preferable to open only one cut, and when opening multiple cuts, it is preferable to cover the cuts other than the one to be used with a cover member or the like. In this way, MFP 101 according to this embodiment has built-in projector 204, and may be configured such that projector 204, reader function unit 201, and printer function unit 202 are three-dimensionally arranged one above the other as shown in Fig. 2. The present invention may also be applied to other configurations such as a left-right arrangement, and further, projector 204 may be provided movably.

[0018] The cutout 212 is a cutout for installing an external input I / F on the front side, and the cutout 205 is a cutout for installing an external input I / F on the rear side, and is an area for installing a connector unit that connects the external input I / F to the projector 204. This external input I / F is provided with a connector of an HDMI (registered trademark) (High Definition MultiMedia Interface) 210 or a projector external input I / F (D-sub) 211. The cutout 212 or the cutout 205 may be selectively provided depending on the installation situation. The D-sub connector 215 on the projector 204 is connected to the projector external input connector (D-sub) 214 connected from the projector external input I / F (D-sub) 211. The HDMI connector 216 on the projector 204 is connected to the projector external input connector (HDMI) 213 connected from the projector external input I / F (HDMI) 210.

[0019] When projecting an image of an application displayed on PC 105 onto projector 204, a D-sub connector of PC 105 and projector external input I / F (D-sub) 211 are connected with a D-sub cable. This makes it possible to display an image on projector 204 by outputting an image from PC 105. When connecting from PC 105 via HDMI, an image of PC 105 can be displayed by connecting using projector external input I / F (HDMI) 210. On the other hand, when connecting projector 204 and PC 105 via WiFi, a computer image is input from PC 105 via wireless antenna 442 and wireless LAN 441 connected to controller unit 400 of MFP 101 described later.

[0020] The projector expansion unit 203 is connected to the printer function unit 202 using an expansion function cable 220 extending from the rear of the printer function unit 202 of the MFP 101. The expansion function cable 220 is made up of two types of cables: a projector control cable 206 and a projector projection image cable 207. The expansion function cable 220 is connected to the MFP connector 208 of the projector expansion unit 203, and input to the built-in projector control unit shown in FIG. 6. The projector control unit in FIG. 6 judges the signals flowing through the projector control cable 206 and the projector projection image cable 207 input from the MFP 101, and outputs image signals to the projector 204.

[0021] 4. The reader function unit 201 and the printer function unit 202 are connected to the controller unit 400, which is connected to an operation unit 250 for operating and controlling the reader function unit 201, the printer function unit 202, and the projector expansion unit 203. When a key 711 shown in FIG. 7 is operated on the operation unit 250, the projector expansion unit 203 operates according to a control command sent from the controller unit 400 via the projector control cable 206. The projector expansion unit 203 projects an image signal sent via the projector projection image cable 207 by the projector 204. 7 is operated, image data is sent to printer function unit 202 via projector projection image cable 207 in accordance with a control command sent from controller unit 400 via projector control cable 206, causing image formation on a storage medium. Projector power key 222 is a key that can turn on the power of projector 204, and even when MFP 101 is turned off, it is possible to use only projector 204 by turning projector power key 222 ON.

[0022] <Reader function section and printer function section> Next, the reader function unit 201 and the printer function unit 202 according to this embodiment will be described with reference to FIG.

[0023] First, the reader function unit 201 will be described. The documents loaded on the document feeder 300 are transported one by one onto the document glass surface 246. When the document is transported to a predetermined position on the document glass surface 246, the lamp 241 of the scanner unit 240 turns on, and the scanner unit 240 moves to irradiate the document with light. The reflected light from the document is input to a CCD image sensor unit 245 (hereinafter referred to as CCD) via mirrors 242, 243, and 244.

[0024] Next, the printer function unit 202 will be described. The printer function unit 202 is provided with process units 251y, 251m, 251c, and 251k arranged on a substantially horizontal straight line at regular intervals. Each process unit 251y, 251m, 251c, and 251k forms a toner image of a developer of yellow (y), magenta (m), cyan (c), and black (k), respectively. The toner images formed by each process unit 251y, 251m, 251c, and 251k are primarily transferred to the intermediate transfer belt 258 that contacts the belt. The toner images of each color superimposed on the intermediate transfer belt 258 are transported and transferred to a sheet of paper synchronized by a registration roller 265 (described later) at a nip where a drive roller 272 and a secondary transfer roller 260 contact each other. Each of the process units 251y, 251m, 251c, and 251k includes a photosensitive drum 252, a charging roller 253, a laser exposure device 254, a developing device 255, a toner container 256, and an auxiliary charging brush 259. In Fig. 1, the reference numbers are suffixed with symbols y, m, c, and k to correspond to the respective colors.

[0025] The printer function unit 202 also includes primary transfer rollers 257y, 257m, 257c, and 257k, an intermediate transfer belt 258, a secondary transfer roller 260, a transfer cleaning device 261, a paper feed cassette 263, and a registration roller 265. The printer function unit 202 also includes a fixing device 267, a drive roller 272, a pre-registration transport sensor 298, and a transport sensor 297. The fixing device 267 includes a fixing roller 268 and a pressure roller 269. The operation of each component will be described later.

[0026] <Control configuration of the printer function unit 202> Next, a configuration related to control of the printer function unit 202 according to this embodiment will be described with reference to Fig. 5. The printer function unit 202 mainly includes a communication controller 510, an image formation control unit 550, and each of the loads 254, 297, 298, 509 to 512. The image formation control unit 550 includes a CPU circuit unit 551 including a CPU 504, a ROM 501, and a RAM 502 in order to control each of the loads related to image formation.

[0027] In the image forming operation, first, the communication controller 510 receives an instruction to start image formation from the controller unit 400 and transmits it to the CPU circuit unit 551. Upon receiving the instruction to start image formation, the CPU circuit unit 551 acquires job information data. The contents of the job information will be described later with reference to FIG. 8. Then, the CPU circuit unit 551 stores the job information in the RAM 502 and executes a program stored in the ROM 501. Thereafter, the CPU circuit unit 551 controls the laser exposure devices 254y, 254m, 254c, and 254k, the motors 509 to 512, the separation motor 513, and the fixing motor 514 to perform the image forming operation described later.

[0028] The motor 512 drives the photosensitive drum 252k and the developing unit 255k, and the motors 509 to 511 drive the photosensitive drums 252y, 252m, and 252c and the developing units 255y, 255m, and 255c, respectively, similar to the motor 512. The separation motor 513 controls the contact and separation of the intermediate transfer belt 258 and the process units 251y, 251m, 251c, and 251k. The fixing motor 514 drives the fixing roller 268 and the pressure roller 269. When the image forming operation is completed, the CPU circuit unit 551 erases the job information stored in the RAM 502.

[0029] <Controller section explanation> Next, the control configuration (controller unit) of the MFP 101 according to this embodiment will be described with reference to FIG. 4A. As described with reference to FIG. 2, the MFP 101 is composed of a reader function unit 201 which is an image input device, a printer function unit 202 which is an image output device, a controller unit 400, and an operation unit 250 which is a user interface. The reader function unit 201, the printer function unit 202, and the operation unit 250 are each connected to the controller unit 400, which is connected to a network transmission unit such as a LAN 100 or a public line 104. Transmission by G3 and G4 fax including color image transmission is possible from the public line. Also, a PC 103 is connected via the LAN 100, and it is possible to send and receive files using FTP and SMB protocols, and to send and receive e-mail.

[0030] The controller unit 400 is connected to the reader function unit 201, which is an image input device, and the printer function unit 202, which is an image output device. On the other hand, the controller unit 400 is also connected to the LAN 100 and the public line (WAN) 104, and can input and output image information and device information. Each component (device) provided in the controller unit 400 will be described. The CPU 401 is a controller that controls the entire system. The RAM 402 is a system work memory for the CPU 401 to operate, and is also an image memory for temporarily storing image data. The ROM 406 is a boot ROM in which a boot program for the system is stored. The HDD 407 is a hard disk drive, and stores system software and image data. The operation unit I / F 403 is an interface unit with the operation unit (UI) 250, and outputs image data to be displayed on the operation unit 250 to the operation unit 250. In addition, it plays a role of transmitting information operated by a user of this system from the operation unit 250 to the CPU 401. The LAN circuit 404 is connected to a wired LAN 440 and a wireless LAN 441, and the wired LAN 440 is connected to an external network via the LAN 100 to input and output information. The wireless LAN 441 is connected to a wireless antenna 442 to input and output information. The modem 405 is connected to a public line 104 to input and output image information. The binary image rotation unit 410 and the binary image compression / expansion unit 411 are used to change the orientation of the image before transmitting the binary image by the modem 405, and to convert the image to a predetermined resolution or a resolution that matches the capabilities of the other party. Compression and expansion support JBIG, MMR, MR, and MH. The DMAC 408 is a DMA controller that reads an image stored in the RAM 402 without going through the CPU 401, and transfers the image to the image bus I / F 409. Alternatively, the DMAC 408 writes an image from the image bus I / F 409 to the RAM 402 without going through the CPU 401. The projector I / F 443 is connected to the projector 204, and inputs an image signal to the projector 204 to project an image. 444 is a component including an encoder and a decoder used for audio and video for Web conferences. Details will be described later with reference to FIG. 11. The above devices are connected to a system bus 416.

[0031] Furthermore, the controller unit 400 has the following components: One or more image bus I / Fs 412 are interfaces for controlling high-speed image input / output via an image bus 419. Each compressor 413 connected to each image bus I / F 412 is a compressor for JPEG compression in units of 32 pixels x 32 pixels before sending the image to the image bus 419. Also, a decompressor 431 connected to the image bus I / F 412 is a decompressor for decompressing an image sent via the image bus 419.

[0032] A raster image processor (RIP) 415 develops the PDL code from the host computer into a bitmap image (multiple values). Specifically, the CPU 401 first stores the PDL code received via the LAN circuit 404 in the RAM 402 via the system bus 416. The CPU 401 converts the PDL into intermediate code, which is then input to the RIP 415 via the system bus 416 again, and the RIP 415 develops the intermediate code into a bitmap image (multiple values). In this embodiment, the RIP 415 develops the intermediate code into a 1200 dpi bitmap image. After that, the high-definition resolution conversion unit 414 reduces the resolution of the image data. In this embodiment, the 1200 dpi data is converted into a 600 dpi signal. This makes it possible to convert the 1200 dpi image into 600 dpi data while retaining the phase information of the 1200 dpi image, and details will be described later. In other words, the character (font) and line ratio (proportion) are processed so that the output has the expressive power of a 1200 dpi resolution level even if the output is 600 dpi.

[0033] The scanner image processing unit 418 performs various appropriate image processing (e.g., correction, processing, editing) on ​​the color image and black-and-white image from the reader function unit 201 and outputs the image (multi-value). Similarly, the printer image processing unit 432 performs various appropriate image processing (e.g., correction, processing, editing) on ​​the printer function unit 202 and outputs the image. When printing, the expander 431 performs binary-to-multi-value conversion, so binary and multi-value output are possible.

[0034] The image conversion unit 417 has various image conversion functions used when converting an image on the RAM 402 and writing it back to the RAM 402. The rotator 422 can rotate an image of 32 pixels x 32 pixels at a specified angle, and supports binary and multi-value input and output. The rescaling unit 423 has a function of converting the resolution of an image (for example, from 600 dpi to 200 dpi) and changing the size (for example, from 25% to 400%). Before changing the size, the rescaling unit 423 rearranges an image of 32 x 32 pixels into an image of 32 lines. The color space conversion unit 424 converts the multi-value input image, for example, a YUV image on the RAM 402 into a Lab image by matrix calculation and LUT, and stores it in the RAM 402. In addition, this color space conversion unit 424 has a 3 x 8 matrix calculation and a one-dimensional LUT, and can perform known background removal and backlight prevention. The converted image is output in multi-value. The binary / multiple-value conversion unit 425 converts a 1-bit binary image into a multi-value image of 8 bits and 256 gradations. Conversely, the multi-value / binary conversion unit 429 converts, for example, an 8-bit, 256-gradation image on the RAM 402 into a 1-bit, 2-gradation image by a method such as error diffusion processing, and stores the image on the RAM 402. The composition unit has a function of combining two multi-value images on the RAM 402 into one multi-value image. For example, by combining an image of a company logo on the RAM 402 with an original image, it is possible to easily add a company logo to the original image. The thinning unit 427 is a unit that performs resolution conversion by thinning out the pixels of a multi-value image, and can output a multi-value image of 1 / 2, 1 / 4, or 1 / 8. By using it in conjunction with the magnification changer 423, it is possible to perform enlargement and reduction over a wider range. The shift unit 428 can add or remove margins to the input binary or multi-value image and output it. The rotator 422, the magnifier 423, the color space converter 424, the binary / multiple value converter 425, the combiner 426, the thinning out unit 427, the shifter 428, and the multi-value / binary converter 429 can be linked together to operate. For example, when rotating a multi-valued image on the RAM 402 and converting the resolution, both processes can be linked together without going through the RAM 402.

[0035] FIG. 4B shows the image format. The image format according to this embodiment utilizes an image packet structure as disclosed in Japanese Patent Application Laid-Open No. 2001-103473. Specifically, in the compressor 413, a raster format image 470 is rearranged as a packet 471 of 32×32 pixels as shown in FIG. 4B, and JPEG compression is performed on a packet basis. At the same time, information such as an ID indicating the position of the packet, a color space, a Q table ID, and a data length is added to the packet to form a header. Furthermore, binary data (image area flag) indicating characters and photographs is also compressed in the same manner and attached to the end of the JPEG. 472 indicates packet data. The expander 431 expands the JPEG based on this header information and rearranges it into a raster image. By making such a packet image, when rotating an image, only the image inside the packet is rotated, and by changing the position of the packet ID, it is possible to rotate partially by decompression compression, which is very efficient. All images flowing through the image bus 419 are packet images. When a raster image is required for FAX transmission, the binary image rotation unit 410, the binary image compression and decompression unit 411, etc., the packet image is converted into a raster image by software.

[0036] FIG. 4C shows the detailed processing configuration of the scanner image processing unit 418. The 8-bit RGB luminance signals input from the scanner are converted by the masking 450 into standard RGB color signals that are not dependent on the filter color of the image sensor. The filter 451 uses, for example, a 9×9 matrix to blur the image or add sharpness. The histogram 452 is a processing unit that samples the image signal data in the input image and is used to determine the background level of the input image. In this module, RGB data within a rectangular area surrounded by a start point and an end point specified in the main scanning direction and the sub-scanning direction is sampled at a constant pitch in the main scanning direction and the sub-scanning direction to create a histogram. The created histogram is read out when background removal or prevention of back-scan is specified, and the background of the document is estimated from the histogram. The histogram is stored and managed in the RAM 402 or HDD 407 together with the image as the background removal level, and is used for image processing when printing or transmitting. The gamma 453 processes the density of the entire image to be darker or lighter. For example, it is a processing unit that converts the color space of the input image into an arbitrary color space and performs correction processing on the color of the input system. In order to determine whether the original is color or black and white, the image signal before scaling is converted to the well-known Lab by the color space conversion unit 454. In FIG. 4C, a and b represent color signal components, and if it is equal to or higher than a predetermined level in the comparator 455, a 1-bit judgment signal is output from the comparator 455 as a chromatic color, otherwise as an achromatic color. The counter 456 measures the output from the comparator 455. The character / photo judgment unit 457 is a processing unit that extracts character edges from the image and separates the image into characters and photos. As an output, it outputs a character / photo judgment signal. This signal is also stored in the RAM 402 or HDD 407 together with the image and is used at the time of printing. The specific original judgment unit 458 compares the degree of match between the input image signal and the pattern held inside the judgment unit, and outputs a judgment result of match or mismatch. Depending on the judgment result, the image can be processed to prevent counterfeiting of banknotes, securities, etc.

[0037] FIG. 4D shows a detailed processing configuration of the printer image processing unit 432. The background removal unit 460 removes the background color of the image data and removes unnecessary background fogging. For example, the background removal is performed by a 3×8 matrix operation or a one-dimensional LUT. The monochrome generation unit 461 converts color image data, for example, RGB data, into a single color Gray when converting color image data into monochrome data and printing it as a single color. For example, the monochrome generation unit 461 is configured with a 1×3 matrix operation that multiplies RGB by an arbitrary constant to generate a Gray signal. The output color correction unit 462 performs color correction according to the characteristics of the printer function unit 202 that outputs the image data. The output color correction unit 462 is configured with a process such as a 4×8 matrix operation or direct mapping, and generates an image signal of six colors CMYKLcLm or four colors CMYK from the input RGB image signal. In this embodiment, image signals corresponding to the six toner colors of the printer function unit 202, cyan (C), magenta (M), yellow (Y), black (K), light cyan (Lc), and light magenta (Lm), are output at 600 dpi and 8 bits. Alternatively, image signals corresponding to the four colors of cyan (C), magenta (M), yellow (Y), and black (K) are output at 600 dpi (dots per inch) and 8 bits. The output of the six-color and four-color image signals is switched by a process described in detail later. The filter processing unit 463 arbitrarily corrects the spatial frequency of the image data, and is configured to perform a process of performing, for example, a 9×9 matrix operation. The gamma correction unit 464 performs gamma correction according to the characteristics of the printer function unit 202 that outputs the data, and is typically configured with a one-dimensional LUT. The halftone correction unit 465 is a processing unit that performs any halftone processing in accordance with the number of gradations of the output printer function unit 202, and is a halftone processing unit that performs any screen processing such as binarization or 32-value conversion, and error diffusion processing. Each processing unit can also be switched by a character / photo determination signal (not shown). The inter-drum delay memory 466 is a memory for overlaying CMYKLcLm images by shifting the printing timing of CMYKLcLm by the distance between the drums in a color printer having drums for each color of CMYKLcLm.In a color printer having six drums for each of the CMYKLcLm colors, delays can be made to align the positions of the six color images for each color. Of course, even when the output of the output color correction unit 462 is four colors, CMYK, the delay can be adjusted in the inter-drum delay memory 466.

[0038] In this embodiment, an electrophotographic printing function unit is used, but the present invention is not limited to this, and an inkjet printing function unit can also be used.

[0039] <Display example of the operation unit 250> Next, a display example on the operation unit 250 of the MFP 101 according to this embodiment will be described with reference to Fig. 7. The operation unit 250 is provided with various keys for instructing image forming operations such as image editing contents for image processing by the reader function unit 201 and the number of copies, and a liquid crystal display unit 710 for displaying contents during operation. The operation unit 250 is also provided with a hard key group 720. The hard key group 720 is various hard keys, a start key 723 is a key for starting copying, and a home key 722 is a key for returning the display and settings of the liquid crystal display unit 710 to the standard state. A sleep key 721 is a key for putting the MFP 101 into a power saving state.

[0040] Reference numeral 700 denotes a basic menu screen. The liquid crystal display unit 710 is a touch panel type liquid crystal display, and key input can be performed by pressing various keys displayed on the key display unit. On the key display unit, a post-reading projector display key 711 is displayed as one of the various keys. The post-reading projector display key 711 is a key for reading a document loaded on the document feeder or reader function unit 201, converting it into image data, and transmitting the image data to the projector 204 installed in the projector extension unit 203 to project it.

[0041] When the projector display key 711 is pressed after reading, the screen 701 with projector scan displayed in 740 is displayed on the liquid crystal display unit 710. The screen 701 further displays a read key 741, a next page key 742, a previous page key 743, and an end key 744. When the read key 741 is pressed, a command is transmitted to the system bus 416 via the operation unit I / F 403. The CPU 401 that has been notified of the command checks the status of the projector 204 via the projector I / F 443, and transmits the image read by the reader function unit 201 to the projector 204 together with a display request to instruct the projector to display. When the next page key 742 is pressed, the next page can be displayed, and when the previous page key 743 is pressed, the previous page is displayed. When the end key 744 is pressed, the display of the scan image is terminated. Note that the present invention is not limited to this, and the same control as when the read key 741 is pressed may be performed in response to pressing of the after-read projector display key 711. In other words, the reader function unit 201 may be controlled to read the document and display it on the projector 204 with a one-touch operation by the user. This can further simplify the user operation and provide a more user-friendly operation system. Also, a one-touch key as described above may be provided in addition to the after-read projector display key 711.

[0042] Numeral 702 indicates a menu screen related to the projector 204. Screen 702 may be transitioned to from screen 700. In this case, a projector key is displayed selectably as a group of various keys on the liquid crystal display unit 710 of screen 700. In this case, when the projector key is operated, transition to screen 702 occurs. Note that the projector key may be included in the group of hard keys 720. Screen 702 includes a projector image print key 712, a setting key 713, a Web conference setting key 714, a Web conference start / end key 715, and a file display key 716.

[0043] When the projector image print key 712 on the screen 702 is pressed, a screen 703 with projector print displayed at 745 is displayed, and the screen 703 is configured to include a number of copies setting key 746, a density setting key 747, and a print start key 748. When the number of copies setting key 746 is pressed, the number of copies to be printed can be set. When the density setting key 747 is pressed, the density at the time of printing can be set. When the print start key 748 is pressed, the controller unit 400 checks the status of the projector 204 from the projector I / F 443 through the projector control cable 206. Information on the presence or absence of a displayed image and the resolution is obtained, and if an image is displayed, the CPU 401 sends the image data to the printer function unit 202 to print.

[0044] A projector setting key 713 on the screen 702 is a key for setting the projector, and pressing the projector setting key 713 allows manual distortion correction, manual keystone correction, light intensity adjustment, and the like (not shown) to be performed. A Web conference setting key 714 is a key for setting a Web conference and for acquiring a Web conference session from the relay server 106. When acquiring a Web conference session, pressing the Web conference setting key 714 causes a session confirmation screen 724 to be displayed on the liquid crystal display unit 710. The session confirmation screen 724 displays the Web conference time in 730, and an input area 731 for the Web conference time in 731. The session confirmation screen 724 further displays the session number in 732, the session number "210" in 733, and a participant key 734 is displayed selectably. When the time is input in the input area 731 for the Web conference time, the MFP 101 transmits the machine number and the Web conference time that it holds, and the session number is transmitted from the relay server 106 and displayed in 733 on the liquid crystal display unit 710. When the participant key 734 is pressed, the participant setting screen 726 is displayed. In the participant setting screen 726, participant setting: 210 is displayed in 770, and the participants are acquired from the account management service described later from the relay server 106, and the acquired participants are displayed in the display area 771. In the example of FIG. 7, the display area 771 displays MFP-A / MFP-B in which participation is set, and MFP-C in which participation is not set. When the MFP-C is selected and the add key 774 is pressed, the MFP-C can also participate in the Web conference. When the scroll keys 775 and 776 are pressed, the participants can be displayed when they do not all fit in the display area 771. When the start key 772 is pressed, the conference can be started even if the start date and time has not been reached. Moreover, by pressing the end key 773, the conference that has started can be ended.

[0045] When the Web conference start / end key 715 on screen 702 is pressed at the start time of the Web conference, a session selection start screen 725 is displayed. The session number displayed by pressing the Web conference setting key 714 is displayed in a session number input area 735. When the corresponding session number is entered there and a session start key 736 is entered, the session management service described below is notified of the session number, start time, and MFP device number, and if they match, the Web conference can be started. When the session end key 770 is pressed, the started session can be ended.

[0046] When the projector file display key 716 on the screen 702 is pressed, a screen 704 with a projector file screen displayed in 750 is displayed on the liquid crystal display unit 710. The screen 704 includes a URL setting key 751, a URL display area 752, a display key 753, a next page key 754, a previous page key 755, and an end key 756. By pressing the URL setting key 751, an external server or an internal file system can be selected, and when an external server is selected, a file to be displayed on the projector 204 can be specified in the URL display area 752. By pressing the display key 753, a command is notified to the CPU 401 via the system bus 416 about the imaged data by an image development unit described later. The CPU 401 that has been notified of the command checks the state of the projector 204 via the projector I / F 443, and transmits an image to the projector 204 together with a display request to instruct the projector to display it. The next page can be displayed by pressing the next page key 754, and the previous page can be displayed by pressing the previous page key 755. The display of the scanned image can be ended by pressing the end key 756.

[0047] <Remote control section explanation> Next, referring to Fig. 9A and Fig. 9B, a remote operation unit that realizes the operation unit 250 according to this embodiment by software on an external PC will be described. The remote operation unit is realized by displaying a screen displayed on the operation unit 250 of the MFP 101 on a display of a PC 103 that is an external PC, and receiving a user input entered via the displayed screen. The PC 103 performs network communication with the MFP 101 via the network 100, and outputs a request for the remote operation unit in HTTP (Hyper Text Transfer Protocol) format. The network 100 is connected to a LAN circuit 404 that is capable of communicating with the Internet and is connected to a controller unit 400 of the MFP 101, and a request for the remote operation unit is transmitted to the controller unit 400 via the LAN circuit 404.

[0048] The controller unit 400, which has received a request from the remote operation unit of the PC 103, transmits screen information of a user authentication screen 901 to the external PC. When a request is received from an external tablet or mobile device (not shown), screen information of a user authentication screen 902 with a changed layout is transmitted to the external mobile device. When accessed from the mobile device thereafter, the display is changed in layout and transmitted to the external tablet or mobile device. Here, screens 981 to 987 of the external PC are used as an example for explanation. Screens 991 to 997 displayed on the corresponding external mobile device correspond to screens 981 to 987, respectively, and explanations thereof are omitted since only the layout is changed.

[0049] When the input of a user name 903 and a password 904 is accepted on a user authentication screen 901 from the PC 103, the input information is transmitted to the MFP 101 as authentication data, and the controller unit 400 judges whether or not it matches the data stored in advance. If it matches, the controller unit 400 transmits a top screen 981 of the remote operation unit to the PC 103. A device status confirmation screen key 906 and a consumables status confirmation key 908 are arranged on the top screen 981. When the device status confirmation screen key 906 is input on the PC 103, the software on the PC 103 transmits a request for status information of the printer function unit 202, the reader function unit 201, the projector 204, and the modem 405 to the MFP 101 via the network. When the browser of the PC 103 receives the status information notified in response to the request, it displays the status information in a status display area 907. Similarly, when the consumables status confirmation key 908 is input, information is acquired from the MFP 101 and displayed in a display area 909. Furthermore, on the top-level screen 981, as functions 910, a projector print key 911, a projector scan key 912, a projector setting key 913, a Web conference start key 914, a Web conference setting key 915, and a projector file display key 916 are arranged.

[0050] When the projector scan key 912 is pressed, a screen 982 with "Projector Scan" displayed on 920 is displayed, and a read key 921, a next page key 922, a previous page key 923, and an end key 924 are displayed. When the read key 921 is pressed, a command is transmitted to the MFP 101 through the network 100. The CPU 401 that has been notified of the command checks the status of the projector 204 through the projector I / F 443, and transmits an image read by the reader function unit 201 to the projector 204 together with a display request, instructing the projector to display it. When the next page key 742 is pressed, the next page can be displayed, and when the previous page key 923 is pressed, the previous page is displayed. When the end key 924 is pressed, the display of the scan image is terminated.

[0051] When the projector print key 911 is pressed, a screen 983 showing projector print is displayed on 930, and a number of copies setting key 931, a density setting key 932, and a print start key 933 are displayed. When the number of copies setting key 931 is pressed, the number of copies to be printed can be set. When the density setting key 932 is pressed, the density of the printed matter can be set. When the print start key 933 is pressed, a command is sent to the MFP 101 via the network 100, and the controller unit 400 checks the status of the projector 204 from the projector I / F 443 through the projector control cable 206. The controller unit 400 obtains information on the presence or absence of a displayed image and the resolution, and if an image is displayed, sends image data to the printer function unit 202 to print it.

[0052] A Web conference setting key 915 is a key for setting up a Web conference and for acquiring a Web conference session from the relay server 106. When acquiring a Web conference session, pressing the Web conference setting key 915 displays a session confirmation screen 986 including displays 960 to 965. In the session confirmation screen 986, in the Web conference setting of 960, 961 displays the conference time, and an input area is displayed in 962. When the conference time is input in the input area 962, the MFP 101 transmits the device number and the Web conference time that it holds, which are transmitted to the PC 107 of the Web conference system via the relay server 106, and receives a response including session information. Upon receiving the response, the MFP 101 notifies the PC 103 of the screen information or session information, and causes the display area 964 to display the session number. Pressing the participant key 965 displays a screen 987, acquires participants from an account management service of the relay server 106, which will be described later, and displays them in the display area 971. In the example of Fig. 9B, MFP-A / MFP-B that are set as participants and MFP-C that are not set as participants are displayed in display area 971. When MFP-C is selected and add key 976 is pressed, MFP-C can also participate in the Web conference. When the scroll keys 977 and 978 are pressed, it is possible to display the participants when they do not all fit in display area 971. Here, when start key 975 is pressed, it is possible to start the Web conference even if the start date and time has not yet been reached. Also, by pressing end key 974, the started Web conference can be ended.

[0053] When a Web conference start key 914 on a top screen 981 is pressed, a session selection start screen 985 including displays 950 to 958 is displayed. On the screen 985, a session number is displayed in 951, and selectable session numbers are selectably displayed in an input area 952. When the corresponding session number is input (selected) and a session start key 956 is input, the session number, start time, and device number of the MFP 101 are notified to a session management service described later. Thereafter, it is determined whether they match, and if they match, the Web conference is started. Also, by pressing scroll keys 957 and 958, session numbers that do not fit in the display area 971 can be displayed. Here, by pressing the start key 956, a Web conference can be started via a session. Also, by pressing the end key 955, the started session can be ended.

[0054] When the projector file display key 916 is pressed, a screen 984 is displayed with "Projector File Display" displayed in 940, and a URL selection key 941, a URL display area 942, and a display key 943 are displayed. Furthermore, a next page key 944, a previous page key 945, and an end key 946 are displayed on the screen 984. When the URL selection key 941 is pressed, an external server or an internal file system can be selected, and when an external server is selected, a file to be displayed on the projector 204 can be specified in the URL display area 942. When the display key 943 is pressed, a command is notified to the CPU 401 via the system bus 416 about the imaged data by an image development unit described later. The CPU 401 that has been notified of the command checks the state of the projector 204 via the projector I / F 443, and transmits an image to the projector 204 together with a display request to instruct the projector to display it. The next page can be displayed by pressing the next page key 944, and the previous page can be displayed by pressing the previous page key 945. The display of the file image can be terminated by pressing the end key 946.

[0055] <Preparation for Printer Function> Next, a preparatory operation for making the printer function unit 202 ready for image formation will be described with reference to FIGS. 3 and 5. The preparatory operation is a preparatory operation before receiving an image formation start signal from the controller unit 400. Therefore, in preparation for both monochrome and color image formation start signals, the CPU 504 of the image formation control unit 550 starts driving the motors 509-512. Here, when the motors 509-512 are driven, the motor developing units 255y, 255m, 255c, and 255k and the photosensitive drums 252y, 252m, 252c, and 252k are rotated. When the speed of the motors 509-512 rises to a constant speed, the CPU 504 drives the separation motor 513 to bring the intermediate transfer belt 258 into contact with the process units 251y, 251m, 251c, and 251k. Furthermore, the CPU 504 charges the photosensitive drums 252y, 252m, 252c, and 252k to negative polarity. When the power is turned on or when the printer is returned from the power saving mode, the CPU 504 performs image density correction control to make the image density constant and color shift correction control when the internal state of the printer function unit 202 has changed due to long-term non-use. When a jam occurs, the CPU 504 performs cleaning control to remove toner remaining on the intermediate transfer belt 258 and the photosensitive drums 252y, 252m, 252c, and 252k. Any method may be used for the image density correction control, color shift correction control, and cleaning control, so detailed description will be omitted. When the intermediate transfer belt 258 and the process unit 251k are in contact with each other when a jam occurs, the CPU 504 may perform cleaning control to remove toner remaining on the intermediate transfer belt 258 and the photosensitive drum process unit 251k during the return operation after the jam occurs. In other words, cleaning control does not need to be performed on the photosensitive drums 252y, 252m, and 252c.

[0056] <Image formation operation of the printer function unit> Next, a basic image forming operation that is performed upon receiving an image forming request from a standby state in which the operation of the printer function unit 202 is stopped will be described with reference to Figs. 3 and 5. Upon receiving an image formation start signal, the CPU 504 starts driving the motor 512. Here, when the motor 512 is driven, the motor developing unit 255k and the photosensitive drum 252k are rotated. When the speed of the motor 512 rises to a constant speed, the CPU 504 drives the separation motor 513 to bring the intermediate transfer belt 258 into contact with the process unit 251k. Furthermore, the photosensitive drum 252k is negatively charged. Then, the laser exposure device 254k irradiates an image signal input from the outside from a laser emission unit to form an electrostatic latent image on the photosensitive drum 252k.

[0057] The developer 255k is applied with a developing bias of the same polarity as the charging polarity (negative polarity) of the photosensitive drum 252k, and adheres black toner to the electrostatic latent image formed on the photosensitive drum 252k, making it visible as a toner image. In the primary transfer, a primary transfer bias (opposite polarity (positive polarity) to that of the toner) is applied to the primary transfer roller 257k. At that time, with the primary transfer roller 257k being pressed against the photosensitive drum 252k via the intermediate transfer belt 258, the toner image on the photosensitive drum 252k is primarily transferred to the driven intermediate transfer belt 258.

[0058] The toner image on the intermediate transfer belt 258 is transported to a secondary transfer section between a drive roller 272 and a secondary transfer roller 260. In accordance with the timing when the leading edge of the toner image moves to the secondary transfer section, a storage medium such as paper fed by a paper feed cassette 263 passes through a transport path formed substantially vertically and is transported to the secondary transfer section by a registration roller 265. The toner image is secondarily transferred collectively to the storage medium transported to the secondary transfer section by a secondary transfer roller 260 to which a secondary transfer bias (opposite polarity (positive polarity) to that of the toner) is applied. Residual toner remaining on the intermediate transfer belt 258 after the secondary transfer is scraped off by a transfer cleaning device 261, and is transported and collected as recovered toner. The storage medium on which the toner image has been formed is transported to a fixing device 267 located downstream of the secondary transfer section. The toner image formed on the storage medium is heated and pressed in a fixing nip between a fixing roller 268 and a pressure roller 269, and is thermally fixed to the surface of the storage medium. A series of image formation operations is completed by the above operations.

[0059] Furthermore, when the CPU 504 receives an image formation start signal for forming a color image, it drives the separation motor 513 to bring the intermediate transfer belt 258 into contact with the process units 251y, 251m, 251c, and 251k. Thereafter, the image forming operation for each color is performed in the same manner as for the monochrome image.

[0060] <Job information> Next, the job information will be described with reference to Fig. 8. Job information 800 includes job presence / absence 801, number of pages 802, and color data for each page 803. The example shown in Fig. 8 shows job information for a job in which the first page is a monochrome image, the second page is a color image, and the third page is a color image. That is, in job information 800, job presence / absence 801 indicates presence, number of pages 802 is set to 3 pages, and monochrome, color, and color are stored as color data for each page 803.

[0061] Therefore, if there is data on whether or not a job exists 801, it can be determined that the job information is stored. Also, by checking the color of each page by the number of pages 802, it can be determined whether or not the job includes color pages. Note that when multiple instructions to start image formation for a job are received, the job information is treated as a whole, and the number of pages and the color of each page are updated.

[0062] <Projector> Next, referring to FIG. 6, a projector according to this embodiment will be described. In this embodiment, a projector using a transmissive liquid crystal panel will be described as an example of a projection device. However, the present invention is not limited to a projector using a transmissive liquid crystal panel as a display device. For example, the present invention can also be applied to a projector using a display device such as DLP (Digital Light Processing) or LCOS (Liquid Crystal On Silicon reflective liquid crystal) panel. In addition, liquid crystal projectors (simply referred to as projectors) are generally known as single-panel and three-panel types, but either type may be used. The liquid crystal projector of this embodiment projects an image by controlling the light transmittance of the liquid crystal element according to the image to be displayed and projecting the light from the light source that has passed through the liquid crystal element onto a screen. The configuration and operation of the projector 204 will be described below.

[0063] The projector 204 according to this embodiment has a CPU 610, a ROM 611, a RAM 612, an image input unit 630, an image processing unit 640, an external communication unit 693, an MFP communication unit 695, and an MFP image input / output unit 696. The projector 204 also has a liquid crystal control unit 650, liquid crystal elements 651R, 651G, 651B, a light source control unit 660, a light source 661, a color separation unit 662, a color synthesis unit 663, an optical system control unit 670, and a projection optical system 671. The projector 204 also has a reproduction unit 691, a storage medium 692, a communication unit 693 that communicates with an external device, and an imaging unit 694.

[0064] MFP communication unit 695 is connected to projector control cable 206 which is connected to MFP connection connector 208, and communicates with MFP 101. CPU 610 determines the status of communication with MFP 101 and communication with external devices, and determines whether to input or output an image. If it is determined that an image is to be input or output, MFP image input / output unit 696 inputs or outputs an image from / to MFP 101 via projector projection image cable 207 in accordance with an instruction from CPU 610.

[0065] The CPU 610 controls each block of the projector 204. The ROM 611 is a memory that stores a control program that describes the processing procedure of the CPU 610. The RAM 612 is a memory that temporarily stores the control program and data as a work memory. The CPU 610 temporarily stores still image data and video data reproduced from the storage medium 692 by the reproduction unit 691 in the RAM 612, and reproduces each image and video using the program stored in the ROM 611. In other words, the RAM 612 functions as a graphic memory of the projector 204. The CPU 610 can also temporarily store images and videos acquired by the imaging unit 694 in the RAM 612, convert the images and videos into still image data or video data using the program stored in the ROM 611, and record them in the storage medium 692.

[0066] The image input unit 630 receives an image signal from an external device, and includes, for example, a composite terminal, an S image input terminal, a D terminal, a component terminal, and an analog RGB terminal. The image input unit 630 also includes, for example, a DVI terminal, a DVI-D terminal, an HDMI (High Definition MultiMedia Interface) (registered trademark) terminal, and the like. When the image input unit 630 receives an analog signal, it converts the received analog signal into a digital signal. Then, the image input unit 630 transmits the received image signal to the image processing unit 640. Here, the external device may be any device capable of outputting an image signal, and may be, for example, a personal computer, a camera, a mobile phone, a smartphone, or a hard disk recorder.

[0067] The image processing unit 640 performs processing for changing the number of frames, the number of pixels, the image shape, etc., on the image signal received from the image input unit 630 or the external communication unit 693, and transmits the result to the liquid crystal control unit 650, and is, for example, a microprocessor for image processing. The image processing unit 640 does not need to be a dedicated microprocessor, and the CPU 610 may execute the same processing as the image processing unit 640 by a program stored in the ROM 611, for example. The image processing unit 640 can execute functions such as frame thinning processing, frame interpolation processing, resolution conversion processing, OSD superimposition processing such as menus, distortion correction processing (keystone correction processing), and edge blending. The image processing unit 640 can perform the above-mentioned processing on images and videos reproduced by the CPU 610 other than the received signal received from the image input unit 630.

[0068] The liquid crystal control unit 650 adjusts the transmittance of the liquid crystal elements 651R, 651B, and 651G by controlling the voltage applied to the liquid crystal of the pixels of the liquid crystal elements 651R, 651G, and 651B based on the image signal processed by the image processing unit 640. The liquid crystal control unit 650 does not need to be a dedicated microprocessor, and for example, the CPU 610 may execute the same process as the liquid crystal control unit 650 by a program stored in the ROM 611. For example, when an image signal is input to the image processing unit 640, the liquid crystal control unit 650 controls the liquid crystal elements 651R, 651B, and 651G so that the transmittance corresponds to the image every time it receives one frame of image from the image processing unit 640. The liquid crystal element 651R is a liquid crystal element for red, and is for adjusting the transmittance of red among the light output from the light source 661 and separated into red (R), green (G), and blue (B) by the color separation unit 662. The liquid crystal element 651G is a liquid crystal element corresponding to the color green, and is intended to adjust the transmittance of the green color of the light output from the light source 661 and separated into red (R), green (G), and blue (B) by the color separation section 662. The liquid crystal element 651B is a liquid crystal element corresponding to the color green, and is intended to adjust the transmittance of the blue color of the light output from the light source 661 and separated into red (R), green (G), and blue (B) by the color separation section 662. A specific control operation of the liquid crystal elements 651R, 651G, and 651B by the liquid crystal control section 650, and details of the configurations of the liquid crystal elements 651R, 651G, and 651B will be described later.

[0069] The light source control unit 660 controls the on / off and light intensity of the light source 661, and is made up of a control microprocessor. The light source control unit 660 does not need to be a dedicated microprocessor, and for example, the CPU 610 may execute the same processing as the light source control unit 660 by a program stored in the ROM 611. The light source 661 outputs light for projecting an image on a screen (not shown), and may be, for example, a halogen lamp, a xenon lamp, or a high-pressure mercury lamp. The color separation unit 662 separates the light output from the light source 661 into red (R), green (G), and blue (B), and is made up of, for example, a dichroic mirror, a prism, or the like.

[0070] In addition, when LEDs (Light Emitting Diodes) or the like corresponding to each color are used as the light source 661, the color separation unit 662 is not necessary. In addition, the color synthesis unit 663 synthesizes the red (R), green (G), and blue (B) lights transmitted through the liquid crystal elements 651R, 651G, and 651B, and is composed of, for example, a dichroic mirror, a prism, or the like. The light obtained by synthesizing the red (R), green (G), and blue (B) components by the color synthesis unit 663 is sent to the projection optical system 671. At this time, the liquid crystal elements 651R, 651G, and 651B are controlled by the liquid crystal control unit 650 so that the transmittance of the light corresponds to the image input from the image processing unit 640. Therefore, when the light synthesized by the color synthesis unit 663 is projected onto the screen by the projection optical system 671, it is displayed on the screen corresponding to the image input by the image processing unit 640.

[0071] The optical system control unit 670 controls the projection optical system 671 and is composed of a control microprocessor. The optical system control unit 670 does not need to be a dedicated microprocessor, and for example, the CPU 610 may execute the same processing as the optical system control unit 670 by a program stored in the ROM 611. The projection optical system 671 projects the combined light output from the color combining unit 663 onto a screen. The projection optical system 671 is composed of a plurality of lenses and a lens actuator, and can drive the lenses with the actuator, and can enlarge, reduce, adjust the focus of the projected image, etc.

[0072] The reproducing unit 691 reads out still image data and moving image data stored in the storage medium 692 to the RAM 612 and reproduces them, or receives still image data and moving image data of images and videos obtained by the imaging unit 694 from the CPU 610 and records them in the storage medium 692. The reproducing unit 691 may also record still image data and moving image data received by the communication unit 693 in the storage medium 692. The reproducing unit 691 is composed of, for example, an interface electrically connected to the storage medium 692 and a microprocessor for communicating with the storage medium 692. The reproducing unit 691 does not need to include a dedicated microprocessor, and the CPU 610 may execute the same processing as the reproducing unit 691 by a program stored in the ROM 611, for example. The storage medium 692 can record still image data, moving image data, and other control data required for the liquid crystal projector according to the embodiment. The storage medium 692 may be any type of storage medium, such as a magnetic disk, an optical disk, or a semiconductor memory. Furthermore, the storage medium 692 may be in a form that is detachable from the projector 204 .

[0073] The external communication unit 693 is for transmitting and receiving control signals, still image data, moving image data, etc. from external devices. Here, the external communication unit 693 is connected to a projector-side HDMI connector 216 connected to the projector 204. It is further connected to a projector external input connector (HDMI) 213 connected from a projector external input I / F (HDMI) 210.

[0074] <pc> Next, the hardware configuration of the relay server 106 and the PC 107 of the Web conference system according to this embodiment will be described with reference to FIG.

[0075] The PC 107 includes a control unit 1010 and an operation unit 1017. The control unit 1010 includes a CPU 1011, a ROM 1012, a RAM 1013, a HDD 1014, an operation unit I / F 1015, and a network I / F 1016. The control unit 1010 including the CPU 1011 controls the operation of the entire PC 107. The CPU 1011 executes programs stored in the ROM 1012 and the HDD 1014 to realize the functions of the PC 107, the processing of the PC 107 in a sequence diagram to be described later, and the processing of a flowchart related to the PC 107. The ROM 1012 stores various programs executed by the CPU 1011. The RAM 1013 is used as a temporary storage area such as a main memory and a work area of ​​the CPU 1011. The HDD 1014 stores image data and various programs. The operation unit I / F 1015 connects the operation unit 1017 and the control unit 1010. The operation unit 1017 is provided with a liquid crystal display unit having a touch panel function, a keyboard, a mouse, etc. The network I / F 1016 connects the control unit 1010 to the Internet 120.

[0076] The hardware configuration of relay server 106 is similar to the hardware configuration of PC 107 in terms of the basic configuration described above. That is, CPU 1011 of relay server 106 executes programs stored in ROM 1012 and HDD 1014 of relay server 106. In this way, relay server 106 realizes the functions of relay server 106, the processing of relay server 106 in the sequence diagram described below, and the processing of flowcharts related to relay server 106.

[0077] <Functional configuration of each device> Next, referring to FIG. 11, the functional configuration of the MFP 101, the PC 107, and the relay server 106 according to the present embodiment will be described. The relay server 106 includes a session management service 1121, an account management service 1122, a document management service 1123, and a relay service 1120. The account management service 1122 allows registration of two types of accounts: an account as a user (individual) and an account as a connected device. For an account as a user (individual), input of a name, an email address, and a password is required, and group registration, etc. is possible as necessary. Personal authentication is performed using a password. Although the authentication method is not particularly limited in this embodiment, it is possible to use an authentication system of the relay server 106 itself, and the account management service can have its own authentication system. Registration as a connected device involves registering the device's machine number, device name, and password. Authentication is performed using the device's machine number and password. Data required for these accounts can be input from the operation unit 1017 of the relay server 106. The session management service 1121 manages the session number, the start time, and the participating accounts. The participating accounts are accounts that have been authenticated by the account management service 1122. When an external connection request occurs to the relay service 1120, the relay service 1120 queries the session management service 1121. If the session and the participant match, the relay service 1120 starts relaying. The document management service 1123 determines whether the document can be displayed, and if it cannot be displayed, displays a message to the participant that the document cannot be displayed. In this embodiment, the participating accounts are shown as connected devices, but personal accounts are also possible.

[0078] The MFP 101 includes a Web server 1102, a Web browser 1131, a client 1132 which is a client program for the MFP 101 in the Web conference system, a server-side proxy 1101, and a client-side proxy 1130. In this manner, a Web browser function is built into the MFP 101. The components 444 of the MFP 101 also include an audio encoder 1105, an audio decoder 1106, a video encoder 1107, and a video decoder 1108.

[0079] The PC 107 includes a Web browser 1111, a client 1112 of the Web conference system, and a client-side proxy 1110. The PC 107 further includes an audio encoder 1113, an audio decoder 1114, a video encoder 1115, and a video decoder 1116. The client 1132 of the MFP 101 of the Web conference system and the client 1112 of the PC 107 are each an application program. The client 1112 encodes an image displayed on a display (not shown) of the PC 107 by a video encoder 1115. Furthermore, audio input by a microphone connected to the PC 107 is encoded by an audio encoder 1113. The encoded audio and video are encapsulated in HTTP (Hyper Text Transfer Protocol). Similarly, the encoded audio data encapsulated in HTTP is decoded by audio decoders 1106 and 1114. Audio is output from a speaker (not shown), and the encoded video data is decoded by video decoders 1108 and 1116 and displayed as video on web browsers 1131 and 1111. The encoded audio data and video data are transmitted and received via a relay service 1120 using HTTP.

[0080] When the server-side proxy 1101 receives a connection instruction via the operation unit 250, it establishes a connection with the relay service 1120 and then mediates (relays) communication between the relay service 1120 and the Web server 1102. When the Web server 1102 receives an HTTP (Hyper Text Transfer Protocol) communication request from the relay server 106, it has a function of returning a response according to the request. The client-side proxy 1110 in the PC 107 mediates (relays) communication between the Web browser 1111 and the relay service 1120. The client-side proxy 1130 in the MFP 101 mediates (relays) communication between the Web browser 1131 and the relay service 1120. The relay service 1120 provides a Web server function, and has a function of returning a response according to the request when it receives an HTTP communication request from the PC 107 and the MFP 101.

[0081] Here, the HTTP communication performed between the server-side proxy 1101 and the relay service 1120, and the HTTP communication performed between the client-side proxies 1110, 1130 and the relay service 1120 will be described. HTTP is a client / server protocol defined in RFC (Request For Comment) 2616, and has a number of methods. In general, a GET method is used when a client receives information from a server, and a POST method is used when a client transmits information to a server. In this embodiment, the POST method is used when the server-side proxy 1101 transmits data to the relay service 1120, and when the client-side proxies 1110, 1130 transmit data to the relay service 1120. The GET method is used when the server-side proxy 1101 receives data from the relay service 1120, and when the client-side proxies 1110, 1130 receive data from the relay service 1120. Furthermore, separate connections are used for transmission and reception. The video data transmitted and received using the HTTP protocol is expanded on the RAM 402 in the controller unit 400, and is transmitted to the projector 204 via the projector I / F 443 for display.

[0082] <Processing Procedure> (Projection of scanned image) Various processing procedures will be described below with reference to Fig. 12 to Fig. 14. Fig. 12 shows the processing procedure when an image is read by the reader function unit 201 and displayed by the projector 204. Here, the operation when the projector display key 711 after reading is pressed will be described. The processing described below is realized, for example, by the CPU 401 reading a program stored in advance in the ROM 406 or HDD 407 into the RAM 402 and executing it.

[0083] In S1202, the CPU 401 detects that a document has been placed on the ADF by the user. Then, in S1203, the CPU 401 detects that a user has pressed the post-reading projector display key 711 on the operation unit 250. Specifically, a command (operation information) is transmitted to the system bus 416 via the operation unit I / F 403 and notified to the CPU 401 regarding a user operation performed on the operation unit 250. Note that the CPU 401 may start reading the document placed on the ADF by the reader function unit 201 at this timing. The reading may be started at any timing, and may be started, for example, after confirmation of power supply to the projector 204 described later.

[0084] Thereafter, in S1204, the CPU 401 that has been notified of the command acquires the status of the projector 204 via the projector I / F 443, and determines whether or not the projector 204 is energized based on the acquired status information. If the projector 204 is not energized, the process proceeds to S1205, where the CPU 401 energizes the power line included in the projector control cable 206 to power on the projector 204, and the process proceeds to S1206. If it is determined in S1204 that the projector 204 is energized, the process proceeds directly to S1206.

[0085] In S1206, the CPU 401 notifies the projector 204 of a display request. Next, in S1207, the CPU 401 passes the image data, which is read from the original by the reader function unit 201 and converted into digital data, through the compressor 413 to compress and store in the RAM 402. Here, the CPU 401 calculates the size of the compressed image data and the size of the image data when the resolution is further converted as the data size of the image read by the reader function unit 201. Here, the image data when the resolution is converted is image data converted to a low resolution, and the data size is smaller than that of the image data before conversion. Note that the process of actually converting the resolution and reading is the process of S1216 described later. Furthermore, in S1208, the CPU 401 acquires the free space of the RAM 612 calculated by the CPU 610 of the projector 204, and proceeds to S1209. Note that here, an example has been described in which the CPU 401 acquires the free space of the RAM 612 from the CPU 610 and executes the processes from S1209 onwards. However, the present invention is not limited to this. For example, the CPU 401 may notify the CPU 610 of the projector 204 of the size of the image data calculated in S1207, and the CPU 610 may execute the subsequent processes.

[0086] In S1209, the CPU 401 determines whether or not the image data of the image size acquired in S1207 can be stored in the RAM 612 based on the free space of the RAM 612 notified by the CPU 610. If the image data cannot be stored in the RAM 612, the process proceeds to S1211, and if the image data can be stored in the RAM 612, the process proceeds to S1210. In S1211, the CPU 401 determines whether or not the image data can be stored in the RAM 612 at the size after resolution conversion. If the image data can be stored, the process proceeds to S1216, and if not, the process proceeds to S1212.

[0087] In S1212, the CPU 401 determines whether or not the image data can be saved to the storage medium 692. If the image data can be saved, the process proceeds to S1213, and if not, the process proceeds to S1214. In S1213, the CPU 401 saves the image data to the storage medium 692 and returns the process to S1209 to determine again whether or not the image data can be stored in the RAM 612. This is to check again whether free space has been secured, since the image data that has been subjected to display processing by the projector 204 is deleted from the RAM 612. Note that if free space in the RAM 612 cannot be secured even after this, the image data has already been saved to the storage medium 692, so the processes of S1212 and S1213 are skipped, and the determinations of S1209 and S1211 are periodically performed.

[0088] On the other hand, if it is determined in S1212 that the data cannot be saved to storage medium 692, the process proceeds to S1214, where CPU 401 determines whether or not free space has been created in RAM 612. The process waits until free space is created in RAM 612, for example due to the end of a presentation, and if sufficient free space is created, the process proceeds to S1216. Note that in addition to the determination in S1214, a determination similar to that in S1211 may be added.

[0089] If it is determined in S1211 that the images can be stored in RAM 612 after resolution conversion, the process proceeds to S1216, where CPU 401 sets the resolution conversion, reads the images, calculates the number of images that can be stored in RAM 612, and proceeds to S1217. If it is determined in S1209 that the images can be stored in RAM 612 without resolution conversion, the process proceeds to S1210, where CPU 401 calculates the number of images that can be stored. Then, the process proceeds to S1215, where CPU 401 reads the images without setting the resolution conversion, and proceeds to S1217.

[0090] When reading of the images is completed, the process proceeds to S1217, where the CPU 401 transfers image data for the number of images to be stored in the RAM 612, and transfers and stores the remaining images to the HDD 407. Next, in S1219, the CPU 401 determines whether the images stored in the HDD 407 can be transferred to the projector 204, and if transferable, the process proceeds to S1220, where the remaining images are transferred to the projector 204, and the process ends.

[0091] It is also possible to encode image data stored in the RAM 402 in a video format, and the CPU 401 encodes the image data through a video encoder 1107 via a system bus 416. The encoded data can be displayed on the Web browser of the PC 107 via a Web conference system client 1132 and a relay service 1120.

[0092] (Printing projected images) 13, a process procedure for printing an image displayed on the projector 204 by the printer function unit 202 will be described. The process described below is realized, for example, by the CPU 401 reading a program stored in advance in the ROM 406 or HDD 407 into the RAM 402 and executing it. Here, the projector image print key 712 is selected on the screen 702, and the screen transitions to the screen 703.

[0093] In S1301, when the user presses print start key 748 on screen 703, CPU 401 checks the status of projector 204 via projector control cable 206 by projector I / F 443. Next, in S1302, CPU 401 determines whether or not there is an image being displayed on projector 204 in accordance with the status of projector 204 acquired in S1301, and if there is, proceeds to S1303, and if there is not, ends the processing.

[0094] In S1303, the CPU 401 determines whether there is free space in the RAM 402 that stores the print image. If sufficient free space can be secured, the process proceeds to S1306. If not, the process proceeds to S1304, where the CPU 401 checks the free space on the HDD 407. If sufficient free space can be secured on the HDD 407 in S1304, the process proceeds to S1305, where the CPU 401 saves the data on the RAM 402 onto the HDD 407, and then proceeds to S1306. On the other hand, if free space cannot be secured on the HDD 407 in S1304, the process waits until free space can be secured.

[0095] In S1306, the CPU 401 transmits the image displayed on the projector 204 from the projector 204 to the RAM 402. Next, in S1307, the CPU 401 acquires information on the resolution of the transmitted image and determines whether it can be printed as is. If resolution conversion is necessary, the process proceeds to S1308, where the CPU 401 performs resolution conversion on the image data, and the process proceeds to S1309. If it can be printed as is, the process proceeds to S1309.

[0096] In S1309, the CPU 401 sets the number of copies to be printed and density parameters according to user settings, and executes printing in S1310. In this way, when printing the screen of the Web conference system displayed on the projector 204, the image data projected on the RAM 402 is transferred from the projector 204, and the image data on the RAM 402 is sent to the printer function unit 202 for printing.

[0097] (Projection of scanned image while projector is running) 14, a process procedure for reading an image by the reader function unit 201 and projecting the image while presentation data is being displayed from the external PC 105 will be described. The process described below is realized, for example, by the CPU 401 reading a program stored in advance in the ROM 406 or HDD 407 into the RAM 402 and executing the program.

[0098] In S1402, the CPU 401 detects that a document has been placed on the ADF by the user. Then, in S1403, the CPU 401 detects that a user has pressed the post-reading projector display key 711 on the operation unit 250. Specifically, a command (operation information) is transmitted to the system bus 416 via the operation unit I / F 403 and notified to the CPU 401 regarding a user operation performed on the operation unit 250. Note that the CPU 401 may start reading the document placed on the ADF by the reader function unit 201 at this timing. The reading may be started at any timing, and may be started, for example, after confirmation of power supply to the projector 204 described later.

[0099] Thereafter, in S1404, the CPU 401 notified of the command notifies the projector 204 to display the read image. Next, in S1405, the CPU 401 determines whether the image in the RAM 402 can be saved to the storage medium 692. If the image cannot be saved, the process proceeds to S1409, where the CPU 401 notifies the projector 204 that display is not possible, and this flowchart ends. On the other hand, if the image can be saved, the process proceeds to S1406, where the CPU 401 saves the image data in the RAM 402 to the storage medium 692.

[0100] Next, in S1407, the CPU 401 passes the image data, which is read from the document by the reader function unit 201 and converted into digital data, through the compressor 413 to compress and store in the RAM 402. Here, the CPU 401 calculates the size of the compressed image data and the size of the image data when the resolution is further converted as the data size of the image read by the reader function unit 201. Here, the image data when the resolution is converted is image data converted to a low resolution, and the data size is smaller than that of the image data before conversion. Note that the process of actually converting the resolution and reading is the process of S1413 described later. Furthermore, in S1408, the CPU 401 acquires the free space of the RAM 612 calculated by the CPU 610 of the projector 204, and proceeds to S1410. Note that here, an example has been described in which the CPU 401 acquires the free space of the RAM 612 from the CPU 610 and executes the processes from S1410 onwards. However, the present invention is not limited to this. For example, the CPU 401 may notify the CPU 610 of the projector 204 of the size of the image data calculated in step S1407, and the CPU 610 may execute the subsequent processes.

[0101] In S1410, the CPU 401 determines whether the image data of the image size acquired in S1407 can be stored in the RAM 612 based on the free space of the RAM 612 notified by the CPU 610. If the image data can be stored in the RAM 612, the process proceeds to S1411, where the CPU 401 executes the reading process without setting the resolution conversion, and proceeds to S1415. On the other hand, if the image data cannot be stored in the RAM 612, the CPU 401 checks whether the image data can be stored in the RAM 612 by performing the resolution conversion. If the image data cannot be stored, the process proceeds to S1409, where the CPU 401 notifies that the projector display is not possible, and ends this flowchart. The notification may be displayed on the operation unit 250 of the MFP 101, or the information may be transmitted to an external device such as the PCs 103, 105, and 107 and displayed on the display unit of the transmission destination. On the other hand, if the data can be stored in the RAM 612, the process proceeds to S1413, where the CPU 401 sets the resolution conversion, executes the reading process, calculates the number of sheets to be stored in the RAM 612, and the process proceeds to S1415.

[0102] Next, in S1415, the CPU 401 transfers image data of images that can be stored in the RAM 612 to the projector 204. In S1416, the CPU 401 transfers image data of the remaining images that were not transferred in S1415 to the HDD 407 on the controller side. Thereafter, in S1417, the CPU 401 determines whether or not input of the display end key 744 of the scan image has been accepted. If input of the display end key 744 has been accepted, the process proceeds to S1420, where the CPU 401 transfers the image from the storage medium 692 to the RAM 612, returns to the original presentation, and ends this flowchart. On the other hand, if it is determined in S1417 that the display end key 744 has not been entered (for example, if the next page key 742 of the scan image has been entered), the process proceeds to S1418, where the CPU 401 determines whether or not it is necessary to transfer the image from the HDD 407. If necessary, the process proceeds to S1419, where the CPU 401 transfers the image to the projector 204, displays it, and returns to S1417. Also, if it is determined in S1418 that transfer is not necessary, the process returns to S1417. Thereafter, the process waits until input of the end key 744 is received, proceeds to the process of S1420 described above, and ends this flowchart.

[0103] Image data stored in the RAM 402 can also be encoded in a video format, and is encoded through a video encoder 1107 via a system bus 416. The encoded data can be displayed on the Web browser of the PC 107 via a Web conference system client 1132 and a relay service 1120.

[0104] As described above, the image processing device according to the present embodiment includes a scanner that reads an image from a document and a projector that projects an image according to image data. The image processing device displays an operation screen for receiving a first instruction to project the image read by the scanner with the projector on the display unit of the image processing device or the display unit of an external device. Upon receiving the first instruction, the image processing device transfers image data of the image read by the scanner to the projector and projects it according to the free space of the memory of the projector. The image processing device further includes a printer unit that prints an image on a sheet according to the image data, and is capable of receiving a second instruction on the operation screen to print the image being projected by the projector. Upon receiving the second instruction, the image processing device acquires image data of the image being projected by the projector from the projector, converts it into printable image data, and transfers it to the printer, and causes the printer to print the image. The image processing device is capable of receiving a third instruction to project the image read by the scanner with the projector while the projector is projecting an image. When a third instruction is received, the image processing device can transfer image data of an image read by the scanner to the projector to project it in place of the image being projected, and then return to the image being projected in response to a user instruction.

[0105] In this way, according to the present embodiment, an image read from a document can be projected by a projector in accordance with a simple operation by a user. In addition, the contents projected by the projector can be printed in accordance with a simple operation by a user. In addition, even during projection by the projector, another image can be read by a scanner and projected as an interrupt. In this way, the image processing device according to the present embodiment can print an image displayed by a projector as it is. It is possible to print out the displayed presentation data as necessary without printing all of it, and it is possible to take notes at appropriate times, thereby improving business efficiency. In addition, when a user wishes to indicate a change during a presentation, it is possible to read a chart or a document containing words written on the spot and display it as it is on the projector, instead of verbally. Therefore, it is possible to convey one's intention to the other person, and to directly convey one's intention.

[0106] As described above, the present invention makes it possible to project an image read by a scanner with a projector according to a simple operation by a user. Therefore, it is possible to execute the method of reading once with a scanner, converting it into image data, saving it in an external device such as a PC, visualizing the saved image data using an application on the PC, and projecting it on a projector in one go, which has been conventionally done. This allows a user to visualize their thoughts by handwriting or the like on the spot when they are unable to communicate their thoughts well during a meeting, and projecting and sharing the visualized images, thereby promoting effective meetings. Also, when a user wants to write notes on a presentation slide displayed during a presentation meeting, the user writes the notes in a text document and takes notes. There are cases where the notes are taken late or the page is wrong during the explanation, and when the notes are read again later, they do not match the images on the presentation slides, making the notes ineffective. It is possible to take notes by printing the images of the presentation slides displayed on the spot, and when the notes are looked back on later, they can be associated with the presentation slides, making them effective notes, and eliminating information omissions.

[0107] In addition, the projector can be used for a web conference function. By linking this web conference function with the projector's functions, it is possible to read and display the image on the projector during a web conference using the web conference function, and share the image on the web conference system.

[0108] <Other embodiments> The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0109] The invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0110] 100: local area network, 101: full color MFP, 102: file server, 103: personal computer for printing, 104: public line, 105: personal computer for projector display, 106: relay server, 107: personal computer for TV conference, 108: firewall, 201: reader function unit, 202: printer function unit, 203: projector expansion unit, 204: projector, 205: rear projector external input I / F installation notch, 206: projector control cable, 207: projector projection image cable, 208: MF P connection connector, 209: Right side projector installation notch, 210: Projector external input I / F (HDMI), 211: Projector external input I / F (D-sub), 212: Front projector external input I / F installation notch, 213: Projector external input connector (HDMI), 214: Projector external input connector (D-sub), 215: Projector side D-sub connector, 216: Projector side HDMI connector, 217: Projector side control connector, 218: Projector image input connector, 220: Extended function cable, 221: Front notch, 250: Operation unit< / pc>

Claims

1. An image processing device, comprising: A reading means for reading an image from a document; A printing means; A projection means for projecting an image; A storage means; an operation means for receiving a first instruction for causing the projection means to project an image read by the reading means, and a second instruction for causing the printing means to print the image projected by the projection means; a control means for controlling, when the first instruction is received by the operation means, the projection means to project the image read by the reading means and to transmit image data of the image read by the reading means to a server for a Web conference, and for controlling, when the second instruction is received by the operation means, the printing means to print the image projected by the projection means; Equipped with When the first instruction is received by the operation means, the control means determines whether the size of the image data of the image read by the reading means is a size that can be stored in the storage means, and if the size of the image data is a size that cannot be stored in the storage means, lowers the resolution, causes the reading means to read the original at the lowered resolution, and causes the projection means to project the image read by the reading means in place of the image being projected.

2. 2 . The image processing apparatus according to claim 1 , wherein the control means, when receiving the first instruction through the operation means, further causes the reading means to read the image of the document.

3. The operation means has a display unit that displays a first operation screen related to a basic menu of the image processing device, The image processing apparatus according to claim 1 , wherein the first operation screen includes an object for performing the first instruction.

4. 1. A method for controlling an image processing apparatus including a reading means for reading an image from an original, a printing means, a projection means for projecting an image, a storage means, and an operation means for receiving a first instruction for causing the projection means to project the image read by the reading means, and a second instruction for causing the printing means to print the image projected by the projection means, comprising: a control step in which, when the control means receives the first instruction on the operation means, the control means controls the projection means to project the image read by the reading means and to transmit image data of the image read by the reading means to a server for a Web conference, and, when the control means receives the second instruction on the operation means, the control means controls the printing means to print the image projected by the projection means; Including, A control method for an image processing device, characterized in that when the first instruction is received by the operation means, the control process determines whether the size of the image data of the image read by the reading means is a size that can be stored in the storage means, and if the size of the image data is a size that cannot be stored in the storage means, lowers the resolution, causes the reading means to read the original at the lowered resolution, and causes the projection means to project the image read by the reading means in place of the image being projected.

5. 5. A program for causing a computer to execute the control method for an image processing apparatus according to claim 4.

Citation Information

Patent Citations

  • Combined machine

    JP2005331871A

  • Image processing apparatus, image processing program, and image processing method

    JP2010219856A

  • Image forming device and image projection system

    JP2011166201A

  • Image processing device, and control method and program therefor

    JP2012134774A

  • Service providing system and service providing method

    JP2014238823A