Recording control method, program, and storage medium

Abstract

To provide a recording device that is moved by a user on a recording medium to perform recording, and to perform recording on the recording medium at an appropriate size.SOLUTION: A recording control method has: an acquisition step of acquiring recording data for performing recording; an imaging step of picking up an image of a recording device that performs recording by using the recording data; a recognition step of recognizing the attitude of the recording device from a picked-up image picked up in the imaging step; a display step of converting the recording data into a coordinate system corresponding to the attitude of the recording device in the picked-up image based on a result of recognition of the attitude of the recording device, and displaying the converted recording data on a display based on a predetermined point of the recording device in the picked-up image; and a transmission step of transmitting the recording data to the recording device.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present invention relates to a recording control method for a recording apparatus. [Background technology]

[0002] Printing devices that print by applying a printing material such as toner or ink to paper or similar recording media are generally stationary. In contrast, printing devices that allow the user to move the device itself over the recording medium have recently been developed. A printing device that allows the user to move the device itself over the recording medium will be referred to as a portable printer below.

[0003] Portable printers offer greater freedom in print positioning than conventional stationary recording devices. They also require a different alignment method than stationary printers. Patent Document 1 proposes a method for correcting misalignment during printing on such portable printers. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2017-81012 Summary of the Invention [Problem to be solved by the invention]

[0005] Conventional stationary recording devices can print by matching the data to be recorded with the size of the recording medium. For example, by specifying the paper size to be recorded from the printer driver, the data to be recorded can be appropriately enlarged or reduced. However, portable printers have no restrictions on the size of the recording medium. Therefore, it is not possible to appropriately enlarge or reduce the data to be recorded. As a result, if the data to be recorded is too large for the range intended by the user, it will overflow. Furthermore, if the data to be recorded is too small, readability may be reduced.

[0006] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to enable a recording device in which a user records by moving the device over the recording medium to record at an appropriate size on the recording medium. [Means for solving the problem]

[0007] The recording control method according to the present invention comprises: A recording control method executed by a recording control device, comprising: An acquisition step of acquiring recording data for recording, an imaging step of imaging a recording device that performs recording using the recording data, and a recognition step of recognizing the posture of the recording device from the image captured in the imaging step, in which a result of processing to identify an identification mark that is not shown in the captured image among a plurality of identification marks that are all different colors and are provided at a plurality of vertices of the recording device is determined. As a result The recording method is characterized by comprising a recognition step of recognizing the attitude of the recording device based on the result of the recognition of the attitude of the recording device, a display step of converting the recording data into a coordinate system corresponding to the attitude of the recording device in the captured image based on the result of the recognition of the attitude of the recording device and displaying the converted recording data on a display means using a predetermined point of the recording device in the captured image as a reference, and a transmission step of transmitting the recording data to the recording device. [Effects of the Invention]

[0008] According to the present invention, in a recording device in which a user performs recording by moving the device over a recording medium, it is possible to perform recording with an appropriate size on the recording medium. [Brief explanation of the drawings]

[0009] [Figure 1A] 1 is a perspective view of a recording apparatus according to a first embodiment of the present invention; [Figure 1B] FIG. 2 is an enlarged view of an ink ejection chip that constitutes a print head. [Figure 2] FIG. 2 is a diagram showing a smartphone as a print control device according to the first embodiment. [Figure 3]FIG. 1 is a block diagram showing a print control system according to a first embodiment. [Figure 4] FIG. 2 is a diagram showing the functional block configuration of an image processing accelerator that performs image processing. [Figure 5] 10 is a flowchart showing the operation of a print control method. [Figure 6] A schematic diagram showing a printer displayed on a display. [Figure 7] 10 is a flowchart showing a method for virtually rendering recording results on a display. [Figure 8] FIG. 10 is a schematic diagram of a printer showing a method for calculating the drawing origin. [Figure 9] Schematic diagram showing coordinates on a display. [Figure 10] FIG. 10 is a schematic diagram showing how a virtual print result is drawn from the origin. [Figure 11] FIG. 10 is a schematic diagram showing a virtual printing result rendered on a display. [Figure 12] FIG. 10 is a schematic diagram showing a virtual printing result rendered on a display. [Figure 13] 10 is a flow chart illustrating a method for performing redrawing. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] (First embodiment) FIG. 1A is a schematic perspective view of a recording apparatus (hereinafter referred to as a printer) according to a first embodiment of the present invention.

[0012] In FIG. 1A, printer 100 is a printer (hereinafter also referred to as a portable printer) of a type in which a user manually moves the device itself over a recording medium to perform recording. Switch 101 is a switch that instructs the start of printing. Identification marks 102 to 109 are identification marks used to determine the position of the printer, which will be described later. In this embodiment, identification marks 102 to 109, each with a built-in LED, are provided at each vertex of printer 100. Print head (recording head) 110 is an inkjet type print head and is equipped with an ink ejection chip.

[0013] FIG. 1B is an enlarged view of an ink ejection chip 110a that constitutes the print head 110. A nozzle row (ink ejection nozzle row) 111 is a physical ejection port from which ink is actually ejected. Although only one nozzle row 111 is shown in FIG. 1B, in reality, there are as many nozzle rows 111 as there are colors to be used. Note that although an inkjet printer is used as an example in this embodiment, other types of recording devices, such as a thermal transfer type or ink ribbon type printer, may also be used.

[0014] 2 is a schematic diagram of a smartphone (recording control device) capable of communicating with a printer in this embodiment. The smartphone 200 includes a display 201, which is a display device. The smartphone 200 also includes a camera 304 (see FIG. 3). Note that although this embodiment uses a smartphone as an example, a device with a similar configuration, such as a tablet PC, may also be used.

[0015] FIG. 3 is a block diagram showing the configuration of a printer 100 and a smartphone 200, which are components of a printing system (recording system) in this embodiment.

[0016] 3, a CPU 301 of the smartphone 200 performs data calculation processing. A RAM 302 is a temporary storage area used by the CPU 301 when performing calculations. A mass storage device 303 can store various data such as programs that can be executed on the smartphone 200 and data used by the programs. A camera 304 is an imaging device provided in the smartphone 200. Image data captured by the camera 304 is recorded in the mass storage device 303. The captured image data is expanded in the RAM 302 and can be used as target data for calculation processing by the CPU 301.

[0017] The display 201 can display data stored in the RAM 302 or the mass storage device 303. The data transfer I / F 306 transmits and receives data to and from devices external to the smartphone 200. For example, data can be transmitted and received to and from a personal computer (not shown). The data transfer I / F 306 can also transmit print data to the printer 100.

[0018] Meanwhile, the CPU 311 of the printer 100 performs data calculation processing. The image processing accelerator 312 is an image processing calculation block specialized for the printer 100, and performs data processing in cooperation with the CPU 311. The data transfer I / F 313 sends and receives data to and from devices external to the printer 100. The RAM 314 is a temporary storage area used by the CPU 311 and image processing accelerator 312 when performing calculations. The ROM 315 stores parameters used by the CPU 311 and image processing accelerator 312 when performing calculations. Parameters read from the ROM 315 may also be loaded into the RAM 314. The head controller 316 is a head controller that controls ink ejection from the inkjet print head used as an example in this embodiment.

[0019] FIG. 4 is a diagram showing the functional block configuration of the image processing accelerator 312, which is composed of an ASIC that performs image processing. An input unit 401 receives print data from the smartphone 200 via a data transfer I / F 313 as input data. The received data is input to the image processing accelerator 312. The image processing accelerator 312 includes a color correction unit 402, a color separation unit 403, an output tone correction processing unit 404, and a quantization processing unit 405, which are processing blocks that separate the input data into ink colors and determine the amount of ink to be printed. Note that in this embodiment, it is assumed that image processing is performed by the printer 100, but data that has been image processed on the smartphone 200 side can also be sent to the printer 100. The configuration of the image processing accelerator 312 is not limited to this configuration, and blocks for arbitrary correction processing, etc., may be added.

[0020] The flow of processing in the print control system configured as above will be described below. Fig. 5 is a flowchart illustrating processing in the smartphone 200 in this embodiment.

[0021] First, in step S501, CPU 301 specifies print data (recording data). In this embodiment, it is assumed that data to be printed is stored in smartphone 200. This data may be data prepared in advance, or may be image data captured by smartphone 200.

[0022] In step S502, the user uses a smartphone to capture a live view image (captured image) of the printer 100 and its surroundings. In this manner, although the present embodiment will be described taking an example in which a live view image is used, the same processing as described below can be performed on a captured still image.

[0023] 6 is a schematic diagram showing a live view image in which an image of the printer 100 is captured and displayed on the display 201 of the smartphone 200.

[0024] 5, in step S503, CPU 301 displays a pseudo print result of the print data on display 201. A method for displaying this pseudo print result will be described below.

[0025] FIG. 7 is a flowchart showing the operation of the smartphone 200 to display a pseudo print result on the display 201.

[0026] In step S701, the CPU 301 recognizes the printer 100.

[0027] Here, a method for recognizing the printer 100 will be described. First, communication is established between the printer 100 and the smartphone 200 using the data transfer I / F 313 in the printer 100. At this time, the model number of the printer 100 can be sent from the printer 100 to the smartphone 200. Alternatively, an application may be prepared for each printer model and installed on the smartphone 200.

[0028] Once communication is established, the printer 100 identifies its own location using the identification marks 102 to 109. For example, assume that all eight identification marks are different colors. In this case, each LED built into each identification mark emits light with a different chromaticity. When an image of the printer 100 is captured with the smartphone 200, at least one point will be in the printer 100's shadow. Based on the color of the shadowed LED, a program installed on the smartphone 200 can identify the direction from which the user captured the image of the printer 100. In other words, the orientation of the printer 100 relative to the smartphone 200 can be identified. When an image is captured parallel to any side or face of the rectangular parallelepiped, two or four LEDs will be in shadow. In this case, the direction from which the image was captured can be identified based on the color of the captured LED.

[0029] In this way, the direction from which the printer 100 is being photographed can be identified. Even if the identification marks are the same color, the direction from which the image is being photographed can be identified by, for example, varying the lighting cycle for each identification mark. Alternatively, specific identification patterns can be appropriately arranged, and the direction from which the image is being photographed can be identified based on the recognized pattern.

[0030] Another method is to use pattern matching to compare the acquired printer image with a pre-prepared printer appearance corresponding to that printer model and determine the direction in which the printer is being photographed. A known algorithm, such as the parametric eigenspace method, can be used as a pattern matching method. In this case, disparity images can be acquired using multiple cameras on a smartphone, and the accuracy of pattern matching can be improved based on estimated distance information. Alternatively, distance information can be obtained based on depth-of-field information. In either case, it is sufficient to be able to identify the printer's position and the direction in which it is being photographed.

[0031] 7, in step S702, the CPU 301 calculates the origin of image formation, which is the position of the nozzle that serves as the reference for the print head 110.

[0032] Here, an example of a method for calculating the depiction origin will be described. Assume that the printer 100 is currently displayed on the display 201 of the smartphone 200 as shown in FIG. 1A. In this case, the position of the print head 110 can be calculated from the relative pixel positions of the identification marks 102, 103, and 104. An example of the calculation method is shown below.

[0033] FIG. 8 is a bottom view of the printer 100 shown in FIG. 1A. In FIG. 8, the nozzle at the top left of the print head 110 (the recording element in the case of a thermal transfer or ink ribbon printer) is the reference nozzle. Since the model of the portable printer is known, the dimensions of each part of the printer 100 can be known in advance. From FIG. 8, the writing start position O(X0, Y0) of the print head 110 (the position of the reference nozzle) can be calculated as the point obtained by dividing the height direction of the printer 100 into a:b and the width direction into c:d.

[0034] FIG. 9 is a diagram illustrating coordinates set on the display 201 of the smartphone 200. In FIG. 9, consider Cartesian coordinates with the upper left corner of the display 201 as the origin. These will be referred to as "display coordinates" below. For example, the identification mark 103 of the reflected printer 100 can be acquired as display coordinates P103 (x1, y1). From the display coordinates of the identification marks 103, 104, and 105 thus obtained and the internal division ratio obtained from the model, the start coordinates on the display coordinates (coordinates of the depiction origin) can be identified.

[0035] 7, the CPU 301 renders the print data designated in step S501 as a preview image for checking the actual print position, size, etc. An example of the rendering method will be described below.

[0036] FIG. 10 shows preview coordinates XY, with the origin being the writing position in the display coordinate system identified as described above. Preview image 1001 is a preview image of the print data specified in step S501. The preview coordinates XY are coordinates in which the X axis is taken from the aforementioned rendering origin in the direction of identification marks 104 and 105, and the Y axis is taken in the direction of identification marks 103 and 104. Here, the position information of the print data is converted into preview coordinates (a coordinate system corresponding to the orientation of the printer 100). Any known conversion method can be used. For example, a rotation method using an affine transformation can be used. Once the rendering data is obtained in this way, it is rendered on the display 201 with the rendering origin (a specified point) in the display coordinate system as the origin.

[0037] 11 is a schematic diagram showing the state in which the writing origin and writing direction are determined in this way and a preview image of the print data is displayed on the display 201. In this way, a virtual print result can be displayed on the display.

[0038] 5, in step S504, CPU 301 actually transmits print data to printer 100. To start printing, the user presses switch 101 to move printer 100. As an alternative method, the instruction to start printing may be transmitted from, for example, a smartphone, rather than by pressing switch 101.

[0039] As described above, according to this embodiment, in a printer where a user moves the device over a recording medium to perform recording, the user can check a print preview image (pseudo print image) on the smartphone display before actually printing, which allows recording at an appropriate size on the recording medium.

[0040] (Second embodiment) In the second embodiment, an example of transforming rendered print data (preview image) will be described. The process up to rendering the preview image is the same as that up to step S503 in FIG.

[0041] 12 is a diagram showing a state in which a preview image of print data is displayed on the display 201. A recording medium 1201 is a medium onto which the printer 100 actually records. Here, it is assumed to be printable paper.

[0042] A preview image 1202 is a preview image of the specified print data displayed on the display 201. An object 1203 is an object that is recorded in advance on the recording medium 1201. For example, any object can be a graph, a design, a text string, or the like.

[0043] The preview image 1202 may be drawn with a degree of transparency relative to the recording medium 1201. In other words, the preview image 1202 may be drawn semi-transparently so that the recording medium 1201 can be seen. When the preview image 1202 overlaps with the object 1203, the user can operate the preview image 1202 on the display 201 to enlarge or reduce the preview image 1202 and rotate it as necessary.

[0044] FIG. 13 is a flowchart showing a method for changing the display magnification of a preview image on smartphone 200.

[0045] In step S1301, the CPU 301 detects a user operation. Specifically, for example, if the display 201 is an electrostatic panel, suppose two fingers or a similar device touch two different points. The display 201 can calculate the distance between the two touched points from the change in potential at the touched points. By increasing or decreasing the distance between the fingers, the enlargement or reduction ratio from the initial contact can be calculated. The ratio thus obtained is multiplied by an appropriate coefficient, and the resulting value is multiplied by the display ratio of the preview image 1202. The smartphone 200 transmits the image data thus enlarged, reduced, or rotated to the printer 100 as printing data. This allows the printer 100 to reproduce, on the recording medium 1201, an image that has been enlarged, reduced, or otherwise processed by the user on the smartphone 200.

[0046] In step S1302, the CPU 301 redraws the preview image 1202 based on the display ratio thus obtained. The subsequent steps up to printing are the same as those in the first embodiment.

[0047] As described above, according to the second embodiment, an image that has been processed in advance by a user on a smartphone can be reproduced on a recording medium.

[0048] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0049] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0050] 100: printer, 101: switch, 102 to 109: identification marks, 110: print head, 200: smartphone, 201: display, 301, 311: CPU, 302, 314: RAM, 303: mass storage device, 304: camera, 306, 313: data transfer I / F, 312: image processing accelerator, 315: ROM, 316: head controller

Claims

1. A recording control method executed by a recording control device, comprising: an acquisition step of acquiring recording data for recording; an imaging step of imaging a recording device that performs recording using the recording data; a recognition step of recognizing the orientation of the recording device from the captured image captured in the imaging step, the recognition step recognizing the orientation of the recording device based on the result of a process of identifying an identification mark that does not appear in the captured image from among a plurality of identification marks that are all different colors and are provided at a plurality of vertices of the recording device; a display step of converting the recording data into a coordinate system corresponding to the orientation of the recording device in the captured image based on the result of recognizing the orientation of the recording device, and displaying the converted recording data on a display means with a predetermined point of the recording device in the captured image as a reference; a transmitting step of transmitting the recording data to the recording device; A recording control method comprising:

2. 2. The recording control method according to claim 1, wherein the identification mark has a built-in LED.

3. 3. The recording control method according to claim 1, wherein the recording device is a rectangular parallelepiped, and the plurality of identification marks are eight identification marks arranged at eight vertices of the rectangular parallelepiped.

4. A recording control method according to any one of claims 1 to 3, characterized in that in the display step, a preview image of a recording image that will be formed when recording is started from the beginning of the recording data in the attitude of the recording device recognized in the recognition step is displayed on the display means.

5. 5. The print control method according to claim 1, wherein the predetermined point is the position of a predetermined print element of a printhead in the printing apparatus.

6. 6. A print control method according to claim 5, wherein the printhead is an ink-jet printhead, and the predetermined point is the position of a predetermined ink ejection nozzle of the printhead.

7. 7. The recording control method according to claim 1, further comprising a modifying step of modifying the recording data.

8. 8. The recording control method according to claim 7, wherein the transformation step includes processing of at least one of enlarging, reducing, and rotating the recording data.

9. 9. The recording control method according to claim 7, wherein in the transmitting step, the recording data modified in the modifying step is transmitted to the recording device.

10. 10. The recording control method according to claim 1, wherein the display step further displays an image of the recording device.

11. 11. The recording control method according to claim 1, wherein the display step further displays an image of a recording medium on which the recording device is to record.

12. 12. The recording control method according to claim 11, wherein, in the display step, when the recording data is displayed, the recording data is displayed so that the recording medium can be seen through the recording data.

13. A program for causing a computer to execute the recording control method according to any one of claims 1 to 12.

14. 13. A computer-readable storage medium storing a program for causing a computer to execute the recording control method according to claim 1.

Images