Printing process program and printing process method

Abstract

To synthesize a decorative object in an imaging screen without increasing a load in information management.SOLUTION: A control circuit 102 of an operation terminal 20, in S5, receives selection of a desired template TP that includes at least one photograph arrangement frame 30, at least one decorative object 40 arranged within or near the photograph arrangement frame 30, and a background image 50, through an operation unit 110 or the like; and in S10, analyzes the template TP in which selection is received in S5, extracts the decorative object 40 included in the template TP, synthesizes the decorative object 40 extracted in S10 in a screen of an imaged visual field PV imaged by a camera 111, and displays it on a touch panel 112.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a printing processing program and a printing processing method.

Background Art

[0002] Conventionally, a technique of inserting a photographic image at a predetermined position of a template and further adding and synthesizing a predetermined additional image to the photographic image is known (for example, see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, when the template and the decorative object to be synthesized with the photographed photo are separately held in an application program, it is necessary to manage the decorative object separately from the template, and the load on information management increases. Such a point is not particularly considered in the above conventional technology, and there is room for improvement.

[0005] The present invention has been made to solve the problems of the above-described conventional technology. That is, an object of the present invention is to provide a printing processing program and a printing processing method that enable a decorative object to be synthesized into a shooting screen without increasing the load on information management.

Means for Solving the Problems

[0006] To achieve the above objective, the present invention provides a terminal device connected to a printing apparatus for printing on a long printing medium, comprising a control unit, an operation unit, an imaging unit, and a display unit. The terminal device provides the control unit to perform the following steps: a selection reception step of receiving the selection of a desired template via the operation unit, which includes at least one photo arrangement frame, at least one decorative object arranged inside or near the photo arrangement frame, and a background image; an analysis and extraction step of analyzing the template received in the selection reception step and extracting the decorative object included in the template; and a composite display step of compositing the decorative object extracted in the analysis and extraction step into a shooting screen of a predetermined field of view captured by the imaging unit and displaying it on the display unit.

[0007] When the printing processing program of the present invention is executed in the control unit of the terminal device, a selection reception step, an analysis extraction step, and a composite display step are performed. When a user selects a desired template via the control panel, the selection is accepted in the selection acceptance step. The template includes a photo placement frame, decorative objects to be placed inside or near the photo placement frame, and a background image. The selected template is analyzed in the analysis extraction step, and the decorative objects included in the template are extracted. The extracted decorative objects are composited into the image capture screen of a predetermined field of view captured by the imaging unit during the composite display step, and then displayed on the display unit.

[0008] As described above, in the present invention, decorative objects included in a template can be easily composited into the shooting screen by performing an analysis on the template and extracting the decorative objects. According to the present invention, unlike when the template and decorative objects are held separately, it is sufficient to manage them as a single entity as a template including decorative objects. According to the present invention, decorative objects can be composited into the shooting screen without significantly increasing the burden on information management. [Effects of the Invention]

[0009] According to the present invention, decorative objects can be composited into the shooting screen without significantly increasing the burden on information management. [Brief explanation of the drawing]

[0010] [Figure 1] This document shows a front view, a right side view, and a functional block diagram illustrating the functional configuration of an operating terminal according to one embodiment of the present invention. [Figure 2] This is a functional block diagram showing the functional configuration of a label creation device. [Figure 3] This diagram illustrates the overall and essential parts of an example template stored in the template memory unit, and also illustrates the essential and overall parts of the shooting standby screen displayed on the touch panel. [Figure 4] This is an explanatory diagram showing the automatic standby screen displayed on the touch panel and the photographic images stored in the photo image storage unit. [Figure 5] This is an explanatory diagram illustrating the template display screen with photos that appears on the touch panel. [Figure 6] This is an explanatory diagram showing the print preparation screen displayed on the touch panel. [Figure 7] This is an explanatory diagram showing an example of a printed label that will be created. [Figure 8] This is a flowchart illustrating the control procedure executed by the control circuit of the operating terminal. [Figure 9] This is an explanatory diagram illustrating the data structure of the template. [Figure 10] This diagram illustrates the essential parts of an example template stored in the template memory unit in a modified configuration where the operating terminal is held horizontally to take a camera shot, and also illustrates the essential parts and the entirety of the shooting standby screen displayed on the touch panel. [Figure 11] This is an explanatory diagram illustrating the replacement behavior in a modified version that allows the replacement of decorative objects or photographs on the template. [Figure 12]It is an explanatory diagram showing the replacement behavior in a modification example that enables replacement of a decorative object or a photograph on a template. [Figure 13] It is a flowchart showing a control procedure executed by a control circuit of an operation terminal.

Embodiment for Carrying Out the Invention

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] <Operation terminal> An operation terminal 10 that executes a print processing program according to this embodiment is shown in FIGS. 1(a) to 1(c). The operation terminal 10 is connected to a label creating device 20. "Connection" includes both wireless connection via an interface such as Wi-Fi (registered trademark) or Bluetooth (registered trademark), and wired connection via a USB cable or the like. The operation terminal 10 generates print data for forming a desired image on a printing tape (described later) and outputs it to the label creating device 20. The label creating device 20 forms an image corresponding to the print data acquired from the operation terminal 10 on the printing tape to form a printed label (described later). The operation terminal 10 is an example of a terminal device, and the label creating device 20 is an example of a printing device.

[0013] As shown in FIGS. 1(a) and 1(b), the operation terminal 10 includes a touch panel 112, operation buttons 110 that allow a user to perform appropriate operations, and a camera 111 that can photograph an object. Although the operation terminal 10 is an example of a smartphone in the drawing, it may be another information terminal that can be connected to the label creating device 20, such as a tablet computer. The touch panel 112 displays various information and allows the user to execute various operations. The operation function part of the touch panel 112 and the operation buttons 110 are collectively referred to as, hereinafter appropriately, "operation unit 110 etc.". The operation unit 110 etc. is an example of an operation unit, and the display function part of the touch panel 112 is an example of a display unit. The camera 111 includes a lens 111A, and is activated when the user operates an operation button 110 or the like, and performs video shooting and still image shooting on the object. The camera 111 is an example of an imaging unit.

[0014] As shown in FIG. 1(c), in addition to the operation button 110, the camera 111, and the touch panel 112, the operation terminal 10 includes a control circuit 102, a memory 106, and a communication control unit 108.

[0015] The control circuit 102 includes a ROM 102A, a RAM 102B, and a CPU 102C. The control circuit 102 executes various programs stored in the ROM 102A while utilizing the temporary storage function of the RAM 102B by the arithmetic function of the CPU 102C. The various programs include a printing processing program for executing the flows of FIGS. 8 and 13 described later. The control circuit 102 is an example of a control unit.

[0016] The communication control unit 108 controls the information communication performed with the label creating device 20. The control circuit 102 can transmit and receive various information and data with the label creating device 20 via the communication control unit 108. The memory 106 is a non-volatile memory such as an EEPROM, and includes a template storage unit 106A and a photo image storage unit 106B. In the photo image storage unit 106B, for example, photo images taken by the camera 111 are stored. In the template storage unit 106A, a plurality of predetermined templates (details will be described later) for creating printed labels using the photo images stored in the photo image storage unit 106B are stored in advance, for example.

[0017] <Label creating device> As shown in FIG. 2, the label creating device 20 includes a cartridge holder 216, a conveyance device 209, a printing head 205, a cutter 207, a display unit 212, an operation unit 210, a communication control unit 208, a control circuit 202, and a memory 206.

[0018] The cartridge holder 216 is configured to allow the attachment and detachment of a cartridge 201 that can supply the printable tape 203. The printable tape 203 is an example of a long printing medium. The transport device 209 transports the tape to be printed 203 that is unwound from the tape roll 204 of the cartridge 201. The print head 205 forms a desired image on the tape to be printed 203 that is transported by the transport device 209. The cutter 207 is driven by the user operating the cut lever 213. The cutter 207 cuts the printed tape 203 after printing has finished by the print head 205, and generates a printed label. The control unit 210 allows the user to perform various operations. The display unit 212 displays various information and messages.

[0019] The control circuit 202 includes a ROM 202A, a RAM 202B, and a CPU 202C. The control circuit 202 executes various programs stored in the ROM 202A, utilizing the temporary storage function of the RAM 202B, using the calculation function of the CPU 202C. The control circuit 202 controls the entire label creation device 20, including the transport device 209 and the print head 205. The communication control unit 208 controls the information communication that takes place between it and the operating terminal 10. The control circuit 202 can send and receive various information and data with the operating terminal 10 via the communication control unit 208. Memory 206 is a non-volatile memory such as EEPROM, and can store various types of information.

[0020] <Template> As described above, in this embodiment, a template is used to create a printed label using a photographic image taken by the camera 111. Figure 3(a) shows the template display screen 112A of the touch panel 112, which represents an example of a template TP stored in the template storage unit 106A. The template display screen 112A is displayed on the touch panel 112 by appropriate operation by the user of the operation unit 110 or the like. As shown in Figure 3(a), the template TP has a roughly rectangular background image 50, and a photograph placement frame 30 and decorative objects 40 placed on the background image 50.

[0021] At least one, and in this example four, photo placement frames 30A to D are provided as photo placement frames 30. Hereafter, the four photo placement frames 30A to D will be collectively referred to as "photo placement frames 30". In this example, when creating a printed label, photographic images are inserted into the roughly square photo placement frames 30 as described below. Multiple photographic images are inserted in a predetermined order, in this example in the order of photo placement frames 30A → 30B → 30C → 30D. Photo placement frames 30A, 30B, 30C, and 30D are marked with the order "1", "2", "3", and "4" corresponding to this order.

[0022] At least one decorative object 40 is provided; in this example, there are 11 decorative objects 40a to k. Hereafter, the 11 decorative objects 40a to k will be collectively referred to as "decorative objects 40". The decorative objects 40 are used to decorate the photographic image by overlapping it with the photographic image placed in the photographic frame 30.

[0023] The decorative objects 40 are positioned in a fixed position relative to the background image 50 and the photo placement frame 30. Decorative objects 40a and 40b, modeled after a frog's face and a glass, respectively, are placed at the top center and bottom left of the first photo placement frame 30A. Decorative objects 40c and 40d, modeled after a champagne bottle and a star, respectively, are placed so as to span the first and second photo placement frames 30A and 30B. Decorative object 40e, modeled after a dog's face, is placed at the bottom center of the second photo placement frame 30B. Decorative object 40f, modeled after a star, is placed at the bottom left of the second photo placement frame 30B. Decorative objects 40g, 40h, and 40i, modeled after a round-glasses mask, a star, and a cracker, respectively, are placed at the center, bottom right, and bottom left of the third photo placement frame 30C. Decorative objects 40j and 40k, which resemble a false beard and a star, respectively, are placed in the lower center and lower left corners of the fourth photo placement frame 30D.

[0024] <Display of decorative objects within the field of view> In this embodiment, when a photograph is taken with the camera 111 to be placed in the photograph placement frame 30 of the template TP, the decorative object 40 can be displayed within the field of view of the camera. For example, the process of taking a photograph to be inserted into the first photograph placement frame 30A is explained by Figures 3(b) to (d). The same process is performed for the other photograph placement frames 30B to D.

[0025] Figure 3(c) shows the main part of the shooting standby screen 112P displayed on the touch panel 112 when the camera 111 captures a person P0, which is the subject. In this example, video is being recorded with the operating terminal 10 in a position where the longitudinal direction of the shooting standby screen 112P is approximately vertical. This position is an example of the first imaging position. In the shooting standby screen 112P, a shooting field of view PV is generated with the vertical direction as the longitudinal direction. The shooting field of view PV is an example of the first predetermined field of view. In Figure 3(c), the state before the decorative object 40 of the template TP, which will be described later, is composited and displayed is shown for convenience.

[0026] Figure 3(b) shows the positional and size relationship between the photograph placement frame 30A and the field of view PV in Figure 3(c). The photograph placement frame 30A is approximately square and is represented by a dashed rectangle U in Figure 3(b). The field of view PV is a vertically elongated rectangle and is represented by a dashed rectangle V in Figures 3(c) and 3(b).

[0027] For example, when the video recording button 112b labeled "Take photos using this template" on the template display screen 112A in Figure 3(a) is operated, the system transitions to the shooting standby screen 112P in Figure 3(d). On the shooting standby screen 112P, the portion of the person P0 in the shooting field of view PV in Figure 3(c) corresponding to the inside of the rectangular frame U is displayed in a cropped form. Furthermore, on the shooting standby screen 112P in Figure 3(d), the portions of the decorative objects 40a to 40d related to the photo placement frame 30A in Figure 3(b) corresponding to the inside of the rectangular frame U are cropped and superimposed on the person P0.

[0028] As can be seen by comparing Figure 3(c) and Figure 3(b), regions representing the difference between the rectangular frame V and the rectangular frame U are created at both the upper and lower ends of the shooting field of view PV. As shown in Figure 3(d), these two regions are displayed as gray zones G1 and G2 above and below the rectangular frame U in the shooting standby screen 112P. In the shooting standby screen 112P, the inside of the rectangular frame U corresponding to the photo placement frame 30 is displayed more clearly than the gray zones G1 and G2 outside it. In other words, gray zones G1 and G2 are displayed in a more obscured manner compared to the inside of the rectangular frame U. The obscuration is not limited to this graying method; other forms are acceptable as long as they are less conspicuous than the inside of the rectangular frame U. The inside of the rectangular frame U in Figure 3(d) is an example of the first size region, and is also an example of the size region. Gray zones G1 and G2 are an example of the first outer frame region, and are also examples of the outer frame region.

[0029] <Automatic still image capture> In this embodiment, the process of photographing a person P0 and displaying decorative objects 40 superimposed on it, as described above using Figure 3(d), is performed automatically for the number of photo placement frames 30. This automatic photography process will be explained with reference to Figures 4(a) to (h).

[0030] For example, when the "Start" button 112a located at the bottom of the shooting standby screen 112P shown in Figure 3(d) is pressed, the system transitions to the automatic shooting screen 112Q0 shown in Figure 4(a). In this embodiment, at predetermined intervals, for example every 5 seconds, the content of the portion of the field of view PV that is being filmed at that time, corresponding to the inside of the rectangular frame U, is automatically saved as a still image. In other words, the camera shutter is released. The automatic shooting screen 112Q0 in Figure 4(a) has the same display content as the shooting standby screen 112P in Figure 3(d), and as mentioned above, the portion of the decorative objects 40a to 40d related to the photo placement frame 30A that is inside the rectangular frame U (some are not shown) is displayed overlapping the person P0.

[0031] The lower gray zone G2 is provided with five circular color timers™, each representing one second elapsed. The color timers™ are initially white, and after transitioning to the automatic shooting screen 112Q0, they change from white to gray out sequentially, starting from the rightmost color timer™, every second elapsed. Below the lower gray zone G2 on the automatic shooting screen 112Q0 is a still image thumbnail display area 112c that displays thumbnails of captured still images. The same applies to the automatic shooting screens 112Q1 to 112Q3 described later.

[0032] After transitioning to the automatic shooting screen 112Q0, if 5 seconds have elapsed and a still image of person P0 is retained, the photographic image is stored in the photographic image storage unit 106B. As shown in Figure 4(e), the stored photographic image includes only the image of person P0 and does not include the corresponding decorative objects 40a to d. After storage, the corresponding thumbnail is displayed in the still image thumbnail display area 112c.

[0033] As described above, once 5 seconds have elapsed and the photographic image of person P0 corresponding to the photo placement frame 30A has been stored, the system transitions to the automatic shooting screen 112Q1 shown in Figure 4(b). In the automatic shooting screen 112Q1, using the same method as described above, the portion of the decorative objects 40c, 40e, and 40f related to the photo placement frame 30B that is inside the rectangular frame U is displayed overlapping person P1. In this example, person P1 is the same person as person P0, but is shown with a different expression or pose in front of the camera 111. After 5 seconds have elapsed since transitioning to the automatic shooting screen 112Q1, the still image of person P1 is retained, and the photographic image shown in Figure 4(f) is stored in the photographic image storage unit 106B, and the corresponding thumbnail is added to the still image thumbnail display area 112c and displayed. After that, the system transitions to the automatic shooting screen 112Q2 shown in Figure 4(c).

[0034] In the automatic shooting screen 112Q2 shown in Figure 4(c), as described above, the portion of the decorative objects 40g, 40h, and 40i related to the photo placement frame 30C that is inside the square frame U is displayed overlapping the person P2. The person P2 shown is the same person as person P0 and P1, but with a different expression or pose. After 5 seconds have elapsed since transitioning to the automatic shooting screen 112Q2, the still image of person P2 is retained, the photographic image shown in Figure 4(g) is stored in the photographic image storage unit 106B, and a thumbnail is added to the still image thumbnail display area 112c and displayed. After that, the system transitions to the automatic shooting screen 112Q3 shown in Figure 4(d).

[0035] In the automatic shooting screen 112Q3 shown in Figure 4(d), as described above, the portion of the decorative objects 40k and 40j related to the photo placement frame 30D that is inside the square frame U is displayed overlapping the person P3. The person P3 shown is the same person as persons P0, P1, and P2, but with a different expression or pose. After 5 seconds have elapsed since transitioning to the automatic shooting screen 112Q3, the still image of person P3 is retained, the photographic image shown in Figure 4(h) is stored in the photographic image storage unit 106B, and a thumbnail is added to the still image thumbnail display area 112c and displayed. Hereafter, persons P0, P1, P2, etc. will be collectively referred to simply as "person P". The automatic shooting screens 112Q0 to Q3 will be collectively referred to as "automatic shooting screen 112Q" as appropriate below. Automatic shooting screen 112Q and the aforementioned shooting standby screen 112P are examples of shooting screens.

[0036] <Display template with photo> Once the shooting and recording of still images for all photo placement frames 30 are completed as described above, the photo template display screen 112R shown in Figure 5 is displayed on the touch panel 112. On the photo template display screen 112R, the photographic images of the people P0, P1, P2, and P3, as described above, are inserted and displayed in the respective photo placement frames 30A, 30B, 30C, and 30D of the template TP shown in Figure 3(a).

[0037] In this embodiment, the photographic image stored in the photographic image storage unit 106B can be processed into multiple processing modes by the CPU 102C using known methods. A processing image display field 112d is provided at the bottom of the photo template display screen 112R. The processing image display field 112d displays a list of processed thumbnail images showing the appearance of the photographic image inserted into the photo placement frame 30, which has been specified at that time by operation of the operation unit 110, etc., after each of the above multiple processing modes has been applied. When the user selects one of these displayed items through appropriate operation via the operation unit 110, etc. (see "✓" in the figure), the photographic image in the specified photo placement frame 30 is processed in the selected mode.

[0038] <Print preparation screen> In the photo template display screen 112R of Figure 5, after the photo images in all photo placement frames 30 have been processed as described above, the "Next" button 112e at the bottom is operated to proceed to the print preparation screen 112S shown in Figure 6. The print preparation screen 112S is equipped with an information display area 112f that shows the model information of the label creation device 20 that will perform the printing and various print setting information, and a preview display area 112g. In the preview display area 112g, the print content of the printed label, which reflects all of the shooting and various operations described above, is displayed as a label image LI. The label image LI represents the appearance of the printed label, with decorations by corresponding decorative objects 40a to 40k applied to each of the photo images of people P0, P1, P2, and P3, similar to the display content of the photo template display screen 112R of Figure 5.

[0039] <Appearance of printed label> When the "Print" button 112h located at the top of the print preparation screen 112S shown in Figure 6 is operated, print data including various images corresponding to the label image LI is sent to the label creation device 20, and the corresponding printed label L is generated. An example of the appearance of the generated printed label L is shown in Figure 7.

[0040] As shown in Figure 7, in the printed label L, according to the content described above, the photographic images Ph0, Ph1, Ph2, and Ph3 of the people P0, P1, P2, and P3 are formed at positions corresponding to the four photo placement frames 30A to D of the template TP described above. Similar to the arrangement in template TP, decorative objects 40a and 40b are formed on the upper center and lower left sides of the first photographic image Ph0, respectively. Decorative objects 40c and 40d are formed to span the first and second photographic images Ph1 and Ph2, respectively. Decorative objects 40e and 40f are provided on the lower center and lower left sides of the second photographic image Ph1, respectively. Decorative objects 40g, 40h, and 40i are provided in the center, lower right, and lower left sides of the third photographic image Ph2, respectively. Decorative objects 40j and 40k are provided in the lower center and lower left sides of the fourth photographic image Ph3, respectively.

[0041] <Control Procedure> To implement the method described above, the control procedure executed by the control circuit 102 of the operation terminal 10 based on the printing processing program of this embodiment will be explained by the flowchart in Figure 8. The printing processing method of this embodiment is executed by following this flowchart.

[0042] In S5, an appropriate screen for accepting the selection of an image for the template TP based on the user's operation via the operation unit 110 is displayed on the touch panel 112, and the user's selection via the operation unit 110 is accepted. S5 is an example of a selection acceptance step.

[0043] In S10, the template TP selected and accepted in S5 is read from the template storage unit 106A and displayed on the template display screen 112A, and analysis of the template TP is performed. Through this analysis, the photo placement frame 30 and decorative objects 40 included in the template TP are detected. The detection method at this time is explained with reference to Figure 9.

[0044] Figure 9 shows an example of the data structure of the template TP shown in Figure 3(a). The data of the template TP consists of array information of objects, for example, as schematically shown in Figure 9. In this example, the array information includes data A corresponding to the background image 50, data B1, B2, B3, ... corresponding to the photo placement frame 30, and data C1, C2, C3, ... corresponding to the decorative object 40. Hereafter, data B1, B2, B3, ... will be collectively referred to simply as "data B," and data C1, C2, C3, ... will be collectively referred to simply as "data C."

[0045] Data A, B, and C each contain type information representing the type of the corresponding image, and file information representing the file name of the corresponding image. In addition to the above, Data B and C also contain attribute information representing the attributes of the corresponding image, and size information and position information representing the size and position coordinates of the corresponding image, respectively.

[0046] Data A includes type information of "background" indicating that it is a background, and file information of "pattern 1" representing the configuration of the background image 50, which in this example is the grid pattern shown in Figure 3(a), etc.

[0047] Data B1 includes type information "image" indicating that it is a normal image, and file information "image" representing the form of the photo placement frame 30, in this example representing the gray approximate square shown in Figure 3(a), etc. Data B includes attribute information "Photobooth" indicating that it is a photo placement frame, size information "width:xx1,height:yy1" indicating the size, and position information "x1,y1" indicating the position coordinates. Although not explained here, data B2 and data B3 have a similar data structure.

[0048] Data C1 includes type information "image" indicating that it is a normal image, and file information "frog" representing the form of the decorative object 40a, in this example the shape of a frog as shown in Figure 3(a), etc. Data C1 also includes attribute information "Decoration" indicating that it is a decorative object, size information "width:xx2,height:yy2" indicating its size, and position information "x2,y2" indicating its position coordinates. I will omit the explanation, but data B2 and data B3 have a similar data structure.

[0049] Data C4 includes type information "image" indicating that it is a normal image, and file information "star" representing the form of the decorative object 40d, in this example the star-like shape shown in Figure 3(a), etc. Data C4 also includes attribute information "Decoration" indicating that it is a decorative object, size information "width:xx3,height:yy3" indicating its size, and position information "x3,y3" indicating its position coordinates.

[0050] Returning to Figure 8, in S10, based on the data structure of the template T described above, the photo placement frame 30 with attribute information "photobooth" and the decorative object 40 with attribute information "decoration" are extracted, or detected. S10 is an example of an analysis and extraction step.

[0051] In S15, size and position information for each photo placement frame 30 detected by the analysis in S10 is acquired, and in S20, size and position information for each decorative object 40 detected by the analysis in S10 is acquired. This acquired information is stored, for example, in RAM 102B.

[0052] When the video recording button 112b on the template display screen 112A is operated, the system switches to the shooting standby screen 112P in S25, and the size and position of the field of view PV captured by the camera 111 are acquired. Then, in S30, the camera 111 starts recording video of the subject, and in the example above, an image of the person P is acquired. In S40, the orientation of the operating terminal 10 during shooting by the camera 111 is acquired. In the example above, it is acquired that the first imaging orientation is such that the longitudinal direction of the shooting standby screen 112P is approximately vertical.

[0053] In S45, the size of the photo placement frame 30 stored in S15 is obtained, and in S50, the position of the photo placement frame 30 stored in S15 is obtained. In S55, based on the results obtained in S45 and S50, the positions of the upper and lower gray zones G1 and G2, which are the difference between the shooting field of view PV and the photo placement frame 30, in other words, the difference between the square frame V and the square frame U as explained in Figure 3(d), are identified.

[0054] In S60, based on the acquisition results from S45 to S55, the shape of the rectangular frame U corresponding to the photo placement frame 30 to be processed at this point is reflected in the shooting field of view PV. In other words, the area outside the rectangular frame U in the shooting field of view PV is displayed as gray zones G1 and G2. The appearance image of the subject acquired from S30 onwards is cropped to fit the shape of the rectangular frame U and displayed.

[0055] In S65, based on the memory result from S20, all decorative objects 40 corresponding to the photo placement frame 30 to be processed are reflected and displayed within the shape display of the rectangular frame U of the shooting field PV by S60 (see shooting standby screen 112P in Figure 3(d)). S65 is an example of a composite display step. In S67, the "Start" button 112a on the shooting standby screen 112P is pressed, triggering a transition to the automatic shooting screen 112Q. The color timer™ then begins displaying a countdown for a predetermined time, which in the above example is 5 seconds. Note that this process in S67 may also be performed after S30.

[0056] In S70, it is determined whether the imaging orientation of the camera 111 has changed since the acquisition in S40. For example, if the imaging orientation has changed from the first imaging orientation, in which the longitudinal direction of the shooting standby screen 112P is approximately vertical, to the second imaging orientation, in which the longitudinal direction of the shooting standby screen 112P is approximately horizontal, then the determination is "Yes," and the process returns to S40.

[0057] If the imaging posture has not changed, S70 is determined to be No, and it is determined whether a predetermined time has elapsed since the countdown started in S67, which in the above example was 5 seconds (S75). If the predetermined time has elapsed, it is determined to be Yes, and a still image is retained based on the video recording content of the camera 111 at this point (S80). In other words, the shutter is released and a photograph is taken. As mentioned above, the retained still image is the approximately square portion of the shooting field PV corresponding to the shape of the square frame U, and in S85 it is stored as a photographic image in the photographic image storage unit 106B.

[0058] In S90, it is determined whether processing has been completed for all photo placement frames 30 related to the template TP selected in S5 and analyzed in S10. Until processing of all photo placement frames 30 is complete, S90 is determined to be No, and the process returns to S40, with steps S40 to S85 being repeated, and photography corresponding to each photo placement frame 30 continues while the decorative object 40 is displayed in the shooting field PV (see Figures 4(a) to (d) and 4(e) to (h)).

[0059] Once processing of all photo placement frames 30 is complete, S90 is determined to be Yes and the process proceeds to S95, where a photo template display screen 112R is displayed, which includes a template TP with the corresponding photo images inserted and placed in all photo placement frames 30 (see Figure 5). In S100, processing of the photo images inserted and placed in each photo placement frame 30 is accepted through appropriate operations by the user via the operation unit 110, etc.

[0060] By pressing the "Next" button 112e on the photo template display screen 112R, the user moves to the print preparation screen 112S (see Figure 6). By pressing the "Print" button 112h on the print preparation screen 112S, print data including the image reflecting the processing up to S100 is sent to the label creation device 20 (S105), and the corresponding printable label L is created (see Figure 7).

[0061] <Effects of the Embodiment> As described above, when the printing processing program of this embodiment is executed in the control circuit 102 of the operation terminal 10, steps S5, S10, and S65 are performed. When a user selects a desired template TP via the operation unit 110, etc., the selection is accepted in S5. The template TP includes a photo placement frame 30, decorative objects 40 placed inside or near the photo placement frame 30, and a background image 50. Analysis is performed on the selected template TP in S10, and the decorative objects 40 included in the template TP are extracted. The extracted decorative object 40 is composited in S65 into the shooting standby screen 112P of the shooting field PV captured by the camera 111 and displayed on the touch panel 112.

[0062] As described above, in this embodiment, by performing an analysis on the template TP and extracting the decorative objects 40, the decorative objects 40 included in the template TP can be easily composited into the screen. According to this embodiment, unlike when the template TP and the decorative objects 40 are held separately, it is sufficient to manage them as a single entity as the template TP including the decorative objects 40. According to this embodiment, the decorative objects 40 can be composited into the captured screen without significantly increasing the information management burden.

[0063] Furthermore, in this embodiment, in particular at S65, the portion of the shooting field of view PV in the shooting standby screen 112P displayed on the touch panel 112 that corresponds to the rectangular frame U corresponding to the photo placement frame 30 of the template TP is displayed more clearly than the other gray zones G1 and G2. According to this embodiment, a user viewing the shooting standby screen 112P can clearly recognize the region within the shooting field of view PV that will be assigned to the template TP.

[0064] Furthermore, in this embodiment, the camera 111 of the operating terminal 10 can adopt a first imaging posture in which the longitudinal direction of the shooting screen is approximately vertical. In the first imaging posture, the camera 111 generates a first imaging field PV with the vertical direction as its longitudinal direction (see Figure 3(c)). In S65, in this vertically elongated first imaging field PV, the portion corresponding to the rectangular frame U that corresponds to the above-mentioned photograph arrangement frame 30 is displayed more clearly than the two gray zones G1 and G2 located at both ends in the vertical direction. According to this embodiment, in the first imaging posture, the user viewing the shooting screen can clearly recognize the area within the rectangular frame U, which is the portion of the vertically elongated first shooting field of view PV that will be assigned to the template TP, more clearly than the gray zones G1 and G2 above and below it.

[0065] Furthermore, in this embodiment, in particular, in the first imaging posture described above, in S65, the gray zones G1 and G2 located at both the vertical ends of the vertically elongated first imaging field PV are displayed more obscured than the area within the rectangular frame U located in the center of the vertical direction. According to this embodiment, in the first imaging posture, the gray zones G1 and G2, which are not assigned to the template TP within the vertically elongated first imaging field PV, can be made less noticeable.

[0066] Furthermore, in this embodiment, in particular, in S10, the decorative object 40 is extracted from the template TP while the background image 50 is not extracted, and in S65, the decorative object 40 is composited in the shooting standby screen 112P and the automatic shooting screen 112Q while the background image 50 is not composited. According to this embodiment, the processing load of the control circuit 102 in S10 and S65 can be reduced.

[0067] <Variation> It should be noted that the present invention is not limited to the embodiments described above, and various modifications are possible without departing from its spirit and technical concept. Such modifications will be described in order below.

[0068] (1) When taking a picture with the operating terminal held horizontally In the above embodiment, video was recorded with the operating terminal 10 in a position where the longitudinal direction of the screen during shooting was approximately vertical. However, video may also be recorded with the operating terminal 10 in a position where the longitudinal direction of the screen during shooting is approximately vertical. Such modifications will be explained with reference to Figure 10.

[0069] Figure 10(a) corresponds to Figure 3(b) above, and as described above, the photo placement frame 30A is approximately square, and its outline is represented by a dashed rectangular frame U. Figure 10(b) corresponds to Figure 3(c) above, and shows the main part of the shooting standby screen 112P when photographing a person P0. In this example, video is being shot with the operating terminal 10 in a position where the longitudinal direction of the shooting standby screen 112P is approximately horizontal. This position is an example of the second imaging position. The shooting field of view PV at this time is a horizontally elongated approximately rectangle, and its outline is represented by a dashed rectangular frame V in Figures 10(a) to (c). This shooting field of view PV is an example of the second predetermined field of view.

[0070] As described above, in this modified example, for example, when the video recording button 112b labeled "Take photos using this template" on the template display screen 112A in Figure 3(a) is operated, the system transitions to the shooting standby screen 112P in Figure 10(c). On the shooting standby screen 112P, the portion of the person P0 in the shooting field of view PV in Figure 10(b) corresponding to the inside of the rectangular frame U is displayed in a cropped form. Furthermore, on the shooting standby screen 112P in Figure 10(c), the portions of the decorative objects 40a to 40d related to the photo placement frame 30A in Figure 10(a) corresponding to the inside of the rectangular frame U are cropped and superimposed on the person P0, and displayed.

[0071] Similar to the embodiment described above, as can be seen by comparing Figure 10(b) and Figure 10(a), regions representing the difference between the rectangular frame V and the rectangular frame U are created at both the left and right ends of the shooting field of view PV. As shown in Figure 10(c), in this modified example, these two regions are displayed as gray zones G1 and G2 on the left and right sides of the rectangular frame U, respectively, in the shooting standby screen 112P. Similar to the above embodiment, in the shooting standby screen 112P, the inside of the rectangular frame U corresponding to the photo placement frame 30 is displayed more clearly than the gray zones G1 and G2, while the gray zones G1 and G2 are displayed more obscured compared to the inside of the rectangular frame U. The area inside the rectangular frame U in Figure 10(c) is an example of the second size region, and also an example of the size region. The gray zones G1 and G2 are examples of the second outer frame region, and also examples of the outer frame region.

[0072] In this modified example, the same effects as those of the above embodiment are obtained. Furthermore, in this modified example, the camera 111 of the operating terminal 10 can adopt a second imaging posture in which the longitudinal direction of the shooting screen is approximately horizontal. In the second imaging posture, the camera 111 generates a second shooting field of view PV with the left-right direction as the longitudinal direction (see Figure 10(b)). As a result, in S65 of Figure 8, in the horizontally elongated second shooting field of view PV, the area corresponding to the rectangular frame U that corresponds to the above-mentioned photo placement frame 30 is displayed more clearly than the two gray zones G1 and G2 located at both ends in the left-right direction. According to this modified example, in the second imaging posture, the user viewing the shooting screen can clearly recognize the area corresponding to the rectangular frame U, which is the part of the horizontally elongated second shooting field of view PV that will be assigned to the template TP, more clearly than the gray zones G1 and G2 on its left and right sides.

[0073] Furthermore, in this modified example, in the case of the second imaging posture described above, at S65, the gray zones G1 and G2 located at both ends in the left-right direction of the horizontally elongated second imaging field PV are displayed more obscured than the area within the rectangular frame U located in the center in the left-right direction. According to this modified example, in the case of the second imaging posture, the gray zones G1 and G2 of the horizontally elongated second imaging field PV that are not assigned to the template TP can be made less conspicuous.

[0074] (2) When it is possible to replace decorative objects or photos on the template. In this modified example, with the photo template display screen 112R of Figure 5 displayed on the touch panel 112, the user can swap decorative objects or photographic images by operating via the user's control unit 110 or the like.

[0075] For example, in the example shown in Figure 11, the decorative objects 40e and 40j located in the photo placement frames 30B and 30D of the template TP in Figure 11(a), which has the same arrangement as in Figure 5, are swapped to form the template TP in Figure 11(b).

[0076] For example, in the example shown in Figure 12, the photographic images of people P0 and P3 placed in photo placement frames 30A and 30D of template TP in Figure 12(a), which has the same arrangement as in Figure 5, are swapped to form template TP in Figure 12(b).

[0077] In this modified example, the control procedure executed by the control circuit 102 of the operating terminal 10 is shown in the flowchart of Figure 13, which corresponds to Figure 8. In Figure 13, steps S101 to S104 are newly added between S100 and S105 in the flowchart of Figure 8.

[0078] In S101, it is determined whether or not an appropriate replacement operation of decorative objects 40 has been performed via the operation unit 110, etc., in the template TP in which photographic images have been inserted and placed in all photographic placement frames 30 in S95. If no replacement operation has been performed, it is determined to be No and proceeds to S103 described below. If a replacement operation has been performed, it is determined to be Yes and the replacement of the corresponding decorative object 40 is performed (S102), and proceeds to S103.

[0079] In S103, it is determined whether or not a photo image replacement operation has been performed in the template TP via the operation unit 110, etc. If no replacement operation has been performed, it is determined to be No and proceeds to S105. If a replacement operation has been performed, it is determined to be Yes and the replacement of the corresponding photo image is performed (S104), and then proceeds to S105.

[0080] In this modified example, as shown in Figure 5, after the template display screen 112R with a photograph is displayed, the user can replace the decorative object 40 or photographic image within the template TP as desired. Therefore, user convenience can be further improved.

[0081] (3) Others In the above, the arrows shown in Figures 1(c), 2, etc., represent just one example of signal flow and do not limit the direction of signal flow.

[0082] Furthermore, the flowcharts shown in Figures 8 and 13 do not limit the present invention to the procedures shown in the flowcharts above, and additional or deleted procedures or changes in order are permitted without departing from the spirit and technical idea of ​​the invention.

[0083] In addition to what has already been described above, the methods described in the above embodiments and their respective modifications may be used in appropriate combinations.

[0084] Furthermore, although not to be exemplified individually, the present invention may be implemented with various modifications without departing from its spirit. [Explanation of Symbols]

[0085] 10. Operating terminal (an example of a terminal device) 20. Label creation device (an example of a printing device) 102 Control circuit (an example of a control unit) 110 Operation buttons (example of control panel) 111 Camera (Example of an imaging unit) 112 Touch panel (an example of an operation unit and display unit) 112P Shooting standby screen (Example of a shooting screen) 112Q Automatic shooting screen (Example of a shooting screen) 203 Printed tape (an example of a printing medium) G1,2 Gray Zone (Examples of areas outside the first gate, second gate, and areas outside the gate) L Printed Label PV imaging field of view (examples of the first and second designated fields of view) TP Template

Claims

1. A terminal device connected to a printing device that prints on a long print medium, the terminal device having a control unit, an operation unit, an imaging unit, and a display unit, the control unit of the terminal device being: a selection receiving step of receiving, via the operation unit, a selection of a desired template including at least one photo layout frame, at least one decorative object to be placed inside or near the photo layout frame, and a background image; an analysis and extraction step of analyzing the template whose selection has been accepted in the selection accepting step and extracting the decorative object included in the template; a composite display step of compositing the decorative object extracted in the analyzing and extracting step into a photographed screen of a predetermined field of view captured by the imaging unit and displaying the decorative object on the display unit; A printing processing program for executing the above.

2. In the synthesis and display step, 2. The printing processing program according to claim 1, wherein an area of ​​the predetermined field of view corresponding to the photo layout frame is displayed more clearly than other areas outside the frame of the predetermined field of view on the shooting screen.

3. The imaging unit In a first imaging attitude in which the longitudinal direction of the photographic screen is a substantially vertical direction, a first predetermined field of view is generated in which the vertical direction is the longitudinal direction, and in a second imaging attitude in which the longitudinal direction of the photographic screen is a substantially horizontal direction, a second predetermined field of view is generated in which the horizontal direction is the longitudinal direction, In the synthesis and display step, In the first imaging attitude, a first size area corresponding to the photograph layout frame, excluding two first outer-frame areas located at both ends in the vertical direction of the first predetermined field of view, is displayed more clearly than the first outer-frame area, A printing processing program as described in claim 2, wherein in the second imaging posture, a second size area corresponding to the photo layout frame, excluding two second frame outer areas located at both ends of the second specified field of view in the left and right directions, is displayed more clearly than the second frame outer areas.

4. In the synthesis and display step, 4. The print processing program according to claim 3, wherein the first outer frame area is displayed more hidden than the first size area, or the second outer frame area is displayed more hidden than the second size area.

5. In the analyzing and extracting step, The background image included in the template is not extracted, In the synthesis and display step, 5. The printing processing program according to claim 1, wherein the background image is not synthesized in the photographed screen of the predetermined field of view.

6. A printing processing method executed by a terminal device connected to a printing device that prints on a long print medium, comprising: a selection receiving step of receiving a selection of a desired template including at least one photo layout frame, at least one decorative object to be placed inside or near the photo layout frame, and a background image; an analysis and extraction step of analyzing the template whose selection has been accepted in the selection accepting step and extracting the decorative object included in the template; a synthesis display step of synthesizing and displaying the decorative object extracted in the analysis and extraction step on a photographed screen of a predetermined field of view; A printing processing method comprising:

Images