Cut design adjustment device, cut design adjustment method, and program

Abstract

When displaying cut design information, which virtually represents the finished product to be cut by the cutting device, on a captured image, the system allows the user to intuitively understand the distance between the cut design information and the object to which the finished product will be attached within the captured image. [Solution] The CPU of the terminal device displays a captured image of the real world, including the object to be attached, on the display unit. On the displayed captured image, it displays cut design information, which virtually represents the output obtained by cutting the paper with a cutting device, with the position and size of the cut design information, including the depth direction, adjustable. At the same time, the CPU of the terminal device displays a shadow corresponding to the cut design information on the captured image.

Description

Technical Field

[0001] The present invention relates to a cut design adjustment device, a cut design adjustment method, and a program.

Background Art

[0002] Conventionally, a cutting device that cuts a cut target such as paper has been known. For example, Patent Document 1 describes that a place where a product cut by a cutting device is pasted is photographed, and an image video in a state where a design (cut design information) to be cut is superimposed on the obtained video data is displayed. Further, it is described that the size and arrangement position of the cut design information on the video data can be changed by a predetermined operation by an operator.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the technique described in Patent Document 1, the sense of distance (the sense of distance in the depth direction) between the displayed cut design information and its pasting position is not expressed.

[0005] The present invention has been made in view of such problems, and when displaying cut design information that virtually represents a product cut by a cutting device on a photographed image, the purpose is to enable a user to intuitively grasp the sense of distance between the cut design information and the object to be pasted of the product in the photographed image.

Means for Solving the Problems

[0006] To solve the above problems, the cut design adjustment device of the present invention comprises a display unit that displays a captured image of the real world, and a control unit that displays on the captured image cut design information, which virtually represents the output obtained by cutting the medium to be cut by the cutting device, so as to be able to adjust the position and size of the cut design information, including the depth direction, and the control unit displays a shadow corresponding to the cut design information on the captured image. [Effects of the Invention]

[0007] According to the present invention, when displaying cut design information, which virtually represents the finished product to be cut by the cutting device, on a captured image, the user can intuitively grasp the sense of distance between the cut design information and the object to which the finished product will be attached within the captured image. [Brief explanation of the drawing]

[0008] [Figure 1] This is a diagram of a cutting system according to an embodiment of the present invention. [Figure 2] This is a block diagram showing the functional configuration of a cutting device. [Figure 3] This is a perspective view showing a mounting platform on which a cardboard base with paper attached is placed. [Figure 4] This is a block diagram showing the functional configuration of terminal devices. [Figure 5] This is a flowchart showing the process of adjusting the cut design. [Figure 6] This figure shows an example of the adjustment screen. [Figure 7] (a) is a perspective view showing that the displayed cut design information is located away from the object to be pasted in the captured image, and (b) is a diagram showing the shadow that appears when the object to be pasted shown in (a) is photographed from above and the cut design information is far from the object to be pasted in the captured image. [Figure 8](a) is a perspective view showing that the cut design information is located closer to the object to be pasted in the captured image than in Figure 7, and (b) is a diagram showing the shading that appears when the object to be pasted shown in (a) is photographed from above, and the cut design information is closer to the object to be pasted in the captured image than in Figure 7. [Figure 9] (a) is a perspective view showing how the position of the cut design information in the depth direction coincides with the surface of the object to be pasted in the captured image, and (b) is a diagram showing the shading that appears when the object to be pasted shown in (a) is photographed from above and the position of the cut design information in the depth direction coincides with the surface of the object to be pasted in the captured image. [Figure 10] This figure shows an example of cut design information and shading display when there are multiple potential objects to be pasted into within a captured image, each with a different position (height) in the depth direction. [Figure 11] This figure shows an example of adjusting the position and size of cut design information through cut design adjustment processing. [Figure 12] This figure shows an example of adjusting the position and size of cut design information through cut design adjustment processing. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described in detail below with reference to the drawings. However, the scope of the present invention is not limited to the illustrated examples.

[0010] As shown in Figure 1, the cutting system 1 of this embodiment comprises a cutting device 10 and a terminal device 50. The cutting device 10 is a device that cuts a rectangular or other planar medium to be cut, which is attached to a base sheet 32 ​​(described later) placed on a mounting table 31 (described later), into any planar shape. In this embodiment, an example in which paper 60 (see Figure 3), such as A5 paper, is used as the medium to be cut is described, but it is not limited to this. Other media that can be cut with a cutter blade may also be used as the medium to be cut, such as sheets of resin, stickers, or leather.

[0011] The terminal device (cut design adjustment device) 50 is a PC (Personal Computer) that communicates with the cutting device 10 via wireless communication. The terminal device 50 receives input of operation information related to the cutting device 10, displays display information related to the cutting device 10, generates cut data to cause the cutting device 10 to perform the cut according to the input operation information, and transmits it to the cutting device 10.

[0012] The terminal device 50 connected to the cutting device 10 is not limited to a PC, but may be a smartphone, tablet PC, AR (augmented reality) goggles, or other terminal device. The wireless communication method between the cutting device 10 and the terminal device 50 shall be Bluetooth®. However, the wireless communication method is not limited to Bluetooth, and may be a Wi-Fi® or other communication method. The communication connection between the cutting device 10 and the terminal device 50 is not limited to wireless communication, but may be wired communication. Wired communication may be, for example, USB (Universal Serial Bus) wired communication via a communication cable.

[0013] As shown in Figure 2, the cutting device 10 includes an MPU (Micro Processor Unit) 11, an operation unit 12, a storage unit 13, an indicator unit 14, a wired communication unit 15, a wireless communication unit 16, a cutting unit 17, an origin position detection unit 18, a paper feeding unit 19, and a paper feeding detection unit 20. Each part of the cutting device 10 is connected via a bus 21.

[0014] The MPU 11 controls each part of the cutting device 10. The MPU 11 has a CPU (Central Processing Unit) and a RAM (Random Access Memory). The CPU reads out a specified program from various programs stored in the storage unit 13, expands it in the RAM, and executes various processes in cooperation with the expanded program. The RAM is a volatile semiconductor memory, and a work area for temporarily storing various data and programs is formed. The operation unit 12 has various buttons, accepts pressing inputs to each button from the user, and outputs the operation information to the MPU 11. The various buttons of the operation unit 12 include position keys for moving the position of the paper 60, a temporary stop button for cutting, a set button for the paper 60, a take-out button for the paper 60, and the like.

[0015] The storage unit 13 is a storage unit capable of reading and writing information such as a flash memory. The storage unit 13 stores various data such as cutting data and various programs.

[0016] The indicator unit 14 has a light-emitting part such as an LED (Light Emitting Diode), and indicates various states of the cutting device 10 by lighting / extinguishing. The indicator unit 14 has, for example, a power lamp indicating power on / off. The indicator unit 14 turns on / off the light emission of the light-emitting part according to an instruction from the MPU 11.

[0017] The wired communication unit 15 is an interface for wired communication of a communication standard such as USB. The MPU 11 transmits and receives information to and from an external device such as the terminal device 50 via the wired communication unit 15 and a communication cable. The wireless communication unit 16 has an antenna, a modulation / demodulation circuit, a signal processing circuit, etc., and is an interface for wireless communication of Bluetooth with an external device such as the terminal device 50. The MPU 11 transmits and receives information to and from an external device such as the terminal device 50 via the wireless communication unit 16.

[0018] The cutting unit 17 includes an X-axis motor 171, a Z-axis motor 172, a carriage 173, and a cutter blade 174. The cutting unit 17 moves the cutter blade 174 mounted on the carriage 173 in the X-axis and Z-axis directions by the X-axis motor 171 and Z-axis motor 172, according to instructions from the MPU 11. The cutting unit 17 cuts the paper 60 attached to the base 32 placed on the mounting table 31 into any planar shape by moving the cutter blade 174. The cutter blade 174 is mounted on the carriage 173 in a state where its axis (drive axis) 174c is rotatable around the axis. In other words, the cutter blade 174 is designed so that the blade faces in the cutting direction when the paper (medium to be cut) 60 is cut. To orient the blade in the cutting direction, the carriage 173 and / or paper feed unit 19 are driven while the tip (edge) of the cutter blade 174 is slightly touching the paper 60, thereby allowing the blade to be oriented in the desired direction. Now, referring to Figure 3, the paper 60 attached to the base sheet 32 ​​placed on the mounting table 31, and the X, Y, and Z axes will be explained.

[0019] The backing sheet 32 ​​is used for purposes such as preventing the cutter blade 174 from damaging the mounting table 31 and ensuring that the paper 60 is placed in the correct position. The backing sheet 32 ​​has a rectangular shape in planar form. Since the backing sheet 32 ​​is placed on the mounting table 31, it has a shape that fits within the planar shape of the mounting table 31. The backing sheet 32 ​​is made of a soft material so as not to damage the cutter blade 174 when cutting the paper 60, and has an adhesive applied to its upper surface for attaching the paper 60. The mounting table 31 is on which the backing sheet 32 ​​with the paper 60 attached is placed. The X-axis is taken as the main scanning direction when transporting the mounting table 31 (backing sheet 32, paper 60). The Y-axis is perpendicular to the X-axis and is taken as the transport direction (paper feeding direction, sub-scanning direction) of the mounting table 31 (backing sheet 32, paper 60). The Z-axis is perpendicular to the XY plane and is taken as the direction in which the cutter blade 174 moves up and down relative to the paper 60.

[0020] Returning to Figure 2, the X-axis motor 171 is a motor that drives the carriage 173 in the X-axis direction according to the instructions of the MPU 11. The Z-axis motor 172 is a motor that drives the cutter blade 174 in the Z-axis direction according to the instructions of the MPU 11. The carriage 173 is a movable part in the X-axis direction on which the cutter blade 174 is mounted. The cutter blade 174 is a blade made of a conductive material such as metal for cutting paper 60, with a cutting edge that is, for example, angled at its tip.

[0021] The origin position detection unit 18 is a position detection unit, such as an optical sensor, that detects whether or not the cutter blade 174 is at the origin position in the X-axis direction, according to instructions from the MPU 11. The origin position detection unit 18 outputs the detection result of whether or not the cutter blade 174 is at the origin position to the MPU 11. The MPU 11 uses the detection result of whether or not the cutter blade 174 is at the origin position to control the position of the cutter blade 174 in the X-axis direction of the cutting unit 17.

[0022] The paper feeding unit 19 has a Y-axis motor 191. The paper feeding unit 19 is a transport unit that, in accordance with instructions from the MPU 11, transports the mounting table 31 on which the backing sheet 32 ​​with the paper 60 attached is placed in the Y-axis direction by driving the Y-axis motor 191. The paper feeding detection unit 20 is a detection unit, such as an optical sensor, that, in accordance with instructions from the MPU 11, detects whether or not the mounting table 31 on which the backing sheet 32 ​​with the paper 60 attached is placed has been fed (set) into the paper feeding opening of the paper feeding unit 19. The paper feeding detection unit 20 outputs the detection result of the paper 60 being set to the MPU 11.

[0023] As shown in Figure 4, the terminal device 50 comprises a CPU 51, RAM 52, storage unit 53, display unit 54, operation unit 55, communication unit 56, and imaging unit 57. Each part of the terminal device 50 is connected via a bus 58.

[0024] The CPU 51, acting as the control unit, is a processor that controls the operation of each part of the terminal device 50 by reading and executing the program 531 stored in the memory unit 53 and performing various arithmetic operations. The RAM 52 provides the CPU 51 with a working memory space and stores temporary data. The memory unit 53 is a non-temporary recording medium readable by the CPU 51 as a computer, and stores the program 531 and various data (e.g., cut data). The program 531 includes a program for executing the cut design adjustment process described later.

[0025] The display unit 54 consists of an LCD (Liquid Crystal Display), an EL (Electro Luminescence) display, etc., and displays various information according to the display information instructed by the CPU 51.

[0026] The operation unit 55 has a key input unit such as a keyboard and a pointing device such as a mouse, and receives key operation input and position operation input from the user, and outputs the operation information to the CPU 51. The CPU 51 accepts the user's input operation based on the information transmitted from the operation unit 55.

[0027] The communication unit 56 may be, for example, a communication unit that employs a wireless standard such as Bluetooth, or a wired communication unit such as a USB terminal.

[0028] The imaging unit 57 captures the real-world shooting range and generates two-dimensional (2D) image data of the shooting range, as well as depth image data that includes depth information of the shooting range. In this embodiment, the imaging unit 57 continuously captures (records video) the shooting range at a predetermined frame rate. The imaging unit 57 outputs the generated image data (image data and depth image data) to the CPU 51.

[0029] Next, the operation of the cutting system 1 will be described. When the CPU 51 of the terminal device 50 is instructed by the operation unit 55 to execute the cut design adjustment process, it works in cooperation with the program 531 to execute the cut design adjustment process shown in Figure 5. The cut design adjustment process is a process in which the terminal device 50 adjusts the shape and size of the cut design according to the user operation and causes the cutting device 10 to cut the paper 60.

[0030] In the cut design adjustment process, the CPU 51 first displays a list of cut designs (not shown) on the display unit 54 and accepts the selection of a cut design by the operation of the operation unit 55 (step S1). The cut design is the design (shape) when cutting the paper 60, which is the medium to be cut. The cut design may be one that is pre-set and stored in the storage unit 53, or it may be one that the user has created and stored in the storage unit 53.

[0031] Next, the CPU 51 causes the shooting unit 57 to take a picture of the area including the object 70 to be attached, which is obtained by cutting the paper 60 with the cutting device 10, and acquires a captured image 80 (step S2). Then, it displays an adjustment screen 541 on the display unit 54, which has cut design information 81 superimposed on the captured image 80 (step S3). The cut design information 81 is information (image) that virtually represents the object obtained by cutting the paper 60 with the cutting device 10. In this embodiment, the case in which the direction of the attachment surface of the object 70 is taken as the shooting direction will be used as an example for explanation.

[0032] The adjustment screen 541 is a screen for the user to adjust the position and size of the cut design on the object 70 to be pasted onto the captured image 80. As shown in Figure 6, the adjustment screen 541 displays the captured image 80 including the object 70 to be pasted onto, cut design information 81 corresponding to the selected cut design, and a confirmation button 541a. The user can adjust the placement and size of the cut design on the object 70 to be pasted onto by moving, enlarging, or shrinking the cut design information 81 using the operation unit 55. For example, by left-clicking the mouse cursor of the operation unit 55 over the cut design information 81, the cut design information 81 becomes selected, and the cut design information 81 can be moved by dragging it. Also, by dragging one of the handles (circles) at the four corners that are displayed when the cut design information 81 is selected, the cut design information 81 can be enlarged or reduced. Note that Figure 6 and Figures 11 and 12 described later show an example in which a scrapbook with two pet photos placed on it was photographed as the object 70 to be pasted onto.

[0033] Here, when actually cutting the paper 60 according to the cut design and attaching the resulting product to the object to be attached 70, the product is positioned slightly above the surface of the object to be attached 70, and then brought closer to the object to be attached 70 at a fixed position and attached. In other words, the operation involves moving the product in the direction of the object to be attached 70. In this embodiment, the position (display position) of the cut design information 81 can also be moved in the depth direction so that the user can adjust the position of the cut design with the same feel as when actually attaching the product to the object to be attached 70. The depth direction is the direction perpendicular to the plane of the captured image 80. For example, when the cut design information 81 is selected and the mouse wheel of the operation unit 55 is rotated upward, the CPU 51 displays the cut design information 81 so that it is moved away from the user's viewpoint (so that it becomes smaller). In other words, the cut design information 81 is displayed so that it appears closer to the object to be attached 70 in the captured image 80. When the cut design information 81 is selected, and the mouse cursor on the control unit 55 is rotated downwards, the CPU 51 displays the cut design information 81 so that it is closer to the user's viewpoint (so that it is larger). In other words, the cut design information 81 is displayed so that it appears to be further away from the object 70 to which the captured image 80 will be pasted. The initial display position and initial display size of the cut design information 81, including the depth direction, are predetermined.

[0034] Furthermore, the CPU 51 displays a shadow 82 of the cut design information 81 on the captured image 80 according to the distance between the cut design information 81 and the object to be attached 70 (distance in the depth direction), so that the user can intuitively grasp the distance (distance in the depth direction) between the cut design information 81 and the object in the captured image (the object located behind the cut design information 81). For example, as shown in Figure 7(a), if the cut design information 81 is located at a position far from the attachment surface of the object to be attached 70 in the captured image 80 in the depth direction, the CPU 51 displays a larger shadow 82, as shown in Figure 7(b). As shown in Figure 8(a), if the cut design information 81 is moved closer to the object to be attached 70 in the captured image 80 than in the state shown in Figure 7(a), the CPU 51 displays a smaller shadow 82, as shown in Figure 8(b), than the shadow 82 shown in Figure 7(b). As shown in Figure 9(a), when the position of the cut design information 81 in the depth direction matches the position of the adhesive surface of the object 70 to be attached in the captured image 80, the CPU 51 erases the shadow 82. This makes it possible for the user to intuitively grasp the distance (distance in the depth direction) between the cut design information 81 and the object 70 to be attached. Furthermore, when the cut design information 81 matches the position of the adhesive surface of the object 70 to be attached, this can be easily recognized.

[0035] Furthermore, it is preferable that the position of the virtual light source for generating the shadow 82 be such that the shadow 82 can be seen in front of the cut design information 81 from the user's perspective.

[0036] Furthermore, due to the display control of the CPU 51 described above, for example, as shown in Figure 10(a), if there are multiple candidate objects 70A and 70B for the object to be pasted 70 in the captured image 80, and their positions in the depth direction are different, if the cut design information 81 is on the surface of object 70A, which is closer to the user's viewpoint, the shadow 82 will not be displayed. However, if the cut design information 81 is moved to the surface of object 70B, which is farther from the user's viewpoint, without changing its position in the depth direction, the shadow 82 will be displayed. If the depth of the cut design information 81 is moved to the surface of object 70B, as shown in Figure 10(b), the cut design information 81 will be displayed smaller, and the shadow 82 will no longer be displayed. Therefore, when multiple objects with different positions in the depth direction are displayed in the captured image 80, the user can intuitively grasp the position in the depth direction of each object and the sense of distance of the cut design information 81 in the depth direction relative to each object by observing the shadow 82 when the cut design information 81 is moved.

[0037] When the adjustment screen 541 is displayed, the CPU 51 determines whether or not the confirmation button 541a on the operation unit 55 has been operated (step S4). The CPU 51 disables the operation of the confirmation button 541a if the position of the cut design information 81 in the depth direction does not match the surface of any object in the captured image 80. This prevents the cut design information 81 from being confirmed when its position in the depth direction does not match the surface of the object to be attached 70, thereby preventing the cut design from being cut to a size unintended by the user.

[0038] If the CPU determines that the confirmation button 541a has not been pressed (step S4; NO), the CPU 51 changes the position and size of the cut design information 81 on the adjustment screen 541 in accordance with the user's operation of the control unit 55 (step S5), and returns to step S2. The CPU 51 repeatedly executes steps S2 to S5 until the confirmation button 541a is pressed by the control unit 55.

[0039] For example, if you select a tulip as the cut design and photograph a scrapbook as the object to be pasted 70, the adjustment screen 541 will first display the photographed image 80, which includes the scrapbook, as shown in Figure 11(a). Figures 11 and 12 show the display area of ​​the photographed image 80 on the adjustment screen 541.

[0040] Next, as shown in Figure 11(b), the tulip cut design information 81 is displayed on the captured image 80. A shading 82 corresponding to the cut design information 81 is also displayed. When the user moves this cut design information 81 onto the scrapbook surface and shrinks it so that it fits within the left margin, the result is as shown in Figure 11(c). However, in this state, there is a lot of blank space near the center of the scrapbook, which does not look good.

[0041] Therefore, when the user tilts the photo on the left side of the scrapbook, the captured image 80, including the pasting target object 70 (scrapbook) with the rearranged photo layout, is displayed on the adjustment screen 541, as shown in Figure 12(a). Subsequently, as shown in Figure 12(b), the tulip cut design information 81 is displayed on the captured image 80 at the size and position shown in Figure 11(c). However, the displayed cut design information 81 is small and positioned too far to the left. Therefore, when the user moves the cut design information 81 slightly to the right and enlarges it using the operation unit 55, the scrapbook with the cut design information 81 positioned nicely is displayed, as shown in Figure 12(c).

[0042] Returning to Figure 5, if it is determined in step S4 that the confirmation button 541a of the operation unit 55 has been operated (step S4; YES), the CPU 51 acquires the shape and size of the cut design information 81 displayed on the adjustment screen 541 and generates cut data based on the shape and size of the cut design (step S6). The cut data is information for cutting the paper 60 in the cutting device 10, and may be data representing the outline of the cut design, or it may be outline data converted into drive data for driving the cutting unit 17 and paper feeding unit 19 of the cutting device 10.

[0043] Next, the CPU 51 transmits the generated cut data to the cutting device 10 via the communication unit 56, causing the cutting device 10 to cut the paper 60 (step S7), and then terminates the cut design adjustment process.

[0044] In the cutting device 10, when cut data is received from the terminal device 50 via the wired communication unit 15 or the wireless communication unit 16, the MPU 11 controls the cutting unit 17 and the paper feeding unit 19 based on the cut data to cut the paper 60. This makes it possible to obtain a finished product of the optimal size for pasting onto the object 70 to be pasted, with the design desired by the user.

[0045] (Variation 1) In the above embodiment, the case where the terminal device 50 is a PC was used as an example. However, if the terminal device 50 is a smartphone or the like, the user will be holding the terminal device 50 to shoot video, and the viewpoint will not be stable due to camera shake, making adjustment difficult. Therefore, a stop button for fixing the captured image 80 may be provided on the adjustment screen 541, and when the stop button is pressed, the CPU 51 may fix the display on the adjustment screen 541 to the captured image 80 (a still image of one frame of the video) captured by the shooting unit 57 at the time of pressing (or immediately thereafter). This allows the user to adjust the cut design information 81 with a stable captured image 80, improving convenience.

[0046] (Modification 2) For example, if a user selects a large object as the object to be pasted 70 and displays cut design information 81 on a captured image 80 including the object to be pasted 70 and makes adjustments, the size of the adjusted cut design information 81 may exceed the size that can be cut by the cutting device 10. Therefore, in step S4, when the operation unit 55 determines that the confirmation button 541a has been pressed, the CPU 51 determines whether the size of the cut design information 81 exceeds a predetermined threshold (a size that fits on the paper 60), and if the size of the cut design information 81 exceeds the predetermined threshold, it outputs a warning. The warning may be displayed, for example, on the adjustment screen 541 displayed on the display unit 54, or it may be output by voice if the terminal device 50 is equipped with an audio output unit. This prevents errors from occurring in the cutting device 10.

[0047] (Variation 3) Furthermore, if the terminal device 50 is a smartphone or the like, the user will be holding the terminal device 50 while recording video, which may make manual adjustment difficult. Therefore, the terminal device 50 may be equipped with an audio input unit and a function to adjust the size and position of the cut design information 81 based on the input audio. Alternatively, it may be equipped with a function to detect the user's gestures and adjust the size and position of the cut design information 81 according to the gestures. This allows adjustments to be made even when the user's hands are occupied.

[0048] (Modification 4) If the distance between the cut design information 81 and the application surface of the object to be applied 70 is large, the shadow 82 may extend beyond the object to be applied 70 depending on the position of the virtual light source. Also, the direction in which the shadow 82 is displayed changes depending on the position of the light source. Therefore, the terminal device 50 may be equipped with an adjustment unit for adjusting the position of the virtual light source. For example, a light source adjustment button for transitioning to the light source adjustment mode is provided on the adjustment screen 541, and when the light source adjustment button is operated by the operation unit 55, the CPU 51 transitions to the light source adjustment mode and performs the function of an adjustment unit in cooperation with the operation unit 55. For example, the CPU 51 moves the position of the virtual light source in the up, down, left, and right directions on the display unit 54 screen in response to the operation of the up, down, left, and right arrow keys on the keyboard of the operation unit 55, moves the height of the light source (position in the depth direction) with the operation of the mouse wheel, and changes the size and position of the shadow 82 displayed on the captured image 80 in accordance with the movement of the light source position. This makes it possible to adjust so that the shadow 82 does not extend beyond the object to be applied 70. Also, the shadow 82 can be displayed in the direction preferred by the user. The user interface for adjusting the position of the light source is not limited to the above.

[0049] (Variation 5) In the above embodiment, the case where the captured image 80 is a 2D image was described as an example, but the captured image 80 may be a 3D image. For example, the terminal device 50 is an AR (augmented reality) goggle, and the CPU 51 has the shooting unit 57 capture a 3D image including the object to be attached in the real world 70 at a predetermined frame rate and displays it as the captured image 80 on the display unit 54, and also displays the cut design information 81 and its shading 82 on the 3D image on the display unit 54. By displaying the shading 82, the virtual cut design information 81 can be made to look realistic. The position and size of the cut design information 81 may be adjusted, for example, using gestures by the user. For example, when the CPU 51 detects a user's action of pinching, moving, and releasing the cut design information 81, it moves the cut design information 81 accordingly. When it detects a finger-spreading motion on the cut design information 81, it enlarges the cut design information 81. When it detects a finger-closing motion on the cut design information 81, it shrinks the cut design information 81. Furthermore, the terminal device 50 that displays the captured image 80 as a 3D image is not limited to AR goggles; it may also be a smartphone or a PC.

[0050] As described above, the CPU 51 of the terminal device 50 displays a captured image 80 of the real world, including the object to be pasted 70, on the display unit 54. On the displayed captured image 80, it displays cut design information 81, which virtually represents the output obtained by cutting the paper 60 with the cutting device 10, with the position and size of the cut design information 81, including the depth direction, adjustable. At the same time, the CPU 51 displays a shadow 82 corresponding to the cut design information 81 on the captured image 80. Therefore, the user can intuitively grasp the sense of distance between the cut design information 81 and the object to be pasted 70 in the captured image 80.

[0051] Here, by making the captured image 80 a moving image, even if the object to be pasted 70 is changed, the user can easily adjust the position and size of the cut design information 81 on the changed object to be pasted 70. Also, by making the captured image 80 a still image of a single frame of the moving image, the user can adjust the cut design information 81 while the captured image 80 is stable.

[0052] Furthermore, the terminal device 50 is equipped with an adjustment unit for adjusting the position of a virtual light source that generates the shadow 82, so that the shadow 82 does not extend beyond the object 70 to which it is attached. In addition, the shadow 82 can be displayed in the direction preferred by the user.

[0053] The above description of the embodiments is merely an example of the cut design adjustment device, cut design adjustment method, and program according to the present invention, and is not limited thereto.

[0054] For example, the above embodiment discloses an example in which semiconductor memory such as ROM or a hard disk is used as a computer-readable medium for the program according to the present invention, but the invention is not limited to this example. Portable recording media such as CD-ROMs can be used as other computer-readable media. Furthermore, a carrier wave can also be used as a medium for providing the data of the program according to the present invention via a communication line.

[0055] Although embodiments and modifications of the present invention have been described above, the scope of the present invention is not limited to the embodiments described above, but includes the scope of the invention as described in the claims and its equivalents. [Explanation of symbols]

[0056] 1 Cutting system, 10 Cutting device, 50 Terminal device (cutting design adjustment device), 51 CPU, 54 Display unit, 60 Paper (medium to be cut), 80 Captured image, 81 Cutting design information, 82 Shading

Claims

1. A display unit that shows images taken from the real world, A control unit that displays on the aforementioned captured image cut design information, which virtually represents the output obtained by cutting the medium to be cut by the cutting device, with the position and size of the cut design information, including the depth direction, adjustable; Equipped with, The control unit, To display shading corresponding to the cut design information on the captured image. Cut design adjustment device.

2. The aforementioned captured image is a moving image or a still image of a single frame from a moving image. The cut design adjustment device according to claim 1.

3. It includes an adjustment unit for adjusting the position of a virtual light source that produces the aforementioned shadow. The cut design adjustment device according to claim 1.

4. Computers A display process in which a captured image of the real world is displayed on the display unit, The process includes a control step that displays on the captured image cut design information, which virtually represents the output obtained by cutting the medium to be cut by the cutting device, in a manner that allows adjustment of the position and size of the cut design information, including the depth direction. The control process described above is: To display shading corresponding to the cut design information on the captured image. How to adjust the cut design.

5. Computers, A display unit that shows images captured from the real world. A control unit that displays on the aforementioned captured image cut design information, which virtually represents the output obtained by cutting the medium to be cut by the cutting device, with adjustable position and size including the depth direction of the cut design information. To make it function as, The control unit, To display shading corresponding to the cut design information on the captured image. program.

Images