Augmented reality design and printing system

The augmented reality design printing system allows for easy customization and printing of virtual designs onto real objects, addressing the limitations of conventional systems by integrating a photographing and printing mechanism for flexible design adaptation.

JP7591121B2Active Publication Date: 2024-11-27LUCKA INC
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023500958
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-02-22
Filing Date
2022-02-21
Publication Date
2024-11-27
Estimated Expiration
2042-02-21

AI Technical Summary

Technical Problem

Conventional augmented reality systems cannot print virtual images onto real objects, and existing clothing sales methods face challenges in accommodating varying human body shapes and limited design flexibility.

Method used

An augmented reality design printing system that includes a photographing section, augmented reality image synthesis, and a printing section, allowing virtual designs to be easily changed and printed onto objects like clothing, towels, or smartphone cases, using a virtual design storage unit, extraction, and composite video creation.

Benefits of technology

Enables easy customization of virtual designs on real objects, displaying augmented reality images accurately, and printing them onto items like T-shirts, with enhanced user interface and environmental adaptability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007591121000001
    Figure 0007591121000001
  • Figure 0007591121000002
    Figure 0007591121000002
  • Figure 0007591121000003
    Figure 0007591121000003
Patent Text Reader

Abstract

[Problem] Provided is an augmented reality design printing system that can easily change a virtual design of a first designed object, display an augmented reality video using the virtual design, and actually print, on a second designed object, the virtual design displayed in the augmented reality video. [Solution] The present invention comprises: an imaging unit that images a first designed object; an augmented reality video compositing unit that composites an augmented reality image by replacing, with a virtual design, at least a part of the image of the first designed object imaged by the imaging unit; a display unit that displays the augmented reality image; and a printing unit that prints the virtual design on a second designed object. The first designed object has, on at least a part of the surface thereof, a virtual design replacement part which is replaced with a virtual design when displayed on the display unit.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an augmented reality design printing system that can actually print a design displayed in an augmented reality image created by overlaying a virtual image on an actual image. [Background technology]

[0002] With the recent development of information technology, systems that display images in which virtual images are superimposed on actual images (augmented reality images) have been proposed.

[0003] For example, Patent Document 1 discloses a periscope that appropriately processes images of various objects to be viewed, such as landscapes, and provides them to a user. The periscope comprises an imaging means for capturing images of the objects to be viewed, a storage means for storing virtual images of objects whose locations are specified within the objects to be viewed, in association with the objects to be viewed, and an image synthesis means for extracting from the storage means a virtual image corresponding to the captured image of the objects to be viewed and synthesizing and displaying the same. The periscope can quickly and reliably display images of objects such as ruins within the actual view.

[0004] On the other hand, a sales method has been proposed in which a large amount of image data such as patterns is stored and distributed via a communication network such as the Internet, the distributed image data is printed on clothing such as T-shirts, and the printed clothing is then sold.

[0005] For example, Patent Document 2 discloses a clothing sales method in which clothes capable of displaying images are made available for trying on by loan or the like in a sales counter having a full-length mirror or other mirror, and a large number of image data are provided in that sales counter or a wider area for selection of items to be tried on using electronic data processing, and one or more image data items selected as items to be tried on are used to display images of the clothes to be tried on, and the image data selected as items to be purchased is printed on clothing such as T-shirts, and the printed clothing is sold. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2003-264740 A [Patent Document 2] JP 2003-41420 A Summary of the Invention [Problem to be solved by the invention]

[0007] However, conventional systems for displaying augmented reality images, such as the periscope described above, can display virtual reality images that are overlaid on real images, but have the problem that they cannot be printed onto real objects.

[0008] On the other hand, the above-mentioned clothing sales method has a problem in that it is necessary to prepare clothes that can display images to try on. In addition, there is a problem that it is practically difficult to prepare clothes that can display images to fit various body shapes because people have different body shapes. Furthermore, there is a problem that the designs printed on the clothes, etc. are limited to those prepared in advance. In addition, there is a problem that the designs cannot be changed.

[0009] In view of the above-mentioned circumstances, the present invention aims to provide an augmented reality design printing system that can easily change the virtual design of a first designed object, display an augmented reality image using the changed design, and actually print the virtual design displayed in the augmented reality image on a second designed object. [Means for solving the problem]

[0010] As a result of intensive research and development into the above-mentioned problems, the inventors of the present invention have discovered the following revolutionary augmented reality design printing system.

[0011] A first aspect of the present invention for solving the above problem is an augmented reality design printing system comprising a photographing unit for photographing a first object to be designed, an augmented reality image synthesis unit for replacing at least a portion of the image of the first object to be designed photographed by the photographing unit with a virtual design to synthesize an augmented reality image, a display unit for displaying the augmented reality image, and a printing unit for printing the virtual design on a second object to be designed, wherein the first object to be designed has a virtual design replacement unit on at least a portion of its surface which is replaced with the virtual design when displayed on the display unit, and the augmented reality image synthesis unit has a virtual design storage unit for storing a plurality of virtual designs, a virtual design extraction unit for extracting virtual designs from the virtual design storage unit, and a synthetic image creation unit for replacing the virtual design replacement unit with the virtual design extracted by the virtual design extraction unit to create an augmented reality image.

[0012] Here, the term "augmented reality image" refers to an augmented reality image obtained by overlaying a virtual reality image on a real image.

[0013] According to this first aspect, it is possible to provide an augmented reality design printing system that can easily change the virtual design of a first designed object, display an augmented reality image using the changed design, and actually print the virtual design displayed in the augmented reality image on a second designed object.

[0014] A second aspect of the present invention is an augmented reality design printing system as described in the first aspect, characterized in that it has an input unit for inputting information such as text and pictures, and a virtual design addition unit for adding the information input from the input unit to the virtual design.

[0015] According to the second aspect, a virtual design to which new information has been added and an augmented reality image using the virtual design can be created and displayed.

[0016] A third aspect of the present invention is an augmented reality design printing system described in the first or second aspect, characterized in that the first designed object further has a identification section that indicates that the image includes the first designed object when photographed by the photographing section, the augmented reality image synthesis section has a identification section confirmation section that confirms whether the identification section is included in the image of the first designed object photographed by the photographing section, and a identification section judgment section that judges whether the identification section confirmed by the identification section confirmation section has been photographed so as to satisfy a predetermined judgment condition, and the virtual design extraction section extracts a virtual design from the virtual design storage section based on the judgment of the identification section judgment section.

[0017] According to the third aspect, the virtual design of the first object to be designed can be easily changed, and an augmented reality image using the virtual design can be easily displayed.

[0018] A fourth aspect of the present invention is an augmented reality design printing system as described in the third aspect, characterized in that the specified judgment condition is that the specified part is not confirmed by the specified part confirmation unit for a specified period of time, and the virtual design extraction unit extracts a virtual design from the virtual design storage unit in accordance with the specified extraction condition.

[0019] According to the fourth aspect, the virtual design of the first object to be designed can be changed more easily, and an augmented reality image using the virtual design can be easily displayed.

[0020] A fifth aspect of the present invention is an augmented reality design printing system according to the third or fourth aspect, further comprising an invisible light irradiation unit capable of emitting invisible light, and the specific part confirmation unit detects invisible light reflected by the specific part and determines whether a specific part is included based on the area of ​​the part that reflects the invisible light.

[0021] According to the fifth aspect, it is possible to detect a specific portion more accurately without being affected by the external environment, as compared to a case where a specific portion is detected based on color, shape, or the like.

[0022] A sixth aspect of the present invention is an augmented reality design printing system described in any one of the first to fifth aspects, characterized in that the composite image creation unit has a center position calculation unit that calculates the position of the center of the virtual design replacement part in the image of the first object to be designed captured by the photographing unit, a placement unit that places the center of the virtual design at the center position of the virtual design replacement part calculated by the center position calculation unit, a length detection unit that detects the length of a specified part of the virtual design replacement part in the image of the first object to be designed captured by the photographing unit, an adjusted virtual design creation unit that creates an adjusted virtual design by adjusting the length of the virtual design corresponding to the specified part based on the length of the specified part of the virtual design replacement part, and a synthesis unit that replaces the virtual design replacement part with the adjusted virtual design and synthesizes an augmented reality image.

[0023] In the sixth aspect, an augmented reality image can be easily created that matches the shape and size of the virtual design replacement part of the first design object photographed by the photographing unit. As a result, by viewing the augmented reality image, for example, a person wearing or holding up the T-shirt can clearly imagine wearing the T-shirt with the virtual design.

[0024] A seventh aspect of the present invention is an augmented reality design printing system described in any one of the third to sixth aspects, further comprising an information terminal connected via a network, and capable of controlling at least one of the power on / off, the angle of the shooting unit relative to the first design object, the brightness, lightness and contrast of the display unit, and the specified judgment conditions of the identification part judgment unit from the information terminal.

[0025] According to the seventh aspect, the behavior of the augmented reality design printing system (at least one of the power on / off, the angle of the shooting unit relative to the first design object, the brightness and contrast of the display unit, and the specified judgment conditions of the identification unit judgment unit) can be controlled from a remote location.

[0026] An eighth aspect of the present invention is an augmented reality design printing system described in any one of the first to seventh aspects, characterized in that it has a clarification processing unit that clarifies the difference between the virtual design replacement portion of the first designed object contained in the image captured by the capture unit and the portion other than the virtual design replacement portion.

[0027] In the present invention, the virtual design replacement portion and the portion other than the virtual design replacement portion are distinguished from the image captured by the image capture unit. However, the image captured by the image capture unit is affected by the external environment (external light wavelength, intensity, etc.), and depending on the external environment, it may be difficult to distinguish between the virtual design replacement portion and the portion other than the virtual design replacement portion.

[0028] According to the eighth aspect, even if such a situation occurs, the image (video) processing by the clarification processing unit makes it possible to accurately distinguish between the virtual design replacement part and the part other than the virtual design replacement part. As a result, regardless of the external environment, the virtual design of the first design object can be easily changed, and an augmented reality video using the virtual design can be reliably displayed.

[0029] A ninth aspect of the present invention is the augmented reality design printing system according to any one of the first to eighth aspects, characterized in that the first design object is clothing, a towel, a mask, or a smartphone case.

[0030] According to the ninth aspect, the virtual design of clothing, towels, masks or smartphone cases can be easily changed, and an augmented reality image using the same can be displayed, and the virtual design displayed in the augmented reality image can actually be printed on the clothing or smartphone case.

[0031] In the present invention, a "unit" or a "system" does not simply mean a physical means, but also includes cases where the functions of the "unit" or "system" are realized by software. Also, the functions of one "unit" or "system" may be realized by two or more physical means or devices, or the functions of two or more "units" or "systems" may be realized by one physical means or device. [Brief description of the drawings]

[0032] [Figure 1] FIG. 1 is a schematic diagram of a T-shirt used in the first embodiment. [Diagram 2] FIG. 2 is a schematic conceptual diagram of the augmented reality design printing system according to the first embodiment. [Diagram 3] FIG. 3 is a schematic diagram of the main body according to the first embodiment. [Figure 4] FIG. 4 is a schematic conceptual diagram of the augmented reality image synthesis unit according to the first embodiment. [Diagram 5] FIG. 5 is a schematic conceptual diagram of the composite video creating unit according to the first embodiment. [Figure 6] FIG. 6 is a flowchart showing the operation of the augmented reality design printing system according to the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0033] Hereinafter, an embodiment of an augmented reality design printing system according to the present invention will be described with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiment. (Embodiment 1)

[0034] First, the first design object photographed by the augmented reality design printing system of the present embodiment described later will be described. The first design object is not particularly limited as long as it has a virtual design replacement section 301 (301a, 301b) that is replaced with a virtual design 410 when displayed on the display section 30 of the augmented reality design printing system 1 described later on at least a part of the surface, and a specification section 302 that indicates that the image includes the first design object when photographed by the photographing section 20 of the augmented reality design printing system 1 described later. The first design object is not particularly limited as long as it can be printed. Examples of the first design object include clothing, towels, masks, and smartphone cases.

[0035] There are no particular limitations on the virtual design replacement section 301, so long as it can be replaced with a virtual design when displayed on the display section 30 of the augmented reality design printing system 1. An example of the virtual design replacement section 301 is a part colored green or blue, which is used for chromakey.

[0036] The identifying portion 302 is not particularly limited as long as it indicates that the image includes the first object to be designed when photographed by the photographing portion 20 of the augmented reality design printing system 1. Examples of the identifying portion 302 include a portion colored with paint that has a higher light reflectance than other portions, and a portion with a specific shape that can be recognized as an image including the first object to be designed by image analysis.

[0037] In this embodiment, as shown in Fig. 1, a T-shirt is used as the first design subject 300. A specific portion 302 is formed in the center of the T-shirt, which is colored with paint that has a higher light reflectance than other portions. The front surface 301a (virtual design replacement portion) other than the specific portion 302 is dyed green, and the back surface 301b (virtual design replacement portion) is dyed blue.

[0038] The shape, size, and material of the T-shirt are not particularly limited as long as they can form the above-mentioned specified portion 302 and virtual design replacement portions 301a and 301b. The T-shirt may be actually worn by a person, or may be held up in front of or behind the person with respect to the imaging unit 20.

[0039] Next, the augmented reality design printing system 1 in this embodiment will be described. Fig. 2 is a schematic conceptual diagram of the augmented reality design printing system 1 in this embodiment. As shown in this figure, the augmented reality design printing system 1 is composed of a main body 10 having two doors 11 attached so as to open from the center to both the left and right sides, and a printing unit 100 connected to the main body 10 via a network 200. Although not shown, in this embodiment, a plurality of main bodies 10 are connected to the printing unit 100 via the network 200.

[0040] First, the main body 10 will be described. Fig. 3 is a schematic diagram of the main body 10 with the door open. As shown in this figure, the main body 10 has a rectangular parallelepiped housing 12, and is equipped therein with a shooting unit 20, a display unit 30, and an augmented reality image synthesis unit 40. Although not shown, the shooting unit 20, the display unit 30, and the augmented reality image synthesis unit 40 are connected to each other by wire or wirelessly.

[0041] The photographing unit 20 is attached to the center of the door side (front side) of the top plate inside the housing 12, and can photograph a person or the first design object 300 located in front of the main body 10. The photographing unit 20 is not particularly limited as long as it can photograph the specific part 302 and the virtual design replacement parts 301a and 301b of the first design object 300. As the photographing unit 20, for example, a commercially available CCD camera or the like can be mentioned.

[0042] The display unit 30 is attached to the inner back panel of the housing 12 and is capable of displaying an augmented reality image, which will be described later. The display unit 30 is not particularly limited as long as it is capable of displaying an augmented reality image. Examples of the display unit 30 include a liquid crystal display and an organic EL display.

[0043] Further, the augmented reality image synthesis unit 40 will be described. The augmented reality image synthesis unit 40 is attached to the lower part inside the housing 12, and is capable of synthesizing an augmented reality image by replacing at least a part of the image of the first designed object 300 photographed by the photographing unit 20 with a virtual design 410 described later.

[0044] 4 is a schematic conceptual diagram of the augmented reality image synthesis unit 40. As shown in this figure, the augmented reality image synthesis unit 40 has a virtual design storage unit 41, a specific part confirmation unit 42, a specific part determination unit 43, a virtual design extraction unit 44, and a synthetic image creation unit 45.

[0045] The virtual design storage unit 41 is not particularly limited as long as it can store a plurality of virtual designs 410. As the virtual design storage unit 41, for example, commercially available database software capable of storing a plurality of virtual designs 410 can be used.

[0046] Here, the virtual design 410 refers to image data to be replaced by the virtual design replacement parts 301a and 301b of the first design subject 300 when displayed on the display unit 30. The shape of the virtual design 410 is preferably similar (including the same) to the shape of the virtual design replacement parts 301a and 301b of the first design subject 300, but may not be the same. The virtual design 410 in this embodiment may be, for example, video (image) data of a character appearing in a manga or animation from the neck to the waist. In this embodiment, the virtual design is composed of two pieces of image data, a virtual design on the front side of a T-shirt and a virtual design on the back side of the T-shirt. The virtual design may include virtual design-related information about the virtual design (image data of the entire image of the virtual design, the creator of the virtual design, and information about the price and size of the T-shirt to be described later) and image data related to the virtual design (image data of a "frame" displayed around the display unit, etc.).

[0047] The specific part confirmation unit 42 is not particularly limited as long as it can confirm whether the specific part 302 is included in the image of the first design object 300 photographed by the photographing unit 20 by color, shape, etc. Examples of the specific part confirmation unit 42 include a program having such a function.

[0048] In addition, when an invisible light irradiating unit capable of irradiating invisible light such as an infrared irradiator is attached to the photographing unit 20 and invisible light such as infrared light is irradiated, the specific part confirmation unit 42 may include a program that detects invisible light reflected by the specific part 302 and determines whether the specific part 302 is included based on the area of ​​the part that reflects the invisible light (determines whether the area of ​​the part that reflects the invisible light can be regarded as the same as the area of ​​the specific part 302 that has been set in advance). By configuring the specific part confirmation unit 42 in this way, the specific part can be detected more accurately without being affected by the external environment than when the specific part 302 is detected based on color, shape, etc. In this embodiment, a program that recognizes a part that is brighter than other parts as the specific part 302 is used.

[0049] The identification part determination unit 43 is not particularly limited as long as it can determine whether the identification part 302 confirmed by the identification part confirmation unit 42 has been photographed so as to satisfy a predetermined determination condition. Examples of the identification part determination unit 43 include a program having such a function. Note that the predetermined condition is not particularly limited as long as it is a state (condition) in which the identification part 302 can be confirmed by the identification part confirmation unit 42. In this embodiment, the predetermined condition is that the identification part 302 is continuously recognized (photographed) by the identification part confirmation unit 42.

[0050] The virtual design extraction unit 44 is not particularly limited as long as it can extract the virtual design 410 from the virtual design storage unit 41 based on the judgment of the identified part judgment unit 43. Examples of the virtual design extraction unit 44 include a program having such a function. In this embodiment, a program is used that does not extract a new virtual design 410 when a predetermined condition (the identified part 302 is continuously recognized (photographed)) is satisfied, but extracts the virtual design 410 from the virtual design storage unit 41 according to the predetermined extraction condition when the identified part 302 is not recognized for a certain period of time (for example, 0.5 seconds).

[0051] The composite image creation unit 45 is not particularly limited as long as it can create an augmented reality image by replacing the virtual design replacement units 301a and 301b with the virtual design 410 extracted by the virtual design extraction unit 44. The composite image creation unit 45 may be, for example, a program having such a function. In this embodiment, the composite image creation unit 45 is configured as follows.

[0052] 5 is a schematic conceptual diagram of the composite video image creation unit 45. As shown in this figure, the composite video image creation unit 45 has a center position calculation unit 450, a placement unit 451, a length detection unit 452, an adjusted virtual design creation unit 453, and a composition unit 454.

[0053] The center position calculation unit 450 is not particularly limited as long as it can calculate the center positions of the virtual design replacement parts 301a and 301b in the image of the first design subject 300 captured by the shooting unit 20. For example, the center position calculation unit 450 may be a program having such a function. In this embodiment, a program is used that calculates the center positions in the vertical direction from the upper and lower ends of the virtual design replacement parts 301a and 301b captured by the shooting unit 20, calculates the center positions in the horizontal direction from the right and left ends of the virtual design replacement parts 301a and 301b, and finally calculates the center positions of the virtual design replacement parts 301a and 301b in the image of the first design subject 300 captured by the shooting unit 20.

[0054] The placement unit 451 is not particularly limited as long as it can place the center of the virtual design 410 at the center positions of the virtual design replacement parts 301a and 301b calculated by the center position calculation unit 450. Examples of the placement unit 451 include programs having such functions. In the present embodiment, a program is used that similarly calculates the position of the center of the virtual design 410 and aligns this position with the center positions of the virtual design replacement parts 301a and 301b calculated by the center position calculation unit 450.

[0055] The length detection unit 452 is not particularly limited as long as it can detect the length of a predetermined portion of the virtual design replacement parts 301a and 301b in the image of the first design subject 300 photographed by the photographing unit 20. For example, the length detection unit 452 may be a program having such a function. In this embodiment, a program is used that divides the virtual design replacement parts 301a and 301b evenly into a predetermined number (for example, 20) in the horizontal direction and calculates the width of each divided part.

[0056] The adjusted virtual design creation unit 453 is not particularly limited as long as it can create an adjusted virtual design obtained by adjusting the length of the virtual design 410 corresponding to a predetermined portion based on the length of the predetermined portion of the virtual design replacement units 301a and 301b. The adjusted virtual design creation unit 453 may be, for example, a program having such a function. In this embodiment, a program is used that divides the virtual design 410 equally in the horizontal direction by a predetermined number (for example, 20 pieces) in the same way as the length detection unit 452 does, adjusts the width (number of dots, etc.) of each divided portion so that it becomes the length of each portion calculated by the length detection unit 452, and then synthesizes the divided portions to create an adjusted virtual design adjusted to the same shape and size as the virtual design replacement units 301a and 301b in the image of the first design subject 300 captured by the capture unit 20.

[0057] The synthesis unit 454 is not particularly limited as long as it can replace the virtual design replacement units 301a and 301b with the adjusted virtual designs and synthesize the augmented reality video. For example, the synthesis unit 454 may be a program having such a function. In this embodiment, a similar program is used. In this embodiment, the front side (the part corresponding to the virtual design replacement unit 301a) and the back side (the part corresponding to the virtual design replacement unit 301b) of the T-shirt can be replaced with the corresponding virtual design based on the color of the front side of the T-shirt (the color of the front side determines whether it is the front side or the back side).

[0058] The main body 10 is not particularly limited as long as it has the above-mentioned functions. The main body 10 may be, for example, a commercially available personal computer or a dedicated video processing device.

[0059] 2 is not particularly limited as long as it can print the virtual design 410 on the second design subject. Examples of the printing unit 100 include a printing machine and a printing company. In this embodiment, the printing unit 100 is a printing machine that can print the virtual design 410 on the front side (virtual design replacement section 301a) and back side (virtual design replacement section 301b) of a T-shirt, which is the second design subject.

[0060] Furthermore, the network 200 is not particularly limited and may be wired or wireless as long as it can connect the main body 10 and the printing unit 100. Examples of the network 200 include the Internet and an intranet.

[0061] Next, a description will be given of the operation of the augmented reality design print system 1. Fig. 6 is a flowchart showing the operation of the augmented reality design print system 1.

[0062] First, when the augmented reality design printing system 1 is started, the image of the first design object 300 is captured by the image capturing unit 20 (S1). Then, the identification unit confirmation unit 42 confirms whether the image of the identification unit 302 is included in the image captured by the image capturing unit 20 (S2).

[0063] Then, if a predetermined condition is satisfied (S3), the center position calculation unit 450 calculates the positions of the centers of the virtual design replacement parts 301a and 301b in the image of the first design subject 300 (S4). After that, the placement unit 451 calculates the position of the center of the virtual design 410 (S5), and the length detection unit 452 detects the length of the predetermined part (S6).

[0064] Next, an adjusted virtual design is created by adjusted virtual design creation unit 453 (S7), and then an augmented reality image is created by synthesis unit 454 (S8). Then, the augmented reality image is finally displayed on display unit 30 (S9). Here, virtual design-related information about the virtual design displayed on display unit 30 may be displayed, together with the augmented reality image, at the bottom of display unit 30, etc.

[0065] On the other hand, if the predetermined conditions are not met, the virtual design extraction unit 44 extracts a virtual design 410 from the virtual design storage unit 41 in accordance with the predetermined extraction conditions (S11). Thereafter, the same process is carried out from S4.

[0066] These operations are then repeated (S10) until the virtual design 410 is printed on the second design object (S12).

[0067] By configuring the augmented reality design printing system 1 as described above, it is possible to easily change the virtual reality design of an object whose design is to be changed, and to display an augmented reality image using the design. Also, by configuring the composite image creation unit 45 as described above, it is possible to easily create an augmented reality image that matches the shape and size of the virtual design replacement parts 301a and 301b of the first design subject 300 photographed by the photographing unit 20. As a result, by viewing the augmented reality image, a person wearing or holding the T-shirt can clearly imagine the appearance of wearing the T-shirt with the virtual design 410.

[0068] In addition, in this embodiment, the virtual design extraction unit 44 is configured not to extract a new virtual design 410 when a predetermined condition (the specific part 302 is continuously recognized (photographed)) is satisfied, and to extract the virtual design 410 from the virtual design storage unit 41 according to the predetermined extraction condition when the specific part 302 is not recognized for a certain time (for example, 0.5 seconds). Therefore, the virtual design 410 can be easily changed by holding a hand, arm, or obstacle between the specific part 302 and the photographing unit 20, or by flapping a T-shirt, so that the specific part 302 is not photographed by the photographing unit 20. In this embodiment, such an excellent user interface is provided. The predetermined extraction condition is not particularly limited, and for example, the virtual design 410 may be extracted according to a predetermined order, or the virtual design 410 may be extracted randomly.

[0069] Furthermore, a second design object can be created with the same design as the augmented reality image printed thereon by sending a favorite virtual design 410 to the printing unit 100. The second design object may be the same type of product as the first design object 300, or may be a different type of product.

[0070] In addition, since the augmented reality design printing system 1 is built into the housing 12, it is compact in size and can be installed in various environments and easily transported. In other words, the augmented reality design printing system 1 is also the world's smallest original T-shirt store where you can virtually try on T-shirts. (Embodiment 2)

[0071] In the first embodiment, the virtual design cannot be changed, but the present invention is not limited to this.

[0072] For example, the augmented reality design printing system according to embodiment 1 may be configured to further include an input unit for inputting information such as characters and pictures, and a virtual design adding unit for adding the information input from the input unit to the virtual design. Note that there is no particular limitation on the locations where the input unit and the virtual design adding unit are attached.

[0073] Here, the input unit is not particularly limited as long as it can input information such as characters, pictures, etc. Examples of the input unit include a keyboard, a smartphone, a notebook computer, a dedicated input device, etc.

[0074] The virtual design adding unit is not particularly limited as long as it can add information input from the input unit to the virtual design. For example, the virtual design adding unit may be a program having such a function. The virtual design adding unit adds information input from the input unit to the virtual design extracted by the virtual design extraction unit, and creates a new virtual design, thereby allowing the virtual design adding unit to be incorporated into the augmented reality design printing system according to the first embodiment.

[0075] By configuring the augmented reality design printing system in this way, it is possible to create a virtual design with new information added and an augmented reality image using the virtual design. In this embodiment, it is possible to display an augmented reality image of an original T-shirt with new information added to the virtual design, and also to produce a T-shirt with the original design by sending the design to the printing unit. (Embodiment 3)

[0076] In the first embodiment, the augmented reality design print system is configured using a main body including a photographing unit, a display unit, and an augmented reality image synthesis unit, but the present invention is not limited to this.

[0077] For example, the augmented reality design printing system may be configured using a so-called smartphone or tablet computer instead of the main body of the first embodiment. The smartphone or tablet computer has at least a camera as a photographing unit and a display as a display unit. The augmented reality design printing system may be configured so that the smartphone or tablet computer has the configuration (internal processing configuration) that the main body of the first embodiment has other than these, or the augmented reality design printing system may be configured so that a video processing server connected to the smartphone or tablet computer via a network has the internal processing configuration.

[0078] If the augmented reality design printing system is configured so that a smartphone, tablet computer, etc. has an internal processing configuration, the smartphone, tablet computer, etc. will have functions similar to those of the main body of embodiment 1, and the same effects as those of the augmented reality design printing system of embodiment 1 can be obtained.

[0079] On the other hand, if the augmented reality design printing system is configured so that the image processing server has an internal processing configuration, the augmented reality image will be displayed on the smartphone display as follows.

[0080] First, when the smartphone camera captures the first design object, the image data is transmitted to the image processing server via the network. The image processing server that receives the image data creates an augmented reality image in the same manner as the main body of the first embodiment, and transmits the augmented reality image data to the smartphone. The smartphone that receives the augmented reality image data displays the augmented reality image on the display. In this way, even if the augmented reality design printing system is configured so that the image processing server has an internal processing configuration, the same effect as the augmented reality design printing system according to the first embodiment can be obtained.

[0081] The image processing server is not particularly limited as long as it has an augmented reality image synthesis unit, and for example, a commercially available personal computer or a dedicated image processing device can be used.

[0082] Needless to say, a smartphone, a tablet computer, or the like may also function as the input unit of the second embodiment. (Embodiment 4)

[0083] In the above-described embodiment, the augmented reality image is displayed and the second design object having the virtual design printed thereon is created, but the present invention is not limited to this.

[0084] The augmented reality design printing system according to the above-described embodiment may be configured to further include a sound output unit that outputs sound based on sound data, a sound data storage unit that stores the sound data, and a sound data extraction unit that extracts sound data from the sound data storage unit based on a virtual design.

[0085] Here, the sound output unit is not particularly limited as long as it can output sound based on sound data. Examples of the sound output unit include speakers. Here, the sound data is not particularly limited as long as it is data related to sound. Examples of the sound data include sound effect data and performance data of a predetermined song. The location where the sound output unit is attached is not particularly limited, but it is desirable to attach it to the back surface of the display unit. By attaching the sound output unit to this position, the augmented reality image displayed on the display unit and the sound work together to improve the amusement property.

[0086] The sound data storage unit is not particularly limited as long as it can store sound data. Examples of the sound data storage unit include commercially available database software.

[0087] The sound data extraction unit is not particularly limited as long as it can extract sound data from the sound data storage unit based on the virtual design. For example, the sound data extraction unit may be a program in which the virtual design and the sound data are uniquely (one-to-one) associated with each other, and which extracts sound data associated with the virtual design extracted by the virtual design extraction unit.

[0088] By configuring the augmented reality design printing system in this way, it is possible to output sounds that match the augmented reality image displayed on the display unit. Specifically, for example, if an original T-shirt of a certain band is displayed on the display unit as the augmented reality image, it is possible to output the music of that band. As a result, it is possible to increase people's desire to purchase a T-shirt with the same design as the augmented reality image.

[0089] It goes without saying that the virtual design storage unit 41 may also function as the sound data storage unit, and the virtual design extraction unit may also function as the sound data extraction unit. (Embodiment 5)

[0090] In the above-described embodiment, the method of controlling the power on / off, the angle of the shooting unit relative to the first design object, the brightness, lightness and contrast of the display unit, and the specified judgment conditions of the identification unit judgment unit is not particularly limited, but the augmented reality design printing system may be configured so that it can be controlled from a remote location.

[0091] For example, it is possible to connect to an information terminal located in a remote location via a network and control at least one of the power on / off, the angle of the shooting unit relative to the first designed object, the brightness, luminance and contrast of the display unit, and the specified judgment conditions of the identification unit judgment unit from the information terminal.

[0092] To turn the power of the augmented reality design printing system on and off, simply install a switch that can turn the power on and off via the network.

[0093] In addition, to adjust the angle of the imaging unit relative to the first design object, an angle adjustment device incorporating a motor that can be controlled from the outside can be attached, and this can be controlled from an information terminal while viewing the image captured by the imaging unit.

[0094] The brightness, luminance and contrast of the display unit and the predetermined judgment conditions of the identification unit judgment unit can be adjusted by installing a personal computer or the like in which such a program is installed and controlling it from an information terminal.

[0095] By configuring the augmented reality design printing system in this manner, it is possible to control the behavior of the augmented reality design printing system (at least one of the power on / off, the angle of the shooting unit relative to the first designed object, the brightness and contrast of the display unit, and the specified judgment conditions of the identification unit judgment unit) from a remote location. (Embodiment 6)

[0096] In the above-described embodiment, no processing was performed on the image captured by the capture unit before the augmented reality image was synthesized by the synthetic image creation unit of the augmented reality image synthesis unit, but the present invention is not limited to this.

[0097] The image captured by the imaging unit is affected by the external environment (external light wavelength, intensity, etc.), and depending on the conditions of the external environment, it may become difficult to distinguish between the virtual design replacement part and parts other than the virtual design replacement part.

[0098] Therefore, for example, the augmented reality design printing system may be configured to have a clarification processing unit that clarifies the difference between the virtual design replacement portion of the first designed object contained in the image captured by the capture unit and the portion other than the virtual design replacement portion.

[0099] Here, the clarification processing unit is not particularly limited as long as it can clarify the difference between the virtual design replacement part of the first design object and the part other than the virtual design replacement part. Specifically, it can be a program that can change the contrast, brightness, brightness, etc. of the image captured by the shooting unit. The clarification processing unit may be built into the shooting unit, or the augmented reality design printing system may be configured to have a personal computer or the like in which the above-mentioned program or the like is built.

[0100] By configuring the augmented reality design printing system in this way, it is possible to distinguish between the virtual design replacement part and the part other than the virtual design replacement part based on data in which the difference between the virtual design replacement part of the first design object and the part other than the virtual design replacement part is clarified by the clarification processing part. As a result, the augmented reality design printing system can easily change the virtual design of the first design object regardless of the external environment, can reliably display an augmented reality image using the virtual design, and can print the same design as the augmented reality image on the second design object. (Other embodiments)

[0101] The augmented reality design printing system of the fourth embodiment may be configured to further include a door detection unit that detects whether the door is open or closed, and an effect improvement unit that causes the sound output unit to output sound effects and the display unit to display a predetermined image (effect image) according to the state of the door detected by the door detection unit. Here, the sound effects and effect images are not particularly limited.

[0102] The door detector is not particularly limited as long as it can detect whether a door inside the housing is opened or closed. Examples of the door detector include commercially available door sensors.

[0103] The effect improving unit is not particularly limited as long as it can cause the sound output unit to output a sound effect and the display unit to display a predetermined image (effect image) according to the state of the door detected by the door detection unit. Examples of the effect improving unit include a program having such functions.

[0104] By configuring the augmented reality design printing system in this way, it is possible to output effective sounds and display effective images on the display unit when the door is opened or closed, thereby improving the amusement properties of the augmented reality design printing system.

[0105] In the first embodiment, the augmented reality image synthesis unit is configured to have a virtual design storage unit, a specific part confirmation unit, a specific part judgment unit, a virtual design extraction unit, and a synthetic image creation unit, but the present invention is not limited thereto. The augmented reality image synthesis unit is not particularly limited in its configuration as long as it can replace at least a part of the image of the first design object photographed by the photographing unit with the virtual design to synthesize the augmented reality image. [Explanation of symbols]

[0106] 1 Augmented reality design and printing system 10 Main unit 11 Door 12. Cabinet 20. Photography Department 30 Display section 40 Augmented reality image synthesis unit 41 Virtual Design Storage 42 Specific Part Confirmation Department 43 Specific Department Judgment Department 44 Virtual Design Extraction 45 Composite Image Creation Department 100 printing department 200 Network 300 First Design 301 Virtual Design Replacement Section 301a T-shirt surface (virtual design replacement section) 301b T-shirt back (virtual design replacement section) 302 Specific section 410 Virtual Design 450 Center position calculation section 451 Placement section 452 Length detector 453 Adjusted Virtual Design Creation Department 454 Synthesis Section

Claims

1. A photographing unit that photographs a first designed object; An augmented reality image synthesis unit that replaces at least a part of the image of the first design object photographed by the photographing unit with a virtual design to synthesize an augmented reality image; a display unit that displays the augmented reality image; a printing unit that prints the virtual design on a second design subject; An augmented reality design and printing system comprising: The first design object is a virtual design replacement portion that is replaced with the virtual design when displayed on the display portion, on at least a portion of the front surface; The augmented reality image synthesis unit includes: a virtual design storage unit for storing a plurality of the virtual designs; a virtual design extraction unit that extracts the virtual design from the virtual design storage unit; a synthetic image creation unit that creates the augmented reality image by replacing the virtual design replacement unit with the virtual design extracted by the virtual design extraction unit, The first design object is Further, the image capturing unit includes a specification unit that indicates that the image includes the first design object when the image capturing unit captures the first design object. The augmented reality image synthesis unit includes: A specific part confirmation unit that confirms whether the specific part is included in the image of the first design object photographed by the photographing unit; a specific part determination unit that determines whether the specific part confirmed by the specific part confirmation unit is photographed so as to satisfy a predetermined determination condition, the virtual design extraction unit extracts the virtual design from the virtual design storage unit based on a determination by the identification unit determination unit; the predetermined determination condition is that the identification unit is not confirmed by the identification unit confirmation unit for a predetermined period of time, the virtual design extraction unit extracts the virtual design from the virtual design storage unit in accordance with a predetermined extraction condition; An augmented reality design and printing system.

2. an input section for inputting character and picture information; a virtual design adding unit that adds the information input from the input unit to the virtual design; The augmented reality design and printing system according to claim 1 , further comprising:

3. Further comprising an invisible light irradiating unit capable of irradiating invisible light, the specific part confirmation unit detects the invisible light reflected by the specific part, and determines whether the specific part is included based on an area of ​​a portion that reflects the invisible light.

3. The augmented reality design printing system according to claim 1 or 2.

4. The synthetic image creation unit includes: a center position calculation unit that calculates the position of the center of the virtual design replacement part in the image of the first design object captured by the imaging unit; an arrangement unit that arranges a center portion of the virtual design at a position of a center portion of the virtual design replacement portion calculated by the center position calculation unit; a length detection unit that detects a length of a predetermined portion of the virtual design replacement unit in the image of the first design object captured by the image capture unit; an adjusted virtual design creation unit that creates an adjusted virtual design by adjusting a length of the virtual design corresponding to a predetermined portion based on a length of the predetermined portion of the virtual design replacement unit; a synthesis unit that synthesizes the augmented reality image by replacing the virtual design replacement unit with the adjusted virtual design; 4. The augmented reality design printing system according to claim 1, further comprising:

5. Further comprising an information terminal connected via a network, The information terminal can control at least one of the power on / off, the angle of the photographing unit relative to the first design object, the brightness, luminance and contrast of the display unit, and the predetermined judgment condition of the identification unit judgment unit.

5. The augmented reality design printing system according to claim 1, wherein the augmented reality design printing system comprises:

6. A clarification processing unit that clarifies the difference between the virtual design replacement part of the first object included in the image captured by the imaging unit and a part other than the virtual design replacement part, 6. The augmented reality design printing system according to claim 1, wherein the augmented reality design printing system comprises:

7. The augmented reality design printing system according to any one of claims 1 to 6, wherein the first design object and the second design object are clothing, a towel, a mask, or a smartphone case.

Citation Information

Patent Citations

  • Method for selling clothing and system for fitting and printing

    JP2003041420A

  • Observation scope

    JP2003264740A

  • Try-on support system using augmented reality

    JP2016004564A

  • Virtual planogram management system and method

    JP2019016375A

  • Devices, systems and methods of capturing and displaying appearances

    WO2014100250A2