Moving three-dimensional image hologram rendering and printing method and system

Abstract

Provided are a moving three-dimensional image hologram rendering and printing method and system. A hologram production method according to an embodiment of the present invention involves: acquiring a plurality of images constituting a moving image; generating a plurality of images having different vertical viewpoints from the acquired images; and generating a hologram by rearranging the generated images. Accordingly, by producing digital hologram content by expanding a moving image, a moving picture that can only be utilized online can be naturally and three-dimensionally viewed offline, which is the real world.

Description

Method and system for rendering and printing moving three-dimensional image holograms

[0001] The present invention relates to a hologram production technology, and more specifically, to a technology for producing a moving image displayed on a display as a hologram and enabling the display / viewing of the image.

[0002] Figure 1 is a drawing illustrating a moving image (10) primarily used in Internet communities. This moving image (10), also called a GIF, can only be viewed on a computer monitor or a touch screen of a mobile device.

[0003] This situation not only limits users' access to moving images (10) online, but also hinders creators' desire for diverse expression.

[0004] Accordingly, a method is needed to enable diverse use / viewing of moving images (10) through more diverse displays / exhibitions.

[0005] The present invention has been devised to solve the above problems, and the purpose of the present invention is to provide a method and system for rendering and printing a moving 3D image hologram, which is a means for allowing a moving image that can only be used online to be viewed in a three-dimensional manner offline.

[0006] A method for producing a hologram according to one embodiment of the present invention for achieving the above object includes: a step of acquiring a plurality of first images constituting a moving image; a first generation step of generating a plurality of second images having different upper and lower viewpoints from the acquired first images; and a second generation step of rearranging the generated second images to generate a hologram.

[0007] The first generation step may be to generate second images with different upper and lower viewpoints using an oblique projection method.

[0008] A moving image may be an image that can only be displayed on a display.

[0009] The first images may be images taken from different points of view.

[0010] The method for producing a hologram according to the present invention may further include, prior to the first generation step, a step of generating intermediate time point images of the first images and expanding the first images.

[0011] The first generation step may be to generate second images using a machine learning model trained to generate second images at different viewpoints from first images at different viewpoints.

[0012] The machine learning model can be trained to add new secondary images between the secondary images to increase the viewpoint.

[0013] The new second image may be an image related to second images of adjacent viewpoints.

[0014] The method for producing a hologram according to the present invention may further include a step of printing the hologram produced in the second production step on a holographic medium.

[0015] According to another aspect of the present invention, a hologram production system is provided, comprising: a terminal for acquiring a plurality of first images constituting a moving image; a first server for generating a plurality of second images having different vertical viewpoints from the acquired first images; and a second server for generating a hologram by rearranging the generated second images.

[0016] According to another aspect of the present invention, a method for producing a hologram is provided, comprising: a first generation step of generating a plurality of second images having different vertical viewpoints from a plurality of first images constituting a moving image; a second generation step of rearranging the generated second images to generate a hologram; and a step of printing the hologram generated in the second generation step on a holographic medium.

[0017] According to another aspect of the present invention, a hologram production system is provided, comprising: a first server that generates a plurality of second images having different vertical viewpoints from a plurality of first images constituting a moving image; a second server that rearranges the generated second images to generate a hologram; and a holographic printer that prints the generated hologram on a holographic medium.

[0018] As described above, according to embodiments of the present invention, by expanding a moving image, digital holographic content can be created and printed on a holographic medium to be utilized as a hologram, thereby allowing moving pictures that can only be utilized online to be viewed in a natural and three-dimensional manner in the real world offline.

[0019] Figure 1 is an example of a moving image mainly used in Internet communities.

[0020] Figure 2 is a moving image of a single point in time,

[0021] Figure 3 is a moving image of multiple views,

[0022] Figure 4 is a composition of a moving image,

[0023] Figure 5 is a hologram production system according to one embodiment of the present invention;

[0024] Figure 6 is a method for producing a hologram according to another embodiment of the present invention;

[0025] Figure 7 is an example of viewpoint expansion.

[0026] Figure 8 is an example of image rendering and repositioning results.

[0027] Hereinafter, the present invention will be described in more detail with reference to the drawings.

[0028] An embodiment of the present invention presents a method and system for rendering and printing a moving 3D image hologram. This technology enables offline viewing of animated GIFs in three dimensions with a three-dimensional effect by processing a moving image to create a hologram.

[0029] To this end, in the embodiment of the present invention, when rendering a moving object, not only the movement according to the viewpoint of the observer, but also the direction when looking at the object from that viewpoint is considered for rendering, thereby providing a three-dimensional effect and an animation effect at the same time. That is, as illustrated in FIG. 2, an image that performs different movements depending on the viewpoint of the observer may be provided, but rather than a rendering method in which the viewpoint does not change depending on the viewpoint of the observer, as in a flat display, a rendering method in which the viewpoint changes in addition to the movement depending on the viewpoint of the observer is proposed, as illustrated in FIG. 3.

[0030] Specifically, when the observer's viewpoint changes left and right, the object's movement changes, and when the observer's viewpoint changes up and down, the object's viewpoint changes, rendering the hologram content.

[0031] As illustrated in FIG. 4, a moving image (10) is typically composed of approximately 20 to 30 images. However, since it is impossible to create holographic content with only 20 to 30 images, an embodiment of the present invention proposes a method for creating holographic content by extending this.

[0032] FIG. 5 is a diagram illustrating the configuration of a hologram production system according to one embodiment of the present invention. As illustrated, the hologram production system according to the embodiment of the present invention is configured to include a PC (110), an image expansion server (120), a hologram production server (130), and a holographic printer (140).

[0033] PC (110) is a computing system for acquiring moving images that will serve as the basis for producing holograms.

[0034] The image expansion server (120) expands the viewpoint by additionally generating images of intermediate viewpoints between images of different viewpoints that constitute a moving image acquired by the PC (110).

[0035] And the image expansion server (120) generates images with different viewpoints for each image with different viewpoints using an oblique projection method, and at the same time, expands the viewpoints by additionally generating images with intermediate viewpoints between the images.

[0036] The number of images is significantly increased by the image expansion server (120). This corresponds to the processing performed because images from many viewpoints are required to create a digital hologram.

[0037] The creation / expansion of images by the image expansion server (120) is performed using 1) a machine learning model trained to input images of different viewpoints and generate images of intermediate viewpoints, and 2) a machine learning model trained to generate images of different viewpoints from images, while adding new images between the generated images to increase the viewpoints. The added images are images related to images of adjacent viewpoints, i.e., images of intermediate viewpoints.

[0038] Meanwhile, the viewpoint can be expanded vertically (+45° to -45°). +45° is assumed to be a viewpoint looking down at a 45° angle from above, and -45° is assumed to be a viewpoint looking up at a 45° angle from below.

[0039] It is assumed that a moving image, or a moving image with an expanded viewpoint, is composed of 24 images, each with a different viewpoint. In this case, the composition of the images generated through viewpoint generation / expansion by the image expansion server (120) is as follows.

[0040] 1) Image at the 1st viewpoint -> Image at the 45° viewpoint, Image at the 30° viewpoint, Image at the 15° viewpoint, Image at the 0° viewpoint (original), Image at the -15° viewpoint, Image at the -30° viewpoint, Image at the -45° viewpoint,

[0041] 2) Image of the 2nd viewpoint -> Image of 45° viewpoint, Image of 30° viewpoint, Image of 15° viewpoint, Image of 0° viewpoint (original), Image of -15° viewpoint, Image of -30° viewpoint, Image of -45° viewpoint,

[0042] 3) Image of the 3rd viewpoint -> Image of 45° viewpoint, Image of 30° viewpoint, Image of 15° viewpoint, Image of 0° viewpoint (original), Image of -15° viewpoint, Image of -30° viewpoint, Image of -45° viewpoint,

[0043] ...

[0044] 24) Image at the 24th viewpoint -> Image at the 45° viewpoint, Image at the 30° viewpoint, Image at the 15° viewpoint, Image at the 0° viewpoint (original), Image at the -15° viewpoint, Image at the -30° viewpoint, Image at the -45° viewpoint

[0045] The number of images increases significantly by the image expansion server (120), and it is usually desirable to create a total of about 10,000 images, but there is no limit to the number of expanded images.

[0046] The hologram generation server (130) generates digital hologram content using images converted / expanded by the image expansion server (120).

[0047] A holographic printer (140) prints digital hologram content generated by a hologram generation server (130) onto a holographic medium.

[0048] The process of producing a hologram by the system illustrated in FIG. 5 will be described in detail below with reference to FIG. 6. FIG. 6 is a drawing provided to explain a hologram production method according to another embodiment of the present invention.

[0049] To create a hologram, the PC (110) first acquires a moving image that will serve as the basis for creating the hologram (S210). As described above, the moving image can only be displayed on a display and is composed of multiple images, each taken from a different viewpoint.

[0050] The PC (110) transmits the acquired moving image to the image expansion server (120) and requests image expansion. Then, the image expansion server (120) generates images with different upper and lower viewpoints from each of the images with different viewpoints that make up the moving image, thereby increasing the number of images and expanding the viewpoints (S220).

[0051] Figure 7 illustrates the viewpoint expansion by step S220. As shown, the upper image is an image from a viewpoint looking down (+45°), the middle image is an image from a viewpoint looking straight ahead (0°), and the lower image is an image from a viewpoint looking up from below (-45°).

[0052] The next image expansion server (120) requests hologram generation by transmitting the expanded images through step S220 to the hologram generation server (130). Then, the hologram generation server (130) generates digital hologram content using the transmitted images (S230). Fig. 8 shows the result of rendering and rearranging the expanded images through step S220, from which digital hologram content is generated.

[0053] Thereafter, the hologram generation server (130) transmits the generated digital hologram content to a holographic printer (140) and requests hologram printing. Then, the holographic printer (140) prints the received digital hologram content on a holographic medium to produce a hologram (S240).

[0054] The holographic medium printed with digital holographic content through the S240 step allows the holographic content to be viewed offline, such as in an exhibition hall, rather than on a display.

[0055] Meanwhile, before viewpoint expansion in step S220, it is also possible to expand viewpoints, that is, add images with intermediate viewpoints between images with different viewpoints that make up a moving image.

[0056] So far, preferred embodiments of a moving three-dimensional image hologram rendering and printing method and system have been described in detail.

[0057] In the above examples, moving images are expanded to create digital holographic content, which can be printed on a holographic medium to be used as a hologram, allowing moving pictures that can only be used online to be viewed in a three-dimensional 3D format in the real world, offline.

[0058] Meanwhile, it goes without saying that the technical idea of ​​the present invention can also be applied to a computer-readable recording medium containing a computer program that performs the functions of the device and method according to the present embodiment. In addition, the technical idea according to various embodiments of the present invention can be implemented in the form of computer-readable code recorded on a computer-readable recording medium. The computer-readable recording medium can be any data storage device that can be read by a computer and store data. For example, the computer-readable recording medium can be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical disk, a hard disk drive, etc. In addition, the computer-readable code or program stored on the computer-readable recording medium can be transmitted through a network connected between computers.

[0059] In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and various modifications can be made by a person having ordinary skill in the art to which the present invention pertains without departing from the gist of the present invention as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present invention.

Claims

1. A step of acquiring a plurality of first images constituting a moving image; A first generation step of generating a plurality of second images with different upper and lower viewpoints from the acquired first images; and A method for producing a hologram, characterized by including a second generation step of generating a hologram by rearranging the generated second images.

2. In claim 1, The first stage of creation is A method for producing a hologram, characterized by generating second images with different upper and lower viewpoints using an oblique projection method.

3. In claim 1, Moving images, A method for producing a hologram, characterized in that the image can only be displayed on a display.

4. In claim 1, The first images are, A method for producing a hologram characterized by images taken at different times.

5. In claim 4, A method for producing a hologram, characterized in that it further includes a step of generating intermediate time point images of the first images before the first generation step, thereby expanding the first images.

6. In claim 4, The first stage of creation is, A method for producing a hologram, characterized in that second images are generated by using a machine learning model trained to generate second images at different viewpoints from first images at different viewpoints.

7. In claim 6, The machine learning model is, A method for producing a hologram, characterized in that it is learned to add new second images between second images to increase the viewpoint.

8. In claim 7, The new second image is, A method for producing a hologram, characterized in that the image is related to second images of adjacent viewpoints.

9. In claim 1, A method for producing a hologram, characterized by further comprising a step of printing a hologram generated in a second generation step on a holographic medium.

10. A terminal for acquiring a plurality of first images constituting a moving image; A first server that generates a plurality of second images with different upper and lower viewpoints from the acquired first images; and A hologram production system characterized by including a second server that rearranges the generated second images to generate a hologram.

11. A first generation step of generating a plurality of second images having different upper and lower viewpoints from a plurality of first images constituting a moving image; A second generation step of rearranging the generated second images to generate a hologram; and A method for producing a hologram, characterized by comprising a step of printing a hologram generated in a second generation step on a holographic medium.

12. A first server that generates a plurality of second images with different upper and lower viewpoints from a plurality of first images constituting a moving image; A second server that rearranges the generated second images to create a hologram; and A hologram production system, comprising: a holographic printer for printing a generated hologram on a holographic medium;

Images