High-resolution personal video postcard preparation system and method using photos and videos of different scales

Abstract

The invention relates to a system and method that enables users to create souvenir videos by integrating their own videos or photos into different locations. In particular, the invention relates to a system and method for generating high-resolution videos in which users' images are placed in various locations and zooming in and out can be performed.

Description

[0001] HIGH-RESOLUTION PERSONAL VIDEO POSTCARD PREPARATION SYSTEM AND METHOD USING PHOTOS AND VIDEOS OF DIFFERENT SCALES

[0002] Subject of the Invention and Technical Field

[0003] The invention relates to a system and method that enables users to create souvenir videos by integrating their own photos into different locations. In particular, the invention relates to a system and method for generating high-resolution videos in which users’ images are placed in various locations and zooming in and out can be performed.

[0004] State of the Art photos and videos carry important commemorative value on a personal and cultural level. They remind us of the important moments we share with the people we love. These memories become more precious with the passage of time. Looking at the recordings years later makes us feel as if we are reliving the moment and creates an emotional connection.

[0005] One feature of photos and videos is that they are a way of strengthening relationships with the people they are taken with. Family members, friends and partners take photos to document and remember their time together.

[0006] Individuals interact with their social environment through posts shared on social media. Through these posts, friends and family members follow, comment on, and interact with developments in each other's lives. Sharing posts is an effective way to communicate with people far away and stay up to date.

[0007] Social media is also a platform where people can show who they are, what they are interested in, where they are or how they feel through their posts. People can express themselves and showcase their identities through their posts.

[0008] The most important feature of social media is that posts can reach very large audiences. However, in order to reach large audiences, it is important to make quality posts that attract users' attention. Such posts have higher visibility, stand out among other posts, and are highlighted by the platform.

[0009] There are a variety of ways to make high-definition, engaging videos. These methods require shooting elements such as lighting and gimbals, and a specialized production team. For example, 360-degree photo and video creation services are available. However, these systems require expensive equipment and a qualified production team that can use this equipment.

[0010] Another way to create high-resolution, engaging photos and videos is through video and photo editing applications. With the aforementioned applications, the user can make edits using various filters and methods. In order to make these edits, the user has to have some skills and training. Automated processes are not offered.

[0011] In patent application no. KR102434832 B1, a method of providing a virtual travel service using artificial intelligence-based real-time background separation and object synthesis is presented. It comprises the steps of capturing an image of a tourist destination selected by a user in a 360-degree VR view, using an artificial intelligence algorithm to capture a user's face and body via a camera (8) provided at the front of the user terminal, and displaying a synthesized image by synthesizing the user's face and body in real time against the background of the selected tourist destination.

[0012] Patent application no. US2005099494A1 relates to a method of capturing panoramic images that allows the user to obtain panoramic photos with a digital camera (8) without the aid of a computer system or special lenses. According to the present techniques, a digital camera (8) captures a series of image frames while a user pans the digital camera (8) across a panoramic image scene, and combines the captured image frames as the image frames are captured.

[0013] Patent application no. CN108961166A discloses a panoramic image generation system, a panoramic image generation method and a panoramic image generation device. The panoramic image generation system particularly includes an illumination device, a first image acquisition device, and a server, wherein the illumination device is used to provide light with brightness matching the colors of an object to be photographed; the first image acquisition device is used to acquire appearance images of the object to be photographed; and the server is used to combine a plurality of appearance images of the object to be photographed obtained from the first image acquisition device to form an appearance panoramic image of the object to be photographed.

[0014] There is a need for a new system and method that enables the creation of videos that can be prepared at different scales, that users can keep as a souvenir, and that can attract attention on social media, without an experienced production team and expensive equipment.

[0015] Technical Problems to Be Solved by the Invention

[0016] The main object of the video postcard preparation system and method of the invention is to prepare more impressive and engaging videos with zoom in and zoom out effects in an easy way for the user.

[0017] The advantage of the video postcard preparation system and method of the invention is that it provides businesses and users with an easy and fast video preparation tool.

[0018] Another advantage of the video postcard preparation system and method of the invention is that it enables users to create professional quality videos without a production team thanks to its artificial intelligence-supported technology.

[0019] An advantage of the video postcard preparation system and method of the invention is that it can be applied to different platforms such as desktop, kiosk, mobile, and websites.

[0020] For a better understanding of the video postcard preparation system and method of the invention, the figures given below will be used.

[0021] Description of the Figures

[0022] Figure- 1 shows a schematic view of the video postcard preparation system of the invention. Figure-2 shows a schematic view of the kiosk shooting booth application in the video postcard preparation system of the invention.

[0023] Figure-3 shows a schematic view of the shooting box application in the video postcard preparation system of the invention.

[0024] Figure-4 shows a schematic representation of how the user photo and template images of the invention are combined.

[0025] Figure-5 shows a flowchart of the video postcard preparation method of the invention.

[0026] Reference Numbers of Sections, Parts, and Flow that Help Explain the Invention

[0027] 1. Video postcard preparation system

[0028] 2. Template image

[0029] 3. User photo

[0030] 4. API

[0031] 5. Database

[0032] 6. Server

[0033] 7. Interface

[0034] 8. Camera

[0035] 9. Render service

[0036] 10. User

[0037] 11. Shooting booth

[0038] 12. User's position

[0039] 13. Green wall

[0040] 14. POS device

[0041] 15. Modem

[0042] 16. Power source

[0043] 17. Shooting box

[0044] Method Steps

[0045] 100. Step of location selection

[0046] 200. Step of capturing the template image by gradually zooming out

[0047] 300. Step of image quality enhancement 400. Step of determining the areas on the template where people will be placed

[0048] 500. Step of uploading the created template to the system

[0049] 600. Step of the user uploading the photos

[0050] 700. Step of editing the photos and removing backgrounds

[0051] 800. Step of generating the video with the render service using the template and photos

[0052] 900. Step of video sharing

[0053] Detailed Description of the Invention

[0054] The video postcard preparation system (1) of the invention enables users (10) to use their own photos to create high-quality dynamic souvenir videos using a pre-prepared template. It provides an easy-to-use, fast and effective solution for users (10) and businesses who want to create engaging and original content, especially for social media posts and marketing campaigns.

[0055] The term high-resolution is defined as images used in the description having a resolution compatible with images obtained with DSLR or mirrorless cameras (8) offering a resolution of at least 3840 x 2160 pixels. In addition, "engaging" content creation refers to videos shot at different scales, dynamically integrating user photos (3), and enriched visual elements delivered through artificial intelligence-based effects. In this way, the aim is to create videos that are recognizable on social media platforms and have high interaction potential.

[0056] A schematic view of the video postcard preparation system (1) of the invention is given in Figure-1. A schematic view of the kiosk application of the video postcard preparation system (1) of the invention is given in Figure-2. A schematic view of the shooting box application in the video postcard preparation system of the invention is given in Figure- 3. A schematic representation of how the user photo (3) and template images (2) of the invention are combined is given in Figure-4. A flowchart of the video postcard preparation method of the invention is given in Figure-5.

[0057] The invention is a video postcard preparation system (1) that generates videos with zoom-in and zoom-out effects, comprising the following components:

[0058] • a template image (2) for preparing the template, which is taken using at least one high-resolution DSLR or mirrorless camera (8) and at least one telephoto lens with a focal length of at least 600 mm , starting from the closest distance to the focal point and gradually zooming out, consisting of a total of 5 to 10 photos or a video of up to 1 minute in digital environment,

[0059] • at least one database (5) in which said template images (2) and videos created from said template images (2) are stored,

[0060] • at least one API (4) that accesses the data within said database (5) and records data onto the database (5);

[0061] • at least one server (6) that contains said database (5) and said API (4) components, configured to exchange data using any communication protocol and to execute at least one application thereon,

[0062] • at least one interface (7) through which user photos (3) are uploaded to said server (6) and the output video is delivered to the user (10),

[0063] • and a render service (9) that operates as a 3rd-party application upon request from the server (6) and converts the images sent by the server (6) into a video with zoom-in and zoom-out effects.

[0064] The video postcard preparation system (1) of the invention comprises an artificial intelligence-based image enhancement unit for enhancing the resolution of said template images (2) and for image reproduction. If the resolution of the aforementioned template images (2) is insufficient, if there is not enough detail to increase the resolution, and / or if the photos contain images that disrupt the view, the artificial intelligence based image enhancement unit uses advanced GAN-based artificial intelligence algorithms such as ESRGAN and SRGAN on the image to recreate the photo. Said artificial intelligence based image enhancement unit can be run on said server (6) or as an outsourced service as a 3rd party application. In the video postcard preparation system (1) of the invention, said template images (2) are captured using a high-resolution DSLR or mirrorless camera (8). The shots are taken starting from a focal point and gradually zooming out. The gradual zoom-out process can be achieved by either having the camera on the drone zoom out while recording video or by taking photos by adjusting the lens settings of a camera remaining stable with the help of a tripod-like equipment. A tripod is used to take said template images (2) with said camera (8) in a fixed position. Figure-4 shows the panoramic image resulting from combining the template images (2) and the user photo (3). As a result of taking template images (2) by zooming out, a wider angle and higher quality details are obtained.

[0065] The video postcard preparation system (1) of the invention comprises at least one server (6) that contains said database (5) and said API (4) components, configured to exchange data using any communication protocol and to execute at least one application thereon. Said server (6) can be used as a local or cloud server (6). The local server (6) provides a fast solution with no latency problems when reaching the network.

[0066] The video postcard preparation system (1) of the invention comprises at least one interface (7) through which user photos (3) are uploaded to said database (5) and the output video is delivered to the user (10). Said interface (7) belongs to an electronic device designed for different needs. Through said interface (7), user photos (3) can be uploaded to said server (6). Said electronic device can be a computer, a smart device or can also be designed as a kiosk. Said interface (7) can be developed as a website, mobile application, desktop application.

[0067] The video postcard preparation system (1) of the invention includes a background removal service for removing the background after uploading user photos (3). Said background removal service can be run on said server (6) or as an outsourced service as a 3rd party application. The background removal service uses artificial intelligence solutions developed with the Mask R-CNN (Region-Based Convolutional Neural Networks) algorithm or other CNN-based algorithms. The video postcard preparation system (1) of the invention uses a visual completion unit to correctly complete missing parts of user photos (3). This visual completion unit uses algorithms like Patch Match, DeepFill v2, etc.

[0068] The video postcard preparation system (1) of the invention comprises a mismatch corrector for light adjustment of photos taken under different lighting conditions. Said mismatch corrector utilizes artificial intelligence-based algorithms such as Color Transfer and similar methods. In this way, the color tones of the entire image are matched.

[0069] The use of an example video postcard preparation system (1) of the invention can be in the form of a desktop application or a mobile application. User photos (3) are uploaded to the application. If the background of the uploaded photos needs to be removed, the “Remove Background” option is selected. The uploaded photos and the template to create the video are then selected. The video is created with the render service (9). Optionally, charges can be made by credit or subscription.

[0070] Another application of the video postcard preparation system (1) of the invention is the kiosk application. Figure-2 shows a schematic representation of the kiosk application. The kiosk application includes a shooting booth (11) that is enclosed or made of transparent materials such as plexiglass or glass, designed to prevent light from entering from the outside environment. Said camera (8) is positioned on a wall within said shooting booth (11) and faces the wall opposite the wall on which it is positioned. The invention comprise at least one green wall (13) opposite the camera (8) that facilitates background removal with the green screen application. For the user photo (3) to be taken, the user's position (12) is opposite said camera (8), close to said green wall (13). Said shooting booth (11) includes at least one power source (16) and modem (15). This ensures that the Internet connection and electrical needs of the shooting booth (11) are met without interruption. Said shooting booth (11) also includes a POS device (14) to facilitate payment transactions. Users make the payment themselves without the need for another person.

[0071] In the video postcard preparation system (1) of the invention, the kiosk application can also be realized with a shooting box (17). Figure-3 shows an example design of the shooting box (17). Photos can be taken in open areas using the shooting box (17). Said camera (8) and interface (7) are located on said shooting box. After giving the necessary instructions to take a photo via said interface (7), the user moves into the field of view of said camera (8), settles in a predetermined or described position and waits for the photographing process to take place.

[0072] The video postcard preparation method of the invention allows to obtain high resolution videos with zoom in and zoom out effects from photos. This method allows users (10) to have high-resolution, engaging videos in different locations. When considered in the form of process flow, said method fundamentally consists of the following steps:

[0073] - Step of location selection (100)

[0074] - Step of capturing the template image by gradually zooming out (200)

[0075] - Step of image quality enhancement (300)

[0076] - Step of determining the areas on the template where people will be placed (400)

[0077] - Step of uploading the created template to the system (500)

[0078] - Step of the user uploading the photos (600)

[0079] - Step of editing the photos and removing backgrounds (700)

[0080] - Step of generating the video with the render service using the template and photos (800)

[0081] - Step of video sharing (900).

[0082] Step of location selection (100): Popular and touristic places are selected during the step of location selection. Photos are taken in locations known to everyone, but at angles that not everyone can photograph. This allows people to have video in places where they would like to have a photo, but where it is difficult to get one. Alternatively, businesses such as companies, hotels, municipalities, theme parks may wish to have templates created with their locations or products at the center to support marketing and promotional activities.

[0083] Step of capturing the template image by gradually zooming out (200): At the step of capturing the template image by gradually zooming out, template images (2) are acquired using a 4K resolution DSLR or mirrorless camera (8) and at least one telephoto lens with a focal length of at least 600mm. A tripod is used to ensure that the images are stable. Said template images (2) are captured in digital environment, totaling between 5 to 10 photos or a video of up to 1 minute, starting from the closest distance to the focal point and gradually zooming out. The first image is taken starting from the angle closest to the focal point. This image provides a good quality and clear image in which people can be placed. The “gradually zooming out” step means that the camera (8) starts shooting from the closest distance to the focal point, in a non-limiting embodiment, from approximately a distance of “1” meter, using a 600mm telephoto lens, then moves away by approximately 0.5 meters for each photo frame, up to a total of 5 meters. In this way it will be gradually withdrawn, a little further away each time. This aims to provide a smooth zoom effect in the video. Template images (2) are taken in the same light and weather conditions. This ensures that the images are consistent in terms of color and light.

[0084] Step of image quality enhancement (300): In the step of image quality improvement, adjustments are made if the resolution is not sufficient. If there is not enough detail to increase the resolution, the artificial intelligence-based image enhancement unit uses advanced GAN-based artificial intelligence algorithms such as ESRGAN, SRGAN on the image to reconstruct the images. If there are images in the content of the images that disrupt the view, these are corrected with photo editing applications, these parts are completed or removed by reproduction with artificial intelligence. These images are used to zoom in and out in a video editing application to a focal point that is far away from the angle of a panoramic image. The result is a combination of a panoramic image and a point image. This visually rich video content strengthens users' (10) willingness to share posts.

[0085] Step of determining the areas on the template where people will be placed (400): At the step of determining the areas on the template where people will be placed, the positioning of the images of people in template images (2) is determined manually.

[0086] Step of uploading the created template to the system (500): At the step of uploading the created template to the system, the template file is uploaded to the server (6) via the interface (7) with the locations where people's images will be placed specified.

[0087] Step of the user uploading the photos (600): At the step of the user uploading the photos (3), users (10) upload their desired user photos (3) to the server (6) via the desktop application, mobile application, or web platform, or take a snapshot with the kiosk application and send it to the server (6).

[0088] Step of editing the photos and removing backgrounds (700): In the step of editing the photos and removing backgrounds, the background is removed from the user photo (3) and the user photo (3) is edited to match the template images (2). The users' (10) entire bodies must be visible. If there are missing sections, the visual completion unit uses algorithms such as Patch Match, DeepFill v2. to complete them correctly. To remove the background of user photos (3), the background removal service uses artificial intelligence solutions developed with the Mask R-CNN (Region-Based Convolutional Neural Networks) algorithm or other CNN-based algorithms. In addition, artificial intelligence algorithms such as Color Transfer are used to eliminate color and light incompatibilities of photos taken under different lighting conditions.

[0089] Step of generating the video with the render service using the template and photos (800): At the step of generating the video with the render service using the template and user photos (3), they are placed at predetermined positions. The necessary scaling and rotation of the photo is performed to achieve this placement. Photos are corrected for being sideways or inverted, and the correct angle and direction are determined. In this way, the user photo (3) is accurately positioned within the scene. This process can be performed manually or automatically using an advanced artificial intelligence-based image scaler.

[0090] Step of video sharing (900): In the step of video sharing, the prepared video is presented to the user (10) in a digital environment.

[0091] Industrial Application of the Invention

[0092] The video postcard preparation system and method of the invention is preparation system for engaging and unique video postcards that can be kept as a souvenir or shared on social media platforms, especially for people visiting touristic areas. The invention can be applied across different platforms. For example, it can be adapted to products such as desktops, kiosks, and smart devices. The invention can also be used as a promotional tool. Companies can offer their visitors a different video experience with their own logos and templates.

Claims

CLAIMS1. A video postcard preparation system (1) that generates videos with zoom-in and zoom-out effects, characterized in that it comprises the following components: o a template image (2) for preparing the template, which is taken using at least one high-resolution DSLR or mirrorless camera (8) and at least one telephoto lens with a focal length of at least 600 mm, starting from the closest distance to the focal point and gradually zooming out, consisting of a total of 5 to 10 photos or a video of up to 1 minute in digital environment, o at least one database (5) in which said template images (2) and videos created from said template images (2) are stored, o at least one API (4) that accesses the data within said database (5) and records data onto the database (5), o At least one server (6) that contains said database (5) and said API (4) components, configured to exchange data using any communication protocol and to execute at least one application thereon, o at least one interface (7) through which user photos (3) are uploaded to said server (6) and the output video is delivered to the user (10), o a render service (9) that operates as a 3rd-party application upon request from the server (6) and converts the images sent by the server (6) into a video with zoom-in and zoom-out effects.

2. The video postcard preparation system (1) according to claim 1 , characterized in that it comprises at least one enclosed shooting booth (11) into which the user(10) enters and in which the shootings are carried out.

3. The video postcard preparation system (1) according to claim 2, characterized in that it comprises a camera (8) positioned on a wall within said shooting booth(11) and facing the wall opposite the wall on which it is positioned.

4. The video postcard preparation system (1) according to claim 2, characterized in that it comprises at least one green wall (13) inside said shooting booth (11), which facilitates background removal by green screen application in front of said camera (8).

5. The video postcard preparation system (1) according to claim 2, characterized in that it comprises a user's position (12) within said shooting booth (11), in front of said camera (8), close to the green wall (13).

6. The video postcard preparation system (1) according to claim 1 , characterized in that it comprises at least one shooting box (17) with an open enclosure and comprising said camera (8) thereon, in which the user positions themselves within said camera's (8) field of view to take a photo.

7. The video postcard preparation system (1) according to any one of the preceding claims, characterized in that it comprises at least one local server (6) that does not require a network connection.

8. The video postcard preparation system (1) according to any one of the preceding claims, characterized in that it comprises an artificial intelligence-based image enhancement unit for enhancing the resolution of said template images (2) and for image reproduction.

9. The video postcard preparation system (1) according to any one of the preceding claims, characterized in that it comprises an artificial intelligence-based image enhancement unit using GAN-based artificial intelligence algorithms such as ESRGAN, SRGAN.

10. The video postcard preparation system (1) according to any one of the preceding claims, characterized in that it comprises a background removal service that uses CNN-based artificial intelligence algorithms.

11. A method for generating videos with zoom-in and zoom-out effects, characterized in that it comprises the following steps:- Step of location selection (100)- Step of capturing the template image by gradually zooming out (200)- Step of image quality enhancement (300)- Step of determining the areas on the template where people will be placed (400)- Step of uploading the created template to the system (500)- Step of the user uploading the photos (600)- Step of editing the photos and removing backgrounds (700)- Step of generating the video with the render service using the template and photos (800)- Step of video sharing (900).

12. The method according to claim 11 , characterized in that, in the step of capturing the template image by gradually zooming out (200), it comprises the process steps of capturing said template images (2) in digital environment, between 5 to 10 in total, starting from the closest distance to the focal point and gradually zooming out.

13. The method according to claim 11 , characterized in that, in the step of image quality enhancement (300), it comprises the process steps of reconstructing the template image (2) by an artificial intelligence-based image enhancement unit using GAN-based artificial intelligence algorithms such as ESRGAN, SRGAN.

14. The method according to claim 11 , characterized in that, in the step of image processing and editing (200), it comprises the process steps of removing the background of the user photos (3) by the background removal service using CNNbased artificial intelligence algorithms.

Images