Apparatus and method for providing photographing service including artificial intelligence-based product advertising function

Abstract

The invention relates to a shooting method with a product advertising function. The method comprises the steps of: receiving at least one image from a photographic device or a user terminal; determining whether the image contains an advertising product by using an advertising product recognition model that takes the image as an input and outputs whether the picture contains the advertising product; and providing an award to the user when the image contains the advertising product.

Description

Technical Field

[0001] This disclosure relates to devices and methods for providing a shooting service that includes product advertising functionality based on artificial intelligence, and more specifically, to devices and methods for providing a service that rewards a user by using an artificial intelligence model to identify images containing advertised products. Background Technology

[0002] Unmanned photo booths offering self-service photo opportunities are becoming new experiential spaces where young people can express themselves and connect with others. Despite smartphones evolving into high-performance cameras, consumers remain enthusiastic about printed photos because they allow them to preserve memories in analog rather than digital form.

[0003] Self-service photo booths have rapidly evolved into various forms, such as self-service studios where users take photos themselves using a remote control, and methods that allow for instant printing at affordable prices.

[0004] For example, Photoism offers self-service photo taking under the concept of unmanned photo studios, operating more than 350 stores nationwide, and that number is growing rapidly.

[0005] Self-service photo booths are an evolution of the popular sticker photo booths of the past. The difference between self-service photo booths and sticker photo booths lies in their offering in the form of various small studios. While past sticker photos primarily focused on people, recent self-service photo booths utilize spacious areas to provide a variety of stage options. Furthermore, unlike in the past, IT technologies such as high-resolution cameras, convenient payment systems, and photo paper remaining notification systems have been integrated, making it not only more convenient for customers to use but also easier for operators to manage.

[0006] Another revenue model for existing photo booths is to generate income by displaying mid-roll advertisements during the printing time of photos taken at the self-service photo booth. Furthermore, it is activating additional revenue streams beyond photo taking, such as website advertisements that allow users to download photos taken at the self-service photo booth.

[0007] However, recently, advertisers have increasingly needed to improve advertising effectiveness by directly showcasing advertised products in photos taken by their clients. Summary of the Invention

[0008] Technical issues Existing selfie services face low advertising effectiveness because their revenue generation methods rely primarily on indirect advertising, such as mid-roll ads and website ads.

[0009] Therefore, the problem that this invention seeks to solve is to address these existing problems and to provide a new method that can deliver a direct advertising effect by photographing the customer and the advertised product together when the customer uses the selfie service.

[0010] Therefore, the inventors of this disclosure attempt to develop a method that determines whether an image contains an advertised product by means of an artificial intelligence model, and provides a reward to the user when the advertised product is contained in an image captured in a customer's self-service photo service.

[0011] The tasks of this disclosure are not limited to those described above, and those skilled in the art will clearly understand from the following description other tasks not mentioned.

[0012] Solution to the problem To address the objectives of this disclosure, a shooting method incorporating product advertising functionality is provided according to an embodiment of this disclosure. The method includes: receiving at least one image from a shooting device or a user terminal; determining whether the image contains an advertised product by using an advertising product recognition model that takes the image as input and outputs whether the image contains an advertised product; and providing a reward to the user when the image contains an advertised product.

[0013] According to the features of this disclosure, it also includes providing assistance to the shooting device in taking pictures, and the assistance in taking pictures containing the advertised product may be shooting assistance regarding at least one of the following: product exposure range for identifying the advertised product, the position or size of the advertised product in the picture, or exposure conditions for characters or product names contained in the advertised product.

[0014] According to the features of this disclosure, the advertising product recognition model may include an object recognition model and a character recognition model for images.

[0015] According to the features of this disclosure, it may also include: receiving information from the shooting device about the advertised product selected by the user, and providing the user with a recommended background image based on the identifier of the advertised product.

[0016] According to another feature of this disclosure, the identifier of the advertised product may contain information about the characteristics of the advertised product, including the color, type, and target customer group of the advertised product.

[0017] According to another feature of this disclosure, providing rewards to users can be differentiated based on at least one of the following: the number of advertised products contained in an image, the number of images containing advertised products, or the proportion of the area occupied by advertised products in an image.

[0018] According to another feature of this disclosure, providing user rewards may include: providing a shooting reward of changing an existing shooting frame to a private frame for free, or providing a reward of additional opportunities to shoot in a private frame for a fee.

[0019] To address the aforementioned issues, a system for providing a shooting service incorporating product advertising functionality, according to an embodiment of this disclosure, is provided. The system includes: a shooting device configured to capture at least one image, a user terminal, and a server configured to determine whether an image contains an advertising product by using an advertising product recognition model that takes the image as input and outputs whether the image contains an advertising product, and to provide a reward to the user when the image contains an advertising product.

[0020] According to one feature of this disclosure, the capturing device is also configured to receive assistance in capturing images, which may be shooting assistance regarding at least one of the following: product exposure range for identifying the advertised product, the position or size of the advertised product in the image, or exposure conditions for characters or product names contained in the advertised product.

[0021] According to another feature of this disclosure, the advertising product recognition model may include an object recognition model and a character recognition model for images.

[0022] According to another feature of this disclosure, the shooting device is configured to send an advertising product selected by the user to a server, which can also be configured to provide the user with a recommended background for the image based on the identifier of the advertising product.

[0023] According to another feature of this disclosure, the identifier of the advertised product may contain information about the characteristics of the advertised product, including the color, type, and target customer group of the advertised product.

[0024] According to another feature of this disclosure, the server can differentiate the reward based on at least one of the number of advertised products contained in the image, the number of images containing advertised products, or the area occupied by the advertised products in the image.

[0025] According to another feature of this disclosure, the server can also be configured to offer a shooting reward of changing an existing shooting frame to a private frame for free, or to offer a reward of additional opportunities to shoot in a private frame for a fee.

[0026] To address the aforementioned problems, a shooting device incorporating product advertising functionality according to another embodiment of this disclosure is provided. The shooting device includes a display unit, an interface unit, a shooting unit, an output unit, and a control unit, wherein the control unit includes a memory and one or more processors executing a program loaded in the memory. The program includes instructions for receiving at least one image from the shooting device or a user terminal, instructions for determining whether an image contains an advertised product using an advertising product recognition model that takes the image as input and outputs whether the image contains the advertised product, and instructions for providing a reward to the user when the image contains the advertised product.

[0027] Other specific details of this implementation scheme are included in the detailed description and accompanying drawings.

[0028] Advantages of the invention According to one embodiment of this disclosure, by determining whether the image captured by the shooting device contains the advertised product and providing a reward to the user when the image contains the advertised product, active user participation can be induced, and since the advertised product is directly promoted in the form of user participation, a high promotional effect can be expected.

[0029] Furthermore, according to one embodiment of this disclosure, by providing assistance to the shooting device in capturing images, the malfunctions of the advertising product recognition model, which takes images as input and outputs whether the images contain the advertised products, can be reduced, thereby improving the accuracy of the advertising product recognition model.

[0030] Furthermore, according to one embodiment of this disclosure, when the advertised product is included in the image, a higher promotional effect can be expected by providing users with more opportunities to take rewarded photos using private frames.

[0031] Furthermore, according to one embodiment of this disclosure, when users select actual social media, chat applications, etc., and pay rewards, operators can maximize the exposure of advertised products.

[0032] The various advantages and effects of this disclosure are not limited to those described above; this specification also includes many other different effects. Attached Figure Description

[0033] Figure 1a This is a conceptual diagram illustrating a system for providing a shooting service that includes product advertising functions according to an embodiment of this disclosure.

[0034] Figure 1b This is a block diagram illustrating an exemplary configuration of a system for providing shooting services according to an embodiment of this disclosure.

[0035] Figure 2 This is a block diagram illustrating the configuration of a user terminal according to an embodiment of this disclosure.

[0036] Figure 3 This is a block diagram illustrating an exemplary hardware configuration that can be implemented by a server system or each server included in a server system according to an embodiment of this disclosure.

[0037] Figure 4a and Figure 4b This is a block diagram illustrating an exemplary configuration of a camera device providing a camera service according to an embodiment of this disclosure.

[0038] Figure 5 This is a conceptual diagram illustrating a processor for a system that provides conventional shooting services.

[0039] Figure 6 This is an example diagram showing the interface screen of a user terminal that provides a shooting service including product advertising functions according to an embodiment of this disclosure.

[0040] Figure 7 This is a flowchart schematically illustrating the process of a shooting device for a system that provides shooting services including product advertising functions according to an embodiment of this disclosure.

[0041] Figure 8 This is a flowchart schematically illustrating the movement process of a system providing a shooting service including product advertising functions according to another embodiment of this disclosure.

[0042] Figure 9 This is a flowchart illustrating the operation method of a system for providing a shooting service including product advertising functions according to an embodiment of this disclosure.

[0043] Figure 10 Figures 1 to 14 are example diagrams showing the interface screen of a user terminal or kiosk that provides a shooting service including product advertising functions according to an embodiment of the present disclosure. Detailed Implementation

[0044] The advantages and features of this disclosure and the methods of implementing it will become apparent from the following detailed description of the embodiments and the accompanying drawings. However, this disclosure is not limited to the embodiments disclosed below, but will be implemented in various different forms. These embodiments are provided merely to complete this disclosure and to fully inform those skilled in the art to which this disclosure pertains, which is defined only by the scope of the claims. In the drawings, similar reference numerals may be used for similar elements.

[0045] Here, expressions such as “have,” “may have,” “include,” “may contain,” “include,” or “may include” refer to the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of other features.

[0046] In this disclosure, the expressions “A or B”, “at least one of A and / or B”, or “one or more of A and / or B” can include all possible combinations of the items listed together. For example, “A or B”, “at least one of A and B”, or “at least one of A or B” can all mean (1) containing at least one A, (2) containing at least one B, or (3) containing both at least one A and at least one B.

[0047] The expressions “first,” “second,” “first,” or “second” as used in this disclosure may describe various components regardless of their order and / or importance, and are used only to distinguish one component from another, but do not limit these components. For example, a first user terminal and a second user terminal may refer to different user terminals regardless of their order or importance. For example, without departing from the scope of the rights set forth in this disclosure, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component.

[0048] When a component (e.g., a first component) is described as being "(operably or communicatively) coupled" / "coupled to" or "connected to" another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component or may be connected via another component (e.g., a third component). Conversely, when a component (e.g., a first component) is described as being "directly coupled" or "directly connected" to another component (e.g., a second component), it is understood that there are no other components (such as a third component) between the first component and the other component.

[0049] The expression “configured (or set) as” as used herein can be used interchangeably with the context, such as “suitable,” “capable,” “designed to,” “adapted,” “manufactured to,” or “able to.” The term “configured (or set) as” does not necessarily mean “specifically designed for” in a hardware sense. Rather, in some contexts, the phrase “device configured as” can mean that the device, together with other devices or components, is “capable” of performing a certain action. For example, the phrase “processor configured (or set) to perform A, B, and C” can refer to a dedicated processor (e.g., an embedded processor) used to perform these operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform these operations by running one or more software programs stored in a memory device.

[0050] The terminology used herein is for the purpose of describing specific embodiments only and is not intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly indicates otherwise. The terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art described herein. Terms used herein that are defined in general dictionaries may be interpreted as having the same or similar meaning in the context of the relevant art, and are not to be interpreted in an ideal or overly formal sense unless explicitly defined herein. In some cases, even if a term is defined herein, it should not be construed as excluding the embodiments described herein.

[0051] Each feature of the various embodiments of this disclosure can be combined or integrated with each other in part or in whole, and those skilled in the art will readily understand that various technological interconnections and operations are possible. Each embodiment can be implemented independently of each other, or can be implemented together in a related manner.

[0052] To clarify the interpretation of this specification, the terminology used herein will be defined as follows.

[0053] The term "capture device" refers to an unmanned information device used for taking pictures. When using a capture device, people can view the captured images via a touchscreen and print them out immediately after taking the picture using a remote control or timer. Capture devices can also be called "capture booths," "photo booths," or "picture booths." Although the embodiments of this disclosure are described herein as being performed by a capture server, in some cases, they can also be performed by the capture device.

[0054] The term "picture" refers to a photograph captured by the imaging unit of an imaging device. A picture may include one or more users, and the photo output may contain one or more pictures. According to one embodiment, "picture" may refer to a picture or a portion of a video clip printed on the photo output.

[0055] The term "advertised product" refers to a product for which a promotional request has been received from an advertiser. In this context, advertised products can include pharmaceuticals, learning materials, snacks, cosmetics, beverages, merchandise (such as photo cards, cheerleaders, keychains), company logos, clothing, etc., but this is just one example and not an exception. According to one implementation plan, advertised products can include movies, alcoholic beverages, insurance, etc.

[0056] The term "photo print" refers to a printed photograph output from a photographic device. Photo prints can also be called watermarked photos and can be in the form of stickers.

[0057] The term "application" refers to a photo application that provides users with various functions using a self-portrait service linked to server system 200 and / or shooting device 300. For example, a user can use the "application" to search for nationwide stores in the country, participate in promotional activities for advertised products, and earn rewards for doing so.

[0058] The following will describe in detail, with reference to the accompanying drawings, the apparatus and method for providing a shooting service that includes artificial intelligence-based product advertising functions according to the present disclosure.

[0059] Figure 1a This is a diagram illustrating a system for providing a shooting service that includes product advertising functions and a screen displayed on a user terminal, according to an embodiment of this disclosure.

[0060] Reference Figure 1a According to the present disclosure, the system 1000 (hereinafter referred to as the self-shooting system) that provides shooting services including product advertising functions may include a user terminal 100, a user interface providing server 200 (hereinafter referred to as the shooting server 200, which includes product advertising functions) and a shooting device 300.

[0061] User terminal 100 can be a device held by a user who wishes to use camera 300 to take a self-portrait. User terminal 100 can be a portable digital device equipped with storage and a microprocessor with computing capabilities, such as a smartphone, tablet, personal computer, or laptop, and is not limited to a specific form. In various embodiments, user terminal 100 can download video material, such as captured images, and transmit it to camera server 200, which includes product advertising functionality. In another embodiment, user terminal 100 can capture images and send them to camera server 200, which includes product advertising functionality.

[0062] A camera server 200 with product advertising functionality can determine whether a captured image contains an advertising product by using an advertising product recognition model with an image from a camera device 300 as input. If the image contains an advertising product, the camera server 200 with product advertising functionality can provide a reward to the user terminal 100. According to this embodiment, if the camera server 200 automatically, semi-automatically, or manually uploads a user-captured image to social media or sets it as a profile in a chat application, it can provide a reward to the user terminal 100. For example, according to an embodiment of this disclosure, a user can upload a captured image to social media and capture the uploaded post to register with an application of an operator providing camera equipment and / or camera services. In this case, the camera server 200 or the application can identify features of the uploaded post, such as the user's ID, tags, etc., using OCR or image recognition to determine whether the post has been uploaded. If the identified user-uploaded post or profile contains an advertising product, the camera server 200 can provide a reward to the user terminal 100. As users receive rewards for actual social media, chat applications, etc., operators can maximize the exposure of advertising products.

[0063] Here, the rewards provided to user terminal 100 may include points or privacy frames, and this disclosure is not limited to these. For example, it may include lottery tickets that can be drawn in activities operated by the operator, or lottery tickets that increase the chances of winning in activities held by advertisers. Meanwhile, the camera server 200, which includes product advertising functionality, can receive and store images, camera equipment information, user data, matching data, etc. The camera server 200, which includes product advertising functionality, can provide users with an identification code that allows access to the location where photos taken by the camera device 300 are stored. The identification code that allows access to the photo storage location may include a barcode and / or a QR code. The identification code may be printed on the photo output along with the photo. Furthermore, when user terminal 100 recognizes the identification code, the camera server 200, which includes product advertising functionality, can respond to a request for the captured image and provide the image to user terminal 100. The camera server 200, which includes product advertising functionality, may include a device database server, a content management system (CMS) database server, a storage server, and a mobile database server. Figure 2 The document details the specifications of the camera server 200, which includes product advertising capabilities.

[0064] The shooting device 300 is configured to provide a selfie service that allows users to take and print their own photos. The shooting device 300 can generate resources (e.g., the captured image) after shooting and upload them to a touchscreen. The shooting device 300 can print photo outputs containing the image and an identification code. According to this embodiment, the shooting device 300 can provide the image to the shooting server 200 in digital file form and then provide it to the user terminal 100 while using AI to determine whether the image contains advertised products. Furthermore, the shooting device 300 can provide printed photo outputs and also provide the captured image to the user in digital file form. More detailed configuration of the shooting device 300 is available in... Figure 3 a and Figure 3 Details are provided in section b.

[0065] Figure 1b This is a block diagram illustrating an exemplary configuration of a system for providing shooting services according to an embodiment of this disclosure.

[0066] Reference Figure 1b The camera server 200, which includes product advertising functionality, can include a device database server 210, a CMS database server 220, a storage server 230, and a mobile database server 240 to manage and store each piece of data. Figure 1b Although each server is shown as a separate configuration, the invention is not limited thereto, and each server shown does not necessarily need to be implemented as a separate configuration; two or more servers can be implemented as one server, or configured as modules that perform corresponding functions within one server.

[0067] Device DB server 210 can be a server used to manage the shooting device 300 through communication. In this case, device DB server 210 can receive and store device information of the shooting device 300 and provide it to the shooting device manager. The device information of the shooting device 300 may include basic information about the shooting device 300 (e.g., ID, hardware information), information required for communication with the shooting device 300, printer status (e.g., remaining paper, printer errors), software program operation status information, software program update information, etc. Furthermore, device DB server 210 can manage the operation status of the shooting device 300 in real time (e.g., normal operation, idle state, error occurrence, etc.). According to one implementation, device DB server 210 can use AI to determine whether the advertised product is included in the image.

[0068] CMS DB server 220 can be a server used to store user data and / or stored information (such as URLs). A CMS (Content Management System) is a system that allows the camera device manager to intuitively manage content. User data may include captured images, historical data indicating whether an advertised product is included in the image (determined by an advertised product recognition model), data from user-selected boxes, payment information, matching data matching resource and member information, etc. CMS DB server 220 can receive and store captured images from camera device 300 and provides an API for uploading images to storage server 230.

[0069] Storage server 230 may be a server used to store images captured from shooting device 300 by communicating with CMS DB server 220 and / or mobile DB server 240, etc. Storage server 230 may provide user-captured images from stored resources (e.g., captured images) to user terminal 100 based on matching data stored in CMS DB server 220.

[0070] Mobile DB server 240 can be a server used to store member information and / or file address information. For example, mobile DB server 240 can receive image requests from user terminal 100 and transmit member information stored in CMS DB server 220. Mobile DB server 240 does not store captured image files, but can store file address information that allows users to download directly from the application or storage server 230.

[0071] like Figure 1b As shown, the shooting device 300, the shooting server 200 including product advertising functions, and the various servers 210, 220, 230, and 240 that constitute it can exchange data with the user terminal 100 through a communication network. The communication network according to one embodiment of this disclosure can be configured regardless of the communication mode (e.g., wired or wireless communication) and can be configured as various communication networks, such as a local area network (LAN), a metropolitan area network (MAN), or a wide area network (WAN). Preferably, the communication network mentioned in this specification can be the known Internet or the World Wide Web (WWW). However, the communication network can at least partially include, but is not limited to, known wired and wireless data communication networks, known telephone networks, or known wired or wireless television communication networks. For example, the communication network can be a wireless data communication network that at least partially implements conventional communication methods, such as WiFi communication, WiFi Direct communication, Long Term Evolution (LTE) communication, 5G communication, Bluetooth communication (including Bluetooth Low Energy (BLE) communication), infrared communication, ultrasonic communication, etc. As another example, the communication network can be an optical communication network that at least partially implements conventional communication methods (such as LiFi).

[0072] Figure 2 This is a block diagram illustrating the configuration of a user terminal according to an embodiment of this disclosure.

[0073] Reference Figure 2 The user terminal 100 may include a memory interface 110, one or more processors 120, and a peripheral interface 130. Various components within the user terminal 100 may be connected via one or more communication buses or signal lines.

[0074] The memory interface 110 can be connected to the memory 150 to transfer various types of data to the processor 120. Here, the memory 150 may include at least one of the following storage media: flash memory, hard disk memory, multimedia card micro, card-type memory (e.g., SD or XD memory), RAM, SRAM, ROM, EEPROM, PROM, network storage, cloud or blockchain database.

[0075] In various implementations, memory 150 may store at least one of an operating system 151, a communication module 152, a graphical user interface (GUI) module 153, a sensor processing module 154, a telephone module 155, and an application module 156. Specifically, the operating system 151 may contain instructions for processing basic system services and instructions for performing hardware operations. The communication module 152 may communicate with at least one of one or more other devices, computers, and servers. The GUI 153 may handle the graphical user interface. The sensor processing module 154 may handle sensor-related functions (e.g., processing voice input received using one or more microphones 192). The telephone module 155 may handle telephone-related functions. The application module 156 may execute various functions of a user application, such as electronic messaging, web browsing, media processing, navigation, imaging, and other processing functions. Furthermore, user terminal 100 may store one or more software applications 156-1, 156-2 associated with a specific type of service in memory 150. In this case, application 156-1 refers to a photo application that provides various functions to the user using a selfie service on user terminal 100. Here, users can use the 156-1 app to search for stores that offer selfie services, view promotional activities for advertised products, upload photos of advertised products taken by the user, and earn rewards for doing so.

[0076] In various implementations, memory 150 may store digital assistant client module 157 (hereinafter referred to as DA client module), and correspondingly store instructions for performing client functions of the digital assistant and various user data 158 (e.g., other data such as user data, information on user participation in activities, information on winning activities, etc.).

[0077] On the other hand, the DA client module 157 can obtain the user's voice input, text input, touch input and / or gesture input through various user interfaces (e.g., I / O subsystem 140) provided on the user terminal 100.

[0078] Furthermore, the DA client module 157 can output data in audiovisual and tactile forms. For example, the DA client module 157 can output data consisting of at least two or more combinations of voice, sound, notifications, text messages, menus, graphics, video, animation, and vibration. Additionally, the DA client module 157 can communicate with a digital assistant server (not shown) using the communication subsystem 180.

[0079] In various implementations, the DA client module 157 can collect additional information about the environment surrounding the user terminal 100 from various sensors, subsystems, and peripheral devices to construct a context associated with user input. For example, the DA client module 157 can provide contextual information along with user input to the digital assistant server to infer the user's intent. Here, the contextual information accompanying the user input can include sensor information, such as lighting, ambient noise, ambient temperature, images, videos, etc., of the surrounding environment. As another example, the contextual information can include the physical state of the user terminal 100 (e.g., device orientation, device location, device temperature, power level, speed, acceleration, motion pattern, cellular signal strength, etc.). As yet another example, the contextual information can include information related to the software state of the user terminal 100 (e.g., processes running on the user terminal 100, installed programs, past and current network activity, background services, error logs, resource usage, etc.).

[0080] In various implementations, memory 150 may contain append or delete instructions; furthermore, user terminal 100 may contain... Figure 2 Additional configurations beyond those shown, or some configurations that can be excluded.

[0081] The processor 120 can control the overall operation of the user terminal 100 and can use applications or programs stored in the memory 150 to execute various commands for implementing a photo-taking service interface that includes artificial intelligence-based product advertising functions.

[0082] The processor 120 may correspond to a computing device such as a central processing unit (CPU) or an application processor (AP). Furthermore, the processor 120 may be implemented as an integrated chip (IC), for example, as a SoC (System-on-a-Chip) that integrates various computing devices such as an NPU (Neural Processing Unit).

[0083] Peripheral interface 130 can provide data to enable user terminal 100 to perform various functions by connecting to various sensors, subsystems, and peripheral devices. It is understood here that any function performed by user terminal 100 is performed by processor 120.

[0084] Peripheral interface 130 can receive data from motion sensor 160, illumination sensor (light sensor) 161, and proximity sensor 162, allowing user terminal 100 to perform functions such as orientation, light, and proximity detection. Alternatively, peripheral interface 130 can receive data from other sensors 163 (positioning system - GPS receiver, temperature sensor, biometric sensor), allowing user terminal 100 to perform functions related to those other sensors 163.

[0085] In various implementations, user terminal 100 may include a camera subsystem 170 connected to peripheral interface 130 and an optical sensor 171 connected thereto, allowing user terminal 100 to perform various imaging functions, such as taking photos and recording video clips.

[0086] In various implementations, user terminal 100 may include a communication subsystem 180 connected to peripheral interface 130. The communication subsystem 180 may consist of one or more wired / wireless networks and include various communication ports, radio frequency transceivers, and optical transceivers.

[0087] In various implementations, user terminal 100 may include an audio subsystem 190 connected to peripheral interface 130, and the audio subsystem 190 includes one or more speakers 191 and one or more microphones 192, allowing user terminal 100 to perform voice operation functions, such as voice recognition, voice playback, digital recording and telephone functions.

[0088] In various implementations, user terminal 100 may include an I / O subsystem 140 connected to peripheral interface 130. For example, I / O subsystem 140 may control touchscreen 143 included in user terminal 100 via touchscreen controller 141. For example, touchscreen controller 141 may use any of a variety of touch sensing technologies (e.g., capacitive, resistive, infrared, surface acoustic wave, proximity sensor array, etc.) to detect user touch and movement or interruption of touch and movement. As another example, I / O subsystem 140 may control other input / control devices 144 included in user terminal 100 via other input controller 142. For example, other input controller 142 may control pointing devices such as one or more buttons, joystick switches, thumbwheels, infrared ports, USB ports, and styluses.

[0089] Figure 3This is a block diagram illustrating an exemplary hardware configuration that can be implemented by a server system or each server included in a server system according to an embodiment of this disclosure.

[0090] Reference Figure 3 The camera server 200, which includes product advertising functionality, may include a communication interface 210, a memory 220, an I / O interface 230, and a processor 240, and each component can communicate with each other through one or more communication buses or signal lines. (See reference...) Figures 1a to 1b The shooting server 200 that provides the service can be a shooting server 200 that includes product advertising functions.

[0091] The communication interface 210 can connect to the shooting equipment and / or user terminal via a wired / wireless communication network to exchange data.

[0092] For example, communication interface 210 can receive user information, payment information, images, device status information, etc., from the shooting device. Furthermore, communication interface 210 can receive image requests from the user terminal. As another example, communication interface 210 can send control information to the shooting device to control it. Communication interface 210 can send images to the user terminal. Additionally, communication interface 210 can send the user terminal a determination of whether the image contains an advertised product, based on an advertising product recognition model. Furthermore, if the image contains an advertised product, communication interface 210 can offer a reward to the user. In this case, the reward may include points or a privacy frame.

[0093] Simultaneously, the communication interface 210, capable of sending and receiving such data, includes a wired communication port 211 and a wireless circuit 212. The wired communication port 212 may include one or more wired interfaces, such as Ethernet, Universal Serial Bus (USB), FireWire, etc. Furthermore, the wireless circuit 212 can send and receive data with external devices via RF signals or optical signals. Moreover, wireless communication can utilize various communication standards, protocols, and technologies, such as at least one of GSM, EDGE, CDMA, TDMA, Bluetooth, Wi-Fi, VoIP, Wi-MAX, or any other suitable communication protocol.

[0094] The memory 220 can store various data used in the selfie service. For example, the memory 220 can store device information of the shooting device, user data, storage information, captured images, membership information, results output from the advertising product recognition model, and / or file address information.

[0095] In various implementations, memory 220 may include volatile or non-volatile recording media capable of storing various data, instructions, and information. For example, memory 220 may include at least one storage medium selected from flash memory, hard disk memory, multimedia card microstorage, card-type memory (such as SD or XD memory), RAM, SRAM, ROM, EEPROM, PROM, network storage, cloud, and blockchain databases.

[0096] In various implementations, memory 220 may store at least one configuration of operating system 221, communication module 222, user interface module 223, and one or more applications 224.

[0097] Operating systems 221 (e.g., LINUX, UNIX, MAC OS, WINDOWS, VxWorks, etc.) can contain various software components and drivers to control and manage general system operations (e.g., memory management, storage device control, power management, etc.) and can support communication between various hardware, firmware, and software components.

[0098] The communication module 222 can support communication with other devices through the communication interface 210. The communication module 222 may contain various software components for processing data received by the wired communication port 211 or the wireless circuit 212 of the communication interface 210.

[0099] The user interface module 223 can receive user requests or inputs from a keyboard, touch screen, mouse, microphone, etc. via I / O interface 230, and can provide a user interface on the display.

[0100] Application 224 may contain programs or modules configured to be executed by one or more processors 240. Here, an application for a selfie service can be implemented on a server farm.

[0101] I / O interface 230 can connect I / O devices (not shown) of server 200 for providing shooting services to user interface module 223, such as at least one of a display, keyboard, touch screen, and microphone. I / O interface 230 can receive user input (e.g., voice input, keyboard input, touch input, etc.) together with user interface module 223, and can process commands based on the received input.

[0102] The processor 240 can be connected to the communication interface 210, the memory 220 and the I / O interface 230 to control the overall operation of the server 200 to provide shooting services, and can execute various commands to download captured pictures or corresponding time-lapse videos to the user terminal through the application or program stored in the memory 220.

[0103] Processor 240 may correspond to a computing device such as a central processing unit (CPU) or an application processor (AP). Furthermore, processor 240 may be implemented as an integrated chip (IC), for example, as a system-on-a-chip (SoC) integrating various computing devices. Alternatively, processor 240 may include modules for computing artificial neural network models, such as a neural processing unit (NPU).

[0104] Figure 3 This is merely one implementation scheme for configuring server 200, and server 200 may have omitted features. Figure 3 Some of the components shown include Figure 3 Additional components not shown, or a configuration or arrangement combining two or more components. Components that may be included in server 200 may be implemented as hardware, software, or a combination of both, and may include one or more signal processing or application-specific integrated circuits.

[0105] Figure 4a and Figure 4b This is a block diagram illustrating an exemplary configuration of a camera device providing a camera service according to an embodiment of this disclosure.

[0106] Reference Figure 4a According to one embodiment of the present disclosure, the shooting device 300 may include a display unit 301, an interface unit 302, a power supply unit 303, a communication unit 304, a payment unit 305, a control unit 310, a shooting unit 321, an output unit 322, a sensor unit 323, and an illumination unit 324.

[0107] Display unit 301 can display various information related to the operation of shooting device 300. For example, display unit 301 can display menus about shooting services, the appearance of the subject, etc. Furthermore, display unit 301 can display user interface (UI) and graphical user interface (GUI) information based on the displayed images. The specific description of the information displayed by display unit 301 described above is merely an example, and this disclosure is not limited thereto.

[0108] The display unit 301 may include at least one of liquid crystal display (LCD), thin film transistor liquid crystal display (TFT LCD), organic light-emitting diode (OLED), flexible display, 3D display, electronic ink display and light-emitting diode (LED).

[0109] Interface unit 302 is configured to receive user input required for shooting services such as shooting and printing, and can be implemented using a physical keyboard, dome switch, touchpad, stick, joystick, etc., and is not limited thereto. In one embodiment of this disclosure, display unit 301 can be implemented as a touch screen by forming a touch sensor and interlayer structure, or as an integrated unit. Such a touch screen can be used both as display unit 301 of shooting device 300 and as interface unit 302.

[0110] The power supply unit 303 can supply power to all or some of the components of the shooting device 300. For example, the power supply unit 303 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or any other components for generating, managing, and distributing power.

[0111] The communication unit 305 allows the capturing device 300 to send and receive data with a server system or external devices via a communication network. The capturing device 300 can bidirectionally send and receive data about captured images, user information, and links to storage devices storing image data with the server system via the communication unit 305.

[0112] Payment unit 305 allows users to pay for services provided by camera 300 using cards, cash, mobile payments, cryptocurrencies, coupons, barcodes, two-dimensional barcodes, etc.

[0113] The control unit 310 can perform overall control of the shooting device 300. In one embodiment of this disclosure, after selecting shooting conditions through the interface unit 302 and processing payment through the payment unit 305, the control unit 310 can control the shooting unit 321 to shoot the object, and then input the shooting command again through the interface unit 305. The control unit 310 can receive the captured images and send them to the server system through the communication unit 305. The control unit 310 can receive download URL links from the server system to access the corresponding images, and based on this, control the output unit 322 to issue a QR code.

[0114] In one embodiment of this disclosure, the control unit 310 may include a processor 311 and a memory 312.

[0115] The control unit 310 may include one or more processors 311. The one or more processors 311 included in the control unit 310 may be integrated into a single chip or physically separated. Furthermore, the processor 311 and memory 312 may also be implemented as a single chip. Memory 312 may include volatile memory, such as SRAM, DRAM, and non-volatile memory, such as flash memory, read-only memory (ROM), and erasable programmable read-only memory (EPROM).

[0116] The shooting unit 321 can capture objects located in the shooting space of the shooting device 300 in response to control signals from the control unit 310.

[0117] Output unit 322 can print out a photo output containing a QR code, which allows access to the captured photo image and images stored in the server system. In one embodiment of this disclosure, capturing unit 321 and output unit 322 may each include a camera and a printer.

[0118] The sensor unit 323 can detect whether the user is in front of the shooting device 300, or whether the user's movements are in front of the shooting device 300.

[0119] The illumination unit 324 may include the illumination required for the imaging unit 321 to perform imaging operations.

[0120] Reference Figure 4b According to one embodiment of the present disclosure, the shooting device 300 may include a PC 330, a camera 331, a printer 332, a user control unit 341, an I / O board 342, a card payment device 343, a banknote reader 344, etc., and the components included in the shooting device 300 can exchange various information with each other.

[0121] The camera 331 can provide captured images to the PC 330. In addition, the camera can receive camera on / off control signals from the I / O board 342.

[0122] Printer 332 can receive output control information from PC 330 and can send printer status information to PC 330.

[0123] I / O board 342 can receive control information sent from PC 330 to each component or from each component to PC 330.

[0124] The user control unit 341 may include a touch monitor 30 and / or an imaging remote controller 31. The touch monitor 30 may send touch coordinate information input by the user to the PC 330. The imaging remote controller 31 may send button press information to the PC 330 via the I / O board 342.

[0125] When a user selects card payment, the card payment device 342 can send the card information (such as the card number) entered by the user to the PC 330. When a user selects cash payment, the banknote reader 344 can send the banknote insertion information of the banknote inserted by the user to the PC 330 via the I / O board 342.

[0126] PC 330 can perform overall control of the components included in the shooting device 300. PC 330 can send user information, payment information, images, and shooting device status information collected from various components to an external server 400. Here, PC 330 can receive the results of the advertising product recognition model of the image from the external server 400. On the other hand, referring to Figures 1 to... Figure 2 External server 400 can be a shooting server 200 that includes product advertising functions.

[0127] Figure 5 This is a conceptual diagram illustrating a processor for a system that provides conventional shooting services.

[0128] In a traditional photography service, advertiser 510 requests selfie device operator 520 to advertise a product (e.g., product A). At this point, selfie device operator 520 can create a shooting frame suitable for the advertised product. As another example, selfie device operator 520 can generate an advertising video to be displayed when advertiser 510 prints photos after the selfie session. Selfie device operator 520 can provide selfie shooting frames or advertising videos suitable for the advertised product to company-operated stores or franchisees 530.

[0129] Users can take self-portrait photos using a camera device 550 installed in a company-operated store or franchise store 530. At this time, the camera device 550 can provide the user with a frame containing advertised products and can print the photo output 540 requested by the user. As another example, the camera device 530 can provide advertising videos received from traditional photography services during the printing time of the captured photo 540.

[0130] Therefore, traditional photography services can indirectly promote advertising by providing users with frames related to the advertised product. Furthermore, traditional photography services can also enhance advertising by providing videos related to the advertised product during the client's photo printing period.

[0131] Figure 6 This is an example diagram showing the interface screen of a user terminal that provides a shooting service including product advertising functions according to an embodiment of this disclosure.

[0132] An application providing a photo-taking service with product advertising capabilities can offer user interfaces 610, 620, and 630 for participating in activities promoting advertised products to users. For example, a user can click "Event Photo" on the first user interface screen 610 to upload an event photo. Here, the event photo can be received from a shooting device. As another example, the event photo 620 can be a photo taken from the user's terminal.

[0133] When a user uploads an event photo, a user interface 620 can be provided to display the event photo containing product advertising functionality. The event photo may include an image 621 containing the advertised product. At this time, according to one embodiment of this disclosure, a camera server containing product advertising features can input the image 621 containing the advertised product as input value to a product recognition model. Here, the camera server containing product advertising features can use the product recognition model to determine whether the image 621 containing the advertised product is included in the event photo. If the event photo includes the image 621 containing the advertised product, the camera server containing the product advertising functionality can provide a reward to the user terminal. If the image 621 containing the advertised product is included in the event photo, a user interface 630 can be provided displaying 1000 points as a reward.

[0134] A more detailed description of the shooting service, which includes product advertising functionality, will be explained in a subsequent implementation plan.

[0135] Figure 7 This is a flowchart schematically illustrating the process of a shooting device for a system that provides shooting services including product advertising functions according to an embodiment of this disclosure.

[0136] In S701, when a user completes a shooting action using the camera 710, the camera 710 can upload the user ID (UID) and the captured images and / or videos to the CMS. At this time, the camera 710 can also send the user ID (UID) and the captured images and / or videos to the CMS DB server 722. The CMS DB server 722 can store the user ID (UID) and the images and / or videos received from the camera 710.

[0137] In S702, the CMS DB server 722 can send user IDs (UIDs) and images and / or videos to the storage server 723. The API (or API server) provided by the CMS DB server 722 can upload user IDs (UIDs) and image and / or video files to the storage server 723 upon receiving them.

[0138] In S703, storage server 723 can send the URL (or file address) of the uploaded image and / or video file to CMS DB server 722 in response to receiving user ID (UID) and image and / or video.

[0139] In S704, the CMS DB server 722 can match user IDs (UIDs) with the URLs (or file addresses) of uploaded images and / or video files.

[0140] In the S705, the CMS DB server 722 can send a URL matching the UID to the shooting device 710.

[0141] In S706, the camera device 710 can generate a QR code containing UID information.

[0142] In S707, the user terminal 730 can use AI to determine whether the received image and / or video file contains an advertised product. In this case, AI composed of an advertising product recognition model can be used to determine whether the advertised product is included.

[0143] In S708, user terminal 730 can upload the parsed UID, member information and AI detection results to CMSDB server 722.

[0144] In S709, CMS DB server 722 can upload the parsed UID, member information and AI detection results to storage server 723.

[0145] In the S710, the camera 710 can print a QR code and / or a photo from the download page containing the UID.

[0146] In the S711, the user terminal 730 can parse the UID using the QR code provided by the camera 710.

[0147] In S712, user terminal 730 can send the parsed UID and member information logged on user terminal 730 to CMS DB server 722.

[0148] In S713, CMS DB server 722 can match the received UID with member information.

[0149] In S714, CMS DB server 722 can send updated UID, member information, URL and AI detection results to mobile DB server 724.

[0150] In the S715, when the camera 710 uses AI to determine that the advertised product is not included in the image, it can offer the user the opportunity to retake the photo.

[0151] In S716, user terminal 730 can send resource viewing and image download requests to mobile DB server 724.

[0152] In the S717, the user terminal 730 can send the file address to the mobile DB server 724.

[0153] In S718, storage server 723 can provide image file downloads to user terminal 730.

[0154] Figure 8 This is a flowchart schematically illustrating the movement process of a system providing a shooting service including product advertising functions according to another embodiment of this disclosure.

[0155] In S801, when a user takes a photo using the camera device 810, they can upload their user ID (UID) and the captured image and / or video to the CMS. At this time, the camera device 810 can send the user ID (UID) and the captured image and / or video to the CMS DB server 822. The CMS DB server 822 can store the user ID (UID) and the images and / or videos received from the camera device 810.

[0156] In S802, the CMS DB server 822 can send user IDs (UIDs) and images and / or videos to the storage server 823. The API (or API server) provided by the CMS DB server 822 can upload user IDs (UIDs) and image and / or video files to the storage server 823 upon receiving them.

[0157] In S803, the storage server 823 can, in response to receiving the user ID (UID) and the image and / or video, send the URL (or file address) of the uploaded image and / or video file to the CMS DB server 822.

[0158] In S804, the CMS DB server 822 can match the user ID (UID) with the URL (or file address) of the uploaded image and / or video file.

[0159] In S805, the CMS DB server 822 can send a URL matching the UID to the shooting device 810.

[0160] In S806, the camera device 810 can generate a QR code containing UID information.

[0161] In S807, user terminal 830 can upload the parsed UID and AI type to CMS DB server 822.

[0162] In S808, the CMS DB server 822 can send the parsed UID and AI detection results to the storage server 823.

[0163] In S809, the camera device 810 can print a QR code and / or photo from the download page containing the UID.

[0164] In S810, user terminal 830 can parse UID using the QR code provided by camera 810.

[0165] In S811, user terminal 830 can send the parsed UID and member information logged in from user terminal 730 to CMS DB server 822.

[0166] In S812, the CMS DB server 822 can match the received UID with the member information.

[0167] In S813, CMS DB server 822 can send updated UID, member information and URL to mobile DB server 824.

[0168] In S814, user terminal 830 can send resource viewing and image download requests to mobile DB server 824.

[0169] In S815, user terminal 830 can send file address to mobile DB server 824.

[0170] In S816, the user terminal 830 can use AI to determine whether the received image and / or video file contains advertising products. At this point, AI composed of an advertising product recognition model can be used to determine whether advertising products are included.

[0171] In S817, storage server 823 can provide image file downloads to user terminal 830.

[0172] In S818, when an advertised product is included in an image, the user terminal 830 can request a private box coupon from the CMS DB server 822. For example, if the user terminal 830 uses AI to determine that an advertised product is included in an image, it can request a private box coupon from the CMS DB server 822. Conversely, if the AI ​​detection result determines that no advertised product is detected, the user terminal 830 can terminate the process.

[0173] In S819, when a private box code and / or random number are provided to the user terminal 830 (or user account), the user terminal 830 can receive a private box coupon provided by the CMS DB server 822.

[0174] When a privacy frame coupon is offered to a user, or when a user uses a privacy frame coupon, the kiosk will enter a privacy frame code and / or a random number, and the user can take a photo using the corresponding privacy frame within a preset time.

[0175] Figure 9 This is a flowchart illustrating an operation method of a system for providing a shooting service including product advertising functions according to an embodiment of this disclosure. Figure 10Figures 1 to 14 are example diagrams illustrating the interface screen of a user terminal providing a shooting service including advertising functions according to an embodiment of the present disclosure.

[0176] First, refer to Figure 9 The image capture server 200, which includes product advertising functionality, receives an image (S910). At this time, the image can be a four-section photograph containing slices of the advertised product. Here, the image capture server 200 can receive the image from a shooting device or a user terminal. Here, the image can be a four-section photograph taken from the shooting device. As another example, the image can be a photograph taken from the user terminal. In this case, the image capture server 200 can provide an image capture frame to the user terminal.

[0177] Simultaneously, the camera server 200, which includes product advertising functionality, can receive data about matched users from the camera device. For example, when the camera server 200 receives images from the camera device, it can also receive data indicating that the user is receiving images.

[0178] More specifically, refer to Figure 10 The camera server 200, which includes product advertising functionality, can receive event photo upload requests through interaction with the event photo area 1010. At this time, the camera server 200 can provide a user interface for uploading event photos to the user terminal. Here, it can be confirmed that the mileage 1020 of the currently logged-in user on the user terminal is 0 points.

[0179] Reference Figure 11a The user interface of the user terminal can display image 1110 taken by the user terminal and uploaded to the server by the user. As another example, image 1110 displayed on the user terminal can be an image captured and received by a camera. Here, the user terminal can receive images captured via a QR code provided by the camera. Furthermore, the user terminal can be logged in with the same user on the camera to receive captured images via the server. In this case, the method by which the user terminal receives images from the camera is not limited to the above and can be configured in various ways.

[0180] In another implementation scheme, refer to Figure 11b The user interface of the shooting device can display a screen asking the user whether to upload the images 1110 captured by the shooting device to the shooting server 200 to participate in the activity. If the user enters "yes" 1120, the shooting server 200, which includes product advertising functionality, can receive the activity photo upload request. Furthermore, users can log in to the shooting device using the account they wish to earn rewards from.

[0181] In another implementation, the camera server 200, which includes product advertising functionality, can provide assistance in capturing images containing advertised products on a camera device. In this case, the assistance in capturing images containing advertised products may include shooting aids regarding the product exposure range, the position of the advertised product in the image, and the exposure range of text or product names contained within the advertised product. Here, the product exposure range can be the ratio of the exposed area in the image to the total area of ​​the image corresponding to the advertised product. Additionally, the position or size of the advertised product in the image can refer to the position or size of the advertised product within the image. In this case, the exposure conditions for text or product names contained within the advertised product can refer to the conditions for text or product names that must be included in the text or product name contained within the advertised product. Simultaneously, assistance in capturing images containing advertised products can be provided to improve the accuracy of the advertised product recognition model of the camera server 200 with product advertising functionality, or to enhance the promotional effect of the advertised product.

[0182] For example, a camera server 200 with product advertising functionality can help specify that 70% of the area of ​​the advertised product image should be exposed in the picture. Furthermore, the camera server 200 can help specify that the product should not be located at the outer edge, but rather in the center. As another example, it can help specify that the closer the advertised product is to the center of the image and the larger its size, the greater the reward. Additionally, the camera server 200 can help specify that if the product name is… It should be exposed as " Meanwhile, the assistance in capturing images of advertised products from the image capture server 200, which includes product advertising functionality, is not limited to the examples above and can be configured in various ways.

[0183] Back Figure 9 The image capture server 200, which includes product advertising functionality, uses an advertising product recognition model to determine whether an image contains an advertising product (S920). In this case, the advertising product recognition model can be an AI model configured to use an image as input to determine whether an image contains an advertising product. Here, the advertising product recognition model can consist of an object recognition model and a character recognition model.

[0184] More specifically, refer to Figure 12The image capture server 200, which includes product advertising functionality, can determine whether an image contains an advertising product by using an advertising product recognition model as input. In this case, the image capture server 200 can identify the advertising product 1210 using the object recognition model of the advertising product recognition model. Alternatively, the image capture server 200 can identify characters or product names 1220 contained in the advertising product using the character recognition model of the advertising product recognition model.

[0185] At this point, the object recognition model can consist of one of the object detection models. For example, the object recognition model can consist of the YOLO model. In this case, the object recognition model can include a loss function. Here, the object recognition model is an object detection model without a mainstream anchor, and the loss function can include classification loss, bounding box regression loss, object loss, etc. On the other hand, the object recognition model can consist of artificial neural network models, convolutional neural networks (CNNs), etc. As another example, the object recognition model can perform machine learning based on methods such as supervised learning, unsupervised learning, and reinforcement learning. Currently, machine learning algorithms used to perform machine learning can include decision trees, Bayesian networks, support vector machines, artificial neural networks, AdaBoost, perceptrons, genetic programming, clustering, etc. On the other hand, the character recognition model can consist of optical character recognition (OCR), etc.

[0186] Back Figure 9 The image capture server 200, which includes product advertising functionality, provides a reward to the user terminal based on whether the image contains an advertised product (S930). If it is determined that the image contains an advertised product, the image capture server 200 can provide a reward to the user terminal. Here, the reward could be points given to users logged into the user terminal. Conversely, if it is determined that the image does not contain an advertised product, the image capture server 200 can provide a request to the user terminal and / or the capturing device to retake the image.

[0187] Another example is that a camera server 200 with product advertising capabilities can offer rewards to users in the form of private frames. In this case, the private frame can be a self-portrait frame created by a self-portrait device operator commissioned by the advertiser. For example, the private frame could include frames that change color, frames that change character poses, and frames that change character appearance, etc.

[0188] Here, if it is determined that the image contains advertised products, the camera server 200 with product advertising functionality can provide a private frame code and / or a random number. In this case, a private frame coupon or shooting ticket can be provided to the user for immediate shooting. On the other hand, if the camera server 200 with product advertising functionality determines that the image does not contain advertised products, it can terminate the shooting process.

[0189] In this scenario, if a privacy frame coupon is provided to the user, or if the user uses the privacy frame coupon, the kiosk will enter a privacy frame code and / or a random number, allowing the user to continue taking photos using the privacy frame.

[0190] For example, if the advertised product identified by the advertised product recognition model is a glow stick of idol A, then the shooting server 200, which includes product advertising functions, can reward the user with a private frame coupon of idol A.

[0191] Meanwhile, if the shooting server 200, which includes product advertising functionality, identifies the advertised product through the advertising product recognition model, it can offer users the right to change the frame of their selfie photos to one of the existing frames and / or a private frame in the form of a free coupon.

[0192] Furthermore, if the camera server 200, which includes product advertising functionality, identifies the advertised product through an advertising product recognition model, it can provide users with additional shooting tickets in the form of paid coupons for taking more selfies with private frames. Another example is that the camera server 200, which includes product advertising functionality, can differentiate rewards to user terminals. According to this implementation, the shooting device 300 can differentiate rewards. In this case, the camera server 200, which includes product advertising functionality, can differentiate rewards based on the number of advertised products, the number of images containing the advertised products, and the area ratio of the advertised products in the images. Here, the number of advertised products can be the number of advertised products contained in a single image. For example, if there are three advertised products in an image, the number of advertised products can be three. Here, the number of images containing advertised products can be the number of images in four slices of an image containing advertised products. For example, if there are three images containing advertised products in four slices of an image, the number of images containing advertised products can be three. Furthermore, the area ratio of the advertised products in the image can be the ratio of the area occupied by the advertised products to the total area of ​​the image. For example, if the advertised product occupies 30% of the area in the image, then the area occupied by the advertised product in the image can be 30%.

[0193] More specifically, refer to Figure 13 If the image capture server 200, which includes product advertising functionality, determines that the image contains an advertised product, it can provide a reward to the user terminal. At this point, upon confirmation using the user terminal, the user's mileage of 1310 has increased to 500 points due to the provided reward.

[0194] In another implementation, the image capture server 200, which includes product advertising functionality, can provide users with backgrounds suitable for the advertised product. In other words, the image capture server 200 can provide users with recommended backgrounds for images based on the identifier of the advertised product. In this case, the identifier of the advertised product can contain information about the characteristics of the advertised product, including its type, color, and target customer group.

[0195] More specifically, refer to Figure 14a The camera server 200, which includes product advertising functionality, can provide a user interface 1410 for users to select from multiple advertised products. At this time, the camera server 200 can receive the advertised product selected by the user from the camera device.

[0196] Reference Figure 14b The image capture server 200, which includes product advertising functionality, can provide a basic background identified by the identifier of the advertised product. At this time, the image capture server 200 can also provide a basic background 1420 determined based on the type, color, and target customer group of the advertised product. Here, the image capture server 200 can receive the basic background from the advertiser. Alternatively, the image capture server 200 can provide an image that changes the background of the captured photograph to the basic background.

[0197] Reference Figure 14c The image capture server 200, which includes product advertising functionality, can provide a user interface for selecting from multiple backgrounds determined based on the identifier of the advertised product. In this case, the image capture server 200 can include backgrounds such as 1430 determined by the color of the advertised product, 1440 determined by the atmosphere of the advertised product, and 1450 determined by the type of the advertised product. For example, if the advertised product is a naturalistic toner, the image capture server 200 can provide options such as a white background determined by a color matching the toner, a background with leaves matching naturalism, and a background with droplets, depending on the type of toner. On the other hand, the image capture server 200 can also provide images that change the background of the captured photograph to each of the multiple backgrounds.

[0198] According to this implementation plan, the private frame can be provided as a random frame. The random object can be a member of an idol group, an artist's outfit, etc., and the random frame can be set in various ways. (See reference...) Figure 14dMembers of idol A can be randomly selected and provided as frames. At this time, the private frame can be provided as a hidden frame 1460, which only displays the outline of the randomly selected member, making it impossible to identify which member it is. If the user successfully completes the task (e.g., taking a photo using idol A's cheering stick), the user can select a member and print the photo taken with the selected member. Conversely, if the user fails to complete the task, the user can print the photo taken with a randomly selected member from idol A. The program executed by the terminal and server described in this disclosure can be implemented as a hardware component, a software component, and / or a combination of hardware and software components. The program can be executed by any system capable of executing computer-readable instructions.

[0199] Software can comprise computer programs, code, instructions, or a combination of one or more of these, and can be configured to operate on demand or independently or jointly with a processing device. Software can be implemented as a computer program containing instructions stored on a computer-readable storage medium. Examples of computer-readable recording media include magnetic storage media (e.g., read-only memory (ROM), random access memory (RAM), floppy disks, hard disks, etc.) and optical reading media (e.g., CD-ROMs, digital versatile optical discs (DVDs)). Computer-readable recording media distributed across networked computer systems allow for the distributed storage and execution of computer-readable code. The medium can be read by a computer, stored in memory, and executed by a processor.

[0200] Computer-readable storage media can be provided in the form of non-transient storage media. Here, "non-transient" means that the storage medium does not contain signals, but is tangible, and does not distinguish whether the data can be stored permanently or temporarily on the medium.

[0201] Furthermore, the program according to the embodiments of this disclosure can be included and provided as a computer program product. The computer program can be traded as a product between buyers and sellers. The computer program can include software programs and storage media readable by a computer including the software programs. For example, the computer program can include software products, such as downloadable applications, electronically distributed by the manufacturer through a device or electronic marketplace (e.g., Google Play Store, App Store). For electronic distribution, at least some of the software programs can be stored on storage media or temporarily generated. In this case, the storage media can be the manufacturer's server, the electronic marketplace's server, or the storage media of a relay server temporarily storing the software programs.

[0202] In a system comprising a server and a device, the computer program may contain the storage medium of the server or the device. Alternatively, if a third device (e.g., a smartphone) is present that communicates with the server or device, the computer program may contain the storage medium of the third device. Alternatively, the computer program may contain the software program itself transferred from the server to the device or from the third device to the device. In this case, one of the server, the device, and the third device may execute the computer program to perform the method according to the disclosed embodiment. Alternatively, two or more of the server, the device, and the third device may execute the computer program to perform the method according to the disclosed embodiment in a distributed manner. For example, the server may execute a computer program stored on the server to control devices connected to the server to perform the method according to the disclosed embodiment. As another example, the third device may execute a computer program to control devices connected to the third device to perform the method according to the disclosed embodiment. When the third device executes the computer program, it may download the computer program from the server and execute the downloaded computer program. Alternatively, the third device may execute a computer program provided in a pre-loaded state to perform the method according to the initiated embodiment.

[0203] While the embodiments have been described above with reference to limited embodiments and accompanying drawings, those skilled in the art can make various modifications and variations to the provided description. For example, the described techniques may be performed in a different order than those described, and / or components such as the described computer system or module may be combined or assembled in a different form than those described, or may be replaced or substituted by other components or equivalents, while still achieving the appropriate results.

[0204] Marker explanation: 100: Systems used to provide photography services that include product advertising functions 110: Filming equipment; 120: Server system 121: Device DB Server 122: CMS DB Server 123: Storage server; 124: Mobile database server 200: A camera server with product advertising capabilities. 300: Filming equipment.

Claims

1. A shooting method implementing a product advertising function, the shooting method comprising: Receive at least one image from the shooting device or user terminal; Whether an image contains an advertised product is determined by using an advertising product recognition model, whereby the advertising product recognition model takes the image as input and outputs whether the image contains an advertised product; and Users are rewarded when the image contains advertised products.

2. The method of claim 1, further comprising providing assistance to the capturing device in capturing the image; The assistance in taking the image containing the advertised product is shooting assistance in at least one of the following: identifying the product exposure range of the advertised product, the position or size of the advertised product in the image, or the exposure conditions of characters or product names contained in the advertised product.

3. The method according to claim 1, wherein the advertising product recognition model includes an object recognition model and a character recognition model for the image.

4. The method according to claim 1, further comprising: Receive information about the advertised product selected by the user from the shooting device; as well as The system provides the user with a recommended background for the image based on the identifier of the advertised product.

5. The method of claim 4, wherein the identifier of the advertised product includes information about the characteristics of the advertised product, the characteristics including the color, type, and target customer group of the advertised product.

6. The method of claim 5, wherein providing rewards to the user comprises: The reward is provided differently based on at least one of the following: the number of advertised products contained in the image, the number of images containing the advertised products, or the area occupied by the advertised products in the image.

7. The method of claim 6, wherein providing rewards to the user comprises: Offer a bonus of changing your existing shooting frame to a privacy frame for free, or Offers a bonus of extra opportunities to be photographed in a private, paid setting.

8. A system for providing a shooting service including product advertising functions, the system comprising: A camera device configured to capture at least one image; User terminal; as well as A server configured to determine whether an image contains an advertising product by using an advertising product recognition model, the advertising product recognition model taking the image as input and outputting whether the image contains an advertising product; and Users are rewarded when the image contains advertised products.

9. The system of claim 8, wherein the capturing device is further configured to receive assistance in capturing the image. The assistance in taking the image is related to at least one of the following: identifying the product exposure range of the advertised product, the position or size of the advertised product in the image, or the exposure conditions of characters or product names contained in the advertised product.

10. The system according to claim 8, wherein the advertising product recognition model comprises: Object recognition model and character recognition model for the image.

11. The system of claim 8, wherein the capturing device is configured to: Information about the advertised product selected by the user is sent to the server. The server is also configured to: The system provides the user with a recommended background for the image based on the identifier of the advertised product.

12. The system according to claim 11, The identifier of the advertised product includes: Information regarding the characteristics of the advertised product, including the product's color, type, and target customer group.

13. The system according to claim 8, The server is also configured to: The reward is provided differently based on at least one of the following: the number of advertised products contained in the image, the number of images containing the advertised products, or the area occupied by the advertised products in the image.

14. The system according to claim 13, The server is also configured to: Offer a bonus of changing your existing shooting frame to a privacy frame for free, or Offers a bonus of extra opportunities to be photographed in a private, paid setting.

15. A shooting device including product advertising function, the shooting device comprising: Display unit; Interface unit; Shooting unit; Output unit; as well as Control unit The control unit includes a memory and one or more processors that execute programs loaded in the memory. The program includes: Instructions for receiving at least one image from a shooting device or user terminal; Instructions for determining whether an image contains an advertised product using an advertising product recognition model, wherein the advertising product recognition model takes the image as input and outputs whether the image contains an advertised product; and Instructions for providing rewards to the user when the image contains advertised products.

Images