Method and apparatus for providing photography service including content utilization advertising function based on artificial intelligence

Abstract

The present invention provides a method performed by a processor of a photographing service providing apparatus, the method comprising the steps of: receiving at least one instant print image according to an advertisement event participation request from a photographing device or a user device; determining whether an advertisement pose is included in an instant print image by inputting the instant print image into a pose recognition model configured to output whether the advertisement pose is included therein by using the image as an input; and if the instant printing image contains the advertisement posture, providing a reward to the shooting equipment or the user equipment.

Description

Technical Field

[0001] This disclosure relates to a method and apparatus for providing a photography service that includes advertising functionality based on artificial intelligence and utilizing content. Background Technology

[0002] Unmanned photo booths offering self-service photography are gradually becoming a new type of experiential space for young people to express themselves and attract others. Utilizing the advantages of the photo booths themselves, unmanned photo booths are being set up in places with dense cultural facilities or high foot traffic, such as event venues, exhibition halls, and concert halls.

[0003] Therefore, this disclosure discloses advertisements targeting users visiting unmanned photo booths. For example, disclosed advertising formats include: incorporating idols, athletes, or internet celebrities into the background or frame of photos; displaying the advertised subject on the screen during the photo printing process; and displaying the advertised subject on websites where users save their photos.

[0004] However, traditional advertising is provided to users unilaterally, which limits its ability to achieve significant advertising results in the short term.

[0005] The background art is provided to facilitate a better understanding of this disclosure. The descriptions in the background art should not be construed as conventionally accepted prior art. Summary of the Invention

[0006] Technical issues Therefore, a new approach is needed to maximize advertising effectiveness by providing unmanned photo booths with self-service photography.

[0007] Therefore, the inventors of this invention aim to develop a method that provides user-participatory advertising services by guiding user behavior and providing matching advertisements when users pose for photos, thereby enhancing advertising effectiveness.

[0008] The tasks covered by this disclosure are not limited to those described above, and other tasks not mentioned will be clearly understood by those skilled in the art from the following description.

[0009] Solution to the problem To address the aforementioned issues, one embodiment of this disclosure provides an artificial intelligence-based method for a photography service that includes content utilization capabilities. The method is configured to include: receiving at least one instant-printed image based on a request for participation in an advertising event from a shooting device or a user device; determining whether the instant-printed image contains an advertising gesture by inputting the instant-printed image into a gesture recognition model configured to receive the image as input and output whether it contains the advertising gesture; and providing a reward to the shooting device or the user device if the instant-printed image contains the advertising gesture.

[0010] Based on the features of this disclosure, the pose recognition model can be a model configured to output the probability that a user pose contained in an instant print image corresponds to a predefined advertising pose.

[0011] Based on the characteristics of this disclosure, the method may further include: determining the advertisement pose to be identified in the pose recognition model by using an advertisement training model, wherein the advertisement training model is trained using advertisement content as input to detect user pose.

[0012] According to the features of this disclosure, the method may further include: providing the shooting device with guidelines for the advertising event, the guidelines including at least one of the following: full-body exposure range, rotation direction and movement direction of each body part, and size or direction change based on the coordinates of body feature points to identify the advertising pose.

[0013] According to the features of this disclosure, receiving the image means receiving an instant print image from the shooting device in real time, and determining whether the advertising gesture is included also includes providing the shooting device with a probability indicating whether the advertising gesture is included in the instant print image.

[0014] According to the features of this disclosure, receiving the instant print image means receiving a plurality of instant print images consisting of multiple frames, and providing the reward means providing the reward if at least one of the plurality of instant print images contains an advertising gesture that matches a request to participate in the advertising event.

[0015] According to the features of this disclosure, receiving the instant print image further includes: determining the type of advertising event based on the graphic objects contained in the instant print image.

[0016] To address the aforementioned problems, another embodiment of this disclosure provides an apparatus for providing photographic services. The apparatus includes: a communication interface; a memory; and a processor operatively connected to the communication interface and the memory; wherein the processor is configured to: receive at least one instant-printed image based on a request from a shooting device or a user device to participate in an advertising event; determine whether the instant-printed image contains an advertising pose by inputting the instant-printed image into a pose recognition model, the pose recognition model being configured to receive the image as input and output whether it contains an advertising pose; and if the instant-printed image contains the advertising pose, provide a reward to the shooting device or the user device.

[0017] To address the aforementioned issues, another embodiment of this disclosure provides a shooting device that utilizes AI-based content to provide functionality. The device includes a communication interface, an I / O interface, a memory, and a processor operably connected to the I / O interface and the memory; wherein the processor is configured to: acquire at least one instant-print image via the I / O interface, the instant-print image containing a user's request to participate in the advertising event; determine whether the instant-print image contains an advertising gesture by inputting the instant-print image into a gesture recognition model, the gesture recognition model being configured to receive the image as input and output whether it contains an advertising gesture; and if the image contains the advertising gesture, provide a reward to the user matching the instant-print image via the communication interface.

[0018] Other specific details of this implementation are included in the detailed description and accompanying drawings.

[0019] Beneficial effects of the present invention This invention guides users to pose in specific ways related to an advertising theme within an unmanned photo booth (hereinafter referred to as "photography equipment") that provides self-service photography. It also provides users with corresponding rewards when such poses are detected, thereby encouraging active participation. In particular, this user-participatory advertising format enhances user affinity for the advertising subject and proactively presents the product to users.

[0020] Furthermore, this invention improves the accuracy of pose recognition models that detect user postures by providing guidance on advertising themes and their associated specific poses within the shooting device. In particular, by improving recognition accuracy, rewards can be delivered more accurately to users participating in advertising events, thereby increasing user engagement satisfaction.

[0021] Furthermore, this invention can enhance users' impression of advertising content by designating specific iconic poses or dance moves as key advertising features in various content and integrating them into photography services.

[0022] The effects of this disclosure are not limited to the examples above; this disclosure also includes many other different effects. Attached Figure Description

[0023] Figure 1 This is a block diagram illustrating the configuration of a photography service system that includes content-based advertising functionality based on artificial intelligence, according to one embodiment of the present disclosure.

[0024] Figure 2 This is a block diagram illustrating the configuration of an apparatus for providing photographic services according to one embodiment of the present disclosure.

[0025] Figure 3 This is a schematic flowchart illustrating a method of providing photographic services through a device for providing photographic services, according to one embodiment of this disclosure.

[0026] Figure 4 This is a schematic diagram illustrating a posture recognition model according to one embodiment of the present disclosure.

[0027] Figure 5 This is a block diagram illustrating the configuration of a shooting device that includes an AI-based content-based advertising function, according to one embodiment of the present disclosure.

[0028] Figure 6 This is a schematic flowchart illustrating a method for providing photography services in a photography service system, according to one embodiment of the present disclosure.

[0029] Figure 7 This is an exemplary diagram illustrating an interface screen of a photography device that provides advertising functionality utilizing content, according to one embodiment of this disclosure.

[0030] Figure 8 This is an illustrative diagram illustrating a method for performing a photography service in a photography service system according to another embodiment of this disclosure.

[0031] Figures 9a, 9b, 9c and 9d are exemplary diagrams illustrating the interface screen of a user device that provides a photography service including advertising functionality utilizing content, according to one embodiment of this disclosure. Detailed Implementation

[0032] The advantages and features of this disclosure, as well as the methods for achieving these advantages and features, will become apparent from reference to the embodiments detailed below and the accompanying drawings. However, this disclosure is not limited to the embodiments disclosed below, but can be implemented in various different forms; these embodiments are provided only to complete this disclosure and to enable those skilled in the art to fully understand the scope of the invention, which is defined only by the scope of the claims. In the drawings, similar reference numerals may be used to denote similar elements.

[0033] In this document, expressions such as “have,” “may have,” “include,” or “may include” mean that there are corresponding features (e.g., constituent elements such as numbers, functions, operations, or parts), and do not exclude the existence of additional features.

[0034] In this disclosure, the expressions “A or B”, “at least one of A and / or B”, or “one or more of A and / or B” can include all possible combinations of the listed items. For example, expressions such as “A or B”, “at least one of A and B”, or “at least one of A or B” can refer to: (1) containing at least one A; (2) containing at least one B; or (3) containing both at least one A and at least one B.

[0035] The terms "first," "second," "firstly," or "secondly," as used in this disclosure, are used to describe various components, regardless of their order and / or importance; these terms are used only to distinguish different components and do not constitute limitations on those components. For example, "first user equipment" and "second user equipment" may represent different user equipment, regardless of their order or importance. For instance, without departing from the scope of the rights defined in this disclosure, a first component may also be referred to as a second component; similarly, a second component may also be referred to as a first component.

[0036] When describing a "(operational or communicative) coupling" or "connection" relationship between a component (e.g., a first part) and another component (e.g., a second part), it should be understood that the component can be directly coupled to the other component or indirectly connected to the other component through an intermediate component (e.g., a third part). On the other hand, when describing a "direct coupling" or "direct connection" relationship between a component (e.g., a first part) and another component (e.g., a second part), it should be understood that there are no intermediate components (e.g., a third part) between the component and the other component.

[0037] The expression “configured to” as used in this article is interchangeable with expressions such as “applicable to,” “capable of,” “designed for,” “adapted to,” “made for,” or “capable of,” depending on the context. At the hardware level, the term “configured to” does not necessarily mean “specifically designed for.” Rather, in some contexts, the phrase “device configured to…” can mean that the device is “capable” of performing a certain operation when working in conjunction with other devices or components. For example, the phrase “processor configured to perform A, B, and C” can refer to a dedicated processor (e.g., an embedded processor) specifically designed to perform these operations, or it can refer to a general-purpose processor (e.g., a CPU or application processor) that can perform these operations by running one or more software programs stored in a storage device.

[0038] The terminology used in this document is used only to describe specific embodiments and is not intended to limit the scope of other embodiments. Unless the context clearly indicates otherwise, singular expressions may also include plural expressions. The terms used herein (including technical or scientific terms) may have the same meaning as commonly understood by one of ordinary skill in the art described herein. Terms used in this document that are already defined in a general dictionary may be interpreted as having the same or similar meaning in the context of the relevant art; unless explicitly defined in this document, they should not be interpreted as having an idealized or overly formal meaning. In some cases, even if a term is defined in this document, it should not be interpreted as excluding the various embodiments covered by this document.

[0039] Each feature in the various embodiments of this disclosure can be combined or integrated with each other, either partially or entirely; as will be readily understood by those skilled in the art, various technical interconnections and operational methods are feasible. The various embodiments can be implemented independently of each other or in a coordinated manner.

[0040] To clarify the interpretation of this specification, the terms used herein will be defined as follows.

[0041] As used herein, the term "instant print image" refers to an image captured by a camera and output immediately after capture. This instant print image may contain at least one user with a facial pose. Depending on the specific capture method, the instant print image may consist of a single image containing the same user or multiple images. Furthermore, the instant print image may be mapped to the following data: identification data of the camera that captured the image, date data of the capture time, and identification data of the user contained in the image.

[0042] The term "ad training model" used in this paper refers to a model trained to detect user poses using advertising content as input. Specifically, advertising content can be images or videos featuring people as the subject of the advertisement, such as movies, plays, stage videos, video ads, or image ads. The advertising training model can detect poses that other users might imitate in the images or videos. In particular, if the advertising content is video, the advertising training model can detect user poses in overlapping segments based on text or audio data. For example, the advertising training model can detect user poses within segments where specific lyrics, dialogue, or melody are detected.

[0043] The term "pose recognition model" as used in this paper can refer to a model configured to receive an image as input and output whether the image contains an advertising pose. Specifically, the image can be an instant-printed image acquired by a camera, and the pose recognition model can output the probability that a user pose contained in the instant-printed image corresponds to a predefined advertising pose. Furthermore, the user's pose can be determined based on body features; for example, body feature points can include multiple points that match the center or edges of the head, body, limbs, hands, fingers, etc.

[0044] In various implementations, the advertising training model and the pose recognition model can consist of at least one model or two or more ensemble models selected from deep neural networks (DNNs), such as VGGNet, R, and DenseNet based on convolutional neural networks (CNNs); fully convolutional networks (FCNs) with encoder-decoder structures, SegNet, DeconvNet, DeepLAB V3+ and U-Net, SqueezeNet, AlexNet, ResNet 18, MobileNet-v2, MobileNet-v3, GoogLeNet, ResNet50, ResNet101, Inception-v3, and EfficientNet.

[0045] The present invention will be described in detail below with reference to the accompanying drawings and by describing preferred embodiments thereof.

[0046] Figure 1 This is one embodiment of the disclosure, which shows a block diagram of a photography service system configuration that includes AI-based content-based advertising functionality.

[0047] Reference Figure 1 A photography service system 1000 (hereinafter referred to as the "photography service system") that includes content-based advertising functionality based on artificial intelligence can be a photography service system that uses an artificial neural network model to analyze user poses in instantly captured photographs (hereinafter referred to as "instant print images") and provides rewards to users, depending on whether the analyzed poses match predefined advertising poses. To this end, the photography service system 1000 of this disclosure may include a device 100 for providing photography services, a shooting device 200, and a user device 300.

[0048] The device 100 for providing photography services is a server device of a service provider. It analyzes user poses in instant-printed images and determines whether to offer rewards based on the analysis results. The device 100 for providing photography services may include a general-purpose computer, a laptop computer, and a data server. Specifically, the device 100 for providing photography services can receive instant-printed images containing users from a shooting device 200 or a user device 300. The device 100 for providing photography services can determine eligibility to participate in an advertising event based on at least one of the following: identification data of the shooting device mapped to the instant-printed image, date data of the shooting time, or identification data of the user contained in the image. Here, eligibility to participate in an advertising event can be understood as determining whether an advertising event is currently underway through the photography service system 1000, whether the provided instant-printed image was taken by another shooting device, or whether the instant-printed image was taken a long time ago.

[0049] Furthermore, the device 100 providing the photography service can determine the type of advertising event based on the graphic objects contained in the instant-printed image. For example, the device 100 can detect advertising event frames and advertising event objects in the instant-printed image and determine the advertising type that matches the advertising event frame or object. Here, the advertising type can be understood as advertising content; and the device 100 providing the photography service can determine the advertising pose to be detected based on the advertising event frame or object. In addition, the frames contained in the instant-printed image may contain text data (e.g., the title of the advertising content) or image data (e.g., a schematic image representing the advertising content).

[0050] The device 100 providing the photography service can determine whether an instant-printed image contains an advertising pose. For example, the device 100 can input the instant-printed image into a pose recognition model to obtain a probability value indicating whether a user's pose in the instant-printed image matches one of a pre-specified plurality of advertising poses. Based on this probability value, the device 100 can determine whether the user's pose matches the advertising pose. In another example, if the advertising type is determined based on an advertising event frame, or if a specific advertising event is specified according to a request to participate in an advertising event, the device 100 can input the instant-printed image into the pose recognition model to determine whether the user's pose presented in the instant-printed image corresponds to a predefined single advertising pose and use the determination result as a result value.

[0051] If the instant print image contains an advertising gesture, the device 100 for providing the photography service can offer a reward to the shooting device 200 or the user device 300. For example, the reward could be points earned through the photography service. The device 100 can provide a coupon number or a two-dimensional barcode to offer a reward to the shooting device 200, or to the user account via an application or webpage installed on or running on the user device 300.

[0052] In various implementation schemes, the rewards offered by the device 100 for providing photography services may also include hidden photo frames, event raffle tickets, etc. Specifically, the device 100 for providing photography services may send a reward selection request to the shooting device 200 or the user device 300 to determine which reward to offer the user: points, a hidden photo frame, or an event raffle ticket. If a hidden photo frame is selected as the reward, the device 100 for providing photography services may offer additional photography services to the shooting device 200 or provide a coupon for using a paid photo frame to the user device 300.

[0053] In various implementations, before receiving an instantly printable image, the device 100 for providing photography services can receive a request to participate in an advertising event from any shooting device 200. Here, the request to participate in an advertising event can be a request to participate in any advertisement or activity, and the device 100 for providing photography services can provide guidance on the advertising event to the shooting device 200 based on the request. Specifically, the device 100 for providing photography services can receive an instantly printable image from the shooting device 200 in real time. The device 100 for providing photography services can provide guidance to the shooting device 200, including the full-body exposure range, the rotation and movement directions of various body parts, and changes in size or orientation based on body feature coordinates to identify advertising poses. For example, using the guidance provided by the device 100 for providing photography services, the shooting device 200 can visually and audibly output guiding information such as "Please raise your arms," ​​"Please turn your body to the left," and "Please make a V-shape with your index and middle fingers" on the captured image. Furthermore, this guiding information can be provided to multiple users in the image captured by the shooting device 200. Furthermore, the device 100 for providing photography services can provide a probability value to the shooting device 200, which indicates whether an advertising pose is contained in an image that can be printed instantly. For example, the device 100 for providing photography services can provide a probability value indicating how similar a user pose contained in an image that can be printed instantly is to any advertising pose selected by the user.

[0054] In various implementations, before receiving the instant print image, the device 100 providing the photography service can identify the content to be advertised based on the type of advertising event included in the request for participation in the advertising event from any of the shooting devices 200. The device 100 providing the photography service can provide the shooting device 200 with preset text or audio data of the identified advertising content. For example, if the identified advertising content is a music video, the chorus can be provided to the shooting device 200 as audio data; if it is a drama or movie, specific lines can be provided to the shooting device 200 as text data.

[0055] In various implementations, the apparatus 100 for providing photographic services may receive a plurality of instant-printed images consisting of multiple frames. The apparatus 100 may segment each of the plurality of instant-printed images and input the segmented images into a pose recognition model to determine whether each image contains an advertising pose. If at least one of the multiple instant-printed images contains an advertising pose that matches a request to participate in an advertising event, the apparatus 100 for providing photographic services may provide a reward.

[0056] In various implementations, the apparatus 100 for providing photography services may include various database (DB) servers to provide photography services with advertising functionality. Specifically, the apparatus 100 for providing photography services may include: identification data of the shooting devices 200; a device DB server storing the operating status of each shooting device 200 (e.g., normal, idle, error state, etc.); a content management system (CMS) DB server storing various types of data related to the photography services provided by the shooting devices 200 (e.g., service UI, real-time image frames, advertising events, payment data, etc.); a storage server storing real-time images captured by the shooting devices 200; and a mobile DB server storing user accounts using the photography service, etc.

[0057] The shooting device 200 may be a shooting device installed in an unmanned photo booth that provides self-service photo taking. The shooting device 200 can capture an instant printable image of the user and provide the captured instant printable image to the device 100 for providing photography services upon request, in order to encourage the user to participate in an advertising event. For example, the request for participation in an advertising event issued by the shooting device 200 to the device 100 for providing photography services may include the identification data of the shooting device 200, the instant printable image, and the user identification data, and may optionally include advertising event selection data.

[0058] In various implementations, the capturing device 200 may provide a printable image containing the user to the user device 300 upon the user's request for a printable image. For example, after capturing the printable image, the capturing device 200 may request user identification data (e.g., user's phone number, ID, etc.) to transmit the printable image; or it may output data for accessing a photography service webpage or application, through which the user can download the printable image.

[0059] In various implementations, the camera device 200 may perform advertising functions utilizing the content of the device 100 for providing photography services. In such cases, the camera device 200 may determine whether the advertising gesture is included in the user's instant print image without providing an instant print image to the device 100 for providing photography services.

[0060] User device 300 is a device owned by a user of the photography service, which may include a smartphone, tablet, personal computer (PC), laptop, etc. User device 300 may install or run a web page or mobile application or program provided by device 100 for providing the photography service to output a user interface screen for requesting the photography service. Here, the photography service may include services for downloading instant-printed images captured by photography device 200, and services for participating in advertising events using these instant-printed images.

[0061] In various implementations, user device 300 may send at least one instant-print image to device 100 for providing photography services in response to a request to participate in an advertising event. For example, user device 300 may run a web service page or application to select any one of multiple ongoing advertising events and upload an image captured by camera 200. Furthermore, user device 300 may receive rewards from device 100 for providing photography services, depending on whether the instant-print image contains an advertising gesture. For example, user device 300 may receive requests for selected rewards (e.g., points, hidden borders, or event raffle tickets) from device 100 for providing photography services, and may receive specific types of rewards through the user's account based on the user's selection.

[0062] This concludes the description of a photography service system 1000 according to one embodiment of this disclosure. According to this disclosure, the photography service system 1000 can enhance the impression of the advertised object while reducing user resistance to direct or participatory advertising by utilizing facial gestures as an advertising medium.

[0063] The following will refer to Figure 2 The apparatus 100 for providing photography services is described.

[0064] Figure 2 This is a block diagram illustrating the configuration of an apparatus for providing photographic services according to one embodiment of the present disclosure.

[0065] Reference Figure 2 The apparatus 100 for providing photography services may include a communication interface 110, a memory 120, an I / O interface 130, and a processor 140, and the components may communicate with each other via one or more communication buses or signal lines.

[0066] Communication interface 110 can connect to camera device 200 and / or user device 300 via a wired / wireless communication network to exchange data. For example, communication interface 110 can receive instant printable images from camera device 200 and user device 300, and can send rewards to camera device 200 and user device 300 depending on whether the instant printable image contains advertising gestures. In another example, communication interface 110 can receive instant printable images from camera device 200 in real time, and can send a probability value to camera device 200 indicating whether the instant printable image contains advertising gesture content.

[0067] Meanwhile, the communication interface 110 for implementing such data transmission and reception includes a wired communication port 111 and a wireless circuit 112; wherein, the wired communication port 111 may include one or more wired interfaces, such as Ethernet, Universal Serial Bus (USB), FireWire, etc. Furthermore, the wireless circuit 112 can transmit and receive data with external devices via radio frequency (RF) signals or optical signals. In addition, wireless communication can employ various communication standards, protocols, and technologies, such as at least one of GSM, EDGE, CDMA, TDMA, Bluetooth, Wi-Fi, VoIP, Wi-MAX, or any other suitable communication protocol.

[0068] The memory 120 may store various data used in the apparatus 100 for providing photographic services. For example, the memory 120 may store identification data of the shooting device 200 and the user device 300, as well as user interface configuration data for the services provided by the shooting device 200 and the user device 300. In another example, the memory 120 may store a pose recognition model and its training data, which is configured to take an image as input and output whether the image contains an advertising pose; and may store an advertising training model and its training data, which is trained to detect a user's pose using advertising content as input.

[0069] In various embodiments, memory 120 may include volatile or non-volatile recording media capable of storing various data, instructions, and information. For example, memory 120 may include at least one type of storage medium such as flash memory, hard disk, micro multimedia card, card memory (e.g., SD or XD memory), RAM, SRAM, ROM, EEPROM, PROM, network storage, cloud storage, and blockchain database.

[0070] In various implementations, memory 120 may store configurations of at least one of operating system 121, communication module 122, user interface module 123, and one or more application programs 124.

[0071] The operating system 121 (such as LINUX, UNIX, MACOS, WINDOWS, VxWorks and other embedded operating systems) may contain various software components and drivers for controlling and managing routine system tasks (such as memory management, storage device control, power management, etc.) and may support communication between various hardware, firmware and software components.

[0072] The communication module 123 can support communication with other devices through the communication interface 110. The communication module 120 may include various software components for processing data received through the wired communication port 111 or the wireless circuit 112 of the communication interface 110.

[0073] The user interface module 123 can receive user requests or inputs from a keyboard, touch screen, mouse, microphone, etc. via the I / O interface 130, and can provide a user interface on the display.

[0074] Application 124 may contain programs or modules configured to be executed by one or more processors 140. Here, the application for providing advertising services using instant printed images may be implemented on a server cluster.

[0075] I / O interface 130 can connect I / O devices (not shown) (e.g., at least one of a display, keyboard, touch screen, and microphone) of device 100 for providing photography services to user interface module 123. I / O interface 130 can cooperate with user interface module 123 to receive user input (e.g., voice input, keyboard input, touch input, etc.) and process instructions based on the received input.

[0076] The processor 140 can be connected to the communication interface 110, the memory 120 and the I / O interface 130 to control the overall operation of the device 100 for providing photographic services, and the processor 140 can execute various instructions to perform photographic services, including artificial intelligence-based content utilization functions, through applications or programs stored in the memory 120.

[0077] Processor 140 may correspond to a computing device such as a central processing unit (CPU) or an application processor (AP). Furthermore, processor 140 may be implemented as an integrated chip (IC), such as a system-on-a-chip (SoC) integrating various computing devices. Alternatively, processor 140 may include modules for computing artificial neural network models, such as a neural processing unit (NPU).

[0078] The following will refer to Figure 3 and Figure 4 This explains how the processor 140 in the device 100 for providing photography services provides photography services that incorporate advertising events.

[0079] Figure 3 This is a schematic flowchart of a method for providing a photographic service performed by an apparatus for providing photographic services, according to one embodiment of the present disclosure.

[0080] Reference Figure 3 The processor 140 may receive at least one instant-print image from the capturing device 200 or the user device 300 (S110). Specifically, the processor 140 may determine eligibility to participate in an advertising event based on at least one of the following: capturing device identification data mapped to the instant-print image, date data regarding the capturing time, or user identification data contained in the image. Here, eligibility to participate in an advertising event can be understood as determining whether an advertising event is currently underway through the photography service system 1000; whether the provided instant-print image was captured by another capturing device; or whether the instant-print image was captured earlier. Based on this determination result, the processor 140 may determine whether a valid instant-print image contains an advertising gesture.

[0081] Following (S110), the processor 140 can determine whether the instant-printed image contains an advertising gesture by inputting the instant-printed image into a gesture recognition model; the gesture recognition model is configured to receive the image as input and output information about whether it contains an advertising gesture (S120). In other words, the processor 140 can determine whether the user's gesture or gesture in the instant-printed image is similar to the gesture or gesture of a person in the advertising content.

[0082] In this regard, Figure 4 This is a schematic diagram showing a posture recognition model according to one embodiment of the present disclosure.

[0083] Reference Figure 4In (a), the processor 140 can input the instant-printed image 12 into the pose recognition model 11-1, which is configured to take the image as input and output whether it contains an advertising pose. From this, the processor 140 obtains a probability value 13, which indicates whether the user's pose matches any of a pre-specified plurality of advertising poses. The processor 140 can determine which advertising pose the user's pose matches based on the probability value output by the pose recognition model 11-1.

[0084] Reference Figure 4 In (b) of this example, processor 140 can identify which advertising event the user wishes to participate in upon receiving an instant print image. For example, processor 140 can determine the type of advertising event based on the graphic object 14-1 contained in the instant print image 14. In another example, processor 140 can check whether the user has selected a specific advertising event in their request to participate in the advertising event. Processor 140 can input the instant print image 14 into a pose recognition model 11-2; this model is configured to take an image as input and output whether it contains an advertising pose, thereby deriving a probability 15 that the user's pose in the instant print image 14 corresponds to a predefined advertising pose. Processor 140 can combine the probability value output by the pose recognition model 11-2 with the previously identified advertising event type to determine whether it matches an advertising pose contained in a specific advertising content in the instant print image 15.

[0085] Following step (S120), if the instant print image contains a corresponding advertising gesture, processor 140 may issue a reward to shooting device 200 or user device 300 (S130). For example, the reward could be points usable in the photography service. Processor 140 may provide a coupon number or QR code to issue the reward to shooting device 200; or issue the reward to the user's account via an application or webpage installed or running on user device 300.

[0086] In various implementation schemes, the rewards provided by processor 140 may also include mystery photo frames, event raffle tickets, etc. Specifically, processor 140 may send a reward selection request to shooting device 200 or user device 300 to determine whether to issue points, mystery photo frames, or event raffle tickets as rewards to the user. If a mystery photo frame is selected as the reward, processor 140 may provide additional shooting services to shooting device 200 or issue coupons to user device 300 to allow the user to use paid photo frames.

[0087] In various implementations, processor 140 can receive a request to participate in an advertising event from any capturing device 200 before receiving the instant print image. This request can be for participation in any advertising campaign or activity; processor 140 can then provide guidance to capturing device 200 regarding the advertising event based on this request. Specifically, processor 140 can receive the instant print image from capturing device 200 in real time. Processor 140 can provide capturing device 200 with guidance regarding the full-body exposure range, the rotation and movement directions of various body parts, and changes in size or direction based on body feature point coordinates to identify advertising poses. For example, using the guidance provided by processor 140, capturing device 200 can visually and audibly output guiding information such as "Please extend both arms diagonally upwards," "Please turn your body to the left," "Please make a V-sign with your index and middle fingers," and "Please rest one arm against the wall" on the image being captured. Furthermore, this guiding information can also be provided to multiple users in the image captured by capturing device 200. Additionally, the processor 140 can provide the capturing device 200 with a probability value indicating whether the printable image contains an advertising gesture. For example, the processor 140 can provide the capturing device 200 with a probability value indicating the similarity between a user gesture contained in the printable image and any advertising gesture selected by the user.

[0088] In various implementations, before receiving the instant print image, the processor 140 can determine the advertising content to be advertised based on the type of advertising event included in the request to participate in the advertising event from any of the shooting devices 200. The processor 140 can send pre-set text or audio data for the determined advertising content to the shooting device 200. For example, if the determined advertising content is a music video, the chorus can be sent to the shooting device 200 as audio data; while if it is a TV series or movie, specific lines can be sent to the shooting device 200 as text data.

[0089] In various implementations, processor 140 may receive a plurality of instant print images consisting of multiple frames. Processor 140 may segment each of the plurality of instant print images and input the segmented plurality of instant print images into a pose recognition model to determine whether each image contains an advertising pose. If at least one of the plurality of instant print images contains an advertising pose that matches a request to participate in an advertising campaign, processor 140 may provide a reward.

[0090] Thus far, an apparatus 100 for providing photographic services has been described according to one embodiment of this disclosure; next, referring to Figure 5The shooting device 200 and user device 300 that actually implement the photography service are described below.

[0091] Figure 5 This is a block diagram illustrating the configuration of a shooting device that includes an AI-based content-based advertising function, according to one embodiment of the present disclosure.

[0092] Reference Figure 5 The imaging device 200 may include a communication interface 210, a memory 220, an I / O interface 230, and a processor 240; each component may communicate with each other through one or more communication buses or signal lines.

[0093] Communication interface 210 can connect to the device 100 for providing photography services and / or user equipment 300 via a wired / wireless communication network to exchange data. For example, communication interface 210 can transmit instant-printed images to the device 100 for providing photography services; and can receive data from the device 100 for providing photography services indicating whether the instant-printed image contains an advertising gesture, or a reward issued based on the presence of an advertising gesture. In another example, communication interface 210 can receive user identification data from user equipment 300 and can send a reward to user equipment 300 based on whether the instant-printed image contains an advertising gesture.

[0094] Meanwhile, the communication interface 210 for implementing such data transmission and reception includes a wired communication port 211 and a wireless circuit 212; wherein, the wired communication port 211 may include one or more wired interfaces, such as Ethernet, Universal Serial Bus (USB), FireWire, etc. Furthermore, the wireless circuit 212 can transmit and receive data with external devices via radio frequency (RF) signals or optical signals. In addition, wireless communication can employ various communication standards, protocols, and technologies, such as GSM, EDGE, CDMA, TDMA, Bluetooth, Wi-Fi, VoIP, Wi-MAX, or at least one of any other applicable communication protocols.

[0095] The memory 220 may store various types of data for the capturing device 200. For example, the memory 220 may store recognition data and user interface configuration data for performing advertising functions utilizing AI-based content. In another example, the memory 220 may store a pose recognition model configured to take an image as input and output information about whether it contains an advertising pose. In yet another example, the memory 220 may store graphic objects of advertising content that can be inserted into an instant-print image, guides (images, audio, text, etc.) for directing the placement of advertising poses, etc. Here, the graphic objects may include frames for advertising content, images of people, etc.; wherein the frames may contain text data such as the title of the advertising content, or image data such as a schematic image representing the advertising content.

[0096] In various implementations, memory 220 may include volatile or non-volatile recording media capable of storing various types of data, instructions, and information. For example, memory 220 may include at least one storage medium selected from flash memory, hard disk, micro multimedia card, card memory (e.g., SD card, XD card, etc.), RAM, SRAM, ROM, EEPROM, PROM, network storage, cloud storage, and blockchain database.

[0097] In various implementations, memory 220 may store configurations of at least one of operating system 221, communication module 222, user interface module 223, one or more applications 224, payment module 225, camera module 226, and photo printing module 227.

[0098] The operating system 221 (e.g., LINUX, UNIX, MACOS, WINDOWS, VxWorks, and other embedded operating systems) may contain various software components and drivers for controlling and managing routine system tasks (e.g., memory management, storage device control, power management, etc.) and may support communication between various hardware, firmware, and software components.

[0099] The communication module 223 can support communication with other devices through the communication interface 210. The communication module 220 may contain various software components for processing data received through the wired communication port 211 or the wireless circuit 212 of the communication interface 210.

[0100] The user interface module 223 can receive user requests or inputs from a keyboard, touch screen, mouse, microphone, etc. via the I / O interface 230, and can provide a user interface on the display 231.

[0101] Application 224 may contain programs or modules configured to be executed by one or more processors 240. Here, an application for capturing and instantly printing images, and utilizing those images for advertising services, can be implemented on a server cluster.

[0102] Payment module 225 can perform payment operations corresponding to photography service requests based on user requests or inputs obtained through I / O interface 230. Payment module 225 can perform contact or contactless payments. For example, payment module 225 can perform payments using methods such as Magnetic Secure Transmission (MST), IC chips, Near Field Communication (NFC), Radio Frequency Identification (RFID), and EMV. Furthermore, payment module 225 can also perform payments corresponding to photography service requests using cash or two-dimensional barcodes.

[0103] The camera module 226 can capture real-time images and videos. The camera module 226 can capture images or videos containing the user through an optical sensor 232 disposed on the front of the shooting device 200, and the image being captured can be displayed on the display screen 231.

[0104] The photo printing module 227 can respond to user requests or input received via I / O interface 230, generate at least one image from multiple images captured by camera module 226, and print it out via printer 233. For example, the photo printing module 227 can generate a live image that combines frames, backgrounds, and graphic objects for advertising content with images or videos captured by camera module 226. Furthermore, the photo printing module 227 can output image code containing a link for downloading the live image from user device 300 simultaneously with the output of the live image. Here, the link can be understood as a webpage link provided by device 100 providing photography services or a link for installing or running an application.

[0105] I / O interface 230 can connect the I / O devices (not shown) of the shooting device 200 (e.g., at least one of display screen 231, keyboard, touch screen, and microphone) to the user interface module 223. I / O interface 230 can work with user interface module 223 to receive user input (e.g., voice input, keyboard input, touch input, etc.) and process instructions (e.g., select an advertising event, capture an image, etc.) based on the received input.

[0106] In various implementations, the I / O interface 230 may include a display 231, an optical sensor 232, and a printer 233. The display 231 may display images being captured by the camera module 226 and simultaneously detect user touch and movement, or interruptions of touch and movement, using any of a variety of touch sensing technologies (e.g., capacitive, resistive, infrared, surface acoustic wave, proximity sensor array, etc.). Furthermore, the optical sensor 232 may receive light from the surrounding environment projected through one or more lenses and convert that light into data representing an image. Therefore, the optical sensor 232 may capture still images or videos containing the user. Additionally, the printer 233 may print the instantaneous images generated by the photo printing module 227 as physical photographs.

[0107] The processor 240 can be connected to the communication interface 210, the memory 220 and the I / O interface 230 to control the overall operation of the shooting device 200; and the processor 240 can execute various instructions through the application or program stored in the memory 220 to perform photographic services including content utilization functions based on artificial intelligence.

[0108] Processor 240 may correspond to a computing device such as a central processing unit (CPU) or an application processor (AP). Furthermore, processor 240 may be implemented as an integrated chip (IC), such as a system-on-a-chip (SoC) integrating various computing devices. Alternatively, processor 240 may include modules for computing artificial neural network models, such as a neural processing unit (NPU).

[0109] In various implementations, processor 240 may acquire at least one image via I / O interface 230, the image containing a user's request to participate in an advertising event. For example, a user's request to take a photo and participate in the activity may be acquired via display 231. Processor 240 may display the user image acquired via camera module 226 on display 231 and may take a photo upon the user's request, thereby acquiring an instant printable image containing the user.

[0110] In various implementations, processor 240 can determine whether the instant-printed image contains an advertising gesture by inputting it into a gesture recognition model configured to receive the image as input and output whether it contains an advertising gesture. Furthermore, if the instant-printed image does contain an advertising gesture, processor 240 can issue a reward to the user corresponding to the instant-printed image via communication interface 210. For example, processor 240 can provide additional photography services using a "hidden frame" as a reward via display 231, or issue points to the user's account that can be used in subsequent photography services.

[0111] Thus far, a photographic device 200 providing AI-based content utilization functionality has been described according to one embodiment of this disclosure. According to this disclosure, the photographic device 200 providing selfie services can guide users to make specific poses related to the advertising subject; when such a pose is detected, the device provides the user with a corresponding reward, thereby stimulating the user's active participation.

[0112] The following will combine Figure 6 Figure 9 describes the overall operation method of the photography service system 1000.

[0113] Figure 6 This is an illustrative flowchart of a method for providing photography services in a photography service system, based on one embodiment of this disclosure.

[0114] Reference Figure 6 As can be seen, according to one embodiment of this disclosure, the method of providing photography services in the photography service system is an example of a method in which a reward is immediately provided to the user once an instant printable image is acquired through the shooting device 200. Specifically, the device 100 for providing photography services can provide the shooting device 200 with guidance on participating in an advertising event (S11). For example, if the device 100 for providing photography services receives a request to participate in a specific advertising event through the shooting device 200, the device can provide the corresponding advertising event participation guidance. For example, the device 100 for providing photography services can output a music video or a video containing specific lines and gestures from the advertising event as guidance.

[0115] In this regard, Figure 7 This is an example diagram of the interface screen of a shooting device that provides a photography service including advertising functions utilizing the content, according to one embodiment of the present disclosure.

[0116] Reference Figure 7 The shooting device 200 can receive a guide 21 (indicating a shooting posture matching the current advertising event) from the device 100 providing the photography service, and display the guide on the display screen 231. It can also display an image of the user currently being photographed in an adjacent area 22. For example, the guide 21 could be a music video or dance video included in the advertising event. Furthermore, if any of multiple advertising events 21 are selected, the shooting device 200 can receive objects that can be inserted into an instant print image from the device 100 providing the photography service, and display these objects on the display screen 231. Here, the objects may include frames for carrying advertising content, images of people, etc. In addition, the shooting device 200 can provide guiding text for changing the position and angle of the user's posture based on the real-time image of the user displayed on the display screen 231.

[0117] In various implementations, the camera device 200 may display multiple ongoing advertising events in the photography service via the display screen 231. For example, these advertising events may include: activities where users attempt to imitate the unique poses of characters in movies or TV shows; activities where users attempt to imitate the signature poses of celebrities; and activities where users attempt to imitate the dance moves of idols.

[0118] Refer again Figure 6 The capturing device 200 can capture an instant printable image (S12) and send the instant printable image, along with a request to participate in an advertising event, to the device 100 for providing photography services (S13). The device 100 for providing photography services can then determine whether the instant printable image contains an advertising gesture (S14). If the image does contain an advertising gesture, the device 100 for providing photography services confirms this through the capturing device 200 to determine which device should issue the reward. Depending on the user's selection through the capturing device 200, the device 100 for providing photography services can issue various types of rewards to the capturing device 200 or the user device 300 (S15).

[0119] Next, Figure 8 This is a schematic flowchart illustrating a method for providing photography services in a photography service system, according to another embodiment of this disclosure.

[0120] refer to Figure 8 According to another embodiment of this disclosure, the method for providing photography services in a photography service system is a specific embodiment of a method for distributing rewards based on instant images provided by user equipment 300. Specifically, the shooting device 200 can capture an instant-printed image and provide it to the user equipment 300 (S21). The user equipment 300 can store the instant-printed image and send a request to the device 100 for providing photography services to participate in an advertising event containing the instant-printed image (S22).

[0121] In this regard, Figures 9a, 9b, 9c and 9d illustrate exemplary schematic diagrams of the interface screen of a user device that provides an advertising function that includes the use of content according to one embodiment of the present disclosure.

[0122] Referring to Figure 9a, user device 300 can install and run an application provided by device 100 for providing photography services. The interface screen running on user device 300 may contain information 31 about the user account and advertising events 32 that the user can participate in. If the user selects advertising event 32, user device 300 may display the interface screen shown in Figure 9b; this screen includes an area 33 for uploading instant printable images, and the instant printable image 34 uploaded by the user may be displayed in this area. Furthermore, if the user selects the upload button 35, user device 300 may send a request to device 100 for providing photography services to participate in the advertising event, containing the instant printable image.

[0123] The device 100 for providing photography services may use the instant print image transmitted from the user device 300 to determine its feasibility of participating in the advertising event (S23). For example, the device 100 for providing photography services may determine whether the instant print image received from the user device 300 was taken by another camera or is an instant print image taken a long time ago. The device 100 for providing photography services may determine, based on the above determination result, whether the valid instant print image contains an advertising gesture (S24). If it contains an advertising gesture, the device 100 for providing photography services can confirm the type of reward that the user should receive through the user device 300. For example, as shown in FIG9d, the device 100 for providing photography services may issue points that can be used in the photography service as a reward to the user device 300.

[0124] This concludes the description of a photography service system according to one embodiment of the present disclosure. According to the present disclosure, by setting iconic poses or dance moves as "advertising points" in various types of content and integrating them into the photography service, it is possible to incentivize users to actively participate in advertising events and help users remember the advertising content.

[0125] Although the embodiments of this disclosure have been described in detail herein with reference to the accompanying drawings, this disclosure is not limited to these specific embodiments; various modifications can be made without departing from the scope of the inventive concept. Therefore, the embodiments disclosed herein are intended to illustrate, not limit, the inventive concept, and the scope of the invention is not limited by these embodiments. Thus, the above embodiments should be understood in all respects as illustrative rather than restrictive. The scope of protection of this disclosure should be interpreted in accordance with the appended claims, and all technical concepts falling within their equivalent scope should be construed as included within the scope of this disclosure.

Claims

1. A method executed by a processor of a photography service providing device, comprising: Receive at least one instant printable image based on a request from the shooting device or user device to participate in an advertising event; The instant print image is input into a pose recognition model to determine whether the instant print image contains an advertising pose. The pose recognition model is configured to receive the image as input and output whether it contains an advertising pose. as well as If the instant print image contains the advertising gesture, a reward is provided to the shooting device or the user device.

2. The method according to claim 1, The pose recognition model is configured to output the probability that a user pose contained in an instant print image corresponds to a predefined advertising pose.

3. The method according to claim 1, further comprising: The advertising posture to be identified in the posture recognition model is determined by using an advertising training model, which is trained using advertising content as input to detect user posture.

4. The method according to claim 1, further comprising: Provide the shooting equipment with guidelines for the advertising event. The guidelines include at least one of the following: full-body exposure range, rotation and movement directions of each body part, and magnitude or orientation changes of coordinates of body feature points to identify the advertising pose.

5. The method according to claim 4, in, Receiving the instant-printed image means receiving the instant-printed image from the capturing device in real time, and The step of determining whether the advertising gesture is included further includes: providing the shooting device with a probability indicating whether the advertising gesture is included in the instant print image.

6. The method according to claim 1, in, Receiving the instant print image refers to receiving multiple instant print images composed of multiple frames, and The provision of the reward means that if at least one of the plurality of instant print images contains an advertising gesture that matches the request to participate in the advertising event, then the reward is provided.

7. The method according to claim 1, in, Receiving the instant print image further includes: determining the type of advertising event based on the graphic objects contained in the instant print image.

8. The method according to claim 1, Before receiving the instant print image, it also includes providing text or audio data preset by the shooting device, depending on the type of advertising event included in the request to participate in the advertising event.

9. An apparatus for providing photographic services, comprising: Communication interface; Memory; as well as A processor operatively connected to the communication interface and the memory; The processor is configured as follows: Receive at least one instant printable image based on a request from the shooting device or user device to participate in an advertising event; The instant print image is input into a pose recognition model to determine whether the instant print image contains an advertising pose. The pose recognition model is configured to receive the image as input and output whether it contains an advertising pose. as well as If the instant print image contains the advertising gesture, a reward is provided to the shooting device or the user device.

10. The apparatus according to claim 9, The pose recognition model is configured to output the probability that a user pose contained in an instant print image corresponds to a predefined advertising pose.

11. The apparatus according to claim 9, wherein, The processor is also configured to: The advertising posture to be identified in the posture recognition model is determined by using an advertising training model, which is trained using advertising content as input to detect user posture.

12. The apparatus according to claim 10, in, The processor is configured to provide the shooting device with guidelines for the advertising event. The guidelines include at least one of the following: full-body exposure range, rotation and movement directions of each body part, and magnitude or orientation changes of coordinates of body feature points to identify the advertising pose.

13. The apparatus according to claim 12, in, The processor is also configured to receive printable images from the shooting device in real time and to provide the shooting device with a probability indicating whether the advertising pose is included in the printable images.

14. The apparatus according to claim 9, in, The processor is configured to receive a plurality of instant print images consisting of multiple frames, and to provide the reward if at least one of the plurality of instant print images contains an advertising gesture that matches a request to participate in the advertising event.

15. The apparatus according to claim 9, in, The processor is also configured to determine the type of advertising event based on the graphic objects contained in the instant print image.

16. The apparatus according to claim 9, in, The processor is also configured to provide text or audio data preset by the shooting device, based on the type of advertising event included in the request to participate in the advertising event, before receiving the instant print image.

17. A shooting device for providing AI-based content utilization functionality, comprising: Communication interface; I / O interfaces; Memory; as well as A processor operatively connectable to the communication interface, the I / O interface, and the memory; The processor is configured as follows: At least one instant print image is obtained through the I / O interface, the instant print image containing a request for the user to participate in the advertising event; the instant print image is input into a gesture recognition model to determine whether the instant print image contains an advertising gesture, the gesture recognition model being configured to receive an image as input and output whether it contains an advertising gesture. And if the instant print image contains the advertising gesture, a reward is provided to the user matching the instant print image via the communication interface.

Images