Method for managing simple imaging system

Abstract

The present invention relates to a technique for managing a simple imaging system. The method for managing a simple imaging system according to one embodiment comprises operations in which: a sensor unit recognizes the entry of a user; a control unit executes imaging preparation in response to the entry of the user; a camera acquires consecutive images of the user in response to the execution of the imaging preparation; a touch screen transmits, to a data processing unit, a selection signal for an imaging option of the user; the data processing unit estimates one or more imaging time points on the basis of the selection signal and the consecutive images of the user; and the camera acquires a still image by capturing the user at the one or more predicted imaging time points.

Description

How to manage a simple shooting system

[0001] The present invention relates to a technology for managing a system for simply taking pictures in a photography booth, and to a technology for taking four-cut pictures and short-form pictures.

[0002] Unless otherwise indicated herein, the materials described in this section are not prior art to the claims of this application, and their inclusion in this section is not intended to be admitted as prior art.

[0003] Prior technologies have limitations in their user interfaces. They can be unintuitive or fail to meet the diverse needs of users. Complex or limited interfaces can degrade the user experience.

[0004] Previous technologies have been lacking in automation and customization. Without automated and customizable features like automatic sensor activation, shooting timing adjustments, and personalized lighting and background music settings, users may struggle to create content with the quality and style they desire.

[0005] Furthermore, prior technologies lacked integrated shooting and sharing services. Without the ability to immediately print and upload to social media after shooting, users had to take additional steps, which could be inconvenient. Existing systems lacked easy access and sharing options via QR codes or download links, limiting users' ability to efficiently manage and share their content.

[0006] One embodiment of the present invention proposes a simple shooting system that provides a one-stop service from shooting to printing and SNS uploading to maximize user convenience and further simplify the shooting experience in order to overcome the limitations of conventional technologies.

[0007] The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.

[0008] A method for managing a simple photographing system according to one embodiment includes: an operation for recognizing a user's position by a sensor unit; an operation for executing photographing preparation in response to the user's position by a control unit; an operation for acquiring continuous images of the user in response to the execution of the photographing preparation by a camera; an operation for transmitting a selection signal for a photographing option of the user to a data processing unit by a touch screen; an operation for estimating one or more photographing points of time based on the selection signal and the continuous images of the user by the data processing unit; and an operation for acquiring a still image by capturing the user at one or more predicted photographing points of time by the camera.

[0009] The method may further include an operation of generating a QR code including link information that can access the still image and the continuous image by the content management unit.

[0010] The above method may further include an action of accessing the user's account of social media by the social media integrated management unit and uploading the still image or the continuous image to the social media.

[0011] The operation of estimating one or more shooting points may include an operation of preprocessing the user's continuous images by an image preprocessing unit to generate preprocessed data; an operation of generating feature data based on the preprocessed data and the user's selection signal by a feature extraction unit; an operation of converting the feature data into time series information by a data conversion unit; and an operation of estimating one or more shooting points based on the time series information by a time estimation unit.

[0012] The operation of estimating the at least one shooting point may include: an operation of determining a difference value that causes the time series information to satisfy a stationarity condition; an operation of generating difference information by differentiating the time series information by the difference value; an operation of defining a difference variable representing the difference information as a linear combination of a past difference variable that affects the difference variable, a past error variable that affects the difference variable, and one or more parameters; an operation of determining a first lag of the past difference variable; an operation of determining a second lag of the past error variable; an operation of determining the at least one parameter based on the first lag, the second lag, and the difference information using a statistical prediction model composed of a neural network; and an operation of estimating the at least one shooting point using the difference variable.

[0013] According to one embodiment of the present invention, the simple shooting system can provide a one-stop service from shooting to printing and SNS uploading, thereby maximizing user convenience and further simplifying the shooting experience.

[0014] The effects that can be obtained from the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by a person having ordinary skill in the art to which the present invention belongs from the description below.

[0015] Other aspects, features and advantages of the above-described specific preferred embodiments of the present invention will become more apparent from the following description taken in conjunction with the accompanying drawings.

[0016] FIG. 1 is a diagram showing the configuration of an electronic device according to one embodiment.

[0017] Figure 2 is a diagram showing the configuration of a program according to one embodiment.

[0018] FIG. 3 is a diagram illustrating the overall configuration of a simple photographing system according to one embodiment.

[0019] FIG. 4 is a flowchart illustrating the operation of a simple photographing system management method according to one embodiment.

[0020] FIG. 5 is a diagram illustrating the configuration of a simple photographing system management server according to one embodiment.

[0021] It should be noted that throughout the drawings, like reference numerals are used to illustrate identical or similar elements, features and structures.

[0022] The following embodiments combine components and features of the embodiments in a predetermined form. Each component or feature may be considered optional unless explicitly stated otherwise. Each component or feature may be implemented without being combined with other components or features. Furthermore, various embodiments may be formed by combining some components and / or features. The order of operations described in various embodiments may be changed. Some components or features of one embodiment may be included in another embodiment or may be replaced with corresponding components or features of another embodiment.

[0023] In the description of the drawings, procedures or steps that may obscure the gist of various embodiments are not described, and procedures or steps that can be understood by a person with ordinary skill in the art are also not described.

[0024] Throughout the specification, when a part is said to "comprising" (or including) a certain component, this does not mean that other components are excluded, but rather that other components can be included, unless specifically stated otherwise. In addition, terms such as "unit," "unit," and "module" used in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware, software, or a combination of hardware and software. In addition, the words "a" or "an," "one," "the," and similar related words may be used in the singular and plural sense in the context of describing various embodiments (especially in the context of the claims below) unless otherwise indicated herein or clearly contradicted by context.

[0025] Hereinafter, embodiments according to various embodiments will be described in detail with reference to the attached drawings. The detailed description disclosed below, together with the attached drawings, is intended to explain exemplary embodiments of various embodiments and is not intended to represent the only embodiment.

[0026] Additionally, specific terms used in various embodiments are provided to aid understanding of the various embodiments, and the use of such specific terms may be changed in other forms without departing from the technical spirit of the various embodiments.

[0027] In addition, the method for providing a service for monitoring and evaluating the operational status of a franchise store according to one embodiment of the present invention can be configured in the same manner as the device for providing a service for monitoring and evaluating the operational status of a franchise store disclosed in FIGS. 1 to 6.

[0028] In addition, the method for providing a service for monitoring and evaluating the operational status of a franchise store in combination with hardware may be implemented as a computer program stored in a computer-readable recording medium.

[0029] In addition, the method for providing a service for monitoring and evaluating the operational status of a franchise store in combination with hardware can be implemented using a computer-readable recording medium storing a computer program.

[0030]

[0031] FIG. 1 is a block diagram of an electronic device within a network environment, according to various embodiments. Referring to FIG. 1 , in a network environment, an electronic device may communicate with another electronic device via a first network (e.g., a short-range wireless communication network) or with at least one of an electronic device and a server via a second network (e.g., a long-range wireless communication network). In one embodiment, the electronic device may communicate with another electronic device via a server (108).

[0032] According to one embodiment, an electronic device may include components such as a processor, memory, an input module, an audio output module, a display module, an audio module, a sensor module, an interface, a connection terminal, a haptic module, a camera module, a power management module, a battery, a communication module, and a subscriber identification module. In certain examples, at least one of these components may be omitted or other components may be added. Furthermore, in some examples, these components may be used in an integrated manner. An electronic device may also be referred to as a client, a terminal, or a peer.

[0033] A processor can control other components (e.g., hardware or software components) connected to an electronic device and primarily execute software (e.g., programs) to perform various data processing and calculations. Typically, a processor stores commands or data received from other components (e.g., sensor modules or communication modules) in volatile memory and processes the stored commands and data to perform various calculations or data processing tasks. The resulting data can then be stored in non-volatile memory. By doing so, the processor can control the functions of an electronic device and process data to perform necessary tasks.

[0034] According to one embodiment, the processor (120) may include a main processor (e.g., a central processing unit or an application processor) or an auxiliary processor (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor. For example, when an electronic device includes a main processor and an auxiliary processor, the auxiliary processor may be configured to use less power than the main processor or to be specialized for a given function. The auxiliary processor may be implemented separately from the main processor or as a part of the main processor.

[0035] A coprocessor is a component that plays a crucial role within an electronic device. It can act as an assistant to the main processor or work in conjunction with the main processor to control functions or states related to other components (e.g., a display module, a sensor module, or a communication module). For example, when the main processor is inactive (e.g., sleeping), the coprocessor can act as the main processor and operate. When the main processor is active (e.g., running an application), the coprocessor can work in conjunction with the coprocessor to control various functions and states. By performing these roles, the coprocessor can enhance the performance and efficiency of the electronic device.

[0036] In some examples, a coprocessor (e.g., a neural network processing unit) with a hardware architecture specialized for processing AI models may be included. The AI ​​models may be generated through machine learning. This learning may occur on the electronic device itself or through a separate server (e.g., an external server, a cloud server). Learning algorithms may take various forms, such as supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

[0037] An AI model may include multiple layers of artificial neural networks. These artificial neural networks may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network (DQN), or a combination of these methods. However, these examples are not limited thereto.

[0038] An artificial intelligence model may additionally or alternatively include software structures in addition to hardware structures.

[0039] Memory is a crucial component used in electronic devices, storing various data. This data primarily consists of input or output data from commands associated with software programs. Memory is divided into volatile and nonvolatile memory. Volatile memory loses stored data when power is turned off, while nonvolatile memory retains data even when power is turned off.

[0040] A program consists of software and can be stored in memory. This program may include components such as an operating system, middleware, and applications. The operating system serves as the core software of a computer system, managing the efficient interaction between hardware and software and providing an interface between the user and computer resources. Middleware is the software layer that facilitates communication between applications and hardware or other software. An application is a software program designed to perform a specific task and provides functionality tailored to the user's needs. These components are stored and executed in memory, supporting the operation of the computer system and providing functionality to the user.

[0041] An input module can provide components of an electronic device (e.g., a processor) with the ability to receive commands or data from an external source (e.g., a user). This module can be composed of various input devices. For example, these can include elements such as a microphone, mouse, keyboard, and buttons. Additionally, a digital pen, such as a stylus pen, can also be used as an input module. The input module facilitates interaction between a user and an electronic device and can function to allow the user to transmit commands or input data. Voice commands can be transmitted through a microphone, and actions such as clicking, scrolling, and key input can be performed using a mouse and keyboard. Furthermore, a button can be pressed to execute a specific function, or a stylus pen can be used to input drawings or handwriting directly into the electronic device. The input module can transmit user commands and inputs to the electronic device for processing.

[0042] An audio output module can output audio signals to the outside of an electronic device. This module may include components such as a speaker or a receiver. Speakers are primarily used for general purposes, such as multimedia playback or recording playback. Receivers are primarily used to receive incoming calls. Furthermore, audio output modules can output audio signals generated by an electronic device to the outside, thereby transmitting sound to the user. Various multimedia content, such as music, movies, and games, can be played through the speaker, while phone calls and notification sounds can be received through the receiver. This allows users to enjoy a variety of audio experiences, such as listening to sounds or voices.

[0043] The first network and the second network refer to a connection structure that enables information exchange between each node, such as terminals and servers, or a network that connects servers and electronic devices. The first network and the second network include, but are not limited to, the Internet, a Local Area Network (LAN), a Wireless Local Area Network (WLAN), a Wide Area Network (WAN), a Personal Area Network (PAN), 3G, 4G, LTE, 5G, Wi-Fi, etc. The first network and the second network may be closed first and second networks, such as a LAN or WAN, but are preferably open, such as the Internet. The Internet refers to a worldwide open computer network (198) and second network (199) structure that provides various services existing at the TCP / IP protocol and its upper layer, namely, HyperText Transfer Protocol (HTTP), Telnet, File Transfer Protocol (FTP), Domain Name System (DNS), Simple Mail Transfer Protocol (SMTP), Simple Network Management Protocol (SNMP), Network File Service (NFS), and Network Information Service (NIS).

[0044] A database may have a general data structure implemented in the storage space (hard disk or memory) of a computer system using a database management program (DBMS). The database may have a data storage form that allows free searching (extracting), deleting, editing, adding, etc. of data. The database may be implemented to suit the purpose of one embodiment of the present disclosure using a relational database management system (RDBMS) such as Oracle, Informix, Sybase, or DB2, an object-oriented database management system (OODBMS) such as Gemston, Orion, or O2, and an XML native database such as Excelon, Tamino, or Sekaiju, and may have appropriate fields or elements to achieve its own function.

[0045]

[0046] Figure 2 is a diagram showing the configuration of a program according to one embodiment.

[0047] FIG. 2 is a block diagram illustrating a program (140) according to various embodiments. According to one embodiment, the program (140) may include an operating system (142), middleware (144), or an application (146) executable in the operating system (142) for controlling one or more resources of the electronic device (101). The operating system (142) may include, for example, Android™, iOS™, Windows™, Symbian™, Tizen™, or Bada™. At least some of the programs (140) may be preloaded in the electronic device (101), for example, during manufacturing, or may be downloaded or updated from an external electronic device (e.g., the electronic device (102 or 104), or a server (108)) when used by a user. All or part of the program (140) may include a neural network.

[0048] The operating system (142) may control the management (e.g., allocation or retrieval) of one or more system resources (e.g., processes, memory, or power) of the electronic device (101). The operating system (142) may additionally or alternatively include one or more driver programs for driving other hardware devices of the electronic device (101), for example, an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197).

[0049] Middleware (144) can provide various functions to the application (146) so that functions or information provided from one or more resources of the electronic device (101) can be used by the application (146). Middleware (144) can include, for example, an application manager (201), a window manager (203), a multimedia manager (205), a resource manager (207), a power manager (209), a database manager (211), a package manager (213), a connectivity manager (215), a notification manager (217), a location manager (219), a graphics manager (221), a security manager (223), a call manager (225), or a voice recognition manager (227).

[0050] The application manager (201) can manage, for example, the life cycle of the application (146). The window manager (203) can manage, for example, one or more GUI resources used on the screen. The multimedia manager (205) can, for example, identify one or more formats required for playing media files, and perform encoding or decoding of a corresponding media file among the media files using a codec suitable for the corresponding format selected among the media files. The resource manager (207) can manage, for example, the source code of the application (146) or the memory space of the memory (130). The power manager (209) can manage, for example, the capacity, temperature, or power of the battery (189), and determine or provide related information necessary for the operation of the electronic device (101) using the corresponding information. According to one embodiment, the power manager (209) can be linked with the basic input / output system (BIOS) (not shown) of the electronic device (101).

[0051] The database manager (211) can, for example, create, search, or modify a database to be used by the application (146). The package manager (213) can, for example, manage the installation or update of an application distributed in the form of a package file. The connectivity manager (215) can, for example, manage a wireless connection or direct connection between the electronic device (101) and an external electronic device. The notification manager (217) can, for example, provide a function for notifying a user of the occurrence of a specified event (e.g., an incoming call, a message, or an alarm). The location manager (219) can, for example, manage location information of the electronic device (101). The graphics manager (221) can, for example, manage one or more graphic effects to be provided to the user or a user interface related thereto.

[0052] The security manager (223) may provide, for example, system security or user authentication. The telephony manager (225) may manage, for example, a voice call function or a video call function provided by the electronic device (101). The voice recognition manager (227) may, for example, transmit the user's voice data to the server (108) and receive, from the server (108), a command corresponding to a function to be performed in the electronic device (101) based at least in part on the voice data, or text data converted based at least in part on the voice data. In one embodiment, the middleware (244) may dynamically delete some existing components or add new components. In one embodiment, at least a portion of the middleware (144) may be included as a part of the operating system (142) or implemented as separate software different from the operating system (142).

[0053] The application (146) may include, for example, a home (251), a dialer (253), an SMS / MMS (255), an instant message (IM) (257), a browser (259), a camera (261), an alarm (263), a contact (265), a voice recognition (267), an email (269), a calendar (271), a media player (273), an album (275), a watch (277), a health (279) (e.g., measuring biometric information such as the amount of exercise or blood sugar), or an environmental information (281) (e.g., measuring barometric pressure, humidity, or temperature information) application. According to one embodiment, the application (146) may further include an information exchange application (not shown) that can support information exchange between the electronic device (101) and an external electronic device. The information exchange application may include, for example, a notification relay application configured to transmit designated information (e.g., a call, a message, or an alarm) to an external electronic device, or a device management application configured to manage an external electronic device. The notification relay application may, for example, transmit notification information corresponding to a designated event (e.g., receipt of an email) that occurs in another application (e.g., an email application (269)) of the electronic device (101) to the external electronic device. Additionally or alternatively, the notification relay application may receive notification information from the external electronic device and provide the information to the user of the electronic device (101).

[0054] A device management application may, for example, control the power (e.g., turning on or off) or the function (e.g., brightness, resolution, or focus) of an external electronic device or a component thereof (e.g., a display module or a camera module of the external electronic device) that communicates with the electronic device (101). The device management application may additionally or alternatively support the installation, deletion, or update of an application running on the external electronic device.

[0055] Throughout this specification, the terms "neural network," "neural network," and "network function" may be used interchangeably. A neural network may be composed of a set of interconnected computational units, generally referred to as "nodes." These "nodes" may also be referred to as "neurons." A neural network comprises at least two or more nodes. The nodes (or neurons) comprising a neural network may be interconnected by one or more "links."

[0056] Within a neural network, two or more nodes connected via links can form a relationship between input and output nodes. The concepts of input and output nodes are relative, meaning that any node that is in an output relationship with one node can also be in an input relationship with another node, and vice versa. As described above, input-to-output node relationships can be created based on links. One input node can be connected to one or more output nodes via links, and vice versa.

[0057] In a relationship between input nodes and output nodes connected through a single link, the value of the output node can be determined based on the data input to the input node. Here, the node interconnecting the input nodes and output nodes can have a weight. The weight can be variable and can be varied by the user or an algorithm so that the neural network can perform a desired function. For example, when one or more input nodes are interconnected to one output node through each link, the output node can determine the output node value based on the values ​​input to the input nodes connected to the output node and the weight set on the link corresponding to each input node.

[0058] As described above, a neural network is a network in which two or more nodes are interconnected through one or more links, forming input and output node relationships within the network. The characteristics of a neural network can be determined based on the number of nodes and links within the network, the relationships between the nodes and links, and the weight values ​​assigned to each link. For example, if two neural networks have the same number of nodes and links but different weight values ​​between the links, the two neural networks can be perceived as different from each other.

[0059]

[0060] FIG. 3 is a diagram illustrating the overall configuration of a simple photographing system according to one embodiment.

[0061] In one embodiment, the simple shooting system is a platform for four-frame photography and short-form photography that offers a modern multimedia experience. It centers around a booth structure with innovative features and a user-friendly design. The booth integrates a high-definition camera, advanced lighting, and sound systems, enabling users to easily create high-quality content. Upon entering the booth, a sensor automatically activates the camera, ready for shooting, and a touchscreen allows users to easily initiate the shoot.

[0062] The core of this system is its four-frame photo capture and short-form video recording capabilities, which automatically adjust timing to provide optimal video length. Users can personalize their videos by selecting from a variety of themes and filters. These customizations reflect their creativity and enable diverse content creation.

[0063] Additionally, the simple shooting system can provide integrated shooting and printing services. After taking a photo, it is immediately printed using a high-quality printer installed within the booth. The printed photo can also be printed with a QR code for video access. This allows users to easily access and further share the captured content.

[0064] Users can create personalized shooting environments through an interface that allows them to easily adjust lighting and background music. These real-time customizations enhance the user experience and make the shooting process more enjoyable and unique.

[0065] Finally, the simple shooting system features social media integration, allowing users to upload footage directly to social media after filming. This process is linked to the user's account and optimized for easy sharing.

[0066] In this way, the simple shooting system can be effectively used at events, festivals, tourist attractions, and more, providing users with unique and engaging experiences. This could be an attractive solution for users seeking a modern multimedia experience.

[0067] Referring to FIG. 3, the simple shooting system (310) may include a shooting booth, a camera system, a lighting and sound system, a touchscreen interface, a printing device, a social media integration management unit, and a QR code system.

[0068] A photo booth provides a space where users can take their own photos. The exterior structure of the photo booth features a sturdy, safe frame designed to protect the user's privacy and the device. The interior of the photo booth provides ample space for users to comfortably stand or sit, and is equipped with lighting and a backdrop suitable for filming.

[0069] The camera system may include a camera capable of capturing high-definition video and photos. The camera system may include sensors capable of tracking the user's movements.

[0070] The lighting and sound system provides a variety of lighting settings and background music selections. Users can directly control the lighting and sound system.

[0071] The touchscreen interface can provide an interface to control functions such as setting shooting modes, lighting, music, etc. and uploading to SNS.

[0072] The printing device may include a high-quality printer capable of quickly printing photographs.

[0073] The QR code system may include a QR code generator. The QR code generator may generate a QR code that includes a short-form video link in the printed photo.

[0074] The social media integration management unit may include a social media integration system and network connection tools. The social media integration system may provide a function that allows users to directly upload captured content by linking to their social media accounts. The network tool may support the rapid upload and sharing of captured content through a stable internet connection.

[0075] The simple shooting system (310) may be linked to software capable of comprehensively manipulating the components. The software may be installed on the processor of the simple shooting system (310). The software may include shooting control software and a user interface for user customization. The shooting control software may provide functions for users to easily select and adjust shooting times, filters, themes, etc. The user interface may provide user customization settings. Through the user interface, users can adjust lighting, music, filters, etc. to suit their personal preferences.

[0076] Each of these components is designed to provide users with an intuitive and convenient photography and short-form shooting experience.

[0077] The simple shooting system (310) is a system based on interaction between a user terminal and an operator's system. Their interaction and operation are described below.

[0078] A user can enter the photo booth. In one embodiment, the simple photo booth system (310) can recognize the user's position through a sensor unit. When the user enters the photo booth, the sensor can recognize the user's position.

[0079] The simple shooting system (310) can initiate shooting preparations in response to the user's position via the control unit. Here, the shooting preparations may include all preparations for capturing still and continuous images of the user. For example, inactive cameras, touchscreens, and printing devices may be activated.

[0080] The simple shooting system (310) can capture a series of images of the user in response to the execution of a shooting preparation via a camera. The camera can capture the series of images by capturing the user at some or all of the time before the user takes the shot. The short series of images or videos thus captured can be referred to as short-form.

[0081] The simple shooting system (310) can transmit a selection signal for a user's shooting options to the data processing unit via the touchscreen. The user can adjust shooting settings via the touchscreen. The user can also set shooting modes, lighting, music, etc. via the touchscreen. The user's selection signal for the shooting options can be transmitted to the data processing unit.

[0082] The simple shooting system (310) can estimate one or more shooting points based on a selection signal and a user's continuous images through a data processing unit.

[0083] The simple photographing system (310) can preprocess a user's continuous images through an image preprocessing unit to generate preprocessed data. During this process, image quality is improved, data size is adjusted, and unnecessary information is removed. This is an essential step for achieving better results in subsequent processing. The image preprocessing unit can improve the clarity of the images by removing unnecessary noise or interference from the continuous images. This can be accomplished using filtering techniques. The preprocessing unit can adjust the color balance of the images to enhance color perception and provide a more natural visual presentation. The preprocessing unit can standardize the image size and normalize pixel values ​​within a certain range to increase computational efficiency in subsequent processing. The preprocessing unit can emphasize the edges of important objects or shapes in the images to improve accuracy in subsequent feature extraction. The preprocessing unit can adjust contrast to make image details more distinct. This plays a crucial role in object recognition and classification. If necessary, the preprocessing unit can adjust the image to the optimal orientation and size through rotation, scaling, or other geometric transformations.

[0084] The simple shooting system (310) can generate feature data based on preprocessing data and a user's selection signal through a feature extraction unit. The feature extraction unit analyzes the shooting environment and conditions set by the user and extracts optimal image characteristics suitable for the environment. For example, if the user selects bright lighting and upbeat music, the feature extraction unit extracts feature data from the preprocessing data so that the brightness, color contrast, and dynamic elements of the image suitable for such environment are reflected. The feature data generated in this way plays a crucial role in estimating the shooting time, which produces results that better suit the user's shooting intention and environment.

[0085] The simple photographing system (310) can convert feature data into time-series information through a data conversion unit. The data conversion unit can convert the feature data into time-series information based on the time information contained in the feature data. The data conversion unit arranges the feature data in a temporal context, enabling the identification of patterns or trends over time.

[0086] The simple shooting system (310) can estimate one or more shooting points based on time series information through a point estimation unit. The point estimation unit can estimate one or more shooting points corresponding to current time series information based on past data.

[0087] The simple photographing system (310) can determine a difference value that makes time series information satisfy the stationarity condition through a point estimation unit. The point estimation unit can generate difference information by differentiating the time series information by the difference value. The point estimation unit can define a difference variable representing the difference information as a linear combination of a past difference variable that affects the difference variable and a past error variable that affects the difference variable. The point estimation unit can determine a first lag of the past difference variable. The point estimation unit can determine a second lag of the past error variable. The point estimation unit can determine one or more parameters based on the first lag, the second lag, and the difference information using a statistical prediction model composed of a neural network. The point estimation unit can estimate one or more shooting points using the difference variable.

[0088] The simple shooting system (310) can generate difference information by differentiating the time series information by the difference value through the time estimation unit. Stationarity refers to the property that the mean and variance of the time series are constant and there is no specific trend (trend). Stationarity is defined as strong stationarity and weak stationarity. Generally, it is considered that the analysis is valid even if only weak stationarity is satisfied, and the criteria for satisfying weak stationarity are defined as follows.

[0089] For any t, h, a random variable X such that:

[0090]

[0091]

[0092]

[0093] Here, is the autocovariance function (ACVF), and the third equation means that the covariance does not depend on time point t, but only on the time difference (lag) h.

[0094] When a random variable sample does not exhibit stationarity, stationarity can be achieved through a difference process. Here, difference refers to finding the difference between the values ​​at time t and time t-1. The number of difference processes can be defined as the difference value, which is an integer greater than or equal to 0.

[0095] The first difference, where the difference value is 1, is defined as follows:

[0096]

[0097] The second difference, with a difference value of 2, is defined as follows:

[0098]

[0099] The point estimation unit can generate difference information by differentiating time series information by the difference value. For example, if the difference value satisfying the stationarity condition is 2, and the number of samples of the random variable yt is N, the number of samples of the difference variable y't becomes N-2.

[0100] The simple shooting system (310) can define a differential variable representing differential information through a point estimation unit as a linear combination of a past differential variable affecting the differential variable, a past error variable affecting the differential variable, and one or more parameters.

[0101] [Mathematical Formula 1]

[0102]

[0103] In mathematical expression 1, p is referred to as the second lag, and q is referred to as the first lag. y't denotes the value of the difference variable y' at time t, and y't-p denotes the value of the difference variable y' at time tp. means the value of the error variable at time t, means the value of the error variable at time tq.

[0104] The simple shooting system (310) can determine the first time lag of the past differential variable through the time estimation unit. The time estimation unit can define the differential correlation variable and determine the first time lag using Equation 2. The time estimation unit can generate a graph (e.g., Graph 1) with the time series data of the differential correlation variable calculated by Equation 2 as the vertical axis and the time lag as the x-axis. The time estimation unit can determine the time lag immediately preceding the time lag at which the value of the differential correlation variable first enters the first confidence interval based on a predetermined first confidence interval as the first time lag.

[0105] [Equation 2]

[0106]

[0107] In mathematical expression 2, is a differential correlation variable, yt is a differential variable, and y't in Equation 1 can be substituted into yt in Equation 2. is the mean of the difference variable, k is the lag, and here T is the length of the time series.

[0108] [Graph 1]

[0109]

[0110] In Graph 1, the blue dotted line represents the confidence interval, and since the first value within the confidence interval appears when the lag is 9, the value immediately before that, 8, can be defined as the first lag.

[0111] The simple shooting system (310) can determine the second time lag of the past error variable through the time estimation unit. The time estimation unit can define the differential partial variable using Equation 3 and determine the second time lag. The time estimation unit can generate a graph (e.g., Graph 2) with the time series data of the differential partial variable as the vertical axis and the time lag calculated by Equation 3 as the x-axis. The time estimation unit can determine the time lag immediately preceding the time lag at which the value of the differential correlation variable first enters the second confidence interval based on a predetermined second confidence interval as the second time lag.

[0112] [Equation 3]

[0113]

[0114] In mathematical expression 2, is a differential correlation variable, is the error variable and in mathematical expression 1 It is the same as . is the mean of the error variable, k is the lag, and here T is the length of the time series.

[0115] [Graph 2]

[0116]

[0117] In Graph 2, the blue dotted line represents the confidence interval, and since the first value within the confidence interval appears when the lag is 2, the value immediately before that, 1, can be defined as the second lag.

[0118] The simple shooting system (310) can determine one or more parameters based on the first disparity, second disparity, and differential information using a statistical prediction model composed of a neural network through a point estimation unit.

[0119] A statistical prediction model may include an input layer, one or more hidden layers, and an output layer.

[0120] Each training data consisting of the first lag, the second lag, and the differential information is input to the input layer of the statistical prediction model, passes through one or more hidden layers and an output layer, and outputs an output vector. The output vector is input to a loss function layer connected to the output layer, and the loss function layer outputs a loss value using a loss function that compares the output vector with the correct vector for each training data, and the parameters of the statistical prediction model can be learned in a direction in which the loss value decreases.

[0121] [Equation 4]

[0122]

[0123] The loss function can follow Equation 4. In Equation 4, n represents the number of training data per class, y and j represent identifiers representing classes, C represents a constant value, M represents the number of classes, x_y represents the probability that training data belongs to class y, x_j represents the probability that training data belongs to class j, and L represents the loss value.

[0124] Since the number of learning data per class is reflected in Equation 4, a class with a small number of learning data may have a small effect on learning, and a class with a large number of learning data may have a large effect on learning.

[0125] The simple shooting system (310) can estimate one or more shooting points using a differential variable through a point estimation unit. In mathematical expression 1, the differential value of the differential variable is determined by the stationarity condition, the first time difference is determined by mathematical expression 2, the second time difference is determined by mathematical expression 3, and the remaining parameters are determined by a statistical prediction model, so mathematical expression 1 can be defined. The data processing unit can estimate current difference information based on past difference information using the defined mathematical expression 1, and estimate one or more shooting points based on the estimated difference information.

[0126] The simple shooting system (310) can capture still images of a user at one or more predicted shooting points using a camera. The estimated one or more shooting points may be predicted to be optimal moments for capturing the user under shooting conditions selected by the user. This allows the simple shooting system (310) to capture still images of higher quality and more meaningful images, thereby providing greater user satisfaction.

[0127] The simple shooting system (310) can generate a QR code containing link information for accessing still images and continuous images through the content management unit.

[0128] Users' still images, continuous images, and QR codes can be temporarily stored in the database. The storage period can be preset, for example, for several hours or several days, depending on operational policies.

[0129] A simple photographing system (310) can develop still images into photographs using a photographing device. A QR code can be inserted into the photograph.

[0130] Referring to Figure 3, for example, the touchscreen interface can display still images, continuous images, QR codes, and social media access icons. Users can view still images and continuous images through the touchscreen interface and access content via their terminal using QR codes. Users can also easily access their social media accounts by touching the social media access icons.

[0131] The simple shooting system (310) includes a social media integration management unit that can access a user's social media account and upload still or continuous images to social media. The social media integration management unit can facilitate the user's easy upload of captured content to social media. Users can upload content directly to social media via the touchscreen of the shooting booth. This process is achieved through linking the user's social media account with the booth system.

[0132] Users can use their smartphones or tablets to scan QR codes, access captured photos and videos, and even upload them directly to social media. Users can scan the QR code on the printed photos with their devices. After scanning, their devices will automatically be redirected to a link to download or view the photos and videos. Users can then download the content or share it directly on social media via this link.

[0133] In this way, the simple shooting system (310) ensures smooth interaction between users and operators, and can provide a simple and enjoyable experience to users and efficient content management and customer service to operators.

[0134]

[0135] FIG. 4 is a flowchart illustrating the operation of a method for managing a simple photographing system (310) according to one embodiment.

[0136] According to one embodiment, in operation (401), the sensor unit can recognize the user's position. When the user enters the shooting booth, the sensor can recognize the user's position.

[0137] According to one embodiment, in operation (403), the control unit may execute preparations for capturing in response to the user's position. Here, preparations for capturing may include all preparations for acquiring still images and continuous images of the user.

[0138] In one embodiment, in operation (405), the camera may acquire a series of images of the user in response to the execution of the shooting preparation. The camera may capture a short-form image of the user by capturing the user in a short period of time before the user takes the shot.

[0139] In one embodiment, in operation (407), the touchscreen may transmit a selection signal for a user's shooting option to the data processing unit. The shooting options may include selections for shooting mode, lighting, music, etc.

[0140] According to one embodiment, in operation (409), the data processing unit may estimate one or more shooting points based on a selection signal and the user's continuous images. The data processing unit may preprocess the continuous images based on the user's shooting options, extract features, and estimate one or more shooting points using statistical processing techniques and a neural network model.

[0141] In one embodiment, in operation (411), the camera can capture a still image of the user at one or more predicted shooting points. This allows the simple shooting system (310) to capture higher quality and more meaningful still images, thereby providing greater user satisfaction.

[0142]

[0143] FIG. 5 is a diagram illustrating the configuration of a simple photographing system management server according to one embodiment.

[0144] According to one embodiment, the simple shooting system (310) may include a content management unit (511), a sensor unit (513), a control unit (515), a camera (517), a data processing unit (512), a touch screen (519), lighting (521), a speaker (523), and a social media integration management unit (525).

[0145] The content management unit (511) can generate a QR code containing link information that can access still images and continuous images captured by the camera.

[0146] The sensor unit (513) can recognize that a user has entered the shooting booth.

[0147] The control unit (515) can execute shooting preparations in response to the user's position. Here, the shooting preparations can include all preparations for acquiring still images and continuous images of the user.

[0148] The camera (517) can capture a user in a short period of time before the user takes the picture, thereby obtaining a series of images, referred to as short-form images. The camera (517) can capture a user in a short period of time before the user takes the picture, thereby obtaining one or more still images.

[0149] The touchscreen (519) can transmit a selection signal for the user's shooting options to the data processing unit. The touchscreen (519) can display still images, continuous images, QR codes, and social media access icons. The user can view still images and continuous images through the touchscreen (519) and access content through the terminal using the QR code.

[0150] Lighting (521) can change the illuminance, brightness, and saturation for capturing the user's image within the shooting booth. Lighting (521) can provide a combination of light patterns according to various temporal rules.

[0151] The speaker (523) can provide audio signals for user-selected music or guidance.

[0152] The social media integrated management unit (525) can support users in easily uploading captured content to social media. Users can upload content directly to social media via the touchscreen of the photo booth. This process is accomplished through linking the user's social media account with the booth system.

[0153] The data processing unit (512) may include an image preprocessing unit (514), a feature extraction unit (516), a data conversion unit (518), a viewpoint estimation unit (520), and a model learning unit (522).

[0154] The image preprocessing unit (514) can preprocess the user's continuous images to generate preprocessed data.

[0155] The feature extraction unit (516) can generate feature data based on preprocessing data and a user's selection signal.

[0156] The data conversion unit (518) can convert feature data into time series information.

[0157] The point-of-view estimation unit (520) can estimate one or more shooting points based on time series information. The point-of-view estimation unit (520) can estimate one or more shooting points using a statistical prediction model composed of a neural network model based on time series information.

[0158] The model learning unit (522) can learn a statistical prediction model composed of a neural network model as a basis. Each learning data composed of a first time difference, a second time difference, and differential information is input to an input layer of the statistical prediction model, passes through one or more hidden layers and an output layer, and outputs an output vector. The output vector is input to a loss function layer connected to the output layer. The loss function layer outputs a loss value using a loss function that compares the output vector with the correct answer vector for each learning data. The parameters of the statistical prediction model can be learned in a direction in which the loss value decreases.

[0159]

[0160] The embodiments described above may be implemented using hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0161] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination. The program commands recorded on the medium may be those specially designed and configured for the embodiment or may be those known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of the program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiment, and vice versa.

[0162] Software may include a computer program, code, instructions, or a combination of one or more of these, and may configure a processing device to perform a desired operation or, independently or collectively, command the processing device. The software and / or data may be permanently or temporarily embodied in any type of machine, component, physical device, virtual equipment, computer storage medium or device, or transmitted signal wave, for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0163] Although the embodiments described above have been described with limited drawings, those skilled in the art will appreciate that various technical modifications and variations can be applied based on the above. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0164] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. An action to recognize the user's position by the sensor unit; An action of executing shooting preparation in response to the user's position by the control unit; An action of acquiring a continuous image of the user in response to the execution of the above shooting preparation by the camera; An action of transmitting a selection signal for the user's shooting option to the data processing unit by means of a touch screen; An operation of estimating one or more shooting points based on the selection signal and the user's continuous images by the data processing unit; and An action of capturing a still image by capturing the user at one or more predicted shooting points by the camera. A method for managing a simple photographing system, comprising:

2. In paragraph 1, An action of generating a QR code including link information that can access the still image and the continuous image by the content management unit. A method for managing a simple photographing system, further comprising:

3. In paragraph 1, An action of accessing the user's account on social media and uploading the still image or continuous image to the social media by the social media integrated management department. A method for managing a simple photographing system, further comprising:

4. In paragraph 1, The operation of estimating one or more of the above shooting points is: An operation of preprocessing the continuous images of the user by an image preprocessing unit to generate preprocessed data; An operation of generating feature data based on the preprocessing data and the user's selection signal by a feature extraction unit; An operation of converting the feature data into time series information by a data conversion unit; and An operation of estimating one or more shooting points based on the time series information by a point estimation unit. A method for managing a simple photographing system, comprising:

5. In paragraph 4, The operation of estimating one or more of the above shooting points is: An operation of determining a difference value that ensures that the above time series information satisfies the stationarity condition; An operation of generating difference information by differentiating the time series information by the difference value; An operation of defining a differential variable representing the differential information as a linear combination of a past differential variable affecting the differential variable, a past error variable affecting the differential variable, and one or more parameters; An operation for determining the first lag of the above past difference variable; An operation for determining the second lag of the above past error variable; An operation of determining one or more parameters based on the first time difference, the second time difference, and the differential information using a statistical prediction model composed of a neural network; and An operation of estimating one or more shooting points using the above difference variables. A method for managing a simple photographing system, comprising:

Images