Method and system for providing web ar contents based on tattoo sticker markers
The method addresses the inconvenience of app-based AR services by delivering stable and immersive AR experiences on web browsers, correcting distortions for tattoo stickers, thereby reducing user dropout rates and enhancing interaction.
Patent Information
- Application Number
- KR1020260064827
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2026-04-09
- Publication Date
- 2026-11-06
- Estimated Expiration
- 2046-04-09
AI Technical Summary
Existing AR services require app installation, which causes inconvenience and high user churn rates, especially with disposable products like tattoo stickers, and fail to provide immersive experiences due to distortion from joint movement and skin curvature.
A method that provides WEB AR content without app installation, correcting distortion through marker identification and rendering on a web browser, using computer vision and AI to stabilize and personalize AR content based on user input.
Reduces user dropout rates by providing stable and immersive AR experiences on web browsers, correcting distortions caused by joint movements and skin curvature, and allowing content parameter changes based on user input.
Smart Images

Figure 112026043731640-PAT00001_ABST
Abstract
Description
Technology Field
[0001] The present disclosure relates to a technology for providing WEB AR content based on tattoo sticker markers, and more specifically, to a method and system that provides an appless method that breaks down the barrier to app installation and corrects distortion caused by joint movement or skin curvature. Background Technology
[0002] Existing AR services are designed with a structure that requires users to install a dedicated application to use them. This approach demands an additional installation process to experience AR content, which can cause inconvenience to users. In particular, when combined with disposable products such as tattoo stickers, the barrier to entry required by the app acts as a major cause of high user churn rates. Consequently, these technical limitations restrict the accessibility of AR services and act as factors that hinder the user experience.
[0003] Furthermore, existing AR technology has limitations in recognizing unstructured media. Human skin is a curved surface rather than a flat one, and designs or markers are highly likely to become distorted due to movement. Due to these characteristics, issues such as AR content jittering or misalignment occur. This degrades the stability and accuracy of AR content, potentially providing a negative user experience. These technical limitations become even more pronounced, particularly when applied to products such as tattoo stickers.
[0004] Furthermore, existing AR services often limit themselves to simply playing sounds or providing flat experiences through dedicated apps. This fails to offer users an immersive experience and results in the inability to fully realize the potential of AR technology. In particular, by failing to provide the interactive and intuitive experiences users expect, it restricts the potential for utilizing AR services. The problem to be solved
[0005] The purpose of the present disclosure is to provide a method and system for providing WEB AR content that provides augmented reality content without app installation and corrects distortion caused by joint movement or skin curvature. means of solving the problem
[0006] A method according to one embodiment of the present disclosure is a method executed by an electronic device, comprising the steps of acquiring an image of a tattoo sticker attached to a user's body, identifying a marker corresponding to the tattoo sticker based on the image, selecting augmented reality content based on the user's preference information corresponding to the marker, and rendering the augmented reality content on a web browser of the user's terminal, wherein the augmented reality content may be content in which at least some of the parameters of the content can be changed based on the user's input.
[0007] In one embodiment, the step of identifying the marker may include removing distortion caused by the user's joint movement or skin curvature from the image, and identifying the marker by extracting feature points of the tattoo sticker from the image from which the distortion has been removed.
[0008] In one embodiment, the step of removing distortion includes: extracting the coordinates of pixels constituting the outline of the tattoo sticker included in the image; calculating the distance difference and angle difference between the coordinates of the extracted pixels and the outline pixel coordinates of a pre-stored reference marker; generating a deformation vector including the direction of movement and distance of movement of the pixels based on the calculated distance difference and angle difference; and correcting the shape of the image by moving the pixels of the image in the reverse direction of the deformation vector by the distance of movement. The step of rendering includes correcting the rendering coordinates of the augmented reality content based on the correction of distortion. The step of correcting the rendering coordinates may include: obtaining reference plane coordinates where the augmented reality content is to be displayed; calculating curved surface mapping coordinates that reflect the shape of the skin curvature or joint movement by reflecting the direction of movement and distance of movement of the deformation vector at each point of the obtained reference plane coordinates; and matching the calculated curved surface mapping coordinates to the screen output coordinate system of the web browser to determine the rendering coordinates.
[0009] In one embodiment, the step of selecting the augmented reality content may include the step of extracting preference information based on the attributes of the tattoo sticker and the logs of the user terminal, and the step of outputting the augmented reality content corresponding to the preference information by inputting the preference information into an artificial intelligence model.
[0010] In one embodiment, the step of outputting the augmented reality content corresponding to the preference information by inputting the preference information into an artificial intelligence model may include the step of separating the log included in the preference information into visual feature values and interaction frequency values through the artificial intelligence model, the step of calculating a match rate score by comparing the metadata of each of the plurality of candidate augmented reality contents stored in a database with the visual feature values and the interaction frequency values, and the step of extracting the candidate augmented reality content with the highest match rate score among the plurality of candidate augmented reality contents and determining and outputting it as the augmented reality content corresponding to the tattoo sticker.
[0011] In one embodiment, the method may further include the steps of: calculating the pixel area occupied by the tattoo sticker in each of a plurality of frame images continuously acquired through a camera of the user terminal; decreasing the transparency parameter of the augmented reality content and increasing the texture resolution parameter applied to the augmented reality content when the calculated pixel area increases by more than a preset reference area value; and increasing the transparency parameter of the augmented reality content and decreasing the texture resolution parameter when the calculated pixel area decreases to less than the preset reference area value.
[0012] An apparatus according to one embodiment of the present disclosure may be combined with hardware and controlled by a computer program stored on a medium to execute the method of any one of the methods described above. Effects of the invention
[0013] According to one embodiment of the present disclosure, user dropout rates can be reduced by rendering augmented reality content through a web browser without the need for app installation. According to one embodiment of the present disclosure, shaking or misalignment of augmented reality content can be prevented by stably identifying markers through correction of distortions caused by joint movements or skin curvature. Furthermore, according to one embodiment of the present disclosure, the immersion of the user experience can be enhanced by providing augmented reality content that allows content parameters to be changed based on user input. Brief explanation of the drawing
[0014] FIG. 1 illustrates an environment in which a management device according to one embodiment of the present disclosure can be applied. FIG. 2 illustrates an electronic device capable of implementing a management device according to one embodiment of the present disclosure. FIG. 3 illustrates a flowchart showing a method according to one embodiment of the present disclosure. Figure 4 illustrates a flowchart showing the detailed operation of the identification operation described with reference to Figure 3. Figure 5 illustrates a flowchart showing the detailed operation of the removal operation described with reference to Figure 4. Figure 6 illustrates a flowchart showing the detailed operation of the rendering operation described with reference to Figure 3. Figure 7 illustrates a flowchart showing the detailed operation of the correction operation described with reference to Figure 6. FIG. 8 illustrates a flowchart showing the detailed operation of the selection operation described with reference to FIG. 3. FIG. 9 illustrates a flowchart showing the detailed operation of the output operation described with reference to FIG. 8. FIG. 10 illustrates a flowchart illustrating a method according to one embodiment of the present disclosure. FIG. 11 illustrates a flowchart showing a method according to one embodiment of the present disclosure. FIG. 12 illustrates a flowchart showing the detailed operation of the generation operation described with reference to FIG. 11. FIG. 13 illustrates a flowchart showing the detailed operation of the removal operation described with reference to FIG. 12. FIGS. 14 to 16 illustrate flowcharts showing detailed operations of the playback operation described with reference to FIG. 11. FIG. 17 illustrates an example of implementation that may be referenced in various embodiments of the present disclosure. Specific details for implementing the invention
[0015] The various embodiments described in this disclosure are illustrative for the purpose of clearly explaining the technical concept of this disclosure and are not intended to limit it to specific embodiments. The technical concept of this disclosure includes various modifications, equivalents, alternatives, and embodiments selectively combined from all or part of each embodiment described in this disclosure. Furthermore, the scope of the technical concept of this disclosure is not limited to the various embodiments presented below or the specific descriptions thereof.
[0016] Terms used in this disclosure, including technical or scientific terms, may have the meaning generally understood by a person skilled in the art to which this disclosure pertains, unless otherwise defined. Since such terms may be referred to by various other terms depending on technological development, changes, conventions, and the preferences of skilled persons, the scope of the technical concept of this disclosure is not limited by the meaning of the terms used below.
[0017] Expressions used in this disclosure, such as “comprising,” “may compose,” “possessing,” “possessing,” “having,” and “possessing,” mean that the subject feature (e.g., function, operation, or component, etc.) exists and do not exclude the existence of other additional features. That is, such expressions should be interpreted as open-ended terms implying the possibility of including other embodiments.
[0018] Singular expressions used in this disclosure may include the meaning of the plural form unless otherwise indicated by the context, and this applies likewise to singular expressions described in the claims.
[0019] Ordinal expressions used in this disclosure, such as "first," "second," or "first," "second," etc., are used to distinguish one object from another when referring to a plurality of objects of the same kind, unless otherwise indicated in the context, and do not limit the order or importance of the objects.
[0020] Expressions used in the present disclosure, such as “A, B and C”, “A, B or C”, “at least one of A, B and C”, and “at least one of A, B or C”, may mean each of the listed items or all possible combinations of the listed items. For example, “at least one of A or B” may refer to (i) at least one A, (ii) at least one B, and (iii) at least one A and at least one B.
[0021] The expression “based on” as used in this disclosure is used to describe one or more factors affecting an act or action of a decision or judgment described in the phrase or sentence containing this expression, and this expression does not exclude additional factors affecting said act or action of a decision or judgment.
[0022] As used in the present disclosure, the expression that a certain component (e.g., a first component) is "connected" or "connected" to another component (e.g., a second component) may mean that the certain component is not only directly connected or connected to the other component, but is also connected or connected through a new other component (e.g., a third component).
[0023] As used in this disclosure, the expression "configured to" may have meanings such as "set to," "capable of," "modified to," "made to," or "capable of." This expression is not limited to the meaning of "specifically designed in hardware." For example, a processor configured to perform a specific operation may mean a generic-purpose processor capable of performing that specific operation by executing software, or a special-purpose computer structured through programming to perform that specific operation.
[0024] The expressions “part,” “module,” “model,” etc. used in this disclosure refer to software or hardware components such as FPGAs (Field-Programmable Gate Arrays) and ASICs (Application Specific Integrated Circuits). Here, “part,” “module,” “model,” etc. may be configured to reside in an addressable storage medium and may be configured to operate one or more processors. Accordingly, “part,” “module,” “model,” etc. may include components such as software components, object-oriented software components, class components, and task components, as well as processors, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. Additionally, the functions provided through “part,” “module,” “model,” etc. may be combined into smaller units of “part,” “module,” or “model.”
[0025] Embodiments of the present disclosure will be described below with reference to the attached drawings. In the attached drawings, identical or corresponding components are given the same reference numerals. Furthermore, in the description of the embodiments below, the description of identical or corresponding components may be omitted. However, even if a description of a component is omitted, it is not intended that such component is not included in any embodiment.
[0026] FIG. 1 illustrates an environment (100) to which a management device (110) according to one embodiment of the present disclosure can be applied.
[0027] Referring to FIG. 1, an environment (100) according to one embodiment of the present disclosure may be illustrated. The environment (100) may include a management device (110) and a user terminal (120). The management device (110) and the user terminal (120) may communicate with each other through a network.
[0028] The management device (110) can receive an image of a tattoo sticker from a user terminal (120). The management device (110) can create or select augmented reality content based on the received image. The management device (110) can transmit the created or selected augmented reality content to the user terminal (120). For example, the management device (110) may be a Web Server, a Cloud Server, an Application Server, a Database Server, an Artificial Intelligence Server, an Edge Computing Server, or a Distributed Computing System. However, the present disclosure is not limited thereto.
[0029] In one embodiment of the present disclosure, the management device (110) can perform an operation to correct distortion of a tattoo sticker image. The management device (110) can analyze image distortion caused by the user's joint movements or skin curvature. Based on the analysis results, the management device (110) can generate a deformation vector and use it to correct the image to be close to the original shape. In addition, the management device (110) can extract feature points of the tattoo sticker from the corrected image to reliably identify markers.
[0030] In one embodiment of the present disclosure, the management device (110) can provide personalized augmented reality content based on user preference information. The management device (110) can compose preference information by collecting unique attributes of a tattoo sticker and usage logs of a user terminal (120). The management device (110) can use an artificial intelligence model to select the augmented reality content with the highest match rate with the preference information from a database and transmit it to the user terminal (120).
[0031] The user terminal (120) can photograph a tattoo sticker attached to the user's body. The user terminal (120) can transmit the photographed image to the management device (110). The user terminal (120) can render the augmented reality content received from the management device (110) onto a web browser and provide it to the user. For example, the user terminal (120) may be a smartphone, a tablet computer, a notebook computer, smart glasses, a head-mounted display (HMD), a wearable device, or a personal computer (PC). However, the present disclosure is not limited thereto.
[0032] In one embodiment of the present disclosure, a user terminal (120) can use an augmented reality service through a web browser without installing a separate application. The web browser of the user terminal (120) may support technologies such as WebAssembly, WebGL, or WebAR. Through this, the user terminal (120) can render augmented reality content provided by the management device (110) in real time and process interactions with the user.
[0033] In one embodiment of the present disclosure, a user terminal (120) can receive user input and interact with augmented reality content. The user terminal (120) can detect user input through a touch screen, voice recognition, or a motion sensor, etc. The user terminal (120) can request a management device (110) to change parameters such as color, size, shape, or animation of the augmented reality content according to the detected user input, or process it itself.
[0034] FIG. 2 illustrates an electronic device (200) capable of implementing a management device (110) according to one embodiment of the present disclosure.
[0035] Referring to FIG. 2, the electronic device (200) may implement a management device (110) or a user terminal (120) according to one embodiment of the present disclosure. The electronic device (200) may be implemented as various computing devices. For example, the electronic device (200) may be a desktop computer, a laptop computer, a tablet computer, a smartphone, a server computer, a wearable device, and an Internet of Things (IoT) device. However, the present disclosure is not limited thereto. The electronic device (200) may include a processor (210), a memory (220), and a communication interface (230).
[0036] The processor (210) can control the overall operation of the electronic device (200). The processor (210) can perform various operations proposed in the present disclosure by executing instructions stored in memory (220). The processor (210) may be a multi-core processor including one or more cores.
[0037] The processor (210) can perform operations to acquire an image of a tattoo sticker and identify a marker according to program code stored in memory (220). Specifically, the processor (210) can remove distortion caused by the user's joint movements or skin curvature from the image. The processor (210) can identify a marker by extracting feature points of the tattoo sticker from the image from which distortion has been removed. Additionally, the processor (210) can select augmented reality content based on the user's preference information and control the rendering of the selected augmented reality content on a web browser of the user terminal (120).
[0038] In one embodiment of the present disclosure, the processor (210) can execute an artificial intelligence model to output augmented reality content corresponding to preference information. The processor (210) can generate sound data corresponding to a tattoo image in the form of a voice waveform and control the sound data to be played on a web browser. For example, the processor (210) may be a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a Neural Processing Unit (NPU), a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), and a System on Chip (SoC). However, the present disclosure is not limited thereto.
[0039] The memory (220) can store data, programs, and instructions necessary for the operation of the processor (210). The memory (220) may include volatile memory or non-volatile memory. The memory (220) can store an operating system (OS), an application program, and program code for performing the methods of the present disclosure.
[0040] The memory (220) can temporarily or permanently store image data of a tattoo sticker received from a user terminal (120). The memory (220) can store outline pixel coordinate data of a reference marker required to perform a distortion correction algorithm. Additionally, the memory (220) can store user preference information, attribute information of the tattoo sticker, log data of the user terminal (120), and an artificial intelligence model for recommending augmented reality content.
[0041] In one embodiment of the present disclosure, the memory (220) may store a database containing metadata of various augmented reality content. The memory (220) may store original audio waveform data and generated sound data corresponding to a voice waveform tattoo. For example, the memory (220) may be Random Access Memory (RAM), Read-Only Memory (ROM), Flash Memory, Solid State Drive (SSD), Hard Disk Drive (HDD), Optical Disk, and Magnetic Tape. However, the present disclosure is not limited thereto.
[0042] The communication interface (230) can enable the electronic device (200) to communicate with another device or network. The communication interface (230) can transmit and receive data via a wired communication method or a wireless communication method. The communication interface (230) can operate under the control of the processor (210).
[0043] When the electronic device (200) is implemented as a management device (110), the communication interface (230) can receive a tattoo sticker image from a user terminal (120) via a network. Additionally, the communication interface (230) can transmit augmented reality content selected by the processor (210) to the user terminal (120). When the electronic device (200) is implemented as a user terminal (120), the communication interface (230) can transmit a captured tattoo sticker image to the management device (110) and receive augmented reality content from the management device (110).
[0044] In one embodiment of the present disclosure, the communication interface (230) may communicate with a blockchain network to authenticate ownership of a Non-Fungible Token (NFT). For example, the communication interface (230) may communicate using Ethernet, Wi-Fi, Bluetooth, Zigbee, Near Field Communication (NFC), 5th Generation (5G), and Long Term Evolution (LTE) technologies. However, the present disclosure is not limited thereto.
[0045] FIG. 3 illustrates a flowchart showing a method (S300) according to one embodiment of the present disclosure.
[0046] Referring to FIG. 3, the method (S300) can be performed by a management device (110).
[0047] In step S310, the management device (110) can acquire an image of a tattoo sticker. The management device (110) can receive an image captured through the camera of the user terminal (120) via a network. The image may include a tattoo sticker attached to a part of the user's body. The acquired image may be a still image. The acquired image may be one of a plurality of frame images constituting a real-time video stream.
[0048] In step S320, the management device (110) can identify a marker corresponding to a tattoo sticker based on an image. The management device (110) can apply computer vision technology to the received image to analyze the pattern, shape, or color information of the marker. The management device (110) can extract feature points from the image. The management device (110) can identify a unique marker corresponding to a tattoo sticker by comparing the extracted feature points with reference marker data stored in memory (220).
[0049] In step S330, the management device (110) can select augmented reality content based on user preference information corresponding to the marker. The management device (110) can analyze log data of a user account associated with the identified marker or attribute information of a tattoo sticker. The management device (110) can infer the user's preference based on the analyzed information. The management device (110) can select augmented reality content from the database that matches the inferred preference.
[0050] In step S340, the management device (110) can render augmented reality content on a web browser of a user terminal (120). The management device (110) can transmit data related to the selected augmented reality content to the user terminal (120). The user terminal (120) can render the augmented reality content in real time through a web browser and provide it to the user without a separate application installation process.
[0051] In one embodiment of the present disclosure, a method executed by an electronic device may include the steps of acquiring an image of a tattoo sticker attached to a user's body, identifying a marker corresponding to the tattoo sticker based on the image, selecting augmented reality content based on user preference information corresponding to the marker, and rendering the augmented reality content on a web browser of the user's terminal (120). The augmented reality content may be content in which at least some of the parameters of the content can be changed based on the user's input. For example, the parameters that can be changed may be color, size, shape, animation effect, sound, interaction script, or physical property. However, the present disclosure is not limited thereto. When the user touches the screen of the user terminal (120), the management device (110) may change at least some of the above-described parameters in response to the touch input.
[0052] FIG. 4 illustrates a flowchart showing the detailed operation (S400) of the identification operation (S320) described with reference to FIG. 3.
[0053] Referring to FIG. 4, the detailed operation (S400) of the identification operation (S320) can be performed by the management device (110). In one embodiment of the present disclosure, the step of identifying a marker may include the step of removing distortion caused by a user's joint movement or skin curvature from an image, and the step of identifying a marker by extracting feature points of a tattoo sticker from the image from which distortion has been removed.
[0054] In step S410, the management device (110) can remove distortions in the image caused by the user's joint movements or skin curvature. The management device (110) can correct geometric deformations of the image that occur because the user's body is not flat. The management device (110) can apply a digital image processing algorithm to smooth out curvatures or folds included in the acquired tattoo sticker image. Through this, the management device (110) can transform the tattoo sticker attached to a three-dimensional curved surface into a two-dimensional plane.
[0055] In one embodiment of the present disclosure, the step of identifying a marker may include removing distortion caused by the user's joint movements or skin curvature from the image. The management device (110) can improve the accuracy of marker recognition by using the distortion-corrected image in a subsequent processing step. The management device (110) can perform stable marker tracking by applying a distortion correction algorithm to each of the consecutive frames, even if the shape of the tattoo sticker changes in real time according to the movement of the body part.
[0056] In step S420, the management device (110) can identify a marker by extracting feature points of a tattoo sticker from a distortion-removed image. The management device (110) can detect feature points representing a unique pattern of the marker from a distortion-removed, flattened image. The management device (110) can analyze a set of detected feature points or geometric relationships between them. The management device (110) can determine which marker the tattoo sticker included in the image corresponds to by comparing the analysis results with a pre-stored marker database. For example, the feature points may be corners, edges, blobs, textures, color distributions, frequency domain characteristics, or Scale-Invariant Feature Transform (SIFT) points. However, the present disclosure is not limited thereto.
[0057] In one embodiment of the present disclosure, the step of identifying a marker may include the step of identifying a marker by extracting feature points of a tattoo sticker from a distortion-removed image. The management device (110) can restore the original shape of the marker through distortion correction. By extracting feature points based on the restored shape, the management device (110) can reduce the misrecognition rate of the marker. Consequently, the management device (110) can ensure that augmented reality content is stably rendered at the correct location.
[0058] In one embodiment of the present disclosure, step S420 may include the step of determining a unique identifier of a marker by comparing the geometric arrangement of extracted feature points with the arrangement of feature points of a reference marker stored in a database. The management device (110) may calculate the similarity between two sets of feature points using a feature point matching algorithm. If the similarity is greater than or equal to a preset threshold, the management device (110) may confirm the reference marker as the identified marker.
[0059] FIG. 5 illustrates a flowchart showing a detailed operation (S500) of the removal operation (S410) described with reference to FIG. 4.
[0060] Referring to FIG. 5, the detailed operation (S500) of the removal operation (S410) can be performed by the management device (110). The detailed operation (S500) of the removal operation (S410) may include a process of removing distortion caused by the user's joint movement or skin curvature.
[0061] In step S510, the management device (110) can extract the coordinates of pixels constituting the outline of a tattoo sticker included in an image. The management device (110) can identify a tattoo sticker area from the image using computer vision technology. The management device (110) can obtain location information of pixels along the boundary of the identified tattoo sticker area. The management device (110) can extract pixels constituting the outline using an edge detection algorithm. For example, the edge detection algorithm may be Canny Edge Detection, Sobel Filter, Laplacian Filter, Prewitt Filter, Roberts Cross operator, Fuzzy Logic based Edge Detection, or Marr-Hildreth algorithm. However, the present disclosure is not limited thereto.
[0062] In step S520, the management device (110) can calculate the distance difference and the angle difference between the coordinates of the extracted pixels and the outline pixel coordinates of the reference marker stored in advance. The memory (220) can store the outline pixel coordinate data of the reference marker, i.e., the tattoo sticker in an ideal state without distortion. The processor (210) can align the outline pixel coordinates of the tattoo sticker in the acquired image with the outline pixel coordinates of the reference marker stored in the memory (220). The processor (210) can calculate the Euclidean distance between each corresponding point. The processor (210) can analyze the pixel array around each corresponding point. The processor (210) can calculate the angle difference indicating the directionality of the outline segment.
[0063] In step S530, the management device (110) can generate a deformation vector including the direction of movement and distance of movement of the pixel based on the distance difference and the angle difference. The processor (210) can interpret the calculated distance difference as the magnitude of the deformation and the angle difference as the direction of the deformation. The processor (210) can synthesize information regarding the magnitude and direction of the deformation. The processor (210) can generate a deformation vector field representing the path of movement and the distance required for each distorted pixel to return to an ideal position. The deformation vector can be represented as a two-dimensional or three-dimensional vector.
[0064] In step S540, the management device (110) can correct the shape of the image by moving the pixels of the image by a distance in the reverse direction of the deformation vector. The processor (210) can apply the generated deformation vector field to the entire image. The processor (210) can perform an image warping transformation that repositions the pixels by the magnitude of the corresponding vector in the opposite direction of the deformation vector calculated for each pixel. The image of the tattoo sticker, which was deformed due to skin curvature or joint movement, can be restored to a shape similar to that attached to a flat surface.
[0065] FIG. 6 illustrates a flowchart showing a detailed operation (S600) of the rendering operation (S340) described with reference to FIG. 3.
[0066] Referring to FIG. 6, the detailed operation (S600) of the rendering operation (S340) described with reference to FIG. 3 can be performed by the management device (110).
[0067] In step S610, the management device (110) can correct the rendering coordinates of the augmented reality content based on the correction of distortion. The management device (110) can adjust the coordinates so that the augmented reality content is displayed naturally on the surface of the user's body by utilizing data generated during the process of removing image distortion. This correction process can ensure that the augmented reality content is not simply superimposed flatly on the image, but rather deforms together with the curvature of the skin or the movement of the joints. As a result, the rendering stability and realism of the augmented reality content can be improved.
[0068] FIG. 7 illustrates a flowchart showing a detailed operation (S700) of the correction operation (S610) described with reference to FIG. 6.
[0069] Referring to FIG. 7, the detailed operation (S700) of the correction operation (S610) described with reference to FIG. 6 can be performed by the management device (110).
[0070] In step S710, the management device (110) may obtain reference plane coordinates where the augmented reality content is to be displayed. The reference plane coordinates may be coordinate information when the augmented reality content is displayed on an ideal plane that is not distorted. The management device (110) may set a predefined 2D or 3D coordinate system as the reference plane coordinates depending on the type of identified marker. For example, the reference plane coordinates may be a pixel coordinate system of a digital image corresponding to the original design of the tattoo sticker. However, the present disclosure is not limited thereto.
[0071] In step S720, the management device (110) can calculate curved surface mapping coordinates that reflect the shape of skin curvature or joint movement by reflecting the direction and distance of movement of the deformation vector to each point of the reference plane coordinates. The management device (110) can convert the reference coordinates on a plane into a curved surface in three-dimensional space using the deformation vector described with reference to FIG. 5. The vertices of each reference plane coordinate can move according to the deformation vector to form a virtual curved surface similar to the shape of the actual user's body surface. Through this process, the augmented reality content can be rendered in a form that naturally fits the body curvature, rather than in a flat form.
[0072] In step S730, the management device (110) can determine rendering coordinates by matching the surface mapping coordinates to the screen output coordinate system of the web browser. The management device (110) can perform a projection transform on the calculated 3D surface mapping coordinates to 2D screen coordinates in accordance with the camera view of the user terminal (120). The management device (110) can finally determine the transformed 2D coordinates as rendering coordinates and instruct the user terminal (120) to output augmented reality content on the web browser according to the coordinates. Through this, the augmented reality content can appear to be stably fixed on the tattoo sticker despite the user's movements or body curvature.
[0073] FIG. 8 illustrates a flowchart showing a detailed operation (S800) of the selection operation (S330) described with reference to FIG. 3.
[0074] Referring to FIG. 8, the detailed operation (S800) of the selection operation (S330) described with reference to FIG. 3 can be performed by the management device (110).
[0075] In step S810, the management device (110) can extract preference information based on the attributes of the tattoo sticker and the logs of the user terminal (120). The attributes of the tattoo sticker may include unique visual or semantic characteristics of the tattoo sticker. For example, the attributes of the tattoo sticker may be a design theme, a main color palette, the size of the design, a style type, a cultural background, a symbolic meaning, and associated character information. However, the present disclosure is not limited thereto. The logs of the user terminal (120) may include the user's past behavioral patterns and interaction records. For example, the logs of the user terminal (120) may include the type of augmented reality content interacted with in the past, the time spent on specific content, the frequency of function usage, social media sharing history, location information, app usage records, and search records. However, the present disclosure is not limited thereto. The management device (110) can combine the extracted attributes of the tattoo sticker and the logs of the user terminal (120). The management device (110) can generate a personalized preference profile of the user through combined information.
[0076] In step S820, the management device (110) can input preference information into an artificial intelligence model. The management device (110) can output augmented reality content corresponding to the preference information. The artificial intelligence model can analyze the input preference information. Based on the analysis results, the artificial intelligence model can recommend or generate highly relevant content among various augmented reality contents stored in a database. For example, the artificial intelligence model may be a collaborative filtering model, a content-based filtering model, a deep learning-based recommendation system, a reinforcement learning model, a Generative Adversarial Network (GAN), a Large Language Model (LLM), or a Recurrent Neural Network (RNN). However, the present disclosure is not limited thereto.
[0077] FIG. 9 illustrates a flowchart showing a detailed operation (S900) of the output operation (S820) described with reference to FIG. 8.
[0078] Referring to FIG. 9, the detailed operation (S900) of the output operation (S820) can be performed by the management device (110).
[0079] In step S910, the management device (110) can separate the logs included in the preference information into visual feature values and interaction frequency values through an artificial intelligence model. For example, the visual feature values may be data quantifying the color distribution, complexity of the shape, main pattern, style, texture, line thickness, or contrast of the tattoo sticker. However, the present disclosure is not limited thereto. The interaction frequency values may be data quantifying the pattern of a user interacting with specific augmented reality content. For example, the pattern of interaction may be the number of times a specific function is activated, the time spent on the content, the frequency of touching a specific object, the number of times the screen is zoomed in or out, the act of sharing the content, the number of times a specific animation is repeated, or the frequency of changing the shooting angle of the augmented reality camera. However, the present disclosure is not limited thereto. The management device (110) may extract visual features from an image using a Convolutional Neural Network (CNN) model. The management device (110) can analyze user log data over time using a Recurrent Neural Network (RNN) model. The management device (110) can identify interaction patterns through the analyzed user log data.
[0080] In step S920, the management device (110) can calculate a match rate score by comparing the metadata of each of the multiple candidate augmented reality contents stored in the database with the visual feature values and interaction frequency values. For example, the metadata of the candidate augmented reality contents may be information describing the content's theme, color palette, animation style, interaction method, sound design, content genre, or character design. However, the present disclosure is not limited thereto. The management device (110) can measure the similarity between the user's preference vector and the metadata vector of each candidate content using an algorithm such as cosine similarity. Based on the measured similarity, the management device (110) can derive a quantitative match rate score indicating how well each candidate content matches the user's taste.
[0081] In step S930, the management device (110) can extract the candidate augmented reality content with the highest match rate score. Subsequently, the management device (110) can determine the extracted content as the augmented reality content corresponding to the tattoo sticker. The management device (110) can output the determined augmented reality content. The management device (110) can rank the candidate augmented reality contents based on the calculated match rate score. The management device (110) can finally select the content with the highest rank. The management device (110) can transmit the selected augmented reality content to the web browser of the user terminal (120). The user terminal (120) can provide the transmitted augmented reality content to the user.
[0082] FIG. 10 illustrates a flowchart showing a method (S1000) according to one embodiment of the present disclosure.
[0083] Referring to FIG. 10, the method (S1000) can be performed by a management device (110).
[0084] In step S1010, the management device (110) can calculate the pixel area occupied by the tattoo sticker in each of the multiple frame images acquired continuously. The management device (110) can analyze a video stream transmitted in real time from the camera of the user terminal (120). The management device (110) can identify the boundary of the tattoo sticker within each frame image. The management device (110) can determine the pixel area by calculating the total number of pixels included within the boundary. The change in pixel area can be used as an indicator to estimate the relative distance between the user terminal (120) and the tattoo sticker.
[0085] In step S1020, the management device (110) may reduce the transparency parameter of the augmented reality content if the calculated pixel area increases beyond a preset reference area value. Additionally, the management device (110) may increase the texture resolution parameter applied to the augmented reality content. An increase in the pixel area may mean that the user has approached the tattoo sticker more closely. The management device (110) may adjust the transparency to make the augmented reality content appear clearer and more realistic. At the same time, the management device (110) may increase the texture resolution to allow the user to experience high-quality graphics even at close range.
[0086] In step S1030, the management device (110) may increase the transparency parameter of the augmented reality content if the calculated pixel area decreases to less than a preset reference area value. Additionally, the management device (110) may decrease the texture resolution parameter. A decrease in pixel area may indicate that the user is moving away from the tattoo sticker. The management device (110) may increase transparency so that the augmented reality content blends naturally with the surrounding environment. Additionally, the management device (110) may lower the texture resolution. This reduces the rendering load of the user terminal (120) and allows for efficient management of system resources.
[0087] FIG. 11 illustrates a flowchart showing a method (S1100) according to one embodiment of the present disclosure.
[0088] Referring to FIG. 11, the method (S1100) can be performed by a management device (110).
[0089] In step S1110, the management device (110) can acquire a tattoo image in the form of a voice waveform applied to the user's skin. The user terminal (120) can photograph the tattoo located on the user's skin using a camera. The management device (110) can receive the tattoo image from the user terminal (120) via a network. The tattoo image may include a design that visually embodies the waveform of a specific voice or sound. The management device (110) can acquire continuous frame images from a real-time video stream. Alternatively, the management device (110) can acquire a single still image taken by the user.
[0090] In step S1120, the management device (110) can generate sound data corresponding to the tattoo image. The management device (110) can extract visual information of the voice waveform by applying an image processing algorithm to the acquired tattoo image. The management device (110) can convert the extracted waveform into a digital audio signal by analyzing features such as shape, amplitude, and frequency. The management device (110) can generate playable sound data by encoding the converted digital audio signal using a specific audio codec.
[0091] In step S1130, the management device (110) can play sound data on the web browser of the user's user terminal (120). The management device (110) can transmit the generated sound data to the user terminal (120) using a streaming protocol. The user terminal (120) can receive and immediately play the sound data through the web browser without the process of installing a separate dedicated application. The playback of sound data can be implemented through web standard technologies such as a Web Audio API (Application Programming Interface).
[0092] FIG. 12 illustrates a flowchart showing a detailed operation (S1200) of the generation operation (S1120) described with reference to FIG. 11.
[0093] Referring to FIG. 12, the management device (110) can perform a detailed operation (S1200) of the creation operation (S1120).
[0094] In step S1210, the management device (110) can remove distortion caused by the user's joint movements or skin curvature from the tattoo image. Human skin may not be flat and may have a curved surface. The skin may stretch or contract depending on the user's movements. The user's joint movements or skin curvature may deform the shape of the voice waveform included in the tattoo image. The management device (110) can correct the deformation of the voice waveform shape. The management device (110) can perform a process of restoring the voice waveform to a shape close to the original shape through correction.
[0095] In one embodiment of the present disclosure, the step of removing distortion may include the step of extracting the coordinates of pixels constituting the outline of the tattoo included in the tattoo image. The management device (110) may identify the boundary line of the area occupied by the tattoo in the tattoo image using an image processing algorithm. The management device (110) may calculate the distance difference and the angle difference between the coordinates of the extracted pixels and the outline pixel coordinates of a pre-stored reference marker. Based on the calculated distance difference and the angle difference, the management device (110) may generate a deformation vector including the direction of movement and the distance of movement of the pixels. The management device (110) may correct the shape of the tattoo image by moving the pixels of the tattoo image by the distance in the reverse direction of the deformation vector.
[0096] In step S1220, the management device (110) can perform a geometric restoration algorithm to restore the voice waveform shape from the distortion-removed tattoo image into a form comparable to the original audio waveform data. The management device (110) can extract features including the amplitude, period, and phase of the voice waveform from the corrected image. The management device (110) can convert the extracted visual features into audio signal parameters in the time domain. For example, the management device (110) can map the horizontal axis of the image to the time axis. The management device (110) can generate one-dimensional waveform data by mapping the brightness or position of a pixel to the amplitude.
[0097] In step S1230, the management device (110) can generate sound data corresponding to the result of applying the restoration algorithm. The management device (110) can synthesize a playable digital audio signal based on geometrically restored waveform data. The generated sound data may have a standard audio format that can be played in a web browser of the user terminal (120). For example, the sound data may be Waveform Audio File Format (WAV), MPEG-1 Audio Layer 3 (MP3), Advanced Audio Coding (AAC), Ogg Vorbis, Free Lossless Audio Codec (FLAC), Audio Interchange File Format (AIFF), or Windows Media Audio (WMA). However, the present disclosure is not limited thereto. The management device (110) can transmit the generated sound data to the user terminal (120) via a network (130).
[0098] FIG. 13 illustrates a flowchart showing a detailed operation (S1300) of the removal operation (S1210) described with reference to FIG. 12.
[0099] Referring to FIG. 13, the detailed operation (S1300) of the removal operation (S1210) can be performed by the management device (110).
[0100] In step S1310, the management device (110) can extract the coordinates of pixels constituting the outline of the tattoo image. The management device (110) can identify the boundary line between the tattoo and the skin by applying an edge detection algorithm to the input tattoo image. The management device (110) can acquire in-screen coordinate information of all pixels located on the identified boundary line and store it in the form of a list or array. For example, the edge detection algorithms that the management device (110) can utilize may be a Canny edge detector, a Sobel filter, a Laplacian filter, a Prewitt operator, a Roberts intersection operator, a Holistically-Nested Edge Detection algorithm, or a Difference Operator-based algorithm. However, the present disclosure is not limited thereto.
[0101] In step S1320, the management device (110) can calculate the distance difference and the angle difference between the coordinates of the pixels and the outline pixel coordinates of the reference marker that were previously stored. The management device (110) can load the undistorted original tattoo design, i.e., the outline pixel coordinate data of the reference marker, stored in memory (220). The management device (110) can establish a correspondence relationship between the pixel coordinates extracted in step S1310 and the pixel coordinates of the reference marker. The management device (110) can calculate the distance difference by calculating the Euclidean distance between each pair of corresponding points. Additionally, the management device (110) can calculate the slope or angle of the line segment created by connecting each coordinate point and adjacent coordinate points. Through this, the management device (110) can calculate the angle difference indicating the degree of distortion of the shape.
[0102] In step S1330, the management device (110) can generate a deformation vector including the direction and distance of movement of pixels based on distance difference and angle difference. The management device (110) can determine a vector value indicating the direction and distance each pixel must move to be restored to its original form using the calculated distance difference and angle difference information. The management device (110) can calculate the deformation vector using interpolation not only for the outline pixels of the tattoo image but also for the interior pixels. Through this, the management device (110) can generate a deformation vector field for the entire image.
[0103] In step S1340, the management device (110) can correct the shape of the tattoo image by moving the pixels of the tattoo image by a distance in the reverse direction of the deformation vector. The management device (110) can produce an inverse transformation vector that has the same magnitude and opposite direction for the deformation vector generated in step S1330. The management device (110) can correct distortion by using image warping technology to reposition all pixels of the tattoo image according to the corresponding inverse transformation vector. Through this process, the tattoo image, which has been deformed due to the curvature of the skin or the movement of joints, can be restored to a shape similar to that attached to a flat surface.
[0104] FIG. 14 illustrates a flowchart showing a detailed operation (S1400) of the playback operation (S1130) described with reference to FIG. 11.
[0105] Referring to FIG. 14, the detailed operation (S1400) of the playback operation (S1130) can be performed by the management device (110).
[0106] In step S1410, the management device (110) can control the sound data to be played continuously and synchronized from a point corresponding to a deformed location based on a time code mapping algorithm, even if a discontinuity in the form of a voice waveform occurs due to the curvature or movement of the skin in a tattoo image acquired in real time. The management device (110) can map each point of the tattoo image to a specific time code of the sound data. Even if part of the tattoo image is temporarily obscured or distorted due to the user's movement, the management device (110) can continue playing the sound from the time code mapped to that location when it is recognized again. This synchronization control can provide the user with a seamless audio experience.
[0107] In one embodiment of the present disclosure, the management device (110) can check the brightness values of pixels within a tattoo image acquired in real time. By checking the brightness values, the management device (110) can identify a discontinuous section, which is an area where pixels in the shape of a voice waveform do not exist. The management device (110) can extract a first pixel coordinate located at the start point of the discontinuous section and a second pixel coordinate located at the end point. The management device (110) can calculate a first slope value of a line connecting a predetermined number of pixels prior to the first pixel coordinate. Additionally, the management device (110) can calculate a second slope value of a line connecting a predetermined number of pixels prior to the second pixel coordinate. The management device (110) can calculate a curved trajectory by summing and averaging the first slope value and the second slope value. The management device (110) can create a virtual waveform area by connecting the first pixel coordinate and the second pixel coordinate within the discontinuous section with the calculated curved trajectory. The management device (110) can generate an audio signal corresponding to the pixel coordinates of the generated virtual waveform area. The management device (110) can insert the generated audio signal at a playback point corresponding to a discontinuity section and play it.
[0108] FIG. 15 illustrates a flowchart showing a detailed operation (S1500) of the playback operation (S1130) described with reference to FIG. 11.
[0109] Referring to FIG. 15, the detailed operation (S1500) of the playback operation (S1130) can be performed by the management device (110).
[0110] In step S1510, the management device (110) can access a database containing sound data based on anchor points inserted in a tattoo image. An anchor point may be an identification mark intentionally inserted within the tattoo design. The management device (110) can analyze the location, number, or arrangement pattern of anchor points in the acquired image. Through the analyzed anchor point information, the management device (110) can identify unique sound data associated with the corresponding tattoo image.
[0111] In one embodiment of the present disclosure, the step of accessing a database containing sound data may include the step of separating the regions of anchor points by comparing the brightness values of a plurality of anchor points included in a tattoo image with the brightness values of adjacent pixels. For example, the management device (110) may separate the anchor point regions using image thresholding, edge detection, blob analysis, a region growing algorithm, a contour tracing algorithm, a watershed transform, or connected-component labeling. However, the present disclosure is not limited thereto. The management device (110) can clearly distinguish between the voice waveform portion and the anchor point portion through the separated regions.
[0112] In one embodiment of the present disclosure, the step of accessing a database containing sound data may include the step of measuring the relative distance ratio between the region center points of separated anchor points in pixels. The management device (110) may calculate the geometric center or centroid of each anchor point region and set it as a center point. The management device (110) may calculate the Euclidean distance between the set center points and calculate the relative ratio to a reference distance. The method using the distance ratio can maintain a consistent value even if the size of the image changes as the distance between the camera and the subject changes.
[0113] In one embodiment of the present disclosure, the step of accessing a database containing sound data may include the step of generating an index code for database access by converting a combination of measured distance ratios. A management device (110) may organize a plurality of measured distance ratio values into a single vector or matrix. A management device (110) may generate a unique index code by applying a hash function to the organized vector or matrix. The generated index code may be used as a key value pointing to specific sound data within the database.
[0114] In one embodiment of the present disclosure, the step of accessing a database containing sound data may include the step of obtaining an access address value of a specific sound data corresponding to a tattoo image among a list of sound data stored in the database using an index code. The management device (110) may query the database with the generated index code to search for an item that matches the code. As a result of the search, the database may return a file path where the sound data is stored, a Uniform Resource Locator (URL) address, or a streaming server address. The management device (110) may transmit the obtained access address value to a user terminal (120) to control the playback of the sound data.
[0115] FIG. 16 illustrates a flowchart showing a detailed operation (S1600) of the playback operation (S1130) described with reference to FIG. 11.
[0116] Referring to FIG. 16, the detailed operation (S1600) of the playback operation (S1130) can be performed by the management device (110).
[0117] In step S1610, the management device (110) can access a database containing sound data based on the authentication of ownership of a non-fungible token. The management device (110) can query the authentication information received from the user terminal (120) on a blockchain network. The management device (110) can verify the user's ownership of the non-fungible token through the query results. The management device (110) can allow access to the sound data corresponding to the tattoo image only when ownership is authenticated. This method can function as a means of proving digital ownership of sound content and guaranteeing the scarcity and value of the content.
[0118] In one embodiment of the present disclosure, the step of playing (S1130) may include the step of accessing a database containing sound data based on authentication of ownership of a non-fungible token. Sound data associated with a tattoo image may be issued as a unique non-fungible token. A user may acquire the right to play the sound data by owning the said non-fungible token. A management device (110) may verify in real time whether a specific non-fungible token is owned by linking with the user's digital wallet. Once verification is complete, the management device (110) may stream the sound data mapped to the said token within the database to a user terminal (120). For example, the blockchain network serving as the basis for the issuance and trading of non-fungible tokens may be Ethereum, Polygon, Solana, Binance Smart Chain, Klaytn, Aptos, or Sui. However, the present disclosure is not limited thereto.
[0119] In one embodiment of the present disclosure, the accessing step (S1610) may include receiving a digital wallet address from a user terminal (120), querying whether a specific non-fungible token is owned through a smart contract on a blockchain network using the received digital wallet address, and authorizing database access if the ownership information returned as a result of the query matches information associated with a tattoo image. The management device (110) may call the lookup function of the smart contract to verify whether the wallet address possesses a specific token ID. If ownership is confirmed, the management device (110) may generate a temporary access token for accessing the database and transmit it to the user terminal (120). The user terminal (120) may securely stream sound data using the received temporary access token.
[0120] FIG. 17 illustrates an example of implementation (1700) that may be referenced in various embodiments of the present disclosure.
[0121] Referring to FIG. 17, an example of implementation (1700) that may be referenced in various embodiments of the present disclosure may be illustrated. The example of implementation (1700) may include a user (1710) and a user terminal (1720). The example of implementation (1700) may represent a situation in which a tattoo (1711) attached to the body of the user (1710) is recognized by the camera of the user terminal (1720). The user terminal (1720) may render augmented reality content (1721) corresponding to the tattoo (1711) on a web browser.
[0122] The user (1710) may be a subject who has attached a tattoo (1711) to a part of their body. The tattoo (1711) may function as a visual marker to activate an augmented reality experience. The tattoo (1711) may include a uniquely identifiable pattern, image, or QR code. The management device (110) may analyze an image of the tattoo (1711) received from the user terminal (1720) to identify the marker and provide augmented reality content (1721) pre-mapped to the marker.
[0123] Regarding the user terminal (1720), details that overlap with those described for the user terminal (120) of FIG. 1 may be omitted. The user terminal (1720) can acquire an image of the tattoo (1711) using a built-in camera. The user terminal (1720) can receive augmented reality services through a web browser without a separate application installation process. The user terminal (1720) can display augmented reality content (1721) and an interaction area (1722) together on a display screen.
[0124] In one embodiment of the present disclosure, a user terminal (1720) may utilize web-based rendering technology. The user terminal (1720) may communicate with a management device (110) via a web browser to transmit a tattoo (1711) image and receive corresponding augmented reality content (1721) data. Based on the received data, the user terminal (1720) may render the augmented reality content (1721) in real time using a technology such as WebGL or WebAR.
[0125] Augmented reality content (1721) may be a digital object that is superimposed on real space when the tattoo (1711) is recognized. For example, augmented reality content (1721) may be a three-dimensional (3D) model, a two-dimensional (2D) image, an animation, a video clip, text information, audio data, or a combination thereof. However, the present disclosure is not limited thereto. FIG. 17 may show an example in which a three-dimensional model having the shape of a dragon is implemented as augmented reality content (1721).
[0126] The management device (110) can provide personalized augmented reality content (1721) based on user preference information. The management device (110) can extract preference information by collecting unique attributes of the tattoo (1711), log data of the user terminal (120), and the user's past interaction history. By inputting the extracted preference information into an artificial intelligence model, the management device (110) can dynamically select and transmit augmented reality content (1721) that the user (1710) is most interested in.
[0127] In one embodiment of the present disclosure, the augmented reality content (1721) may have interactive characteristics that change in real time according to user input. The user (1710) may change parameters such as the color, size, position, shape, or animation movements of the augmented reality content (1721) through an interaction area (1722). Such interaction may enhance the user experience by providing the user with greater immersion and enjoyment.
[0128] The interaction area (1722) may be a graphical user interface (GUI) displayed on a touchscreen of a user terminal (1720). The interaction area (1722) may include various control elements to enable the user to interact with augmented reality content (1721). For example, the interaction area (1722) may include buttons, sliders, joysticks, color pickers, text input fields, menu lists, or toggle switches. However, the present disclosure is not limited thereto. When the user (1710) operates a specific control element within the interaction area (1722), the user terminal (1720) may process a command corresponding to the input to update the state of the augmented reality content (1721).
[0129] Although the operations included in the method of the present disclosure have been described in a sequential order according to the flowchart in which the method is illustrated, the operations included in the method of the present disclosure may be executed in any other combination. Furthermore, detailed changes or modifications may be made to the operations included in the method of the present disclosure, and the fact that such operations are included in the flowchart does not imply that they are essential for executing the method of the present disclosure. In one embodiment, at least some of the operations included in the method of the present disclosure may be performed in parallel, iteratively, or heuristically. Additionally, in another embodiment, at least some of the operations included in the method of the present disclosure may be omitted.
[0130] Various embodiments of the present disclosure may be implemented as software on a machine-readable storage medium (MRSM). Additionally, software may be inferred from the various embodiments of the present disclosure by a person skilled in the art to which the present disclosure pertains. For example, the software may be a computer program containing instructions that can be read by a computing device. In one embodiment, the processor of the computing device may execute a called instruction to cause the components of the computing device to perform a function corresponding to that instruction. The storage medium may refer to any type of recording medium in which information that can be read by a device is stored. The storage medium may include, for example, ROM, RAM, CD-ROM, magnetic tape, floppy disk, or optical information storage device. In one embodiment, the storage medium may be implemented in a distributed form in a networked computer system, etc. Here, the software may be stored in a distributed manner in a computer system, etc. Additionally, in another embodiment, the storage medium may be a non-transitory storage medium. Non-transient storage media refer to media that exist regardless of whether information is stored semi-permanently or temporarily, and do not include signals that are transmitted transiently.
[0131] A method according to one embodiment of the present disclosure may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., Compact Disc Read Only Memory (CD-ROM)) or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0132] Although the technical concept according to the present disclosure has been described by various embodiments above, the technical concept according to the present disclosure includes various substitutions, modifications, and changes that can be made within the scope of understanding by a person skilled in the art to which the present disclosure pertains. Furthermore, such substitutions, modifications, and changes should be interpreted as being included within the scope of the claims.
Claims
Claim 1 A method executed by an electronic device comprises: acquiring an image of a tattoo sticker attached to a user's body; identifying a marker corresponding to the tattoo sticker based on the image; selecting augmented reality content based on the user's preference information corresponding to the marker; and rendering the augmented reality content on a web browser of the user's terminal, wherein the augmented reality content is content in which at least some of the parameters of the content may be changed based on the user's input, and the step of selecting the augmented reality content comprises: extracting the preference information based on the attributes of the tattoo sticker and the log of the user terminal; and inputting the preference information into an artificial intelligence model to output the augmented reality content corresponding to the preference information, and the step of inputting the preference information into an artificial intelligence model to output the augmented reality content corresponding to the preference information comprises: separating the log included in the preference information into visual feature values and interaction frequency values through the artificial intelligence model; and calculating a match rate score by comparing the metadata of each of a plurality of candidate augmented reality contents stored in a database with the visual feature values and the interaction frequency values. The method comprises the step of extracting the candidate augmented reality content with the highest match rate score among the plurality of candidate augmented reality contents, determining it as the augmented reality content corresponding to the tattoo sticker, and outputting it, wherein the visual feature value is data quantifying the color distribution, shape complexity, main pattern, style, texture, line thickness, or contrast of the tattoo sticker, and the interaction frequency value is data quantifying the pattern of the user interacting with the augmented reality content. Claim 2 A method according to claim 1, wherein the step of identifying the marker comprises: a step of removing distortion caused by the joint movement or skin curvature of the user in the image; and a step of identifying the marker by extracting feature points of the tattoo sticker in the image from which the distortion has been removed. Claim 3 In claim 2, the step of removing distortion comprises: extracting the coordinates of pixels constituting the outline of the tattoo sticker included in the image; calculating the distance difference and angle difference between the coordinates of the extracted pixels and the outline pixel coordinates of a pre-stored reference marker; generating a deformation vector including the direction of movement and distance of movement of the pixels based on the calculated distance difference and angle difference; and correcting the shape of the image by moving the pixels of the image in the reverse direction of the deformation vector by the distance of movement; and the step of rendering comprises correcting the rendering coordinates of the augmented reality content based on the correction of distortion, and the step of correcting the rendering coordinates comprises: obtaining reference plane coordinates where the augmented reality content is to be displayed; calculating curved surface mapping coordinates reflecting the shape of the skin curvature or joint movement by reflecting the direction of movement and distance of movement of the deformation vector at each point of the obtained reference plane coordinates; and matching the calculated curved surface mapping coordinates to the screen output coordinate system of the web browser to determine the rendering coordinates. Claim 4 delete Claim 5 delete
Citation Information
Patent Citations
Apparatus and method for advertising based on temporary tattoo
KR1020180103540A
Apparatus for providing mixed reality content using three-dimension object and marker and method thereof
KR1020190088657A
Artificial intelligence-based digital content creation device and method for generating digital content from text information
KR102555968B1
Customized photo booth system using lightweight ai-based facial landmark detection
KR102939416B1
