Method, apparatus and program for providing shopping support service

Abstract

A method for providing a shopping support service according to various embodiments of the present invention is disclosed. The method comprises: acquiring a post shared through a social network; generating product information included in the post; generating a shopping support button corresponding to the product information; and displaying the shopping support button on the post. The shopping support button may include at least one of a share button for sharing a product in a chat room of a user account and a cart button for adding a product to a shopping cart of the user account.

Description

Technology Field

[0001] The present invention relates to a method, device, and program for providing a shopping support service, and specifically to a method, device, and program for providing a shopping support service that supports shopping for products included in social network posts or web pages. Background Technology

[0003] With the advancement of online shopping, users have come to prefer exploring and purchasing products through various channels. In particular, the process of discovering products not only on e-commerce platforms but also on social network services (SNS), blogs, communities, and news sites, and connecting this discovery to a direct purchase, is becoming increasingly important. This shift is increasing the need to design the consumer purchasing journey in the digital environment in a more intuitive and efficient manner.

[0004] Traditionally, online shopping systems have operated primarily around a method where users directly visit specific shopping mall websites or applications to search for products, add them to a shopping cart, and make a payment. However, recently, consumers are increasingly encountering and becoming interested in products through social media feeds, search results, advertisements, and online articles, and methods that naturally induce shopping within this content are gaining attention. In particular, as the social commerce market grows rapidly, the convergence of social media and e-commerce is accelerating.

[0005] In response to these environmental changes, various forms of shopping support technologies have been developed. For instance, some e-commerce platforms allow users to share links to specific products with friends and family, while some social media platforms offer features that enable users to tag and sell products directly within their posts. Additionally, visual search technology is utilized to locate products based on images viewed online, and services that recommend products tailored to user interests through AI recommendation systems are also widely used.

[0006] However, existing shopping support technologies can make the process of connecting a user's discovery of a product of interest to a purchase cumbersome. For example, even if a user sees a specific product in a social media post or on a webpage, they may still need to go through the inconvenient process of searching for and purchasing it within an online store. Furthermore, existing sharing functions often transmit product information in the form of simple links, and the process of adding items to a cart or proceeding to payment is frequently not seamlessly integrated. Additionally, if a product included in a social media post or webpage is not clearly tagged, it becomes difficult to find, potentially leading to a disjointed user experience.

[0007] Accordingly, there is a growing need for technology that connects online content and shopping functions in a more intuitive and user-friendly manner. In this regard, Korean Published Patent No. 10-2018-0117434 discloses a method and system for promoting shopping and secure transactions using SNS, as well as a computer-readable recording medium. The problem to be solved

[0009] The present invention is conceived in response to the aforementioned background technology and aims to provide a method, apparatus, and program for providing shopping support services.

[0010] The technical problems of the present invention are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0012] According to an embodiment of the present invention for solving the problem described above, a method for providing a shopping support service is disclosed. The method may include: a step of obtaining a post shared through a social network; a step of generating product information included in the post; a step of generating a shopping support button corresponding to the product information; and a step of displaying the shopping support button on the post.

[0013] In an alternative embodiment, the step of generating product information included in the post may include: extracting text included in the post; obtaining at least one product name from the text; recognizing a specific product associated with the at least one product name; and generating the product information including at least one of a place selling the specific product, the price of the specific product, and the stock of the specific product.

[0014] In an alternative embodiment, the step of generating product information included in the post may further include: extracting an image included in the post when the at least one product name is not obtained from the text; obtaining at least one product name from the image; recognizing a specific product associated with the at least one product name; and generating product information including at least one of a sales outlet selling the specific product, the price of the specific product, and the stock of the specific product.

[0015] In an alternative embodiment, the step of generating product information included in the post comprises: determining a recommended product based on the text and the image when the at least one product name is not obtained from the text and the image; and generating product information corresponding to the recommended product; and the step of determining a recommended product based on the text and the image may include: selecting at least one candidate product based on the purchase history of the user account and preference information of the user account; obtaining candidate product information including at least one of price, sales volume, stock, discount rate, user rating, and promotion corresponding to each of the at least one candidate product; and determining at least one of the at least one candidate product as a specific product based on the candidate product information.

[0016] In an alternative embodiment, the step of generating a shopping support button corresponding to the product information comprises: a step of determining a priority for the two or more products when two or more products are recognized in the step of generating product information included in the post; and a step of determining the display position of the shopping support button corresponding to the product information of each of the two or more products based on the priority; and the step of determining a priority for the two or more products may include: a step of obtaining multiple product information including at least one of price, sales volume, stock, discount rate, user rating, and promotion corresponding to each of the two or more products; a step of calculating a priority score corresponding to each of the two or more products based on the multiple product information; and a step of determining a priority for the two or more products corresponding to the priority score.

[0017] In an alternative embodiment, the shopping support button includes at least one of a share button for sharing a product in a chat room of a user account and a cart button for adding a product to a shopping cart of the user account, and the method may include: a step of obtaining a selection input for a specific chat room to share the product information when input for the share button is obtained; a step of displaying the product information and a cart button corresponding to the product information in the specific chat room based on the selection input; and a step of displaying a cart view button for checking the shopping cart when input for the cart button is obtained in the specific chat room.

[0018] In an alternative embodiment, the method further comprises the step of displaying a shopping cart screen of the user account when input for the cart view button is obtained; and the shopping cart screen may include at least one product added to the shopping cart through the cart addition and user information that added the at least one product to the shopping cart.

[0019] In an alternative embodiment, the method may further include: displaying a shopping support layer on a current screen displayed on a user terminal; capturing the current screen when input for the shopping support layer is obtained; extracting current screen product information included on the captured current screen; and generating the shopping support button corresponding to the current screen product information.

[0020] According to one embodiment of the present invention for solving the above-described problem, an apparatus is disclosed. The apparatus comprises: a memory for storing one or more instructions; and a processor for executing the one or more instructions stored in the memory, and the processor can perform the above-described methods by executing the one or more instructions.

[0021] According to one embodiment of the present invention for solving the above-described problem, a computer program stored on a computer-readable recording medium is disclosed, which is combined with a computer as hardware to perform the above-described methods.

[0022] Other specific details of the present invention are included in the detailed description and drawings. Effects of the invention

[0024] The present invention can recognize product information included within content while a user is browsing social network service (SNS) posts or web pages, and support shopping more intuitively and efficiently based on this.

[0025] In addition, according to the present invention, user convenience can be improved by analyzing the content of a post or webpage to generate an appropriate shopping support button (e.g., an add to cart button or an add all to cart button) without the cumbersome process of the user directly searching for a specific product or manually adding it to a shopping cart.

[0026] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description below. Brief explanation of the drawing

[0028] FIG. 1 is a drawing illustrating a system according to one embodiment of the present invention. FIG. 2 is a hardware configuration diagram of a computing device according to one embodiment of the present invention. FIGS. 3 to 14 are drawings for explaining a shopping support method according to an embodiment of the present invention. Specific details for implementing the invention

[0029] Various embodiments are now described with reference to the drawings. In this specification, various descriptions are provided to facilitate an understanding of the invention. However, it is evident that these embodiments can be practiced without such specific descriptions.

[0030] As used herein, terms such as “component,” “module,” “system,” etc. refer to computer-related entities, hardware, firmware, software, combinations of software and hardware, or executions of software. For example, a component may be, but is not limited to, a procedure executed on a processor, a processor, an object, an execution thread, a program, and / or a computer. For example, both an application executed on a computing device and the computing device itself may be a component. One or more components may reside within a processor and / or an execution thread. A component may be localized within a single computer. A component may be distributed among two or more computers. Additionally, these components may be executed from various computer-readable media having various data structures stored therein. Components may communicate through local and / or remote processes, for example, according to signals having one or more data packets (e.g., data from a component interacting with another component in a local system or distributed system, and / or data transmitted through signals to other systems and networks such as the Internet).

[0031] Furthermore, the term "or" is intended to mean an implicit "or" rather than an exclusive "or." That is, unless otherwise specified or evident from the context, "X uses A or B" is intended to mean one of the natural implicit substitutions. In other words, if X uses A; if X uses B; or if X uses both A and B, "X uses A or B" may apply to any of these cases. Additionally, the term "and / or" as used herein should be understood to refer to and include all possible combinations of one or more of the enumerated related items.

[0032] Additionally, the terms “comprising” and / or “comprising” should be understood to mean that such features and / or components are present. However, the terms “comprising” and / or “comprising” should be understood not to exclude the presence or addition of one or more other features, components and / or groups thereof. Furthermore, unless otherwise specified or clearly evident from the context to indicate a singular form, the singular in this specification and claims should generally be interpreted to mean “one or more.”

[0033] Those skilled in the art should recognize that the various exemplary logical blocks, configurations, modules, circuits, means, logics, and algorithmic steps described in connection with the embodiments disclosed herein may be implemented in electronic hardware, computer software, or a combination of both. To clearly exemplify the interchangeability of hardware and software, various exemplary components, blocks, configurations, means, logics, modules, circuits, and steps have been generally described above in terms of their functionality. Whether such functionality is implemented in hardware or software depends on the specific application and design constraints imposed on the overall system. Skilled technicians may implement the described functionality in various ways for each specific application. However, such decisions regarding implementation should not be interpreted as moving out of the scope of the invention.

[0034] The description of the presented embodiments is provided to enable those skilled in the art to use or practice the present invention. Various modifications to these embodiments will be apparent to those skilled in the art. The general principles defined herein may be applied to other embodiments without departing from the scope of the present invention. Thus, the present invention is not limited to the embodiments presented herein. The present invention should be interpreted in the broadest possible scope consistent with the principles and novel features presented herein.

[0035] In this specification, the term "computer" refers to any type of hardware device comprising at least one processor, and may be understood to include software configurations operating on said hardware device according to the embodiments. For example, the term "computer" may be understood to include smartphones, tablet PCs, desktops, laptops, and user clients and applications running on each of these devices, but is not limited thereto.

[0036] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0037] Each step described in this specification is described as being performed by a computer, but the subject of each step is not limited thereto, and depending on the embodiment, at least some of each step may be performed on different devices.

[0039] FIG. 1 is a drawing illustrating a system according to one embodiment of the present invention.

[0040] Referring to FIG. 1, a system according to one embodiment of the present invention may include a computing device (100), a user terminal (200), and an external server (300). The system illustrated in FIG. 1 is according to one embodiment, and its components are not limited to the embodiment illustrated in FIG. 1 and may be added, changed, or deleted as needed.

[0041] In one embodiment, the computing device (100) may provide a shopping support service. For example, the computing device (100) may provide a function to identify products included in social network posts or web pages and generate an add to cart button or a share button based on this.

[0042] Specifically, the computing device (100) can acquire a post shared through a social network. Additionally, the computing device (100) can generate product information included in the post. Additionally, the computing device (100) can generate a shopping support button corresponding to the product information. Furthermore, the computing device (100) can display the shopping support button on the post. Here, the shopping support button may include at least one of a share button for sharing a product in a chat room of the user account and an add-to-cart button for adding a product to the shopping cart of the user account.

[0043] Accordingly, the computing device (100) of the present invention can support shopping so that a user can purchase products encountered on social networks or web pages more intuitively and conveniently. In particular, unlike conventional manual search methods, the present invention can extract product information and simplify the purchasing process without direct user intervention, thereby improving the user experience.

[0044] Hereinafter, an example of a method in which a computing device (100) provides a shopping support service will be described with reference to FIGS. 3 to 14.

[0045] In various embodiments, the computing device (100) may provide Web or Application-based services. However, it is not limited thereto.

[0046] The computing device (100) may include any type of computer system or computer device, such as, for example, a microprocessor, a mainframe computer, a digital processor, a portable device, and a device controller. However, it is not limited thereto.

[0047] Hereinafter, the hardware configuration of the computing device (100) will be described with reference to FIG. 2.

[0048] Meanwhile, the user terminal (200) can be connected to the computing device (100) through the network (400) and may be a terminal of a user using the shopping support service provided by the computing device (100).

[0049] For example, the user terminal (200) may include a user terminal that browses posts through a social network service (SNS) or a web browser and uses shopping support buttons provided within the posts to add or share products to a shopping cart. Additionally, the user terminal (200) may be used to share product information in a specific chat room through a messenger application, or to place a group order by jointly organizing a shopping cart with other users.

[0050] Here, the user terminal (200) may include, for example, various types of computer devices. More specifically, for example, the user terminal (200) may refer to various terminal devices such as smartphones, tablet PCs, desktops, and laptops.

[0051] The user terminal (200) includes a display on at least a part of the terminal and may include an operating system for running applications or extension-based services provided by the computing device (100). For example, the user terminal (200) may be a smartphone, but is not limited thereto, and the user terminal (200) may include all kinds of handheld-based wireless communication devices such as navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) terminal, smartpad, tablet PC, etc., as wireless communication devices that ensure portability and mobility.

[0052] An external server (300) can be connected to a computing device (100) through a network (400), and can transmit and receive various information / data necessary for the computing device (100) to provide shopping support services, and can store and manage various information / data generated as the computing device (100) provides shopping support services.

[0053] For example, the external server (300) may be a database server that stores information used in the shopping support service. As another example, the external server (300) may be a server that provides information used in the shopping support service.

[0054] The network (400) may refer to a connection structure capable of exchanging information between each node, such as computing devices, multiple terminals, and servers. For example, the network (400) includes a Local Area Network (LAN), a Wide Area Network (WAN), the World Wide Web (WWW), a wired and wireless data network, a telephone network, a wired and wireless television network, etc.

[0055] Wireless data communication networks include, but are not limited to, 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), 5GPP (5th Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi, Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), RF (Radio Frequency), Bluetooth network, NFC (Near-Field Communication) network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, etc.

[0057] FIG. 2 is a hardware configuration diagram of a computing device according to one embodiment of the present invention.

[0058] Referring to FIG. 2, a computing device (100) according to one embodiment of the present invention may include one or more processors (110), a memory (120) for loading a computer program (151) executed by the processor (110), a bus (130), a communication interface (140), and a storage (150) for storing the computer program (151). Here, FIG. 2 illustrates only the components related to the embodiment of the present invention. Therefore, a person skilled in the art to which the present invention pertains will understand that other general-purpose components may be included in addition to the components illustrated in FIG. 2.

[0059] The processor (110) controls the overall operation of each component of the computing device (100). The processor (110) may be composed of one or more cores and may include processors for data analysis and deep learning, such as a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), or a tensor processing unit (TPU) of the computing device. Alternatively, it may be configured to include any type of processor well known in the art of the present invention.

[0060] Additionally, the processor (110) can perform operations for at least one application or program for executing the method according to embodiments of the present invention, and the computing device (100) may have one or more processors.

[0061] In various embodiments, the processor (110) may further include RAM (Random Access Memory, not shown) and ROM (Read-Only Memory, not shown) for temporarily and / or permanently storing signals (or data) processed within the processor (110). Additionally, the processor (110) may be implemented in the form of a system-on-chip (SoC) comprising at least one of a graphics processing unit, RAM, and ROM.

[0062] Memory (120) stores various data, instructions and / or information. Memory (120) may load a computer program (151) from storage (150) to execute a method / operation according to various embodiments of the present invention. When the computer program (151) is loaded into memory (120), the processor (110) may perform the method / operation by executing one or more instructions constituting the computer program (151). Memory (120) may be implemented as volatile memory such as RAM, but the technical scope of the present invention is not limited thereto.

[0063] The bus (130) provides communication functions between components of the computing device (100). The bus (130) can be implemented as various types of buses, such as an address bus, a data bus, and a control bus.

[0064] The communication interface (140) supports wired and wireless internet communication of the computing device (100). Additionally, the communication interface (140) may support various communication methods other than internet communication. To this end, the communication interface (140) may be configured to include a communication module well known in the art of the present invention. In some embodiments, the communication interface (140) may be omitted.

[0065] Storage (150) can store a computer program (151) non-temporarily. When performing a process according to an embodiment of the present invention through a computing device (100), storage (150) can store various information necessary to perform a method according to the disclosed embodiment or to provide a service.

[0066] The storage (150) may be configured to include non-volatile memory such as ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), flash memory, a hard disk, a removable disk, or any form of computer-readable recording medium well known in the art to which the present invention belongs.

[0067] A computer program (151) may include one or more instructions that cause a processor (110) to perform a method / operation according to various embodiments of the present invention when loaded into memory (120). That is, the processor (110) may perform the method / operation according to various embodiments of the present invention by executing the one or more instructions.

[0068] In one embodiment, the computer program (151) may include one or more instructions to perform various methods related to various tasks related to learning a neural network model.

[0069] The steps of the method or algorithm described in connection with embodiments of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or implemented by a combination thereof. The software module may reside in RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, a hard disk, a removable disk, a CD-ROM, or any form of computer-readable recording medium well known in the art to which the present invention belongs.

[0070] The components of the present invention may be implemented as a program (or application) and stored on a medium to be executed in combination with a computer, which is hardware. The components of the present invention may be implemented as software programming or software elements, and similarly, embodiments may be implemented in programming or scripting languages ​​such as C, C++, Java, assembler, etc., including various algorithms implemented as combinations of data structures, processes, routines, or other programming configurations. Functional aspects may be implemented as algorithms executed on one or more processors.

[0072] FIGS. 3 to 14 are drawings for explaining a method of providing a shopping support service according to an embodiment of the present invention.

[0073] According to one embodiment of the present invention, a computing device (100) can provide shopping support services in a social network environment.

[0074] Referring to FIG. 3, the computing device (100) can obtain a post shared through a social network (S110).

[0075] Specifically, the computing device (100) can retrieve posts by linking with a social network server based on the user's account information or access rights, and can request and receive metadata including text, images, videos, hashtags, links, etc. of specific posts through an official API provided by the social network platform.

[0076] For example, the computing device (100) may request data from a social network server based on the identifier, link, or account information of the post when a user shares a specific post on a social network application or web browser, or requests shopping support services for a post exposed in a user feed.

[0077] In another embodiment, the computing device (100) may also acquire posts shared through a messenger app.

[0078] Specifically, while browsing a social network's post feed, a user may discover a specific post and want to share it with others. In this case, the user can select the "Share Post" menu to share the post in a messenger chat room.

[0079] At this time, the computing device (100) can acquire a post shared in a messenger chat room. The computing device (100) can analyze text, images, videos, etc. included in the shared post and automatically generate a cart button on the messenger chat room.

[0080] When a user selects the Add to Cart button, the computing device (100) can add the product corresponding to the button to the user's cart. Through this, a participant in the chat room can conveniently purchase the product included in the post simply by clicking the generated Add to Cart button. This will be described in detail later in FIGS. 12 to 14.

[0081] According to one embodiment of the present invention, a computing device (100) can generate product information included in a post (S120).

[0082] For example, the computing device (100) can generate product information by identifying a product related to a post based on text and images included in the post. Here, if the computing device (100) fails to identify a product based on text and images included in the post, it may determine a recommended product based on text and images and generate product information for the recommended product.

[0083] In one embodiment, the computing device (100) can extract text included in the post.

[0084] Specifically, the computing device (100) can identify product names, brand names, option information, etc. by receiving text data within a post from a social network server and using morphological analysis and natural language processing.

[0085] For example, the computing device (100) can determine whether a specific word or phrase appearing in the text refers to a product currently on sale by performing a match with an internal or external product name database, and can improve recognition accuracy by analyzing synonyms or similar expressions together in the process.

[0086] For example, the computing device (100) can construct a list of product candidates by prioritizing the extraction of cases where a specific brand name or model number in the text is repeated more than a preset number of times (e.g., 3 times) or is indicated as a hashtag, and can re-verify whether it matches an actual product being sold by comparing each item included in the list of product candidates with a similar keyword dictionary or search log. Here, the computing device (100) considers all possible variations of text expressions, including text expressions containing incorrect spacing or typos, through a normalization process, so that product names can be recognized without omission even in posts containing non-standard user input or abbreviations.

[0087] In one embodiment, the computing device (100) can obtain at least one product name from text. And, the computing device (100) can recognize a specific product associated with at least one product name.

[0088] Specifically, the computing device (100) can generate a list of candidate products corresponding to the product names identified in the text analysis step, and for each, look up detailed information (e.g., price, stock, sales location, discount rate, rating, etc.) to finally determine the most suitable specific product.

[0089] More specifically, when it is difficult to determine a single candidate product, the computing device (100) can determine the final product by additionally collecting categories, sales records, user review scores, etc. from a product DB for each candidate product, and then evaluating the product suitability using a predefined algorithm (e.g., weighted scoring).

[0090] For example, the computing device (100) may recognize the optimal product tailored to the user by reflecting the search history or shopping cart history and preferred brands of the user account in the past.

[0091] For example, if the computing device (100) identifies through data whether the user has a history of purchasing products of the same brand multiple times or has a tendency to prefer products of a specific price range, it can increase the score of candidate products of the same brand and belonging to a similar price range to ultimately select a specific product. Accordingly, the user is intuitively presented with products that match their shopping patterns, which increases the likelihood of naturally leading to a purchase from the post.

[0092] In one embodiment, the computing device (100) can generate product information including at least one of a sales outlet selling a specific product, the price of a specific product, and the stock of a specific product.

[0093] Specifically, the computing device (100) can link with a product database provided by an external server (300) to check the price, stock status, delivery options, etc., of a specific product recognized by sales outlet and configure integrated product information.

[0094] For example, when the same product is handled by multiple retailers, the computing device (100) can prioritize displaying the retailer with the most appropriate price or stock situation to increase the user's purchasing convenience.

[0095] For example, when a specific product is handled at multiple sales outlets, the computing device (100) can calculate a comprehensive score by simultaneously comparing the real-time inventory quantity, delivery speed, user rating, and promotion status of each sales outlet, and based on this, can simplify the ordering process by displaying the sales outlet that is most advantageous to the user at the top of the screen or setting it as the default selection value.

[0096] In various embodiments, the computing device (100) can extract an image included in a post when at least one product name is not obtained from the text. And, the computing device (100) can obtain at least one product name from the image.

[0097] Specifically, the computing device (100) can identify objects presumed to be products within images included in a post and match them with product candidates through a deep learning-based object recognition model or an image classification algorithm.

[0098] More specifically, the computing device (100) can infer detailed information, such as which product line the object belongs to or which brand it is similar to, by extracting key visual features (e.g., logo, packaging shape, color pattern, texture) within an image in vector form and querying a pre-trained image feature database. Through this, the computing device (100) can identify the product name even when text analysis results are insufficient or there is little text in the post.

[0099] For example, the computing device (100) can accurately deduce a product name that could not be known by text analysis alone by detecting a specific brand logo or unique packaging element on an image.

[0100] Meanwhile, the computing device (100) can recognize a specific product associated with at least one product name obtained through an image, and generate product information including at least one of a sales outlet selling the specific product, the price of the specific product, and the stock of the specific product.

[0101] Specifically, the computing device (100) can determine the list of candidate products based on the image analysis results, and then retrieve product information stored in an external server (300) or an internal database to collect detailed information for each candidate.

[0102] More specifically, the computing device (100) can select the variant product with the highest degree of match as the final product by comparing product barcode information or detailed specifications of product descriptions (e.g., weight, capacity, size) when there are multiple variant products that are presumed to be the same product but have slightly different model names or options.

[0103] For example, since the price or stock of the same product may vary depending on the seller, the computing device (100) can improve shopping convenience by providing optimized product information to the user by comprehensively considering this.

[0104] In various embodiments, the computing device (100) can determine recommended products based on text and images when at least one product name is not obtained from text and images. Additionally, the computing device (100) can generate product information corresponding to the recommended products.

[0105] Specifically, the computing device (100) can select at least one candidate product based on the purchase history of the user account and the preference information of the user account.

[0106] For example, the computing device (100) can select candidate products by considering user purchase frequency or recent consumption patterns, brands of interest, and preferences for discounted products within a specific category, and can also reflect the results of content analysis (such as the subject or hashtag of a post) in the process.

[0107] For example, if the entire post consists of travel-related hashtags but does not include specific product information, the computing device (100) can suggest highly relevant products, such as travel bags, pouches, and accessories, as priority candidates based on the user's past travel product purchase history, preferred brands, and vacation season special offers.

[0108] Additionally, the computing device (100) can obtain candidate product information including at least one of price, sales volume, inventory, discount rate, user rating, and promotion corresponding to each of at least one candidate product. And, based on the candidate product information, the computing device (100) can determine at least one product among the at least one candidate product as a specific product.

[0109] Specifically, the computing device (100) can evaluate various indicators of individual candidate products in an integrated manner to calculate a score or assign a priority, thereby making a final decision on a product with a high ranking in user-customized recommendations.

[0110] For example, the computing device (100) can recommend products with high sales volume, reasonable prices, and high user ratings first, thereby inducing the user to naturally take an interest in the products in the post.

[0111] For example, the computing device (100) can provide optimized information to enable the user to make a decision quickly by first selecting products with high public preference by giving high weight to sales volume indicators, and then checking discount rates or stock availability to make an additional determination of whether they are suitable for purchase now. Through this, the computing device (100) enables an efficient purchasing process while minimizing interaction with the user, and at the same time, can improve the shopping experience.

[0112] According to one embodiment of the present invention, a computing device (100) can generate a shopping support button corresponding to product information (S130). Here, the shopping support button may include at least one of a share button for sharing a product in a chat room of a user account and a cart add button for adding a product to a shopping cart of a user account.

[0113] Specifically, the computing device (100) can be configured to identify the location where a product name or related phrase is detected within the text area or image area of ​​the post at the time when the product information included in the post is confirmed, and to place a “Add to Cart” or “Share” button in an overlay form corresponding to that location.

[0114] For example, the computing device (100) can utilize an API that can access UI components provided by the SNS platform to convert specific text of a post into a clickable hyperlink form, or insert an icon that highlights a product area on an image so that the user can directly touch or click it.

[0115] In various embodiments, when a plurality of products (i.e., two or more products) are recognized in step (S120), the computing device (100) can determine the priority of each product and determine the display position of the shopping support button based on this.

[0116] Specifically, when the computing device (100) recognizes two or more products during the step of generating product information included in a post, it can determine the priority for the two or more products. And, based on the priority, the computing device (100) can determine the display position of a shopping support button corresponding to the product information of each of the two or more products.

[0117] More specifically, the computing device (100) can obtain multiple product information including at least one of price, sales volume, inventory, discount rate, user rating, and promotion corresponding to each of two or more products.

[0118] For example, the computing device (100) can determine priority by assigning a high priority score to products that have both high sales volume and high ratings, and assigning a low score to products that have relatively low sales volume or low stock.

[0119] Specifically, the computing device (100) can calculate a priority score corresponding to each of two or more products based on multiple product information.

[0120] More specifically, the computing device (100) can predefine a method for setting weights for each product and calculate the score of each product using a formula such as, for example, “(sales volume Х a) + (rating Х b) - ((1 / inventory) Х c) - (discount rate Х d)”. Here, a, b, c, and d may be pre-set weight values ​​based on statistical data, and may be set to grant additional bonus points in the case of a product that is currently undergoing a specific promotion.

[0121] For example, the computing device (100) can determine priority by applying a large coefficient of a if it is a product with very high sales volume, and increasing the coefficient of d to increase the score as it is a product targeted for promotion.

[0122] Additionally, the computing device (100) can determine the priority of two or more products in correspondence with priority scores. In this case, the computing device (100) can place the button of the product with the highest priority first in the position with the highest visibility in the text area or image area within the post.

[0123] Specifically, the computing device (100) can optimize the user experience by placing buttons in a clearly identifiable area at the top of a post or inside an image for items with higher priority, and placing them in a lower position or in a form that can be viewed by accessing an additional menu for items with lower priority.

[0124] For example, when a computing device (100) recognizes several types of pasta ingredients in a post, it can assign an order of placement such that the ingredient with the best value for money is displayed as the first button and the next best value for money is displayed as the second button when the discount rate and sales volume are evaluated comprehensively.

[0125] According to one embodiment of the present invention, the computing device (100) can display a shopping support button (S140).

[0126] Specifically, the computing device (100) can display a shopping support button on the post.

[0127] Specifically, the computing device (100) dynamically generates UI elements to insert “Add to Cart” or “Share” buttons in real time on a post screen on an SNS application or web browser, and can perform a process of sending the corresponding product information to a shopping cart or sharing a link to a specific chat room when each button is clicked or touched.

[0128] For example, the computing device (100) can be implemented to synthesize a shopping support interface on the server side with the post data and transmit it to the user terminal (200), or for a client application running on the user terminal (200) to receive product information at the time of post loading and overlay a button on the screen.

[0129] For example, referring to FIG. 4, the computing device (100) can provide an interface that allows the user to send product information to a specific chat room and review products or proceed with a group purchase with other users in the chat room by displaying a cart button and a share button in the part where words such as "vongole pasta," "garlic," and "clam meat" are recognized in the post text or in the area where pasta ingredients are detected in the image.

[0130] Accordingly, the computing device (100) of the present invention can prioritize the placement of the most suitable product among multiple products and configure other products to be easily accessible, thereby simultaneously increasing the user's shopping convenience and efficiency.

[0132] According to various embodiments of the present invention, a computing device (100) can provide shopping support services on various current screens (e.g., websites, social network services (SNS), messenger applications, image galleries, video streaming services, electronic document viewers, etc.).

[0133] Specifically, the computing device (100) can display a shopping support layer on the current screen displayed on the user terminal. Here, the shopping support layer is an interface that covers part or all of the screen of the user terminal, for example, in the form of a translucent or pop-up, and can directly place shopping functions (e.g., product recognition, price lookup, add to cart buttons, etc.) on the webpage or social media post currently being viewed.

[0134] That is, the computing device (100) can be configured to display an overlay UI (user interface) that allows the user to immediately check product information and add it to a shopping cart without switching to a separate application when the user discovers a product while browsing social media or websites.

[0135] For example, the computing device (100) can activate and display a shopping support layer when the user terminal presses a “shopping support” icon or button, or detects a specific gesture. This shopping support layer enables the user to browse products and add items to a cart with simple operations, thereby allowing for an immediate shopping flow without the need for separate link copying or app launching.

[0136] Meanwhile, the computing device (100) can capture the current screen when input for the shopping support layer is obtained. Then, the computing device (100) can extract current screen product information included on the captured current screen. Subsequently, the computing device (100) can generate a shopping support button corresponding to the current screen product information.

[0137] Specifically, the computing device (100) can identify product names, brand logos, or price information displayed on the screen by performing image analysis and text analysis based on a captured image, and can identify one or more products through this.

[0138] More specifically, the computing device (100) can detect product images in a captured image using a deep learning-based object recognition model and obtain product information by determining what type or brand the detected image is.

[0139] For example, when the computing device (100) sees the text “Tumbler” and a specific brand logo together on the screen, it can refer to an internal product database to find the actual product name “Stainless Steel Tumbler 460ml” and obtain the corresponding price, stock, and sales location information. Subsequently, the computing device (100) can place buttons such as “Add to Cart,” “View Details,” and “Share” corresponding to the identified product on a shopping support layer, thereby allowing the user to immediately add the product to a shopping cart or send it to another person.

[0140] Accordingly, the computing device (100) can provide the advantage of improving overall shopping convenience and efficiency by enabling the user to immediately purchase or share products recognized on the current screen without running a separate shopping mall application or entering website addresses one by one.

[0142] According to one embodiment of the present invention, a computing device (100) can provide shopping support services in a messenger integration environment.

[0143] Referring to FIG. 5, when the computing device (100) obtains input for a share button, it can obtain a selection input for a specific chat room to share product information (S210).

[0144] Specifically, the computing device (100) can call up a list of chat rooms or a list of friends and allow the user to select which chat room to send the product information to when the user presses a ‘share’ button on a post or shopping mall product page displayed within an SNS application or messenger application.

[0145] For example, a computing device (100) may receive identification information of a specific chat room (e.g., chat room ID or participant list) from a user terminal (200) and prepare a message transmission process based thereon. In this process, the user may select one or more chat rooms, or open a specific group chat to share product information with multiple people simultaneously.

[0146] In one embodiment, the computing device (100) can display product information and a cart button corresponding to the product information in a specific chat room based on a selection input (S220).

[0147] Specifically, the computing device (100) may be configured to transmit product-related information, such as the product name, price, brief description, or thumbnail image, to a chat room conversation window designated by the user, and at the same time display a ‘Add to Cart’ button.

[0148] For example, the computing device (100) supports other users in the chat room in immediately viewing the product and adding it to the cart by combining and transmitting “detailed information of the product” and a “add to cart” button link in the form of a chat message. When the button is pressed, the user terminal (200) is linked with the shopping mall server or the shopping cart management module of the computing device (100) to immediately add the product to the shopping cart, and products added by multiple users in the same chat room can be combined into a single shopping cart.

[0149] In various embodiments, the computing device (100) may provide a market platform for purchasing goods and may also provide a sharing function for selected goods on the market platform.

[0150] For example, in the market platform illustrated in FIG. 6, when a specific product is selected, a detailed information screen as illustrated in FIG. 7 is displayed, and the detailed information screen may include a share button.

[0151] And, when the computing device (100) obtains input for a share button, it obtains input for a specific chat room to share product information, and then can share product information in the chat room as shown in FIG. 8. Through this, when a user finds a product they like in a shopping mall environment, they can immediately share the product information with friends or acquaintances without having to go through the process of copying a link or switching messengers separately, and can easily check the shared product in the chat room and proceed to the purchase process.

[0152] In one embodiment, when the computing device (100) obtains input for a cart add button in a specific chat room, it may display a cart view button to check the cart (S230).

[0153] Specifically, the computing device (100) can activate a separate “View Cart” button or display it in a popup form so that the contents of the shopping cart can be checked immediately when the user clicks the button while the “Add to Cart” button is sent to the chat room conversation window.

[0154] For example, the computing device (100) provides a convenient shopping experience by additionally displaying UI elements such as 'Open Cart' at the bottom of the screen of the user terminal (200) or within the chat window, allowing the user to immediately view the cart details without ending the chat. When entering the cart screen, the user can intuitively check all products, quantities, options, and estimated payment amounts registered to the user account, and additionally, functions such as payment processing, coupon application, and joint ordering with other users can be linked, thereby improving shopping convenience.

[0155] In various embodiments, the computing device (100) can extract product information based on text entered in a chat room and display the product information in the chat room.

[0156] Specifically, the computing device (100) can identify a shopping intention based on text entered in a chat room before extracting product information. And, the computing device (100) can perform product information extraction when a shopping intention is identified.

[0157] More specifically, the computing device (100) recognizes words, phrases, or inquiries related to price or options (e.g., “How much is it?”, “Do you have the size?”) that suggest purchasing behavior, such as “buy,” “order,” “I need,” etc., in the chat room conversation using natural language processing (NLP) techniques, and if such expressions are detected above a certain level, it can determine that the user actually purchases the product or is interested in it.

[0158] For example, the computing device (100) can analyze the text “I have a gathering with friends on the weekend, so I should order some drinks and snacks” and recognize “drinks”, “snacks”, etc. as potential product keywords, and if it determines that the user’s utterance intention is to actually purchase the items, it can perform a process of querying and extracting product candidates in the next step.

[0159] For example, the computing device (100) may examine the entire context of the chat room conversation. For instance, if the conversation continuously contains content related to preparing for a specific event or gathering, such as “Shall we have a party in the evening?” “Then let’s order pizza and chicken!” “Let’s order beer too,” it may determine that the user’s intention to ‘order party food (pizza, chicken, beer)’ is clear, and search an online product database or recognize already secured product information based on the keywords (pizza, chicken, beer). Then, the computing device (100) may automatically display product names corresponding to the keywords appearing in the message based on the identified list of product candidates, or place a ‘Add to Cart’ button in the chat window to induce users to make quick purchasing decisions.

[0160] When the computing device (100) has completed identifying the user's shopping intent, it can receive the user's text message entered into the chat application from the chat application server side and recognize the product name in the message through natural language processing (NLP).

[0161] More specifically, the computing device (100) identifies product-related keywords by matching words appearing in a message with an internal or external product database, and if multiple identical or similar products are extracted as candidates, it can determine the optimal product through priority criteria such as user purchase history or sales volume.

[0162] For example, when the sentence “I also order cider” is entered, the computing device (100) identifies the keyword “cider” as a product candidate and can prioritize viewing product information from the cider product list that the user has previously frequently purchased or that has a discount promotion applied.

[0163] For example, as illustrated in FIG. 9, when a user enters a chat message saying “I’m ordering cider too,” the computing device (100) can display product information for the “cider” product in the chat room as illustrated in FIG. 10. That is, the computing device (100) can synthesize actual product names such as “Lotte / Chilsung Cider* Special,” price, and a brief description into a chat message format and send it to the chat room along with a “Add to Cart” button. This allows other users in the chat room to check the message and press the “Add to Cart” button to add the product to their shopping cart.

[0164] In various embodiments, the computing device (100) may display a shopping cart screen of a user account when it obtains input for a cart view button. Here, the shopping cart screen may include at least one product added to the shopping cart through adding to cart and user information that added at least one product to the shopping cart.

[0165] Specifically, when the computing device (100) detects an event where the “View Cart” button is clicked or tapped in a chat room, it can retrieve a list of all products added so far in the same chat room or the same cart session on the server side.

[0166] For example, the computing device (100) can configure the screen to map a user ID and a product ID connected to the shopping cart information, so as to display the product name, price, quantity and options, as well as which user added the product in the form of “Orderer: (Username)”.

[0167] For example, as illustrated in FIG. 11, the computing device (100) configures the UI to display the name or purchase history of the user who added the product to the shopping cart for each product, thereby enabling multiple users to easily distinguish the products they have each added when placing a group order. Next to “Our Home Cooking Bean Sprouts,” “Orderer: Eunhye Cheon” may be displayed, next to “Pulmuone / Large and Firm Tofu,” “Orderer: Yonghwan Kim” may be displayed, and “Orderer: Eunhye Cheon” may be displayed again for the “Lotte / Chilsung Cider* Special” product. Through this, when multiple people place a joint order, it is possible to check in real time who added which product, and the shared costs can be easily sorted at the time of payment.

[0168] Accordingly, the computing device (100) displays product information in real time through text analysis entered in the chat room and supports convenient shopping cart management using “Add to Cart” and “View Cart” buttons, thereby enabling users to process everything from ordering to payment preparation in one go within the same chat environment without switching to a separate app.

[0170] According to an additional embodiment of the present invention, a computing device (100) can acquire an image including the price of a product displayed in an offline store and link it with online sales information to provide the user with price comparison, product information sharing, and shopping cart management.

[0171] Specifically, the computing device (100) can analyze a price tag or package image of a product captured by a user terminal (200) and extract the name, price, brand logo, etc. of the product using OCR (Optical Character Recognition) and object recognition techniques. Additionally, the computing device (100) can perform matching with a pre-linked online shopping mall database based on the extracted information to check the online sales price, inventory, discount benefits, etc. of identical or similar products, and enable real-time comparison with offline store prices.

[0172] More specifically, the computing device (100) can generate integrated product information including stock status, review ratings, promotion information, etc., after comparing product images and price information taken by the user at the store with the product catalog on the server side.

[0173] For example, the computing device (100) can provide the user with an immediate price comparison result in the form of “20,000 won at an offline store, and the lowest online price is 18,000 won.” In addition, the computing device (100) can support the user’s rational consumption by providing specific discount information, such as “an additional 10% coupon available online only today.”

[0174] Additionally, the computing device (100) can combine product information with a messenger sharing function, allowing the user to easily send product links, prices, images, etc. to a specific chat room or SNS account. Through this, the product condition or price can be immediately shared with acquaintances who did not come to the offline store together, and group purchasing or exchanging opinions can be made possible. Furthermore, by linking with a shopping cart function, convenience can be enhanced so that even if a product is viewed at the offline store and liked but not purchased immediately, it can be saved to an online shopping cart and paid for later or purchased at a discounted time.

[0175] Accordingly, the computing device (100) can create new added value throughout the e-commerce ecosystem by combining offline shopping experience and online shopping convenience, and by providing users with an integrated shopping support service that enables real-time price comparison, group shopping, and subsequent purchase management.

[0177] FIGS. 12 to 14 are drawings illustrating a method for providing a shopping support service for a post shared through a messenger app according to another embodiment of the present invention.

[0178] This explanation uses an example where a user discovers a post by a cooking influencer while browsing a social network feed and wishes to introduce the dish to others or purchase the ingredients featured in the post.

[0179] The user can share the post in a messenger chat room by selecting the post sharing menu indicated by the dotted circle in Fig. 12, and the shared post is displayed in the chat room as shown in Figs. 13 and 14.

[0180] The computing device (100) can analyze the text, images, videos, etc. of a shared post and generate product information included in the shared post.

[0181] Specifically, the computing device (100) can extract text included in a shared post and obtain at least one product name from the extracted text. For example, if a cooking influencer's post includes ingredient names such as "olive oil" or "pasta noodles" as text, the computing device (100) can obtain a product name from the text. If a product name is not obtained from the text, the computing device (100) can extract an image included in the post and obtain at least one product name through image recognition. For example, a product name can be obtained by recognizing an ingredient image from a cooking photo included in the post. If a product name is not obtained from either the text or the image, the computing device (100) can determine a recommended product based on the text and the image. In this case, the computing device (100) can select candidate products based on the purchase history and preference information of the user account, obtain candidate product information including at least one of the price, sales volume, stock, discount rate, user rating, and promotion of each candidate product, and determine a specific product based on this. The computing device (100) can generate product information including at least one of a sales outlet selling a specific product recognized in this way, the price and stock of the product.

[0182] The method for generating product information here may include at least some of the methods described above in S120.

[0183] Additionally, the computing device (100) can generate a shopping support button corresponding to the generated product information. The shopping support button may include an add to cart button.

[0184] The Add to Cart button is a button that allows a product to be immediately added to a user's shopping cart within a chat room, and can be generated individually corresponding to each product's information. For example, if a shared post contains multiple products, the computing device (100) can generate a Add to Cart button corresponding to each product. When a user selects the Add to Cart button, the computing device (100) can add the product corresponding to the button to the user's shopping cart. At this time, the computing device (100) can display product information such as the product name, price, and seller on the Add to Cart button, so that the user can check the product information and add it to the shopping cart without leaving the chat room. Additionally, when a product is added to the shopping cart by selecting the Add to Cart button, the computing device (100) can display a View Cart button within the chat room to check the shopping cart, and the user can select the View Cart button to immediately move to the shopping cart screen.

[0185] The method for creating a shopping support button here may include at least some of the methods described above in S130.

[0186] The computing device (100) can display the generated shopping support button (e.g., add to cart button) in the chat room.

[0187] Specifically, the shopping support button is linked to a shared post displayed within the chat room and can be displayed at the bottom or adjacent area of ​​the post, as illustrated by the dotted circle in FIG. 13. For example, if a post shared within the chat room contains multiple products, the computing device (100) can individually generate and display a "Add to Cart" button corresponding to each product. At this time, the user can add the product to the cart by selecting the "Add to Cart" button corresponding to the desired product. The "Add to Cart" button can be displayed along with product information such as the product name, price, and seller, and is configured so that the user can decide whether to purchase while intuitively checking the product information. Additionally, the "Add to Cart" button can be displayed identically to all participants in the chat room, and each participant in the chat room can independently add the product to the cart corresponding to their user account.

[0188] The method of displaying the shopping support button here may include at least some of the methods described above in S140.

[0189] Additionally, the computing device (100) may automatically generate a "Add All Ingredients" button that can add all products included in a shared post to a shopping cart in bulk.

[0190] Specifically, if a cooking influencer's post contains multiple ingredients, the computing device (100) can automatically generate an "Add All Ingredients" button that allows all recognized products to be added to the shopping cart at once, along with individual "Add to Cart" buttons corresponding to each of the multiple products recognized from the post. Additionally, the computing device (100) can generate the "Add All Ingredients" button independently. The automatically generated "Add All Ingredients" button can be displayed within the chat room, as illustrated by the dotted circle in FIG. 14. When a user selects the "Add All Ingredients" button, the computing device (100) can add the multiple products recognized from the post to the user's shopping cart in bulk. In this case, if there are multiple vendors selling the same product, the computing device (100) can automatically select the optimal vendor based on at least one of price, sales volume, stock, discount rate, user rating, and promotion, and add it to the shopping cart. Additionally, if multiple participants in the chat room each select the "Add All Ingredients" button, the computing device (100) can individually add the corresponding products to each participant's shopping cart.

[0191] As explained above, each step according to the present embodiment may share some steps with the previously described embodiment, and the previously described content may be applied identically or substantially identically to steps not separately described, including the steps described in the present embodiment. That is, although each step described in the present embodiment has been explained focusing on the parts that differ from the previously described embodiment, the content related to the corresponding step of the previously described embodiment may be applied to the present embodiment as is or with modifications. However, it should be noted that each step of the present embodiment is not necessarily limited to being identical to the corresponding step of the previously described embodiment, and may be applied with various modifications within the scope of the technical concept of the present invention.

[0193] Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention may be implemented in other specific forms without altering its technical concept or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive.

Claims

Claim 1 A method for providing a shopping support service, comprising: a step of obtaining a post shared through a social network; a step of generating product information included in the post; a step of generating a shopping support button corresponding to the product information; and a step of displaying the shopping support button. Claim 2 A method for providing a shopping support service according to claim 1, wherein the step of generating product information included in the post comprises: a step of extracting text included in the post; a step of obtaining at least one product name from the text; a step of recognizing a specific product associated with the at least one product name; and a step of generating product information including at least one of a sales outlet selling the specific product, the price of the specific product, and the stock of the specific product. Claim 3 A method for providing a shopping support service according to claim 2, wherein the step of generating product information included in the post further comprises: a step of extracting an image included in the post when at least one product name is not obtained from the text; a step of obtaining at least one product name from the image; a step of recognizing a specific product associated with at least one product name; and a step of generating product information including at least one of a sales outlet selling the specific product, the price of the specific product, and the stock of the specific product. Claim 4 In claim 3, the step of generating product information included in the post comprises: a step of determining a recommended product based on the text and the image when at least one product name is not obtained from the text and the image; and a step of generating product information corresponding to the recommended product; and the step of determining a recommended product based on the text and the image comprises: a step of selecting at least one candidate product based on the purchase history of the user account and preference information of the user account; a step of obtaining candidate product information including at least one of price, sales volume, stock, discount rate, user rating, and promotion corresponding to each of the at least one candidate product; and a step of determining at least one product among the at least one candidate product as a specific product based on the candidate product information. Claim 5 A method for providing a shopping support service according to claim 1, wherein the step of generating a shopping support button corresponding to the product information comprises: a step of determining a priority for the two or more products when two or more products are recognized in the step of generating product information included in the post; and a step of determining the display position of the shopping support button corresponding to the product information of each of the two or more products based on the priority; and the step of determining a priority for the two or more products comprises: a step of obtaining multiple product information including at least one of price, sales volume, stock, discount rate, user rating, and promotion corresponding to each of the two or more products; a step of calculating a priority score corresponding to each of the two or more products based on the multiple product information; and a step of determining a priority for the two or more products corresponding to the priority score. Claim 6 A method for providing a shopping support service according to claim 1, wherein the shopping support button comprises at least one of a share button for sharing a product in a chat room of a user account and a cart button for adding a product to a shopping cart of the user account, and the method comprises: a step of obtaining a selection input for a specific chat room to share the product information when input for the share button is obtained; a step of displaying the product information and a cart button corresponding to the product information in the specific chat room based on the selection input; and a step of displaying a cart view button for checking the shopping cart when input for the cart button is obtained in the specific chat room. Claim 7 In claim 6, the method further comprises the step of displaying a shopping cart screen of the user account when input for the cart view button is obtained; wherein the shopping cart screen includes at least one product added to the shopping cart through the cart addition and user information that added the at least one product to the shopping cart. Claim 8 A method for providing a shopping support service according to claim 1, further comprising: a step of displaying a shopping support layer on a current screen displayed on a user terminal; a step of capturing the current screen when input for the shopping support layer is obtained; a step of extracting current screen product information included on the captured current screen; and a step of generating the shopping support button corresponding to the current screen product information. Claim 9 A device comprising: a memory for storing one or more instructions; and a processor for executing the one or more instructions stored in the memory, wherein the processor performs the method of claim 1 by executing the one or more instructions. Claim 10 A computer program stored on a computer-readable recording medium that is combined with a computer, which is hardware, to perform the method of claim 1.

Images