Apparatus and method for providing book services based on book images

Abstract

The book image-based book service provider device may include: an acquisition unit that acquires book images from a user; a determination unit that determines whether the user is a learning service user who uses a previously designated learning service and whether there is a purchase history of the user with respect to the target book corresponding to the book image in a previously designated shopping mall; and a provision unit that provides book services related to the target book if it is determined that a purchase history exists.

Description

Technical Field

[0001] The present invention relates to a book service providing apparatus and method based on a book image. In particular, in the present invention, a user who uses a specific learning service authenticates by recognizing at least a partial area of a book using a terminal, and then, when it is determined that there is a purchase-related history of the user in a designated shopping mall related to the recognized book, digital content related to the book is provided to the user, so that only subscribers who have purchased genuine books can play the digital content, thereby promoting the growth of the publishing industry and improving the protection of the rights of copyright holders, and creating a new publishing ecosystem. The present invention relates to a book service providing apparatus and method based on a book image.

Background Art

[0002] This (book) is also said to be the spiritual food that enriches life. Reading a book has more meaning than just accumulating knowledge or collecting information. For children, it can also be a form of play, and for people of all ages, it can be a healthy and beneficial hobby. The degree of interest in books is increasing day by day.

[0003] This (book) is also widely used as a teaching material for educational and learning purposes. As for the types of book genres, there are a great variety, such as poems, fairy tales, short stories, essays, self-help books, and so on.

[0004] The current book market offers both physical books and ebooks, videos, and audio services utilizing those books. However, existing publishers do not produce and distribute online digital content based on currently popular new releases or bestsellers. Traditionally, such content is only distributed as an appendix, such as a CD, when purchasing a book. The reason for this is that online distribution of such digital content based on books would affect and hinder the sales of the physical books. On the other hand, consumers tend to have a high demand for digital content related to the most talked-about and best-selling books, but traditionally, such digital content has not been supplied, resulting in an imbalance between supply and demand in the book market.

[0005] Furthermore, the current publishing industry for physical books is generally in a transitional period. With the emergence and revitalization of secondhand trading platforms, the proportion of people purchasing genuine books for the first time is gradually decreasing. In addition, various social issues are causing a decline in the readership of physical books themselves, resulting in a bleak outlook for the future.

[0006] The paper books that children read are mainly fairy tales, and because many parents encourage their children to read, their usage rate is relatively high compared to paper books read by other age groups (teenagers, adults, etc.). However, children's paper books come in a variety of themes (learning content) appropriate for each age group (months), and as children grow, it becomes necessary to provide them with books that are appropriate for their current age. Therefore, the period during which a particular book can be used for a child's learning tends to be short. As a result, many parents tend to purchase used books or borrow books from libraries rather than buying and using officially licensed books for their children's education, resulting in a significantly low purchase rate of officially licensed books. Furthermore, with the development of information and communication technology, e-book services and educational video content services for children are already actively provided in the current book market. Therefore, it is now possible to learn and educate using e-books and video content without purchasing physical books (especially officially licensed books), and the perception of the need to purchase paper books is decreasing.

[0007] Furthermore, from a convenience standpoint, e-books have the advantage of being easily and quickly accessible anytime, anywhere, compared to paper books. Therefore, even among young people and adults, only a small number of people read paper books these days, with the vast majority tending to read e-books.

[0008] For the various reasons mentioned above, the future of the paper book publishing industry is indeed looking bleak.

[0009] Thus, the current book market is largely dominated by the used book market and the e-book market, while the market for genuine physical books is declining. This makes it difficult to protect the rights of copyright holders and contributes to the decline of the publishing industry.

[0010] Therefore, there is an urgent need to develop technologies that can revive the currently stagnant paper book publishing market (especially the market for legitimate paper books) and create a new form of publishing ecosystem that allows authors to receive protection for their rights as copyright holders of books.

[0011] The technology underlying this invention is disclosed in Patent Document 1: Korean Published Patent No. 10-2012-0012871. [Prior art documents] [Patent Documents]

[0012] [Patent Document 1] Korean Published Patent Publication No. 10-2012-0012871 [Overview of the Initiative] [Problems that the invention aims to solve]

[0013] The present invention aims to solve the problems of the prior art described above, and to provide a book image-based book service provision device and method that allows only subscribers who have purchased genuine products (genuine books) to play specific content (digital content), thereby increasing the proportion of genuine product buyers compared to used book transactions, extending the book ownership period of subscribers, and thereby contributing to the growth of the publishing industry and improving the protection of copyright holders' rights, as well as enabling the construction of a new publishing ecosystem through a business model that combines digital devices and paper books.

[0014] The present invention aims to solve the problems of the prior art described above, and to provide a book image-based book service provision device and method that corrects the imbalance between supply and demand in the conventional book market by making digital content using books (physical books) that are in high demand in the book market available (for example, available for a fee), thereby enabling the sale of digital content of the most in-demand new releases and best-selling books without affecting the sale of the physical books.

[0015] The present invention aims to solve the problems of the prior art described above, and to provide a book image-based book service provision device and method that enables users to utilize a variety of services (target book-related digital content) provided in connection with a specific book, thereby not only enabling users to acquire and learn the content written in the book, but also to enhance their interest and immersion by allowing them to engage with the book-related content in a more diverse way.

[0016] The present invention aims to solve the problems of the prior art described above, and to provide a book image-based book service provision device and method that, when it is determined that a user has a book purchase history or billing history for a particular book, provides and makes available book services related to that book (i.e., digital content related to the target book), and in particular enables the user to conveniently connect to and use these services without complexity or hassle. However, the technical problems that the embodiments of the present invention aim to solve are not limited to those described above, and other technical problems may exist. [Means for solving the problem]

[0017] As a technical means for achieving the technical challenges described above, a book image-based book service provider according to one embodiment of the present invention may include: an acquisition unit for acquiring book images from a user; a determination unit for determining whether the user is a learning service user who uses a previously designated learning service and whether there is a purchase history of the user with respect to the target book corresponding to the book image in a previously designated shopping mall; and a provision unit for providing book services related to the target book if it is determined that such a purchase history exists.

[0018] Furthermore, the determination unit can determine that a user who uses a monthly subscription service provided free of charge or for a fee in a book service provision device based on book images is a user of the learning service.

[0019] Furthermore, the purchase-related history may be a record of when the user purchased or rented the target book at the previously designated shopping mall.

[0020] Furthermore, when the shooting mode is detected, the acquisition unit can acquire the book image within the displayed image by analyzing the displayed image on the screen.

[0021] Furthermore, the book image may be an image obtained by recognizing at least a portion of the target book.

[0022] Furthermore, the book service is a service that provides access to pre-generated digital content related to the target book for a fee, and the digital content related to the target book may include content relating to at least one of the following: video, audio, and activities related to the target book.

[0023] In addition, the method for providing a book service based on a book image according to an embodiment of the present invention includes: a step of obtaining a book image from a user by an obtaining unit; a step of determining by a determination unit whether the user is a learning service user who uses a pre-specified learning service and determining whether there is a purchase-related history of the user regarding a target book corresponding to the book image in a pre-specified shopping mall; and a step of providing a book service related to the target book by a providing unit when it is determined that the purchase-related history exists.

[0024] The above-described problem-solving means are merely exemplary and should not be construed as intending to limit the present invention. In addition to the above-described exemplary embodiments, there may be further embodiments in the drawings and the detailed description of the present invention.

Advantages of the Invention

[0025] According to the problem-solving means of the present invention described above, by providing a book service providing apparatus and method based on a book image, when playing a specific content (digital content), only subscribers who have purchased genuine products (genuine books) in a pre-specified shopping mall can play it, thereby increasing the proportion of purchasers of genuine products for second-hand book transactions and extending the book holding period of subscribers. As a result, it is possible to promote the growth of the publishing industry and improve the protection of the rights of copyright holders, and a new publishing ecosystem can be constructed by a business model that combines digital devices and paper books.

[0026] According to the problem-solving means of the present invention described above, by providing a book service providing apparatus and method based on a book image, digital content utilizing the book (physical book) can be used for new publications and best-selling books in high demand in the book market, thereby correcting the imbalance between demand and supply in the conventional book market, and effectively selling or lending digital content of new publications and best-selling books in particular high demand without affecting the sales of the physical books.

[0027] According to the aforementioned means for solving the problems of the present invention, by providing a book image-based book service provision device and method, users can access a variety of services (digital content related to the target book) provided in relation to a specific book (book, target book). This not only enables users to acquire and learn the content written in the book, but also enhances their interest and immersion by allowing them to engage with the book-related content in a more diverse way.

[0028] According to the aforementioned means for solving the problems of the present invention, by providing a book image-based book service provision device and method, when it is determined that a user has a book purchase history or billing history for a specific book (target book), book services related to that book (i.e., digital content related to the target book) can be provided to the user and made available for use. In particular, when using these services, the user can conveniently access and use them without complexity or hassle. However, the effects obtained by the present invention are not limited to those described above, and other effects may exist. [Brief explanation of the drawing]

[0029] [Figure 1] This figure shows a schematic configuration of a book image-based book service provider according to one embodiment of the present invention. [Figure 2] This figure shows a schematic configuration of a book image-based book service provision system, including a book image-based book service provision device according to one embodiment of the present invention. [Figure 3] This figure illustrates a book image acquired by a book image-based book service provider according to one embodiment of the present invention. [Figure 4] This figure illustrates a comparison save icon provided by the control unit of a book image-based book service provider according to one embodiment of the present invention. [Figure 5] This is a flowchart illustrating the operation of a book image-based book service provision method according to one embodiment of the present invention. [Modes for carrying out the invention]

[0030] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings, so that those skilled in the art in which the present invention pertains can easily implement it. However, the present invention can be implemented in various forms and is not limited to the embodiments described herein. Furthermore, in order to clearly illustrate the present invention, parts unrelated to the description have been omitted from the drawings, and similar parts throughout the specification are denoted by similar reference numerals. Throughout the specification of the present invention, where it is stated that one part is “connected” to another part, this includes not only cases where it is “directly connected,” but also cases where it is “electrically connected” or “indirectly connected” between them via other elements. Furthermore, throughout the specification of the present invention, when it is stated that a member is located "above," "on top," "at the top end," "below," "at the bottom," or "at the bottom end" of another member, this includes not only cases where the member is in contact with another member, but also cases where another member exists between the two members. Where the specification of the present invention as a whole states that a part "includes" a certain component, unless otherwise stated, this does not mean that other components are excluded, but rather that other components may be further included. Furthermore, throughout the specification of the present invention, some operations or functions described as being performed by a terminal, apparatus, or device may be performed by a server connected to such terminal, apparatus, or device. Similarly, some operations or functions described as being performed by a server may be performed by a terminal, apparatus, or device connected to such server. Furthermore, throughout the specification of this invention, the term "at least one" may be defined as a term that includes both singular and plural forms. Also, even if the expression "at least one" is not present, it is clear that each component may exist in singular or plural forms. Whether each component is provided in singular or plural forms is modifiable depending on the embodiment.

[0031] Figure 1 shows a schematic configuration of a book image-based book service provider 10 according to one embodiment of the present invention. Figure 2 shows a schematic configuration of a book image-based book service provider system 100 including the book image-based book service provider 10 according to one embodiment of the present invention. Figure 3 is a diagram illustrating the book images acquired by the book image-based book service provider 10 according to one embodiment of the present invention.

[0032] In the following, for the sake of explanation, the book image-based book service provision device 10 according to one embodiment of the present invention will be referred to as "the device 10," and the book image-based book service provision system 100 according to one embodiment of the present invention will be referred to as "the system 100." Referring to Figures 1 to 3, the system 100 may include the device 10 and the user terminal 30.

[0033] This device 10 is a book image-based book service provider, and may be a device that can provide users 31 with a variety of book services related to recognized book images based on the recognition of book images. Such a device 10 may be referred to by other terms, such as a book image recognition-based book service provider.

[0034] The service provided by this device 10 is a book image-based book service, which may be referred to as "this service" below for convenience of explanation, and may also be called by other terms such as "Globi service." Such this service may be a monthly subscription service provided to users for a fee or free of charge. Furthermore, in this invention, the previously specified learning service may mean this service (monthly subscription service) provided by this device 10.

[0035] The device 10 authenticates users 31 who have purchased or rented books available only at designated shopping malls by recognizing at least a portion of the book using their user terminal 30. Subsequently, if it is determined that a purchase or rental history of the user at the designated shopping mall (i.e., the user's purchase history described later) exists in relation to the recognized book, the device 10 can provide the user with digital content related to that book. Here, the designated shopping mall can be understood as a concept that includes the device 10's own shopping mall operated by the administrator (or the learning service provider to which the administrator belongs), and partner shopping malls affiliated with the administrator (or the learning service provider).

[0036] In describing the present invention, books may be referred to by other terms such as "books." Furthermore, books provided (sold or rented) at a previously designated shopping mall in the present invention may be referred to as "designated books," which may mean genuine books or physical books (genuine physical books) provided only at the previously designated shopping mall. Additionally, books (physical books) recognized (recognized by scanning or photographing) by the user with the camera of the user terminal 30 may be referred to as "target books." In the present invention, the user can obtain a book image corresponding to a target book by having the user terminal 30 recognize the target book.

[0037] The books considered in this invention (physical books), particularly the books for which book services (i.e., digital content) are provided by the provisioning unit 13, are books provided in a previously designated shopping mall (designated books), which, for example, are books in high demand in the book market and may be new releases and best-selling books. However, the invention is not limited to these, and the books considered in this invention may include not only new releases and best-selling books, but also a variety of other types of books, such as general books.

[0038] In this invention, the books considered are more preferably new releases and best-selling books. Accordingly, the purpose of this invention (i.e., the device 10 and the system 100) is to correct the imbalance between supply and demand in the conventional book market by making digital content using new releases and best-selling books that are in high demand in the book market available (for example, for a fee), and to provide a technology that enables the sale of digital content of the most in-demand new releases and best-selling books without affecting the sale of the physical books.

[0039] Furthermore, the previously designated shopping malls considered in this invention may include, as mentioned above, the company's own shopping mall (a company-owned online / offline shopping mall) directly operated by the administrator (or the learning service provider company to which the administrator belongs) that manages and operates the device 10, or they may also include partner shopping malls (partner online / offline shopping malls) that are affiliated with the administrator (or the learning service provider company). In other words, the previously designated shopping malls may include, for example, shopping malls that are directly operated by the administrator or indirectly operated through partnerships. The number of previously designated shopping malls considered in this invention may be one or more.

[0040] According to this, the designated books considered in the present invention are books (genuine books, genuine physical books) that are provided (sold or rented) only at the previously designated shopping malls, and specifically, this does not mean books provided only at the company's own shopping malls, but may mean books provided at the company's own shopping malls or affiliated shopping malls.

[0041] Furthermore, the previously designated shopping mall may be a shopping mall that makes at least one book (a physical book, a genuine book) available for purchase or rental to users. In other words, the previously designated shopping mall may be a shopping mall that provides at least one book to users through sale or rental. For the sake of explanation, below we will assume that the previously designated shopping mall is capable of providing multiple books as at least one book (i.e., providing them through sale or rental).

[0042] The multiple books offered at the previously designated shopping mall may be books that are not offered (provided through sale or rental) at any other shopping mall. In other words, the multiple books may, for example, be books (books exclusive to the company) that are offered (provided through sale or rental) only at the previously designated shopping mall, and in this invention, the multiple books may be referred to by other terms such as multiple designated books. Each of the multiple books may mean a physical book.

[0043] User terminal 30 may mean a terminal owned by user 31 who uses the device 10. User 31 can purchase or rent at least one book from among several books offered (in particular, offered through sale or rental) at the designated shopping mall. After purchasing or renting at least one book from among several books offered at the designated shopping mall, user 31 can, for example, recognize (scan, photograph) the book using the camera of their user terminal 30, and in response to the recognition, the device 10 can provide book services related to the recognized book (i.e., the target book). Here, book services may, for example, be paid services. If user 31 wishes to use the book services provided by the device 10, for example, they can use them by paying the amount corresponding to the fee.

[0044] Here, the book recognized by user 31 with the camera of user terminal 30 may be referred to as the "target book" in this invention, as mentioned above. User 31 can be anyone, regardless of age or gender. User 31 may also be referred to by other terms such as user, customer, member, etc.

[0045] In this context, a book service related to the target book may mean a service that provides (to users) pre-generated digital content related to the target book for a fee. Here, the digital content related to the target book may include content relating to at least one of the following: video, audio, and activities related to the target book. Thus, a book service related to the target book may be an additional service provided for a fee in connection with the target book (physical book).

[0046] For example, when the user recognizes a target book (a specific physical book) via the camera of the user terminal 30, the device 10 obtains a book image of the target book from the user 31. After that, it determines whether the user is a learning service user who uses a previously designated learning service. If it is determined that the user is a learning service user, it then determines whether there is a purchase-related history, which is a history of the user purchasing or borrowing the target book at a previously designated shopping mall. If it is determined that a purchase-related history exists, the device 10 can provide the user with a book service related to the target book (so that it can be played on the user terminal) and make it available to the user.

[0047] In this case, when a book image is acquired, if the device 10 detects that the user is logged in to the device 10 (already registered and logged in), it can determine that the user is a learning service user who uses a previously designated learning service (i.e., this service, a monthly subscription service). Subsequently, if the device 10 determines that the user is a learning service user, it then, as an example, uses the login information of the logged-in user to determine whether there is a history (i.e., purchase-related history) of the user purchasing or borrowing the target book (i.e., a designated book corresponding to the target book) at a previously designated shopping mall. If such purchase-related history exists, the device 10 can provide the user with a book service related to the target book of a service provided by the device 10 (for example, a paid service).

[0048] In this case, if the device 10 determines that no purchase-related history exists, it can provide the user with a payment guidance page on the screen (user terminal screen) to guide the user to purchase or rent the target book (physical book). Here, the payment guidance page may include default sales price information, which is information about the amount the user must pay if they wish to purchase the target book, and default usage fee information (or rental fee information), which is information about the amount the user must pay if they wish to rent the target book. As a result, the user can purchase or rent the target book (physical book) by paying (settling) the amount (payment amount) for the default sales price information or default usage fee information provided by the device 10 on the payment guidance page.

[0049] For example, if user 31 pays the amount specified in the default usage fee information, they can borrow the target book provided at the designated shopping mall. In this case, the target book can only be borrowed and used for the default usage period corresponding to the default usage fee information. Here, the default usage fee information (or rental fee information) may be referred to by other terms, such as information on a predetermined fixed amount for purchasing the rental-related usage rights (rights of use) of the target book.

[0050] The user terminal 30 possessed by user 31 may include, but is not limited to, all types of wireless communication devices, such as PCS (Personal Communication System), GSM (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (WCode Division Multiple Access), Wibro (Wireless Broadband Internet) terminals, smartphones, smartpads, tablet PCs, notebook computers, wearable devices, and desktop PCs.

[0051] For example, the device 10 can transmit and receive data in conjunction with a user terminal 30 via a network 20. The network 20 may include, but is not limited to, a variety of wired and wireless networks, such as a 3GPP (3rd Generation Partnership Project) network, an LTE (Long Term Evolution) network, a WiMAX (World Interoperability for Microwave Access) network, the Internet, a LAN (Local Area Network), a Wireless LAN (Wireless Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), a Bluetooth (Bluetooth) network, an NFC (Near Field Communication) network, a satellite broadcasting network, an analog broadcasting network, or a DMB (Digital Multimedia Broadcasting) network.

[0052] The device 10 may be a device or server that provides web pages, app pages, programs, or applications related to the provision of book image-based book services. Such programs or applications related to the provision of book image-based book services provided by the device 10 may, for convenience of explanation, be referred to as the program or app below. User 31 can access and use the book image-based book services through the program or app provided by the device 10. Furthermore, user 31 can use the service without installing the program or app, or after installing it, or after installing the program or app, or without registering (or logging in). In the present invention, it is preferable that user 31 installs the app or program and registers (or logs in) before or after installation to use the service, but it is not limited to this, and it is also possible to use the service without installation or registration (or login).

[0053] For example, the device 10 may be a device that can be embodied in the form of a program or application (app) installed on the user terminal 30. In other words, the book image-based book service provision method provided via the device 10 can be embodied in the form of a program or application and provided to the user 31 via the user terminal 30. When the device 10 is embodied in the form of a program or application installed on the user terminal 30, for example, the device 10 shown in Figure 1 may be contained within the user terminal 30.

[0054] However, this is not the only possible configuration. As another example, the device 10 may be configured as a server capable of sending and receiving data via the network 20 to the user terminal 30, as shown in Figure 2. The device 10 configured as a server can control the operation (for example, screen display) of the user terminal 30 connected to the application or program provided by the device 10.

[0055] Furthermore, the device 10 can provide a book image-based book service provision platform (the Platform) through the provision of this application or program.

[0056] In the following, for the sake of clarity, the present invention will be explained using, as an example, Figure 1, as the central point of reference, in which the device 10 is contained within the user terminal 30. However, this is merely an example to aid in understanding the present invention and is not limited to this. As mentioned above, the device 10 can also be implemented in the form of a server. Therefore, the following description of the device 10 can be applied to the case where the device 10 is implemented in the form of a server, either identically or in equivalent terms. The device 10 will now be described in more detail.

[0057] When the device 10 obtains a book image from a user, it determines whether the user is a learning service user or not. If the user is a learning service user, it can determine (confirm) whether there is a purchase history in which the user has purchased or rented the target book corresponding to the book image at a previously designated shopping mall. In this case, depending on whether or not a purchase history exists, the device 10 can provide (play) a book service related to the target book (i.e., a paid digital content provision service related to the target book) on the screen (user terminal screen) to allow the user to use it. On the other hand, if no purchase history exists, it can provide a payment guidance page on the screen to allow the user to purchase or rent the target book (physical book) (i.e., guide the user to make a payment to purchase or rent the physical book of the target book).

[0058] When providing this service, the device 10 and system 100 operate an online or offline shopping mall (i.e., a designated shopping mall) where physical books are purchased or rented, and allow customers who have purchased or rented physical books (genuine books) at the designated shopping mall to recognize (scan, photograph) images of the book's cover and pages (i.e., the pages that make up the book) via the camera of a terminal (user terminal) such as a tablet or smart device. In this process, the device 10 and system 100 distinguish and recognize only books purchased or rented at the designated shopping mall (i.e., the company's own shopping mall and partner shopping malls). At this time, only if the book corresponding to the image (book image) recognized by the user's camera is a book offered at the designated shopping mall (i.e., a designated book) and the user is a user of the learning service, the device 10 and system 100 distinguish and retrieve the digital content of the book, which is provided for a fee, and provide it to the user, making it available to the user. In this case, if the device 10 determines that the user is a learning service user and has a purchase history, it can, for example, extract (recall) the digital content related to the specified book that corresponds to the target book (i.e., the same specified book that is the same book as the target book) from among the multiple digital content related to specified books already stored in the database unit 15, and provide the extracted digital content related to the specified book to the user as a book service related to the target book (in particular, digital content related to the target book).

[0059] When the device 10 provides a user with book services related to a target book (i.e., digital content related to the target book), it can prevent the user from receiving book services related to the target book unless the user performs an authentication process in which the camera recognizes the cover of the designated target book or an image of a page inside the target book. In other words, the book services related to the target book provided to the user by the device 10 (which may be at least one of the designated book-related digital contents among multiple designated book-specific designated book-related digital contents in the database unit 15) may be paid services, and may be configured so that the digital content is not accessed or played (i.e., not provided to the user) unless the user performs authentication via the cover and / or image of the designated target book.

[0060] The device 10 can retrieve and provide the user with digital content related to the book, which is provided for a fee, on this platform (particularly within the database unit 15) and play it on the screen (user terminal) only if the user is determined to be a learning service user and authenticated to have a purchase history in which the user has purchased or rented the target book at a previously designated shopping mall. In this way, the device 10 can be configured so that authentication regarding the ownership of the book (designated book) is performed only by executing an authentication process in which the camera of the user terminal recognizes the cover or a part of the pages of the book after the user has actually purchased or rented the book at a previously designated shopping mall. As a result, it is possible to promote the sale of physical books (physical books corresponding to the designated book) and make it possible to sell the digital content of the physical book (designated book) to the user by providing a paid book service, without causing a decline in sales of physical books. In the present invention, as an example, the administrator who manages the viewed device 10 may be, as an example, an administrator who produces and / or distributes the book (designated book).

[0061] The administrator of this device 10 may be a user who manages whether physical books can be sold or rented at designated shopping malls (i.e., the company's own shopping mall and partner shopping malls). Alternatively, the administrator may be a user who operates a content platform using this device 10 that provides digital content related to physical books (designated books) for a fee. This device 10 can provide digital content related to physical books (designated books) to various digital devices (terminals) such as tablet PCs and smartphones, making it available to users. In this invention, the user terminal 30 may be referred to by other terms, such as a digital terminal, for example. Specifically, referring to Figures 1 to 3, the device 10 may include an acquisition unit 11, a determination unit 12, a provision unit 13, a control unit 14, and a database unit 15.

[0062] The acquisition unit 11 can acquire book images from the user 31. In this case, the book images acquired by the acquisition unit 11 may be book images of books (designated books) provided (provided through sale or rental) at a previously designated shopping mall, or they may be book images of books not provided at a previously designated shopping mall.

[0063] User 31 can recognize (photograph, scan) a specific book (a specific physical book) with the camera of the user terminal 30, and thereby the acquisition unit 11 can acquire a book image generated by User 31 recognizing the specific book with the user terminal 30 from the user terminal 30. In this case, the book corresponding to the book image acquired by the acquisition unit 11 (i.e., the specific book recognized by the user with the camera) may be referred to as the target book in this invention.

[0064] When the shooting mode is detected, the acquisition unit 11 can acquire a book image of the target book within the displayed image by analyzing the displayed image (image analysis). The book image acquired by the acquisition unit 11 may mean an image (an image relating to the target book) acquired by the user 31 recognizing (scanning, photographing) at least a portion of the area of ​​the target book with the camera of the user terminal 30. In particular, the book image acquired by the acquisition unit 11 may mean an image (an image related to the target book) acquired by recognizing at least a portion of the cover of the target book or at least a portion of the pages within the target book that constitute the target book. Here, the cover may include the front, back, and side covers of the target book. The target book may mean a physical book as described above.

[0065] The target book (i.e., the physical book) that a user uses their device's camera to recognize (photograph, scan) is a book that the user has already purchased or rented (completed) from a previously designated shopping mall, or a book that the user will not purchase or rent from a previously designated shopping mall.

[0066] User 31 can put their user terminal 30 into shooting mode (i.e., activate the camera) by turning on the camera on their user terminal 30. Subsequently, User 31 can recognize (scan and photograph) the target book with the user terminal 30 in shooting mode (i.e., the user terminal with the camera turned on) so that the target book appears on the screen of the user terminal 30 (is exposed, illuminated).

[0067] As shown in Figure 3(a), when the acquisition unit 11 detects that the user 31 has recognized (scanned, photographed) a target book (physical book) with the user terminal 30 in shooting mode, it can perform real-time image analysis on the displayed image (user terminal screen) to determine whether or not the displayed image contains an image of the target book. At this time, if the acquisition unit 11 determines that the displayed image contains an image of the target book as shown in Figure 3(c), it can acquire the book image by extracting the book image of the target book from the displayed image. Here, when performing image analysis, various image analysis techniques that are already known or will be developed in the future (for example, object recognition techniques) can be applied.

[0068] Once the acquisition unit 11 has acquired the book image of the target book, the determination unit 12 can determine whether the user is a learning service user who uses a previously designated learning service, and whether there is a purchase history of the user for the target book corresponding to the book image in the previously designated shopping mall. In particular, if the determination unit 12 determines that the user is a previously designated learning service user, it can then determine whether there is a purchase history.

[0069] Here, the previously specified learning service may mean a monthly subscription service (this service) provided free of charge or for a fee by this device 10. Therefore, the determination unit 12 can determine that a user who uses the monthly subscription service provided free of charge or for a fee by this device 10 is a learning service user.

[0070] In this case, since the monthly subscription service (this service) is provided to users who have completed member registration or logged in to the device 10, the determination unit 12 recognizes that the user is a registered member (user) of the device 10 if the user is logged in to the device 10, and thereby determines that the user is a learning service user. If the user is not logged in to the device 10, the determination unit 12 can also guide the user to use this service after logging in by providing a login guidance page on the screen of the user terminal 30 that allows the user to log in after logging in or registering as a member.

[0071] Here, the previously specified shopping mall may include the company's own shopping mall (its own dedicated online and offline shopping mall) and affiliated partner shopping malls (affiliated online and offline shopping malls) operated by the device 10 or the administrator managing the device 10, as described above.

[0072] A previously designated shopping mall may be a shopping mall that provides a service of selling or renting multiple books. In this case, the multiple books provided (sold or rented) by the previously designated shopping mall may be referred to as multiple designated books, as mentioned above.

[0073] The database unit 15 may have book information (i.e., multiple book information) for multiple books (multiple designated books) provided (i.e., provided through sale or rental) at a previously designated shopping mall pre-stored (registered) by the administrator. The book information is information about a book (designated book), and may include, for example, a photograph of the book related to the designated book, and digital content related to the designated book that has been generated (produced) in connection with the designated book. In other words, the database unit 15 may store the photograph of the book and the digital content related to the designated book in conjunction with each other as book information for the designated book. To put it another way, the database unit 15 may include book information for multiple designated books, and the book information for multiple designated books may include photographs of the book for multiple designated books (in particular, at least one photograph of the book for each of the multiple designated books) and digital content related to the designated book for each of the multiple designated books.

[0074] Furthermore, the book information may also include, for example, at least one of the following: the book's title, publisher information, sales price information, royalty information, and book description information (for example, table of contents information, a brief description, etc.).

[0075] Here, "book image" may mean at least one book image (i.e., a designated book image) related to the designated book, generated by photographing at least a portion of the area of ​​the cover (the entire area) of the designated book, and at least a portion of the area of ​​the pages within the designated book that constitute the designated book. Furthermore, "designated book-related digital content" is additional service-related content provided for a fee in connection with the designated book, and may include at least one of the designated book-related video content, audio content, and activity content.

[0076] The multiple book information, which is the book information of multiple designated books already stored in the database unit 15, may be information stored by uploading it, for example, by an administrator who manages the device 10. Here, the administrator may be, for example, one of the following users: (i) a user belonging to a publisher who supplies, sells, or publishes books (designated books) (publisher-affiliated user), (ii) a user who does not belong to a publisher and directly supplies, sells, or publishes books (designated books) (for example, an individual user), and (iii) a user who is supplied with books by a publisher and mediates (sells, provides) so that users (customers) can purchase or rent those books (designated books) (intermediary). In addition, the administrator may be a user associated with the sale or rental of designated books at a previously designated shopping mall when the designated books are to be sold or rented at that previously designated shopping mall.

[0077] As an example, the administrator can upload book information about a designated book to this device 10 using their own device, and the uploaded book information can be stored (registered) in the database unit 15.

[0078] Furthermore, the multiple book information stored in the database unit 15 may be information about books of multiple genres (designated books). In other words, the database unit 15 may store book information for each of the multiple genres of designated books. Here, the multiple genres (i.e., types of genres) of designated books may include, but are not limited to, educational books, poetry, children's stories, short stories, essays, self-help books, etc., and a wide variety of genres of books may be considered.

[0079] Furthermore, after determining that the user is a learning service user, the determination unit 12 can determine whether or not there is a purchase history of the user related to the target book in the previously designated shopping mall. In this case, the purchase history refers to the user's purchase or rental history in the previously designated shopping mall in relation to the target book recognized by the user terminal 30, and may be a history of the user purchasing or renting the target book (i.e., the target book corresponding to the book image acquired by the acquisition unit 11) in the previously designated shopping mall. In other words, the purchase history may be a book purchase history in which the user purchased the target book in the previously designated shopping mall, or a billing history in which the user was charged for renting the target book in the previously designated shopping mall.

[0080] In this case, the determination unit 12 may, for example, use book information (i.e., multiple book information) already stored in the database unit 15 to determine whether or not a purchase-related history exists, and prioritize determining (identifying) whether or not the target book corresponding to the book image acquired by the acquisition unit 11 is a designated book offered at a previously designated shopping mall (i.e., whether or not the target book is a designated book). For example, the determination unit 12 may determine whether or not a purchase-related history exists if the target book is a designated book, and if the target book is not a designated book, for example, without needing to determine whether or not a purchase-related history exists, control the system so that a notification message is provided to the user terminal 30 indicating that no service is offered or that the book is not a book for which book services are provided (i.e., a book subject to book services).

[0081] As a specific example, in order to determine whether the target book is a designated book, once the acquisition unit 11 has acquired the book image of the target book, the determination unit 12 can then analyze, through image comparison analysis, whether there is a book image among the multiple designated book images that matches the book image of the target book, based on the book information for multiple designated books already stored in the database unit 15, particularly the book images for multiple designated books (at least one book image for each of the multiple designated books). In this case, if the analysis results in the existence of a book image that matches the book image of the target book (i.e., it exists in the database unit 15), then the determination unit 12 can determine that the target book is a designated book (i.e., the target book is a designated book that is offered at a previously designated shopping mall).

[0082] If the judgment unit 12 analyzes that no book image matching the book image of the target book exists in the database unit 15, it can then determine that the target book is not a designated book (i.e., the target book is not a designated book that is offered at a previously designated shopping mall).

[0083] For example, each of the multiple designated books already stored in the database section 15 may be a single book provided (sold or leased) as an individual book, or a set of two or more books provided (sold or leased) as a bundle. In other words, a set of books refers to a collection of various independent books gathered together in a sales unit, and may be referred to by other terms such as a book set.

[0084] As an example, the determination unit 12 compares the similarity between each of the multiple book images for each designated book already stored in the database unit 15 and the book image of the target book acquired by the acquisition unit 11. Based on the results of the similarity comparison, if there is at least one book image among the multiple book images for each designated book that has a similarity of 90% or more to the book image acquired by the acquisition unit 11, the determination unit 12 can determine that the target book corresponding to the acquired book image is the designated book.

[0085] According to this, the determination unit 12 can determine whether the target book is a designated book that is sold or rented at a previously designated shopping mall (i.e., whether the target book is a designated book) by comparing the similarity (degree of match) between the book images of multiple designated books already stored in the database unit 15 and the book images acquired by the acquisition unit 11. In this case, when comparing the similarity between the two images (i.e., the book images and the book images acquired by the acquisition unit 11), various similarity analysis techniques that are already publicly known or will be developed in the future (in particular, similarity analysis techniques that target images) can be applied.

[0086] The provisioning unit 13 can provide book services related to the target book if the determination unit 12 determines that a purchase-related history exists. In particular, the provisioning unit 13 can provide book services related to the target book to the user only if the determination unit 12 determines that the user is a learning service user and that, because the target book is a designated book, a purchase-related history exists in which the user purchased or borrowed the target book at a previously designated shopping mall.

[0087] In other words, when the acquisition unit 11 acquires a book image by having the user recognize (scan or photograph) the target book with the user terminal 30, the provision unit 13 determines whether the user who recognized the target book is a learning service user who uses the previously designated learning service (i.e., whether the user is a learning service user who has already registered with this device 10 and is using this service, which is a monthly subscription service). If it is determined that the user is a learning service user, the provision unit 13 then determines whether there is a purchase-related history in which the user has purchased or borrowed the target book at the previously designated shopping mall. Only if it is determined that a purchase-related history exists can the provision unit 13 provide the user with book services related to the target book.

[0088] In this case, the monthly subscription service may be a paid service or a free service. Furthermore, in this invention, the learning service user is a user who uses the service, and may be referred to by other terms such as subscriber.

[0089] As described above, the book service provided by the provision unit 13 may mean a service that provides access to pre-generated (produced) digital content related to the target book for a fee. Furthermore, the digital content related to the target book may include content relating to at least one of the following: video, audio, and activities (reading activities) related to the target book.

[0090] In other words, the provisioning unit 13 can provide the user 31 with digital content related to the target book (i.e., digital content related to the target book that includes at least one of the following: video content, audio content, and activity content related to the target book) as a book service (additional service, paid service) related to the target book, but only if the user is a learning service user and has a purchase history.

[0091] In this case, the digital content related to the target book that the provision unit 13 provides to the user (or provides on the user terminal) and corresponds to the book service related to the target book may mean the digital content related to the target book of the specified book that corresponds to the target book (i.e., the same specified book that is the same book as the target book) from among the multiple digital content related to the specified book for each specified book already stored in the database unit 15.

[0092] Here, video content refers to pre-produced video content (for example, educational video content) related to the target book (or the corresponding designated book), and may be content produced to include only video (images), or content produced to include both video and audio (sound sources, audio). Audio content refers to pre-produced audio content (for example, educational audio content) related to the target book (or the corresponding designated book), and may be content produced to include only audio (sound sources, audio) without video (images). Activity content refers to pre-produced reading activity content (for example, reading activity guidance content) created to guide the performance (implementation) of reading activities in relation to the target book (or the corresponding designated book), and may, for example, be content produced to include at least one of video (images) and audio (sound sources, audio).

[0093] According to this, the book service related to the target book provided by the provisioning unit 13 (i.e., the digital content related to the target book provided by the provisioning unit 13 for a fee in connection with the book service) may be a book service provided only to users who are learning service users and who have actually purchased or rented a book (a physical book that is a designated book) provided (sold or rented) at a previously designated shopping mall, and who have subsequently performed (completed) an authentication process in which the camera of the user terminal 30 recognizes (scans, photographs) at least a portion of the cover or pages of the book purchased or rented at the previously designated shopping mall. In other words, the book service provided by the provisioning unit 13 may be a book service provided only to users who have a purchase history related to the user at a previously designated shopping mall, who are learning service users using this service, and who have completed an authentication process (camera recognition infrastructure authentication process) in which the camera of the user terminal 30 recognizes at least a portion of the cover or pages of the book purchased or rented at the previously designated shopping mall.

[0094] The provisioning unit 13 can prevent a user from receiving book services related to a target book if the user falls into at least one of the following cases: (i) there is no purchase history for the user; (ii) even if there is a purchase history for the user (i.e., even if the user has purchased or rented the target book at a previously designated shopping mall), the authentication process of recognizing the purchased or rented target book (i.e., the designated book) with the camera of the user terminal 30 is not performed, or the user is not a learning service user; or (iii) the acquisition unit determines that the target book corresponding to the book image acquired by the acquisition unit is not the designated book (i.e., the target book recognized by the user with the camera is not a book offered at a previously designated shopping mall).

[0095] As an example, when the aforementioned determination unit 12 determines whether or not a purchase-related history exists, it collects the user's shopping mall usage history data from a previously designated shopping mall based on the user's login information and analyzes this data to determine whether or not the user's purchase-related history (i.e., history of purchasing or borrowing the target book) exists within the collected user's shopping mall usage history data. Subsequently, if the determination unit 12 determines that a user's purchase-related history exists in relation to the target book, the provision unit 13 recognizes (determines) this as meaning that a user's purchase-related history related to the target book already existed in the past at the time the book image was acquired by the acquisition unit 11. Subsequently, it can provide (play) at least one of the video content, audio content, and activity content related to the target book as a book service related to the target book on the screen (user terminal screen).

[0096] On the other hand, if the determination unit 12 determines that there is no user purchase history related to the target book, the provision unit 13 recognizes (determines) that there was no user purchase history related to the target book in the past at the time the book image was acquired by the acquisition unit 11, and thereafter can provide the aforementioned payment guidance page to the screen (user terminal screen) so that the user 31 can purchase or rent the target book.

[0097] If the service provider 13 determines that the user is a learning service user and has a purchase history, it then provides the book service to the user by playing the book service on the user's terminal. If it determines that there is no purchase history, it provides a payment guidance page on the user's terminal screen, allowing the user to use the book service after making a payment on the payment guidance page.

[0098] According to this, when the service provider 13 provides a book service related to the target book to a user, it can provide the user with a book service related to the target book (i.e., a book service that allows the user to use digital content related to the target book for a fee) only if (i) the user who recognized (scanned or photographed) the target book is a user (member) who has registered as a member with the device 10 (in particular, the program or the application), through a determination of whether or not the user is a learning service user, and (ii) the user has a history of purchasing or lending designated books (in particular, genuine books, genuine designated books) that are sold only in the previously designated shopping mall (i.e., the user is confirmed to be a user who has purchased genuine books), through a determination of whether or not there is a purchase-related history.

[0099] The device 10, by providing book services in the manner described above, can be configured and restricted so that only users (subscribers) who have purchased the genuine product can play specific content (digital content) provided by the device 10. As a result, the period of ownership of the book by subscribers can be extended, thereby contributing to the growth of the publishing industry and improving the protection of copyright holders' rights. Specifically, the device 10 determines that a particular user is a registered member of the device 10, a user receiving the service, and a user who has purchased or rented a designated book (a physical, genuine book) provided at a designated shopping mall operated directly or through a partnership with the administrator of the device 10. When the user recognizes the designated book (a physical, genuine book) with the camera of the user terminal 30, the device 10 can respond to the recognition by providing book services (digital content related to the target book) to the user terminal 30.

[0100] This device 10 can provide book services related to designated books (target books) to users only if the user has purchased a genuine designated book at a pre-designated shopping mall. By providing (implementing) a business model that combines digital devices and paper books, it is possible to build a new publishing ecosystem. In other words, this device 10 can provide a novel publishing ecosystem environment in which the technology of providing digital content online via terminals (digital devices) such as PCs and smartphones and the technology of providing physical books in paper form offline are organically combined.

[0101] The control unit 14 can control the operation of each component within the device 10. Furthermore, the control unit 14 can control the operation of the user terminal 30 (for example, screen display operation).

[0102] As described above, the database unit 15 can store (register) book information for multiple specified books (i.e., multiple book information), and can store various types of information (data) considered in this device 10.

[0103] Figure 2 shows a block diagram of the device 10 when it is implemented in the form of a server. Figure 2 illustrates, as an example, the device 10 interacting with the user terminal 30 via the network 20 within the system 100, but it is not limited to this. Although not shown, the system 100 may also include an administrator terminal owned by the administrator. In such a case, the device 10 can communicate with the user terminal 30 and the administrator terminal via the network 20 to send and receive data.

[0104] Furthermore, although Figure 2 illustrates a single user terminal 30, this is merely for illustrative purposes, and the system 100 may include multiple user terminals owned by multiple users. In this case, user terminal 30 may be any one of the multiple user terminals, and even if some details are omitted below, the explanation given for user terminal 30 (or user) can be applied identically to the explanations for each of the multiple user terminals (or multiple users), and vice versa. The device 10 can control the operation of each terminal connected to the device 10 via the network 20 (for example, screen display operation).

[0105] Figure 3 shows the process by which the acquisition unit 11 acquires a book image of the target book when user 31 recognizes (scans and photographs) the target book using the camera of the user terminal 30.

[0106] As mentioned above, after the user 31 turns on (activates) the camera of the user terminal 30 and puts it into shooting mode, the user 31 can then use the camera to recognize (scan and photograph) the target book (a specific physical book) so that an image of the book (book image) of the target book appears on the screen. In other words, in order to acquire the book image, the user terminal 30 can start (or perform) recognition of the book image of the target book through the camera stream (real-time stream).

[0107] In this case, the acquisition unit 11 can, for example, display a shooting guidance message in a certain area on the screen (the user terminal screen) when it detects that the user is in shooting mode. Here, an example of the shooting guidance message information is, as shown in Figure 3(a), "Hey friend, let me see the whole cover of your book."

[0108] Furthermore, when the acquisition unit 11 detects that it is in shooting mode, it can display a guide message information for improving the recognition rate in a certain area of ​​the screen in order to ensure that the book image of the target book is recognized well (i.e., to improve the recognition rate of the book image). Here, an example of the shooting guidance message information is, as shown in Figure 3(b), "Hey friend, fix the book in the camera so that it is clearly visible!". As an example, when the acquisition unit 11 is in shooting mode, if it detects that at least a portion of the cover area (the entire area of ​​the cover) of the target book has been recognized (i.e., if it detects that at least a portion of the area has been displayed (exposed) on the screen), it can display (provide) the guide message information for improving the recognition rate in a certain area of ​​the screen.

[0109] Guide message information for improving recognition accuracy may or may not be provided on the screen as needed. In other words, the provision of guide message information for improving recognition accuracy may be optional, and whether or not to provide (display) the guide message information for improving recognition accuracy can be decided by the administrator managing this device 10.

[0110] Furthermore, the names and examples of the aforementioned shooting guidance message information and recognition rate improvement guide message information are merely examples to aid in understanding the present invention, and are not limited to them. These can be set and changed in various ways by the administrator managing the device 10.

[0111] When user 31 recognizes (scans and photographs) a target book with user terminal 30 in shooting mode, the acquisition unit 11, when in shooting mode, performs real-time image recognition and real-time analysis (image analysis) on the displayed image on the screen to determine (in real time) whether or not the book image of the target book is included in the displayed image. If the acquisition unit 11 analyzes through real-time image analysis that the book image of the target book is included in the displayed image, it can acquire the book image by extracting the book image of the target book included in the displayed image, as shown in Figure 3(c).

[0112] If the acquisition unit 11 determines (identifies, detects) that the target book image is included, the determination unit 12 then determines, for example, whether there is a book image among the multiple book information already stored in the database unit 15 (particularly among the book images for multiple designated books) that has a similarity to the book image acquired by the acquisition unit 11 that is 90% or higher. If it is determined that there is a book image with a similarity to the predetermined value or higher, the determination unit 12 can determine that the target book is a designated book offered at a previously designated shopping mall (corresponds to a designated book). In other words, the determination unit 12 can determine whether the target book is a designated book by determining, for example, whether there is a designated book among the multiple designated books already stored in the database unit 15 that has a book image with a high similarity (match) to the book image of the target book identified through real-time image recognition or analysis.

[0113] The database unit 15 may store book images linked together for each of the multiple designated books. That is, the database unit 15 may store book images obtained in advance by photographing at least a portion of the cover or pages of each designated book (book) that is the target of image recognition, linked together with the digital content related to the corresponding designated book, as book information. Here, the book images of each of the multiple designated books stored in the database unit 15 may, for example, be pre-processed book images. The database unit 15 may also be referred to as a target set, which may mean a set created by pre-processing the images (book images) of each designated book that are the target of recognition in advance so that they can become recognition results.

[0114] As an example, if the determination unit 12 determines that the target book is a designated book, it can determine, based on the user's login information, whether or not there is a user purchase history (i.e., book purchase history or billing history) related to the target book.

[0115] For example, the determination unit 12 can determine whether or not a user's purchase history exists by collecting and analyzing the user's shopping mall usage history data in a previously designated shopping mall, based on the login information of the logged-in user. In this case, for example, when the determination unit 12 analyzes the collected user's shopping mall usage history data, it can perform both a first determination process, for example (i) determining whether or not a user's purchase history related to the target book and the same individual book exists in the user's shopping mall usage history data, and a second determination process, if the target book is a set of books, determining whether or not a user's purchase history related to a set of books configured to include the target book (i.e., a set of books related to the target book) exists in the user's shopping mall usage history data.

[0116] In this case, if the determination unit 12 determines (detects) that a user's purchase history exists in at least one of the first and second determination processes, it can ultimately determine that a user's purchase history related to the target book exists. If the determination unit 12 determines in both the first and second determination processes that no user's purchase history exists, it can ultimately determine that a user's purchase history related to the target book does not exist.

[0117] Subsequently, if the determination unit 12 determines, for example, that a user's purchase history exists, the provision unit 13 may provide (display) an additional service related to the designated book, the target book, on the screen as a book service related to the target book. Here, the book service (additional service) related to the target book may include, as mentioned above, target book-related digital content (designated book-related digital content) that includes at least one of the previously produced (generated) target book (or corresponding designated book)-related video content, audio content, and activity (reading activity) content in relation to the target book. In this invention, as an example, three types of book services (i.e., video, audio, and activity) have been given as examples of the types of book services provided in relation to the target book, but this is merely one example to help understand the present invention and is not limited thereto. The number and types of book service types applied in this device 10 can be set and changed in various ways by the administrator managing this device 10.

[0118] If the determination unit 12 determines that no purchase history exists for the user, the provision unit 13 may, as described above, provide the user with a payment guidance page on the screen (user terminal screen) that, for example, guides the user to make a payment for purchasing the target book or for lending (renting) the target book.

[0119] In this case, the service provider 13 may or may not provide a payment guidance page as needed. That is, providing a payment guidance page may be optional, and whether or not to provide a payment guidance page can be decided by the administrator managing the device 10.

[0120] As described above, the device 10 can provide a book service (book-related additional service) provision linkage technology based on image recognition of the target book. In addition, the device 10 can also provide the following functions.

[0121] For example, if the service provider 13 determines that there is no purchase history for the user and provides a payment guidance page on the user's terminal, and then detects that the user has paid (made a payment) for the predetermined sales price information or predetermined usage fee information on the payment guidance page, it may then provide the target book to the user as a book that the user has completed purchasing, or provide the target book to the user as a book that the user has completed borrowing.

[0122] In other words, if the service provider 13 detects that the user has paid (made a payment for) the predetermined sales price information or predetermined usage fee information on the payment guidance page, it can then deliver the target book to the address of the already registered user 31. At this time, if the user 31 receives the target book and then has the user terminal 30's camera recognize (scan or photograph) an image of the delivered target book (i.e., the target book purchased or lent by the user), the service provider 13 can respond by providing the user with a paid service related to the target book.

[0123] For example, sales price information is information about the sales price of the book that user 31 must pay to purchase the book, and may be set as, for example, 9,800 won, 10,500 won, etc. Also, for example, usage fee information is information about the usage fee (rental fee) that user 31 must pay to use the loan of the book for a predetermined usage period, and may be set as, for example, a first amount per day (or per 24 hours), a second amount per week, a third amount per month, a fourth amount per year, etc.

[0124] In this case, after providing a payment guidance page to the screen, if the provisioning unit 13 detects a payment execution signal indicating that the user 31 intends to pay (settle) a payment amount which is the amount corresponding to the predetermined sales price information or predetermined usage fee information on the payment guidance page, the user terminal 30 may respond to the detection by performing a settlement on the payment amount (i.e., the amount corresponding to the predetermined sales price information or predetermined usage fee information) through a predefined settlement processing process.

[0125] Here, the predefined payment processing process may mean a process in which, when it is detected that user 31 has pre-stored multiple credit cards in the user terminal 30 in the user's name (the user's own name), the system retrieves the current month's performance record data for each of the multiple credit cards in the user's name that have been pre-stored by user 31, based on the detection point at which the payment execution signal is detected, and, considering the retrieved current month's performance record data, selects one of the multiple credit cards in the user's name that has the smallest unrealized performance amount value at the detection point as the credit card to be processed for payment, and then processes the payment for the payment amount using the selected credit card to be processed for payment.

[0126] Here, the current month performance record data may refer to data related to the current month's performance in relation to the user's credit card. Such current month performance record data may, for example, include performance achievement threshold information, which is the standard for achieving performance set by the credit card company of the user's credit card, and performance fulfillment amount information up to the detection point, recorded by the user using the credit card in the current month up to the point corresponding to the detection point (present). In this case, the unfulfilled performance amount for a specific user's credit card may be information derived by subtracting the performance fulfillment amount information from the performance achievement threshold information for that specific user's credit card.

[0127] As an example, suppose there are three credit cards pre-saved by user 31 under multiple user names. In this case, the service provider 13 derives and confirms the outstanding transaction amounts for each of the three credit cards based on the current month's transaction record data obtained for each of the three credit cards. The result confirms that the outstanding transaction amount for the first credit card is "-113,000 won", the outstanding transaction amount for the second credit card is "-28,000 won", and the outstanding transaction amount for the third credit card is "+40,000 won". In such a case, when the pre-defined settlement process is in progress, the service provider 13 can select the second credit card as the credit card to be settled, as it is the credit card among the three user names (i.e., the first to third credit cards) that has the smallest outstanding transaction amount, and can then perform the settlement process for the payment amount using the selected second credit card. In this case, credit cards with a positive (+) value for the unmet performance amount can be excluded when selecting credit cards for payment processing, as these credit cards have already met their performance requirements.

[0128] This device 10 allows users to have payments made using a specific credit card from among many credit cards in their name, prioritizing the credit card with the smallest outstanding balance, thereby providing an environment in which users can receive more card benefits.

[0129] Furthermore, the control unit 14 can, for example, provide a book search menu in one area of ​​the screen, and when user 31 clicks on the book search menu, it can display a book search page containing multiple book information stored in the database unit 15 on the screen (user terminal screen). User 31 can perform a book search by entering keywords for the book they wish to search for (for example, keywords related to genre, book title, publisher, age, etc.) on the book search page.

[0130] When a user 31 enters keywords for a book search on the book search page, the control unit 14 can extract at least one book from the multiple book information already registered in the database unit 15 that matches the keywords entered by the user 31, generate a list of these book information, and provide it to the screen. Here, as mentioned above, the database unit 15 may store book information for each of multiple genres of books.

[0131] In this case, after the user 31 is provided with a list of keyword-matching book information from the control unit 14, the user can purchase the book by, for example, comparing the keyword-matching book information in the provided list with each other, selecting at least one of them, and making a payment. In this case, the control unit 14 can provide a comparison save icon 50, as shown in Figure 4, in an area of ​​the screen (user terminal screen) to make it easier for the user 31 to compare book information, which can be more easily understood by referring to Figure 4.

[0132] Figure 4 is a diagram illustrating a comparison save icon 50 provided by the control unit 14 of a book image-based book service provider 10 according to one embodiment of the present invention.

[0133] Referring to Figure 4, when a user 31 enters keywords related to a book they wish to search for on the book search page, the control unit 14 extracts multiple keyword-matching book information entries 41, 42, 43, ... from among the multiple book information entries already registered in the database unit 15 that match the keywords entered by the user 31, and can display a list containing the extracted multiple keyword-matching book information entries 41, 42, 43, ... on the screen.

[0134] User 31 can compare the information in the list, ponder what to buy, and then purchase the one keyword-matched book information that they like best before making a payment. However, when making the final selection of the specific book information that they like best, they may struggle to decide which of the various keyword-matched book information (interest keyword-matched book information) they are interested in should be selected.

[0135] In this case, for the convenience of comparing various keyword-matching book information of interest, the control unit 14 can provide a comparison save icon 50 in a certain area on the book search page.

[0136] When user 31 selects, for example, the first keyword matching book information 41 as their favorite keyword matching book information from among multiple keyword matching book information 41, 42, 43, ..., the control unit 14 can, in the process, find that some of the keyword matching book information 41, 42, 43, ... in the list (for example, the first keyword matching book information, the third keyword matching book information) are to their liking. In this process, the control unit 14 can temporarily save these liked keyword matching book information as interest keyword matching book information using the comparison save icon 50. The user can then view and compare the temporarily saved keyword matching book information (i.e., interest keyword matching book information) with the multiple keyword matching book information 41, 42, 43, ... on a single screen of the user terminal 30, and finally select the keyword matching book information they like best (for example, the first keyword matching book information).

[0137] Specifically, while user 31 is reviewing multiple keyword-matching book information entries 41, 42, 43, ... in the list, if, for example, user 31 wants to temporarily save the first keyword-matching book information entry 41 as a keyword-matching book information entry of interest, user 31 can press the first keyword-matching book information entry 41 for a predetermined period of time (for example, 1.5 seconds). In response, the control unit 14 can temporarily save the first keyword-matching book information entry 41 that user 31 pressed for a predetermined period of time in the first temporary save field area 51 among the multiple available temporary save field areas 51, 52, ... within the comparison save icon 50. Subsequently, if user 31, while reviewing the list, wishes to temporarily save the third keyword matching book information 43 from among the multiple keyword matching book information 41, 42, 43, ... in the list as a keyword matching book information of interest, they can press the third keyword matching book information 43 within a predetermined time frame. In response, the control unit 14 can temporarily save the third keyword matching book information 43 in the second temporary save area 52 within the comparison save icon 50.

[0138] In this case, the comparison save icon 50 can basically be in the basic state shown in Figure 4(a). In this case, if user 31 wants to check the keyword matching book information that has been temporarily saved as keyword matching book information of interest, user 31 can click the extended button 50a within the comparison save icon 50 in the basic state. In response to user 31's click on the extended button 50a, the control unit 14 can display the comparison save icon 50 in the basic state as the comparison save icon 50' in the extended state, as shown in Figure 4(b).

[0139] The extended state comparison save icon 50' allows user 31 to view keyword matching book information that has been temporarily saved as information on keyword matching books of interest. That is, within the extended state comparison save icon 50', the first keyword matching book information 41 may be displayed (exposed) in the first temporary save area 51, and the third keyword matching book information 43 may be displayed (exposed) in the second temporary save area 52, as information on keyword matching books of interest. In this case, through each temporary save area within the extended state comparison save icon 50', a representative photograph of the keyword matching book information of interest may be displayed (exposed) in relation to the temporarily saved information on keyword matching books of interest (i.e., as an example, the first temporary save area 51 may display a representative photograph of the first keyword matching book information 41, and the second temporary save area 52 may display a representative photograph of the third keyword matching book information 43).

[0140] Here, the representative photograph of the keyword-matching book information displayed (exposed) in each temporary save area within the comparison save icon 50 may be set as (i) a thumbnail photograph pre-set by the user who registered the keyword-matching book information in this device 10 (i.e., the uploader who uploaded the keyword-matching book information to this device 10, which may be the administrator who manages this device 10, or one of several users who use this device 10), (ii) if the keyword-matching book information contains multiple images, it may be set as a photograph of one of the multiple images in the keyword-matching book information selected by the user 31, or (iii) as a photograph of an image corresponding to a drag area (rectangular drag area) directly specified by the user 31 so as to include some of the content of the detailed description information of the keyword-matching book information that the user 31 wishes to set as a representative photograph. In the present invention, the representative photograph displayed in each temporary save area within the comparison save icon 50 is more preferably set in case (iii) of the three cases described above, and is more preferably set in case (i) if there is no representative photograph set by the user 31.

[0141] Generally, on traditional product sales websites, users could only check information about products they had registered as interests by navigating to a separate cart page or favorites page. This meant that users could not view their interests on the screen they were currently viewing. Furthermore, while the representative image displayed for saved items in the cart is typically a pre-set image by the uploader, if a user has multiple items of interest saved in their cart, it's difficult to intuitively understand what aspects of the information the user liked and registered as an interest based solely on the representative image. Therefore, to find out why they liked a particular item and registered it, the user had to manually re-examine each of their favorited items, which was inconvenient.

[0142] To resolve these conventional problems, the control unit 14 allows the user 31 to temporarily save some of the keyword-matching book information (for example, the first or third keyword-matching book information) from among the multiple keyword-matching book information 41, 42, 43, ... in the temporary save area of ​​the comparison save icon 50. At this time, the control unit 14 can apply and display a photograph that is not a representative photograph already set for the book information (i.e., a representative photograph pre-set by the uploader who uploaded the book information), but rather a photograph that includes some of the content desired by the user 31, set through the specification of a drag area (direct specification) (i.e., an image corresponding to the drag area directly specified by the user 31 via drag input from the detailed description information of the keyword-matching book information).

[0143] Through this, the device 10, by providing comparison save icons 50, can collect only the images (representative photos) of keyword-matching book information that the user 31 is interested in, making it possible to intuitively check and compare them with each other. Without having to move to another page, the user can check and compare the information that they have temporarily saved as information of interest (i.e., keyword-matching book information of interest) together at a glance on the current screen where the list is displayed (i.e., on the book search page where information on multiple books is displayed).

[0144] Below, we will briefly explain the operation flow of the present invention based on the details described above. Figure 5 is a flowchart illustrating the operation of a book image-based book service provision method according to one embodiment of the present invention.

[0145] The book image-based book service provision method shown in Figure 5 can be performed by the device 10 described above. Therefore, even if the details omitted below are not applicable, the description of the device 10 can be applied equally to the description of the book image-based book service provision method. Referring to Figure 5, in step S11, the acquisition unit can acquire a book image of the target book from the user.

[0146] Furthermore, in step S11, the acquisition unit can acquire the book image within the displayed image by analyzing the displayed image shown on the screen when the shooting mode is detected. The book image may be an image acquired by recognizing the cover of the target book or at least a portion of the pages that make up the target book.

[0147] Next, in step S12, the determination unit can determine whether the user is a learning service user who uses a previously designated learning service, and then determine whether the user has a purchase history related to the target book corresponding to the book image in the previously designated shopping mall.

[0148] Next, in step S13, if the service provider determines that the user is a learning service user and has a purchase history, it can provide book services related to the target book.

[0149] Here, the book service may be a service that provides access to pre-generated digital content related to the target book for a fee. Here, the digital content related to the target book may include content relating to at least one of the following: video, audio, and activities (reading activities) related to the target book.

[0150] In the above description, steps S11 to S13 may be further divided into additional steps or combined into fewer steps according to embodiments of the present invention. Also, some steps may be omitted as needed, and the order between steps may be changed.

[0151] A book image-based book service provision method according to one embodiment of the present invention may be embodied in the form of program commands readable via various computer means and recorded on a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, etc., individually or in combination. The program commands recorded on the medium may be specially designed and configured for the present invention, or may be known and usable by those skilled in the field of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specially configured to store and execute program commands, such as ROM, RAM, and flash memory. Examples of program commands may include not only machine code, such as that produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. Such hardware devices may be configured to operate as one or more software modules to perform the operation of the present invention, and vice versa.

[0152] Furthermore, the aforementioned book image-based book service provision method can also be embodied in the form of a computer program or application executed by a computer stored on a recording medium.

[0153] The foregoing description of the present invention is illustrative, and a person with ordinary skill in the art to which the invention pertains will understand that it can be easily modified in other specific forms without altering the technical idea or essential features of the invention. Therefore, the embodiments described above should be understood to be illustrative and not limiting in all respects. For example, each component described as a single type can be implemented in a distributed manner, and similarly, components described as distributed can be implemented in a combined manner. The scope of the present invention is defined by the claims set forth below, and all modifications or altered forms derived from the meaning and scope of the claims and the concept of equivalents thereof are included within the scope of the present invention.

Claims

1. A book image-based book service provider device, Acquisition unit that retrieves book images from the user; A determination unit that determines, based on the user's login information to the device, whether the user is a learning service user who uses a pre-specified learning service which is a service provided by the device, and whether the user has a purchase history related to the target book corresponding to the book image in the pre-specified shopping mall, based on the login information; and If it is determined that the aforementioned purchase history exists, the provider includes a book service provider that provides digital content related to the aforementioned target book, which is a book offered at the previously designated shopping mall; A book image-based book service provider device characterized by the following features.

2. The unit that makes the determination said, Users who utilize the monthly subscription service provided by the book image-based book service provider are determined to be users of the aforementioned learning service. A book image-based book service provider according to claim 1.

3. The aforementioned purchase-related history is a record of when the user purchased or rented the aforementioned target book at the previously designated shopping mall. A book image-based book service provider according to claim 1.

4. The acquisition unit is, When the shooting mode is detected, the book image within the displayed image is acquired by analyzing the displayed image on the screen. A book image-based book service provider according to claim 1.

5. The aforementioned book image is an image obtained by recognizing at least a portion of the area of ​​the target book. A book image-based book service provider according to claim 1.

6. The aforementioned book service is a service that provides access to pre-generated digital content related to the aforementioned target book for a fee. The aforementioned digital content related to the book includes content relating to at least one of the following: video, audio, and activities related to the book. A book image-based book service provider according to claim 1.

7. A method for providing book services on a book image-based system using a book service provision device according to claim 1, The acquisition stage involves acquiring book images from the user; The determination unit determines whether the user is a learning service user who uses a previously designated learning service, and whether there is a purchase history of the user with respect to the target book corresponding to the book image in the previously designated shopping mall; and, The process includes the step of providing book services related to the target book if the provisioning department determines that the aforementioned purchase history exists; A method for providing book services based on book images, characterized by the features described herein.

Images