Information processing system, information processing method, and program

Abstract

To allow for purchase and sale of feature quantities extracted from data electronically between third parties.SOLUTION: An information processing system includes a receiving unit, an extraction unit, and a purchase information management unit. The receiving unit receives a commodity registration request including data from which feature quantity is to be extracted, from a first client terminal. The extraction unit extracts feature quantity indicating characteristics of a person from the above data. The purchase information management unit executes settlement processing for the feature quantity in accordance with a purchase request for the feature quantity from a second client terminal, and stores purchase information based on the settlement processing in a storage unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] An embodiment of the present invention relates to an information processing system, an information processing method, and a program. [Background technology]

[0002] In recent years, broadcasting stations and other companies that handle large volumes of content have increasingly adopted facial recognition systems that use AI (artificial intelligence).By using AI to automatically match people, companies are able to increase the added value of their content and reduce their workload. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2001-067322 [Patent Document 2] Japanese Patent Application Laid-Open No. 2005-202731 [Patent Document 3] JP 2018-18150 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, conventional techniques have not been able to conduct electronic commerce between third parties using features extracted from data. [Means for solving the problem]

[0005] The information processing system of the embodiment includes an extraction unit, a transaction information management unit, and a first transmission unit. The extraction unit extracts features indicating person characteristics from the feature extraction target data. The transaction information management unit executes transaction processing of the features in response to a transaction request for the features from a first client terminal, and stores transaction information based on the transaction processing in a storage unit. The first transmission unit transmits the features for which the transaction processing has been executed to the first client terminal. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a functional configuration of a feature extraction service according to an embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of a functional configuration of a product management system according to an embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a product information table according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a functional configuration of a user management system according to an embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a user information table according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a functional configuration of a purchase management system according to an embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a purchase information table according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of an information processing method according to an embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of a hardware configuration of an information processing system according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] Hereinafter, embodiments of an information processing system, an information processing method, and a program will be described in detail with reference to the accompanying drawings.

[0008] First, an example of the configuration of an information processing system according to an embodiment will be described.

[0009] [Example of information processing system configuration] FIG. 1 is a diagram illustrating an example of the configuration of an information processing system 1 according to an embodiment. The information processing system 1 according to the embodiment is a system that realizes electronic commerce of features extracted from data such as images. For example, the information processing system 1 according to the embodiment extracts features of a facial image contained in an image and makes the features available for sale. This reduces the effort required for complex rights processing, reduces communication capacity, and reduces the effort required for extracting features, making it easier to conduct electronic commerce between third parties.

[0010] The information processing system 1 of the embodiment includes a feature extraction service 11, a product management system 12, a user management system 13, a purchase management system 14, a Web server device 15, a client terminal 16, and a network 17.

[0011] The feature extraction service 11, the product management system 12, the user management system 13, the purchase management system 14, and the web server device 15 are realized by one or more information processing devices. For example, the feature extraction service 11, the product management system 12, the user management system 13, and the purchase management system 14 may be realized by one information processing device, and the web server device 15 may be realized by another information processing device, resulting in a configuration of two information processing devices.

[0012] The feature extraction service 11 extracts features to be used for prediction and judgment by machine learning such as deep learning from data of feature extraction targets (e.g., images and videos). Features are data that quantitatively represent the characteristics and properties of an analysis target contained in the data of the feature extraction targets. Features include, for example, data that represent the facial features of a person contained in the data of the feature extraction targets. Specifically, features are expressed, for example, by numerical values. In the embodiment, an example will be described in which the feature extraction target is an image.

[0013] The product management system 12 stores product information (see FIG. 4 described later) including the feature amounts extracted by the feature amount extraction service 11.

[0014] The user management system 13 stores information about users who use the client terminals 16 (see FIG. 6, which will be described later).

[0015] When a user purchases a product (feature amount), the purchase management system 14 stores purchase information (see FIG. 8 described later) including a purchase record.

[0016] Web server device 15 accepts requests from feature extraction service 11, product management system 12, user management system 13, purchase management system 14, and client terminal 16. For example, Web server device 15 accepts a product registration request from client terminal 16 via network 17, the product registration request requesting registration of a product in product management system 12.

[0017] The client terminal 16 transmits, for example, a product registration request, a product search request, a product purchase request, etc. to the Web server device 15 via the network 17. The number of client terminals 16 may be any number.

[0018] Network 17 connects Web server device 15 and client terminal 16 so that they can communicate with each other. The communication method of network 17 may be a wired method or a wireless method. Network 17 may also be configured using a combination of a wired method and a wireless method. Specifically, network 17 is an internet line or the like.

[0019] [Example of feature extraction service configuration] 2 is a diagram illustrating an example of the functional configuration of the feature extraction service 11 according to the embodiment. The feature extraction service 11 according to the embodiment includes a receiving unit 111, an extracting unit 112, and a transmitting unit 113. The receiving unit 111 receives data such as an image from the web server device 15. The extracting unit 112 extracts features from the data such as an image. The transmitting unit 113 transmits the features to the product management system 12.

[0020] [Example of functional configuration of product management system] 3 is a diagram showing an example of the functional configuration of product management system 12 according to the embodiment. Product management system 12 according to the embodiment includes a product information DB 121, a receiving unit 122, a product information management unit 123, a search unit 124, and a transmitting unit 125. Product information DB 121 stores a product information table 1211.

[0021] 4 is a diagram showing an example of the product information table 1211 according to the embodiment. The product information table 1211 according to the embodiment includes a product ID, a name, a category, meta information, a feature amount, a license rank, a disclosure flag, a registration date and time, and a registered user ID.

[0022] The product ID is information that identifies the product (feature). The name is the name of the person identified by the feature. The category indicates the occupation of the person identified by the feature. The meta information (accompanying information) is information that indicates matters related to the product (feature). The feature is information extracted from an image or the like by the feature extraction service 11.

[0023] The license rank is information indicating the scope of license for a product. In the embodiment, for example, rank 1 is licensed only for personal use. Rank 2 is licensed for personal use and research and development use. Rank 3 is licensed for personal use, research and development use, and commercial use.

[0024] The publication flag indicates whether the product has already been published (sold) or not (1: published, 0: not published). The registration date and time indicates the date and time when the product was registered in the product information DB 121. The registered user ID is information that identifies the user who registered the product.

[0025] Returning to FIG. 3 , the receiving unit 122 receives features from the feature extraction service 11. The product information management unit 123 stores product information including the features as products in a storage unit (in the embodiment, the product information DB 121). Specifically, the product information management unit 123 adds (registers), modifies, and deletes product information from the product information DB 121. The searching unit 124 searches for product information in the product information DB 121 according to search conditions. The search conditions are specified by a product search request from the client terminal 16, for example. The transmitting unit 125 transmits data included in the product information DB 121 in response to a request from the Web server device 15 or the like.

[0026] Note that the product information table 1211 may store multiple types of feature amounts. In this case, the extraction unit 112 of the feature extraction service 11 extracts multiple types of feature amounts using multiple recognition engines. The product information management unit 123 then associates the feature amounts with information identifying the recognition engines used to recognize the feature amounts, and stores the multiple types of feature amounts in the product information table 1211.

[0027] [Example of functional configuration of user management system] 5 is a diagram showing an example of the functional configuration of user management system 13 according to the embodiment. User management system 13 according to the embodiment includes a user information DB 131, a receiving unit 132, a user information management unit 133, and a transmitting unit 134. User information DB 131 stores a user information table 1311.

[0028] 6 is a diagram showing an example of a user information table 1311 according to an embodiment. The user information table 1311 according to an embodiment includes a user ID, a user name, and attributes. The user ID is information for identifying a user. The user name is the name of the user. The attributes indicate the company or organization to which the user belongs.

[0029] 5, the receiving unit 132 receives a product purchase completion notification request including product information of the purchased product from the product management system 12. The user information management unit 133 adds (registers), changes, and deletes user information in the user information DB 131. When the sending unit 134 receives the product purchase completion notification request from the product management system 12, it sends the product purchase completion notification request, which further includes user information of the user who purchased the product, to the purchase management system 14.

[0030] [Example of functional configuration of purchasing management system] 7 is a diagram illustrating an example of the functional configuration of the purchasing management system 14 according to the embodiment. The purchasing management system 14 according to the embodiment includes a purchasing information DB 141, a receiving unit 142, a purchasing information management unit 143, and a transmitting unit 144. The purchasing information DB 141 stores a purchasing information table 1411.

[0031] FIG. 8 is a diagram showing an example of a purchase information table according to an embodiment. The purchase information table 1411 according to an embodiment includes a purchasing user ID, purchase date and time, product ID, and price. The purchasing user ID is information for identifying the user who purchased the product. The purchase date and time indicates the date and time when the product was purchased. The product ID is information for identifying the purchased product. The price indicates the price of the purchased product.

[0032] 7, the receiving unit 142 receives a product purchase completion notification request from the user management system 13. The purchasing information management unit 143 executes product payment processing and adds (registers), changes, and deletes purchasing information from the purchasing information DB 141. Upon receiving the product purchase completion notification request from the user management system 13, the transmitting unit 144 transmits the product purchase completion notification request, which further includes purchasing information of the purchased product, to the client terminal 16 via the Web server device 15.

[0033] [Examples of information processing methods] FIG. 6 is a diagram illustrating an example of an information processing method according to an embodiment.

[0034] <Product registration process flow> First, client terminal 16 transmits a product registration request to Web server device 15 (step S1). Next, when Web server device 15 receives the product registration request from client terminal 16, it transmits the product registration request to product management system 12 (step S2).

[0035] Next, in response to the product registration request from the Web server device 15, the product information management unit 123 of the product management system 12 registers the product information other than the features (product ID, name, category, meta information, usage permission rank, publication flag, registration date and time, and registered user ID) in the product information table 1211 (step S3). Next, the transmission unit 125 of the product management system 12 transmits data such as images included in the product registration request (data to be subjected to feature extraction) to the feature extraction service 11 (step S4).

[0036] Next, the receiving unit 111 of the feature extraction service 11 receives data such as images from the product management system 12 (step S5). Next, the extracting unit 112 of the feature extraction service 11 extracts features from the data such as images (step S6). Next, the transmitting unit 113 of the feature extraction service 11 transmits the features to the product management system 12 (step S7).

[0037] Next, when the receiving unit 122 of the product management system 12 receives the feature from the feature extraction service 11 (step S8), the product information management unit 123 registers the feature in the product information table 1211 and transmits a product registration completion notification request to the Web server device 15.

[0038] Next, when Web server device 15 receives the product registration completion notification request from product management system 12, it transmits the product registration completion notification request to client terminal 16 (step S9). Next, when client terminal 16 receives the product registration completion notification request from Web server device 15, it completes the product registration process (step S10).

[0039] <Product search process flow> First, the client terminal 16 transmits a product search request to the Web server device 15 (step S11). Next, when the Web server device 15 receives the product search request from the client terminal 16, it transmits the product search request to the product management system 12 (step S12).

[0040] Next, the search unit 124 of the product management system 12 searches for product information from the product information table 1211 in response to the product search request from the Web server device 15 (step S13). For example, the search unit 124 uses name, category, meta information, etc. to search for product information that is highly similar to the content of the product search request (appropriate product information based on the product search request) as candidates. Next, the transmission unit 125 of the product management system 12 transmits a search result notification request including the product search results to the Web server device 15 (step S14).

[0041] Next, when Web server device 15 receives the search result notification request from product management system 12, it transmits the search result notification request to client terminal 16 (step S15). Next, when client terminal 16 receives the search result notification request from Web server device 15, it displays the search results included in the search result notification request on the display unit or the like of client terminal 16 (step S16).

[0042] <Product purchase process flow> First, the client terminal 16 transmits a product purchase request to the Web server device 15 (step S17). Next, when the Web server device 15 receives the product purchase request from the client terminal 16, it transmits the product purchase request to the product management system 12 (step S18).

[0043] Next, the product information management unit 123 of the product management system 12 acquires product information from the product information table 1211 in response to the product purchase request from the Web server device 15 (step S19).

[0044] Next, the transmitting unit 125 of the product management system 12 transmits a product purchase completion notification request including product information of the purchased product to the user management system 13 (step S13).

[0045] Next, when the receiving unit 132 of the user management system 13 receives the product purchase completion notification request from the product management system 12, it acquires the user information of the user who purchased the product from the user information table 1311 (step S21). Then, the transmitting unit 134 of the user management system 13 transmits the product purchase completion notification request, which further includes the user information acquired in step S21, to the purchase management system 14.

[0046] Next, when the receiving unit 142 of the purchasing management system 14 receives the product purchase completion notification request from the user management system 13, the purchasing information management unit 143 records the purchasing information in the purchasing information table 1411 (step S22). Then, the transmitting unit 144 of the purchasing management system 14 transmits to the Web server device 15 the product purchase completion notification request that further includes the purchasing information recorded in step S22.

[0047] Next, when Web server device 15 receives the product purchase completion notification request from purchase management system 14, it transmits the product purchase completion notification request to client terminal 16 (step S23). Next, when client terminal 16 receives the product purchase completion notification request from Web server device 15, it displays the purchase information and the like included in the product purchase completion notification request on the display unit of client terminal 16 as necessary, and completes the product purchase process (step S24).

[0048] As described above, in the information processing system 1 of the embodiment, the receiving unit 122 receives a product registration request including feature extraction target data from the client terminal 16 (second client terminal). The extracting unit 112 extracts features indicating person characteristics from the feature extraction target data. The purchasing information management unit 143 executes payment processing for the features in response to a purchase request for the features from the client terminal 16 (first client terminal), and stores purchasing information based on the payment processing in the storage unit (in the embodiment, the purchasing information DB 141).

[0049] As a result, the information processing system 1 of the embodiment allows feature quantities extracted from feature quantity extraction target data to be traded electronically between third parties. Specifically, the information processing system 1 of the embodiment allows a business operator who wants to sell feature quantities as products to register product information in the above-mentioned product information DB 121. Furthermore, the information processing system 1 of the embodiment can present suitable product candidates to a business operator who wants to purchase feature quantities based on the product category, meta information, etc. This allows purchasers to find products more easily and facilitates electronic commerce between third parties.

[0050] In the past, for example, in order to recognize a person from an image, it was necessary to register an image of the person for face matching in advance, which was a time-consuming task. Furthermore, if other businesses were already performing this registration work, there was a need to solve the problem even if it meant spending money. Furthermore, for businesses that create dictionaries (features) for recognizing people from feature extraction target data such as images and videos, the work of creating these dictionaries (features) takes time, so there was a need to find added value in these dictionaries (features).

[0051] According to the information processing system 1 of the above-described embodiment, it is possible to provide an electronic commerce platform that meets such needs.

[0052] In addition, in recent years, there has been a growing need for machine learning using facial images of celebrities to analyze their trends, but information users who need features for use in machine learning have faced challenges such as the communication capacity required to receive large amounts of data, the effort required to extract features after receiving the data, and the effort required to prepare appropriate data.In addition to the above challenges, information providers have had to overcome many issues in order to disseminate information about images and videos they own, such as the portrait rights and publicity rights of people appearing in the images.

[0053] According to the information processing system 1 of the embodiment, it is possible to match people who need features necessary for machine learning with people who are looking to sell, and it is possible to provide a platform where third parties can conduct e-commerce using features extracted from images, etc. Furthermore, the information processing system 1 of the embodiment does not directly handle data such as images and videos, but instead realizes e-commerce only using features of facial images contained in images or videos, (1) Minimize the amount of communication capacity required when buying and selling. (2) Reduce the effort required to extract features after purchase. (3) Reduce the hassle of copyright clearance when trading images or videos electronically. (4) Reduce the effort required to prepare appropriate data (data necessary for machine learning). This can also be achieved.

[0054] Finally, an example of the hardware configuration of the information processing system 1 according to the embodiment will be described.

[0055] [Example of hardware configuration] 10 is a diagram showing an example of the hardware configuration of the information processing system 1 according to the embodiment. The information processing system 1 according to the embodiment is realized by combining one or more computers each having the hardware configuration shown in FIG.

[0056] The information processing system 1 of the embodiment includes a control device 201, a main memory device 202, an auxiliary memory device 203, a display device 204, an input device 205, and a communication device 206. The control device 201, the main memory device 202, the auxiliary memory device 203, the display device 204, the input device 205, and the communication device 206 are connected via a bus 210.

[0057] The control device 201 executes a program read from the auxiliary storage device 203 to the main storage device 202. The main storage device 202 is a memory such as a ROM and a RAM. The auxiliary storage device 203 is a hard disk drive (HDD), a memory card, or the like.

[0058] The display device 204 displays display information. The display device 204 is, for example, a liquid crystal display. The input device 205 is, for example, a keyboard, a mouse, etc. The communication device 206 is an interface for communicating with other devices.

[0059] The programs executed by the information processing system 1 of the embodiment are provided as computer program products recorded in installable or executable format files on computer-readable storage media such as CD-ROMs, memory cards, CD-Rs, and DVDs.

[0060] The programs executed by the information processing system 1 of the embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network.The programs executed by the information processing system 1 of the embodiment may also be provided via a network such as the Internet without being downloaded.

[0061] The program of the information processing system 1 according to the embodiment may be provided in a state where it is pre-installed in a ROM or the like.

[0062] The program executed by the information processing system 1 of the embodiment has a modular configuration including functional blocks that can be realized by the program among the functional blocks described above (FIGS. 2, 3, 5, and 7). As actual hardware, the control device 201 reads and executes the program from a storage medium, and the functional blocks are loaded onto the main storage device 202. In other words, the functional blocks are generated on the main storage device 202.

[0063] Note that some or all of the above-described functional blocks may be realized by hardware such as an integrated circuit (IC) instead of by software.

[0064] Furthermore, when each function is realized using a plurality of processors, each processor may realize one of the functions, or may realize two or more of the functions.

[0065] The information processing system 1 of the embodiment may operate in any manner. For example, the feature extraction service 11, the product management system 12, the user management system 13, and the purchase management system 14 of the information processing system 1 of the embodiment may be operated as a cloud system on a network 17.

[0066] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0067] 1. Information Processing Systems 11 Feature extraction service 12 Product Management System 13 User Management System 14 Purchasing Management System 15 Web server device 16 client terminals 17 Network 111 Receiving unit 112 Extraction part 113 Transmitter 121 Product information DB 122 Receiving unit 123 Product Information Management Department 124 Search Section 125 Transmitter 131 User Information DB 132 Receiving unit 133 User Information Management Department 134 Transmitter 141 Purchasing information DB 142 Receiving unit 143 Purchasing Information Management Department 144 Transmitter 201 Control device 202 Main storage 203 Auxiliary storage device 204 Display device 205 Input Device 206 Communication Equipment 210 Bus 1211 Product Information Table 1311 User Information Table 1411 Purchasing Information Table

Claims

1. an extraction unit that extracts features indicating characteristics of a person from feature extraction target data; a transaction information management unit that executes a transaction process for the feature amount in response to a transaction request for the feature amount from a first client terminal and stores transaction information based on the transaction process in a storage unit; a first transmitting unit that transmits the feature amount of the executed transaction process to the first client terminal; An information processing system comprising:

2. a feature information management unit that stores feature information including the feature in the storage unit; a search unit that searches the storage unit for the feature amount information in response to a search request for the feature amount information from the first client terminal; a second transmission unit that transmits a search result by the search unit to the first client terminal; The information processing system according to claim 1 , further comprising:

3. The feature information includes at least one of information identifying the feature, a name of a person identified by the feature, a category of a person identified by the feature, information indicating matters related to the feature, information indicating a licensed scope for use of the feature, information indicating whether the feature has already been made public, a date and time when the feature was registered, and information identifying a user who registered the feature. The information processing system according to claim 2 .

4. the feature amount includes data indicating facial features of the person; The information processing system according to any one of claims 1 to 3.

5. a receiving unit that receives the feature extraction target data from a second client terminal; The information processing system according to claim 1 , further comprising:

6. an extraction unit extracting features indicating characteristics of a person from the feature extraction target data; a transaction information management unit executing a transaction process for the feature amount in response to a transaction request for the feature amount from a first client terminal, and storing transaction information based on the transaction process in a storage unit; a first transmitting unit transmitting the feature amount of the executed transaction process to the first client terminal; An information processing method including:

7. Computer, an extraction unit that extracts features indicating characteristics of a person from feature extraction target data; a transaction information management unit that executes a transaction process for the feature amount in response to a transaction request for the feature amount from a first client terminal and stores transaction information based on the transaction process in a storage unit; a first transmitting unit that transmits the feature amount of the executed transaction process to the first client terminal; A program to function as a

Images