Data transformation system and method

Abstract

To provide improved methods and systems for data transformation.SOLUTION: In a data transformation system 100, a method of transforming data through an operation function 102 includes: receiving data in a first language specific form; converting the data in the first language specific form into a language agnostic form; storing the data in the language agnostic form; converting the data in the language agnostic form into at least one second language specific form; and exporting, on demand, the data in at least one of the at least one second language specific form.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] REFERENCE TO RELATED APPLICATIONS Herein, U.S. Provisional Patent Application No. 62 / 144,407, filed April 8, 2015, and entitled “Data Transmission System and Method,” No. 6,393,633, the disclosure of which is incorporated herein by reference and priority is claimed pursuant to 37 CFR 1.78(a)(1).

[0002] FIELD OF THEINVENTION The present invention relates to a method and system for data transformation. [Background technology]

[0003] 2. Background of the Invention A variety of data transformation systems and methods are known. Summary of the Invention

[0004] The present invention seeks to provide an improved method and system for data transformation.

[0005] Thus, in accordance with a preferred embodiment of the present invention there is provided a method of transforming data, the method comprising receiving data in a first language specific form, converting the data in the first language specific form into a language agnostic form. ), storing the data in the language independent format, converting the data in the language independent format into at least one second language specific format, and on demand, The method includes exporting the data in at least one of two second language-specific formats.

[0006] Preferably, the conversion of data from the language independent format to at least one second language specific format occurs on demand.

[0007] According to a preferred embodiment of the present invention, the at least one second language-specific formatted data comprises a plurality of second language-specific formatted data, alternatively, the at least one second language-specific formatted data comprises a single second language-specific formatted data.

[0008] According to a preferred embodiment of the present invention, the at least one second language-specific format comprises at least a first language-specific format, and preferably, the at least one second language-specific format comprises data in the same language as the first language-specific format.

[0009] Preferably, the method of transforming data also includes converting the data in the first language specific form from unstructured data to structured data, and converting the data in the first language specific form to the language independent form includes converting the structured data in the first language specific form to structured data in the language independent form.

[0010] According to a preferred embodiment of the present invention, the data in the first language-specific format relates to an object. Additionally, the object includes an article. Preferably, attributes of the article are described by the data. Additionally, the data is related to attributes of the corresponding article. Contains the assigned attribute values.

[0011] There is also provided, in accordance with another preferred embodiment of the present invention, a system for transforming data, the system comprising: a data receiving function operable to receive data in a first language specific format; a language specific data to language independent data conversion function operable to convert data in a first language specific format to a language independent format; a language independent database configured to store the data in a language independent form; a language independent data to language specific data converter operable to convert data in the language independent format to at least one second language specific format; and A data export function is included, the data export function being operable to export, on demand, at least one of the data in at least one second language-specific format.

[0012] In accordance with a preferred embodiment of the present invention, the language independent data to language specific data conversion function is operable to convert, on demand, data in the language independent format into at least one second language specific format.

[0013] Preferably, the at least one second language-specific format data comprises a plurality of second language-specific format data, alternatively, the at least one second language-specific format data comprises a single second language-specific format data.

[0014] According to a preferred embodiment of the present invention, the at least one second language-specific format comprises at least a first language-specific format, and preferably, the at least one second language-specific format comprises data in the same language as the first language-specific format.

[0015] Preferably, the language specific data to language independent data conversion functionality is also operable to convert data in the first language specific format from unstructured data to structured data, and to convert structured data in the first language specific format to structured data in the language independent format.

[0016] Preferably, the data in the first language-specific format relates to an object. Additionally, the object comprises a product. Preferably, attributes of the product are described by the data. Additionally, the data comprises attribute values ​​assigned to attributes of the corresponding product.

[0017] There is further provided, in accordance with a preferred embodiment of the present invention, a method for transforming data, the method including receiving unstructured data in a first language specific format, converting the unstructured data in the first language specific format into a structured language agnostic form, the structured language agnostic form being a representation of the structured language. storing the data in the language-independent format; converting the data in the structured language-independent format to at least one second language-specific format; and exporting, on demand, at least one of the data in the at least one second language-specific format.

[0018] According to a preferred embodiment of the present invention, the conversion of data in a structured, language-independent format into at least one second, language-specific format is performed on-demand.

[0019] According to a preferred embodiment of the present invention, the at least one second language-specific formatted data comprises a plurality of second language-specific formatted data, alternatively, the at least one second language-specific formatted data comprises a single second language-specific formatted data.

[0020] Preferably, the at least one second language-specific format comprises at least a first language-specific format. Preferably, the at least one second language-specific format comprises data in the same language as the first language-specific format.

[0021] In accordance with a preferred embodiment of the present invention, the method of transforming data also includes converting the unstructured data in the first language-specific format from unstructured data to structured data, and converting the unstructured data in the first language-specific format to the structured, language-independent format includes converting structured data in the first language-specific format to structured data in the language-independent format.

[0022] Preferably, the data in the first language-specific format relates to an object. Additionally, the object comprises a product. According to a preferred embodiment of the present invention, attributes of the product are described by the data. Additionally, the data comprises attribute values ​​assigned to the attributes of the corresponding product.

[0023] Still further, in accordance with yet another preferred embodiment of the present invention, there is provided a system for transforming data, the system comprising: an unstructured data receiving facility operable to receive unstructured data in a first language specific format; an unstructured language-specific data to structured language-independent data converter operable to convert the unstructured data in the first language-specific format into a structured language-independent format; a structured language independent database configured to store data in a structured language independent form; a language independent data to language specific data converter operable to convert data in a structured, language independent format into at least one second language specific format; and A data export function is included, the data export function being operable to export, on demand, at least one of the data in at least one second language-specific format.

[0024] In accordance with a preferred embodiment of the present invention, the language-independent data to language-specific data conversion function is operable to convert, on demand, data in a structured, language-independent format into at least one second, language-specific format.

[0025] Preferably, said data in at least one second language-specific format comprises data in a plurality of second language-specific formats, alternatively, said data in at least one second language-specific format comprises data in a single second language-specific format.

[0026] According to a preferred embodiment of the present invention, the at least one second language-specific format comprises at least a first language-specific format, and preferably, the at least one second language-specific format comprises data in the same language as the first language-specific format.

[0027] In accordance with a preferred embodiment of the present invention, structured data is generated from unstructured language-specific data. The language-independent data conversion functionality is operable to convert data in the first language-specific format from unstructured data to structured data, and to convert structured data in the first language-specific format to structured data in the language-independent format.

[0028] Preferably, the data in the first language-specific format relates to an object. Additionally, the object comprises a product. According to a preferred embodiment of the present invention, attributes of the product are described by the data. Additionally, the data comprises attribute values ​​assigned to the attributes of the corresponding product.

[0029] Furthermore, in accordance with yet another preferred embodiment of the present invention, A method is provided for transforming data, the method comprising: providing a structured language independent product database configured to store, for each of a number of products, a number of structured language independent product attribute values ​​assigned to a corresponding number of structured language independent product attributes; receiving unstructured product data in a first language-specific format; analyzing the unstructured product data and extracting unstructured product-specific attribute values ​​from the unstructured product data in the first language-specific format, the unstructured product-specific attribute values ​​assigned to corresponding unstructured product attributes; converting the unstructured product-specific attribute values ​​(assigned to corresponding unstructured product attributes) into a structured, language-independent format; determining whether a structured language-independent product-specific attribute value (assigned to a corresponding structured language-independent product attribute) is associated with a particular product stored in a structured language-independent product database; the structured, language-independent product database is configured to store, for each of the number of products, a number of structured, language-independent product attribute values ​​assigned to a corresponding number of structured, language-independent product attributes; in response to determining that the structured language-independent product-specific attribute value (assigned to the corresponding structured language-independent product attribute) is not associated with a particular product stored in the structured language-independent product database, adding a new product having the structured language-independent product-specific attribute value (assigned to the corresponding structured language-independent product attribute) to the structured language-independent product database; and In response to determining that the structured language-independent product-specific attribute value (assigned to the corresponding structured language-independent product attribute) is associated with a particular product stored in the structured language-independent product database, assigning the structured language-independent product-specific attribute value to the corresponding language-independent structured product attribute of the particular product.

[0030] Preferably, receiving the unstructured product data in the first language-specific format includes receiving the unstructured product data in the first language-specific format from a seller of a product described in the unstructured product data in the first language-specific format. Alternatively, receiving the unstructured product data in the first language-specific format includes automatically pulling the unstructured product data in the first language-specific format from any of a plurality of e-commerce platforms.

[0031] Preferably, the multiple products are classified into multiple product categories. Additionally, the method for transforming the product data also includes classifying the products into at least one of the product categories. Preferably, the method for transforming the product data also includes classifying the products into at least one of the product categories. and analyzing the unclassified product data to classify products described therein into at least one of the product categories. Additionally, the method for transforming the product data also includes using the classification to determine whether structured language independent product specific attribute values ​​(assigned to corresponding language independent structured product attributes) are associated with a particular product stored within the structured language independent product database.

[0032] In accordance with a preferred embodiment of the present invention, the method for transforming product data also includes converting the data in the structured, language-independent format to at least one second language-specific format, and exporting the at least one product data in the at least one second language-specific format.

[0033] Preferably, the method for transforming the product data also includes converting the data in the structured, language independent format into a format suitable for export to any of a plurality of third party e-commerce platforms, and includes exporting the product data in a format suitable for export to the particular one of the plurality of third party e-commerce platforms to the particular one of the plurality of third party e-commerce platforms.

[0034] According to a preferred embodiment of the present invention, exporting the at least one product data in the at least one second language-specific format is on-demand. Alternatively, exporting the at least one product data in the at least one second language-specific format is automatic.

[0035] Preferably, converting the unstructured product-specific attribute values ​​(assigned to corresponding unstructured product attributes) into a structured, language-independent form includes determining whether the unstructured product-specific attribute values ​​and the unstructured product attributes in the first language-specific form are contained in a dictionary, the dictionary including, for each product attribute and product attribute value contained therein, a language-independent identifier and its translation into at least one of the first language forms and at least one second language-specific form, respectively, and determining whether the unstructured product-specific attribute values ​​and the unstructured product attributes are contained in the dictionary. using the dictionary to convert the unstructured product-specific attribute values ​​and the unstructured product attributes into a structured, language-independent form in response to determining that the unstructured product-specific attribute values ​​and the unstructured product attributes are not contained within the dictionary; and adding each of the unstructured product-specific attribute values ​​and the unstructured product attributes in the first language-specific form to the dictionary and assigning a language-independent identifier to each of the unstructured product-specific attribute values ​​and the unstructured product attributes in the first language-specific form in response to determining that the unstructured product-specific attribute values ​​and the unstructured product attributes are not contained within the dictionary.

[0036] In accordance with a preferred embodiment of the present invention, converting the unstructured product-specific attribute values ​​(assigned to the corresponding unstructured product attributes) into a structured, language-independent format also includes, in response to determining that the unstructured product-specific attribute values ​​and the unstructured product attributes are not included in the dictionary, automatically translating the unstructured product-specific attribute values ​​and the unstructured product attributes into at least one second language-specific format each in the dictionary and adding the translation to the dictionary. Preferably, converting the unstructured product-specific attribute values ​​(assigned to the corresponding unstructured product attributes) into a structured, language-independent format also includes, in response to determining that the unstructured product-specific attribute values ​​and the unstructured product attributes are not included in the dictionary, automatically translating the unstructured product-specific attribute values ​​and the unstructured product attributes into at least one second language-specific format each in the dictionary and adding the translation to the dictionary. In response, instructing an administrator of the system to translate the unstructured product-specific attribute values ​​and the unstructured product attributes into each of at least one second language-specific form and add the translations to the dictionary.

[0037] According to a preferred embodiment of the present invention, converting the product data in the structured, language-independent format into at least one of the at least one second, language-specific format uses a dictionary.

[0038] According to a preferred embodiment of the present invention, the conversion of the product data in the structured language independent format to at least one of the at least one second language specific format is performed on-demand. Alternatively, the conversion of the product data in the structured language independent format to at least one of the at least one second language specific format is performed automatically.

[0039] Preferably, said data in at least one second language-specific format comprises data in a plurality of second language-specific formats, alternatively, said data in at least one second language-specific format comprises data in a single second language-specific format.

[0040] According to a preferred embodiment of the present invention, the at least one second language-specific format comprises at least a first language-specific format, and preferably, the at least one second language-specific format comprises data in the same language as the first language-specific format.

[0041] In accordance with yet another preferred embodiment of the present invention, there is provided a multilingual product catalog system, the multilingual product catalog system comprising: an unstructured product data receiving function operable to receive unstructured product data in a first language-specific format; an unstructured product data extraction function operable to analyze the unstructured product data and extract unstructured product-specific attribute values ​​(assigned to corresponding unstructured product attributes) from the unstructured product data in the first language-specific format; an unstructured, language-specific product data to structured, language-independent product data converter operable to convert unstructured product-specific attribute values ​​(assigned to corresponding unstructured product attributes) into a structured, language-independent format; a product matching function operable to: determine whether the structured language-independent product-specific attribute value (assigned to the corresponding structured language-independent product attribute) is associated with a particular product stored in the structured language-independent product database; in response to determining that the structured language-independent product-specific attribute value (assigned to the corresponding structured language-independent product attribute) is not associated with a particular product stored in the structured language-independent product database, add a new product having the structured language-independent product-specific attribute value (assigned to the corresponding structured language-independent product attribute) to the structured language-independent product database; and in response to determining that the structured language-independent product-specific attribute value (assigned to the corresponding structured language-independent product attribute) is associated with a particular product stored in the structured language-independent product database, assign the structured language-independent product-specific attribute value to the corresponding language-independent structured product attribute of the particular product.

[0042] Preferably, the unstructured product data receiving facility is operable to receive unstructured product data in the first language-specific format from a seller of a product described in the unstructured product data in the first language-specific format. In accordance with a preferred embodiment of the present invention, the unstructured product data receiving facility is operable to receive the unstructured product data in the first language-specific format by automatically pulling the unstructured product data in the first language-specific format from any of a plurality of e-commerce platforms.

[0043] Preferably, the multiple products are classified into multiple product categories. In accordance with a preferred embodiment of the present invention, the multilingual product catalog system also includes a product classification function operable to classify the products into at least one of the product categories. Additionally, the product classification function is operable to analyze the unstructured product data to classify the products described therein into at least one of the product categories. Preferably, the product matching function is also operable to use the product classification function to determine whether a structured language independent product specific attribute value (assigned to a corresponding language independent structured product attribute) is associated with a particular product stored in the structured language independent product database.

[0044] In accordance with a preferred embodiment of the present invention, the multilingual product catalog system also includes a language independent product data to language specific product data conversion function operable to convert the product data in the structured language independent format to at least one second language specific format, and a product data export function operable to export the product data in at least one of the at least one second language specific formats. Additionally, the language independent product data to language specific product data conversion function is also operable to convert the product data in the structured language independent format to a format suitable for export to any of a plurality of third party e-commerce platforms, and the product data export function is also operable to export the product data in a format suitable for export to a particular one of the plurality of third party e-commerce platforms to a particular one of the plurality of third party e-commerce platforms.

[0045] Preferably, the product data export facility is operable to export the at least one product data in the at least one second language-specific format on demand. Alternatively, the product data export facility is operable to automatically export the at least one product data in the at least one second language-specific format.

[0046] In accordance with a preferred embodiment of the present invention, the multilingual product catalog system also includes a dictionary that includes, for each product attribute and product attribute value contained therein, a language independent identifier and its translation into at least one first language form and at least one second language specific form, respectively.

[0047] In accordance with a preferred embodiment of the present invention, the unstructured language-specific product data to structured language-independent product data conversion functionality also includes determining whether the unstructured product-specific attribute values ​​and unstructured product attributes in the first language-specific format are contained in a dictionary, and in response to determining that the unstructured product-specific attribute values ​​and unstructured product attributes are contained in the dictionary, using the dictionary to convert the unstructured product-specific attribute values ​​and unstructured product attributes into a structured language-independent format, and converting the unstructured product-specific attribute values ​​and unstructured product attributes into a structured language-independent format. In response to determining that the attributed values ​​and the unstructured product attributes are not included in the dictionary, the method is operable to add each of the unstructured product-specific attribute values ​​and the unstructured product attributes in a first language-specific format to the dictionary and assign a language-independent identifier to each of the unstructured product-specific attribute values ​​and the unstructured product attributes.

[0048] In accordance with a preferred embodiment of the present invention, the unstructured language-specific product data to structured language-independent product data conversion functionality is also operable, in response to determining that the unstructured product-specific attribute values ​​and the unstructured product attributes are not included in the dictionary, to automatically translate the unstructured product-specific attribute values ​​and the unstructured product attributes into at least one second language-specific format each in the dictionary and add the translation to the dictionary. Additionally, the unstructured language-specific product data to structured language-independent product data conversion functionality is also operable, in response to determining that the unstructured product-specific attribute values ​​and the unstructured product attributes are not included in the dictionary, to prompt an administrator of the system to translate the unstructured product-specific attribute values ​​and the unstructured product attributes into at least one second language-specific format each in the dictionary and add the translation to the dictionary.

[0049] Preferably, the language independent product data to language specific product data conversion function is operable to use the dictionary to convert the product data from the structured language independent form to at least one of the at least a second language specific form.

[0050] In accordance with a preferred embodiment of the present invention, the language independent product data to language specific product data conversion functionality is operable to convert the product data in the structured language independent format into at least one of the at least second language specific formats on demand. Alternatively, the language independent product data to language specific product data conversion functionality is operable to automatically convert the product data in the structured language independent format into at least one of the at least second language specific formats.

[0051] Preferably, the at least one second language-specific format data comprises a plurality of second language-specific format data, alternatively, the at least one second language-specific format data comprises a single second language-specific format data.

[0052] According to a preferred embodiment of the present invention, the at least one second language-specific format comprises at least a first language-specific format, and preferably, the at least one second language-specific format comprises data in the same language as the first language-specific format.

[0053] BRIEF DESCRIPTION OF THE DRAWINGS The present invention will be understood and appreciated more fully from the following detailed description taken in conjunction with the drawings, in which: [Brief description of the drawings]

[0054] [Figure 1] FIG. 1 is a simplified block diagram of a data transformation system constructed and operative in accordance with a preferred embodiment of the present invention. [Diagram 2] FIG. 2 is a simplified flow chart illustrating some of the initial steps performed by a seller in conjunction with an embodiment of the system of FIG. [Diagram 3] 3A and 3B show two examples of unstructured language-specific listing data, each of which forms part of a different vendor-supplied file. [Figure 4] FIG. 4 is a simplified block diagram of an Unstructured Product Data Receiving Function (UPDRF) forming part of an embodiment of the system of FIG. [Diagram 5] FIG. 5 is a simplified diagram illustrating the operation of an input data string mapper, which forms part of the Unstructured Product Data Receiving Function (UPDRF) of FIG. [Figure 6] FIG. 6 is a simplified flow chart illustrating the operation of the Unstructured Product Data Receiving Function (UPDRF) of FIG. [Figure 7]FIG. 7 is a simplified example of unstructured language-specific listings data initially stored in a database that forms part of an embodiment of the system of FIG. [Figure 8] FIG. 8 is a simplified flow chart illustrating the operation of a product data extraction function and a product matching function that form part of an embodiment of the system of FIG. [Figure 9] FIG. 9 is a simplified diagram of a category structure table used in the product data extraction and product matching functions that form part of an embodiment of the system of FIG. [Figure 10] FIG. 10 is a simplified diagram of an example of the operation of a product data extraction function forming part of an embodiment of the system of FIG. [Figure 11] FIG. 11 is a simplified diagram of a typical category attribute structure table used by the extraction function of FIG. [Figure 12] FIG. 12 is a simplified diagram of a typical attribute value structure table used by the extraction function of FIG. [Figure 13] FIG. 13 is a simplified diagram of a portion of an exemplary structure translation table used by an embodiment of the system of FIG. [Figure 14] 14A and 14B are simplified flow charts of two category-specific rule sets used by the extraction function of FIG. [Figure 15] FIG. 15 is a simplified diagram of a typical category-specific matrix matching rule. [Figure 16] FIG. 16 is a simplified flow chart illustrating new product creation and data enrichment operations of an embodiment of the system of FIG. [Figure 17] FIG. 17 is a simplified diagram of a portion of a structured product list. [Figure 18] FIG. 18 is a simplified diagram of a portion of a structured product data table. [Figure 19] FIG. 19 is a simplified diagram of a portion of a typical marketplace-specific data specification table. [Figure 20]FIG. 20 is a simplified diagram of an example of the operation of a language independent product data to language specific product data conversion function forming part of the embodiment of FIG. [Figure 21] FIG. 21 is a simplified diagram of a portion of a structure translation table. [Figure 22] FIG. 22 is a simplified flow chart of exemplary product data weight attribute expansion and conversion rules. [Figure 23] FIG. 23 is a simplified diagram of typical language-specific, marketplace-specific product listing creation rules. [Figure 24] FIG. 24 is a simplified diagram of the mapping of categories to specific marketplaces. [Diagram 25] FIG. 25 is a simplified diagram of the mapping of attribute-value pairs to a particular marketplace. [Figure 26] FIG. 26 is a simplified diagram of typical language-specific, marketplace-specific listing data transformation rules. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0055] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference is now made to Figure 1, which is a simplified block diagram of a data conversion system 100 constructed and operative in accordance with a preferred embodiment of the present invention. While Figure 1 illustrates an embodiment of the present invention in the context of a multilingual electronic commerce environment, it will be understood that this and other embodiments of the present invention are not necessarily limited to such an environment.

[0056] Conventional e-commerce platforms typically facilitate product listings in a semi-structured format. The formats required for listings sent to various conventional e-commerce platforms are different and language-specific. Thus, merchants who wish to list their product offerings on a wide range of e-commerce platforms typically must list their products separately on each e-commerce platform and in all desired languages.

[0057] It is a distinguishing feature of embodiments of the present invention to facilitate importing unstructured product listings in any of a first plurality of languages, converting the imported product listings into a structured, language-independent format, and then providing product listings in any of a second plurality of languages. The system of embodiments of the present invention provides product listings in any language suitable for listing in a structured multilingual catalog or any suitable e-commerce platform.

[0058] It is understood that the second plurality of languages ​​will typically also include the language of the original product listing, and that the system of an embodiment of the present invention may be utilized to import unstructured product listings in a first language and provide structured product listings in the same language.

[0059] 1, the data transformation system 100 typically includes a data manipulation function 102 that interacts with a database 110 that forms part of the data transformation system 100. The database 110 preferably includes storage for unstructured product listings, which are typically provided as input in a language-specific format, and for structured product listings that are provided by the data manipulation function 102 of the data transformation system 100. The structured product listings may be stored in the database 110 in both a language-independent format and in one or more language-specific formats.

[0060] The data manipulation functions 102 of the data transformation system 100 preferably include at least the following, which interact with the database 110: an unstructured product data receiving function 120, which is further described below with reference to FIG. 4, and which typically includes a feed upload tool 122, which includes an input data mapper 124, and said unstructured product data receiving function 120 includes a feed file receiving function 128, which preferably includes a data writer 130, a processing need qualifier, and a classifier / matcher trigger 134; Includes product classification / matching function 136; Including, among other things, an unstructured product data extractor 140 that interacts with a dictionary 142; including a conversion function 144 from unstructured language-specific product data to structured language-independent product data, inter alia interacting with the dictionary 142; Includes new product creation and product data enrichment functionality 146; including a conversion function 150 from language independent product data to language specific product data; includes a data export function 160; and Includes selected marketplace listing creation functionality 170.

[0061] These features are further described below with reference to Figures 4-25.

[0062] Reference is now made to FIG. 2, which illustrates typical initial operations performed by a seller using the system of FIG. 1. As seen in FIG. 2, the seller selects the marketplaces in which he wishes to list his product (also referred to herein as "marketplaces for boarding"). The seller preferably selects a currency conversion policy for each marketplace, a price and markup policy for each marketplace, and a shipping and return policy for each marketplace. The seller then saves a seller listing supply file (seller listings supply file) to database 110 in the system of FIG. 1. 2, after uploading the seller listing file, the seller initiates a conversion process of the system of the present invention to convert the unstructured language specific product listings into structured language independent product listings, which are then stored in database 110.

[0063] As seen in the illustrated embodiment of Figure 1, unstructured, language-specific listing data that forms part of a seller listing feed file is typically provided to the data transformation system 100 via an unstructured product data receiving function (UPDRF) 120. Preferably, the data transformation system 100 stores the unstructured, language-specific listing data in a database 110. Examples of two different seller listing feed files appear in Figures 3A and 3B.

[0064] It will be appreciated that each example of a seller listing supply file in Figures 3A and 3B includes two separate listings for camera lenses. The language of all listings in Figures 3A and 3B is English, and the listing data in both examples includes free text that not only describes the camera lens, but also describes the condition of the lens and the price of the lens. Sometimes shipping data is also included.

[0065] The Unstructured Product Data Receiving Function (URDRF) 120 is generally illustrated in Figure 4 and includes a supply upload tool 122 that receives unstructured, language-specific listing data, typically in the form of seller-supplied files such as those shown in Figures 3A and 3B. The supply upload tool 122 is typically implemented on a web page associated with a portal of the system of Figure 1 and enables the functionality described above with reference to Figure 2.

[0066] The feed upload tool 122 includes, among other things, an input data column mapper 124 that maps columns in the seller listing feed file to columns in the database 110 based on instructions received from the seller. The input data column mapper 124 provides mapping instruction outputs that are used by the unstructured product data receiver 120 of the data transformation system 100 to rearrange columns in the seller listing feed file to correspond with columns in the database 110, and the input data column mapper 124 then uploads the rearranged data to the database 110. Figure 5 illustrates the operation of the input data column mapper 124.

[0067] A simplified flow chart summarizing the preferred steps for uploading a seller listing feed file into database 110 appears in Figure 6. In addition to the mapping instruction output provided by input data string mapper 124, the seller listing feed file and the mapping instruction output are processed by a feed file receiver function 128, which also forms part of an unstructured product data receiver function (UPDRF).

[0068] The feed file receiver 128 includes a data writer 130 that maps data from each row in the seller listing feed (raw) to a corresponding row in the database 110 according to the mapping instructions generated by the input data string mapper 124. The data writer 130 also adds a unique listing key to each row, which is preferably stored in the listing data. It is generated by computing a hash function such as the conventional MD5 hash function above.

[0069] The data writer 130 also preferably adds an update date to each row indicating the date the seller listing data was uploaded to the database 110 .

[0070] The feed file receiver 128 also includes a NEED TO PROCESS ascertainer 132 that determines whether the newly loaded listing is a The processing need verifier 132 checks whether the newly added row is related to a listing already in the database, and if not, lists the newly loaded listing as being processing need. The processing need verifier 132 compares the unique listing key of the newly added row with the unique listing keys of all listings in the database. If no match is found, a processing need flag appears in the processing need column of the newly added row.

[0071] The feed file receiver 128 additionally includes a classifier / matcher trigger 134. The classifier / matcher trigger 134 only runs when the entire seller listing feed file is uploaded to the database 110 and a unique listing key is generated for each new row.

[0072] Following the upload of the entire seller listings feed file, the classifier / matcher trigger 134 launches a classification / matching function 136, which processes rows where a processing need flag appears in the processing need column of the newly added row. The classification / matching function 136 attempts to match the new listings with products already in the database 110.

[0073] An exemplary updated unstructured language-specific listings table stored in database 110 is seen in Figure 7, which contains the listing data that appears in the seller listings feed files of Figures 3A and 3B. It can be seen that each row contains, among other things, a unique listing key, an update date, and a processing need flag, if appropriate.

[0074] As mentioned above, following upload of the entire seller listings feed file, the classifier / matcher trigger 134 launches the classification / matching function 136, which processes rows in which a processing need flag appears.

[0075] The classification / matching function 136 is described below in conjunction with FIG. 8, which provides a general overview.

[0076] As seen in Figure 8, classification / matching function 136 first checks for the presence of a unique product identifier, such as an all-numeric UPC code or equivalent, in the new listing. If such a unique product identifier is extracted from the data in the listing description column of a row stored in database 110 (Figure 7) from the seller listings source file, and if the unique product identifier is already stored in database 110, then the product represented by the listing is already stored in database 110. Match the product.

[0077] If a match using a unique product identifier is not achieved, the classifier / matching function 136 then attempts to extract from the new listing the manufacturer and manufacturer part number, which may consist of numbers and letters, usually Latin characters. If the manufacturer and manufacturer part number are extracted from the data in the description column of the listing of a row stored in database 110 (FIG. 5) from the seller listings source file, and if the manufacturer and manufacturer part number are already stored in database 110, then the product represented by the listing is matched to a product already stored in database 110.

[0078] If a match is not achieved using the unique product identifier and the manufacturer and manufacturer part number, the classifier / matching function 136 then attempts to identify the language of the new listing. This is accomplished using conventional techniques such as may be found at https: / / pypi.ython.org / pypi / jangdetect.

[0079] Once the language of a new listing is identified, the listing is categorized. A classifier / matching function 136 categorizes the listing by using language-specific features, and preferably a trained statistical model, to classify all the listing data in each newly added row and classify the row as relating to one of a number of categories in a category structure table (a simplified example of which appears in FIG. 9) stored in database 110.

[0080] Considering FIG. 9, it can be seen that the category structure includes indications of the existence of parent-child relationships between some of the categories. Thus, for example, categories C1000 and C1002 are related to parent category C100, category C1001 is related to parent category C101, and categories C100 and C101 have no parent category. It can be seen that the classification function operates to classify each newly added row into the most specific category, if any, e.g., a child category. The classification function operates to assign a category ID to each row. This category ID is language independent.

[0081] Once the listing's category is identified, the unstructured product data extraction function 140 extracts various attributes and values ​​from the listing data and stores the attributes and values ​​in a language-specific cache of listing extraction data. An example of such a process is illustrated diagrammatically in FIG. 10.

[0082] 10, it can be seen that various structured language-specific attributes and values ​​are extracted from the unstructured, language-specific listing data by the unstructured product data extraction function 140. It is also understood that each of the extracted attributes and values ​​has a corresponding language-independent ID. The extracted language-specific structured data is preferably temporarily stored in a language-specific cache of the listings extraction data, and the unstructured, language-specific product data to structured, language-independent product data conversion function 144 provides corresponding extracted language-independent structured data, which is preferably temporarily stored in the language-independent cache of the listings extraction data.

[0083] Each attribute has an attribute ID. Figure 11 is an example of a category attribute structure table stored in database 110, where the attributes are associated with a particular category, here lens, whose category ID is C1002 (Figure 9). It can be seen that each attribute has a language independent attribute ID and is characterized by an attribute type. Attribute types are typically: Discrete Value List - contains a given discrete number of a given value; Number - Contains numbers which may have many values.

[0084] Each value has a value ID. Figure 12 is a simplified example of an attribute value structure table stored in database 110, whose values ​​are associated with various attributes (Figure 11).

[0085] It is understood that various attributes and values ​​may be applicable to multiple categories, although this is presumed to be rare and not a common occurrence.

[0086] The structures illustrated in the tables of Figures 9, 11 and 12 relate to very large language-specific / language-independent tables stored in database 110, which stores product data corresponding to listing descriptions in all relevant languages ​​for categories, attributes and values ​​and their corresponding language-independent IDs. Dictionary 142 is specifically embodied in a language-specific / language-independent table, a simplified example of which appears in Figure 13. In fact, the structures illustrated in the tables of Figures 9, 11 and 12 may be stored in database 110 without language-specific category, attribute or value names.

[0087] Preferably, the entire language-specific / language-independent table, which typically contains hundreds of thousands, if not millions, of entries, is not used for matching. Instead, only those entries in the identified language are used, and of those entries, initially only those entries associated with the category (FIG. 9) are used in the functionality of FIG. 10. Only once the category of a listing has been identified is attribute and value matching attempted using only those entries (FIGS. 11 and 12) in the language-specific / language-independent table (FIG. 13) that are associated with the language and category already identified.

[0088] Preferably, when matching attributes and values, a value match is first attempted using the value table illustrated in FIG. 13, since in practice most significant values ​​are specific to a single attribute, and therefore attribute matching is also achieved by matching values.

[0089] Returning to Figure 10, it can be seen that there are various rules that identify various listing data elements, typically values, and associate them with various attributes. For example, "18-55" is recognized by the rules as referring to focal length, and "F / " refers to lens aperture. Two exemplary sets of rules useful in the functionality of Figure 11 appear in Figures 14A and 14B.

[0090] Returning now to Figure 8, we see that a category-specific feature match matrix is ​​used for matching. This matrix specifies, for each category, the minimum set of attributes that must be known to establish a product match for products in that category. An example of such a matrix appears in Figure 15.

[0091] The attributes and values ​​necessary to establish a product match are extracted, and if the product in the database contains all of the attributes and values ​​specified in the matrix, the product in the new listing matches the product in the database.

[0092] If the necessary attributes and values ​​to establish a product match are not extracted, the system 100 utilizes new product creation and data enrichment functionality 146 to add a listing to the database 110 .

[0093] Here is a simplified diagram illustrating the new product creation and data enrichment functions 146 of the system 100. Please refer to FIG. 16, which is a flowchart illustrating the process.

[0094] As seen in FIG. 16, if the new listing matches a product already in the database, all of the attributes and values ​​in the new listing are extracted and stored in a language-independent format in a language-independent structured product table in database 110.

[0095] It is then determined whether all of the attribute-value pairs that appear in the new listing appear in the product data stored in the database. If there are any attributes and values ​​in the new listing that do not appear in the product data stored in the database, then these new attributes and values ​​are added to the existing products in database 110.

[0096] If the new listing does not match a product already in the database, a new product row is created in a structured product table in database 110. An example of a structured product table appears in Figure 17. A new product ID is created and all relevant attribute / value pairs are associated with it and preferably stored in a new structured product data table in database 110, an example of which appears in Figure 18. After creation of the new product ID and new attribute / value pairs, the listing is added in a language independent format to the language independent structured product table in database 110.

[0097] As seen in FIG. 16, if the new listing cannot be classified into a category in the database 110, the new listing is disposed of and the system 100 preferably notifies the seller that the new listing could not be classified.

[0098] At this stage, the data in database 110 is ready for export to one or more marketplaces specified by the seller (FIG. 2). For each marketplace, the initial step is to convert the product data from a language-independent format to a language-specific format appropriate for that marketplace. FIG. 20 shows an example of a language-independent to language-specific product data conversion function 150 of system 100. The function preferably consists of a structure translation table, an example of which appears in FIG. 21. Additionally, marketplace-specific conversion parameters are found in a marketplace-specific data specification table, an example of which is illustrated in FIG. 19.

[0099] Preferably, the language independent to language specific product data converter 150 first converts attributes from a language independent format to a language specific format appropriate for the specified marketplace. The language independent to language specific product data converter 150 then translates non-numeric values. As can be seen in Figure 20, the process produces as output a number of attribute-value pairs in a language specific format appropriate for the specified marketplace.

[0100] Because different marketplaces use different units of measurement and currencies, various manipulations of the product data may be performed by the data export function 160. Exemplary rules for such manipulations appear in Figure 22. Additionally, marketplace-specific modification of the product data may be appropriate. Figure 23 shows rules suitable for this purpose.

[0101] As seen in FIG. 23, exemplary language-specific product listing creation rules are presented in Russian for the OZON marketplace. Typically, seven different attribute-value pairs are translated using the table of FIG. 21 and the translated values. The resulting marketplace language-specific product data listings are stored in the marketplace language-specific product data cache in database 110 and assigned to the specified product data cache. The product is ready for boarding to the marketplace.

[0102] Preferably, the selected marketplace listing creation functionality 170 uses the API of the specified marketplace to board the listing to the specified marketplace. The selected marketplace listing creation functionality 170 of the system 100 submits the listing feed in a marketplace-specific format and language via the API. The marketplace-specific format includes a category mapping and attribute-value pair mapping to the particular marketplace. Examples of this mapping can be seen in Figures 24 and 25.

[0103] This mapping may be one-to-one, or it may be more complex such as one-to-many and / or many-to-one. In such cases, attribute-value pairs may be involved in the mapping.

[0104] Once a boarded marketplace category for each listed product is selected, the attribute-value pairs are mapped to specific attribute-value pairs in the boarded marketplace. This typically uses a one-to-one mapping. An example of an attribute-value pair mapping appears in FIG. 25. Attribute-value pairs in the database that do not exist in the boarded marketplace are typically ignored. Attribute-value pairs that exist in the boarded marketplace but not in the database are also typically ignored, but may alternatively be provided by a pre-performed transformation. An example of such a transformation appears in FIG. 26.

[0105] A further important step is to bring together marketplace-specific product information with listing information that is not included within the product data. One example of such listing information is price information. As noted above with reference to FIG. 2, because different pricing policies may be selected by the seller for different marketplaces, the pricing policy may be marketplace specific as it is selected by the seller and is not just a result of currency conversion.

[0106] In addition to price, the listing information may also include vendor selection parameters related to the condition of the product, as seen in FIG.

[0107] It will be appreciated by those skilled in the art that the scope of the present invention is not limited by what has been particularly shown and described above, but rather, the scope of the present invention includes combinations and subcombinations of the features described above and variations thereof that are not present in the prior art.

Claims

1. 1. A method for transforming product data for listing products on an e-commerce platform as an information processing method performed by a computer under the control of software, comprising: receiving unstructured product data in a first language-specific format; converting the unstructured product data in the first language-specific format into structured product data, wherein converting the unstructured product data in the first language-specific format into structured product data includes converting the unstructured product data in the first language-specific format into structured product data by: - Structured product data in a language-specific format; - language-independent structured product data; or converting the unstructured product data in the first language-specific format into a combination of structured product data in a language-independent format, the converting comprising: converting the unstructured product data in the first language-specific format into structured product data in a first language-specific format; converting the unstructured product data in the first language-specific format into structured product data in a second language-specific format; converting the unstructured product data in the first language-specific format into language-independent structured product data; and / or by converting the unstructured product data in the first language-specific format into at least one second language-specific structured data via language-independent structured product data; A method for transforming said product data.

2. A method for transforming product data as described in claim 1, wherein the at least one structured product data in a second language-specific format has product data in the same language as the language of the first language-specific format.

3. The structured product data in the language-specific format above: - Attributes; - a value; or - a combination of attributes and values, A method for transforming product data according to claim 1 or 2.

4. The language-independent structured product data above is: - Attribute ID; a value ID; or - a combination of an attribute ID and a value ID, The method for transforming product data according to any one of claims 1 to 3.

5. 5. The method of transforming product data according to claim 1, wherein the structured product data in a language-specific format is structured product data in a first language-specific format or at least one structured product data in a second language-specific format.

6. The language-independent structured product data above is: - a direct translation of unstructured product data in said first language-specific format; or converting unstructured product data in said first language-specific format into structured product data in said first language-specific format, and then converting said structured product data in said first language-specific format; The method for transforming product data according to claim 5.

7. 7. The method of claim 5, wherein the structured product data in the at least one second language-specific format is a transformation of the language-independent structured product data.

8. A method for transforming product data as described in any one of claim 3, claim 4 citing claim 3, claim 5 citing claim 3 or claim 4 citing claim 3, claim 6 citing claim 5 citing claim 3 or claim 4 citing claim 3, and claim 5 citing claim 3 or claim 4 citing claim 3, or claim 6 citing claim 5 citing claim 3 or claim 4 citing claim 3, which refers to unstructured product data in the first language-specific format and, if structured data corresponding to the target third-party e-commerce platform exists in a database, maps its attributes and / or values.

9. The method for transforming product data according to claim 8, further comprising: if structured data corresponding to a target third-party e-commerce platform does not exist in the database, registering the attributes and / or values ​​in the database.

10. The method for transforming product data according to any one of claims 1 to 9, wherein all or part of the obtained structured product data corresponds to the structure of at least one third party e-commerce platform.

11. 11. The method of transforming product data according to any one of claims 1 to 10, further comprising converting all or part of the resulting structured product data into a format suitable for export to at least one third party e-commerce platform.

12. 12. The method of transforming product data of any one of claims 1 to 11, wherein transforming the unstructured product data in the first language-specific format into structured product data is performed by extracting structured product data from the unstructured product data in the first language-specific format.

13. The unstructured product data in the first language-specific format is: - product title data; - Product description data; or - Includes a combination of product title data and product description data, A method for transforming product data according to any one of claims 1 to 12.

14. 14. The method of transforming product data of any one of claims 1 to 13, wherein the unstructured product data in the first language-specific format includes structured data corresponding to a third party e-commerce platform different from the target third party e-commerce platform.

15. The method for transforming product data according to any one of claims 1 to 14, wherein transforming the unstructured product data in the first language-specific format into structured product data further comprises referring to product category information of a target product.

16. You can refer to the product category information of the target product: - referencing product category information associated with the unstructured product data in the first language-specific format; - by referencing product category information accompanying the structured product data of the relevant third-party e-commerce platform; or - If the product category information is not attached, further including classifying the product category information; The method for transforming product data according to claim 15.

17. The product category information for the applicable product is: - Product category information in a language-specific format; - language-independent product category information; or - a combination of language-specific and language-independent product category information, A method for transforming product data according to claim 15 or 16.

18. 20. The method of claim 17, wherein the language-specific formatted product category information is a first language-specific formatted product category information or at least one second language-specific formatted product category information.

19. The above language-independent product category information is: - a direct translation of product category information associated with unstructured product data in said first language-specific format; or - converting product category information associated with the unstructured product data in the first language-specific format into product category information in the first language-specific format, and then converting the product category information in the first language-specific format; A method for transforming product data according to claim 17 or 18.

20. 20. The method for transforming product data according to claim 18 or 19, wherein the product category information in the at least one second language specific format is a conversion of the product category information in the language independent format.

21. The method for transforming product data according to any one of claims 18 to 20, wherein the at least one product category information in the second language-specific format has product category information in the same language as the language of the first language-specific format.

22. The method of transforming product data according to any one of claims 1 to 21, further comprising registering the resulting structured product data as a catalogue.

23. The method for transforming product data according to any one of claims 1 to 22, further comprising matching the obtained structured product data with an existing catalogue to check whether it has already been registered as a catalogue.

24. 24. The method of transforming product data as described in claim 23, further comprising, when attributes and / or values ​​not previously included are obtained, adding those attributes and / or values ​​to the catalog if the attributes and / or values ​​are already registered as a catalog.

25. 1. A system for transforming product data for listing products on an e-commerce platform, comprising at least software and computer components: a data receiving function performed by the computer under control of the software, the data receiving function operable to receive unstructured product data in a first language-specific format; a data conversion function operated by the computer under control of the software to convert the unstructured product data in the first language-specific format into structured product data, the data conversion function converting the unstructured product data in the first language-specific format into structured product data, the data conversion function - Structured product data in a language-specific format; - language-independent structured product data; or - operable to convert into a combination of structured product data in a language-specific format and structured product data in a language independent format, said converting said unstructured product data in said first language-specific format into structured product data comprising: converting the unstructured product data in the first language-specific format into structured product data in a first language-specific format; converting the unstructured product data in the first language-specific format into structured product data in a second language-specific format; converting the unstructured product data in the first language-specific format into language-independent structured product data; and / or by converting the unstructured product data in the first language-specific format into at least one second language-specific structured data via language-independent structured product data; A system for transforming said product data.

26. A system for transforming product data as described in claim 25, wherein the at least one structured product data in a second language-specific format has product data in a language that is the same as the language of the first language-specific format.

27. The structured product data in the language-specific format above: - Attributes; - a value; or - a combination of attributes and values, 27. A system for transforming product data according to claim 25 or 26.

28. The language-independent structured product data above is: - Attribute ID; a value ID; or - a combination of an attribute ID and a value ID, A system for transforming product data according to any one of claims 25 to 27.

29. 29. The system for transforming product data of any one of claims 25 to 28, wherein the structured product data in a language-specific format is structured product data in a first language-specific format or structured product data in at least one second language-specific format.

30. The language-independent structured product data above is: - a direct translation of unstructured product data in said first language-specific format; or converting unstructured product data in said first language-specific format into structured product data in said first language-specific format, and then converting said structured product data in said first language-specific format; 30. A system for transforming merchandise data as recited in claim 29.

31. 31. The system for transforming product data of claim 29 or 30, wherein the at least one second language-specific format structured product data is a transformation of the language-independent structured product data.

32. The system for transforming product data as described in any one of claims 27, claim 28 citing claim 27, claim 29 citing claim 27 or claim 28 citing claim 27, claim 30 citing claim 29 citing claim 28 citing claim 27 or claim 27, and claim 29 citing claim 28 citing claim 27 or claim 27, or claim 30 citing claim 29 citing claim 27 or claim 27, wherein the data receiving function is operable to refer to the unstructured product data in the first language-specific format and map attributes and / or values ​​of structured data corresponding to the target third party e-commerce platform if such structured data exists in a database.

33. 33. The system for transforming product data of claim 32, wherein the data receiving function is further operable to register attributes and / or values ​​in the database if structured data corresponding to the target third party e-commerce platform does not exist in the database.

34. A system for transforming product data according to any one of claims 25 to 33, wherein all or part of the obtained structured product data corresponds to the structure of at least one third party e-commerce platform.

35. 35. The system for transforming product data of any one of claims 25 to 34, wherein the data conversion functionality is further operable to convert all or part of the resulting structured product data into a format suitable for export to at least one third party e-commerce platform.

36. 36. The system for transforming product data of any one of claims 25 to 35, wherein the data conversion functionality is operable to extract structured product data from unstructured product data in the first language-specific format.

37. The unstructured product data in the first language-specific format is: - product title data; - Product description data; or - Includes a combination of product title data and product description data, A system for transforming product data according to any one of claims 25 to 36.

38. 38. The system for transforming product data of any one of claims 25 to 37, wherein the unstructured product data in the first language-specific format includes structured data corresponding to a third party e-commerce platform different from the target third party e-commerce platform.

39. The system for transforming product data according to any one of claims 25 to 38, wherein the data conversion function is further operable to refer to product category information of a target product.

40. The data conversion function further comprises: - operable to reference product category information associated with the unstructured product data in the first language-specific format; - operable to reference product category information associated with structured product data corresponding to a target third-party e-commerce platform; or - operable to classify the product category information if no product category information is attached; 40. A system for transforming merchandise data as recited in claim 39.

41. The product category information for the applicable product is: - Product category information in a language-specific format; - language-independent product category information; or - a combination of language-specific and language-independent product category information, A system for transforming product data according to claim 39 or 40.

42. 42. The system for transforming product data of claim 41, wherein the language-specific format product category information is a first language-specific format product category information or at least one second language-specific format product category information.

43. The above language-independent product category information is: - a direct translation of product category information associated with unstructured product data in said first language-specific format; or - converting product category information associated with the unstructured product data in the first language-specific format into product category information in the first language-specific format, and then converting the product category information in the first language-specific format; 43. A system for transforming product data according to claim 41 or 42.

44. 44. The system for transforming product data according to claim 42 or 43, wherein the product category information in the at least one second language-specific format is a transformation of the product category information in the language-independent format.

45. The system for transforming product data described in any one of claims 42 to 44, wherein the at least one second language-specific format product category information has product category information in the same language as the first language-specific format.

46. A system for transforming product data according to any one of claims 25 to 45, wherein the data transformation functionality is further operable to populate the resulting structured product data as a catalogue.

47. The system for transforming product data described in any one of claims 25 to 46, further comprising a matching function performed by the computer under the control of the software, the matching function being operable to match the obtained structured product data with an existing catalog to check whether it has already been registered as a catalog.

48. 48. The system for transforming product data as described in claim 47, wherein the matching function is further operable to add attributes and / or values ​​to the catalog when attributes and / or values ​​not previously included are obtained if they are already registered as a catalog.

Images