Commodity data processing system and method

Abstract

The invention relates to the technical field of data management, in particular to a commodity data processing system and method.Business data from different dimensions in a supply chain are obtained through a data management module, the business data from the different dimensions are stored through a data processing module, and when at least one business processing request from a user is received, the business processing request is sent to the user; the service processing algorithm corresponding to the service processing request is determined through the algorithm platform module, and the service processing algorithm is used for processing the service data, so that data intercommunication of users at all levels in the supply chain is realized, and the problem that information of the users at all levels in the supermarket supply chain is not intercommunicated in the prior art is solved. And the business collaboration efficiency is relatively low.

Description

Technical Field

[0001] The present invention relates to the technical field of data management, and in particular to a commodity data processing system and method. Background Art

[0002] In traditional supermarket supply chain business, due to the existence of multiple participants such as consumers, manufacturers, and operators, there is a lack of information exchange and asymmetric communication channels between consumers, manufacturers, and operators, resulting in low business collaboration efficiency and reduced operating income for users at all levels.

[0003] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0004] The main purpose of the present invention is to provide a commodity data processing system and method, aiming to solve the technical problems in the prior art of information non-intercommunication among users at all levels in the supermarket supply chain and low business collaboration efficiency.

[0005] To achieve the above-mentioned purpose, the present invention provides a commodity data processing system, which comprises: a data governance module, a data middle platform module and an algorithm middle platform module, wherein the data quality module and the algorithm middle platform module are respectively connected to the data middle platform module;

[0006] The data governance module is used to obtain business data from at least two dimensions in the supply chain;

[0007] The data middle platform module is used to store the business data and at least one business processing request from the user;

[0008] The algorithm platform module is used to determine the corresponding business processing algorithm based on the business processing request, and call the business processing algorithm to perform data processing on the business data to execute the business process corresponding to the business processing request

[0009] Optionally, the data governance module is further used to obtain first business data through a first data interface, where the first business data is business data associated with a public domain user;

[0010] The second business data in the private domain database is read through the second data interface, where the second data interface is used to establish a connection with the private domain database.

[0011] Optionally, the data governance module is also used to

[0012] Acquire the public domain service data of the public domain user through the first data interface;

[0013] The public domain business data is decrypted to obtain first business data.

[0014] Optionally, the data governance module is further used to obtain a public domain user key;

[0015] Decrypt the public domain business data according to the public domain user key to obtain the friendly business plain text data;

[0016] The friendly business plain text data is encrypted based on a preset encryption algorithm to obtain the first business data. Optionally, the data middle platform module is also used to encrypt the second business data based on a preset encryption algorithm to obtain the encrypted second business data;

[0017] In response to the received service processing request, the corresponding target second service data or the corresponding first service data is extracted.

[0018] Optionally, the algorithm middle platform module is further used to call the business processing algorithm corresponding to the business processing request;

[0019] The target second business data or the first target business data is processed based on the business processing algorithm to execute the business process corresponding to the business processing request.

[0020] Optionally, the algorithm middle platform is also used to preprocess the target first business data or the target second business data, and the preprocessing at least includes: data cleaning, data conversion, data sampling and feature extraction.

[0021] Optionally, the types of the business processing request include at least: product selection request, pricing request, marketing request, recommendation request, forecast request, replenishment request and virtual inventory request.

[0022] In addition, to achieve the above-mentioned purpose, the present invention further proposes a commodity data processing method, which is applied to the commodity data processing system as described above, and the commodity data processing method includes:

[0023] The data governance module obtains business data from at least two dimensions in the supply chain;

[0024] The data middle platform module stores the business data and at least one business processing request from the user;

[0025] The algorithm platform module determines the corresponding business processing algorithm based on the business processing request, and calls the business processing algorithm to perform data processing on the business data to execute the business process corresponding to the business processing request.

[0026] Optionally, the data governance module obtains first business data through a first data interface, where the first business data is business data associated with a public domain user;

[0027] The second business data in the private domain database is read through the second data interface, where the second data interface is used to establish a connection with the private domain database.

[0028] One or more technical solutions proposed in the present invention have at least the following technical effects: the present invention obtains business data from different dimensions in the supply chain through the data governance module, and stores these business data of different dimensions through the data middle platform module, and when receiving at least one business processing request from the user, determines the business processing algorithm corresponding to the business processing request through the algorithm middle platform module, so as to perform a data processing flow on the business data through the business processing algorithm, thereby realizing data interoperability among users at all levels in the supply chain, avoiding the technical problems of information non-interoperability and low business collaboration efficiency among users at all levels in the supermarket supply chain in the prior art. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0030] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0031] Figure 1 It is a schematic diagram of the architecture of the commodity data processing system of the present invention;

[0032] Figure 2 It is a schematic diagram of the control logic flow in the commodity data processing system of the present invention;

[0033] Figure 3 FIG. 1 is a flow chart of a first embodiment of a commodity data processing method according to the present invention.

[0034] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0035] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0036] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0037] Based on this, the embodiment of the present invention provides a commodity data processing system, referring to Figure 1 , Figure 1 It is a schematic diagram of the architecture of a first embodiment of a commodity data processing system of the present invention.

[0038] In this embodiment, the commodity data processing system includes: a data governance module, a data middle platform module and an algorithm middle platform module, and the data quality module and the algorithm middle platform module are respectively connected to the data middle platform module;

[0039] The data governance module is used to obtain business data from at least two dimensions in the supply chain;

[0040] The data middle platform module is used to store the business data and at least one business processing request from the user;

[0041] The algorithm middle platform module is used to determine the corresponding business processing algorithm based on the business processing request, and call the business processing algorithm to perform a data processing flow on the business data to execute the business flow corresponding to the business processing request.

[0042] It should be noted that the commodity data processing system in this embodiment is supported by the data governance module, the data middle platform module, and the algorithm platform module. With the help of the interconnection between the modules, the data management of the supply chain is standardized and secure. Among them, the data middle platform is based on the lake-warehouse integration and storage-computing separation technology to achieve unified access and storage of internal and external data sources, breaking the data silos. At the same time, in the face of the collection and processing of multi-source heterogeneous massive data, the data middle platform builds a real-time data warehouse that integrates streams and batches, and uses a high-availability streaming computing framework to ensure the real-time transmission of massive data and the rate of response to service needs; at the same time, in multi-scenario applications for the supply chain, machine learning, deep learning, knowledge graphs, operations optimization, simulation and other intelligent technical means are used, and the algorithms corresponding to various scenarios are integrated into corresponding scenario models and stored in the algorithm middle platform module. When faced with different scenario requirements, it can solve business problems in multiple scenarios such as product selection, pricing, marketing, and recommendation, deeply explore data value, and break through business bottlenecks.

[0043] In this embodiment, the data governance module includes six sub-modules: metadata management, data standard management, data model management, data quality management, data security management, and data asset management. It is connected to the unified user center, log center, message center, alarm center, and process center, unifies user authentication and access control, and can unify monitoring and process management to ensure standardized and secure data management, forming a complete data governance value system and data asset map, and providing a good data processing foundation.

[0044] The data middle platform can store business data from at least two dimensions of the supply chain, as well as historical business data. The data middle platform is based on lake-warehouse integration and storage-computing separation technology to achieve unified access and storage of internal and external data sources, breaking down data silos.

[0045] The algorithm middle platform supports the storage and operation of algorithms for multiple intelligent technologies such as machine learning, deep learning, knowledge graphs, operations optimization, simulation, etc., to solve business problems in multiple scenarios such as product selection, pricing, marketing, recommendation, forecasting, replenishment, virtual inventory, etc.

[0046] Furthermore, the data governance module is further used to obtain first business data through a first data interface, where the first business data is business data associated with a public domain user;

[0047] The second business data in the private domain database is read through the second data interface, where the second data interface is used to establish a connection with the private domain database.

[0048] It should be understood that the first data interface is used to connect to a database storing various types of business data of public domain users, thereby obtaining the business data of public domain users from the public domain database, and the second data interface directly reads various private domain business data stored in the supply chain. In this embodiment, the public domain refers to business data outside the specified supply chain, and the private domain refers to historical business data generated within the specified supply chain.

[0049] Furthermore, the data governance module is also used to

[0050] Acquire the public domain service data of the public domain user through the first data interface;

[0051] The public domain business data is decrypted to obtain first business data.

[0052] Furthermore, the data governance module is also used to obtain a public domain user key;

[0053] Decrypt the public domain business data according to the public domain user key to obtain the friendly business plain text data;

[0054] The friendly business plaintext data is encrypted based on a preset encryption algorithm to obtain first business data.

[0055] In the specific implementation, refer to Figure 2 Since the data format, storage standard, etc. of public domain business data are different from those of private domain business data, in order to improve the operating efficiency of subsequent business processes, this embodiment can be limited to decryption processing of public domain business data to obtain the plaintext data of friendly businesses of public domain users, and then encrypt the plaintext data of friendly businesses according to the encryption rules of private domain business data, thereby unifying the formats of public domain business data and private domain business data and improving the efficiency of subsequent business processes.

[0056] Furthermore, the data middle platform module is also used to encrypt the second business data based on a preset encryption algorithm to obtain encrypted second business data;

[0057] In response to the received service processing request, the corresponding target second service data or the corresponding first service data is extracted.

[0058] Furthermore, the algorithm middle platform module is also used to call the business processing algorithm corresponding to the business processing request;

[0059] The target second business data or the first target business data is processed based on the business processing algorithm to execute the business process corresponding to the business processing request.

[0060] It can be understood that, in order to adapt to different business processing requests, a specific algorithm can be called to perform business process processing on the target second business data or the first business data stored in the data middle platform module. In this embodiment, the types of business processing requests include at least: product selection requests, pricing requests, marketing requests, recommendation requests, forecast requests, replenishment requests and virtual inventory requests. This embodiment does not impose specific restrictions on this.

[0061] Furthermore, the algorithm middle platform is also used to preprocess the target first business data or the target second business data, and the preprocessing at least includes: data cleaning, data conversion, data sampling and feature extraction.

[0062] The algorithm platform provides end-to-end full-process modeling capabilities, including data preprocessing, feature engineering, model training, model evaluation, and model deployment, making the entire modeling process more standardized and automated. The entire process of model training is displayed in a visual and easy-to-understand way through the visual computation graph (DAG). Users can model by simply dragging and dropping, freeing themselves from the tedious implementation and debugging of the code and focusing more on the business.

[0063] Furthermore, the types of business processing requests include at least: product selection requests, pricing requests, marketing and promotion requests, recommendation requests, forecasting requests, replenishment requests and virtual inventory requests.

[0064] This embodiment obtains business data from different dimensions in the supply chain through the data governance module, and stores these business data of different dimensions through the data middle platform module. When receiving at least one business processing request from the user, the algorithm middle platform module determines the business processing algorithm corresponding to the business processing request, so as to perform data processing on the business data through the business processing algorithm, thereby realizing data interoperability among users at all levels in the supply chain.

[0065] Based on this, the embodiment of the present invention provides a commodity data processing method, referring to Figure 3 , Figure 3 The figure is a flow chart of a first embodiment of a commodity data processing method of the present invention.

[0066] In this embodiment, the commodity data processing method includes:

[0067] Step S10: The data governance module obtains business data from at least two dimensions.

[0068] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a control computer or a cloud server, etc. The following takes the cloud server as an example to illustrate this embodiment and the following embodiments.

[0069] Step S20: The data middle platform module stores the business data and at least one business processing request from the user.

[0070] Step S30: The algorithm middle platform module determines the corresponding business processing algorithm based on the business processing request, and calls the business processing algorithm to perform a data processing flow on the business data to execute the business flow corresponding to the business processing request.

[0071] It should be noted that the commodity data processing system in this embodiment is supported by the data governance module, the data middle platform module, and the algorithm platform module. With the help of the interconnection between the modules, the data management of the supply chain is standardized and secure. Among them, the data middle platform is based on the lake-warehouse integration and storage-computing separation technology to achieve unified access and storage of internal and external data sources, breaking the data silos. At the same time, in the face of the collection and processing of multi-source heterogeneous massive data, the data middle platform builds a real-time data warehouse that integrates streams and batches, and uses a high-availability streaming computing framework to ensure the real-time transmission of massive data and the rate of response to service needs; at the same time, in multi-scenario applications for the supply chain, machine learning, deep learning, knowledge graphs, operations optimization, simulation and other intelligent technical means are used, and the algorithms corresponding to various scenarios are integrated into corresponding scenario models and stored in the algorithm middle platform module. When faced with different scenario requirements, it can solve business problems in multiple scenarios such as product selection, pricing, marketing, and recommendation, deeply explore data value, and break through business bottlenecks.

[0072] In this embodiment, the data governance module includes six sub-modules: metadata management, data standard management, data model management, data quality management, data security management, and data asset management. It is connected to the unified user center, log center, message center, alarm center, and process center, unifies user authentication and access control, and can unify monitoring and process management to ensure standardized and secure data management, forming a complete data governance value system and data asset map, and providing a good data processing foundation.

[0073] The data middle platform can store business data from at least two dimensions of the supply chain, as well as historical business data. The data middle platform is based on lake-warehouse integration and storage-computing separation technology to achieve unified access and storage of internal and external data sources, breaking down data silos.

[0074] The algorithm middle platform supports the storage and operation of algorithms for multiple intelligent technologies such as machine learning, deep learning, knowledge graphs, operations optimization, simulation, etc., to solve business problems in multiple scenarios such as product selection, pricing, marketing, recommendation, forecasting, replenishment, virtual inventory, etc.

[0075] Furthermore, the data governance module is further used to obtain first business data through a first data interface, where the first business data is business data associated with a public domain user;

[0076] The second business data in the private domain database is read through the second data interface, where the second data interface is used to establish a connection with the private domain database.

[0077] It should be understood that the first data interface is used to connect to a database storing various types of business data of public domain users, thereby obtaining the business data of public domain users from the public domain database, and the second data interface directly reads various private domain business data stored in the supply chain. In this embodiment, the public domain refers to business data outside the specified supply chain, and the private domain refers to historical business data generated within the specified supply chain.

[0078] This embodiment obtains business data from different dimensions in the supply chain through the data governance module, and stores these business data of different dimensions through the data middle platform module. When receiving at least one business processing request from the user, the algorithm middle platform module determines the business processing algorithm corresponding to the business processing request, so as to perform a data processing flow on the business data through the business processing algorithm, thereby realizing data interoperability among users at all levels in the supply chain, avoiding the technical problems of information non-interoperability and low business collaboration efficiency among users at all levels in the supermarket supply chain in the prior art.

[0079] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0080] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0081] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the commodity data processing method in the above-mentioned embodiment.

[0082] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination of the above.

[0083] The computer-readable storage medium may be included in the commodity data processing device; or may exist independently without being assembled into the commodity data processing device.

[0084] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the commodity data processing device, the commodity data processing device can process commodity data.

[0085] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0086] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0087] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0088] The readable storage medium provided in this application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned commodity data processing method, and can solve the technical problems of commodity data processing. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the commodity data processing method provided in the above-mentioned embodiment, and will not be repeated here.

[0089] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned commodity data processing method when executed by a processor.

[0090] The computer program product provided by this application can solve the technical problem of commodity data processing. Compared with the prior art, the beneficial effects of the computer program product provided by this application are the same as the beneficial effects of the commodity data processing method provided by the above embodiment, which will not be repeated here.

[0091] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A commodity data processing system, characterized in that: The commodity data processing system includes: a data governance module, a data middle platform module and an algorithm middle platform module, and the data quality module and the algorithm middle platform module are respectively connected to the data middle platform module; The data governance module is used to obtain business data from at least two dimensions in the supply chain; The data middle platform module is used to store the business data and at least one business processing request from the user; The algorithm middle platform module is used to determine the corresponding business processing algorithm based on the business processing request, and call the business processing algorithm to perform a data processing flow on the business data to execute the business flow corresponding to the business processing request.

2. The system according to claim 1, characterized in that The data governance module is further used to obtain first business data through a first data interface, where the first business data is business data associated with a public domain user; The second business data in the private domain database is read through the second data interface, where the second data interface is used to establish a connection with the private domain database.

3. The system according to claim 2, characterized in that The data governance module is further used to obtain the public domain business data of the public domain user through the first data interface; The public domain business data is decrypted to obtain first business data.

4. The system according to claim 3, characterized in that The data governance module is also used to obtain public domain user keys; Decrypt the public domain business data according to the public domain user key to obtain the friendly business plain text data; The friendly business plaintext data is encrypted based on a preset encryption algorithm to obtain first business data.

5. The system according to claim 1, wherein: The data middle platform module is further used to encrypt the second business data based on a preset encryption algorithm to obtain the encrypted second business data; In response to the received service processing request, the corresponding target second service data or the corresponding first service data is extracted.

6. The system according to claim 5, characterized in that The algorithm middle platform module is also used to call the business processing algorithm corresponding to the business processing request; The target second business data or the first target business data is processed based on the business processing algorithm to execute the business process corresponding to the business processing request.

7. The system according to claim 1, characterized in that The algorithm middle platform is also used to preprocess the target first business data or the target second business data, and the preprocessing at least includes: data cleaning, data conversion, data sampling and feature extraction.

8. The system of claim 1, wherein: The types of business processing requests include at least: product selection requests, pricing requests, marketing and promotion requests, recommendation requests, forecasting requests, replenishment requests and virtual inventory requests.

9. A commodity data processing method, characterized in that: The commodity data processing method is applied to the commodity data processing system as described in claims 1 to 8 above, and the commodity data processing method comprises: The data governance module obtains business data from at least two dimensions in the supply chain; The data middle platform module stores the business data and at least one business processing request from the user; The algorithm middle platform module determines the corresponding business processing algorithm based on the business processing request, and calls the business processing algorithm to perform a data processing flow on the business data to execute the business flow corresponding to the business processing request.

10. The method according to claim 9, characterized in that The data governance module obtains first business data through a first data interface, where the first business data is business data associated with a public domain user; The second business data in the private domain database is read through the second data interface, where the second data interface is used to establish a connection with the private domain database.

Images