Information processing device, method and computer readable storage medium

Abstract

This disclosure relates to an information processing apparatus, method, and computer-readable storage medium, belonging to the field of computer technology. The apparatus of this disclosure includes: a task setting module configured to receive user-inputted crawling object information and crawling rules, and generate a crawling task; a task execution module configured to crawl content corresponding to the crawling object according to the crawling task; an information analysis module configured to determine a local object matching the crawling object based on the content corresponding to the crawling object, and compare the content corresponding to the matching crawling object and the local object; and an information output module configured to present the comparison result between the matching crawling object and the local object. The apparatus of this disclosure is simple and convenient for users to operate, improves the efficiency, comprehensiveness, and accuracy of obtaining competitor information, helps users quickly understand the situation, and meets different user needs.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to an information processing device, method, and computer-readable storage medium. Background Art

[0002] With the development of Internet technology, people have more and more channels to obtain information, and the amount of information is increasing. Internet technology has enriched people's daily lives. People can read, shop, entertain, socialize, and so on through the Internet.

[0003] Different types of e-commerce platforms continue to emerge, and the competition between them is becoming increasingly fierce. If e-commerce platforms want to win the market in the fierce competition, they need to pay attention to the situation of their competitors at all times.

[0004] At present, operators usually manually check the information of competitors and then compare it with the information of the platform, such as product prices, so as to adjust the information of the platform. Especially when some competitors only have application APPs, it is necessary to manually check the information of the competitor APP on the mobile phone. Summary of the invention

[0005] The inventors found that the above-mentioned method of manually obtaining competitor information is inefficient and cannot view all competitor information. Manual analysis and comparison of the platform and competitor information is prone to errors and has low accuracy.

[0006] A technical problem to be solved by the present disclosure is: how to improve the efficiency, comprehensiveness and accuracy of obtaining competitor information.

[0007] According to some embodiments of the present disclosure, an information processing device is provided, including: a task setting module, configured to receive crawling object information and crawling rules input by a user, and generate a crawling task; a task execution module, configured to crawl content corresponding to the crawling object according to the crawling task; an information analysis module, configured to determine a local object that matches the crawling object according to the content corresponding to the crawling object, and compare the matching crawling object with the content corresponding to the local object; an information output module, configured to present the comparison result of the matching crawling object and the local object.

[0008] In some embodiments, the grasping object information includes the category of the grasping object and the operation path of the first grasping object, and the grasping rules include a grasping stop condition; the task setting module is configured to automatically generate multiple operation paths of the second grasping objects based on the operation path of the first grasping object until the grasping stop condition is met, wherein the multiple second grasping objects are of the same category as the first grasping object.

[0009] In some embodiments, the crawling rule includes a crawling cycle; the task execution module is configured to crawl the content corresponding to the crawling object according to the crawling cycle.

[0010] In some embodiments, the task execution module includes a crawling client and a scheduling control unit; when the crawling rules include concurrent execution and the task execution module includes multiple crawling clients, the scheduling control unit is configured to distribute the crawling tasks to multiple crawling clients for concurrent execution according to the load of each crawling client.

[0011] In some embodiments, the information analysis module includes a product information analysis unit; the product information analysis unit is configured to extract product name information and price information based on the identifier corresponding to the captured content, segment the product name information, use the segmented words as keywords to query local objects that match the captured object, and compare the price information of the matching captured object and the local object.

[0012] In some embodiments, the information analysis module includes a promotional information analysis unit; the promotional information analysis unit is configured to determine the promotional information and the products targeted by the promotion based on the captured content, determine the local objects that match the products targeted by the promotion, and compare the promotional information of the matching products and local objects, the promotional information including the promotion type and promotion intensity.

[0013] In some embodiments, the device further includes: a storage module configured to store at least one of the information of the local object, the content of the captured object, the comparison result of the matching captured object and the local object, and the capture task.

[0014] In some embodiments, the task setting module includes: a notification setting unit; the notification setting unit is configured to receive subscription information for the captured object set by the user, and in response to changes in the content of the captured object or the matching local object information, send the content of the captured object and the matching local object information to the user's subscription address; the subscription address includes at least one of a SMS address, a website address, and an email address.

[0015] According to other embodiments of the present disclosure, an information processing method is provided, including: receiving crawling object information and crawling rules input by a user, and generating a crawling task; crawling content corresponding to the crawling object according to the crawling task; determining a local object that matches the crawling object according to the content corresponding to the crawling object, and comparing the matching crawling object with the content corresponding to the local object; and presenting the comparison results of the matching crawling object and the local object.

[0016] In some embodiments, the grasping object information includes the category of the grasping object and the operation path of the first grasping object, and the grasping rules include a grasping stop condition; generating a grasping task includes: automatically generating multiple operation paths of the second grasping objects based on the operation path of the first grasping object until the grasping stop condition is met, wherein the multiple second grasping objects are of the same category as the first grasping object.

[0017] In some embodiments, the crawling rule includes a crawling cycle; the content corresponding to the crawled object is crawled according to the crawling cycle.

[0018] In some embodiments, when the crawling rule includes concurrent execution, the crawling tasks are distributed to multiple crawling clients for concurrent execution according to the load of each crawling client.

[0019] In some embodiments, determining a local object that matches the captured object and comparing the content corresponding to the matching captured object and the local object includes: extracting product name information and price information according to the identifier corresponding to the captured content, segmenting the product name information, using the segmented words as keywords to query the local object that matches the captured object, and comparing the price information of the matching captured object and the local object.

[0020] In some embodiments, determining a local object that matches the captured object and comparing the content corresponding to the matching captured object and the local object includes: determining promotional information and the products targeted by the promotion based on the captured content, determining a local object that matches the products targeted by the promotion, and comparing the promotional information of the matching products and the local object, the promotional information including the promotion type and promotion intensity.

[0021] In some embodiments, the method further includes: storing at least one of the information of the local object, the content of the captured object, the comparison result of the matching captured object and the local object, and the capture task.

[0022] In some embodiments, the method also includes: receiving subscription information set by the user for the captured object; in response to changes in the content of the captured object or the matching local object information, sending the content of the captured object and the matching local object information to the user's subscription address; the subscription address includes at least one of a SMS address, a website address, and an email address.

[0023] According to some further embodiments of the present disclosure, an information processing apparatus is provided, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the information processing method of any of the aforementioned embodiments based on instructions stored in the memory device.

[0024] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, wherein when the program is executed by a processor, the information processing method of any of the aforementioned embodiments is implemented.

[0025] In the present disclosure, the user only needs to input the information of the captured object and the capture rules, and the information processing device can automatically capture the content required by the user, and can automatically match the captured object with the local object, compare the contents of the two and present them to the user. The user operation is simple and convenient, and the information of the captured object and the comparison and analysis results with the local object can be obtained in real time, which improves the efficiency, comprehensiveness and accuracy of obtaining competitor information, helps users quickly understand the situation, and meets the different needs of users.

[0026] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0028] Figure 1 A schematic diagram showing the structure of an information processing device according to some embodiments of the present disclosure.

[0029] Figure 2 A schematic diagram showing the structure of an information processing device according to some other embodiments of the present disclosure.

[0030] Figure 3 A flowchart illustrating an information processing method according to some embodiments of the present disclosure is provided.

[0031] Figure 4 A schematic flowchart showing information processing methods according to other embodiments of the present disclosure is provided.

[0032] Figure 5 A schematic diagram showing the structure of an information processing device according to some further embodiments of the present disclosure.

[0033] Figure 6 A schematic diagram showing the structure of an information processing device according to some further embodiments of the present disclosure. DETAILED DESCRIPTION

[0034] The technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The following description of at least one exemplary embodiment is actually only illustrative and is by no means intended to limit the present disclosure and its application or use. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0035] The present disclosure provides an information processing device, Figure 1 Give a description.

[0036] Figure 1 Figure 1 is a structural diagram of some embodiments of the information processing device disclosed in the present invention. Figure 1 As shown, the device 10 of this embodiment includes: a task setting module 110 , a task execution module 120 , an information analysis module 130 , and an information output module 140 .

[0037] The task setting module 110 is configured to receive the crawling object information and crawling rules input by the user and generate a crawling task.

[0038] The information processing device can be connected to an external display device and input device to provide a visual interface to the user. A menu can be used for the user to select the capture object, or the user can directly input the capture object information and capture rules, etc. When designing and developing an information processing device, the developer will first understand the various websites or applications (APPs) that need to be captured, and then develop different capture functions for different websites or applications (APPs). For example, for Android APP, the uiautomatorviewer.bat tool can be used to obtain the name, value, and position of each module in each page, and the name is mapped to the name displayed in the page. When the user enters the displayed name, it will be automatically converted to name and generate a language recognized by the computer.

[0039] The captured object information includes the APP, category, name, operation path, etc. where the captured object is located. The capture rules include the capture stop condition, the capture cycle, etc. For example, if a user needs to capture the page information of iPhone 7 under the mobile phone category of APP1, he can follow the operation instructions on the display interface, fill in or select to open APP1 in the first step, fill in or select the name of the mobile phone category entry "mobile phone" on the homepage in the second step, and fill in or select "iPhone 7" in the third step. The task setting module 110 will automatically generate a language that can be recognized by the computer based on the information entered by the user.

[0040] In some embodiments, the user can choose to grab multiple objects of the same category. In this case, the grab object information input by the user includes the category of the grab object and the operation path of the first grab object, and the grab rule includes a grab stop condition. The task setting module 110 is configured to automatically generate multiple operation paths of the second grab objects according to the operation path of the first grab object until the grab stop condition is met, wherein the multiple second grab objects are of the same category as the first grab object.

[0041] For example, the category of the captured object is mobile phone, and the operation path of the first captured object is the above-mentioned first step of filling in or selecting to open APP1, the second step of filling in or selecting the name of the mobile phone classification entrance in the homepage "mobile phone", and the third step of filling in or selecting "Iphone7", and the capture stop condition is to capture all objects under this category. The capture stop condition can be provided to the user as a drop-down menu for selection, for example, including capturing one object, capturing all objects under the same category, capturing all objects in the APP, etc. The task setting module 110 automatically generates the operation of returning to the mobile phone category page and clicking on the next object according to the name of all objects under the mobile phone category, thereby realizing the operation of capturing all objects under the same category. Similarly, the task setting module 110 can also automatically capture the content of different objects of different categories, and the user only needs to provide an operation path.

[0042] In some embodiments, the user can also set a crawling cycle, and the task setting module 110 sends the crawling cycle to the task execution module 120, and the task execution module 120 executes the crawling task once every crawling cycle. For example, the user can set it to run every few hours, days, etc.

[0043] The task setting module 110 receives the crawling object information and crawling rules input by the user, and can generate the following content, for example.

[0044]

[0045]

[0046] The keywords of the above content are explained as follows. click: means to simulate a click action; its attributes name and value are the name and value corresponding to the target APP module we want to click; get: means to get the content corresponding to the module with the specified module name and value; if and else: appear in pairs; the meaning is that if val1 and val2 are compared by param, if it is true, the content under if will be executed, otherwise the content under else will be executed; for: loop to execute the content inside it; break represents: number of executions; back: used to click the back button. Many complex execution paths can be combined through the above combinations. The above content can be used as a generated crawling task and sent to the task execution module 120.

[0047] The task execution module 120 is configured to crawl the content corresponding to the crawl object according to the crawl task.

[0048] The captured object is, for example, a product, and the corresponding content of the captured object is, for example, the content of the product details page, including the product name, price, product description, number of comments, number of purchases, etc. The captured object is, for example, promotional information or event information, etc. Generally, the home page of the APP will have a circular scrolling advertisement bar to play promotional information or event information, etc., and the information at this location can be captured. The corresponding content of the captured object is, for example, the picture or description information corresponding to the promotional information, etc. Information on any page can be captured, not limited to the above examples.

[0049] The Appium client can be used to crawl the content in the APP. The Appium client is a module developed based on Appium (Appium is an open source, cross-platform testing framework that can be used to test native and hybrid mobile applications) that can simulate human access to the APP on the mobile phone. It can automatically open the APP on the specified mobile phone, and then simulate human behavior such as clicking, swiping up and down; at the same time, the module can read the content displayed on the page. After the above crawling task is sent to the Appium client, it will be translated into execution code by the Appium executor to execute the crawling task.

[0050] The information analysis module 130 is configured to determine a local object that matches the captured object according to the content corresponding to the captured object, and compare the content corresponding to the matched captured object with the local object.

[0051] In some embodiments, when the captured object is a commodity, the information analysis module 130 is configured to extract the commodity name information and price information according to the identifier corresponding to the captured content, segment the commodity name information, use the segmented words as keywords to query local objects that match the captured object, and compare the price information of the matching captured objects and local objects.

[0052] As mentioned in the above embodiments, the names of different positions in the page can be obtained. According to the names corresponding to the captured content, it can be known which ones are product name information and which ones are price information. After extracting the product name information, word segmentation can be performed and used as a keyword to query the local object matching the captured object in the local database. An Elasticsearch cluster can be used, which stores the data of this platform and can automatically calculate the association score between the local object and the captured object based on the keyword, and query the local object similar to the captured object. Furthermore, in addition to comparing the price information of the captured object and the local object, the information of the number of comments and the number of purchases can also be compared. The price information of the captured object and the local object in a capture task can be compared, and the price information of the captured object and the local object in multiple capture tasks within a period of time and the changing rules of the price information can also be compared.

[0053] Furthermore, the information analysis module 130 can not only provide the comparison results of the captured object and the local object, but also analyze and give adjustment suggestions. For example, if the price difference between the captured object and the matching local object is higher than a threshold, an adjustment suggestion to lower the price is given. For another example, whether to adjust the price is determined based on the price ratio and the purchase number ratio of the matching captured object and local object. Furthermore, the weighted sum of the price ratio of the captured object and the local object and the inverse of the purchase number is calculated. If it is lower than a threshold, an adjustment suggestion to lower the price is given.

[0054] In some embodiments, when the captured object is promotional information, the information analysis module 130 is configured to determine the promotional information and the products targeted by the promotion based on the captured content, determine the local objects that match the products targeted by the promotion, and compare the promotional information of the matching products with the local objects. The promotional information includes the promotion type and the promotion intensity. The promotion types include the full reduction type, the preferential price type, the direct reduction type, etc. The promotion intensity reflects the price reduction range of the product and can be divided into different promotion intensity levels. For example, different price reduction thresholds are set, and the larger the corresponding price reduction range, the greater the promotion intensity.

[0055] When the captured object is an image, Opencv2 can be used to extract the text in the image. The text is further segmented, or the text is directly matched to see whether it contains promotional text such as full discount and discount, so as to determine the type of promotion. The text also contains product names or categories, etc. The local objects that match the products targeted by the promotion can be queried through the Elasticsearch cluster, as well as whether the local objects are on promotion. Suggestions can also be given based on the comparison results of the promotion strength of the matched captured object and the local object. For example, if the difference in the promotion strength between the matched captured object and the local object is higher than the threshold, it is recommended to increase the promotion strength.

[0056] The information output module 140 is configured to output the comparison result of the matched captured object and the local object for presentation.

[0057] The information output module 140 outputs the matching captured objects and local objects as well as the comparison results to the user's operation interface for the user to view. That is, after the user inputs the information of the captured object, etc., he clicks to issue the task to view the information of the captured object and local objects as well as the comparison results in real time.

[0058] In the method of the above embodiment, the user only needs to input the information of the captured object and the capture rules, and the information processing device can automatically capture the content required by the user, and can automatically match the captured object with the local object, compare the contents of the two and present them to the user. The user operation is simple and convenient, and the information of the captured object and the comparison and analysis results with the local object can be obtained in real time, which improves the efficiency, comprehensiveness and accuracy of obtaining competitor information, helps users quickly understand the situation, and meets the different needs of users.

[0059] Combine the following Figure 2 Some other embodiments of the information processing device disclosed herein are described.

[0060] Figure 2 FIG. 1 is a structural diagram of some other embodiments of the information processing device disclosed in the present invention. Figure 2 As shown, the device 20 of this embodiment includes: a task setting module 210, a task execution module 220, an information analysis module 230, an information output module 240, and a storage module 250.

[0061] The task setting module 210 , the task execution module 220 , the information analysis module 230 , and the information output module 240 can respectively implement the same functions as the task setting module 110 , the task execution module 120 , the information analysis module 130 , and the information output module 140 .

[0062] The task setting module 210 can also be divided into a capture setting unit 2102 and a task issuing unit 2104 .

[0063] The crawling setting unit 2102 is configured to receive crawling object information and crawling rules input by a user, and generate a crawling task.

[0064] The task issuing unit 2104 is configured to send the crawling task to the task execution module 220 or the storage module 250 .

[0065] For periodically executed tasks, the grabbing tasks may be sent to the storage module 250 first, and the task execution module 220 obtains the grabbing tasks from the storage module 250 every preset period.

[0066] Furthermore, the task setting module 210 may also include: a matching rule setting unit 2106 configured to receive a matching rule input by a user and send it to the information analysis module 130 so that the information analysis module 130 analyzes the content of the captured object according to the matching rule.

[0067] Matching rules are rules for matching captured objects with local objects, such as rules for matching product names, promotion types, etc. When a new matching rule is launched, the rule will be configured on the information processing device, and the API (Application Programming Interface) called by the rule will be associated, such as the API of the Elasticsearch cluster. The matching rule setting unit 2106 can facilitate users to modify, add, delete rules on the page without having to find R&D personnel to modify the matching code; it can improve the versatility of the information processing device disclosed in the present invention.

[0068] Further, the task setting module 210 may also include: a notification setting unit 2108, which is configured to receive subscription information set by the user for the captured object, and in response to the change in the content of the captured object or the matching local object information, send the content of the captured object and the matching local object information to the user's subscription address. The subscription address includes at least one of a text message address, a website, and an email address. The subscription information may include the identifier of the captured object, the subscription address, the sending rules, etc.

[0069] For the periodically executed crawling task notification setting unit 2108, after the crawling task of each crawling period is completed, the content of the crawled object and the matching local object information can be sent to the user's subscription address.

[0070] In some embodiments, the task execution module 220 may include a scheduling control unit 2202 and a crawling client 2204. There may be multiple crawling clients 2204.

[0071] The crawling rules set by the user may include concurrent execution, or when there are multiple crawling clients 2204, the scheduling control unit 2202 may automatically control the multiple crawling clients 2204 to execute tasks in parallel.

[0072] Furthermore, the scheduling control unit 2202 is configured to distribute the crawling tasks to multiple crawling clients for concurrent execution according to the load of each crawling client. The crawling client 2204 is configured to receive the crawling tasks assigned by the scheduling control unit 2202 and crawl the content corresponding to the crawling object. The crawling client is, for example, an Appuim client. The scheduling control unit 2202 sets the number of concurrent startup threads, and the content crawled by each thread will be allocated in advance. For example, 3 threads are set to crawl goods under the same category. When the threads are started, all goods will be divided into 3 parts, and each thread corresponds to one part. The scheduling control unit 2202 mainly receives instructions from the crawling configuration center and controls the Appium client to run, such as asking Appium to start the app, then click on those modules, crawl those contents, etc.

[0073] In some embodiments, the information analysis module 230 may include a product information analysis unit 2302 and a promotion information analysis unit 2304 .

[0074] The product information analysis unit 2302 is configured to extract product name information and price information according to the identifier corresponding to the captured content, segment the product name information, use the segmented words as keywords to query local objects that match the captured objects, and compare the price information of the matching captured objects and local objects.

[0075] The promotion information analysis unit 2304 is configured to determine the promotion information and the products targeted by the promotion based on the captured content, determine the local objects that match the products targeted by the promotion, and compare the promotion information of the matching products and local objects. The promotion information includes the promotion type and promotion intensity.

[0076] In some embodiments, the information output module 240 may include an operation interface display unit 2402 and an operation result display unit 2404 .

[0077] The operation interface display unit 2402 is used to provide an operation interface to the user, that is, an interface for the user to input the captured object information and the captured rules. The operation result display unit 2404 is used to present the comparison result of the matched captured object and the local object.

[0078] In some embodiments, the storage module 250 is configured to store at least one of the information of the local object, the content of the captured object, the comparison result of the matching captured object and the local object, and the capture task.

[0079] Further, the storage module 250 may include: an Elasticsearch cluster 2502, an Hbase cluster 2504, a Redis cluster 2506, and a Mysql cluster 2508. The Elasticsearch cluster 2502 is used to store information of local objects, such as product names, prices, promotional information, etc. The Hbase cluster 2504 is used to store the content corresponding to the captured object and the comparison results of the matching captured object and the local object, etc. The Redis cluster 2506 is used to record the information that the current capture client has captured to avoid repeated execution of multiple concurrent subtasks corresponding to the same task. The Mysql cluster 2508 is used to store the capture tasks.

[0080] The present disclosure also provides a data processing method, Figure 3 Give a description.

[0081] Figure 3 Flowcharts of some embodiments of the data processing method disclosed herein. Figure 3 As shown, the method of this embodiment includes: steps S302 to S308.

[0082] Step S302: receiving the crawling object information and crawling rules input by the user, and generating a crawling task.

[0083] As in the above-mentioned embodiment, the captured object information includes: the webpage or APP where the captured object is located, the category, name, operation path, etc. of the captured object. The capture rules include the capture stop condition, the capture cycle, etc.

[0084] In some embodiments, the grasped object information includes the category of the grasped object and the operation path of the first grasped object, and the grasping rule includes a grasping stop condition. The operation paths of multiple second grasped objects are automatically generated according to the operation path of the first grasped object until the grasping stop condition is met, wherein the multiple second grasped objects are of the same category as the first grasped object.

[0085] Step S304: crawling the content corresponding to the crawling object according to the crawling task.

[0086] In some embodiments, a crawling cycle can be set, and the content corresponding to the crawled object is crawled according to the crawling cycle. For example, the task execution cycle is set, whether it is executed only once or multiple times a day, and the set crawling task is saved to the Mysql database. After the save is successful, the scheduling control unit will receive the task notification and register the task to the application system. In the subsequent scheduling control unit application, if it is found that there is a task to be executed, the task information will be obtained from the Mysql database.

[0087] In some embodiments, multiple crawling clients can be set, and users can also set crawling rules for concurrent execution. The information processing device distributes the crawling tasks to multiple crawling clients for concurrent execution according to the load of each crawling client. For example, after the scheduling control unit obtains the task, it will check whether the task is set for multi-concurrency mode according to the task setting, and reasonably distribute the task to the corresponding Appium client according to the current load of the task cluster. When the Appium client obtains the notification, it will start running and then work according to the crawling task.

[0088] Furthermore, after the Appium client captures the content, it can call the interface to store the content data in Hbase. After the storage is successful, it can record the information that the current Appium client has captured, and call the interface to store it in Redis to avoid repeated execution of multiple concurrent subtasks corresponding to the same task. The Appium client continues to execute until it needs to stop. The user can stop the task at any time, or set the stop condition in advance. When the task executes to the set end point, the task will stop automatically, and the user can be notified that the task has been completed, and the content data captured this time and other information will be recorded.

[0089] Step S306: Determine a local object that matches the captured object according to the content corresponding to the captured object, and compare the content corresponding to the matched captured object with that of the local object.

[0090] In some embodiments, product name information and price information are extracted according to the identifier corresponding to the captured content, the product name information is segmented, the segmented words are used as keywords to query local objects matching the captured object, and the price information of the matching captured object and the local object are compared. For details, please refer to the above embodiments.

[0091] In some embodiments, promotion information and the products targeted for promotion are determined based on the captured content, local objects matching the products targeted for promotion are determined, and the promotion information of the matching products and local objects are compared, and the promotion information includes the promotion type and promotion intensity. For details, please refer to the above embodiments.

[0092] Step S308: presenting the comparison result of the matched captured object and the local object.

[0093] The user can view the matching captured objects and local objects, as well as the comparison results of the corresponding contents of the two in real time, and further perform analysis based on the comparison results.

[0094] Combine the following Figure 4 Other embodiments of the information processing method disclosed herein are described.

[0095] Figure 4Flowcharts of other embodiments of the data processing method disclosed herein. Figure 4 As shown, the method of this embodiment includes: steps S402 to S412.

[0096] Step S402: receiving crawling object information, crawling rules and subscription information for the crawling object set by the user, and generating a crawling task.

[0097] The subscription information includes, for example: a subscribed capture object, a subscription rule, a subscription address, etc. The subscription address includes at least one of a text message address, a website, and an email address.

[0098] Step S404: crawling the content corresponding to the crawling object according to the crawling task.

[0099] Step S406: Determine a local object that matches the captured object according to the content corresponding to the captured object, and compare the content corresponding to the matched captured object with that of the local object.

[0100] Step S408: presenting the comparison result of the matched captured object and the local object.

[0101] Steps S402 to S408 may refer to the implementation method of the aforementioned embodiment.

[0102] Step S410: storing at least one of the information of the local object, the content of the captured object, the comparison result of the matching captured object and the local object, and the capture task.

[0103] Reference may be made to the storage method in the aforementioned embodiment.

[0104] Step S412, in response to a change in the content of the captured object or the matching local object information, the content of the captured object and the matching local object information are sent to the user's subscription address.

[0105] Other subscription rules may also be set, such as sending captured information and the comparison results of matching captured objects and local objects at preset intervals.

[0106] The information processing apparatus in the embodiments of the present disclosure may be implemented by various computing devices or computer systems. Figure 5 as well as Figure 6 Give a description.

[0107] Figure 5 Figure 1 is a structural diagram of some embodiments of the information processing device disclosed in the present invention. Figure 5As shown, the device 50 of this embodiment includes: a memory 510 and a processor 520 coupled to the memory 510, and the processor 520 is configured to execute the information processing method in any of some embodiments of the present disclosure based on the instructions stored in the memory 510.

[0108] The memory 510 may include, for example, a system memory, a fixed non-volatile storage medium, etc. The system memory may store, for example, an operating system, an application program, a boot loader, a database, and other programs.

[0109] Figure 6 FIG. 1 is a structural diagram of some other embodiments of the information processing device disclosed in the present invention. Figure 6 As shown, the device 60 of this embodiment includes: a memory 610 and a processor 620, which are similar to the memory 510 and the processor 520 respectively. It can also include an input and output interface 630, a network interface 640, a storage interface 650, etc. These interfaces 630, 640, 650 and the memory 610 and the processor 620 can be connected, for example, through a bus 660. Among them, the input and output interface 630 provides a connection interface for input and output devices such as a display, a mouse, a keyboard, and a touch screen. The network interface 640 provides a connection interface for various networked devices, for example, it can be connected to a database server or a cloud storage server. The storage interface 650 provides a connection interface for external storage devices such as SD cards and USB flash drives.

[0110] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the information processing method in any of the embodiments of the present disclosure.

[0111] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable non-transient storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0112] The present disclosure is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present disclosure. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0113] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0114] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0115] The above description is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure should be included in the protection scope of the present disclosure.

Claims

1. An information processing device, comprising: A task setting module is configured to receive the grasping object information and grasping rules input by the user according to the operation guidance on the display interface, and generate a grasping task, wherein the grasping object information includes an operation path of a first grasping object, the operation path includes the application, category and name of the first grasping object, and the grasping rule includes a grasping stop condition, and the task setting module is configured to automatically generate a plurality of operation paths of a second grasping object according to the operation path of the first grasping object until the grasping stop condition is met, wherein the plurality of second grasping objects are of the same category as the first grasping object; A task execution module is configured to crawl the content corresponding to the crawl object according to the crawl task, wherein the task execution module includes a crawl client and a scheduling control unit. When the crawl rule includes concurrent execution and the task execution module includes multiple crawl clients, the scheduling control unit is configured to distribute the crawl task to multiple crawl clients for concurrent execution according to the load of each crawl client; An information analysis module is configured to determine a local object matching the captured object according to the content corresponding to the captured object, and compare the content corresponding to the matched captured object and the local object; The information output module is configured to present the comparison results of the matched captured objects and local objects.

2. The information processing device according to claim 1, wherein: The crawling rules include a crawling cycle; The task execution module is configured to crawl content corresponding to the crawl object according to the crawl cycle.

3. The information processing device according to claim 1, wherein: The information analysis module includes a commodity information analysis unit; The product information analysis unit is configured to extract product name information and price information according to the identifier corresponding to the captured content, segment the product name information, use the segmented words as keywords to query local objects matching the captured object, and compare the price information of the matching captured object and local object.

4. The information processing device according to claim 1, wherein: The information analysis module includes a promotion information analysis unit; The promotion information analysis unit is configured to determine the promotion information and the products targeted by the promotion based on the captured content, determine the local objects matching the products targeted by the promotion, and compare the promotion information of the matching products with the local objects, wherein the promotion information includes the promotion type and promotion intensity.

5. The information processing device according to any one of claims 1 to 4, further comprising: The storage module is configured to store at least one of the information of the local object, the content of the captured object, the comparison result of the matched captured object and the local object, and the capture task.

6. The information processing device according to any one of claims 1 to 4, wherein: The task setting module includes: a notification setting unit; The notification setting unit is configured to receive subscription information for a captured object set by a user, and in response to a change in the content of the captured object or the matching local object information, send the content of the captured object and the matching local object information to a subscription address of the user; The subscription address includes at least one of a text message address, a website, and an email address.

7. An information processing method, comprising: Receiving the grab object information and grab rules input by the user according to the operation guide on the display interface, and generating a grab task, wherein the grab object information includes the operation path of the first grab object, the operation path includes the application, category and name of the first grab object, the grab rule includes a grab stop condition, and the generating the grab task includes: automatically generating the operation paths of multiple second grab objects according to the operation path of the first grab object until the grab stop condition is met, wherein the multiple second grab objects are of the same category as the first grab object; According to the crawling task, crawl the content corresponding to the crawling object, and when the crawling rule includes concurrent execution, distribute the crawling task to multiple crawling clients for concurrent execution according to the load of each crawling client; Determine a local object that matches the captured object according to the content corresponding to the captured object, and compare the content corresponding to the matched captured object and the local object; The comparison results of the matched captured objects and local objects are presented.

8. The information processing method according to claim 7, wherein: The crawling rules include a crawling cycle; The content corresponding to the captured object is captured according to the capture cycle.

9. The information processing method according to claim 7, wherein: The determining of a local object matching the captured object and comparing the contents corresponding to the matched captured object and the local object comprises: The product name information and price information are extracted according to the identifier corresponding to the captured content, the product name information is segmented, the segmented words are used as keywords to query the local objects matching the captured objects, and the price information of the matching captured objects and local objects are compared.

10. The information processing method according to claim 7, wherein: The determining of a local object matching the captured object and comparing the contents corresponding to the matched captured object and the local object comprises: The promotion information and the products targeted by the promotion are determined based on the captured content, the local objects matching the products targeted by the promotion are determined, and the promotion information of the matching products and the local objects are compared, wherein the promotion information includes the promotion type and the promotion intensity.

11. The information processing method according to any one of claims 7 to 10, further comprising: The information of the local object, the content of the captured object, the comparison result of the matching captured object and the local object, and at least one of the capture tasks are stored.

12. The information processing method according to any one of claims 7 to 10, further comprising: Receive subscription information set by the user for the crawled object; In response to a change in the content of the captured object or the matching local object information, the content of the captured object and the matching local object information are sent to a subscription address of the user; The subscription address includes at least one of a text message address, a website, and an email address.

13. An information processing device, comprising: Memory; as well as A processor coupled to the memory, wherein the processor is configured to execute the information processing method according to any one of claims 7 to 12 based on instructions stored in the memory device.

14. A computer-readable storage medium having a computer program stored thereon, wherein: When the program is executed by a processor, the steps of the method according to any one of claims 7 to 12 are implemented.

Images