Data processing method and device, equipment, storage medium and computer program product

Abstract

The application discloses a data processing method, device, equipment, storage medium and computer program product. The method comprises the following steps: obtaining a search request of a resource request object, the search request comprising a search text and a target display form; determining a matching resource identifier, the matching resource identifier being matched with the search text; obtaining a resource display mode corresponding to the target display form based on a mapping table element taking the matching resource identifier as a primary key, wherein the mapping table element comprises a mapping relationship between the matching resource identifier and one or more resource display information, and each resource display information comprises a resource display form corresponding to resource data and a resource display mode for displaying the resource data according to the resource display form; and controlling the resource request object to display the resource data according to the resource display mode corresponding to the target display form. The application can improve the adaptability of the resource display mode and the search request object and optimize the resource display effect.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of Internet, and particularly relates to a data processing method, a data processing device, a data processing equipment, a computer storage medium and a computer program product. BACKGROUND

[0002] The Internet provides access to various resources, such as image files, audio files, video files, web pages and the like. As a key component in the infrastructure of the Internet, the search engine can automatically collect various resources from the network, organize and process the information according to certain rules, and provide search services.

[0003] With the continuous development of Internet technology, network resources are rapidly expanding, and resource access methods are various, such as resource access through computer web ports and small program ports. How the search engine provides effective search guidance for various access methods and presents search results that meet search needs is a major research hotspot at present. SUMMARY

[0004] The present application provides a data processing method, device, equipment, storage medium and computer program product, which can improve the adaptability of resource display method and search request object and optimize the resource display effect.

[0005] In one aspect, the present application provides a data processing method, comprising:

[0006] obtaining a search request, the request comprising a search text and a target display form, the target display form being determined based on a resource request object initiating the search request;

[0007] determining a matching resource identifier, the resource data indicated by the matching resource identifier being matched with the search text;

[0008] obtaining a resource display method corresponding to the target display form based on a mapping table element taking the matching resource identifier as a primary key, wherein the mapping table element comprises a mapping relationship between the matching resource identifier and one or more resource display information, each resource display information comprises a resource display form of resource data corresponding to the resource display form and a resource display method of displaying resource data according to the resource display form, and the resource display forms included in different resource display information are different;

[0009] controlling the resource request object to display resource data according to the resource display method corresponding to the target display form.

[0010] In one aspect, the present application provides a data processing device, comprising:

[0011] The acquisition unit is configured to acquire a search request, the request comprising a search text and a target display form, the target display form being determined based on a resource request object initiating the search request;

[0012] The processing unit is configured to acquire a search request, the request comprising a search text and a target display form, the target display form being determined based on a resource request object initiating the search request; determine a matching resource identifier, the resource data indicated by the matching resource identifier matching the search text; based on a mapping table element taking the matching resource identifier as a primary key, acquire a resource display manner corresponding to the target display form, wherein the mapping table element comprises a mapping relationship between the matching resource identifier and one or more resource display information, each resource display information comprising a resource display form corresponding to the resource data and a resource display manner of displaying the resource data according to the resource display form, the resource display forms comprised by different resource display information being different; control the resource request object to display the resource data according to the resource display manner corresponding to the target display form.

[0013] In an implementation manner, the acquisition unit is further configured to acquire document data of a resource provider, the document data comprising resource data, a first identifier of the resource provider, a second identifier of the resource data, one or more resource display forms corresponding to the resource data, and a resource display manner corresponding to each resource display form; and the processing unit is further configured to determine, based on the first identifier and the second identifier, a resource identifier corresponding to the resource data; and determine, based on the resource identifier corresponding to the resource data, the one or more resource display forms, and the resource display manner corresponding to each resource display form, the mapping table element.

[0014] In an implementation manner, the processing unit is further configured to splice the first identifier and the second identifier to obtain a spliced result; and determine the spliced result as the resource identifier corresponding to the resource data; or the processing unit is further configured to perform a hash operation on the spliced result, and determine the resource identifier corresponding to the resource data according to a result of the hash operation.

[0015] In an implementation manner, the acquisition unit is further configured to receive the document data sent by the resource provider; or the acquisition unit is further configured to capture page source code information of the resource provider about the resource data, and parse the page source code information to acquire the document data; wherein the one or more resource display forms corresponding to the resource data and the resource display manner corresponding to each resource display form are added to the page source code information by the resource provider when detecting a capturing operation about the resource data.

[0016] In an implementation manner, the processing unit is further configured to acquire resource data, determine page display data of the resource data according to the resource display mode corresponding to the target display mode, and send the page display data to the resource request object, so that the resource request object displays the resource data according to the page display data.

[0017] In an implementation manner, the processing unit is further configured to acquire resource data, and send the resource data and the resource display mode corresponding to the target display mode to the resource request object, so that the resource request object displays the resource data according to the resource display mode corresponding to the target display mode.

[0018] In an implementation manner, the processing unit is further configured to query an index database, determine a target index matching the search text from the index database, wherein the index database includes one or more indexes, each index includes a mapping relationship between a keyword of resource data and a resource identifier, the keyword in the target index matches the search text, and the resource identifier in the target index is determined as the matching resource identifier.

[0019] In an aspect, the present application provides a data processing device, including a processor adapted to implement one or more computer programs, and a computer storage medium, the computer storage medium stores one or more computer programs, the one or more computer programs are loaded by the processor and implement the data processing method in the aspect of the present application.

[0020] In an aspect, the present application provides a computer readable storage medium, the computer readable storage medium stores a computer program, the computer program includes program instructions, the program instructions are executed by a processor to make the processor implement the data processing method in the aspect.

[0021] In an aspect, the present application provides a computer program product, the computer program product includes computer instructions stored in a computer readable storage medium. The processor of the computer equipment reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer equipment implements the data processing method provided in the aspect and various optional manners.

[0022] The application can obtain a search request of a resource request object, the search request including search text and a target display form. According to the search text, a matching resource identifier corresponding to resource data matched with the search text can be obtained. In a mapping table element with a resource identifier as a primary key, a resource display mode corresponding to the target display form is found, and the resource request object is controlled to display resource data according to the resource display mode corresponding to the target display form. By using the data processing method provided by the application, the target display form matched with the resource request object and the resource display mode corresponding to the target display form can be obtained in the mapping table element, and the resource data is presented according to the resource display mode, so that the display effect of the resource data in the resource request object can be optimized. BRIEF DESCRIPTION OF DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description are only some embodiments of the application, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0024] Figure 1 A structural schematic diagram of a data processing system provided by an embodiment of the application;

[0025] Figure 2 A flowchart of a data processing method provided by an embodiment of the application;

[0026] Figure 3 A scene diagram of obtaining a resource display mode in a data processing method provided by an embodiment of the application;

[0027] Figure 4a A display effect diagram of resource data provided by an embodiment of the application;

[0028] Figure 4b Another display effect diagram of resource data provided by an embodiment of the application;

[0029] Figure 5 A flowchart of a data processing method provided by an embodiment of the application;

[0030] Figure 6 A structural schematic diagram of a data processing device provided by an embodiment of the application;

[0031] Figure 7 A structural schematic diagram of a data processing device provided by an embodiment of the application; DETAILED DESCRIPTION

[0032] The technical solutions in the present application will be described clearly and completely in the present application in combination with the drawings in the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all the other embodiments obtained by those skilled in the art without creative work belong to the protection scope of the present application.

[0033] In order to facilitate understanding, the terms involved in the present application are first described.

[0034] 1. Search engine

[0035] The search engine is responsible for automatically collecting various resources from the network and providing search services. Its working process is divided into three parts: first, the spider crawls and captures web page information on the Internet and stores it in the original web page database; second, the information in the original web page database is extracted and organized, and an index library is established; third, according to the keywords input by the user, the relevant documents are quickly found, the found results are sorted, and the query results are returned to the user.

[0036] 2. Index library

[0037] The index refers to the general term of the database file used for retrieval in the search engine. Each retrieval data is accessed and read index file, and each update data is modified to the index file.

[0038] The establishment of the index library can be summarized as follows: collecting and capturing web page data from different channels, extracting relevant web page information (including the uniform resource locator (URL) where the web page is located, the encoding type, the keywords contained in the page content, the keyword position, the generation time, the size, the link relationship with other web pages, the title, the source, the category, whether it has been parsed, etc.); according to a specific algorithm (such as a relevance algorithm), the relevance (or importance) of each keyword in the page content and the hyperlinks of each web page is obtained, and then the index database of the web page is established using these relevant information, forming the index database; link information extraction, link information (including anchor text, link information, etc.) is sent to the link database; the index library is composed of the above index database and the link database, and is stored for query and call.

[0039] 3. Primary key

[0040] The database primary key refers to a column or a combination of multiple columns, which can uniquely identify each row in the table, and can enforce the entity integrity of the table through it. The primary key is mainly used for association with the foreign key of other tables, and modification and deletion of text records.

[0041] Defining a primary key for a table in a database diagram automatically creates a primary key index, which is a specific type of unique index. The index requires that each value in the primary key be unique. It also allows fast access to data when the primary key index is used in a query.

[0042] 4. Cloud technology

[0043] Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network within a wide area network or local area network to realize data calculation, storage, processing, and sharing. Blockchain is a new application mode of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, and encryption algorithm. It is essentially a decentralized database and a series of data blocks associated using cryptographic methods. Each data block contains information about a batch of network transactions, which is used to verify the validity (anti-fake) of the information and generate the next block.

[0044] For search engine optimization problems, for example, optimizing the display effect of search results on different search request objects by a search engine, the present application proposes the following two optimization methods:

[0045] Method one: The developers of the resource party website inform the search engine of the consistency relationship between different link pages by filling in the canonical tag in the pages of the website. The tag sample is as follows:

[0046] <link rel＝"canonical"href＝"http: www.example.com page.phpitem＝purse">

[0047] By specifying the tag, the search engine will preferentially include and display the page in the tag, realizing link normalization. When including resources, it is relatively convenient to remove duplicates, saving space occupied by resources. For example, for different site links of the same resource, only one end corresponding link can be included.

[0048] Method two: The developers of the resource party website describe the mapping relationship of the web pages of the two sets by specifying a regular expression, so that the search engine only needs to include the resources of the personal computer (PC) site when including resources, and adapt the resources of the PC site using regular rules, so as to display on the mobile (mobile) site. For example:

[0049] PC site page: http: / / www.example.com / v265984.html

[0050] M site page: http: / / m.example.com / v265984.html

[0051] The mapping relationship can be represented by the following regular rules:

[0052] PC site rule: http: / / www.example.com / (\w).html

[0053] M site rule: http: / / m.example.com / $1.html

[0054] Problems of the above-mentioned methods:

[0055] Method one: when the links of resources are collected, in order to save resource occupation space, usually only one link of the same resource in the same site is collected. However, the links of different sites can adapt to different use scenarios. For example, a developer develops a www site of PC end and an M site of mobile daunt. The canonical URL of the page of the M site points to the corresponding PC end page. Thus, when a search engine collects, only the resource of the PC site is collected. When a search user initiates a search on a mobile device, the display result of the PC end is obtained, the display effect adapted to the mobile device cannot be obtained, and the user experience is poor.

[0056] Method two: usually, a search engine tends to collect a PC site, and then adapt to an M site on a mobile end. If a website only has an M site at the beginning, and then a www site is developed, the ordinary adaptation method is difficult to handle this case. At the same time, if there is an applet or other forms of pages, the regular adaptation is more difficult to play a role in it. In addition, the regular adaptation has a prerequisite, that is, the links of different pages need to have a certain mapping relationship. If the mapping relationship does not exist between different links, the regular cannot be written. If multiple links of a page exist on a certain end or a certain application, the regular adaptation cannot play a role, and the role of link unification cannot be achieved. From the perspective of a website developer, the regular matching method requires the developer to know that the search engine has collected all the pages of the website, and requires the developer to understand the mapping relationship between different pages of the resource. The technical requirements for the developer are too high, and the practicality is not high.

[0057] Based on this, the embodiment of the present application proposes a data processing method. When a resource provider accesses a search engine, the search engine allocates a first identifier to the resource provider, which represents a unique resource provider, and unifies all forms of resources of the resource provider to the same owner. When the resource provider submits data to the search engine, each resource carries a second identifier corresponding to the resource, and the identifier of the resource display form of the terminal or application capable of displaying the resource and the resource display mode of each resource display form. When the search request object displays the search result, the search engine can obtain the search request of the resource request object, determine the matching resource identifier corresponding to the resource data matched with the search text according to the search text included in the search request, find the target display form matched with the search request and the resource display mode corresponding to the target display form from the mapping table element corresponding to the matching resource identifier, and display the above resource data on the search request object according to the resource display mode.

[0058] The above data processing method can be applied to the structure diagram of the data processing system as shown in Figure 1 The data processing system as shown in Figure 1 The data processing system includes one or more terminals 110 and one or more servers 120. The terminal 110 and the server 120 are connected through a limited network or an unlimited network to establish a communication connection and exchange data.

[0059] The terminal 110 can be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, a vehicle terminal, a smart home appliance, a smart voice interaction device, etc.

[0060] The search engine installed and running in the terminal 110 is used to realize the search service according to the data processing scheme proposed by the embodiment of the present application. The search engine in the terminal 110 can obtain the search request of the resource request object (such as a small program, a mobile terminal web page, etc.) in the terminal 110, match the search text in the search request to obtain a matching resource identifier, and the resource data indicated by the matching resource identifier matches the search text; according to the target display form included in the search request, the resource display mode corresponding to the target display form is obtained from the mapping table element with the matching resource identifier as the primary key, and the above resource data is displayed on the resource request object in the terminal 110 according to the resource display mode. The mapping table element can be stored in the terminal 110 or in the server 120.

[0061] The server 120 can be a stand-alone physical server, a server cluster composed of multiple physical servers or a distributed system, and can also be a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, and basic cloud computing services such as big data and artificial intelligence platforms.

[0062] The server 120 can be configured to store document data of resource providers obtained by the search engine in the terminal 110, including resource data, a first identifier of the resource provider, a second identifier of the resource data, one or more resource display forms corresponding to the resource data, and a resource display manner corresponding to each resource display form. The server 120 can also be configured to store a mapping data table for easy query and use by the terminal 110.

[0063] The above briefly introduces the data processing method provided by the embodiments of the present application. The specific implementation manner of the data processing method is described in detail below.

[0064] It can be understood that in the specific embodiments of the present application, the search text of the resource request object, the target display form, the document data of the resource provider, and other related data are involved. When the above embodiments of the present application are applied to specific products or technologies, the related data needs to obtain the permission or consent of the related object, and the collection, use and processing of the related data needs to comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0065] Please refer to Figure 2 , Figure 2 A flowchart of a data processing method provided by an embodiment of the present application is shown in the figure. The method is applied to a data processing device, which is a terminal or a server. As shown in Figure 2 the figure, the data processing method includes but is not limited to the following steps:

[0066] S201: Obtain a search request, the search request including a search text and a target display form, the target display form being determined based on a resource request object initiating the search request.

[0067] The resource request object initiating the search request can be any application in the terminal, such as a mobile terminal browser, a computer terminal browser, a small program, etc. According to the resource request object initiating the search request, the target display form corresponding to each resource request object can be determined as a mobile terminal page, a computer terminal page and a small program page respectively. The search text includes but is not limited to words, phrases, articles, etc. It can also be text information obtained by analyzing pictures, videos, links, etc.

[0068] S202: Determine a matching resource identifier, the resource data indicated by the matching resource identifier matching the search text.

[0069] The resource data is data belonging to the resource provider and stored in a database. The matching resource identifier indicates that the resource data matches the search text, which means that the resource data indicated by the matching resource identifier includes keywords, phrases, or other content of the search text.

[0070] In an implementation, the matching resource identifier is determined based on a first identifier of the resource provider of the resource data and a second identifier of the resource data. The first identifier of the resource provider can be a unique identifier assigned by the data processing device to the resource provider when the resource provider accesses the data processing device, which is used to unify all resource data belonging to the resource provider to the same owner. For example, resource provider A is a tourism service company that develops PC web pages, mobile APPs, public accounts, and small programs. Through the first identifier of resource provider A, the above-mentioned several different forms of products and data of A can be unified to resource provider A, which facilitates the normalized storage of resource data belonging to the same owner.

[0071] In an implementation, a resource provider can have multiple resource data, which can be articles, web pages, videos, etc. One resource data can exist in multiple forms, for example, one resource data can have PC pages, HTML5 pages, small program pages, and public account articles. The above-mentioned various forms all have a common second identifier indicating that the form belongs to a resource display form of the resource data. Correspondingly, each resource display form has a corresponding resource display mode for displaying the matched resource data in the corresponding resource display form at the resource request end.

[0072] In an implementation, the first identifier and the second identifier can be spliced to obtain a splicing result, and the splicing result is determined as the resource identifier corresponding to the resource data. For example, the first identifier is "98" and the second identifier is "1128". According to the order of the first identifier first and the second identifier second, the matching resource identifier can be "98#1128", wherein "#" represents any kind of connector, which is not limited in the present application.

[0073] In an implementation manner, the spliced result of the first identifier and the second identifier can be subjected to a hash operation, and a resource identifier corresponding to the resource data is determined according to a hash operation result. For example, assuming that the first identifier is "42" and the second identifier is "1123", the spliced result can be "42#1123" according to the order of the first identifier in the front and the second identifier in the back. According to a hash algorithm, a string can be calculated according to the following formula:

[0074] string=MD5(“42#1123”)=“c42d5c99284ea08f6c1a9cf7b93224fa”

[0075] wherein, MD5 represents MD5 Message-Digest Algorithm in the hash algorithm, which is a widely used password hash function, and can generate a 128-bit (16-byte) hash value to ensure the integrity of information transmission. Alternatively, the string represented by the string can be used as the resource identifier, and a string of a certain length can also be selected as the resource identifier according to the string. If the resource identifier is N (N is a positive integer) characters, the first N characters or the last N characters of the string can be selected as the resource identifier, or if N is greater than the number of characters of the string, characters can be added in front of or behind the string to determine the resource identifier. For example, if N is 10, the resource identifier can be the first 10 bits of the string, that is, the resource identifier is "c42d5c9928". It should be noted that the specific algorithm used for the hash operation is not limited in the embodiments of the present application.

[0076] S203: obtaining a resource display mode corresponding to the target display form based on the mapping table element with the matching resource identifier as the primary key.

[0077] wherein, the mapping table element includes a mapping relationship between the matching resource identifier and one or more resource display information, each resource display information includes a resource display form corresponding to the resource data and a resource display mode for displaying the resource data according to the resource display form, and the resource display forms included in different resource display information are different; the resource display mode can be a link for opening a document of the resource data on a corresponding terminal or application.

[0078] In an implementation manner, the target index matching the search text is found from the index database by querying the index database. The index database includes one or more indexes, each of which contains a mapping relationship between a keyword of resource data and a resource identifier, and the resource identifier to which the resource data belongs can be found according to the keyword of resource data indicated by the index. The keyword in the target index matches the search text, for example, the keyword in the target index is the same as the search text. According to the found target index, the resource identifier in the target index can be determined as the matching resource identifier. For example, refer to Figure 3 A scene diagram of obtaining a resource display mode is provided for an embodiment of the present application. As shown in Figure 3 The data processing device can obtain a mapping table element set from a database, which can be a database in the data processing device or a database in a server. Figure 3 The doc_id in the table 1 indicates the resource identifier, the content indicates the data resource of the resource provider, the show_type indicates the resource display form, and the loc indicates the resource display mode corresponding to the resource display form. Other features can be features such as matching degree scoring of resource data and index, which are not limited by the present application.

[0079] In an implementation manner, if the resource display mode corresponding to the target display form exists in the mapping table element with the matching resource identifier as the primary key, S204 is executed; otherwise, the data processing can be stopped, and optionally, other resource display modes of the resource data in the mapping table element can be selected as the resource display mode corresponding to the target display form, so that S204 is executed.

[0080] S204: The resource request object displays the resource data according to the resource display mode corresponding to the target display form.

[0081] By implementing S201-S203, the search result required by the search request, that is, the resource data, is determined, and the resource display mode of the target display form is determined according to the target display form of the voluntary request object initiating the search request, so that the resource data can be displayed in the resource request object according to the resource display mode. For example, if the determined target display form is a mini-program page, the obtained resource data can be displayed in the resource request object in the form of a mini-program.

[0082] For example, Figure 4a And Figure 4b The two different resource display modes are the effect diagrams of the same resource provider, that is, the weather network. For example, refer to Figure 4a , Figure 4aThe effect schematic diagram of displaying resource data according to the resource display mode corresponding to the target display mode of the resource request object is shown when the target display mode of the resource request object is a PC web page. Please refer to Figure 4b , Figure 4b The effect schematic diagram of displaying resource data according to the resource display mode corresponding to the target display mode of the resource request object is shown when the target display mode of the resource request object is a PC web page.

[0083] In an implementation mode, the page display data of the resource data can be determined according to the resource display mode corresponding to the target display mode by the search engine in the data processing device; the page display data is sent to the resource request object in the terminal, so that the resource request object displays the resource data based on the page display data. For example, if the resource request object in the data processing device, such as a mini-program application, searches through the search engine, the search engine determines that the target resource display mode matched with the mini-program application is a mini-program page after processing, it is determined that the resource data needs to be displayed to the resource request object in the form of a mini-program page; the search engine can perform content adjustment or format change operation on the resource data to obtain the page display data, and the resource request object can display the resource data based on the page display data, so that the resource request object can display the resource data in a suitable way, and the display effect of the resource data on the resource request object is optimized.

[0084] In an implementation mode, the resource data can be obtained by the data processing device, and the resource data and the resource display mode corresponding to the target display mode are sent to the resource request object, so that the resource request object displays the resource data according to the resource display mode corresponding to the target display mode. For example, if the resource request object in the terminal, such as a mobile terminal search website, searches through the search engine, the server receives the resource request of the search website, determines the resource data matched with the resource request and the resource display mode corresponding to the target display mode of the resource data after processing, and sends the resource data and the resource display mode to the terminal. The resource request object can display the resource data according to the resource display mode, such as displaying the resource data through a web page by the mobile terminal search website.

[0085] The embodiment of the application can obtain a search request of a resource request object, the search request comprising a search text and a target display form. According to the search text, a matching resource identifier corresponding to resource data matched with the search text can be obtained. In a mapping table element taking the resource identifier as a primary key, a resource display mode corresponding to the target display form is found, and the resource request object is controlled to display resource data according to the resource display mode corresponding to the target display form. By using the data processing method provided by the application, the target display form matched with the resource request object and the resource display mode corresponding to the target display form can be obtained in the mapping table element, and the result of the search request is displayed according to the resource display mode, thereby improving the use experience during searching. In addition, by the embodiment of the application, the first identifier is used to identify each resource provider, and the second identifier is used to identify each resource data of each resource provider, thereby reducing the difficulty of resource normalization of the data processing device. The resource identifier is determined based on the first identifier and the second identifier, the mapping table element is constructed taking the resource identifier as the primary key, and the mapping relationship between the resource identifier and the index is established, thereby reducing the data magnitude required by the data processing device to establish the index library, facilitating finding the resource data matched with the search request and the resource display form adapted to the resource request object during searching, and optimizing the resource display effect.

[0086] Please refer to Figure 5 , Figure 5 A flowchart of a data processing method provided by the embodiment of the application is shown in the figure. The method is applied to a data processing device, which is a terminal or a server. As shown in Figure 5 , the data processing method comprises but is not limited to the following steps:

[0087] S501: Obtain document data of a resource provider, the document data comprising resource data, a first identifier of the resource provider, a second identifier of the resource data, one or more resource display forms corresponding to the resource data, and a resource display mode corresponding to each resource display form.

[0088] The first identifier of the resource provider can be a unique identifier allocated by the data processing device to the resource provider when the resource provider accesses the data processing device, which is used to normalize all resource data belonging to the resource provider to the same owner. One resource data can have multiple display forms, but when submitted to a search engine, different display forms of the same resource data need to use the same second document identifier, thereby facilitating resource normalization. For example, as shown in Table 1, one resource data can have multiple forms such as a PC page, an HTML5 page, an applet, and a public number article.

[0089] Table 1: Different display forms and display modes of the same resource data

[0090]

[0091] The resource data displayed in the four display modes shown in Table 1 is the same resource data, the display modes (such as web links) corresponding to each display mode are different, but the second identifiers are the same.

[0092] In an implementation manner, if the document access is initiated by the resource provider, the document data actively sent by the resource provider can be received; or, when the data processing device crawls network information through a spider, the document data can be acquired by crawling page source code information of the resource provider about the resource data, and parsing the page source code information, wherein the one or more resource display modes corresponding to the resource data and the resource display mode corresponding to each resource display mode are added into the page source code information by the resource provider when detecting the crawling operation about the resource data.

[0093] S502: Determine the resource identifier corresponding to the resource data based on the first identifier and the second identifier.

[0094] The resource data indicated by the resource identifier corresponding to the data resource is the resource data in the resource provider that matches the second identifier.

[0095] In an implementation manner, the first identifier and the second identifier can be spliced to obtain a splicing result, and the splicing result can be determined as the resource identifier corresponding to the resource data. For example, assuming that the first identifier is "98" and the second identifier is "1128", the resource identifier can be "98#1128" according to the order of the first identifier in the front and the second identifier in the back, wherein "#" represents any kind of connector, which is not limited in the present application.

[0096] In an implementation manner, the splicing result obtained by splicing the first identifier and the second identifier can be subjected to a hash operation, and the resource identifier corresponding to the resource data can be determined according to the hash operation result. For example, assuming that the first identifier is "42" and the second identifier is "1123", the splicing result can be "42#1123" according to the order of the first identifier in the front and the second identifier in the back. According to the hash algorithm, a string can be calculated according to the following formula:

[0097] string=MD5(“42#1123”)=“c42d5c99284ea08f6c1a9cf7b93224fa”

[0098] Wherein, MD5 represents MD5 Message-Digest Algorithm in Hash algorithm, which is a widely used cryptographic hash function, and can produce a 128-bit (16 bytes) hash value to ensure the integrity of information transmission. Alternatively, the string represented string can be used as a resource identifier, and a certain length of string can also be selected as a resource identifier according to the string. If the resource identifier is specified as N (N is a positive integer) characters, the first N characters or the last N characters of the string can be selected as the resource identifier, or if N is greater than the number of characters in the string, characters can be added in front of or behind the string to determine the resource identifier. For example, if N is 10, the resource identifier can be the first 10 characters of the string, that is, the resource identifier is "c42d5c9928".

[0099] S503: Determine the mapping table element based on the resource identifier corresponding to the resource data, one or more resource display forms, and the resource display mode corresponding to each resource display form.

[0100] In the embodiment of the present application, the resource identifier can be used as the primary key, and each resource display form of the resource data corresponding to the resource identifier and the resource display mode corresponding to each resource display form can be saved in the same mapping table element, and different resource display forms and their corresponding resource display forms can be stored in different columns in the mapping table element. Alternatively, as shown in Figure 3 The plurality of mapping table elements belonging to the same resource provider form a mapping table element set, which records the mapping relationship between the resource identifier and the resource display state, the resource display mode of each resource data corresponding to the resource provider.

[0101] S504: Store the document data and the mapping table element of the resource provider.

[0102] In the embodiment of the present application, the obtained document data and mapping table element can be stored in the database of the data processing device according to the first identifier of the resource provider, and all resource data and mapping table elements belonging to the same resource provider can be stored together. Wherein, the database can be a terminal database or a server database, and the present application does not limit it.

[0103] S505: Establish a search index according to the resource data and the resource identifier of the resource data.

[0104] In the embodiment of the present application, one or more indexes are included in the index database, and the indexes can be used to find resource data matching the indexes. The resource identifier corresponding to the resource data matching the index is mapped with the index, so that each index contains the mapping relationship between the keyword of the resource data and the resource identifier, and the resource identifier to which the resource data belongs can be found according to the keyword of the resource data indicated by the index; the keyword in the target index matches the search text.

[0105] In an implementation manner, the step of establishing the index database can be: obtaining text information and extracting relevant web page information (including the URL where the web page is located, the encoding type, the keywords contained in the page content, the keyword position, the generation time, the size, the link relationship with other web pages, the title, the source, the category, whether it has been parsed, etc.) by analyzing the crawled page source code information of the resource provider or the obtained document data of the resource provider; wherein the web page can be a PC web page, an HTML5 web page, a small program web page, etc.; calculating the relevance (or importance) of each keyword in the page content and hyperlinks of each web page according to a certain relevance algorithm, establishing a web page index database based on the relevant information, and constituting the index database; extracting link information, sending the link information (including anchor text, link information, etc.) into a link database, and providing a basis for web page rating; identifying each word in the web page through a dictionary file, and assigning a unique word identification number (word ID); and establishing each index according to the word ID. When the keyword is input for searching, the search keyword is converted into a word ID for analysis and processing, so as to find all relevant web pages matching the keyword from the index database of the web page.

[0106] The embodiment of the present application allocates a unique second identifier to the resource provider, and determines the resource identifier corresponding to each resource data according to the second identifier of each resource data in the resource provider, so as to store different resource display forms of the same resource data and the resource display modes corresponding to each resource display form in the form of a mapping table element, reduces the difficulty of resource normalization of the data processing device, and reduces the data order required by the data processing device to establish the index library; through the mapping table element, the different resource display forms of the same resource and the display modes corresponding to each resource display form can be mapped, so as to match appropriate resource display modes for the resource request end when displaying the search result, improve the adaptability of the resource display mode to the search request object, and optimize the resource display effect.

[0107] Please refer to Figure 6 , Figure 6 A structural schematic diagram of a data processing device provided by the embodiment of the present application is shown in FIG. 1. Figure 6As shown, the data processing apparatus comprises:

[0108] The acquisition unit 610 is configured to acquire a search request, the request comprising a search text and a target display form, the target display form being determined based on a resource request object initiating the search request;

[0109] The processing unit 620 is configured to acquire a search request, the request comprising a search text and a target display form, the target display form being determined based on a resource request object initiating the search request; determine a matching resource identifier, the resource data indicated by the matching resource identifier matching the search text; based on a mapping table element taking the matching resource identifier as a primary key, acquire a resource display mode corresponding to the target display form, wherein the mapping table element comprises a mapping relationship between the matching resource identifier and one or more resource display information, each resource display information comprising a resource display form corresponding to resource data and a resource display mode for displaying the resource data according to the resource display form, the resource display forms comprised by different resource display information being different; control the resource request object to display the resource data according to the resource display mode corresponding to the target display form.

[0110] In an implementation manner, the acquisition unit 610 is further configured to acquire document data of a resource provider, the document data comprising resource data, a first identifier of the resource provider, a second identifier of the resource data, one or more resource display forms corresponding to the resource data, and a resource display mode corresponding to each resource display form; and the processing unit is further configured to determine a resource identifier corresponding to the resource data based on the first identifier and the second identifier; and determine the mapping table element based on the resource identifier corresponding to the resource data, the one or more resource display forms, and the resource display mode corresponding to each resource display form.

[0111] In an implementation manner, the processing unit 620 is further configured to splice the first identifier and the second identifier to obtain a spliced result; and determine the spliced result as the resource identifier corresponding to the resource data; or the processing unit 620 is further configured to perform a hash operation on the spliced result, and determine the resource identifier corresponding to the resource data according to a result of the hash operation.

[0112] In an implementation manner, the acquisition unit 610 is further configured to receive the document data sent by the resource provider; or the acquisition unit 610 is further configured to capture page source code information of the resource provider about the resource data, and parse the page source code information to acquire the document data; wherein the one or more resource display forms corresponding to the resource data and the resource display mode corresponding to each resource display form are added to the page source code information by the resource provider when detecting a capturing operation about the resource data.

[0113] In an implementation manner, the processing unit 620 is further configured to acquire resource data, determine page display data of the resource data according to the resource display mode corresponding to the target display mode, and send the page display data to the resource request object, so that the resource request object displays the resource data according to the page display data.

[0114] In an implementation manner, the processing unit 620 is further configured to acquire resource data, and send the resource data and the resource display mode corresponding to the target display mode to the resource request object, so that the resource request object displays the resource data according to the resource display mode corresponding to the target display mode.

[0115] In an implementation manner, the processing unit 620 is further configured to query an index database, determine a target index matching the search text from the index database, wherein the index database includes one or more indexes, each index includes a mapping relationship between a keyword of resource data and a resource identifier, the keyword in the target index matches the search text, and the resource identifier in the target index is determined as the matching resource identifier.

[0116] According to an embodiment of the present application, Figure 2 and Figure 5 the steps involved in the data processing method shown in Figure 6 may be executed by each unit in the data processing apparatus shown in Figure 2 For example, the steps S201 and Figure 5 S501 shown in Figure 6 may be executed by the acquisition unit 610 in Figure 2 , and the steps S202, S203, S204, and Figure 5 S502, S503, S504, S505 in Figure 6 may be executed by the processing unit 620 in .

[0117] According to an embodiment of the present application, Figure 6 each unit in the data processing apparatus shown in may be combined into one or several units respectively or all, or some of the units can be further split into a plurality of sub-units with smaller functions, and the same operations can be achieved without affecting the implementation of the technical effects of the embodiments of the present application. The above units are logically divided, and in actual application, the functions of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the data processing apparatus can also include other units, and in actual application, these functions can also be assisted by other units, and can be implemented by multiple units.

[0118] It can be understood that the functions of the functional units of the data processing apparatus described in the embodiments of the present application can be specifically implemented according to the methods in the above method embodiments, and the specific implementation process can refer to the related description of the above method embodiments, which will not be repeated here.

[0119] The embodiments of the present application can obtain a search request of a resource request object, the search request including a search text and a target display form. According to the search text, a matching resource identifier corresponding to resource data matching the search text can be obtained. In a mapping table element with the resource identifier as the primary key, a resource display mode corresponding to the target display form is found, and the resource request object is controlled to display resource data according to the resource display mode corresponding to the target display form. By using the data processing method provided by the present application, the target display form matching the resource request object and the resource display mode corresponding to the target display form can be obtained in the mapping table element, and the result of the search request is displayed according to the resource display mode, which improves the use experience during searching. In addition, by the embodiments of the present application, each resource provider can be identified by a first identifier, and each resource data of each resource provider can be identified by a second identifier, which reduces the difficulty of resource normalization by the data processing device. The resource identifier is determined based on the first identifier and the second identifier, the mapping table element is constructed with the resource identifier as the primary key, and the mapping relationship between the resource identifier and the index is established, which reduces the data magnitude required by the data processing device to establish the index library, facilitates finding the resource data matching the search request and the resource display form adapted to the resource request object during searching, and optimizes the resource display effect.

[0120] Please refer to Figure 7 , Figure 7 A structural schematic diagram of a data processing device provided by the embodiments of the present application. The data processing device described in the embodiments of the present application is used to execute the data processing method described above, including a processor 710, a communication interface 720 and a memory 730. The processor 710, the communication interface 720 and the memory 730 can be connected through a bus or other means, and the embodiments of the present application take the connection through the bus as an example.

[0121] The processor 710 (or CPU (Central Processing Unit)) is the computing core and control core of the computer device, which can parse various instructions in the computer device and process various data of the computer device. For example, the CPU can be used to parse the power-on / off instruction sent to the computer device and control the computer device to perform power-on / off operation; for another example, the CPU can transmit various interactive data between the internal structures of the computer device, and the like. The communication interface 720 can optionally include a standard wired interface, a wireless interface (such as Wi-Fi, a mobile communication interface, etc.), and is controlled by the processor 710 to receive and send data. The memory 730 is a memory device in the computer device, used to store programs and data. It can be understood that the memory 730 herein can include a built-in memory of the computer device, and of course can also include an extended memory supported by the computer device. The memory 730 provides a storage space that stores an operating system of the computer device, which can include but is not limited to: an Android system, an iOS system, a Windows Phone system, and the like, and the present application is not limited thereto.

[0122] In the embodiments of the present application, the processor 710 executes the following operations by running the executable program code in the memory 730:

[0123] In an implementation manner, the processor 710 can also execute the following operations by running the executable program code in the memory 730: obtaining a search request, the request including a search text and a target display form, the target display form being determined based on a resource request object initiating the search request; determining a matching resource identifier, the resource data indicated by the matching resource identifier matching the search text; obtaining a resource display mode corresponding to the target display form based on a mapping table element taking the matching resource identifier as a primary key, wherein the mapping table element includes a mapping relationship between the matching resource identifier and one or more resource display information, each resource display information including a resource display form corresponding to resource data and a resource display mode for displaying the resource data according to the resource display form, and the resource display forms included in different resource display information are different; and controlling the resource request object to display the resource data according to the resource display mode corresponding to the target display form.

[0124] In an implementation, the processor 710, by running the executable program code in the memory 730, can further perform the following operations: obtaining document data of a resource provider, the document data comprising resource data, a first identifier of the resource provider, a second identifier of the resource data, one or more resource presentation forms corresponding to the resource data, and a resource presentation manner corresponding to each resource presentation form; determining a resource identifier corresponding to the resource data based on the first identifier and the second identifier; and determining a mapping table element based on the resource identifier corresponding to the resource data, the one or more resource presentation forms, and the resource presentation manner corresponding to each resource presentation form.

[0125] In an implementation, the processor 710, by running the executable program code in the memory 730, can further perform the following operations: splicing the first identifier and the second identifier to obtain a splicing result; determining the splicing result as the resource identifier corresponding to the resource data; or the processing unit is further configured to perform a hash operation on the splicing result, and determine the resource identifier corresponding to the resource data based on a result of the hash operation.

[0126] In an implementation, the processor 710, by running the executable program code in the memory 730, can further perform the following operations: receiving the document data sent by the resource provider; or, scraping page source code information of the resource provider about the resource data, and parsing the page source code information to obtain the document data; wherein the one or more resource presentation forms corresponding to the resource data and the resource presentation manner corresponding to each resource presentation form are added to the page source code information by the resource provider when detecting a scraping operation about the resource data.

[0127] In an implementation, the processor 710, by running the executable program code in the memory 730, can further perform the following operations: obtaining resource data; determining page presentation data of the resource data according to a resource presentation manner corresponding to a target presentation form; and sending the page presentation data to a resource request object, so that the resource request object presents the resource data based on the page presentation data.

[0128] In an implementation, the processor 710, by running the executable program code in the memory 730, can further perform the following operations: obtaining resource data; sending the resource data and a resource presentation manner corresponding to a target presentation form to a resource request object, so that the resource request object presents the resource data according to the resource presentation manner corresponding to the target presentation form.

[0129] In an implementation manner, the processor 710 can also perform the following operations by running the executable program code in the memory 730: querying an index database, determining a target index matching the search text from the index database, wherein the index database comprises one or more indexes, each index comprises a mapping relationship between a keyword of resource data and a resource identifier, the keyword in the target index matches the search text, and the resource identifier in the target index is determined as the matching resource identifier.

[0130] The embodiment of the present application can obtain a search request of a resource request object, the search request comprising a search text and a target display form, according to the search text, a matching resource identifier corresponding to resource data matching the search text can be obtained, in a mapping table element taking the resource identifier as a primary key, a resource display mode corresponding to the target display form is found, and the resource request object is controlled to display the resource data according to the resource display mode corresponding to the target display form. By using the data processing method provided by the present application, the target display form matching the resource request object and the resource display mode corresponding to the target display form can be obtained in the mapping table element, and the result of the search request is displayed according to the resource display mode, thereby improving the use experience during searching. In addition, by using the embodiment of the present application, each resource provider can be identified by a first identifier, and each resource data of each resource provider can be identified by a second identifier, thereby reducing the difficulty of resource normalization of the data processing device; the resource identifier is determined based on the first identifier and the second identifier, the mapping table element is constructed taking the resource identifier as the primary key, and the mapping relationship between the resource identifier and the index is established, thereby reducing the data order required by the data processing device to establish the index library, facilitating finding the resource data matching the search request and the resource display form matching the resource request object during searching, and optimizing the resource display effect.

[0131] The embodiment of the present application further provides a computer readable storage medium, the computer readable storage medium stores instructions, when the instructions are run on a computer, the computer executes the data processing method as described in the embodiment of the present application. The specific implementation manner can refer to the foregoing description, and will not be described here.

[0132] The embodiment of the present application further provides a computer program product or a computer program, the computer program product or the computer program comprises computer instructions, the computer instructions are stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device executes the data processing method as described in the embodiment of the present application. The specific implementation manner can refer to the foregoing description, and will not be described here.

[0133] The terms "first", "second", etc. in the specification and claims of the present application and the drawings are used to distinguish different objects, and are not used to describe a particular order. In addition, the term "comprising" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, device, product or equipment including a series of steps or units is not limited to the steps or units listed, but can optionally further include steps or units not listed, or can optionally further include other steps units inherent to the process, method, device, product or equipment.

[0134] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be realized in electronic hardware, computer software or a combination of both. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of the examples have been described in the above description in a general manner. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. A skilled person can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0135] The method and related apparatus provided by the embodiments of the present application are described with reference to the method flowchart and / or structural schematic diagram provided by the embodiments of the present application. Each flow and / or block in the method flowchart and / or structural schematic diagram, and the combination of the flows and / or blocks in the flowchart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate a means for implementing the functions specified in the flowchart and / or block diagram. Figure 1 The functions specified in one flow or multiple flows and / or structural schematic Figure 1 The functions specified in one flow or multiple flows and / or structural schematic Figure 1 The functions specified in one flow or multiple flows and / or structural schematic Figure 1 The functions specified in one flow or multiple flows and / or structural schematic Figure 1 The functions specified in one flow or multiple flows and / or structural schematic The functions specified in one flow or multiple flows and / or structural schematic

[0136] The above descriptions are only the preferred embodiment of the application, of course, cannot be used to limit the scope of the application, therefore, the equivalent variations made by the claims of the application, still belongs to the scope of the application covered.

Claims

1. A data processing method, characterized in that: include: Obtain document data of a resource provider, the document data including resource data, a first identifier of the resource provider, a second identifier of the resource data, one or more resource display forms corresponding to the resource data, and a resource display method corresponding to each resource display form; Determining a resource identifier corresponding to the resource data based on the first identifier and the second identifier; Determine a mapping table element based on the resource identifier corresponding to the resource data, the one or more resource display forms, and the resource display mode corresponding to each resource display form; wherein the mapping table element uses the resource identifier as a primary key; Obtaining a search request, the search request including a search text and a target display form, the target display form being determined based on a resource request object that initiates the search request; Determining a matching resource identifier, where the resource data indicated by the matching resource identifier matches the search text; Obtaining, based on a mapping table element with the matching resource identifier as a primary key, a resource display mode corresponding to the target display mode, wherein the mapping table element with the matching resource identifier as a primary key includes a mapping relationship between the matching resource identifier and one or more types of resource display information, each type of resource display information including a resource display mode corresponding to the resource data indicated by the matching resource identifier and a resource display mode for displaying the resource data indicated by the matching resource identifier according to the resource display mode, with different resource display information including different resource display modes; The resource request object is controlled to display the resource data indicated by the matching resource identifier according to the resource display mode corresponding to the target display form.

2. The method according to claim 1, characterized in that The determining, based on the first identifier and the second identifier, a resource identifier corresponding to the resource data includes: Concatenate the first identifier and the second identifier to obtain a concatenation result; Determine the splicing result as the resource identifier corresponding to the resource data; or, A hash operation is performed on the splicing result, and a resource identifier corresponding to the resource data is determined according to the hash operation result.

3. The method according to claim 1, characterized in that The obtaining of document data from a resource provider includes: receiving the document data sent by the resource provider; or, Crawl the page source code information of the resource provider regarding the resource data, and parse the page source code information to obtain the document data; wherein, one or more resource display forms corresponding to the resource data and the resource display method corresponding to each resource display form are added to the page source code information by the resource provider when detecting the crawling operation regarding the resource data.

4. The method according to any one of claims 1 to 3, characterized in that The controlling the resource request object to display the resource data indicated by the matching resource identifier according to the resource display mode corresponding to the target display form includes: Acquire the resource data indicated by the matching resource identifier; Determining page display data of the resource data indicated by the matching resource identifier according to the resource display mode corresponding to the target display form; The page display data is sent to the resource request object, so that the resource request object displays the resource data indicated by the matching resource identifier based on the page display data.

5. The method according to any one of claims 1 to 3, characterized in that The controlling the resource request object to display the resource data indicated by the matching resource identifier according to the resource display mode corresponding to the target display form includes: Acquire the resource data indicated by the matching resource identifier; The resource data indicated by the matching resource identifier and the resource display mode corresponding to the target display form are sent to the resource request object, so that the resource request object displays the resource data indicated by the matching resource identifier according to the resource display mode corresponding to the target display form.

6. The method according to any one of claims 1 to 3, characterized in that Determining the matching resource identifier includes: Querying an index database and determining a target index that matches the search text from the index database; wherein the index database includes one or more indexes, each index including a mapping relationship between a keyword of resource data and a resource identifier; and the keyword in the target index matches the search text; The resource identifier in the target index is determined as a matching resource identifier.

7. A data processing device, characterized in that: The device comprises: A processing unit is configured to: obtain document data of a resource provider, the document data including resource data, a first identifier of the resource provider, a second identifier of the resource data, one or more resource display forms corresponding to the resource data, and a resource display method corresponding to each resource display form; determine a resource identifier corresponding to the resource data based on the first identifier and the second identifier; determine a mapping table element based on the resource identifier corresponding to the resource data, the one or more resource display forms, and the resource display method corresponding to each resource display form; wherein the mapping table element uses the resource identifier as a primary key; An acquiring unit, configured to acquire a search request, wherein the search request includes a search text and a target display form, wherein the target display form is determined based on a resource request object that initiates the search request; The processing unit is further configured to: determine a matching resource identifier, wherein the resource data indicated by the matching resource identifier matches the search text; obtain a resource display mode corresponding to the target display form based on a mapping table element with the matching resource identifier as the primary key, wherein the mapping table element with the matching resource identifier as the primary key includes a mapping relationship between the matching resource identifier and one or more resource display information, each type of resource display information including a resource display mode corresponding to the resource data indicated by the matching resource identifier and a resource display mode for displaying the resource data indicated by the matching resource identifier according to the resource display mode, wherein different resource display information includes different resource display modes; and control the resource request object to display the resource data indicated by the matching resource identifier according to the resource display mode corresponding to the target display form.

8. A data processing device, characterized in that: include: a processor adapted to execute one or more computer programs; and A computer storage medium storing one or more computer programs, wherein the one or more computer programs are loaded by the processor and implement the data processing method according to any one of claims 1 to 6.

9. A computer storage medium, characterized in that The computer storage medium includes a computer program, and when the computer program is executed by a processor, it is used to implement the data processing method according to any one of claims 1 to 6.

10. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a computer storage medium. When the computer program is executed by a processor, it is used to implement the data processing method according to any one of claims 1 to 6.

Images