Resource search method and related device

Abstract

The invention discloses a resource searching method and a related device, and relates to the field of data retrieval. Target search operation feature data associated with search operation of the resource content is extracted from a preset simulation database according to the resource content, and the preset simulation database comprises search operation feature data obtained by counting various manual operation contents when manual search is carried out on a media platform. And according to the target search operation feature data, generating a search process task for the resource content, and according to the concurrent execution quantity determined in the target time period, performing concurrent execution on the search process task. According to the method, the search process task is constructed by adopting the feature data of each operation when the real person searches the content on the platform, so that the search process task has high similarity with a real person search behavior during operation, the platform cannot intercept a search program, and the resource acquisition efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of data retrieval technology, and in particular to a resource search method and related devices. Background Art

[0002] At present, most media platforms are based on multimedia content production as their main profit model. For the purpose of protecting their own copyrighted content, each platform usually uses crawlers to crawl media resources on other platforms on the Internet to verify whether other platforms have infringing content. For the purpose of protecting data on their own platforms, other platforms usually set up some anti-crawler technologies, which leads to a decrease in the efficiency of crawling resources and cannot effectively protect the copyrighted content of the platform. Summary of the invention

[0003] In view of the above problems, the present application provides a resource search method and related devices to achieve the purpose of improving resource crawling efficiency. The specific scheme is as follows:

[0004] The first aspect of the present application provides a resource search method, comprising:

[0005] Get the resource content to be searched within the target time period;

[0006] Extracting target search operation feature data associated with the search operation of the resource content from a preset simulation database according to the resource content, the preset simulation database including: search operation feature data obtained by statistically analyzing various manual operation contents when searching manually on a media platform;

[0007] Generating a search process task for the resource content according to the target search operation characteristic data;

[0008] The search process tasks are concurrently executed according to the concurrent execution quantity determined by the target time period.

[0009] In a possible implementation, the target search operation characteristic data includes: one or more of the total duration of stay on the search page, browsing actions, and the interval duration between the browsing actions, and generating the search process task for the resource content according to the target search operation characteristic data includes:

[0010] When the target search operation characteristic data includes the total stay time, the total stay time is scaled according to the task execution strategy and used as the total execution time of the search process task;

[0011] When the target search operation characteristic data includes the browsing action and the interval duration, the browsing action is inserted according to the execution order of the browsing action and the interval duration to obtain the search process task.

[0012] In a possible implementation, the step of generating a search process task for the resource content according to the target search operation characteristic data further includes:

[0013] If the total execution time exceeds the target execution time, the search process task is split according to the keywords representing the resource content to obtain search process subtasks;

[0014] The concurrent execution quantity is updated according to the quantity of the search process subtasks.

[0015] In a possible implementation, when the target search operation characteristic data further includes: when an event of interest is triggered by browsing the current search content, the step of generating a search process task for the resource content according to the target search operation characteristic data further includes:

[0016] The judgment operation on the event of interest is inserted into the total execution time to obtain the search process task.

[0017] In a possible implementation, when the target search operation characteristic data further includes: frequency data of triggering an erroneous operation, generating a search process task for the resource content according to the target search operation characteristic data further includes:

[0018] The misoperation judgment strategy generated according to the frequency data is inserted into the total execution time to obtain the search process task.

[0019] In a possible implementation, the total duration of the stay is scaled according to the task execution strategy to serve as the total execution duration of the search process task, including:

[0020] Determine whether the total amount of the current search process tasks within the target time period is within the preset task total amount range corresponding to the target time period;

[0021] If yes, the total duration of stay is taken as the total execution duration;

[0022] If not, the total duration of stay is shortened in proportion and used as the total execution duration.

[0023] In a possible implementation, the resource search method further includes:

[0024] If there is an idle time period within the target time period, adding a new search process task to the idle time period;

[0025] If the idle time does not exist in the target time period, the concurrent execution amount of the search process tasks in the target time period is increased according to the request execution ratio in the target time period, so as to add the new search process tasks to the target time period for concurrent execution.

[0026] A second aspect of the present application provides a resource search device, comprising:

[0027] Search content acquisition module, used to obtain resource content to be searched within a target time period;

[0028] A feature data matching module is used to extract target search operation feature data associated with the search operation of the resource content from a preset simulation database according to the resource content, wherein the preset simulation database includes: search operation feature data obtained by statistically analyzing various manual operation contents when searching manually on a media platform;

[0029] A search task generating module, used to generate a search process task for the resource content according to the target search operation characteristic data; and

[0030] The search task execution module is used to concurrently execute the search process tasks according to the concurrent execution quantity determined by the target time period.

[0031] A third aspect of the present application provides a computer program product, comprising computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements the resource search method of the first aspect or any implementation of the first aspect.

[0032] A fourth aspect of the present application provides an electronic device, comprising at least one processor and a memory connected to the processor, wherein:

[0033] The memory is used to store computer programs;

[0034] The processor is used to execute the computer program so that the electronic device can implement the resource search method of the above-mentioned first aspect or any implementation manner of the first aspect.

[0035] A fifth aspect of the present application provides a computer storage medium, which carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can use the resource search method of the first aspect or any implementation of the first aspect.

[0036] By means of the above technical scheme, the resource search method provided by the present application is, after obtaining the resource content to be searched within the target time period. According to the resource content, target search operation feature data associated with the search operation of the resource content is extracted from a preset simulation database, wherein the preset simulation database includes: search operation feature data obtained by statistically analyzing various manual operation contents when manually searching on a media platform. According to the target search operation feature data, a search process task for the resource content is generated, and the search process task is concurrently executed according to the number of concurrent executions determined in the target time period. By adopting the feature data of each operation when a real person searches for content on the platform, a search process task is constructed, so that the search process task has a high degree of similarity with the search behavior of a real person during operation, so that the platform cannot intercept the search program, thereby improving the efficiency of resource acquisition. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0038] Figure 1 A structural diagram of a resource search system provided for this application;

[0039] Figure 2 A structural diagram of a terminal provided for this application;

[0040] Figure 3 A structural diagram of a server provided for this application;

[0041] Figure 4 A flowchart of a resource search method provided for this application;

[0042] Figure 5 Process control architecture diagram provided for this application;

[0043] Figure 6 The execution flow chart of the search process task provided for this application;

[0044] Figure 7 A flowchart of the search result analysis provided for this application;

[0045] Figure 8 A structural diagram of a resource search device provided by this application;

[0046] Fig. 9 This is a structural diagram of the electronic device provided for this application. DETAILED DESCRIPTION

[0047] The following describes the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation method section of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.

[0048] The embodiments of the present application are described below in conjunction with the accompanying drawings. Those skilled in the art will appreciate that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0049] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0050] See also Figure 1 , Figure 1 FIG. 1 shows a schematic diagram of the architecture of a resource search system. The system may include a terminal 100 and a server 200. The server 200 may include one or more servers ( Figure 1 In the example, a server is included, and the server 200 can provide the method provided in the embodiment of the present application for one or more terminals.

[0051] Among them, the terminal 100 can be installed with an application for obtaining the resource content to be searched. The above application and web page can provide an interface. The terminal 100 can receive relevant parameters entered by the user on the resource content input interface and send the above parameters to the server 200. The server 200 can obtain the processing result based on the received parameters and return the processing result to the terminal 100.

[0052] It should be understood that in some optional implementations, the terminal 100 can also complete the action of obtaining the processing result based on the received parameters by itself without the cooperation of the server, and the embodiments of the present application are not limited to this.

[0053] Next describe Figure 1 The product form of the mid-terminal 100;

[0054] The terminal 100 in the embodiment of the present application can be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc., and the embodiment of the present application does not impose any limitation on this.

[0055] Figure 2 An optional hardware structure diagram of the terminal 100 is shown.

[0056] refer to Figure 2 As shown, the terminal 100 may include a radio frequency unit 110, a memory 120, an input unit 130, a display unit 140, a camera 150 (optional), an audio circuit 160 (optional), a speaker 161 (optional), a microphone 162 (optional), an earphone jack 163 (optional), a processor 170, an external interface 180, a power supply 190 and other components. Those skilled in the art will appreciate that Figure 2 These are merely examples of terminals or multi-function devices and do not constitute limitations on the terminals or multi-function devices, which may include more or fewer components than those shown in the figures, or combinations of certain components, or different components.

[0057] The input unit 130 can be used to receive input digital or character information, and generate key signal input related to the user settings and function control of the portable multifunctional device. Specifically, the input unit 130 may include a touch screen 131 (optional) and / or other input devices 132. The touch screen 131 can collect the user's touch operations on or near it (such as the user's operation on or near the touch screen using any suitable object such as fingers, joints, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch screen can detect the user's touch action on the touch screen, convert the touch action into a touch signal and send it to the processor 170, and can receive and execute the command sent by the processor 170; the touch signal at least includes the touch point coordinate information. The touch screen 131 can provide an input interface and an output interface between the terminal 100 and the user. In addition, the touch screen can be implemented using multiple types such as resistive, capacitive, infrared and surface acoustic wave. In addition to the touch screen 131, the input unit 130 can also include other input devices. Specifically, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.

[0058] Among them, the input device 132 can receive input data and the like.

[0059] The display unit 140 can be used to display information input by the user or information provided to the user, various menus of the terminal 100, interactive interfaces, file display and / or playback of any multimedia file. In the embodiment of the present application, the display unit 140 can be used to display the interface for inputting resource content, processing results, etc.

[0060] The memory 120 can be used to store instructions and data. The memory 120 can mainly include an instruction storage area and a data storage area. The data storage area can store various data, such as multimedia files, texts, etc.; the instruction storage area can store software units such as operating systems, applications, instructions required for at least one function, or their subsets and extensions. It can also include a non-volatile random access memory; provide the processor 170 with hardware, software and data resources including management of computing and processing equipment, and support control software and applications. It is also used for the storage of multimedia files, and the storage of running programs and applications.

[0061] The processor 170 is the control center of the terminal 100. It uses various interfaces and lines to connect various parts of the entire terminal 100. By running or executing instructions stored in the memory 120 and calling data stored in the memory 120, it executes various functions of the terminal 100 and processes data, thereby controlling the terminal device as a whole. Optionally, the processor 170 may include one or more processing units; preferably, the processor 170 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application program, and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 170. In some embodiments, the processor and the memory may be implemented on a single chip, and in some embodiments, they may also be implemented separately on separate chips. The processor 170 may also be used to generate corresponding operation control signals, send them to corresponding components of the computing and processing device, read and process data in the software, especially read and process data and programs in the memory 120, so that each functional module therein performs corresponding functions, thereby controlling the corresponding components to act according to the requirements of the instructions.

[0062] Among them, the memory 120 can be used to store software codes related to the resource search method, the processor 170 can execute the steps of the resource search method, and can also schedule other units (such as the above-mentioned input unit 130 and display unit 140) to implement corresponding functions.

[0063] The radio frequency unit 110 (optional) can be used for receiving and sending information or receiving and sending signals during a call, for example, after receiving the downlink information of the base station, it is sent to the processor 170 for processing; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, etc. In addition, the radio frequency unit 110 can also communicate with network devices and other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (SMS), etc.

[0064] In this embodiment of the present application, the radio frequency unit 110 can send the resource content data to be searched to the server 200 , and receive the search result data sent by the server 200 .

[0065] It should be understood that the radio frequency unit 110 is optional and can be replaced by other communication interfaces, such as a network port.

[0066] The terminal 100 also includes a power supply 190 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 170 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption.

[0067] The terminal 100 further includes an external interface 180 , which may be a standard Micro USB interface or a multi-pin connector, and may be used to connect the terminal 100 to communicate with other devices, or to connect a charger to charge the terminal 100 .

[0068] Although not shown, the terminal 100 may also include a flashlight, a wireless fidelity (WiFi) module, a Bluetooth module, sensors with different functions, etc., which are not described in detail here. Some or all of the methods described below may be applied in the following embodiments. Figure 2 In the terminal 100 shown.

[0069] Next describe Figure 1 The product form of the server 200;

[0070] Figure 3 A structural diagram of a server 200 is provided, such as Figure 3 As shown, the server 200 includes a bus 201, a processor 202, a communication interface 203, and a memory 204. The processor 202, the memory 204, and the communication interface 203 communicate with each other via the bus 201.

[0071] The bus 201 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0072] The processor 202 may be any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).

[0073] The memory 204 may include a volatile memory, such as a random access memory (RAM). The memory 204 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).

[0074] The memory 204 may be used to store software codes related to the resource search method, and the processor 202 may execute the steps of the resource search method of the chip, and may also schedule other units to implement corresponding functions.

[0075] It should be understood that the above-mentioned terminal 100 and server 200 can be centralized or distributed devices, and the processors in the above-mentioned terminal 100 and server 200 (such as processor 170 and processor 202) can be hardware circuits (such as application specific integrated circuit (ASIC), field-programmable gate array (FPGA), general-purpose processor, digital signal processor (DSP), microprocessor or microcontroller, etc.), or a combination of these hardware circuits. For example, the processor can be a hardware system with an instruction execution function, such as a CPU, DSP, etc., or a hardware system without an instruction execution function, such as an ASIC, FPGA, etc., or a combination of the above-mentioned hardware systems without an instruction execution function and hardware systems with an instruction execution function.

[0076] Reference Figure 4 , Figure 4 A schematic diagram of a resource search method provided in an embodiment of the present application is shown in FIG. Figure 4 As shown, a resource search method provided in an embodiment of the present application may include steps 401 to 404, and these steps are described in detail below.

[0077] 401. Obtain the resource content to be searched within the target time period.

[0078] Specifically, the resource content to be searched can be entered in the search box in the human-computer interaction interface of the terminal. The resource content here can be represented by keywords, that is, the resource content can be searched by entering the keywords of the resource content to be searched in the interaction interface, where the keywords can include keywords of multiple video contents, which can support searching for multiple video contents at one time.

[0079] It is understandable that those skilled in the art can adjust and select the search methods supported by the search box as needed, and no limitation is made here.

[0080] 402. Target search operation feature data associated with the search operation of the resource content is extracted from a preset simulation database according to the resource content. The preset simulation database includes: search operation feature data obtained by statistically analyzing various manual operation contents when searching manually on a media platform.

[0081] Specifically, the preset simulation database can obtain the simulation data model by collecting statistics of various operation behaviors during the operation of real people by simulating the execution of tasks by real people. The characteristic data of real people's operation can be collected by statistics of search requests of a large number of real people on its own or other platforms, and a multi-dimensional simulation data model of real people's browsing and searching behaviors on the platform can be established. The search operation characteristic data included may include: the interval frequency of real people's access to the server; the residence time of real people visiting each page; the average speed of real people visiting each page; the time interval for scrolling the page when real people visit the target platform page; the mouse movement habits when real people visit the target platform page (for example, the mouse wheel turns the page, the mouse cursor moves with the reading of text, the mouse cursor selects certain fields and copies them, the mouse moves to the browser search box to search for keywords on the page, etc.); the real people visit the target platform The categories and hot trends browsed when browsing pages (for example, the content of hot columns or channels, the content of newly launched programs, etc., are all hot trend content); the habits of real people in finding target content when visiting the target platform page (for example, some users find the target content they want to watch through queries, some users find the target content they want to watch through channel classification and step by step through classification pages, and some users find the target content they want to watch through viewing history, etc.); the browsing habits of real people in retrieving trend content through the search function, and whether they search in order according to the search results; the corresponding data of the length of time the real person stays on the playback page and the length of the video after retrieving the target content; the total number of requests made by real people in different time periods of a day, and other data.

[0082] The target search operation feature data may include all the search operation feature data listed above, or part of the search operation feature data, and the search operation feature data to be used may be adjusted as needed, which is not limited here.

[0083] 403. Generate a search process task for resource content according to the target search operation characteristic data.

[0084] Specifically, when the target search operation characteristic data constituted by the above-mentioned search operation characteristic data is obtained, the total execution time of the search process task can be obtained according to the steps of real people searching for keywords in the simulation data model and the operation time of each operation step, and then each operation step can be inserted into the total execution time according to the order in which each operation step is executed, thereby forming the search process task that can be executed by the crawler.

[0085] 404. Perform concurrent execution of the search process tasks according to the concurrent execution quantity determined in the target time period.

[0086] Specifically, the target time period can be the whole day or a certain time period within the whole day. A batch of IP proxies and accounts of the target platform can be prepared in advance. The number of concurrent executions can be determined based on the total number of users on the media platform within the target time period and the proportion of concurrent executions supported. The search process tasks can be executed concurrently according to the determined number of concurrent executions.

[0087] The resource search method generates search process tasks by adopting a simulation data model constructed by real-person behavior, so that the search process tasks are highly consistent with real-person search behaviors when executed, making it impossible for the interception strategy of the media platform to separate the crawler operation, thereby improving the efficiency of resource crawling and realizing automated content crawling.

[0088] Reference Figure 7 As shown, after the resource content crawling is completed, the result confirmation service can be started. After receiving the query results, the multimedia content files in the results are downloaded and stored. After the download is completed, the analysis program will extract the data features of the multimedia content, compare it with its own video copyright content, and give a preliminary judgment result. If the result preliminarily judges that there is infringing content, it will automatically take a screenshot and archive it, and notify manual intervention for secondary confirmation. After manual confirmation of infringing content, the rights protection process can be started to terminate the infringement as soon as possible.

[0089] Of course, an automatic identification model can also be used to determine whether the resource content is infringing, which will not be elaborated here.

[0090] In one possible implementation, in order to make the search process task more similar to human operation in execution, the target search operation feature data includes: one or more of the total stay time on the search page, browsing actions and the interval time between the browsing actions. The above process of generating the search process task for the resource content based on the target search operation feature data may specifically include: when the target search operation feature data includes the total stay time, the total execution time of the search process task is calculated after the total stay time is scaled according to the task execution strategy.

[0091] When the target search operation characteristic data includes browsing actions and the interval duration, the browsing actions are inserted according to the execution order of the browsing actions and the interval duration to obtain the search process task.

[0092] As a specific application, when the target search operation characteristic data includes: the total duration of stay on the search page, the browsing actions, and the interval duration between the browsing actions, the generation process of the search process task may specifically include:

[0093] Step 11: The total duration of the stay is scaled according to the task execution strategy and used as the total execution duration of the search process task.

[0094] Step 12: insert the browsing action into the total execution time according to the execution order and interval duration of the browsing action to obtain the search process task.

[0095] Specifically, when the total duration of stay is scaled according to the task execution strategy, it can be determined whether the total amount of the current search process tasks in the target time period is within the preset task total amount range corresponding to the target time period. If so, the total duration of stay is used as the total execution duration. If not, the total duration of stay is shortened in proportion and used as the total execution duration.

[0096] For example, if we need to monitor the infringement of M groups of keyword content at a specific time, we first extract the steps of searching keywords by real people in the simulation data model, and extract the overhead range of the unit request time for each step. In order to speed up the execution efficiency of the total task, the unit request time range is multiplied by the preset efficiency coefficient to improve the execution efficiency (reduce the proportion of the execution interval time). The M groups of unit actions are accumulated into a preliminary execution process, and the total process duration is calculated.

[0097] Then, the page dwell interval, page scrolling browsing action, mouse following browsing and page scrolling action in the real person data model are extracted, and such behavior actions are inserted between each unit request, accumulated into the execution process, and the total execution time is increased accordingly.

[0098] If the total execution time exceeds the target execution time, the search process task is split according to the keywords representing the resource content to obtain search process subtasks. The concurrent execution quantity is updated according to the number of search process subtasks.

[0099] That is, the current total execution time is compared with the target time for task completion. If the total process time exceeds the target time, the total process is split into tasks to increase the concurrency to shorten the overall task execution efficiency. Independent account, IP, UA and other features are attached to each subtask.

[0100] When the target search operation characteristic data further includes: an event of interest triggered by browsing the current search content, the above-mentioned generating a search process task for resource content according to the target search operation characteristic data further includes:

[0101] Insert the judgment operation of the event of interest into the total execution time to obtain the search process task.

[0102] Specifically, by extracting the browsing tendency and classification habits of different accounts in the simulation data model, content judgment is added to the execution process. If the corresponding tendency content appears, the tendency content browsing action is inserted into the execution process to improve the portrait characteristics of the account.

[0103] When the target search operation characteristic data further includes: frequency data of triggering erroneous operation, the above-mentioned generating a search process task for resource content according to the target search operation characteristic data further includes:

[0104] The error operation judgment strategy generated according to the frequency data is inserted into the total execution time to obtain the search process task.

[0105] Specifically, by extracting the probabilistic misoperation frequency data from the simulation data model, the misoperation behavior is implanted into each sub-process according to the probability of occurrence to enhance the real person behavior characteristics.

[0106] In order to further improve the authenticity of the anthropomorphic operation, the above step 11, after scaling the total stay time according to the task execution strategy, as the total execution time of the search process task, may specifically include:

[0107] Based on the total number of requests for the task and the range of requests for the current period, the number of requests for other non-task periods is calculated proportionally. In the non-task period, the efficiency is reduced according to the efficiency improvement coefficient (the ratio of the execution time interval is enlarged) to restore the real-person data range of the task execution.

[0108] Improving efficiency means executing more tasks per unit time, that is, reducing the execution interval of each step, but it cannot exceed the minimum value of real-person access behavior data to avoid being identified as program behavior by the interception system.

[0109] For example, the number of Internet user requests during the evening peak period (19:00-23:00) is significantly increased, and the number of concurrent task processes is increased during this peak period. The number of Internet user requests during the night trough period (2:00-4:00) is sharply reduced, and the number of concurrent task processes is greatly reduced during this trough period.

[0110] Finally, the tasks of each period of the day can be summarized according to the timeline to generate an all-day execution plan. Then, according to the regular search strategy, the all-day execution plan can be executed regularly to search for resources.

[0111] In order to meet the requirement of adding a temporary new search task, if there is an idle time in the target time period, the new search process task is added to the idle time.

[0112] If there is no idle time in the target time period, the concurrent execution amount of the search process tasks in the target time period is increased according to the request execution ratio in the target time period, so as to add the new search process tasks to the target time period for concurrent execution.

[0113] Specifically, when a new task is added, the task can be decomposed according to time periods, and the original full-day execution plan is checked to see if there is an idle task that can be filled in the time period corresponding to the new task.

[0114] If the new task can be filled into the free part of the original full-day plan, choose to merge with the original plan, generate a new full-day plan version, and switch to the new version for execution.

[0115] If the new tasks cannot be fully filled into the idle part of the original all-day plan, the original all-day plan will be scaled up according to the total request ratio of each time period until the new tasks can be fully filled, and a new all-day plan version will be generated and switched to the new version for execution.

[0116] After the task plan is executed in a time period, the sub-process enters the signal control module. The main process controls the number of sub-process concurrency by sending a signal to close the process according to the execution plan of the next time period. It will also issue instructions to some sub-processes to change features based on the characteristic data of different features in different time periods in the real person data model, so that each feature group strengthens the behavioral characteristics of activities in a specific time period.

[0117] As a specific application of the above resource search method, refer to Figure 5 As shown in the figure, after the total process of resource search is started, the corresponding search process task is obtained through the real person concurrent data model (i.e., the simulation data model), and then the concurrent ratio of the current period is extracted to control the corresponding sub-process to execute the search process task. Figure 6 As shown, when a new task is injected, the corresponding search process task is added through the multidimensional simulation data model (i.e., the simulation data model), and the feature data can be added through the feature library here. In the absence of new task injection, real-person operations can be replayed randomly to continuously improve the real-person features of the current account. After a task is banned, the various features corresponding to this task are temporarily disabled and enter a dormant period. The short-term behavior of this task is simulated by real people, the identification reasons are analyzed, and the identifiable features are blocked in the data model. When the human-machine recognition pop-up window appears, take a screenshot and store it in the library, and change the task features to continue executing the task. The human-machine recognition pop-up window can be manually processed based on image recognition, and the processing actions can be recorded as the basis for processing human-machine recognition.

[0118] A resource search method provided in an embodiment of the present application is introduced above, and a device for executing the resource search method is introduced below.

[0119] See also Figure 8 , Figure 8 A schematic diagram of the structure of a resource search device provided in an embodiment of the present application. Figure 8 As shown, the resource search device includes:

[0120] Search content acquisition module 801, used to acquire resource content to be searched within a target time period;

[0121] The feature data matching module 802 is used to extract target search operation feature data associated with the search operation of the resource content from a preset simulation database according to the resource content, wherein the preset simulation database includes: search operation feature data obtained by statistically analyzing various manual operation contents when searching manually on a media platform;

[0122] A search task generating module 803 is used to generate a search process task for the resource content according to the target search operation characteristic data; and

[0123] The search task execution module 804 is used to concurrently execute the search process tasks according to the concurrent execution quantity determined by the target time period.

[0124] In a possible implementation, the target search operation characteristic data includes: one or more of the total duration of stay on the search page, browsing actions, and the interval duration between the browsing actions. The search task generation module 803 generates a search process task for the resource content according to the target search operation characteristic data, including:

[0125] When the target search operation characteristic data includes the total stay time, the total stay time is scaled according to the task execution strategy and used as the total execution time of the search process task;

[0126] When the target search operation characteristic data includes the browsing action and the interval duration, the browsing action is inserted according to the execution order of the browsing action and the interval duration to obtain the search process task.

[0127] In a possible implementation, the process in which the search task generation module 803 generates a search process task for the resource content according to the target search operation characteristic data further includes:

[0128] If the total execution time exceeds the target execution time, the search process task is split according to the keywords representing the resource content to obtain search process subtasks;

[0129] The concurrent execution quantity is updated according to the quantity of the search process subtasks.

[0130] In a possible implementation, when the target search operation characteristic data further includes: an event of interest triggered by browsing the current search content, the search task generation module 803 generates a search progress task for the resource content according to the target search operation characteristic data, and further includes:

[0131] The judgment operation on the event of interest is inserted into the total execution time to obtain the search process task.

[0132] In a possible implementation, when the target search operation characteristic data further includes: frequency data of triggering an erroneous operation, the search task generation module 803 generates a search process task for the resource content according to the target search operation characteristic data, and further includes:

[0133] The misoperation judgment strategy generated according to the frequency data is inserted into the total execution time to obtain the search process task.

[0134] In a possible implementation, the search task generation module 803 scales the total stay time according to the task execution strategy and uses the scaled stay time as the total execution time of the search process task, including:

[0135] Determine whether the total amount of the current search process tasks within the target time period is within the preset task total amount range corresponding to the target time period;

[0136] If yes, the total duration of stay is taken as the total execution duration;

[0137] If not, the total duration of stay is shortened in proportion and used as the total execution duration.

[0138] In a possible implementation, the method further includes: a new task adding module, configured to add a new search process task to the idle time period if there is an idle time period within the target time period;

[0139] If the idle time does not exist in the target time period, the concurrent execution amount of the search process tasks in the target time period is increased according to the request execution ratio in the target time period, so as to add the new search process tasks to the target time period for concurrent execution.

[0140] The present application also provides an electronic device in an embodiment. Fig. 9 As shown, it shows a schematic diagram of the structure of an electronic device suitable for implementing the embodiment of the present application. The electronic device in the embodiment of the present application may include but is not limited to fixed terminals such as mobile phones, laptops, PDAs (personal digital assistants), PADs (tablet computers), desktop computers, etc. Fig. 9 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0141] like Fig. 9As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 to a random access memory (RAM) 903. When the electronic device is powered on, various programs and data required for the operation of the electronic device are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0142] Typically, the following devices may be connected to the I / O interface 905: an input device 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 908 including, for example, a memory card, a hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although Fig. 9 An electronic device having various devices is shown, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0143] An embodiment of the present application also provides a computer program product including computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements any resource search method provided in the embodiment of the present application.

[0144] A computer-readable storage medium is also provided in an embodiment of the present application. The storage medium carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any resource search method provided in an embodiment of the present application.

[0145] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.

[0146] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a training device, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0147] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0148] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a training device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.

Claims

1. A resource search method, characterized in that: include: Get the resource content to be searched within the target time period; Extracting target search operation feature data associated with the search operation of the resource content from a preset simulation database according to the resource content, the preset simulation database including: search operation feature data obtained by statistically analyzing various manual operation contents when searching manually on a media platform; Generating a search process task for the resource content according to the target search operation characteristic data; The search process tasks are concurrently executed according to the concurrent execution quantity determined by the target time period.

2. The resource search method according to claim 1, characterized in that: The target search operation characteristic data includes: one or more of the total duration of stay on the search page, browsing actions, and the interval duration between the browsing actions. The generating of the search process task for the resource content according to the target search operation characteristic data includes: When the target search operation characteristic data includes the total stay time, the total stay time is scaled according to the task execution strategy and used as the total execution time of the search process task; When the target search operation characteristic data includes the browsing action and the interval duration, the browsing action is inserted according to the execution order of the browsing action and the interval duration to obtain the search process task.

3. The resource search method according to claim 2, characterized in that: The step of generating a search process task for the resource content according to the target search operation characteristic data further includes: If the total execution time exceeds the target execution time, the search process task is split according to the keywords representing the resource content to obtain search process subtasks; The concurrent execution quantity is updated according to the quantity of the search process subtasks.

4. The resource search method according to claim 2, characterized in that: When the target search operation characteristic data further includes: an event of interest triggered by browsing the current search content, the generating of the search process task for the resource content according to the target search operation characteristic data further includes: The judgment operation on the event of interest is inserted into the total execution time to obtain the search process task.

5. The resource search method according to claim 2, characterized in that: When the target search operation characteristic data further includes: frequency data of triggering an erroneous operation, generating a search process task for the resource content according to the target search operation characteristic data further includes: The misoperation judgment strategy generated according to the frequency data is inserted into the total execution time to obtain the search process task.

6. The resource search method according to claim 2, characterized in that: The total duration of the stay is scaled according to the task execution strategy to serve as the total execution duration of the search process task, including: Determine whether the total amount of the current search process tasks within the target time period is within the preset task total amount range corresponding to the target time period; If yes, the total duration of stay is taken as the total execution duration; If not, the total duration of stay is shortened in proportion and used as the total execution duration.

7. The resource search method according to claim 1, characterized in that: Also includes: If there is an idle time period within the target time period, adding a new search process task to the idle time period; If the idle time does not exist in the target time period, the concurrent execution amount of the search process tasks in the target time period is increased according to the request execution ratio in the target time period, so as to add the new search process tasks to the target time period for concurrent execution.

8. A resource search device, characterized in that: include: Search content acquisition module, used to obtain resource content to be searched within a target time period; A feature data matching module is used to extract target search operation feature data associated with the search operation of the resource content from a preset simulation database according to the resource content, wherein the preset simulation database includes: search operation feature data obtained by statistically analyzing various manual operation contents when searching manually on a media platform; A search task generating module, used to generate a search process task for the resource content according to the target search operation characteristic data; and The search task execution module is used to concurrently execute the search process tasks according to the concurrent execution quantity determined by the target time period.

9. An electronic device, characterized in that: The method comprises at least one processor and a memory connected to the processor, wherein: The memory is used to store computer programs; The processor is used to execute the computer program so that the electronic device can implement the resource search method as described in any one of claims 1 to 7.

10. A computer storage medium, characterized in that: The storage medium carries one or more computer programs, and when the one or more computer programs are executed by an electronic device, the electronic device can implement the resource search method as described in any one of claims 1 to 7.

Images