Multimedia information acquisition method, device, equipment and storage medium

Abstract

The application discloses a multimedia information acquisition method, device and equipment and a storage medium. The method comprises the following steps: acquiring page data of a landing page interface of multimedia information of a preset type; performing a preset simulation operation based on the landing page interface and collecting picture and video data displayed by the landing page interface; and taking the page data and the picture and video data as a multimedia information acquisition result. Since the page data of the landing page interface of the multimedia information of the preset type is acquired only when the multimedia information of the preset type is detected, the acquisition of the page data of the multimedia information of a non-pre-set type can be avoided, the effectiveness of information acquisition is improved, the preset simulation operation is performed on the landing page interface, the picture and video data displayed by the landing page interface are collected, the page data and the picture and video data are taken as the multimedia information acquisition result, all data of the multimedia information can be basically acquired, the integrity of information acquisition is ensured, and reliable data is provided for subsequent illegal judgment and evidence.

Description

Technical Field

[0001] This invention relates to the field of Internet technology, and in particular to a method, apparatus, device and storage medium for acquiring multimedia information. Background Technology

[0002] In recent years, some internet security companies have captured millions of pieces of suspected illegal internet multimedia information (such as illegal advertisements and websites). This multimedia information covers industries such as medical care, food, cosmetics, real estate, and finance, and is related to the life, health, and property safety of the people. Behind the illegal multimedia information lies a huge crisis. Due to the characteristics of internet multimedia information, such as its huge quantity, diverse types, rapid illegality, lack of review, and strong concealment, traditional regulatory methods such as inspections and manual collection cannot fully detect internet multimedia information, nor can they detect illegal multimedia information in a timely manner. Relying solely on complaints and public opinion to initiate regulation would be very passive.

[0003] To overcome the above shortcomings, existing technologies use Docker + Fiddler to capture mobile data for analysis and judgment of whether multimedia information is illegal. This existing method involves configuring multiple Docker containers on the host, having the emulator request the network, and using Fiddler as a proxy to obtain the request data in the middle layer. Then, the captured request data is analyzed to see if there is any illegal data in the distributed content. Its disadvantage is that it can only obtain the corresponding distributed content and lacks other evidence for evidence collection and analysis of whether multimedia information is illegal.

[0004] The above content is only used to help understand the technical solution of the present invention and does not represent an admission that the above content is prior art. Summary of the Invention

[0005] The main objective of this invention is to provide a method, apparatus, device, and storage medium for acquiring multimedia information, aiming to solve the technical problems of existing methods and dimensions for acquiring illegal multimedia information data being singular, resulting in difficulties in providing evidence and insufficient clues for law enforcement.

[0006] To achieve the above objectives, the present invention provides a multimedia information acquisition method, the method comprising the following steps: When a preset type of multimedia information is detected in the application page, the page data corresponding to the landing page interface of the multimedia information is obtained; Based on the landing page interface, a preset simulated operation is performed, and the image and video data displayed on the landing page interface during the execution of the preset simulated operation are collected; The page data and the image / video data are used as the multimedia information acquisition results.

[0007] Optionally, before the step of obtaining the page data corresponding to the landing page interface of the multimedia information when a preset type of multimedia information is detected in the application page, the method further includes: Retrieve information about the page content contained in the application page; Based on the page content information, detect whether there is preset type of multimedia information in the application page; The step of using the page data and the image / video data as the multimedia information acquisition result further includes: The page content information, the page data, and the image and video data are used as the multimedia information acquisition results.

[0008] Optionally, the step of detecting whether there is a preset type of multimedia information in the application page based on the page content information includes: Extract content identifiers and / or content materials corresponding to different page content from the page content information; Determine whether there is a preset type of multimedia information in the application page based on the content identifier and / or the content material. Optionally, the step of obtaining the page data corresponding to the landing page interface of the multimedia information when detecting the existence of a preset type of multimedia information on the application page includes: When a preset type of multimedia information is detected in the application page, the link address corresponding to the multimedia information is extracted from the page content information. Obtain the corresponding landing page interface based on the link address, and obtain the page data corresponding to the landing page interface. Optionally, after the step of using the page content information, the page data, and the image / video data as the multimedia information acquisition result, the method further includes: The multimedia information acquisition results are converted according to the target data exchange format to obtain the data to be identified. The data to be identified is sent to a preset data center, so that the preset data center can determine whether the multimedia information is illegal multimedia information based on the data to be identified. Optionally, the step of performing a preset simulated operation based on the landing page interface and collecting image and video data displayed on the landing page interface during the execution of the preset simulated operation includes: Pre-defined simulated operations are executed based on the landing page interface using a pre-defined automation framework. The target data collection method is determined based on the page data; Collect the image and video data displayed on the landing page interface during the execution of the preset simulation operation according to the target data collection method. Optionally, after the step of using the page data and the image / video data as the multimedia information acquisition result, the method further includes: Obtain the anti-crawler policy of the application containing the application page; The application communication parameters currently used by the application are adjusted according to the anti-crawler strategy. Based on the adjusted application communication parameters, request to load different application pages, and return to the step of obtaining the page content information contained in the application page. Optionally, the step of adjusting the application communication parameters currently used by the application according to the anti-crawler strategy further includes: Search the preset strategy library for the parameter adjustment strategy corresponding to the anti-crawler strategy; According to the parameter adjustment strategy, the network communication address of the gateway device linked to the application is changed to adjust the application's communication parameters.

[0009] Optionally, after the step of changing the network communication address of the gateway device linked to the application according to the parameter adjustment strategy to adjust the application communication parameters, the method further includes: According to the parameter adjustment strategy, when the application initiates an application page loading request, the request parameters of the application page loading request are changed. Optionally, before the step of obtaining the anti-crawling strategy of the application where the application page is located, the method further includes: Obtain the current International Mobile Equipment Identity (IMSI) and change the current IMI; After the current International Mobile Equipment Identity (IMEI) is changed, the application is reinstalled, and the step of obtaining the anti-crawler strategy of the application containing the application page is executed. Optionally, the multimedia information acquisition method further includes: Periodically acquire information on the types and display formats of different multimedia information; The pre-defined data collection method is updated based on the type information and the display format. The updated data collection method is used to obtain page content information for different application pages. Furthermore, to achieve the above objectives, the present invention also proposes a multimedia information acquisition device, the multimedia information acquisition device comprising: The information detection module is used to obtain the page data corresponding to the landing page interface of the multimedia information when a preset type of multimedia information is detected in the application page. The data acquisition module is used to perform a preset simulation operation based on the landing page interface, and to collect the image and video data displayed on the landing page interface during the execution of the preset simulation operation; The result acquisition module is used to obtain the page data and the image and video data as multimedia information acquisition results.

[0010] Optionally, the multimedia information acquisition device further includes: an information acquisition module; The information acquisition module is used to acquire page content information contained in the application page, and detect whether there is multimedia information of a preset type in the application page based on the page content information; The result acquisition module is further configured to use the page content information, the page data, and the image and video data as multimedia information acquisition results.

[0011] Optionally, the information detection module is further configured to extract content identifiers and / or content materials corresponding to different page content from the page content information; and determine whether there is preset type of multimedia information in the application page based on the content identifiers and / or the content materials.

[0012] Optionally, the information detection module is further configured to, when detecting that there is multimedia information of a preset type in the application page, extract the link address corresponding to the multimedia information from the page content information; obtain the corresponding landing page interface according to the link address, and obtain the page data corresponding to the landing page interface.

[0013] Optionally, the multimedia information acquisition device further includes: an information sending module; The information sending module is used to convert the multimedia information acquisition result according to the target data exchange format to obtain the data to be identified, and send the data to be identified to a preset data center so that the preset data center can determine whether the multimedia information is illegal multimedia information based on the data to be identified.

[0014] Optionally, the data acquisition module is further configured to execute a preset simulation operation based on the landing page interface through a preset automation framework; determine a target data acquisition method according to the page data; and acquire the image and video data displayed on the landing page interface during the execution of the preset simulation operation according to the target data acquisition method.

[0015] Furthermore, to achieve the above objectives, the present invention also proposes a multimedia information acquisition device, the device comprising: a memory, a processor, and a multimedia information acquisition program stored in the memory and executable on the processor, the multimedia information acquisition program being configured to implement the steps of the multimedia information acquisition method described above.

[0016] In addition, to achieve the above objectives, the present invention also proposes a storage medium storing a multimedia information acquisition program, which, when executed by a processor, implements the steps of the multimedia information acquisition method described above.

[0017] This invention acquires page data corresponding to the landing page interface of multimedia information when a preset type of multimedia information is detected on an application page; then, a preset simulated operation is executed based on the landing page interface, and image and video data displayed on the landing page interface during the execution of the preset simulated operation are collected; finally, the page data and image / video data are used as the multimedia information acquisition result. Because this invention acquires the page data of the landing page interface only when the preset type of multimedia information is detected, it avoids acquiring page data of non-preset type multimedia information, thus improving the effectiveness of information acquisition. Simultaneously, by executing the preset simulated operation on the landing page interface and collecting the image and video data displayed on the landing page interface during the execution of the preset simulated operation, and then using the page data and image / video data together as the multimedia information acquisition result, it can essentially acquire all the data of the multimedia information, ensuring the completeness of information acquisition and providing reliable data for subsequent evidence of illegality. Attached Figure Description

[0018] Figure 1 This is a schematic diagram of the structure of a multimedia information acquisition device in the hardware operating environment involved in the embodiments of the present invention; Figure 2 This is a flowchart illustrating the first embodiment of the multimedia information acquisition method of the present invention; Figure 3 This is an application scenario architecture diagram of the first embodiment of the multimedia information acquisition method of the present invention; Figure 4 This is a schematic diagram of a terminal page of the first embodiment of the multimedia information acquisition method of the present invention; Figure 5 This is a flowchart illustrating the second embodiment of the multimedia information acquisition method of the present invention; Figure 6 This is a structural block diagram of the first embodiment of the multimedia information acquisition device of the present invention.

[0019] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0020] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of the invention.

[0021] Reference Figure 1 , Figure 1This is a schematic diagram of the structure of a multimedia information acquisition device in the hardware operating environment involved in the embodiments of the present invention.

[0022] like Figure 1 As shown, the multimedia information acquisition device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed random access memory (RAM) or a stable non-volatile memory (NVM), such as a disk drive. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0023] Those skilled in the art will understand that Figure 1 The structure shown does not constitute a limitation on the multimedia information acquisition device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0024] like Figure 1 As shown, the memory 1005, which serves as a storage medium, may include an operating system, a data storage module, a network communication module, a user interface module, and a multimedia information acquisition program.

[0025] exist Figure 1 In the multimedia information acquisition device shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the multimedia information acquisition device of the present invention can be set in the multimedia information acquisition device, and the multimedia information acquisition device calls the multimedia information acquisition program stored in the memory 1005 through the processor 1001 and executes the multimedia information acquisition method provided in the embodiment of the present invention.

[0026] This invention provides a method for acquiring multimedia information, referring to... Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the multimedia information acquisition method of the present invention.

[0027] In this embodiment, the multimedia information acquisition method includes the following steps: Step S10: When a preset type of multimedia information is detected in the application page, obtain the page data corresponding to the landing page interface of the multimedia information; It should be noted that the executing entity of the method in this embodiment can be a mobile terminal with data processing, network communication, and program execution functions, such as a mobile phone, tablet computer, or PC. This mobile terminal can be applied to, for example... Figure 3 In the application scenario architecture shown, the multimedia information can be information represented by page elements consisting of text, sound, images, or combinations thereof contained on the application page displayed by the App or mobile terminal.

[0028] like Figure 3 As shown, Figure 3 This is an application scenario architecture diagram of the first embodiment of the multimedia information acquisition method of the present invention. The application scenario architecture includes a host 10, a network connection device 20, a mobile terminal (cluster) 30, and a data center 40. The host 10 is used to deploy the mobile terminal (cluster) and collect log information generated by the cluster. The network connection device 20, which may be a gateway device such as a router, is used to generate a network-wide IP address for the mobile terminal (cluster) to collect various multimedia information from the Internet. The mobile terminal (cluster) 30 is used to simulate user operations on an APP, simulating user actions such as swiping, clicking, and taking screenshots on the APP page, and then sending the collected data to the data center 40. The data center 40 is used to receive the data sent by the mobile terminal (cluster) 30, enabling the backend server to identify illegal multimedia information based on this data.

[0029] It should be understood that the preset type can be a category of multimedia information categorized according to the way multimedia information is displayed on the terminal page (e.g., list page, detail page, or push notification). The landing page interface can be a page loaded based on the network link corresponding to the multimedia information. This page can contain detailed information about the multimedia information, such as title, materials, page elements (e.g., audio and video resources) and their addresses, and various links contained on the page, all of which belong to the aforementioned page data.

[0030] In practice, after a mobile terminal loads and displays the application page of an app, it can first detect whether there is a preset type of multimedia information on the application page. If so, it can obtain the page data corresponding to the landing page interface of the multimedia information.

[0031] Step S20: Execute a preset simulation operation based on the landing page interface, and collect the image and video data displayed on the landing page interface during the execution of the preset simulation operation; In this step, the preset simulated operation refers to various behavioral operations that a real user might perform when using the App, such as simulating a user opening an App page, clicking, dragging, browsing, and editing page elements or controls. The image and video data can be data displayed on the landing page interface in response to the above preset simulated operation, obtained through operations such as screenshotting, image / video stitching, long screenshotting, and audio / video recording. This includes image data and video data, and the image data may contain text and images.

[0032] It should be noted that existing methods for identifying illegal multimedia information typically rely solely on the request data content when a user requests the multimedia information, without considering the image data displayed during the display. This results in insufficient evidence and difficulties in proving the illegal multimedia information during subsequent law enforcement. Therefore, in this embodiment, when the mobile terminal obtains the page information of the landing page, it will also obtain the image and video data displayed on the landing page to form a more complete chain of law enforcement information.

[0033] Furthermore, in order to achieve automated acquisition of image and video data and effectively reduce manpower, as one implementation method, step S20 in this embodiment may further include: Step S201: Execute a preset simulation operation based on the landing page interface using a preset automation framework; Step S202: Determine the target data collection method based on the page data; Step S203: Collect the image and video data displayed on the landing page interface during the execution of the preset simulation operation according to the target data collection method.

[0034] It should be noted that the preset automation framework can be any automation framework that can run on the application client, such as Robotium, UiAutomator, APPium, etc. Different automation frameworks have different advantages and disadvantages, and the automation framework can be selected according to the specific application scenario in practical applications.

[0035] Robotium is a testing framework based on Instrumentation (an Android automation testing tool). It is mainly used for automated testing of a specific APK (Android application package). The APK may or may not have source code. The disadvantage is that testers need to have a certain level of Java knowledge and understand basic Android components. The framework cannot be used across apps (for example, many apps allow users to select the photo album or open the camera to take pictures).

[0036] UIAutomator provides advanced UI testing for native Android apps, supporting virtually all Android event operations. Compared to Instrumentation, it eliminates the need for testers to understand code implementation details (UiAutomatorviewer can capture control properties on the app page without viewing the source code). Tests can run on all devices or emulators and are cross-app compatible. However, it only supports SDK 16 (Android 4.1) and above, and does not support Hybrid Apps or WebApps.

[0037] Appium is an open-source, cross-platform automated testing tool with the following advantages: open source; cross-app compatibility; no need to recompile the app; supports writing test scripts in mainstream languages ​​such as Java, JavaScript, PHP, Python, C#, and Ruby; and extends WebDriver (a simple and fast automated testing framework for testing WebApps), allowing testers with experience in web automation testing to use it directly.

[0038] It should be understood that different types of data in the page data correspond to different data collection methods. In this embodiment, the page data can be divided into audio and video data (audio, video, animation, etc.) and non-audio and video data (text data, character data, etc. other than audio, video, animation, etc.). Then, audio and video data is collected by video recording (including audio recording), and non-audio and video data is collected by image capture methods such as screenshot, image stitching, and long screenshot.

[0039] In specific implementations, the mobile terminal can record the audio and video data displayed on the landing page interface during the execution of the preset simulated operation to obtain the video data corresponding to the audio and video data; alternatively, it can capture images of the non-audio and video data displayed on the landing page interface during the execution of the preset simulated operation to obtain the image data corresponding to the non-audio and video data. For example, if there is a video resource on the landing page interface, when the mobile terminal simulates a user clicking to play the video resource through the aforementioned automation framework, it can start recording the output screen and audio of the video resource to obtain video data; or when the mobile terminal simulates a user browsing text and images on the page through the aforementioned automation framework, it can obtain image data by methods such as screenshotting, image stitching, and long screenshotting.

[0040] Step S30: Use the page data and the image / video data as the multimedia information acquisition result.

[0041] It should be noted that the multimedia information acquisition results obtained by the mobile terminal in this embodiment through the above method include both the access link for multimedia information and most of the content displayed on the landing page of multimedia information. This ensures the reliability and effectiveness of subsequent detection of whether multimedia information involves illegal content, and also facilitates evidence collection during subsequent law enforcement.

[0042] In a specific implementation, the mobile terminal can package the acquired page data and image / video data into the aforementioned multimedia information acquisition result, and then send the multimedia information acquisition result to the data center so that illegal multimedia information can be identified subsequently based on the multimedia information acquisition result.

[0043] Furthermore, in order to ensure that the data center can quickly identify the multimedia information results and improve the identification efficiency of illegal multimedia information, before sending the above-mentioned multimedia information acquisition results to the data center, the mobile terminal in this embodiment will also perform format conversion on the multimedia information acquisition results according to the data exchange format currently used or compatible by the data center (i.e., the target data exchange format below).

[0044] Specifically, the mobile terminal can convert the multimedia information acquisition results according to the target data exchange format to obtain the data to be identified; then the data to be identified is sent to the preset data center, so that the preset data center can determine whether the multimedia information is illegal multimedia information based on the data to be identified.

[0045] Furthermore, considering that Kafka is a fast, scalable, high-throughput, fault-tolerant distributed publish-subscribe messaging system with high throughput, built-in partitioning, support for data replication, and fault tolerance, it is suitable for use in large-scale message processing scenarios. In this embodiment, the aforementioned preset data center can be implemented using Kafka. Since Kafka is written in Scala and Java, the target data exchange format mentioned above in this embodiment can be the lightweight JSON format.

[0046] Furthermore, as an implementation method, to provide more sufficient clues for law enforcement regarding illegal multimedia information and to ensure the accuracy of detecting preset types of multimedia information, before step S10, the method of this embodiment further includes: Step S01: Obtain the page content information contained in the application page; It should be noted that the application page refers to the application client page currently displayed on the human-computer interaction interface of the mobile terminal, and the corresponding page content information refers to all the content information on the page.

[0047] Step S02: Detect whether there is a preset type of multimedia information in the application page based on the page content information; In practical implementation, after obtaining the page content information, the mobile terminal can detect whether there is multimedia information displayed on the application page in the form of a list page, detail page, or push notification, based on that page content information. For example... Figure 4 As shown, Figure 4 This is a schematic diagram of a terminal page according to the first embodiment of the multimedia information acquisition method of the present invention. Figure 4 The application page shown contains multimedia information 1, multimedia information 2, multimedia information 3 and multimedia information 4 displayed in a list format. When the simulated user clicks on multimedia information 1, the mobile terminal jumps to the landing page interface according to the network link corresponding to multimedia information 1. The landing page interface may contain the title and detailed information of multimedia information 1.

[0048] Furthermore, to ensure the accuracy of the detection results, in this embodiment, the mobile terminal can extract content identifiers and / or content materials corresponding to different page contents from the page content information; and then determine whether there is preset type of multimedia information in the application page based on the content identifiers and / or the content materials.

[0049] The content identifier can be a summary of information that represents the type or general content of a page element, such as video, audio, or text. The content material can be the detailed information contained in the content. Taking a news article as an example, the content identifier can be the news title, and the content material can be the body text corresponding to the news title.

[0050] Accordingly, step S10 may include: when a preset type of multimedia information is detected in the application page, extracting the link address corresponding to the multimedia information from the page content information; obtaining the corresponding landing page interface based on the link address, and obtaining the page data corresponding to the landing page interface. Here, the link address is the access link URL corresponding to the multimedia information.

[0051] Accordingly, step S30 may include: using the page content information, the page data, and the image and video data as the multimedia information acquisition result.

[0052] It should be noted that, as one implementation method, mobile terminals combine page content information, page data, and image and video data as multimedia information acquisition results for illegal judgment, which can make the judgment results more reliable and the law enforcement clues more complete.

[0053] Furthermore, to expand the scope of multimedia information data acquisition and continuously upgrade and update information acquisition methods, in this embodiment, the mobile terminal can also periodically acquire the type information and display format of different multimedia information; then, based on the type information and the display format, update the pre-set data acquisition method; and then, based on the updated data acquisition method, acquire the page content information contained in different application pages. Here, the display format refers to the way multimedia information is presented (such as video, audio, text, images, etc.), and the type information refers to the specific presentation method of the multimedia information, such as short videos or mini-videos in video display formats.

[0054] This embodiment acquires page data corresponding to the landing page interface of multimedia information when a preset type of multimedia information is detected on the application page; then, a preset simulated operation is executed based on the landing page interface, and image and video data displayed on the landing page interface during the execution of the preset simulated operation are collected; finally, the page data and image / video data are used as the multimedia information acquisition result. Since this embodiment acquires the page data of the landing page interface only when the preset type of multimedia information is detected, it avoids acquiring page data of non-preset type multimedia information, improving the effectiveness of information acquisition. Simultaneously, by executing the preset simulated operation on the landing page interface, collecting image and video data displayed on the landing page interface during the execution of the preset simulated operation, and then using the page data and image / video data together as the multimedia information acquisition result, it can essentially acquire all the data of the multimedia information, ensuring the completeness of information acquisition and providing reliable data for subsequent evidence of illegality.

[0055] refer to Figure 5 , Figure 5 This is a flowchart illustrating the second embodiment of the multimedia information acquisition method of the present invention.

[0056] Based on the first embodiment described above, after step S30 in this embodiment, the method further includes: Step S40: Obtain the anti-crawler policy of the application containing the application page; It should be noted that different applications use different anti-scraping strategies in practice. Currently, common anti-scraping strategies for applications or websites include: blocking IP addresses, disabling specific request headers, disabling cookies, CAPTCHA verification, JavaScript rendering, and asynchronous AJAX transmission.

[0057] In practical applications, to prevent certain apps with anti-scraping strategies from escaping supervision and spreading illegal multimedia information, developers in this embodiment can pre-collect the anti-scraping strategies configured by different apps, and then use methods to bypass these anti-scraping strategies to collect multimedia information data from the apps.

[0058] In a practical implementation, the mobile terminal can first determine which application provides the currently displayed application page, and then look up the anti-crawling policy corresponding to that application. Therefore, in this embodiment, an anti-crawling policy database for applications can be pre-established, so that when the mobile terminal determines the application where the application page is located, it can look up the corresponding anti-crawling policy in the anti-crawling policy database according to the application identifier (e.g., name, code, etc.) of that application.

[0059] Step S50: Adjust the application communication parameters currently used by the application according to the anti-crawler strategy; It should be noted that the application communication parameters can be parameters required by the application for network communication, such as IP address, request parameters carried in various parts of the network request, such as parameters carried in the request line, request header, blank line and message body of the HTTP request.

[0060] It should be understood that, as seen from the aforementioned anti-crawler strategies, traditional anti-crawler strategies are primarily set to target the application's communication parameters. For example, disabling specific request headers or cookies targets network request headers. Therefore, in practical applications, mobile terminals can adjust the application communication parameters currently used by the application according to anti-crawler strategies to bypass the application's current anti-crawler strategies and obtain the image and video data of the multimedia information displayed by the application.

[0061] Furthermore, to ensure the efficiency of parameter adjustment, developers can pre-configure corresponding parameter adjustment strategies for different types of anti-crawler strategies or methods, so that mobile terminals can directly obtain these strategies when needed and then adjust the parameters.

[0062] In practical implementation, the mobile terminal can search for the parameter adjustment policy corresponding to the anti-crawler policy in a preset policy library; then, according to the parameter adjustment policy, it changes the network communication address of the gateway device to which the application is connected, thereby adjusting the application's communication parameters. Specifically, when the mobile terminal determines that a network communication address change, i.e., an IP address change, is needed based on the parameter adjustment policy, it sends a notification to the gateway device to which the application is connected, so that the gateway device changes its IP address accordingly.

[0063] Of course, considering the diversity of anti-crawler strategies, in this embodiment, the mobile terminal can also modify the request parameters of the application page loading request when the application initiates the application page loading request, based on the parameter adjustment strategy. For example, when simulating a user accessing other pages on different App pages, the mobile terminal can modify the request header of the page loading request, thereby bypassing the App's anti-crawler strategy and continuously obtaining different types and categories of multimedia information.

[0064] Step S60: Based on the adjusted application communication parameters, request to load different application pages, and return to the step of obtaining the page content information contained in the application page.

[0065] It should be noted that after the mobile terminal adjusts the application communication parameters, it can request to load different application pages based on the adjusted application communication parameters, then obtain the page content information contained in the application page, and then repeatedly execute the operation of detecting whether there is a preset type of multimedia information in the application page based on the page content information.

[0066] Furthermore, considering that some applications' anti-crawling strategies may execute anti-crawling operations on the mobile terminal based on the mobile terminal's device parameters, such as the device's factory code, International Mobile Equipment Identity (IMEI), and MAC address, in this embodiment, the mobile terminal can also obtain the current IMEI and change it before performing operations to bypass anti-crawling strategies. After the change of the current IMEI is completed, the application is reinstalled, and the operation of obtaining the anti-crawling strategy of the application containing the application page is executed. For example, after the mobile terminal changes the current IMEI: abc to bcd, it uninstalls the application, reinstalls it, and then performs corresponding subsequent operations based on the changed IMEI and the reinstalled application.

[0067] This embodiment obtains the anti-crawler policy of the application containing the application page, then adjusts the application communication parameters currently used by the application according to the anti-crawler policy, and then requests to load different application pages based on the adjusted application communication parameters, so as to obtain the page content information contained in different application pages in a loop. This can effectively prevent some illegal applications from escaping legal supervision by setting anti-crawler policies and providing a place for the dissemination of illegal multimedia information, and effectively improve the evidence collection of illegal multimedia information.

[0068] Furthermore, this embodiment of the invention also proposes a storage medium storing a multimedia information acquisition program, which, when executed by a processor, implements the steps of the multimedia information acquisition method described above.

[0069] Reference Figure 6 , Figure 6 This is a structural block diagram of the first embodiment of the multimedia information acquisition device of the present invention.

[0070] like Figure 6 As shown, the multimedia information acquisition device proposed in this embodiment of the invention includes: The information detection module 501 is used to obtain page data corresponding to the landing page interface of the multimedia information when a preset type of multimedia information is detected in the application page. The data acquisition module 502 is used to perform a preset simulation operation based on the landing page interface, and to collect the image and video data displayed on the landing page interface during the execution of the preset simulation operation. The result acquisition module 503 is used to obtain the page data and the image and video data as multimedia information acquisition results.

[0071] This embodiment acquires page data corresponding to the landing page interface of multimedia information when a preset type of multimedia information is detected on the application page; then, a preset simulated operation is executed based on the landing page interface, and image and video data displayed on the landing page interface during the execution of the preset simulated operation are collected; finally, the page data and image / video data are used as the multimedia information acquisition result. Since this embodiment acquires the page data of the landing page interface only when the preset type of multimedia information is detected, it avoids acquiring page data of non-preset type multimedia information, improving the effectiveness of information acquisition. Simultaneously, by executing the preset simulated operation on the landing page interface, collecting image and video data displayed on the landing page interface during the execution of the preset simulated operation, and then using the page data and image / video data together as the multimedia information acquisition result, it can essentially acquire all the data of the multimedia information, ensuring the completeness of information acquisition and providing reliable data for subsequent evidence of illegality.

[0072] Based on the first embodiment of the multimedia information acquisition device of the present invention described above, a second embodiment of the multimedia information acquisition device of the present invention is proposed.

[0073] In this embodiment, the multimedia information acquisition device further includes: an information acquisition module; The information acquisition module is used to acquire page content information contained in the application page, and detect whether there is multimedia information of a preset type in the application page based on the page content information; The result acquisition module 503 is further configured to use the page content information, the page data, and the image and video data as multimedia information acquisition results.

[0074] In one implementation, the information detection module 501 is further configured to extract content identifiers and / or content materials corresponding to different page content from the page content information; and determine whether there is preset type of multimedia information in the application page based on the content identifiers and / or the content materials.

[0075] In one implementation, the information detection module 501 is further configured to, when detecting that there is multimedia information of a preset type in the application page, extract the link address corresponding to the multimedia information from the page content information; obtain the corresponding landing page interface according to the link address, and obtain the page data corresponding to the landing page interface.

[0076] In one embodiment, the multimedia information acquisition device further includes: an information sending module; The information sending module is used to convert the multimedia information acquisition result according to the target data exchange format to obtain the data to be identified, and send the data to be identified to a preset data center so that the preset data center can determine whether the multimedia information is illegal multimedia information based on the data to be identified.

[0077] In one implementation, the data acquisition module 502 is further configured to execute a preset simulation operation based on the landing page interface using a preset automation framework; determine a target data acquisition method based on the page data; and acquire the image and video data displayed on the landing page interface during the execution of the preset simulation operation according to the target data acquisition method.

[0078] In one implementation, the data acquisition module 502 is further configured to record video of the audio and video data displayed on the landing page interface during the execution of the preset simulation operation, so as to obtain video data corresponding to the audio and video data; and / or to capture images of the non-audio and video data displayed on the landing page interface during the execution of the preset simulation operation, so as to obtain image data corresponding to the non-audio and video data.

[0079] As one implementation, the multimedia information acquisition device further includes: a parameter adjustment module; The parameter adjustment module is used to obtain the anti-crawler strategy of the application where the application page is located; adjust the application communication parameters currently used by the application according to the anti-crawler strategy; request to load different application pages based on the adjusted application communication parameters, and perform the operation of obtaining the page content information contained in the application page.

[0080] In one implementation, the parameter adjustment module is further configured to search for the parameter adjustment strategy corresponding to the anti-crawler strategy in a preset strategy library; and to change the network communication address of the gateway device linked to the application according to the parameter adjustment strategy, so as to adjust the application communication parameters.

[0081] In one implementation, the parameter adjustment module is further configured to change the request parameters of the application page loading request when the application initiates the application page loading request according to the parameter adjustment strategy.

[0082] In one implementation, the parameter adjustment module is further configured to obtain the current International Mobile Equipment Identity (IMSI) code, change the current IMI code, and after the change of the current IMI code is completed, reinstall the application and execute the operation of obtaining the anti-crawler strategy of the application where the application page is located.

[0083] In one implementation, the information acquisition module is also used to periodically acquire type information and display format of different multimedia information; update the pre-set data collection method according to the type information and the display format; and acquire page content information contained in different application pages according to the updated data collection method.

[0084] Other embodiments or specific implementations of the multimedia information acquisition device of the present invention can be referred to the above-described method embodiments, and will not be repeated here.

[0085] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0086] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0087] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as read-only memory / random access memory, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of the present invention.

[0088] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A method for acquiring multimedia information, characterized in that, The multimedia information acquisition method includes: When a preset type of multimedia information is detected in the application page, the page data corresponding to the landing page interface of the multimedia information is obtained; Based on the landing page interface, a preset simulated operation is performed, and the image and video data displayed on the landing page interface during the execution of the preset simulated operation are collected; The page data and the image / video data are used as the multimedia information acquisition results; The step of performing a preset simulated operation based on the landing page interface and collecting the image and video data displayed on the landing page interface during the execution of the preset simulated operation includes: The target data collection method is determined based on the page data; The image and video data includes image data and / or video data, and the target data acquisition method includes image cropping and / or video recording; Record the audio and video data displayed on the landing page interface during the execution of the preset simulation operation to obtain the video data corresponding to the audio and video data; And / or, capture images of the non-audio / video data displayed on the landing page interface during the execution of the preset simulation operation to obtain image data corresponding to the non-audio / video data.

2. The multimedia information acquisition method as described in claim 1, characterized in that, Before the step of obtaining the page data corresponding to the landing page interface of the multimedia information when a preset type of multimedia information is detected in the application page, the method further includes: Retrieve information about the page content contained in the application page; Based on the page content information, detect whether there is preset type of multimedia information in the application page; The step of using the page data and the image / video data as the multimedia information acquisition result further includes: The page content information, the page data, and the image and video data are used as the multimedia information acquisition results.

3. The multimedia information acquisition method as described in claim 2, characterized in that, The step of detecting whether there is a preset type of multimedia information in the application page based on the page content information includes: Extract content identifiers and / or content materials corresponding to different page content from the page content information; Determine whether there is a preset type of multimedia information in the application page based on the content identifier and / or the content material.

4. The multimedia information acquisition method as described in claim 2, characterized in that, The step of obtaining page data corresponding to the landing page interface of the multimedia information when detecting the presence of a preset type of multimedia information on the application page includes: When a preset type of multimedia information is detected in the application page, the link address corresponding to the multimedia information is extracted from the page content information. Obtain the corresponding landing page interface based on the link address, and obtain the page data corresponding to the landing page interface.

5. The multimedia information acquisition method as described in claim 2, characterized in that, After the step of using the page content information, the page data, and the image and video data as the multimedia information acquisition result, the method further includes: The multimedia information acquisition results are converted according to the target data exchange format to obtain the data to be identified. The data to be identified is sent to a preset data center, so that the preset data center can determine whether the multimedia information is illegal multimedia information based on the data to be identified.

6. The multimedia information acquisition method as described in claim 1, characterized in that, The step of performing a preset simulated operation based on the landing page interface and collecting the image and video data displayed on the landing page interface during the execution of the preset simulated operation includes: Pre-defined simulated operations are executed based on the landing page interface using a pre-defined automation framework. The target data collection method is determined based on the page data; Collect the image and video data displayed on the landing page interface during the execution of the preset simulation operation according to the target data collection method.

7. The multimedia information acquisition method as described in claim 2, characterized in that, After the step of using the page data and the image / video data as the multimedia information acquisition result, the method further includes: Obtain the anti-crawler policy of the application containing the application page; The application communication parameters currently used by the application are adjusted according to the anti-crawler strategy. Based on the adjusted application communication parameters, request to load different application pages, and return to the step of obtaining the page content information contained in the application page.

8. The multimedia information acquisition method as described in claim 7, characterized in that, The step of adjusting the application communication parameters currently used by the application according to the anti-crawler strategy further includes: Search the preset strategy library for the parameter adjustment strategy corresponding to the anti-crawler strategy; According to the parameter adjustment strategy, the network communication address of the gateway device linked to the application is changed to adjust the application's communication parameters.

9. The multimedia information acquisition method as described in claim 8, characterized in that, After the step of changing the network communication address of the gateway device linked to the application according to the parameter adjustment strategy to adjust the application's communication parameters, the method further includes: According to the parameter adjustment strategy, when the application initiates an application page loading request, the request parameters of the application page loading request are changed.

10. The multimedia information acquisition method as described in claim 7, characterized in that, Before the step of obtaining the anti-crawling strategy of the application where the application page is located, the method further includes: Obtain the current International Mobile Equipment Identity (IMSI) and change the current IMI; After the current International Mobile Equipment Identity (IMEI) is changed, the application is reinstalled, and the step of obtaining the anti-crawler strategy of the application containing the application page is executed.

11. The multimedia information acquisition method according to any one of claims 1 to 10, characterized in that, The multimedia information acquisition method further includes: Periodically acquire information on the types and display formats of different multimedia information; The pre-defined data collection method is updated based on the type information and the display format. The updated data collection method is used to obtain page content information for different application pages.

12. A multimedia information acquisition device, characterized in that, The multimedia information acquisition device includes: The information detection module is used to obtain the page data corresponding to the landing page interface of the multimedia information when a preset type of multimedia information is detected in the application page. The data acquisition module is used to perform a preset simulation operation based on the landing page interface, and to collect the image and video data displayed on the landing page interface during the execution of the preset simulation operation; The result acquisition module is used to obtain the page data and the image and video data as multimedia information acquisition results. The step of performing a preset simulated operation based on the landing page interface and collecting the image and video data displayed on the landing page interface during the execution of the preset simulated operation includes: The target data collection method is determined based on the page data; The image and video data includes image data and / or video data, and the target data acquisition method includes image cropping and / or video recording; Record the audio and video data displayed on the landing page interface during the execution of the preset simulation operation to obtain the video data corresponding to the audio and video data; And / or, capture images of the non-audio / video data displayed on the landing page interface during the execution of the preset simulation operation to obtain image data corresponding to the non-audio / video data.

13. The multimedia information acquisition device as described in claim 12, characterized in that, The multimedia information acquisition device further includes: an information acquisition module; The information acquisition module is used to acquire page content information contained in the application page, and detect whether there is multimedia information of a preset type in the application page based on the page content information; The result acquisition module is further configured to use the page content information, the page data, and the image and video data as multimedia information acquisition results.

14. The multimedia information acquisition device as described in claim 13, characterized in that, The information detection module is also used to extract content identifiers and / or content materials corresponding to different page content from the page content information; and to determine whether there is preset type of multimedia information in the application page based on the content identifiers and / or the content materials.

15. The multimedia information acquisition device as described in claim 12 or 13, characterized in that, The information detection module is further configured to, when detecting the presence of a preset type of multimedia information on the application page, extract the link address corresponding to the multimedia information from the page content information; obtain the corresponding landing page interface based on the link address; and obtain the page data corresponding to the landing page interface.

16. The multimedia information acquisition device as described in claim 13, characterized in that, The multimedia information acquisition device further includes: an information sending module; The information sending module is used to convert the multimedia information acquisition result according to the target data exchange format to obtain the data to be identified, and send the data to be identified to a preset data center so that the preset data center can determine whether the multimedia information is illegal multimedia information based on the data to be identified.

17. The multimedia information acquisition device as described in claim 12, characterized in that, The data acquisition module is further configured to execute a preset simulation operation based on the landing page interface using a preset automation framework; determine a target data acquisition method based on the page data; and acquire image and video data displayed on the landing page interface during the execution of the preset simulation operation according to the target data acquisition method.

18. A multimedia information acquisition device, characterized in that, The device includes: a memory, a processor, and a multimedia information acquisition program stored in the memory and executable on the processor, the multimedia information acquisition program being configured to implement the steps of the multimedia information acquisition method as described in any one of claims 1 to 11.

19. A storage medium, characterized in that, The storage medium stores a multimedia information acquisition program, which, when executed by a processor, implements the steps of the multimedia information acquisition method as described in any one of claims 1 to 11.

Images