A data mining method, device, computer equipment and storage medium
By collecting display screens and identifying contents on multi-screen monitors, the data noise problem during crawler collection is solved, and accurate analysis and demand mining of user behavior data is achieved.
Patent Information
- Application Number
- CN202111270892.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-29
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2041-10-29
AI Technical Summary
In the prior art, when collecting user behavior information through crawlers, a large amount of data noise is easily mixed with, resulting in high data distortion and the inability to accurately tap into user needs.
By collecting display screens for multi-screen monitors, obtaining information recognition images from different display screens, performing content recognition processing, and correlating information from different sources to reduce data noise and ensure data reliability.
It realizes accurate collection and analysis of user behavior data, correctly explores user needs under the application, and improves data processing effect.
Smart Images

Figure CN113920496B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of artificial intelligence technology, and in particular, relates to a data mining method, device, computer equipment and storage medium. Background Art
[0002] With the development of network informatization, effective collection and utilization of network information can realize the mining of effective information from massive network data. For example, information collection and data analysis of users' browsing behavior in media carriers can effectively mine user needs and provide better services for current users.
[0003] Existing information collection and mining usually uses web crawler technology, which captures the desired information from massive user behavior data through crawlers, and then processes this information through customized software to mine specific user information.
[0004] However, due to the huge amount of network data, it is easy to be mixed with a lot of data noise when collecting user behavior information through crawlers, resulting in serious distortion of the collected data. It is impossible to correctly mine the accurate user usage needs under the application, affecting the data processing effect. Summary of the invention
[0005] The embodiments of the present application provide a data mining method, apparatus, computer equipment and storage medium to solve the problem in the prior art that when background data collection of user behavior information is performed by crawlers, a large amount of data noise is easily mixed in, resulting in serious distortion of the collected data and inability to correctly mine the accurate user needs under the application.
[0006] A first aspect of an embodiment of the present application provides a data mining method, comprising:
[0007] Capturing display images of a multi-screen display to obtain an information recognition image containing images displayed on different display screens; wherein the multi-screen display comprises a plurality of the display screens, and different display screens display information display contents from different sources;
[0008] Based on the information recognition image, performing content recognition processing on the display screens of each of the display screens to obtain information recognition content;
[0009] Based on the information identification content, the information display content from different sources is associated to obtain mining information.
[0010] Optionally, before collecting display images of the multi-screen displays to obtain information recognition images including images displayed on different display screens, the method further includes:
[0011] Based on the data mining task, determine the target application to be processed;
[0012] Based on the target application, determining information browsing pages with different contents related to the target application as the information display contents from different sources;
[0013] The multi-screen display is controlled to display the information display content separately through the multiple display screens included. Optionally, based on the target application, determining the information browsing pages with different contents related to the target application as the information display content from different sources includes:
[0014] Based on the target application, determining information browsing pages corresponding to different users in the same target application as the information display contents from different sources; or,
[0015] Based on the target application, determining the information browsing pages corresponding to the same user in different target applications as the information display contents from different sources; or,
[0016] Based on the target application, information browsing pages corresponding to different users in different target applications are determined as the information display contents from different sources.
[0017] Optionally, the collecting of display images of multiple displays to obtain information recognition images containing images displayed on different display screens includes:
[0018] Searching for page operation items from information browsing pages displayed on different display screens through a screen operation detection control;
[0019] Based on the page operation item found, triggering a switching operation of the information browsing page;
[0020] Based on the triggered switching operation, when the current information browsing page displayed on at least one of the display screens is switched to the next information browsing page, the display screens of the multi-screen displays are captured to obtain an information recognition image containing the screens displayed on different display screens.
[0021] Optionally, the trigger-based switching operation, when the current information browsing page displayed on at least one of the display screens is switched to the next information browsing page, collects display images of the multi-screen display to obtain information recognition images containing images displayed on different display screens, including:
[0022] Based on the triggered switching operation, the switching paths of the information browsing pages displayed on different display screens are recorded to obtain a page browsing path;
[0023] Based on the page browsing path, when the current information browsing page displayed on at least one of the display screens is switched to a next information browsing page, determining whether the next information browsing page is an information browsing page that has been browsed;
[0024] When the judgment is no, the display images of the multi-screen display are collected to obtain an information recognition image containing the images displayed on different display screens.
[0025] Optionally, based on the page browsing path, when the current information browsing page displayed on at least one of the display screens is switched to a next information browsing page, after determining whether the next information browsing page is an information browsing page that has been browsed, the method further includes:
[0026] When the judgment is yes, the next information browsing page is used as the current information browsing page, and the process returns to execute the page operation item found out, triggering the step of switching the information browsing page, until it is determined that the next information browsing page is not an information browsing page that has been browsed, or until the information display content corresponding to the source of the current display screen is displayed.
[0027] Optionally, the information display contents from different sources are associated based on the information identification content to obtain mining information, including:
[0028] Based on the information identification content, extract key information from the information display content corresponding to the different display screens;
[0029] Based on the extracted key information, information association is performed on the information display contents from different sources to obtain the mined information.
[0030] A second aspect of an embodiment of the present application provides a data mining device, including:
[0031] An image acquisition module is used to acquire display images of a multi-screen display to obtain an information recognition image containing images displayed on different display screens; wherein the multi-screen display includes a plurality of the display screens, and different display screens display information display contents from different sources;
[0032] A content recognition module, configured to perform content recognition processing on the display screens of each of the display screens based on the information recognition image to obtain information recognition content;
[0033] The information association module is used to associate the information display contents from different sources based on the information identification content to obtain mining information.
[0034] A third aspect of an embodiment of the present application provides a terminal, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method described in the first aspect when executing the computer program.
[0035] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method described in the first aspect are implemented.
[0036] A fifth aspect of the present application provides a computer program product, which, when executed on a terminal, enables the terminal to execute the steps of the method described in the first aspect.
[0037] As can be seen from the above, in the embodiment of the present application, by collecting display images of a multi-screen display, an information recognition image containing images displayed on different display screens is obtained. The multi-screen display includes multiple display screens, and information display content from different sources is displayed on different display screens. Based on the information recognition image, content recognition processing is performed on the display images of each display screen to obtain information recognition content, and finally based on the information recognition content, information display content from different sources is associated to obtain mining information. This process starts from the user's perspective, uses a multi-screen display to synchronously display information display content from different sources, and realizes information content recognition of the images displayed on each display screen through the display screen image obtained by collecting the display image, thereby greatly reducing the data noise mixed in when collecting user behavior data, ensuring the reliability of the collected data, and then realizing the correct mining of accurate user demand data under the application based on the identified information content. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0039] Figure 1 This is a process of a data mining method provided by an embodiment of the present application. Figure 1 ;
[0040] Figure 2 This is a schematic diagram of the structure of a multi-screen display in an embodiment of the present application;
[0041] Figure 3 This is a process of a data mining method provided by an embodiment of the present application. Figure 2 ;
[0042] Figure 4 is a structural diagram of a data mining device provided in an embodiment of the present application;
[0043] Figure 5 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0044] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0045] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.
[0046] It should also be understood that the terms used in this application specification are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in this application specification and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include plural forms.
[0047] It should be further understood that the term “and / or” used in the specification and appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.
[0048] As used in this specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]," depending on the context.
[0049] In a specific implementation, the terminal described in the embodiments of the present application includes, but is not limited to, other portable devices such as mobile phones, laptop computers, or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touch pads).
[0050] In the following discussion, a terminal including a display and a touch-sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, mouse and / or joystick.
[0051] The terminal supports various applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk burning application, a spreadsheet application, a game application, a telephone application, a video conferencing application, an email application, an instant messaging application, a workout support application, a photo management application, a digital camera application, a digital camcorder application, a web browsing application, a digital music player application, and / or a digital video player application.
[0052] Various applications that can be executed on the terminal can use at least one common physical user interface device such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the terminal can be adjusted and / or changed between applications and / or within corresponding applications. In this way, the common physical architecture of the terminal (e.g., the touch-sensitive surface) can support various applications with user interfaces that are intuitive and transparent to the user.
[0053] It should be understood that the size of the serial numbers of the steps in this embodiment does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.
[0054] In order to illustrate the technical solution described in this application, a specific embodiment is provided below for illustration.
[0055] See also Figure 1 , Figure 1 This is a process of a data mining method provided by an embodiment of the present application. Figure 1 .like Figure 1 As shown, a data mining method comprises the following steps:
[0056] Step 101, collecting display images of multiple display screens to obtain information recognition images including images displayed on different display screens.
[0057] Among them, the multi-screen display includes multiple display screens, and different display screens display information display content from different sources.
[0058] The multi-screen display is specifically a display including multiple display screens. Figure 2 As shown, the multiple display screens form a display screen array in a multi-screen display. Optionally, the multiple display screens in the display screen array can be, for example Figure 2 The adjacent arrangement shown may also be a separated arrangement with intervals between them, which can be adjusted according to actual needs and specific hardware configuration.
[0059] Among them, the sources of the information display contents corresponding to the pictures displayed by different displays are different.
[0060] Different sources of information display content can be distinguished by APP.
[0061] Specifically, the information display content from different sources is, for example, information display content from different application APPs. The source of the information display content is, for example:
[0062] The user browsing page of Toutiao, the user browsing page of Xigua Video, the product browsing page jumped out from Toutiao, the short video browsing page of Douyin, the product browsing page jumped out from Douyin, the live broadcast room browsing page entered from Douyin, etc.
[0063] Furthermore, different sources of information display content can be distinguished by APP combined with user information.
[0064] In an optional implementation, the information displayed on different display screens is derived from information browsing content of different users in the same application. The source of the information displayed content is, for example:
[0065] The information browsing page of user A in WeChat, and the information browsing page of user B in WeChat.
[0066] Alternatively, the information displayed on different display screens is derived from the information browsed by the same user in different applications. The source of the information displayed is, for example:
[0067] The information browsing page of user A in WeChat and the information browsing page of user A in QQ.
[0068] Alternatively, the information displayed on different display screens is derived from the information browsed by different users in different applications. The source of the information displayed is, for example:
[0069] The information browsing page of user A in WeChat and the information browsing page of user B in TikTok.
[0070] In this step, the images displayed on different display screens in the multi-screen display are collected to obtain information recognition images containing the images displayed on each display screen. Wherein, each time the display image is collected once for the multi-screen display, the information display content from different sources in each display screen collected in the collection operation is automatically formed into a group of data to be processed, that is, the images collected at one collection time are regarded as a group of data content, and a subsequent content recognition processing operation is performed.
[0071] Among them, as the simulated user browsing behavior occurs or the screen jump or screen change rules set in the application take effect, the display content from different sources displayed on different display screens will change, and the changes in the screen content displayed on each display screen are not completely synchronized. Therefore, by collecting the display screens of the display screens at different times, information recognition pictures composed of the display contents of different display screens can be obtained, and the content arrangement and combination of content information from different sources at different collection times can be realized. Through the combined association between information content from different sources, the sample diversity during data analysis and the multi-angle nature of data analysis can be improved.
[0072] This process changes the existing method of capturing data from massive backend network data. It simulates the information browsing process of people from the user's perspective to collect browsing data.
[0073] Specifically, when collecting display images of multiple display screens to obtain information recognition images containing images displayed on different display screens, it can be specifically through Figure 2 The camera in the multi-screen display takes a picture to obtain an information recognition image including the pictures displayed on different display screens, or the multi-screen display is controlled to perform a screenshot operation to obtain a screenshot image obtained by splicing the pictures displayed on the different display screens as an information recognition image.
[0074] That is, by triggering a screenshot operation or a photo taking operation on a multi-screen display, an information recognition image including the images displayed on different display screens is obtained.
[0075] Step 102 , based on the information recognition image, content recognition processing is performed on the display screens of each display screen to obtain information recognition content.
[0076] In this step, by performing content recognition processing on the information recognition image, information recognition contents corresponding to the display screens of each display screen are obtained.
[0077] The information recognition content may specifically include recognized characters, recognized objects, and the like.
[0078] Correspondingly, when performing content recognition processing on the display screens of each display screen, images can be recognized based on the collected information, and image processing operations such as character recognition operations and object recognition operations can be performed therefrom. The specific operations can be performed based on the information recognition content that needs to be obtained.
[0079] The information recognition image is subjected to character recognition processing, and specifically, the characters contained in the information recognition image can be recognized by using OCR (Optical Character Recognition) technology to obtain the information recognition content.
[0080] The information recognition image is processed for object recognition. Specifically, object recognition can be achieved through means such as contour recognition, key feature point recognition, etc., or directly through a pre-trained artificial intelligence model to achieve object recognition in the image to obtain information recognition content.
[0081] Step 103, based on the information identification content, information display contents from different sources are associated to obtain mining information.
[0082] After the information identification content is identified, the information identification content includes the information content corresponding to the screen displayed on each display screen. At this time, it is necessary to extract key information from the information content corresponding to the content displayed on different display screens based on the information identification content to determine the relevance between different information contents, and then determine the valuable information related to the current user based on the information relevance between the information sources.
[0083] The key information includes, for example, keywords with a frequency higher than a threshold, and the type of the identified information content, such as social news, entertainment gossip, beauty and skin care, etc.
[0084] That is, based on the information identification content, information association is performed on the information display contents from different sources to obtain the mining information. Specifically, based on the information identification content, key information is extracted from the information display contents corresponding to different display screens, and based on the extracted key information, information association is performed on the information display contents from different sources to obtain the mining information.
[0085] Among them, based on the extracted key information, information association is performed on information display contents from different sources to obtain mining information. For example, based on the extracted key information, the type of information identification content is determined, and information display contents from different sources belonging to the same type are divided into a data set. Based on the data set, information such as data similarity, data difference, etc. between APPs from different sources of information display content in the set is obtained, or based on the data set, information such as information browsing preferences of users corresponding to different sources of information display content in the set is obtained.
[0086] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.
[0087] AI basic technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics, etc. AI software technologies mainly include computer vision technology, robotics technology, biometrics technology, speech processing technology, natural language processing technology, and machine learning / deep learning.
[0088] This process starts from the user end, simulates the human operating perspective, and uses the user browsing behavior from different sources displayed on each screen in the multi-screen display to collect user browsing images, and conducts content recognition and mining analysis on them, so as to achieve purposeful and targeted collection of user behavior information, improve the accuracy of analysis results, and reduce unnecessary data noise caused by massive data.
[0089] In an embodiment of the present application, by collecting display images of a multi-screen display, an information recognition image containing images displayed on different display screens is obtained. The multi-screen display includes multiple display screens, and information display content from different sources is displayed on different display screens. Based on the information recognition image, content recognition processing is performed on the display images of each display screen to obtain information recognition content, and finally based on the information recognition content, information display content from different sources is associated to obtain mining information. This process starts from the user's perspective, uses a multi-screen display to synchronously display information display content from different sources, and realizes information content recognition of the images displayed on each display screen through the display screen image obtained by collecting the display image, thereby greatly reducing data noise mixed in when collecting user behavior data, ensuring the reliability of the collected data, and then realizing correct mining of accurate user demand data under the application based on the identified information content.
[0090] Among them, further, in an optional embodiment, the aforementioned step 101 collects display images of multiple display screens to obtain information recognition images containing images displayed on different display screens, including:
[0091] Through the screen operation detection control, the page operation items are explored from the information browsing pages displayed on different display screens;
[0092] Based on the discovered page operation items, trigger the switching operation of the information browsing page;
[0093] Based on the triggered switching operation, when the current information browsing page displayed on at least one display screen is switched to the next information browsing page, the display images of the multiple display screens are captured to obtain an information recognition image including the images displayed on different display screens.
[0094] Wherein, each display screen included in the multi-screen display is provided with a page operation detection control, and the page operation detection control is used to detect page operation items in the information browsing page displayed on the display screen. The setting of the page operation detection control in each display screen realizes the simulation of the user's browsing operation.
[0095] The specific implementation of the exploration operation can be to perform blind exploration of page operations in the information browsing page of the display screen through the set page operation detection control, and realize the exploration of page operation items by performing multi-point traversal blind exploration touch on the information browsing page in the display screen, so as to further realize automatic anthropomorphic page operation and enhance the intelligence of simulation of user browsing operations.
[0096] Among them, the page operation items include, for example, click to enter, return, page closing, page turning, page jumping from the current APP to other APP pages, and other operation items.
[0097] When the switching operation of the information browsing page is triggered based on the found page operation items, the corresponding page operation items may be executed based on the order in which the page operation items are found to trigger the switching operation of the information browsing page.
[0098] For example, on the Tik Tok video browsing page, you can find operations such as entering the homepage of the video uploader, playing the video in full screen, and clicking on the product link to jump to the product sales page.
[0099] Based on the discovered page operation items, each time a switching operation of an information browsing page is triggered in at least one display screen, that is, the display screen in the display screen changes, a corresponding operation of collecting display screens on multiple displays is performed to obtain an information recognition image containing the screens displayed on different display screens. In order to collect a new information recognition image, the display contents of different display screens at the current moment can be combined to form an information recognition image, and then image content recognition and correlation analysis operations are implemented on this basis to improve the comprehensiveness of data mining.
[0100] Further, in an optional implementation, the trigger-based switching operation, when the current information browsing page displayed on at least one display screen is switched to the next information browsing page, displays of the multi-screen displays are collected to obtain information recognition images containing the images displayed on different display screens, including:
[0101] Based on the triggered switching operation, the switching paths of the information browsing pages displayed on different display screens are recorded to obtain the page browsing path;
[0102] Based on the page browsing path, when the current information browsing page displayed on at least one display screen is switched to a next information browsing page, determining whether the next information browsing page is an information browsing page that has been browsed;
[0103] When the judgment is no, display images of the multi-screen displays are collected to obtain an information recognition image containing images displayed on different display screens.
[0104] Among them, recording the switching paths of the information browsing pages displayed on different display screens can be to mark different information browsing pages, and each time the information browsing page is switched, the corresponding page mark is recorded in the browsing order of the two information browsing pages corresponding to the current switching operation.
[0105] For example, after entering an APP, the information browsing page displayed on the display screen is the APP main page, and the page mark of the main page is 1. Then, the page switching operation is triggered by the page operation item, and the main page is switched to the personal page of the video uploader A. The personal page of the video uploader A is marked as A. Then, the page switching operation is triggered by the page operation item again, and the personal page of the video uploader A is switched to the video playback page uploaded by the video uploader A on the latest date. The video playback page is marked as A1.
[0106] On this basis, the page switching path of 1-A-A1 can be recorded, that is, the page browsing path can be obtained.
[0107] The page mark can be represented by the function corresponding to the page, or page summary information can be formed based on the page display content as a page mark to distinguish different information browsing pages. For example, the page start position characters, page end position characters, page key information characters, etc. in the information browsing page are recorded to determine whether the current page is an information browsing page that has been browsed, so as to avoid repeated information extraction.
[0108] As a specific implementation, based on the page browsing path, when the current information browsing page displayed on at least one display screen is switched to the next information browsing page, after determining whether the next information browsing page is an information browsing page that has been browsed, the method further includes:
[0109] When the judgment is yes, the next information browsing page is taken as the current information browsing page, and the process returns to execute the step of triggering the switching operation of the information browsing page based on the found page operation item, until it is determined that the next information browsing page is not an information browsing page that has been browsed, or until the information display content corresponding to the source of the current display screen is displayed.
[0110] This processing process, through the page operation detection control, realizes the exploration of page operation items in different information browsing pages, so as to identify the page browsing operations supported in the current page, realize the automatic browsing simulation of the page, explore the possible information combinations of information display content from different sources under the user's browsing operation, and dig out what kind of information transmission content the user will encounter when browsing information using different media, so as to provide a reference for what kind of data to push to the user in what way.
[0111] Different implementation methods of the data mining method are also provided in the examples of this application.
[0112] See also Figure 3 , Figure 3 This is a process of a data mining method provided by an embodiment of the present application. Figure 2 .like Figure 3 As shown, a data mining method comprises the following steps:
[0113] Step 301: Determine a target application to be processed based on a data mining task.
[0114] The data mining task may be a task set in advance. By analyzing the data mining task, it is possible to extract which applications are involved in the target object of the data mining and use these applications as target applications.
[0115] Step 302: Based on the target application, information browsing pages with different contents related to the target application are determined as information display contents from different sources.
[0116] Here, different content information browsing pages related to the target application are, for example, information browsing pages corresponding to different users in the same target application, information browsing pages corresponding to the same user in different target applications, or information browsing pages corresponding to different users in different target applications.
[0117] Specifically, correspondingly, based on the target application, the information browsing pages of different contents related to the target application are determined as information display contents from different sources, including:
[0118] Based on the target application, the information browsing pages corresponding to different users in the same target application are determined as information display contents from different sources; or, based on the target application, the information browsing pages corresponding to the same user in different target applications are determined as information display contents from different sources; or, based on the target application, the information browsing pages corresponding to different users in different target applications are determined as information display contents from different sources.
[0119] Step 303: Control the multi-screen display to display the information display content separately through the multiple display screens included.
[0120] Specifically, when controlling a multi-screen display to separately display information display contents through multiple display screens included therein, when the number of data sources of the information display contents is less than the total number of multiple display screens included in the multi-screen display, the multi-screen display can be controlled to separately display information display contents from different sources through some of the multiple display screens.
[0121] When the number of data sources of the information display content is equal to the total number of the multiple display screens included in the multi-screen display, the multi-screen display can be controlled to directly display the information display content from different sources separately through the multiple display screens.
[0122] When the number of data sources of the information display content is greater than the total number of the multiple display screens included in the multi-screen display, the multi-screen display can be controlled to display the information display content from different sources in batches through the multiple display screens.
[0123] Step 304: collect display images of the multi-screen displays to obtain an information recognition image including the images displayed on different display screens.
[0124] Among them, the multi-screen display includes multiple display screens, and different display screens display information display content from different sources.
[0125] The implementation process of this step is the same as the implementation process of step 101 in the aforementioned embodiment, and will not be repeated here.
[0126] Step 305: Based on the information recognition image, content recognition processing is performed on the display screens of each of the display screens to obtain information recognition content.
[0127] The implementation process of this step is the same as the implementation process of step 102 in the aforementioned embodiment, and will not be repeated here.
[0128] Step 306: Based on the information identification content, information association is performed on the information display content from different sources to obtain mining information.
[0129] The implementation process of this step is the same as the implementation process of step 103 in the aforementioned embodiment, and will not be repeated here.
[0130] As can be seen from the above, in the embodiment of the present application, based on the target application, information browsing pages of different contents related to the target application are determined as information display contents from different sources, and the information display contents are displayed separately through different display screens in a multi-screen display, and by collecting display images of the multi-screen display, an information recognition image containing the images displayed on different display screens is obtained, and based on the information recognition image, content recognition processing is performed on the display images of each display screen to obtain information recognition content, and finally based on the information recognition content, information display contents from different sources are associated to obtain mined information. This process starts from the user's perspective, and uses a multi-screen display to synchronously display information display contents from different sources, and realizes information content recognition of the images displayed on each display screen through the display screen images obtained by collecting the display images, thereby greatly reducing the data noise mixed in when collecting user behavior data, ensuring the reliability of the collected data, and then realizing the correct mining of accurate user demand data under the application based on the identified information content.
[0131] See also Figure 4 , Figure 4 This is a structural diagram of a data mining device provided in an embodiment of the present application. For the sake of convenience of explanation, only the parts related to the embodiment of the present application are shown.
[0132] The data mining device 400 comprises:
[0133] The image acquisition module 401 is used to acquire display images of a multi-screen display to obtain an information recognition image including images displayed on different display screens; wherein the multi-screen display includes a plurality of display screens, and different display screens display information display contents from different sources;
[0134] A content recognition module 402 is used to perform content recognition processing on the display screens of each of the display screens based on the information recognition image to obtain information recognition content;
[0135] The information association module 403 is used to associate the information display contents from different sources based on the information identification content to obtain mining information.
[0136] The device also includes a display control module, which is used to:
[0137] Based on the data mining task, determine the target application to be processed;
[0138] Based on the target application, determining information browsing pages with different contents related to the target application as the information display contents from different sources;
[0139] The multi-screen display is controlled to display the information display content separately through the multiple display screens included.
[0140] The display control module is specifically used for:
[0141] Based on the target application, determining information browsing pages corresponding to different users in the same target application as the information display contents from different sources; or,
[0142] Based on the target application, determining the information browsing pages corresponding to the same user in different target applications as the information display contents from different sources; or,
[0143] Based on the target application, information browsing pages corresponding to different users in different target applications are determined as the information display contents from different sources.
[0144] Among them, the image acquisition module is specifically used for:
[0145] Searching for page operation items from information browsing pages displayed on different display screens through a screen operation detection control;
[0146] Based on the page operation item found, triggering a switching operation of the information browsing page;
[0147] Based on the triggered switching operation, when the current information browsing page displayed on at least one of the display screens is switched to the next information browsing page, the display screens of the multi-screen displays are captured to obtain an information recognition image containing the screens displayed on different display screens.
[0148] The image acquisition module is more specifically used for:
[0149] Based on the triggered switching operation, the switching paths of the information browsing pages displayed on different display screens are recorded to obtain a page browsing path;
[0150] Based on the page browsing path, when the current information browsing page displayed on at least one of the display screens is switched to a next information browsing page, determining whether the next information browsing page is an information browsing page that has been browsed;
[0151] When the judgment is no, the display images of the multi-screen display are collected to obtain an information recognition image containing the images displayed on different display screens.
[0152] The image acquisition module is more specifically used for:
[0153] When the judgment is yes, the next information browsing page is used as the current information browsing page, and the process returns to execute the page operation item found out, triggering the step of switching the information browsing page, until it is determined that the next information browsing page is not an information browsing page that has been browsed, or until the information display content corresponding to the source of the current display screen is displayed.
[0154] Among them, the information association module is specifically used for:
[0155] Based on the information identification content, extract key information from the information display content corresponding to the different display screens;
[0156] Based on the extracted key information, information association is performed on the information display contents from different sources to obtain the mined information.
[0157] The data mining device provided in the embodiment of the present application can implement each process of the embodiment of the above-mentioned data mining method and can achieve the same technical effect. To avoid repetition, it will not be described here.
[0158] Figure 5 is a structural diagram of a computer device provided in an embodiment of the present application. As shown in the figure, the computer device 5 of this embodiment includes: at least one processor 50 ( Figure 5 Only one is shown in the figure), a memory 51, and a computer program 52 stored in the memory 51 and executable on the at least one processor 50, wherein the processor 50 implements the steps of any of the above-mentioned method embodiments when executing the computer program 52.
[0159] The computer device 5 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The computer device 5 may include, but is not limited to, a processor 50 and a memory 51. Those skilled in the art will appreciate that Figure 5 It is only an example of the computer device 5 and does not constitute a limitation of the computer device 5. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the computer device may also include input and output devices, network access devices, buses, etc.
[0160] The processor 50 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0161] The memory 51 may be an internal storage unit of the computer device 5, such as a hard disk or memory of the computer device 5. The memory 51 may also be an external storage device of the computer device 5, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device 5. Further, the memory 51 may also include both an internal storage unit and an external storage device of the computer device 5. The memory 51 is used to store the computer program and other programs and data required by the computer device. The memory 51 may also be used to temporarily store data that has been output or is to be output.
[0162] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0163] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0164] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0165] In the embodiments provided in the present application, it should be understood that the disclosed devices / terminals and methods can be implemented in other ways. For example, the device / terminal embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0166] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0167] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0168] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.
[0169] The present application implements all or part of the processes in the above-mentioned embodiment method, and may also be implemented through a computer program product. When the computer program product runs on a terminal, the terminal can implement the steps in the above-mentioned method embodiments when executing the computer program product.
[0170] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A data mining method, characterized in that: include: Capturing display images of a multi-screen display to obtain an information recognition image including images displayed on different display screens; wherein the multi-screen display comprises a plurality of display screens, and different display screens display information display contents from different sources; each of the display screens is provided with a page operation detection control; the page operation detection control is used to search for page operation items in an information browsing page in the display screen, and based on the order in which the page operation items are searched, execute the corresponding page operation items to achieve simulation of user browsing operations; Based on the information recognition image, performing content recognition processing on the display screens of each of the display screens to obtain information recognition content; Based on the information identification content, information association is performed on the information display content from different sources to obtain mining information; The step of collecting display images from multiple displays to obtain information recognition images containing images displayed on different display screens includes: Using a page operation detection control, searching for page operation items from information browsing pages displayed on different display screens; Based on the page operation item found, triggering a switching operation of the information browsing page; Based on the triggered switching operation, when the current information browsing page displayed on at least one of the display screens is switched to the next information browsing page, the display screens of the multi-screen displays are captured to obtain an information recognition image containing the screens displayed on different display screens.
2. The method according to claim 1, characterized in that Before collecting display images of the multi-screen display to obtain information recognition images including images displayed on different display screens, the method further includes: Based on the data mining task, determine the target application to be processed; Based on the target application, determining information browsing pages with different contents related to the target application as the information display contents from different sources; The multi-screen display is controlled to display the information display content separately through the multiple display screens included.
3. The method according to claim 2, characterized in that The determining, based on the target application, information browsing pages with different contents related to the target application as the information display contents from different sources includes: Based on the target application, determining information browsing pages corresponding to different users in the same target application as the information display contents from different sources; or, Based on the target application, determining the information browsing pages corresponding to the same user in different target applications as the information display contents from different sources; or, Based on the target application, information browsing pages corresponding to different users in different target applications are determined as the information display contents from different sources.
4. The method according to claim 1, characterized in that: The trigger-based switching operation, when the current information browsing page displayed on at least one of the display screens is switched to the next information browsing page, collects display images of the multi-screen display to obtain information recognition images containing images displayed on different display screens, including: Based on the triggered switching operation, the switching paths of the information browsing pages displayed on different display screens are recorded to obtain a page browsing path; Based on the page browsing path, when the current information browsing page displayed on at least one of the display screens is switched to a next information browsing page, determining whether the next information browsing page is an information browsing page that has been browsed; When the judgment is no, the display images of the multi-screen display are collected to obtain an information recognition image containing the images displayed on different display screens.
5. The method according to claim 4, characterized in that The method further comprises: when the current information browsing page displayed on at least one of the display screens is switched to a next information browsing page based on the page browsing path, after determining whether the next information browsing page is an information browsing page that has been browsed: When the judgment is yes, the next information browsing page is used as the current information browsing page, and the process returns to execute the page operation item found out, triggering the step of switching the information browsing page, until it is determined that the next information browsing page is not an information browsing page that has been browsed, or until the information display content corresponding to the source of the current display screen is displayed.
6. The method according to claim 1, characterized in that The information display contents from different sources are associated with each other based on the information identification content to obtain mining information, including: Based on the information identification content, extract key information from the information display content corresponding to the different display screens; Based on the extracted key information, information association is performed on the information display contents from different sources to obtain the mined information.
7. A data mining device, characterized in that: include: An image acquisition module is used to acquire display images of a multi-screen display to obtain information recognition images containing images displayed on different display screens; wherein the multi-screen display includes a plurality of display screens, and different display screens display information display contents from different sources; each of the display screens is provided with a page operation detection control; the page operation detection control is used to search for page operation items in an information browsing page in the display screen, and execute corresponding page operation items based on the order in which the page operation items are searched, so as to simulate the user's browsing operation; A content recognition module, configured to perform content recognition processing on the display screens of each of the display screens based on the information recognition image to obtain information recognition content; An information association module, used to associate the information display contents from different sources based on the information identification content to obtain mining information; The image acquisition module is specifically used for: Using a page operation detection control, searching for page operation items from information browsing pages displayed on different display screens; Based on the page operation item found, triggering a switching operation of the information browsing page; Based on the triggered switching operation, when the current information browsing page displayed on at least one of the display screens is switched to the next information browsing page, the display screens of the multi-screen displays are captured to obtain an information recognition image containing the screens displayed on different display screens.
8. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
