A page inspection method and device, electronic equipment and storage medium

Abstract

The embodiment of the present application discloses a page inspection method and device, including: receiving audio and video of a first page captured by an audio and video acquisition device; determining a first page image based on the audio and video; segmenting the border of the first page image based on an edge detection algorithm, and processing the segmented first page image into a grayscale image; determining that a cursor is in the first page image through the grayscale image; using an optical character recognition algorithm, obtaining the names of each column in the first page image, determining the column name indicated by the cursor in the first page image through the column name, and marking the position of the column name; in response to an infrared control module operating to pull down the first page through the cursor, obtaining the column name corresponding to the cursor clicking on the first page; based on the operation of the cursor clicking on the column name, obtaining operation feedback information corresponding to the column name; and outputting a security monitoring report for the first page based on the operation feedback information. The present application can solve the problem of low page detection efficiency.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer application, and in particular to a page inspection method and device, electronic equipment and storage medium. BACKGROUND

[0002] At present, a television set-top box has become an important source for each family to obtain media information. In the face of a real-time updated and changed electrical program guide (EPG) large screen page, a main method is to manually test and click each resource loading success and failure of the large screen page, or to obtain a first screen page related interface through a crawler technology, and to determine a page loading condition by using interface information.

[0003] However, the related art has a low safety degree for the whole television service, and cannot obtain a third-party resource loading condition of a first screen, cannot obtain a failed resource name in a loading failure condition, and cannot handle the situation, thereby increasing a manpower investment and a time cost. Therefore, a real-time automatic monitoring method is needed to replace manual testing to solve the problem of low page detection efficiency. SUMMARY

[0004] An embodiment of the present application aims to provide a page inspection method and device, electronic equipment and storage medium to solve the problem of low page detection efficiency.

[0005] To solve the above technical problem, an embodiment of the present application is implemented as follows:

[0006] In one aspect, the present application provides a page inspection method, comprising: receiving audio and video of a first page collected by an audio and video collection device, wherein the audio and video are first page information obtained in a set-top box;

[0007] According to the audio and video, a first page image is determined;

[0008] Based on an edge detection algorithm, a frame of the first page image is segmented, and the segmented first page image is processed into a gray picture. By using the gray picture, a cursor in the first page image is determined;

[0009] By using an optical character recognition algorithm, each column name in the first page image is obtained. By using the column name, it is determined that the cursor indicates the column name in the first page image, and a position of the column name is marked;

[0010] In response to an operation of the infrared control module for pulling down the first page by using the cursor, the column name corresponding to the first page clicked by the cursor is obtained;

[0011] Based on the operation of clicking the column name by the cursor, obtaining operation feedback information corresponding to the column name;

[0012] Output a security monitoring report of the first page according to the operation feedback information.

[0013] On the other hand, an embodiment of the present application provides a page inspection device, comprising: a receiving module, configured to receive audio and video of a first page captured by an audio and video capture device, wherein the audio and video are first page information acquired in real time in a set-top box;

[0014] a determination module, configured to determine the first page image based on the audio and video;

[0015] an indication module, configured to segment the border of the first page image based on an edge detection algorithm, and process the segmented first page image into a grayscale image; and determine that the cursor is within the first page image using the grayscale image;

[0016] an acquisition module, configured to acquire the names of the columns in the first page image using an optical character recognition algorithm, determine the column name indicated by the cursor in the first page image based on the column name, and mark the position of the column name;

[0017] A control module, configured to, in response to the infrared control module pulling down the first page by the cursor, obtain the column name corresponding to the first page clicked by the cursor;

[0018] A click module, configured to obtain operation feedback information corresponding to the column name based on the operation of clicking the column name by the cursor;

[0019] An output module is used to output a security monitoring report of the first page according to the operation feedback information.

[0020] On the other hand, an embodiment of the present application provides an electronic device, including a processor and a memory electrically connected to the processor, the memory storing a computer program, and the processor being configured to call and execute the computer program from the memory to implement the above-mentioned page inspection method.

[0021] On the other hand, an embodiment of the present application provides a computer-readable storage medium for storing a computer program, where the computer program can be executed by a processor to implement the above-mentioned page patrol method.

[0022] According to the technical scheme of the embodiment of the present application, the receiving audio and video equipment collects audio and video of a first page, determines a first page image according to the audio and video, processes the first page image into a gray-scale picture based on an edge detection algorithm, and determines the cursor in the first page image through the gray-scale picture. Then, the optical character recognition algorithm is used to obtain each column name in the first page image, the cursor indicates the column name in the first page image through the column name, and the position of the column name is marked. In response to the operation of the infrared control module for pulling down the first page through the cursor, the column name corresponding to the cursor clicking the first page is obtained, the operation feedback information corresponding to the column name is obtained based on the operation of the cursor clicking the column name, and the safety monitoring report of the first page is output according to the operation feedback information. The column name of the first page can be automatically obtained through the optical character recognition algorithm, and the position of the name is marked. The column name of the first page is clicked through the cursor, and the corresponding operation feedback information is obtained, and the safety monitoring report of the first page is output. The present scheme can automatically inspect each column of the first page, and does not need manual detection, thereby improving the inspection efficiency and solving the problem of low page detection efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0023] In order to more clearly illustrate the technical scheme in the one or more embodiments of the present application or the prior art, the drawings needed to be used in the embodiment or the prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the one or more embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0024] Figure 1 is an application scene schematic diagram of a page inspection method according to an embodiment of the present application;

[0025] Figure 2 is a schematic flowchart of a page inspection method according to an embodiment of the present application;

[0026] Figure 3 is a schematic flowchart of a page inspection method according to another embodiment of the present application

[0027] Figure 4 is a schematic block diagram of a page inspection device according to an embodiment of the present application;

[0028] Figure 5 is a hardware structure schematic diagram of a page inspection device according to an embodiment of the present application. DETAILED DESCRIPTION

[0029] The embodiment of the present application provides a page inspection method, device, electronic equipment and storage medium, to solve the problem of low page detection efficiency.

[0030] In order to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described in the following with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor should fall within the scope of protection of the present application.

[0031] The page inspection method provided by the embodiments of the present application can be executed by an electronic device or software installed in the electronic device. Specifically, the electronic device can be a terminal device or a server device. The terminal device can include a smart phone, a notebook computer, a smart wearable device, a vehicle-mounted terminal, etc., and the server device can include a physical server, a server cluster composed of multiple servers, or a cloud server capable of cloud computing.

[0032] Figure 1 is a schematic diagram of an application scenario of a page inspection method according to an embodiment of the present application. As shown in Figure 1 The application scenario of the page inspection method involves an audio and video collection device, an infrared control module, a set-top box, and an electronic device. The audio and video collection device obtains first page information through the set-top box, the infrared control module controls the first page according to the preset operation of the electronic device, the electronic device obtains the information collected by the audio and video collection device, processes and analyzes the information, and automatically feeds back the result as a security monitoring report.

[0033] Figure 2 is a schematic flowchart of a page inspection method according to an embodiment of the present application. As shown in Figure 2 The method of page inspection includes the following steps:

[0034] S202, receiving audio and video collected by an audio and video collection device for a first page, the audio and video being first page information obtained in a set-top box.

[0035] The first page information includes voice, video, text, and location information corresponding to the first page, etc.

[0036] The audio and video collection device obtains the audio and video of the current first page of the set-top box, and the electronic device receives the audio and video collected by the audio and video collection device. It should be noted that when the resource information of the first page in the set-top box changes, the audio and video collected by the audio and video collection device changes with the resource change of the first page information, that is, the audio and video information of the first page in the set-top box can be received in real time.

[0037] S204, determining a first page image according to the audio and video.

[0038] The electronic device processes the audio and video into a first page image according to the acquired audio and video. Specifically, according to the first page information acquired from the set top box, the audio and video containing the first page information are intercepted and spliced into a video frame image, and the video frame image is taken as the first page image.

[0039] In S206, the edge detection algorithm is used to segment the frame of the first page image, and the segmented first page image is processed into a gray image. The cursor in the first page image is determined through the gray image.

[0040] The electronic device can segment the frame of the acquired first page image based on the edge detection algorithm. The first page image can include multiple column channels, and each column has its own frame. The edge detection algorithm is used to segment each frame. Then, the first page image is processed into a gray image, that is, the segmented image is preprocessed into a gray image through a gray value. The cursor information in the gray image is acquired to determine the cursor in the first page image.

[0041] In S208, the optical character recognition algorithm is used to acquire the column names in the first page image. The column names in the first page image indicated by the cursor are determined, and the positions of the column names are marked.

[0042] The optical character recognition algorithm is used to recognize the column names in the first page image. The optical character recognition algorithm includes using optical technology and computer technology to read out the text and convert it into a format that a computer can accept and a person can understand, that is, the text of the column names in the first page image is recognized into a language format that a computer can accept.

[0043] The column names recognized by the optical character recognition algorithm can determine the positions of the column names in the first page image indicated by the cursor, and mark the positions of the column names. For example, the electronic device acquires the column names of TV series and selected programs in the first page image through the optical character recognition algorithm, determines the position of the column name of TV series indicated by the cursor, and marks the position of the column name of TV series indicated by the cursor.

[0044] In S210, in response to the operation of the infrared control module to pull down the first page through the cursor, the column name corresponding to the first page clicked by the cursor is acquired.

[0045] The infrared control module simulates manual operation and can be equivalent to a remote controller to control the operation of the cursor. The electronic device responds to the operation of the infrared control module to pull down the first page through the cursor. When the cursor clicks the column name corresponding to the first page, the column name can be acquired.

[0046] S212: Based on the operation of clicking the column name with the cursor, obtain operation feedback information corresponding to the column name.

[0047] Based on the column name clicked by the cursor, the operation feedback information corresponding to the column name can be obtained. The operation feedback information can be used to represent the specific information fed back when the cursor clicks the column name but fails to jump to the corresponding page as expected. For example, the operation feedback information can be feedback information indicating that the resource information corresponding to the column name is not loaded after the cursor clicks the column name, or feedback information indicating that the information of the column name does not correspond to the column name information of the page jumped to, etc.

[0048] S214: Output the security monitoring report of the first page according to the operation feedback information.

[0049] Based on the operation feedback information obtained in step 212, a security monitoring report of the first page is output. The security monitoring report includes the operation feedback information corresponding to the first page. Specifically, the security monitoring report may include one or more of the following: the consistency of the free names of each column in the first page, the coverage of popular media columns, and a detailed report on content copyright and security.

[0050] The technical solution of the embodiment of the present application receives audio and video of a first page captured by an audio and video device, determines the first page image based on the audio and video, processes the first page image into a grayscale image based on an edge detection algorithm, and determines the cursor is within the first page image based on the grayscale image. Subsequently, an optical character recognition algorithm is used to obtain the names of each column in the first page image. Based on the column name, the column name indicated by the cursor in the first page image is determined, and the position of the column name is marked. In response to the infrared control module using the cursor to pull down the first page, the column name corresponding to the cursor clicking on the first page is obtained. Based on the cursor clicking on the column name, operation feedback information corresponding to the column name is obtained. Based on the operation feedback information, a security monitoring report for the first page is output. The optical character recognition algorithm can automatically obtain the column name of the first page and mark the position of the name. By clicking on the column name of the first page and obtaining the corresponding operation feedback information, a security monitoring report for the first page is output. This solution can automatically inspect each column on the first page without the need for manual inspection, thereby improving inspection efficiency and solving the problem of low page inspection efficiency.

[0051] In one embodiment, the border of the first page image is segmented based on an edge detection algorithm, and the segmented first page image is processed into a grayscale image. Based on the grayscale image, it is determined that the cursor is in the first page image (i.e., S206), and the following steps A1-A2 may be performed:

[0052] Step A1: obtaining the frame position information of the first page image based on an edge detection algorithm, segmenting the first page image according to the frame position information, and determining the segmented first page image.

[0053] First, the frame of all columns in the first page image is obtained according to the edge detection algorithm, the coordinate information of all column frames is obtained according to the frame pixel point information, and at the same time, the current column picture is separated according to the characteristics of the first page image. Generally, the channel column is displayed at the top of the set top box picture, such as selected / TV series, and the position of the channel column is relatively fixed. Therefore, a certain range of pixel points can be selected to obtain the channel column, and each column is segmented.

[0054] Step A2: obtaining the gray value of the segmented first page image, determining the gray image, and determining the cursor in the first page image through the gray image.

[0055] The gray value refers to the brightness value of each pixel in the image, which is usually represented by an integer from 0 to 255. In a gray image, the gray value of each pixel represents the brightness of the pixel. The larger the gray value, the higher the brightness of the pixel, and the smaller the gray value, the lower the brightness of the pixel.

[0056] By obtaining the gray value of the segmented first page image, the gray image is obtained, and the cursor in the first page image is determined from the gray image.

[0057] In this embodiment, the frame information of the first page image is obtained by the edge detection algorithm, and the first page image frame is segmented according to the position of the frame, the segmented first page image is determined, the first page image is preprocessed according to the gray value of the first page image, the cursor in the first page image is determined according to the gray image, the first page image can be preprocessed, and the cursor in the first page image is determined, which provides convenience for subsequent page inspection by controlling the cursor.

[0058] In one embodiment, an optical character recognition algorithm is used to obtain the column names in the first page image, the column names in the first page image are determined by the cursor, and the position of the column names is marked (i.e., S208). The following steps B1-B3 can be executed:

[0059] Step B1: using an optical character recognition algorithm to extract the text in the first page image, and determining the column names in the first page.

[0060] The text of the first page image is automatically recognized by the optical character recognition algorithm, and the text is extracted into a computer format language. Through the recognition of the text, the names of the columns in the first page can be determined.

[0061] Step B2: Based on the column names in the first page, the position of the cursor in the column name is obtained.

[0062] According to the column names corresponding to the text in the first page image extracted by the optical character recognition algorithm in step B1, the cursor is determined in the first page image by step A2, and then the text of the column name indicated by the cursor can be obtained, and the position information of the column name indicated by the cursor can also be determined, wherein the position information of the column name can include column pixel points, coordinate information of the column, etc.

[0063] Step B3: Mark the position of the column name indicated by the cursor according to the position information of the column name.

[0064] According to the recognized column name and the obtained position information of the column name indicated by the cursor, the position information of the column name is marked, that is, the position of the corresponding column name is marked according to the column name indicated by the cursor.

[0065] It should be noted that, by using the optical character recognition algorithm, not only the text of the first page is extracted to determine the position of the column name, but also the position of the column name in the first page is marked by the cursor. In addition, after the cursor clicks the column name in the first page, the information in the second page entered can be extracted and the corresponding position is marked. Moreover, by using the optical character recognition algorithm to obtain the text content corresponding to the page, the content copyright library and the sensitive information library can be compared to find any infringement or sensitive information, and an alarm can be sent immediately.

[0066] In this embodiment, by using the optical character recognition algorithm, each column name in the first page image is automatically recognized, the position information of the indicated column name is obtained by indicating the column name by the cursor, and the position of the column name indicated by the cursor is marked. By recognizing the column name and marking the position of the column name, the information of the first page can be automatically obtained by the optical character recognition algorithm without manual intervention, and the efficiency of obtaining the information of the first page is improved.

[0067] In one embodiment, based on the operation of the cursor clicking the column name, the operation feedback information corresponding to the column name is obtained (i.e., S212), and the following step C can be executed:

[0068] Step C: According to the preset instruction of the infrared control module, in response to the operation of the cursor clicking the column name in the first page, the second page corresponding to the column name is obtained, and the operation feedback information of the second page is determined.

[0069] The preset instruction of the infrared control module is an operation instruction preset for the electronic device, including selecting the segmented channel according to the channel name, such as selecting each program in the steps of left, right, down, right, and right. The channel name includes the channel name of the main channel in the first page, and also includes the channel name of the sub-channel, such as the main channel of the channel name including TV series, selected works, variety shows, etc., and the sub-channel of the channel name including various types of TV series names, various selected works, and various variety show names. The channel name refers to the TV series channel and also refers to the names of various TV series under the TV series channel.

[0070] According to the preset instruction of the infrared control module, the cursor automatically positions each channel. Specifically, after the cursor positions the channel, a rectangular frame similar to the channel name title positioned by the cursor is displayed, thereby distinguishing the channel name title positioned by the cursor. When the cursor clicks on a channel name, the computer can obtain the second page corresponding to the channel name clicked by the cursor, and determine the operation feedback information of the second page. For example, the operation feedback information includes one or more of the following: whether the free identification of the first page and the second page is consistent, such as when the first page has a free identification, the second page also has a free identification, and the second page can be jumped to, when the first page has a free identification, and the second page does not have a free identification, the operation feedback information is that the free identification is inconsistent; or the channel name of the first page is a TV series, and under normal circumstances, the second page will play the film of the resource, and if the playing is successful, the picture of the second page is obtained, and if the playing fails, the operation feedback information is displayed as unable to play, black screen, failure code, and the like.

[0071] In this embodiment, according to the preset instruction of the infrared control module, the cursor can select and click the channel name of each channel in the first page. By clicking the channel name, the second page corresponding to the clicked channel name is obtained, and the operation feedback information of the second page is obtained.

[0072] In one embodiment, according to the preset instruction of the infrared control module, in response to the operation of the cursor clicking on the channel name in the first page (i.e., step C), the following steps D1-D3 can be specifically executed:

[0073] Step D1: performing hierarchical segmentation on the image of the first page, and determining the waterfall picture of the first page according to the image pixel points.

[0074] The image of the first page is obtained, which refers to that the picture is intercepted every time the page is pulled down according to the position of the cursor, and the picture is the first page. The image of the first page is hierarchically segmented, that is, each channel of the first page is segmented, the segmented first page image is spliced according to the pixel points of the first page image, and a picture in the form of a waterfall is obtained.

[0075] Step D2: obtaining the column name position of the first page through the waterfall picture.

[0076] The picture displayed in the form of waterfall can obtain the position of the picture of each level, for example, the first level of the current waterfall has 2 program pictures and the second level has 3 program pictures, and the position of the column name in each level picture is determined according to the level and the corresponding picture.

[0077] Step D3: responding to the operation of clicking the column name by the cursor according to the column name position.

[0078] According to the column name position in the level of step D2 above, the indication of the infrared control module is preset, and the cursor clicks the column name according to the preset instruction, for example, according to the column name position in the level, the preset instruction of the infrared control module includes the steps of clicking the column name position in the level in the order of down-right-down-right-right, and then the cursor clicks the column name position in the level in the order of down-right-down-right-right according to the preset instruction, and the program corresponding to the column name position can be selected in turn.

[0079] In the embodiment, the image of the first page is segmented, the waterfall picture is processed according to the pixel points, the column name position of the first page is obtained through the waterfall picture, and the cursor selects the column of the first page according to the preset indication of the infrared control module. According to the column name position in the first page, the cursor can automatically select and click the corresponding column name, improve the efficiency of obtaining the column name, and save the time cost, without manual clicking operation.

[0080] In one embodiment, according to the operation feedback information, a safety monitoring report of the first page is output (i.e. S214), which can be executed as follows:

[0081] When responding to the operation of clicking the column name in the first page by the cursor, if the second page is not jumped to, the information of the second page is stored in the database, and a report of loading failure is output.

[0082] When the electronic device responds to the operation of clicking the column name in the first page by the cursor, if the second page is not jumped to, the information of the second page is stored in the database, and a report of loading failure is output.

[0083] In this embodiment, if the cursor is clicked on the column name of the first page and does not jump to the second page, the information of the second page is stored in the database, and a report of failed loading is automatically output. The security of the jump from each column in the first page to the second page can be detected, and whether the loading fails can be determined.

[0084] In one embodiment, according to the operation feedback information, a security monitoring report of the first page is output (i.e., S214), and steps E1-E2 can also be performed.

[0085] Step E1: Obtain the first page image, and obtain the third page image within a preset time, the third page image including the latest column name.

[0086] The electronic device obtains the first page image, and obtains the third page image within a preset time, for example, the first page image obtained at 10 o'clock and the third page image corresponding to the first page image obtained at 11 o'clock. The information in the third page image includes a new column name, that is, different from the column name in the corresponding position of the first page image.

[0087] Step E2: Compare the first page image with the third page image, and when the latest column name is different, update the first page to the third page.

[0088] The page information of the first page image and the second page image is analyzed and compared, and the page information of the two is not the same, so the first page is updated to the third page. It should be noted that if the first page image information and the third page image information are consistent, it means that the first page resource is not updated, that is, the first page image information is retained. For example, the name of a TV series in the first page at a certain time is AAA, and after an hour, the name of the TV series in the third page corresponding to the first page is BBB. Because the column name displayed in the first page, that is, the name of the TV series, has changed, that is, the TV program has been updated, the column name in the third page replaces the column name in the first page, and at this time, the first page is replaced by the third page with the latest updated resource.

[0089] In this embodiment, the first page image is obtained, the third page image is obtained within a preset time, and the first page image and the third page image are compared and analyzed. If the column names of the two are the same, no update is performed, and if the column names of the two are different, resource updating is performed, and the third page image replaces the first page image. By comparing the pages twice and automatically replacing the new page information, the page inspection efficiency is improved, and manual replacement of resource information is not required.

[0090] In one embodiment, according to the above embodiment, the security monitoring report of the first page includes multiple types.

[0091] The first type includes a resource success rate of the first page: whether the resource of the first page is successfully loaded when jumping to the second page is monitored, including acquiring resource pictures corresponding to the first page image and the second page image, marking positions of all pictures, and analyzing and comparing the acquired resource information according to preset image or text information, including whether the resource information of the second page matches that of the first page, so as to determine whether the resource is normally loaded, and sending an email and an SMS alarm immediately when the second page cannot be normally loaded.

[0092] The second type includes a resource hotspot coverage rate of the first page: according to a provided popular media list, the first page image is analyzed and recognized by an optical character recognition algorithm, and after comparison and analysis, the proportion of popular resources in the first page can be output.

[0093] The third type includes a first page column name update frequency: according to the actual page operation situation, a timing task is set for the infrared control module to acquire all resources of the first page, the first page image comparison algorithm is combined with the intelligent character recognition algorithm to compare and analyze the first page images before and after, whether the resource is updated, and the column name in the acquired second page image is compared and verified again, so as to determine the frequency of resource update of the first page operation position.

[0094] The fourth type includes a first page free consistency acquisition: whether the free condition is consistent when the first page resource of the set top box jumps to the second page is monitored, the free icon of the first page image and the resource free icon corresponding to the second page image are acquired, the first page icon and the second page free icon are analyzed and compared, so as to determine whether the resource free condition is consistent or the detail page lacks the free icon, and an email and an SMS alarm are sent immediately when the conditions are inconsistent.

[0095] The fifth type includes a first page content security monitoring: the content copyright information and the text information of the first page are detected, a content copyright library and a text sensitive information library are established in advance, all picture information in the first page image is acquired, the text information is acquired by combining the optical character recognition algorithm, and finally the content copyright library and the text sensitive information library are compared, so as to trigger an alarm immediately when infringement or sensitive information is found, and the reliability of the result is increased.

[0096] Through the above safety monitoring, the following related report types can be generated, as shown in Table 1:

[0097]

[0098]

[0099] In this embodiment, various types of security detection reports can be generated by various methods in the above embodiments, wherein the success rate of resources of the first page is used to monitor whether the second page information can be successfully loaded from the first page; the hot spot coverage rate of the resources of the first page is used to determine the proportion of the column information of the first page covering the hot spot content; the update frequency of the column name of the first page is used to determine whether the column change is updated and replaced in time; the free consistency acquisition situation of the first page is used to compare the first page and the second page if they are free, if they are not free, they are not free only if the first page and the second page are consistent in the payment situation, so as to accurately jump to the second page; the content security of the first page is monitored, that is, the extracted text and the content copyright library and the sensitive information library are compared, if the sensitive words are contained, an alarm is also sent, and a report is generated. Through the output of the security monitoring report, the overall control of the page business content quality is realized, and the customized adjustment is made according to the actual situation, the content problem can be found before the user, the user complaint is effectively reduced, and the user experience perception is improved. At the same time, the minute-level dialing test or customized dialing test task demand is provided, and real-time and effective data guarantee is provided for the first screen operation personnel.

[0100] In summary, the electronic device can receive the audio and video of the first page collected by the audio and video device, determine the first page image according to the audio and video, process the first page image into a gray picture based on an edge detection algorithm, and determine the cursor in the first page image through the gray picture. Then, the optical character recognition algorithm is used to obtain the column name in the first page image and the second page image, and the column name indicated by the cursor is determined, and the position of the column name is marked. In response to the operation of the infrared control module for pulling down the first page through the cursor, the column name corresponding to the first page clicked by the cursor is obtained. Based on the operation of clicking the column name by the cursor, the operation feedback information of the second page corresponding to the column name is obtained. According to the operation feedback information, the security monitoring report of the first page for various types is output. As can be seen, by combining various algorithms, the column loading situation, the free consistency, the hot media coverage situation, the content copyright and the content security of the first page are monitored in real time and automatically, and the multi-dimensional security monitoring report is generated for the operation personnel to provide effective data guarantee and control the content quality.

[0101] Figure 3 is a schematic flow chart of a page inspection method according to another embodiment of the present application, as shown in Figure 3 The method comprises the following steps:

[0102] S301, receiving the audio and video of the first page collected by the audio and video collection device.

[0103] The audio and video are first page information obtained in the set top box, for example, the first page includes an EPG large screen page, and the audio and video information of the EPG is obtained.

[0104] S302, determining a first page image according to the audio and video.

[0105] S303, segmenting the frame of the first page image based on an edge detection algorithm, and processing the segmented first page image into a grayscale picture.

[0106] The cursor is determined in the first page image through the grayscale picture. Specifically, taking the example in S310, the first page image, i.e., the EPG page image, can be divided into a total column channel and a sub-column channel. The total column channel can be selected, TV series, variety shows, etc., and is generally located at the top of the EPG page large screen. The sub-column channel can be the classification of selected, the classification of TV series, etc. Each column channel in the EPG page image is segmented by the edge detection algorithm, and is preprocessed into a grayscale picture through a grayscale value.

[0107] S304, obtaining each column name in the first page image by using an optical character recognition algorithm.

[0108] S305, determining that the cursor indicates the column name in the first page image through the column name, and marking the position of the column name.

[0109] S306, determining whether the resource in the first page is updated according to the marked column name position information.

[0110] According to the marked column name position information and the obtained hot resource information, the column hot spot proportion in the first page can be determined. Then, the first page image, i.e., the third page image, is obtained again according to a preset time, the column name in the same position of the first page image and the third page image is compared, whether the column name changes, and whether the third page replaces the first page are determined.

[0111] S307, the infrared control module pulls down the first page through the cursor.

[0112] S308, the cursor clicks the column name corresponding to the first page to obtain a second page corresponding to the column name.

[0113] The second page is a detail page jumped to after the cursor clicks the first page, i.e., the operation feedback information of the second page corresponding to the column name is obtained based on the operation of the cursor clicking the column name of the first page.

[0114] S309, obtaining the page information of the second page by using an optical character recognition algorithm.

[0115] According to the optical character recognition algorithm, the page information of the second page is automatically acquired, wherein the page information comprises a column name of the second page and a column name position and the like.

[0116] S310, the member identifier of the second page is determined.

[0117] The member identifier of the first page is acquired, the cursor clicks the column name of the first page, the member identifier of the second page is acquired according to the page information of the second page, when the member identifier of the second page is consistent with the member identifier of the first page, the second page is jumped to, if not consistent, the second page cannot be jumped to, for example, there is a column name of a certain TV series in the first page, the member identifier is displayed at the column name, that is, only the member can enter the corresponding second page, the second page is the detail page of the TV series, that is, the specific content of the TV series is browsed, when the first page has the member identifier and the second page does not have the member identifier, it may be a problem of the system or a loophole of the personnel, and then the safety monitoring report information is output.

[0118] S311, according to the operation feedback information of the first page and the second page, the safety monitoring report of the first page is output.

[0119] The specific process of S301 to S311 has been described in detail in the above embodiment, and will not be repeated here.

[0120] The technical scheme of the embodiment of the application is adopted, the audio and video of the first page collected by the audio and video equipment is received, the first page image is determined according to the audio and video, the first page image is processed into a gray picture based on the edge detection algorithm, and the cursor in the first page image is determined through the gray picture. Then, the optical character recognition algorithm is used to acquire each column name in the first page image, the cursor indicates the column name in the first page image through the column name, and the column name position is marked, in response to the operation of the infrared control module through the cursor to pull down the first page, the column name corresponding to the cursor clicking the first page is acquired, based on the operation of the cursor clicking the column name, the operation feedback information corresponding to the column name is acquired, and the safety monitoring report of the first page is output according to the operation feedback information. The column name of the first page can be automatically acquired through the optical character recognition algorithm, and the position of the name is marked, the column name of the first page is clicked through the cursor, and the corresponding operation feedback information is acquired, and the safety monitoring report of the first page is output. The scheme can automatically inspect each column of the first page, without manual detection, improve the inspection efficiency, and solve the problem of low page detection efficiency.

[0121] To summarize, particular embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve the desired results. In certain implementations, multitasking and parallel processing can be advantageous.

[0122] The page inspection method provided in the embodiments of the present application is based on the same idea. The embodiments of the present application further provide a page inspection device.

[0123] Figure 4 is a schematic block diagram of a page inspection device according to an embodiment of the present application, as shown in Figure 4 The device comprises:

[0124] The receiving module 41 is configured to receive audio and video of a first page collected by an audio and video collection device, the audio and video being first page information collected in real time in the set top box.

[0125] The determining module 42 is configured to determine a first page image according to the audio and video.

[0126] The indicating module 43 is configured to segment a frame of the first page image based on an edge detection algorithm, and process the segmented first page image into a grayscale picture; and determine the cursor in the first page image through the grayscale picture.

[0127] The obtaining module 44 is configured to obtain each column name in the first page image by using an optical character recognition algorithm, determine the column name indicated by the cursor in the first page image through the column name, and mark the position of the column name.

[0128] The control module 45 is configured to obtain the column name corresponding to the first page clicked by the cursor in response to the operation of the infrared control module of pulling down the first page through the cursor.

[0129] The clicking module 46 is configured to obtain operation feedback information corresponding to the column name based on the operation of the cursor clicking the column name.

[0130] The output module 47 is configured to output a security monitoring report of the first page according to the operation feedback information.

[0131] In one embodiment, the indicating module 43 comprises: obtaining frame position information of the first page image based on an edge detection algorithm; segmenting the first page image according to the position information of the frame to determine the segmented first page image; obtaining a grayscale value of the segmented first page image to determine a grayscale picture; and determining the cursor in the first page image through the grayscale picture.

[0132] In one embodiment, the device comprises, extracting the text in the first page image by using an optical character recognition algorithm, determining the column names in the first page; based on the column names in the first page, obtaining the position of the cursor in the column name; according to the position information of the column name, marking the column name position indicated by the cursor.

[0133] In one embodiment, the clicking module 46 comprises, according to the preset instructions of the infrared control module, in response to the operation of the cursor clicking the column name in the first page, obtaining the second page corresponding to the column name, and determining the operation feedback information of the second page.

[0134] In one embodiment, the device further comprises, performing hierarchical segmentation on the image of the first page, and determining the waterfall picture of the first page according to the image pixel points; obtaining the column name position of the first page through the waterfall picture; and responding to the operation of the cursor clicking the column name according to the column name position.

[0135] In one embodiment, the device further comprises, when responding to the operation of the cursor clicking the column name in the first page, and without jumping to the second page, storing the information of the second page in the database, and outputting a report of failed loading.

[0136] In one embodiment, the device further comprises, obtaining the first page image, obtaining the third page image within a preset time, and the third page image comprises the latest column name; comparing the first page image with the third page image, and when the latest column name is different, updating the first page to the third page.

[0137] By adopting the technical scheme of the embodiments of the present application, the audio and video of the first page collected by the receiving audio and video equipment are received, the first page image is determined according to the audio and video, the first page image is processed into a grayscale picture based on an edge detection algorithm, and the cursor in the first page image is determined through the grayscale picture. Then, the column names in the first page image are obtained by using an optical character recognition algorithm, the column name indicated by the cursor in the first page image is determined through the column name, and the position of the column name is marked. In response to the operation of the infrared control module through the cursor to pull down the first page, the column name corresponding to the first page clicked by the cursor is obtained, the operation feedback information corresponding to the column name is obtained based on the operation of the cursor clicking the column name, and the safety monitoring report of the first page is output according to the operation feedback information. The column names of the first page can be automatically obtained by using the optical character recognition algorithm, and the positions of the names are marked. The column name of the first page is clicked by the cursor, and the corresponding operation feedback information is obtained, and the safety monitoring report of the first page is output. The present scheme can automatically inspect each column of the first page, without manual detection, thereby improving the inspection efficiency and solving the problem of low page detection efficiency.

[0138] Those skilled in the art should understand that Figure 4 The page inspection device in can be used to implement the page inspection method described above, and the detailed description should be similar to the description of the method part above. To avoid redundancy, it will not be repeated here.

[0139] Based on the same idea, the embodiment of the present application also provides a device for page inspection, such as Figure 5 As shown. The page inspection device may have relatively large differences due to different configurations or performances, and may include one or more processors 501 and memory 502, and the memory 502 may store one or more storage applications or data. Among them, the memory 502 can be short-term storage or persistent storage. The application stored in the memory 502 may include one or more modules (not shown in the figure), and each module may include a series of computer executable instructions in the traffic policy recommendation device. Furthermore, the processor 501 can be configured to communicate with the memory 502 and execute a series of computer executable instructions in the memory 502 on the traffic policy recommendation device. The traffic policy recommendation device may also include one or more power supplies 503, one or more wired or wireless network interfaces 504, one or more input and output interfaces 505, and one or more keyboards 506.

[0140] Specifically, in this embodiment, the traffic strategy recommendation device includes a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs may include one or more modules, and each module may include a series of computer-executable instructions in the traffic strategy recommendation device, and is configured to be executed by one or more processors. The one or more programs include computer-executable instructions for performing the following:

[0141] receiving audio and video of the first page captured by an audio and video capture device, where the audio and video are information of the first page acquired in the set-top box;

[0142] Determine the first page image based on the audio and video;

[0143] Segmenting the border of the first page image based on an edge detection algorithm, and processing the segmented first page image into a grayscale image; determining that the cursor is in the first page image based on the grayscale image;

[0144] Using an optical character recognition algorithm, obtain the names of each column in the first page image, determine that the cursor points to the column name in the first page image based on the column name, and mark the position of the column name;

[0145] In response to the infrared control module pulling down the first page with the cursor, obtaining the column name corresponding to the first page clicked by the cursor;

[0146] Based on the operation of clicking the column name with the cursor, obtain the operation feedback information corresponding to the column name;

[0147] Based on the operation feedback information, output the first page of the security monitoring report.

[0148] The technical solution of the embodiment of the present application receives audio and video of a first page captured by an audio and video device, determines the first page image based on the audio and video, processes the first page image into a grayscale image based on an edge detection algorithm, and determines the cursor is within the first page image based on the grayscale image. Subsequently, an optical character recognition algorithm is used to obtain the names of each column in the first page image. Based on the column name, the column name indicated by the cursor in the first page image is determined, and the position of the column name is marked. In response to the infrared control module using the cursor to pull down the first page, the column name corresponding to the cursor clicking on the first page is obtained. Based on the cursor clicking on the column name, operation feedback information corresponding to the column name is obtained. Based on the operation feedback information, a security monitoring report for the first page is output. The optical character recognition algorithm can automatically obtain the column name of the first page and mark the position of the name. By clicking on the column name of the first page and obtaining the corresponding operation feedback information, a security monitoring report for the first page is output. This solution can automatically inspect each column on the first page without the need for manual inspection, thereby improving inspection efficiency and solving the problem of low page inspection efficiency.

[0149] The present application also provides a computer-readable storage medium storing one or more computer programs. The one or more computer programs include instructions. When executed by an electronic device including multiple application programs, the instructions enable the electronic device to perform each process of the above-mentioned traffic policy recommendation method embodiment, and are specifically used to perform:

[0150] receiving audio and video of the first page captured by an audio and video capture device, where the audio and video are information of the first page acquired in the set-top box;

[0151] Determine the first page image based on the audio and video;

[0152] Segmenting the border of the first page image based on an edge detection algorithm, and processing the segmented first page image into a grayscale image; determining that the cursor is in the first page image based on the grayscale image;

[0153] Using an optical character recognition algorithm, obtain the names of each column in the first page image, determine that the cursor points to the column name in the first page image based on the column name, and mark the position of the column name;

[0154] In response to the operation of the infrared control module pulling down the first page through the cursor, the column name corresponding to the first page clicked by the cursor is acquired;

[0155] Based on the operation of the cursor clicking the column name, operation feedback information corresponding to the column name is acquired;

[0156] According to the operation feedback information, a safety monitoring report of the first page is output.

[0157] The technical scheme of the embodiment of the application adopts the following technical scheme: audio and video of a first page collected by an audio and video device are received, the first page image is determined according to the audio and video, the first page image is processed into a gray-scale picture based on an edge detection algorithm, the cursor in the first page image is determined through the gray-scale picture, the optical character recognition algorithm is used to acquire each column name in the first page image, the column name in the first page image indicated by the cursor is determined through the column name, the position of the column name is marked, in response to the operation of the infrared control module pulling down the first page through the cursor, the column name corresponding to the first page clicked by the cursor is acquired, based on the operation of the cursor clicking the column name, operation feedback information corresponding to the column name is acquired, and according to the operation feedback information, a safety monitoring report of the first page is output. The column name of the first page can be automatically acquired through the optical character recognition algorithm, and the position of the name is marked, the column name of the first page is clicked through the cursor, and the corresponding operation feedback information is acquired, and the safety monitoring report of the first page is output. The scheme can automatically patrol each column of the first page, and manual detection is not needed, the patrol efficiency is improved, and the problem of low page detection efficiency can be solved.

[0158] The system, apparatus, module or unit illustrated in the above embodiments can be specifically implemented by a computer chip or entity, or by a product with certain functions. A typical implementation device is a computer. Specifically, the computer may, for example, be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0159] For the convenience of description, the above apparatus is described as various units respectively described in functions. Of course, the functions of each unit can be implemented in the same or more software and / or hardware in the implementation of the application.

[0160] Those skilled in the art will appreciate that embodiments of the application can be readily used as software, hardware, or a combination of software and hardware. In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0161] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0162] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0163] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0164] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0165] The memory can include non-persistent memory and / or persistent memory, such as flash memory, readonly memory (ROM), and / or the like, in a computer-readable medium. The memory is an example of computer-readable media.

[0166] Computer-readable media includes permanent and non-permanent, movable and non-movable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer-readable media does not include transitory media such as modulated data signals and carriers.

[0167] It should also be noted that the terms "comprising", "including", or any other variant thereof are intended to cover non-exclusive inclusion, so that processes, methods, articles or devices that include a series of elements not only include those elements, but also include other elements not explicitly listed or inherent to such processes, methods, articles or devices. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or device comprising the element.

[0168] The present application can be described in the general context of computer-executable instructions, such as program modules, executed by computers. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The present application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules can be located in both local and remote computer storage media, including storage devices.

[0169] Each embodiment in the present application is described in a progressive manner, and the same or similar parts between each embodiment can be referred to each other. Each embodiment focuses on the difference from other embodiments. In particular, for system embodiments, since they are basically similar to method embodiments, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0170] The above merely provides an example of the present application, but is not intended to limit the present application. Any modification, equivalent replacement, improvement, etc. within the spirit and principle of the present application should be included in the scope of claims of the present application.

Claims

1. A page inspection method, characterized in that: The method comprises: Receiving audio and video of a first page captured by an audio and video capture device, wherein the audio and video are first page information acquired in a set-top box; Determining a first page image based on the audio and video; Segmenting the border of the first page image based on an edge detection algorithm, and processing the segmented first page image into a grayscale image; determining that the cursor is within the first page image using the grayscale image; Using an optical character recognition algorithm, obtain the names of each column in the first page image, determine that the cursor points to the column name in the first page image based on the column name, and mark the position of the column name; In response to the infrared control module pulling down the first page by the cursor, obtaining the column name corresponding to the first page clicked by the cursor; Based on the operation of clicking the column name by the cursor, obtaining operation feedback information corresponding to the column name; Output a security monitoring report of the first page according to the operation feedback information.

2. The method according to claim 1, wherein the border of the first page image is segmented based on an edge detection algorithm, and the segmented first page image is processed into a grayscale image; Determining, using the grayscale image, that the cursor is in the first page image includes: Acquiring border position information of the first page image based on an edge detection algorithm, segmenting the first page image according to the border position information, and determining a segmented first page image; The grayscale value of the segmented first page image is obtained to determine the grayscale image, and the cursor is determined to be in the first page image through the grayscale image.

3. The method according to claim 2, wherein the step of obtaining the column names in the first page image using an optical character recognition algorithm, determining that the cursor indicates the column name in the first page image based on the column name, and marking the position of the column name comprises: Extracting text from the first page image using an optical character recognition algorithm to determine the names of each column on the first page; Based on the names of the columns in the first page, obtaining the position of the cursor at the column name; According to the position information of the column name, the column name position indicated by the cursor is marked.

4. The method according to claim 1, wherein obtaining operation feedback information corresponding to the column name based on the operation of clicking the column name by the cursor comprises: According to a preset instruction of the infrared control module, in response to the operation of the cursor clicking the column name in the first page, a second page corresponding to the column name is obtained, and operation feedback information of the second page is determined.

5. The method according to claim 4, wherein the step of: responding to the cursor clicking on the column name on the first page according to the preset instruction of the infrared control module comprises: Performing hierarchical segmentation on the image of the first page, and determining a waterfall image of the first page based on image pixels; Obtain the column name position of the first page through the waterfall image; According to the position of the column name, respond to the operation of clicking the column name with the cursor.

6. The method according to claim 5, wherein outputting a security monitoring report of the first page according to the operation feedback information comprises: When the cursor clicks on the column name in the first page and the page does not jump to the second page, the information of the second page is stored in the database and a report of loading failure is output.

7. The method according to claim 5, wherein outputting a security monitoring report of the first page based on the operation feedback information further comprises: Acquire the first page image, and within a preset time, acquire a third page image, wherein the third page image includes the latest column name; The first page image is compared with the third page image, and when the latest column names are different, the first page is updated to the third page.

8. A page inspection device, characterized in that: The device comprises: A receiving module, configured to receive the audio and video of the first page captured by the audio and video capturing device, wherein the audio and video are the first page information acquired in real time in the set-top box; A determination module, configured to determine a first page image based on the audio and video; an indication module, configured to segment the border of the first page image based on an edge detection algorithm, and process the segmented first page image into a grayscale image; and determine that the cursor is within the first page image using the grayscale image; an acquisition module, configured to acquire the names of the columns in the first page image using an optical character recognition algorithm, determine the column name indicated by the cursor in the first page image based on the column name, and mark the position of the column name; A control module, configured to, in response to the infrared control module pulling down the first page by the cursor, obtain the column name corresponding to the first page clicked by the cursor; A click module, configured to obtain operation feedback information corresponding to the column name based on the operation of clicking the column name by the cursor; An output module is used to output a security monitoring report of the first page according to the operation feedback information.

9. An electronic device, characterized in that: The method comprises a processor and a memory electrically connected to the processor, wherein the memory stores a computer program, and the processor is configured to call and execute the computer program from the memory to implement the page inspection method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The storage medium is used to store a computer program, and the computer program can be executed by a processor to implement the page inspection method according to any one of claims 1 to 7.

Images