Information processing device, information processing method, and program

Abstract

The present invention provides an information processing device, an information processing method, and a program that can suitably check the indexing status of a group of web pages. [Solution] The information processing device 100 checks the indexing status of a first group of web pages consisting of multiple web pages. The acquisition unit 110 acquires information about the first group of web pages, and the indexing status confirmation unit 120 checks whether each web page in the first group of web pages is indexed by a search engine. The indexing rate determination unit 130 then sets the ratio of the number of web pages in the first group of web pages that are indexed by a search engine as the first indexing rate.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] A company's web page is a tool for the company that owns it to convey its charm to the world through the Internet, and it is necessary for the search results to be displayed by a search engine. Search engines such as Google (registered trademark) crawl (read the content of web pages) web pages around the world, index (save information so that it can be displayed in search results) that information, and provide the most relevant information when a user searches.

[0003] Therefore, it is very important for the owner to know whether the website is indexed by the search engine. For example, there is a search engine that has a URL inspection tool for checking whether a specific URL (Uniform Resource Locator) is registered in the index of the search engine (see Non-Patent Document 1).

[0004] Also, there is a technique in which a search engine searches for documents within a specific time window using an index and randomly selects a document from the results (see Patent Document 1).

Prior Art Documents

Non-Patent Documents

[0005]

Non-Patent Document 1

[0006] [Patent Document 1] Special Publication No. 2022-538657 [Overview of the project] [Problems that the invention aims to solve]

[0007] However, there is a problem in that website owners cannot easily check the indexing status.

[0008] This invention has been made in consideration of these circumstances, and aims to provide an information processing device, an information processing method, and a program that can suitably check the indexing status of a group of web pages. [Means for solving the problem]

[0009] To solve the above problems, the present invention provides an information processing device for inspecting the indexing status of a first group of web pages consisting of multiple web pages, comprising: acquisition means for acquiring information about the first group of web pages; indexing status confirmation means for confirming whether each web page of the first group of web pages is indexed by a search engine; and indexing rate determination means for determining a first indexing rate, which is the ratio of the number of web pages indexed by the search engine to the total number of web pages in the first group of web pages.

[0010] Furthermore, in order to solve the above problems, the present invention provides an information processing method for an information processing device that inspects the indexing status of a first group of web pages consisting of multiple web pages, comprising: an acquisition step of acquiring information about the first group of web pages; an indexing status confirmation step of confirming whether each web page of the first group of web pages is indexed by a search engine; and an indexing rate determination step of setting the ratio of the number of web pages indexed by the search engine to the total number of web pages in the first group of web pages as a first indexing rate.

[0011] Furthermore, in order to solve the above problems, the present invention is a computer-readable program that causes a computer to perform the following steps for inspecting the indexing status of a first group of web pages consisting of multiple web pages: an acquisition step for acquiring information about the first group of web pages; an indexing status confirmation step for checking whether each web page of the first group of web pages is indexed by a search engine; and an indexing rate determination step in which the ratio of the number of web pages indexed by the search engine to the total number of web pages in the first group of web pages is defined as the first indexing rate. [Effects of the Invention]

[0012] According to the present invention, the indexing status of a group of web pages can be suitably checked. [Brief explanation of the drawing]

[0013] [Figure 1] This is a block diagram showing the configuration of an information processing system relating to one embodiment of the present invention. [Figure 2] This figure shows an example of the hardware configuration of an information processing device according to one embodiment of the present invention. [Figure 3] This is a flowchart illustrating the information processing procedure in an information processing device according to one embodiment of the present invention. [Figure 4]A flowchart for explaining index rate determination processing considering a confidence interval in an information processing apparatus according to an embodiment of the present invention. [Figure 5] A diagram showing an example of a Wilson confidence interval for explaining a 95% confidence interval in a substantive examination of the present invention. [Figure 6] A diagram for explaining an example of a display screen displayed by a display unit of an information processing apparatus according to an embodiment of the present invention. [Figure 7] A diagram for explaining another example of a display screen displayed by a display unit of an information processing apparatus according to an embodiment of the present invention. [Figure 8] A diagram for explaining yet another example of a display screen displayed by a display unit of an information processing apparatus according to an embodiment of the present invention. [Figure 9] A diagram for explaining an example of a display screen in which an auxiliary information is displayed by a display unit of an information processing apparatus according to an embodiment of the present invention. [Figure 10] A flowchart for explaining an information processing procedure regarding processing [A] in an information processing apparatus according to an embodiment of the present invention.

Mode for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same reference numerals are assigned to the same components, and the description thereof will be omitted as appropriate. In the following description, each component of each device / system indicates a functional unit block, not a hardware unit configuration, unless otherwise specified. Each component of each device / system is realized by an arbitrary combination of hardware and software centered around a CPU, a memory, a program loaded in the memory, a storage medium such as a hard disk storing the program, and a network connection interface of an arbitrary computer. And there are various modifications to the realization method and the device.

[0015] <Configuration of Information Processing System 1> FIG. 1 is a block diagram showing the configuration of an information processing system 1 according to an embodiment of the present invention. The information processing system 1 according to the present embodiment includes an information processing apparatus 100, a user terminal 200, a web server 300, and a search server 400. In the information processing system 1, these devices are connected to each other via a network N, and communication of data including text and images can be performed between them.

[0016] In the present embodiment, the network N will be described by taking the Internet as an example, but it may be a wired or wireless communication network such as a LAN (Local Area Network) or a WAN (Wide Area Network), and communication via a 4G or 5G line may also be included.

[0017] The information processing apparatus 100 is a server computer for inspecting the index status of a website, that is, the index status of a group of web pages composed of a plurality of web pages. The information processing apparatus 100, for example, performs high-speed and large-volume monitoring and ad hoc analysis necessary for SEO (Search Engine Optimization) measures of web pages of users such as individuals, companies, and universities, and provides the analysis results and the like to users who are website owners as SaaS (Software as a Service).

[0018] The user terminal 200 is a computer such as a smartphone, a tablet terminal, a notebook PC, or a desktop PC for a user who is a website owner and enjoys the services provided by the information processing apparatus 100 to perform data input / output. The user terminal 200 includes a display screen 210 for the user to confirm (visually recognize) the index status.

[0019] The web server 300 is a server computer that stores the user's multiple web pages (websites, groups of web pages) as files such as HTML, CSS, and JavaScript. The web server 300 is responsible for sending the data of the corresponding web page when the user accesses a specific URL. In this embodiment, the information processing system 1 is equipped with only one web server 300. However, multiple web servers may be provided on the network N, and each web server may store one or more web pages for one or more users.

[0020] The search server 400 is a server computer or personal computer and includes a search engine 410. For example, an existing search engine such as Google (registered trademark) can be used as the search engine 410. The search engine 410 also stores information about the indexes of various web pages stored on the web server 300 on the network N as an index 420 within the search server 400, or in a database accessible to the search server 400. In this embodiment, the index 420 is held by the search engine 410. In the case of large-scale search engines, for example, to store information on billions of web pages, it may be possible to use multiple search servers to create a distributed index.

[0021] <Configuration of the information processing device 100> The information processing device 100 includes an acquisition unit 110, an index status confirmation unit 120, an index rate determination unit 130, a selection unit 140, a display unit 150, a judgment unit 160, a crawl status confirmation unit 170, and a crawl rate determination unit 180, and inspects the index status of a group of web pages consisting of multiple web pages.

[0022] In the following embodiments, the group of web pages that constitutes the population is referred to as the "first web page group," and the group of web pages of the sample selected by random sampling in the selection unit 140 described later is referred to as the "second web page group."

[0023] The acquisition unit 110 functions as an acquisition means for acquiring information about a group of web pages consisting of multiple web pages provided by a user terminal 200 or the like. For example, the information about the group of web pages is a list of URLs for each web page in the group. Furthermore, the acquisition unit 110 can obtain information about the web page group, which is a list of URLs for each web page in the web page group, either by the user directly inputting it via the user terminal 200, or by obtaining it as data such as RSS (Rich Site Summary), XML sitemap (sitemap.xml), or CSV. The web page group from which the acquisition unit 110 obtains information is the first web page group which constitutes the population.

[0024] The index status confirmation unit 120 functions as an index status confirmation means to check whether each webpage in the first group of webpages acquired by the acquisition unit 110 is indexed by a search engine such as Google (registered trademark). Furthermore, if the index status confirmation unit 120 selects a second set of web pages from the first set of web pages in the population by sampling using the selection unit 140 (described later), the index status confirmation unit 120 can also check whether each web page in the second set of web pages is indexed by a search engine.

[0025] For example, the index status confirmation unit 120 can cause the search engine's inspection tool to check whether each webpage in the second group of webpages selected by the selection unit 140 (described later) is indexed by the search engine. This allows existing systems to be used as is. Specifically, if the information on the first group of webpages acquired by the acquisition unit 110 is a list of URLs (Uniform Resource Locators) for each webpage in the first group of webpages, the search engine's inspection tool is the URL inspection tool of that search engine. Thus, the advantage of using URLs is that it makes it easier for search tools and users themselves to access each webpage. Furthermore, the index status confirmation unit 120's confirmation of whether each webpage in the second webpage group is indexed by a search engine is not limited to the method described above, and other methods may also be used.

[0026] The index rate determination unit 130 functions as an index rate determination means that sets the index rate as the ratio of the number of web pages in a group of web pages that are indexed by a search engine. Specifically, the index rate determination unit 130 sets the first index rate as the ratio of the number of web pages in the first group of web pages, which is the population, that are indexed by a search engine. With the above configuration, the information processing device 100 can provide an indexing rate as an indicator that easily shows the indexing status of the acquired web pages. This allows the user to conveniently check the indexing status of the web pages.

[0027] Furthermore, the index rate determination unit 130 determines the ratio of the number of web pages in the second group of web pages selected by the selection unit 140 (described later) that are indexed by the search engine as the second index rate, and estimates this second index rate as the first index rate for the population. As a result, the information processing device 100 can suitably determine the index rate of the first group of web pages, which is the population, using the index rate of the second group of web pages, which is a sample taken from the first group of web pages, which is the population.

[0028] Furthermore, the index rate determination unit 130 determines a predetermined % confidence interval for the first webpage group based on the relationship between the determined second index rate and the number of webpages in the second webpage group, and estimates this predetermined % confidence interval as the first index rate. This makes it possible to determine the first index rate of the first website group as an index rate based on a statistical perspective, where the range in which the index rate exists has a predetermined % probability.

[0029] The selection unit 140 functions as a selection means that performs sampling on the first group of web pages to select the second group of web pages. The selection unit 140 performs random sampling, such as reservoir sampling. Reservoir sampling is a sampling technique designed to collect samples from a data stream when the length of the data stream is unknown. By using such a random sampling technique, the selection unit 140 can extract uniformly random samples even if the population is a huge data set, and the selection of the second set of web pages as a sample from the first set of web pages as the population can be made more objective. Note that the term "reservoir" may also be pronounced as "reservoir," "reserva," "reservoir," "reservoir," or "reservoir," but in this patent specification, the expression "reservoir" is used.

[0030] Furthermore, the selection unit 140 performs sampling and selects a second group of web pages for the sample when the number of web pages in the first group of web pages, which is the population, exceeds a predetermined threshold. By setting a threshold when performing sampling, the index rate can be appropriately determined depending on the environment in which to check whether or not the pages are indexed. For example, if the number of web pages in the first group of web pages, which constitutes the population, exceeds a predetermined threshold (for example, the number of samples allowed by the search engine), the selection unit 140 determines the number of samples to be taken within the range allowed by the search engine. Then, the selection unit 140 selects the second group of web pages from the first group of web pages according to the determined number of samples. This makes it easy to estimate and confirm the extent to which the first group of web pages, which constitutes the population, is indexed by search engines, regardless of the size of the population.

[0031] The display unit 150 functions as a display means that displays the first index rate determined by the index rate determination unit 130, or, if sampling has been performed by the selection unit 140, the second index rate (estimated first index rate). The second index rate of the sample web page group, which is determined as the first index rate of the population web page group (first web page group), is displayed on the user terminal screen or the like, so that the user can easily check the index rate.

[0032] Furthermore, the display unit 150 displays multiple first index rates determined at different times, or, if sampling has been performed by the selection unit 140, second index rates (multiple estimated first index rates) in chronological order. Users can easily confirm the effectiveness of SEO measures by observing the changes in the index rate. Furthermore, the display unit 150 displays the time-series changes of multiple first index rates determined by the index rate determination unit 130 for different times. This allows the display of the trend of the first index rate, which defines the index rate of the first group of websites as a predetermined percentage confidence interval (for example, a 90% confidence interval, a 95% confidence interval, or a 99% confidence interval) within which the index rate exists with a predetermined probability, so that users can easily check the trend of the index status.

[0033] Here, a confidence interval is an interval estimated by interval estimation, which estimates parameters such as the population mean using data from the sample of the second group of web pages, assuming that the population, which is the first group of web pages, follows a normal distribution. In this embodiment, the index rate determination unit 130 determines a predetermined % confidence interval for the first index rate, which can be specifically determined as a "90% confidence interval," "95% confidence interval," or "99% confidence interval." For example, a "95% confidence interval" means that if a sample is taken from the population and the 95% confidence interval for the population mean is calculated from that sample 100 times, the population mean will fall within that interval 95 or more times.

[0034] The determination unit 160 functions as a determination means for determining whether the index rate has improved or worsened by comparing the upper and lower limits of a predetermined % confidence interval at two different time points. Specifically, the determination unit 160 determines, based on the upper limit (first upper limit) and lower limit (first lower limit) of the predetermined % confidence interval for the first index rate determined by the index rate determination unit 130 at a first time point (e.g., a past time point), and the upper limit (second upper limit) and lower limit (second lower limit) of the predetermined % confidence interval for the first index rate determined at a second time point (e.g., the current time, a time point later than the first time point), whether (1) the second lower limit is greater than the first upper limit, and (2) whether the second upper limit is less than the first lower limit.

[0035] Here, if the second lower limit is greater than the first upper limit (1), all of the predetermined % confidence intervals for the second time point are greater than the predetermined % confidence intervals for the first time point, indicating that the indexing status has improved due to website SEO measures, etc. On the other hand, if the second upper limit is less than the first lower limit (2), all of the predetermined % confidence intervals for the second time point are smaller than the predetermined % confidence intervals for the first time point, indicating that the indexing status has worsened, i.e., deteriorated, due to website SEO measures, etc.

[0036] The display unit 150 displays auxiliary information regarding the judgment result of the judgment unit 160, either superimposed on the time-series display of the first index rate or in a separate window. This auxiliary information may include, for example, auxiliary lines on a graph indicating whether the index status has improved or worsened, pop-up displays of text and images, and email notifications regarding warnings or reports about improvements / deteriorations. In this way, by displaying auxiliary information indicating that the lower limit of the 95% confidence interval after SEO measures is greater than the upper limit of the 95% confidence interval before SEO measures, i.e., that the indexing status has improved due to SEO measures, users can visually confirm the improvement. Conversely, by displaying auxiliary information indicating that the upper limit of the 95% confidence interval after SEO measures is smaller than the lower limit of the 95% confidence interval before SEO measures, i.e., that the indexing status has worsened due to SEO measures, users can visually confirm the deterioration.

[0037] The crawl status confirmation unit 170 functions as a crawl status confirmation means to confirm whether each web page in the second group of web pages of the sample has been crawled by a search engine.

[0038] Furthermore, the crawl rate determination unit 180 functions as a crawl rate determination means that determines the ratio of the number of web pages in the second group of web pages of the sample that are crawled by search engines as the crawl rate, and sets this crawl rate as the crawl rate for the first index group, which is the population. Furthermore, in addition to the aforementioned index rate and various related information, the display unit 150 can also display the crawl rate determined by the crawl rate determination unit 180, the trend of the crawl rate, and various related information on the user terminal 200. This makes it easy to estimate and determine the extent to which the population of first web pages is being crawled by search engines.

[0039] <Example Hardware Configuration> Figure 2 shows an example of the hardware configuration of the information processing device 100 described above according to one embodiment of the present invention. The information processing device 100 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0040] Bus 1010 is a data transmission path for the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060 to send and receive data to and from each other. However, the method of connecting the processor 1020 and the other components to each other is not limited to bus connection.

[0041] The 1020 processor is a processor implemented in components such as the CPU (Central Processing Unit) and GPU (Graphics Processing Unit).

[0042] Memory 1030 is a main memory device implemented using RAM (Random Access Memory), etc.

[0043] The storage device 1040 is an auxiliary storage device implemented as a removable media such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or memory card, or as ROM (Read Only Memory), and has a recording medium. The recording medium of the storage device 1040 stores program modules that realize each function of the information processing device 100. The processor 1020 reads these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to that program module.

[0044] The input / output interface 1050 is an interface for connecting the information processing device 100 with various input / output devices.

[0045] The network interface 1060 is an interface for connecting the information processing device 100 to the network N. The method by which the network interface 1060 connects to the network N may be a wireless connection or a wired connection.

[0046] <Example of operation> The following embodiment describes the process of obtaining data from a first group of websites, which is a population of 2000 pages, and determining the indexing rate when using a search engine (e.g., Google®). In this embodiment, the number of pages allowed by the search engine is set to 500, and this number of pages (500 pages) is used as a threshold. The case in which the number of web pages (500 pages) of the second group of web pages is determined by random sampling when the first group of web pages exceeds this threshold is described. Figure 3 is a flowchart illustrating the information processing procedure in an information processing device 100 according to one embodiment of the present invention.

[0047] In the information processing device 100, the acquisition unit 110 acquires information about a first group of web pages, which is the population, from the user terminal 200 (step S101). For example, the information about the first group of web pages could be all the web pages below the top page of a company's own website, or a group of web pages related to a specific service, and the user can freely specify them according to the purpose of the inspection. Then, the information about these web pages is acquired from the user terminal 200, for example, as CSV format data listing the URLs of each web page in the first group of web pages (step S101).

[0048] Next, the selection unit 140 determines whether the number of web pages in the acquired first web page group exceeds a predetermined threshold (step S102). If the selection unit 140 determines that the number of web pages in the first web page group exceeds the predetermined threshold (YES), it determines the sampling size within the range acceptable to the search engine and selects a second web page group of samples of the number of samples determined by random sampling from the first web page group, which is the population (step S103). This allows the user to easily check how well the first web page group, which is the population, is indexed by search sites, regardless of the size of the population.

[0049] In this embodiment, as described above, the "number of web pages in the first web page group" is set to 2000 pages, the "predetermined threshold" to 500 pages, and the "number of web pages in the second web page group" to 500 pages. Therefore, in step S102, since the number of web pages in the first web page group (2000 pages) exceeds the predetermined threshold (500 pages) (YES), the process proceeds to step S103. Then, in step S103, the second web page group (500 pages) is selected.

[0050] On the other hand, if the selection unit 140 determines in step S102 that the predetermined threshold has not been exceeded (NO), the process proceeds to process [A], which determines the index rate and other parameters for all web pages in the first group of web pages, which constitutes the population. The specific procedure for process [A] will be described later.

[0051] Next, the index status confirmation unit 120 checks the index status of each webpage in the second group of webpages selected in step S103 to see if it has been indexed by the search engine (step S104). Here, prior to the index status check by the index status check unit 120, the crawl status check unit 170 checks whether each webpage in the second webpage group has been crawled by the search engine. This is because search engines typically crawl pages first and then index them. However, indexing does not always occur immediately after crawling, and the timing varies depending on various factors (for example, the reliability of the website, the quality of the pages, the search engine's crawling and indexing schedule, etc.).

[0052] When the crawl status is confirmed by the crawl status confirmation unit 170, the crawl rate determination unit 180 determines the crawl rate as the ratio of the number of web pages in the second web page group that are crawled by search engines, and sets this crawl rate as the crawl rate for the first index group. This makes it easy to estimate, through processing the sample, how much of the first web page group, which is the population, is crawled by search sites. Furthermore, the determination of the crawl rate by the crawl rate determination unit 180 may occur at the same time as the determination of the index rate by the index rate determination unit 130, which will be described later, or they may occur at different, independent times.

[0053] Here, we will explain the index status verification process performed by the index status verification unit 120. The index status verification unit 120 causes the search engine's inspection tool to check whether each webpage in the second webpage group is indexed by the search engine. For example, if the information about the first group of web pages, which is the population, is a list of URLs (Uniform Resource Locators) for each web page in that first group, then a list of URLs for each web page in the second group (a list of 500 URLs) is selected. If the search engine is Google®, then the search engine's URL inspection tool, the "URL Inspection API," is used to check the indexing status of these 500 URLs. This makes it easier for search tools and users themselves to access each web page using the URL. Furthermore, existing systems can be utilized as is, preventing unnecessary system development.

[0054] Next, the index rate determination unit 130 determines the ratio of the number of web pages in the second web page group of the sample that are indexed by the search engine as the second index rate, and further estimates this second index rate as the first index rate (step S105). In this way, according to the information processing device 100 of this embodiment, the index rate of the first web page group, which is the population, can be suitably estimated using the index rate of the second web page group of the sample sampled from the first web page group, which is the population.

[0055] Here, the index rate determination unit 130 can determine the index rate of the population, which is the first group of web pages, based on the "confidence interval," by giving it a range of possible index rates rather than a fixed value. Figure 4 is a flowchart illustrating the index rate determination process (step S105) in an information processing device 100 according to one embodiment of the present invention, when considering the confidence interval.

[0056] First, the index rate determination unit 130 determines the ratio of the number of web pages in the second group of web pages of the sample that are indexed by the search engine as the second index rate (step S105A).

[0057] Next, the index rate determination unit 130 determines a predetermined % confidence interval for the first index rate based on the relationship between the second index rate for the sample determined in step S105A and the number of web pages in the second web page group (step S105B).

[0058] Here, the process for determining a predetermined % confidence interval (step S105B) will be explained. In this embodiment, as an example, a "95% confidence interval" is used. Figure 5 shows an example of a Wilson Confidence Interval (Wilson Score Interval) used to explain the 95% confidence interval in one substantive examination of the present invention. Wilson's confidence interval is a statistical method for estimating the true value of success probabilities and proportions, and is particularly used for proportion data based on a binomial distribution. This method is designed to provide more accurate confidence intervals even when the sample size is small or the proportions are extreme. Ordinary confidence intervals (e.g., those based on a normal distribution) can be inaccurate when the sample size is small or the proportions are extremely skewed (close to 0% or 100%). However, Wilson's confidence interval improves on this by handling the data distribution more carefully. Specifically, it applies corrections that take into account sample size and skew when calculating the confidence interval for success rates. This can increase reliability when the standard normal distribution approximation is inappropriate (small samples or extreme cases). In other words, it is a preferred approach to more realistically reflect the shape of the distribution and prevent underestimation or overestimation. In this example, a 95% confidence interval is used, which means there is a 95% probability that the true value falls within the interval. However, because it offers greater certainty, it is often used when careful estimation is required. For example, if the index rate determination unit 130 obtains a second index rate of 70%, then, as described above, the second group of web pages has a sample size of 500, the first index rate is determined to be in the range of 0.6985 ± 0.04004, that is, the first index rate can take on a range from an upper limit of 0.73854 to a lower limit of 0.65846 (step S105B).

[0059] Returning to Figure 3, once the first index rate (the first index rate estimated from the second index rate) considering the confidence interval is determined in step S105, the display unit 150 displays the first index rate determined by the index rate determination unit 130 on the display screen 210 of the user terminal 200 (step S106). Since the second index rate of the sample second web page group, which was determined as the first index rate of the population first web page group, is displayed on the user terminal screen, the user can easily check the index rate.

[0060] Furthermore, if the index rate determination unit 130 determines a first index rate (a first index rate estimated from the second index rate) for different time periods, the display unit 150 can display the progress of multiple first index rates for those different time periods in chronological order. Figure 6 is a diagram illustrating an example of a display screen 210 displayed by the display unit 150 of an information processing device 100 according to one embodiment of the present invention. As shown in Figure 6, the display screen 210 has a trend display area 211 that displays the trend of the first index rate determined for multiple dates (times) in chronological order. According to Figure 6, the index rate (IN-211a) remained at 70% from October 18 to November 15. The crawling rate (CR-211a) remained at 100% from October 18 to November 15, indicating that all web pages in the second web page group were crawled by the search engine.

[0061] Furthermore, as shown in Figure 6, the display screen 210 has a status display area 212 in the status details (per URL) section that displays the status of whether each webpage in the second webpage group has been indexed by the search engine. This display area includes indicators such as a check mark (if indexed) or an X mark (if not indexed) so that users can check it at a glance. In addition, supplementary information that complements the status is displayed along with the status as a status report. In Figure 6, for example, if the page has been both crawled and indexed, the text information "Registered" is displayed. If the page has been crawled but not indexed, it will display something like "Crawled, Not Indexed".

[0062] Here, some reasons why a website crawled by a search engine might not be indexed include, for example, if the website is newly created and not yet recognized by the search engine, if the website's content is thin and of poor quality, or if the website is being blocked by robots meta tags or robots.txt files.

[0063] Furthermore, as shown in Figure 6, the display screen 210 has a latest status display area 213 that displays the latest crawl rate, index rate, and other information. By checking these trend display area 211, status display area 212, and latest status display area 213 on the display screen 210, users can properly understand the crawl status and index status.

[0064] Figure 7 is a diagram illustrating another example of a display screen 210 displayed by the display unit 150 of an information processing device 100 according to one embodiment of the present invention. As shown in Figure 7, the display unit 150 displays the progress of the first index rate, determined for multiple dates (times), in chronological order in the progress display area 211 of the display screen 210. By checking the display contents of the progress display area 211, the user can see that the index rate (IN-211b) remained at 70% until November 15, but the results of SEO measures for the first group of websites (the period of SEO measures is defined as the period in question or a period prior to that period, but in this embodiment, the timing of when the measures were taken is not particularly important, and the determination is made based on when the results became apparent) were reflected from November 15 to November 22, and the index rate improved to 95% on November 22. In addition, the display information in the status display area 212 and the latest status display area 213 has also been updated.

[0065] Furthermore, as mentioned above, the index rate determination unit 130 can determine the first index rate within a certain range using a confidence interval, rather than as a fixed value. Therefore, the display unit 150 is configured to also display the range of a predetermined % confidence interval (for example, a 95% confidence interval) when the first index rate is estimated and determined using that interval.

[0066] Figure 8 is a diagram illustrating yet another example of a display screen 210 displayed by the display unit 150 of an information processing device 100 according to one embodiment of the present invention. According to the Wilson confidence interval shown in Figure 5, when the number of samples is 500 pages, the 95% confidence interval when the index rate is 70% is 0.6985 ± 0.0404, and the first index rate will have a range of approximately 4% above and below approximately 70%. Also, when the index rate is 95%, the 95% confidence interval is 0.9466 ± 0.01934, and the first index rate will have a range of approximately 2% above and below approximately 95%. As shown in Figure 8, the display unit 150 displays the trend of the first index rate (IN-211c), which has a range of possible values ​​determined for multiple dates and times, in a time series in the trend display area 211 of the display screen 210. Examples of how to display the first index rate (IN-211c) include, for example, displaying the upper and lower limits of the first index rate and their median as lines, or adding a conspicuous color or pattern between the upper and lower limits.

[0067] Furthermore, if the index rate changes significantly, such as when it improves due to SEO measures or, conversely, when it deteriorates, the display unit 150 may display various auxiliary information. For example, auxiliary information may include auxiliary lines on a graph, a pop-up display, or an email sent to the user indicating an improvement in the indexing status, or auxiliary lines on a graph, a pop-up display, or an email sent to the user indicating a deterioration.

[0068] Therefore, in step S106 shown in Figure 3, after the display unit 150 displays the trend of the first index rate, the judgment unit 160 determines the change in the index status based on the change in the first index rate at the first time and the second time (step S107). Figure 9 is a diagram illustrating an example of a display screen 210 on which the display unit 150 of an information processing device 100 according to one embodiment of the present invention displays auxiliary information M. Here, as an example of auxiliary information, a case in which a pop-up display is performed will be described.

[0069] The judgment unit 160 compares the upper limit of the 95% confidence interval (first upper limit U1) of the first index rate (IN-211c) before SEO measures (for example, November 15th (time T1)) with the lower limit of the 95% confidence interval (second lower limit L2) after SEO measures (for example, November 22nd (time T2)), and determines whether the second lower limit L2 is greater than the first upper limit U1. If the second lower limit L2 is greater than the first upper limit U1, the judgment unit 160 determines that the index status has improved due to the SEO measures.

[0070] Furthermore, the judgment unit 160 compares the lower limit of the 95% confidence interval (first lower limit L1) of the first index rate (IN-211c) before SEO measures (for example, November 15th (time T1)) with the upper limit of the 95% confidence interval (second upper limit U2) after SEO measures (for example, November 22nd (time T2)) to determine whether the second upper limit U2 is smaller than the first lower limit L1. If the second upper limit U2 is smaller than the first lower limit L1, the judgment unit 160 determines that the index status has worsened due to the SEO measures.

[0071] Then, based on the judgment result from the judgment unit 160, the display unit 150 overlays auxiliary information indicating improvements or deteriorations on the trend of the first index rate displayed in the trend display area 211 of the display screen 210 (step S108). Auxiliary information indicating improvements may include, for example, auxiliary lines on the graph, pop-up displays, or email notifications. Auxiliary information indicating deteriorations may include, for example, auxiliary lines on the graph, pop-up displays, or email notifications. This allows users to visually confirm the results of the SEO measures, whether they have improved or deteriorated.

[0072] <Processing [A] (If the second group of web pages is not selected)> In step S102 of the flowchart in Figure 3, if the selection unit 140 determines that the predetermined threshold is not exceeded (NO), the number of web pages in the first web page group is less than or equal to 500 pages, which is the sample size allowed by the search engine. Therefore, the selection unit 140 does not perform the selection process for the second web page group, and the process transitions to [A]. Figure 10 is a flowchart illustrating the information processing procedure for process [A] in the information processing device 100 according to one embodiment of the present invention.

[0073] As shown in Figure 10, the index status confirmation unit 120 checks the index status of each web page in the first group of web pages, which consists of 500 or fewer web pages, acquired by the acquisition unit 110, to see if they are indexed by the search engine (step S201).

[0074] Next, the index rate determination unit 130 determines the ratio of the number of web pages in the first group of web pages in the population that are indexed by the search engine as the first index rate (step S202).

[0075] Then, when the first index rate is determined in step S202, the display unit 150 displays the first index rate determined by the index rate determination unit 130 on the display screen 210 of the user terminal 200 (step S203). If the index rate determination unit 130 determines the first index rate for different times, the display unit 150 can display the progress of multiple first index rates for those different times in chronological order.

[0076] Furthermore, after the display unit 150 displays the trend of the first index rate, the determination unit 160 determines the change in the index status based on the change in the first index rate at the first time and the second time (step S204).

[0077] Then, the display unit 150 displays auxiliary information indicating that improvements have been made on the display screen 210, based on the judgment result from the judgment unit 160, similar to the process in step S108 described above (step S205).

[0078] It should be noted that each flowchart described in this embodiment is merely one embodiment. Without altering the spirit of the present invention, there may be processes other than those described in each flowchart, some of the described processes may be omitted, or the order of the processes may be changed. Furthermore, the configuration of the display screen and the display information used to explain the embodiments are also just examples, and some of the display information may be omitted, or other information may be included.

[0079] While embodiments of the present invention have been described above, the embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of this invention is indicated not by the above description but by the claims, and all modifications within the meaning and scope of the claims are intended to be included. [Explanation of Symbols]

[0080] 1. Information Processing System 100 Information Processing Devices 110 Acquisition Department 120 Index Status Confirmation Section 130 Index Rate Determination Section 140 Selection Section 150 Display section 160 Judgment Department 170 Crawl Status Confirmation Section 180 Crawl rate determination unit 200 user terminals 210 Display screen 211 Transition display area 212 Status display area 213 Latest Status Display Area 300 web servers 400 search servers 410 Search Engines 420 Index 1010 Bus 1020 Processor 1030 memory 1040 Storage Devices 1050 Input / Output Interface 1060 Network Interfaces N Network

Claims

1. An information processing device for checking the indexing status of a first group of web pages consisting of multiple web pages, An acquisition means for acquiring information about the first group of web pages, An index status checking means for checking whether each webpage in the aforementioned first group of webpages is indexed by a search engine, An information processing apparatus comprising an index rate determination means, the first index rate being the ratio of the number of web pages in the first group of web pages to the number of web pages indexed by the search engine.

2. In the information processing apparatus according to claim 1, The system further comprises a selection means for sampling the first group of web pages and selecting a second group of web pages, The index status checking means checks whether each webpage in the second group of webpages is indexed by the search engine. The index rate determination means determines the ratio of the number of web pages in the second web page group to the number of web pages indexed by the search engine as the second index rate, and sets the second index rate as the first index rate, in this information processing device.

3. In the information processing apparatus according to claim 2, The index rate determination means determines a predetermined % confidence interval for the first web page group based on the relationship between the determined second index rate and the number of web pages in the second web page group, and sets the predetermined % confidence interval as the first index rate, in this information processing device.

4. In the information processing apparatus according to claim 2, The selection means is an information processing device that performs sampling and selects the second web page group when the number of web pages in the first web page group exceeds a predetermined threshold.

5. In the information processing apparatus according to claim 4, The selection means is an information processing device that, when the number of web pages in the first web page group exceeds a predetermined threshold, determines the number of samples within a range permitted by the search engine, and selects the second web page group from the first web page group based on the sampling.

6. In the information processing apparatus according to claim 2, The sampling is random sampling in the information processing device.

7. In the information processing apparatus according to claim 6, The aforementioned random sampling is reservoir sampling, according to the information processing device.

8. In the information processing apparatus according to claim 2, An information processing apparatus further comprising a display means for displaying the second index rate determined by the index rate determination means.

9. In the information processing apparatus according to claim 8, The display means is an information processing device that displays a plurality of the second index rates determined at different times in a time series.

10. In the information processing apparatus according to claim 9, The index rate determination means determines a predetermined % confidence interval for the first web page group based on the relationship between the determined second index rate and the number of web pages in the second web page group, and sets the predetermined % confidence interval as the first index rate. The display means is an information processing device that displays a plurality of the first index rates determined at different times in a time series.

11. In the information processing apparatus according to claim 10 The upper and lower limits of the predetermined % confidence interval of the first index rate determined by the index rate determination means at the first time are set as the first upper limit and first lower limit. The upper and lower limits of the predetermined % confidence interval for the first index rate determined at the second time point are set as the second upper and second lower limits. The system further comprises a determination means for determining whether the second lower limit is greater than the first upper limit, and whether the second upper limit is less than the first lower limit, The display means is an information processing device that further displays information relating to the judgment result made by the judgment means.

12. An information processing apparatus according to claim 2, The index status confirmation means is an information processing device that causes the search engine's inspection tool to confirm whether each web page in the second group of web pages is indexed by the search engine.

13. In the information processing apparatus according to claim 12, The information relating to the first group of web pages is a list of URLs (Uniform Resource Locators) for each web page in the first group of web pages, An information processing device in which the inspection tool of the aforementioned search engine is a URL inspection tool of the said search engine.

14. In the information processing apparatus according to claim 2, A crawl status confirmation means for confirming whether each web page in the second group of web pages has been crawled by the search engine, An information processing device further comprising a crawl rate determination means that determines the crawl rate as the ratio of the number of web pages in the second group of web pages that are crawled by the search engine, and sets this crawl rate as the crawl rate for the first group of web pages.

15. An information processing method in an information processing device for checking the indexing status of a first group of web pages consisting of multiple web pages, The acquisition step involves obtaining information about the aforementioned first group of web pages, An index status check step to check whether each webpage in the aforementioned first group of webpages is indexed by a search engine, An information processing method comprising an indexing rate determination step, wherein the ratio of the number of web pages in the first group of web pages to the number of web pages indexed by the search engine is defined as the first indexing rate.

16. A computer that checks the indexing status of a first group of web pages consisting of multiple web pages, The acquisition step involves obtaining information about the aforementioned first group of web pages, An index status check step to check whether each webpage in the aforementioned first group of webpages is indexed by a search engine, A computer-readable program for performing an indexing rate determination step, wherein the first indexing rate is defined as the ratio of the number of web pages in the first group of web pages to the number of web pages indexed by the search engine.

Images