Service identification device, analysis device, reference device, methods, programs, and systems executed by these devices
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- INTERNET INITIATIVE JAPAN INC
- Filing Date
- 2024-10-28
- Publication Date
- 2026-05-22
AI Technical Summary
Existing usage service identification methods fail to accurately determine which factors, such as cookies, cause external requests, leading to unclear service identification.
A system that analyzes site URLs, extracts cookies, web storage, and external communication URLs, and matches them with a service database to identify the corresponding services, registering the associations for future reference.
Accurately identifies and registers services used on a website by correlating cookies, web storage, and external communication URLs with their respective services, enabling comprehensive service usage analysis.
Smart Images

Figure 0007864278000001 
Figure 0007864278000002 
Figure 0007864278000003
Abstract
Description
Technical Field
[0001] The present invention relates to a usage service identification device, an analysis device, a reference device, a usage service identification method, an analysis method, a usage service reference method, a usage service identification program, an analysis program, a usage service reference program, and a usage service identification system.
Background Art
[0002] There is known a usage service identification device that activates an Internet browser to access a website to be analyzed, monitors an HTTP request to extract the URL of an external request, and refers to an external service database to identify the service corresponding to the domain and path of the URL of the external request (see, for example, Patent Document 1). However, with such a method, it is unclear which factor such as a cookie causes the external request. [Prior Art Documents] [Patent Documents] [Patent Document 1] Japanese Patent Application Laid-Open No. 2018-185741 General Disclosure
[0003] (Item 1) The usage service identification device may include an analysis item acquisition unit that acquires analysis items including a correspondence relationship between the site URL of the analysis target site and at least one cookie issued on a page in the analysis target site, web storage set, or external communication URL of external communication that occurs. The usage service identification device may include a usage service identification unit that matches the analysis items with a service database and identifies the service corresponding to the cookie, the web storage, or the external communication URL included in the analysis items as the usage service used on the at least one page. The usage service identification device may include a usage service registration unit that registers the correspondence between the site URL and the usage service. The aforementioned service database may contain data in which cookies, web storage, and external communication URLs are associated with services. (Item 2) The aforementioned analysis item acquisition unit may acquire the analysis items from the analysis item database. The aforementioned analysis item database may contain registered correspondences between the site URL and the cookie, web storage, or external communication URL. (Item 3) If the service registration unit is unable to identify the service, it may register the site URL, the cookie, the web storage, or the external communication URL as not being associated with a service. (Item 4) The aforementioned service identification unit may include an external communication URL matching unit that extracts data from the service database that at least partially matches the external communication URL included in the analysis item and the service corresponding to that data, and acquires the service as a service. The aforementioned service identification unit may include a cookie matching unit that extracts data from the service database that at least partially matches the Name attribute of the cookie included in the analysis item and the service that corresponds to that data, and acquires the service as the service that uses the service. The aforementioned service identification unit may include a web storage matching unit that extracts data from the service database that partially matches the origin of the web storage included in the analysis item and the service that corresponds to it, and acquires the service as a service. (Item 5) If the cookie matching unit finds multiple pieces of data that at least partially match the cookie in the Name attribute, it may obtain the service that appears most frequently among the multiple services indicated by those pieces of data as the service being used. (Item 6) The aforementioned service registration unit may register the site URL and the service being used in the service database.
[0004] (Item 7) The analysis device may include an analysis target acquisition unit that acquires the site URL of the site to be analyzed. The analysis device may include an analysis execution unit that analyzes one or more pages within the site published at the site URL and extracts cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur. The analysis device may include an analysis item registration unit that associates the site URL of the page from which the cookie, web storage, or external communication URL is extracted with the cookie, web storage, or external communication URL extracted from the page, and registers them in a manner that can be acquired by the service identification device described in item 1. (Item 8) The analysis execution unit may include a site access unit that uses a virtual browser to specify the site URL and sends a request to the server operating the site to be analyzed, and receives a response from the server. The analysis execution unit may include an analysis item extraction unit that extracts cookies issued by the one or more pages or external communication URLs of external communications generated from the response, and further retrieves data stored in the web storage of the virtual browser. The analysis execution unit may include a script execution unit that, if the response contains a script, executes the script using the virtual browser to access the service. (Item 9) The analysis device may further include a link extraction unit that extracts the page URL of the linked page from the response. The site access unit may further send a request to the server operating the site to be analyzed, specifying the page URL of the linked page, and receive a response from the server. (Item 10) The analysis item registration unit may register the correspondence between the site URL and the cookie, the web storage, or the external communication URL in the analysis item database.
[0005] (Item 11) The reference device may include a service acquisition unit that acquires the service used by the service identification device described in item 1, as a service used at the site to be analyzed. The reference device may include a service reference unit having a service output unit that outputs the service. (Item 12) The aforementioned service acquisition unit may acquire the aforementioned service from the service database. The aforementioned service database may be one in which the site URL and the service used are registered in association with each other using the aforementioned service identification device. (Item 13) The aforementioned reference device may further include an analysis item reference unit. The aforementioned analysis item reference unit may include a second analysis item acquisition unit that acquires analysis items including the correspondence between the site URL of the site to be analyzed and cookies, web storage, or external communication URLs associated with the site URL. The analysis item reference unit may have an analysis item output unit that outputs the site URL included in the analysis item and the cookie, web storage, or external communication URL corresponding to the site URL. (Item 14) The second analysis item acquisition unit may acquire the analysis items from the analysis item database. The aforementioned analysis item database may contain registered correspondences between the site URL and the cookie, web storage, or external communication URL.
[0006] (Item 15) A method for identifying services used by a computer may include a step of obtaining analysis items that include the correspondence between the site URL of the site to be analyzed and cookies issued on at least one page within the site to be analyzed, web storage set, or external communication URLs of external communications that occur. The method for identifying the services being used may include the step of matching the analysis items with a service database to identify the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as services being used on at least one page. The method for identifying the service to be used may include a step of registering the site URL and the service to be used in association with each other. The aforementioned service database may contain data in which cookies, web storage, and external communication URLs are associated with services.
[0007] (Item 16) The analysis method performed by the computer may include a step to obtain the site URL of the site to be analyzed. The analysis method may include the step of analyzing one or more pages within the site published at the site URL and extracting cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur. The analysis method may include a step of associating the site URL of the page on which the cookie is issued, the web storage is set, or the external communication URL is generated with the cookie issued on the page, the web storage that is set, or the external communication URL that is generated, and registering them in a way that can be obtained by the service identification method described in item 15.
[0008] (Item 17) A computer-based method for referencing services used may include a step of acquiring the services used by the service identification method described in item 15, as services used at the site to be analyzed. The usage service reference method may include a step of outputting the usage service.
[0009] (Item 18) The usage service identification program may cause a computer to execute a procedure of obtaining analysis items including a correspondence relationship between a site URL of an analysis target site and at least one cookie issued on a page in the analysis target site, web storage set, or an external communication URL of external communication that occurs. The usage service identification program may cause a computer to execute a procedure of matching the analysis items with a service database and identifying, as a usage service used on the at least one page, a service corresponding to the cookie, the web storage, or the external communication URL included in the analysis items. The usage service identification program may cause a computer to execute a usage service procedure of registering the site URL and the usage service in association with each other. The service database may be one in which data in which each of a cookie, web storage, and an external communication URL is associated with a service is registered.
[0010] (Item 19) The analysis program may cause a computer to execute a procedure of obtaining a site URL of an analysis target site. The analysis program may cause a computer to execute a procedure of analyzing one or more pages in a site published at the site URL and extracting a cookie issued by the one or more pages, web storage set, or an external communication URL of external communication that occurs. The analysis program may cause a computer to execute a procedure of registering, in a manner that enables acquisition by a second computer when the utilization service identification program according to item 18 is executed on the second computer, the site URL of the page where the cookie was issued, the web storage was set, or the external communication URL occurred, in association with the cookie issued on the page, the web storage set, or the external communication URL that occurred.
[0011] (Item 20) The utilization service reference program may cause a computer to execute a procedure of acquiring the utilization service registered by causing the utilization service identification program according to item 18 to be executed on a third computer as the service used on the analysis target site. The utilization service reference program may cause a computer to execute a procedure of outputting the utilization service.
[0012] (Item 21) The utilization service identification system may include the utilization service identification device according to item 1. The utilization service identification system may include the analysis device according to item 7. The utilization service identification system may include the reference device according to item 11. The utilization service identification system may include a service database in which data in which each of a cookie, web storage, and an external communication URL is associated with a service is registered.
[0013] (Item 22) The service identification system may include an analysis device that obtains the site URL of the site to be analyzed, analyzes one or more pages within the site published at the site URL, extracts cookies issued by the one or more pages, sets web storage, or generates external communication URLs, and registers the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the page, the web storage set, or the generated external communication URL. The aforementioned service identification system may include a service identification device that matches analysis items, including the correspondence between the site URL and the cookie, web storage, or external communication URL registered by the analysis device, with a service database, identifies the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on a page on the site URL, and registers the site URL and the service in association. The aforementioned service identification system may include the service database in which data is registered, each of which is associated with a service, such as cookies, web storage, and external communication URLs. (Item 23) The aforementioned service identification system is an analysis item database in which the correspondence between the site URL and the cookie, the web storage, or the external communication URL is registered by the analysis device, and may further comprise an analysis item database in which the analysis device acquires analysis items including the correspondence. (Item 24) The aforementioned service identification system may further include a reference device that acquires the services used as services utilized at the site under analysis, which have been registered by the service identification device, and outputs the services used. (Item 25) The aforementioned service identification system is a service identification system in which the site URL and the service being used are registered in association with each other by the service identification device, and may further comprise the service identification system in which the service being used is acquired by the reference device. (Item 26) The aforementioned service identification system is a site database in which the site URL of at least one site to be analyzed is registered, and may further comprise the site database from which the site URL is obtained by the analysis device.
[0014] (Item 27) The method for identifying the services used may include the steps of obtaining the site URL of the site to be analyzed, analyzing one or more pages within the site published at the site URL to extract cookies issued by the one or more pages, web storage to be set, or external communication URLs of external communications that occur, registering the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the page, the web storage to be set, or the external communication URL that occurs. The method for identifying the services used may include a step of matching the analysis items, which include the correspondence between the site URL registered in the registration step and the cookies, web storage, or external communication URL, with a service database, identifying the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as services used on the page on the site URL, and registering the site URL and the services used in association. The aforementioned service database may contain data in which cookies, web storage, and external communication URLs are associated with services.
[0015] (Item 28) The service identification program may have one or more computers perform the following steps: obtain the site URL of the site to be analyzed, analyze one or more pages within the site published at the site URL, extract cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur, and register the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the page, the web storage set, or the external communication URL that occurs. The service identification program may have one or more computers perform a procedure to identify the services used on a page on the site URL, and to register the site URL and the services used in association with the site URL. This procedure involves matching analysis items, including the correspondence between the site URL and the cookies, web storage, or external communication URLs registered in the registration procedure, with a service database, identifying the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items, and registering them. The aforementioned service database may contain data in which cookies, web storage, and external communication URLs are associated with services.
[0016] It should be noted that the above summary of the invention does not enumerate all of its features. Furthermore, subcombinations of these features may also constitute an invention. [Brief explanation of the drawing]
[0017] [Figure 1] This diagram shows the schematic configuration of the service identification system according to this embodiment. [Figure 2] This shows the functional configuration of the analysis device. [Figure 3] An example of registration information in the site database is shown. [Figure 4] An example of data included in an HTTP response sent from the server being analyzed is shown. [Figure 5]An example of registration information in the analysis item database is shown. [Figure 6] The analysis flow is shown below. [Figure 7] This shows the functional configuration of the service-specific device. [Figure 8A] An example of registration information in the service database is shown. [Figure 8B] An example of registration information in the service database is shown. [Figure 9] An example of registration information in the service database is shown below. [Figure 10] This shows the flow for identifying the service to be used. [Figure 11] The functional configuration of the reference device is shown. [Figure 12] This screen displays the cookies, web storage, or external communication URLs corresponding to the services used, as acquired by the analysis item acquisition unit. [Figure 13] This screen displays the site URL acquired by the analysis item acquisition unit, along with the site's cookies, web storage, or external communication URLs. [Figure 14A] This shows the service usage reference flow. [Figure 14B] This shows the input screen for the analysis target. [Figure 15] This shows the flow chart for referencing analysis items. [Figure 16] An example of a computer configuration is shown. [Modes for carrying out the invention]
[0018] The present invention will be described below through embodiments, but these embodiments are not intended to limit the scope of the claims. Furthermore, not all combinations of features described in the embodiments are necessarily essential to the solution of the invention.
[0019] Figure 1 shows a schematic configuration of the first embodiment of the service utilization identification system (also simply called the system) 1. System 1 is a network system for analyzing a website (also simply called a site) to identify the services used on that site and providing information about the identified services to a user terminal 90 used by the website administrator. System 1 comprises an analysis device 10, a service utilization identification device 50, and a reference device 80. System 1 may further comprise a site database (site DB) 20, an analysis item database (analysis item DB) 40, a service database (service DB) 60, and a service utilization database (service utilization DB) 70. These are connected to each other so as to be able to communicate with each other via a network 99. Note that databases are also referred to as DBs.
[0020] Network 99 is a communication network that connects the analysis device 10, the service identification device 50, the reference device 80, and various databases such as the site database 20 in a manner that enables them to communicate with each other. Network 99 is, for example, the Internet, but is not limited to this; any communication network that enables communication between these devices and databases may be used, such as a local area network or telephone line, or a network in which multiple communication networks coexist.
[0021] The server 30 to be analyzed is the server that operates the site to be analyzed, which is the target of identifying the services being used. Multiple sites may be analyzed, not just one. In such cases, system 1 accesses multiple servers 30 via network 99. For simplicity, this example shows only one server 30.
[0022] The user terminal 90 is, for example, a terminal device used by the administrator of a website operated by the analysis target server 30. The terminal device may be a computer terminal such as a personal computer, or a mobile terminal such as a smartphone or tablet computer. The user terminal 90 is equipped with a display 91 such as an LCD display and functions as a client terminal that communicates with the reference device 80 to obtain information such as the services used on the website and displays it on the display 91. Multiple user terminals 90, each owned by multiple users, may be included in System 1, and multiple users may be able to use System 1.
[0023] The analysis device 10 reads the pages within the site to be analyzed, and using a virtual browser, sends an HTTP / HTTPS request (also simply called a request) to the analysis target server 30 that operates the site. FaithThis computer device analyzes the HTTP / HTTPS response (also simply called the response) to extract cookies or external communication URLs, retrieves data stored in the virtual browser's web storage, and registers these retrieved results as analysis items. The analysis items are available through the service identification device 50, which will be described later. The analysis device 10 has a central processing unit (CPU) and a communication device (neither of which are shown). The analysis device 10 may also be implemented using a cloud (multiple distributed servers or multiple subsystems, etc.). The CPU executes an analysis program to analyze one or more pages within the target site and activates the function of extracting cookies issued on each page, web storage set, and external communication URLs of external communications that occur. The functional configuration of the analysis device 10 will be described later. The analysis program is stored in ROM (not shown), for example, and read by the CPU, or stored in a storage medium such as a CD-ROM, and the CPU reads it using a reader (not shown) and expands it into RAM to start the program. The communication device is capable of communicating with the service identification device 50, the reference device 80, and various databases via wired or wireless communication through the network 99, and can communicate using protocols such as TCP / IP, for example.
[0024] A virtual browser is a browser that runs on one or more independent virtual machines, or on a container that shares the kernel of the host OS. All the functions of a commonly used browser are available in a virtual browser, and all the functions of a browser described herein also apply to virtual browsers.
[0025] Figure 2 shows the functional configuration of the analysis device 10. The analysis device 10 includes an analysis target acquisition unit 11, an analysis execution unit 12, and an analysis item registration unit 13.
[0026] The analysis target acquisition unit 11 is a functional unit that acquires the site URL of the site to be analyzed from the site database 20. However, the method by which the analysis target acquisition unit 11 acquires the site URL is not limited to this; for example, it may also be acquired by the operator of system 1 inputting the site URL via an input device (not shown).
[0027] The site database 20 is a storage device in which various information, such as the site URL of at least one site to be analyzed operated by the server to be analyzed 30, is registered (stored). The storage device may include a hard disk drive (HDD) or the like.
[0028] Figure 3 shows an example of site URL information (URL information) for sites to be analyzed, registered in the site database 20. In this example, three site URLs, such as XXX.com, are registered as sites to be analyzed. Here, a URL generally consists of a scheme, domain, path, parameters, and fragment. The format of site URLs to be registered in the site database 20 is not particularly limited; for example, the part of the URL after the path (path, parameters, and fragment) may be represented by a regular expression. This URL information may be registered by the operator of System 1 via an input device (not shown).
[0029] The analysis execution unit 12 is a functional unit that targets the target site (e.g., "XXX.com") obtained from the site database 20 by the analysis target acquisition unit 11, analyzes one or more pages within the site published on the site URL, and extracts cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur. The analysis execution unit 12 includes a site access unit 121, an analysis item extraction unit 122, a script execution unit 123, and a link extraction unit 124.
[0030] Here, a cookie is data stored by a browser, and there are two types: persistent cookies and session cookies. Persistent cookies are stored in the storage of the device on which the browser is running for a specified period even after the browser is closed, and are used to retain information such as the contents of the user's shopping cart and language settings. Session cookies are temporary cookies that exist only during the session period and are automatically deleted when the browser is closed, and are used to retain login information when the user moves between pages. Cookies are extracted by parsing the response header and retrieving the browser's cookie storage. Cookies have identifiers such as the userPref attribute and Name attribute such as the sessionId attribute, a Domain attribute that manages the domain where the cookie is valid, a Path attribute that manages the path where the cookie is valid, an Expires / Max-Age attribute that manages the expiration date (deletion time) of the cookie, a Secure attribute that manages whether or not it is sent only via HTTPS communication, an HttpOnly attribute that manages whether or not it is prevented from accessing via JavaScript (registered trademark), and a SameSite attribute that manages whether or not it is allowed to send cross-site requests.
[0031] Cookies without a specified domain attribute are only valid for the origin where they are set. The origin consists of the domain, protocol (such as HTTP or HTTPS), and port number. For example, a cookie set on sub.example.com without a specified domain attribute is only valid on sub.example.com and will not be valid on example.com or other subdomains.
[0032] Cookies with a specified domain attribute are valid for the specified domain and its subdomains. For example, a cookie with the domain attribute example.com is valid for example.com and its subdomains and will be sent for all requests under the specified domain.
[0033] Cookies that do not specify a domain attribute, or that specify the same domain as the website being accessed, are called first-party cookies, while cookies that specify a different domain (external domain) are called third-party cookies.
[0034] Web storage refers to APIs for saving data in a browser, and there are two types: Local Storage and Session Storage. Local Storage is an API for saving data until it is explicitly deleted within the browser. The data is stored in the browser's data storage area and can be retained even if the browser is closed. Data stored in Local Storage is shared within the same origin. Session Storage is an API for saving data within the browser only for the duration of a single session. The data is stored in the memory area allocated by the browser and is deleted when the browser tab is closed. Note that data stored in Web Storage is also simply referred to as Web Storage.
[0035] An external communication URL is a URL specified as the destination for communications occurring on a page, and it belongs to a different domain than the domain of this page.
[0036] The site access unit 121 is a functional unit that uses a virtual browser to specify the site URL (the URL of the site's top page) and sends a request to the analysis target server 30, which operates the site to be analyzed, and receives a response from the analysis target server 30. The site access unit 121 further determines whether there are any link URLs that have not yet been specified among the link URLs extracted by the link extraction unit 124. If there are any link URLs that have not yet been accessed, the site access unit 121 specifies these link URLs and sends a request to the analysis target server 30, and receives a response from the analysis target server 30. By the site access unit 121 specifying link URLs and sending requests to the analysis target server 30 and receiving responses from the analysis target server 30, all pages that can be accessed from the top page can be recursively analyzed.
[0037] The analysis item extraction unit 122 is a functional unit that extracts cookies issued by one or more pages or external communication URLs of external communications that occur from the response received by the site access unit 121, and further retrieves data stored in the web storage set in the virtual browser.
[0038] Figure 4 shows an example of data included in an HTTP response sent in response to a request sent to the server 30 being analyzed (for example, the site URL "XXX.com" registered in the site database 20 in Figure 3). An HTTP / HTTPS response consists of a response line (status line), a response header, and a response body. In this example, the response line contains information 35 about the HTTP protocol version and status code, indicating that the version is HTTP / 1.1 and the status code is 200, meaning the request was processed successfully. The response header contains the date and time the response was generated and the cookie settings 31, indicating that this response was generated at 10:18:14 on June 9, 2024, and that the set cookie is available under the example.com domain. The response body contains an HTML document with a script tag 33 embedded in it. The code in the script tag 33 sends JSON data to https: / / example.com / api and displays the response in the console.
[0039] The analysis item extraction unit 122 is a functional unit that extracts cookies and web storage stored in the virtual browser from the virtual browser, and extracts the external communication URL of external communications that occurred on the site from the virtual browser's communication log. The analysis item extraction unit 122 may also obtain this information from response data. In this case, for example, the analysis item extraction unit 122 extracts the cookie setting 31 "sessionId_app1=abc123; Domain=example.com;" from the response header of the data shown in Figure 4, and the external communication URL setting 32 "https: / / example.com / api" from the response body. Note that the method of extracting information contained in the virtual browser's cookies, web storage, communication log, or response is not particularly limited, and it is possible to extract the information by calling an API such as JavaScript®, Python, or Java® from an interface driver that operates the virtual browser.
[0040] The script execution unit 123 is a functional unit that executes a script using a virtual browser if the response sent by the server 30 to be analyzed contains a script. Scripts are generally written within HTML documents, and HTML documents are included in the response body of the HTTP response (see script tag 33 in Figure 3). The execution result of the script can be confirmed, for example, by logs output from the interface driver that operates the virtual browser. This allows for confirmation of the success or failure of the script execution.
[0041] The link extraction unit 124 is a functional unit that extracts the page URL of the linked page from the response sent by the server 30 to be analyzed. The page URL is written in the HTML document, and the HTML document is included in the response body of the HTTP response (see Figure 4). In this example, the link URL of the link to "page1.html" on the page is extracted by extracting the link tag 34 from the response body. This allows the site access unit 121 to access the linked page.
[0042] The analysis item registration unit 13 is a functional unit that, when the analysis item extraction unit 122 extracts cookies issued by pages or external communication URLs of external communications that occur from pages within the site to be analyzed, or when data is obtained from configured web storage, associates the site URL with the cookies issued by pages within the site, configured web storage, or external communication URLs of external communications that occur, and registers them in the analysis item database 40 so that they can be obtained by the service user identification device 50.
[0043] The analysis item database 40 is a storage device in which the analysis item registration unit 13 registers (stores) the correspondence between site URLs and cookies issued by pages within the site, set web storage, or external communication URLs originating from pages. The storage device may include a hard disk drive (HDD) or the like.
[0044] Figure 5 shows an example of analysis information that associates site URLs registered in the analysis item database 40 with cookies issued by pages within the site, web storage settings, or external communication URLs generated by those pages. The analysis item database 40 has three tables that associate site URLs with cookies, site URLs with web storage, and site URLs with external communication URLs. Note that the analysis information may be managed in a single table or by other methods.
[0045] The table above shows the cookie analysis information. The cookie analysis information includes columns for Site URL, Page URL of the page that issued the cookie, Name attribute of the cookie (cookie name) "Name", Domain attribute "Domain", and Control Type "Control Type". In this example, the page URL of the page on Site URL "XXX.com" is "XXX.com / ", the Name attribute of the cookie issued by this page is "sessionId_app1", the Domain attribute is "example.com" (see cookie settings 31 in Figure 4), and the Control Type of this cookie is "3 rd The "Party Cookie" is registered and associated with this entry. The table may also register other attributes that a cookie may have.
[0046] The table in the middle section shows the web storage analysis information. The web storage analysis information includes columns for Site URL, Page URL of the page where web storage is configured, Origin ("Origin"), and Storage Type ("Storage Type"). In this example, the page URL "XXX.com / XXX" of the page with Site URL "XXX.com" is associated with the web storage configured for that page, with Origin "https: / / example1.com" and Storage Type "local Storage". In addition to these, the table may also register other information that web storage can have, such as Key attributes.
[0047] The table below shows the analysis information for external communication URLs. The analysis information for external communication URLs includes a Site URL column, a Page URL column for pages with web storage configured, and an External URL column. In this example, the Page URL "XXX.com / YYY" of the page on Site URL "XXX.com" is registered in association with the external communication URL "http: / / anotherdomain1.com" of the external communication occurring on this page. Similarly, the Page URL "XXX.com / ZZZ" of the page on Site URL "XXX.com" is registered in association with the external communication URL "http: / / anotherdomain2.com" of the external communication occurring on this page.
[0048] According to the analysis device 10 of this embodiment, an analysis target acquisition unit 11 acquires the site URL of the site to be analyzed, an analysis execution unit 12 analyzes one or more pages within the site published by the site URL and extracts cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur, and an analysis item registration unit 13 associates the site URL with the cookies, web storage, or external communication URLs issued on the pages within the site and registers them so that they can be acquired by the service usage identification device described later. As a result, it is possible to extract cookies issued by one or more pages within the site published by the site URL, web storage set, or external communication URLs of external communications that occur, and to register this data for each site so that it can be acquired by the service usage identification device 50. Not only can the services used on the site to be analyzed be listed and registered, but it is also possible to analyze and examine whether cookies, web storage, or external transmissions are used to access the services used.
[0049] Figure 6 shows the flow of the analysis method performed by the analysis device 10.
[0050] In step S11, the analysis device 10 (analysis target acquisition unit 11) acquires the site URL of the site to be analyzed from the site database 20. There may be multiple sites to be analyzed. As mentioned above, the site database 20 has site URL information (URL information) of the sites to be analyzed registered in it. The URL information may also be acquired by the operator of system 1 via an input device (not shown).
[0051] In step S12, the analysis device 10 (analysis execution unit 12) analyzes the pages within the site published at the site URL and extracts all cookies issued by the pages, web storage settings, and external communication URLs for any external communications that occur. It also extracts all link URLs. First, the site access unit 121 uses a virtual browser to send a request to the analysis target server 30, which operates the analysis target site, specifying the site URL (the URL of the site's top page) or the page URL of the linked page extracted by the link extraction unit 124, and receives a response from the analysis target server 30. Next, the analysis item extraction unit 122 extracts cookies issued by one or more pages or external communication URLs for any external communications that occur from the response received by the site access unit 121, and also obtains data stored in the web storage set in the virtual browser. After that, the script execution unit 123 executes the script using the virtual browser if the response sent by the analysis target server 30 contains a script. Finally, the link extraction unit 124 extracts the page URL of the linked page from the response sent by the analysis target server 30.
[0052] This extracts, for example, cookies with the Name attribute "sessionId_app1" and Domain attribute "example.com" issued by a page with the URL "XXX.com / " on the site being analyzed (see Cookie Settings 31 in Figure 4). Details of the extraction are as described above.
[0053] In step S13, the analysis device 10 (site access unit 121) determines whether there are any link URLs among those extracted by the link extraction unit 124 that have not yet been specified. If there are any link URLs that have not yet been specified, the process returns to step S12; otherwise, the process proceeds to S14.
[0054] In step S14, the analysis device 10 (site access unit 121) determines whether there are any site URLs that have not yet been specified among the site URLs extracted by the analysis target acquisition unit 11. If there are site URLs that have not yet been specified, for example, if the analysis of XXX.com (see Figure 3) has been completed but the analysis of YYY.com and ZZZ.com (see Figure 3) has not yet been completed, the device returns to step S12. If there are no such sites (if the analysis of all analysis target sites has been completed), the device proceeds to step S15.
[0055] In step S15, the analysis device 10 (analysis item registration unit 13) associates the site URL with a cookie, web storage, or external communication URL and registers it in the analysis item database 40 (see Figure 5) so that it can be obtained by the service usage identification device 50 (obtainable by the service usage identification method described later). As a result, for example, the site URL "XXX.com / " is associated with the cookie (see cookie settings 31 in Figure 4) issued by a page on this site, with the Name attribute "sessionId_app1" and the domain attribute "example.com". In this way, all analysis information is accumulated in the analysis item database 40. Details of the accumulation of analysis information are as described above.
[0056] According to the analysis method of this embodiment, the analysis method is performed by a computer and comprises the steps of: obtaining the site URL of the site to be analyzed; analyzing one or more pages within the site published by the site URL and extracting cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur; and associating the site URL of the site to be analyzed with the cookies issued by the pages within the site to be analyzed, the web storage set, or external communication URLs that occur on the pages, and registering them so that they can be obtained by the service usage identification method described later. This makes it possible not only to list and register the services used by the site to be analyzed, but also to analyze and examine which means such as cookies and web storage are used to access the services.
[0057] The service identification device 50 is a computer device that identifies the services used by the site under analysis. The service identification device 50 has a CPU and a communication device (neither of which are shown in the diagram). The service identification device 50 may be implemented using a cloud (multiple distributed servers or multiple subsystems, etc.). The CPU performs the function of identifying the services used by the site under analysis by executing a service identification program. The functional configuration of the service identification device 50 will be described later. The service identification program is stored in ROM (not shown), for example, and read by the CPU, or stored in a storage medium such as a CD-ROM, and then read by the CPU using a reader (not shown) and loaded into RAM to be activated. The communication device is a device that can communicate with the analysis device 10, the reference device 80, and various databases via wired or wireless communication over the network 99, and can communicate using protocols such as TCP / IP as an example.
[0058] Figure 7 shows the functional configuration of the service utilization identification device 50. The service utilization identification device 50 includes an analysis item acquisition unit 51, a service utilization identification unit 52, and a service utilization registration unit 53.
[0059] The analysis item acquisition unit 51 is a functional unit that acquires analysis items (correspondence information registered in each of the one or more rows shown in Figure 5) from the analysis item database 40, which include the correspondence between the URL of a page on the site to be analyzed and a cookie issued by at least one page on the site to be analyzed, the web storage set, or the external communication URL that occurs on the page. The analysis item acquisition unit 51 acquires analysis items one by one from the analysis item database 40 and transmits them to the service identification unit 52. The analysis item acquisition unit 51 makes it possible to use analysis items that have been analyzed by a separate device (i.e., the analysis device 10) from the service identification device 50.
[0060] The Service Identification Unit 52 is a functional unit that matches cookies, web storage, or external communication URLs included in each analysis item obtained from the analysis item database 40 by the analysis item acquisition unit 51 with the service database 60, and identifies the matching data and corresponding services as services used on the site. The Service Identification Unit 52 includes an external communication URL matching unit 521, a cookie matching unit 522, and a web storage matching unit 523. Here, a service refers to an external service such as an advertising service or an access analysis service that is executed when a request is sent specifying an external communication URL.
[0061] The service database 60 is a storage device in which one or more service information entries are registered (stored), each of which is associated with a service, such as cookies, web storage, and external communication URLs. The storage device may include a hard disk drive (HDD). Associating each of the cookies, web storage, and external communication URLs with a service means associating each service with a service ID, name, etc., that can uniquely identify the service. Furthermore, a service is not limited to being represented by its name (referred to as the service name), but may also be represented by its ID. In this embodiment, as an example, a service is represented by its service name.
[0062] Figure 8A shows a partial example of service information registered in the service database 60. The service database 60 has three tables that associate service names with cookies, service names with web storage, and service names with external communication URLs.
[0063] The table in the upper section shows service information that associates cookies with services. This service information includes a Service Name column, a Name column for the cookie's Name attribute (cookie name), and a Domain attribute column. In this example, the service name "InsightPulse" is associated with a cookie whose Name attribute is "app1" and whose Domain attribute is "example.com". In addition to these, the table may also register other attributes that a cookie may have.
[0064] The middle table displays service information that associates web storage with a service. This service information includes a Service Name column and an Origin column for the web storage. In this example, the service name "MetricVision" is associated with the Web Storage Origin "https: / / example1.com" used by the service indicated by this service name. In addition to this, the table may also register other information that the web storage may have, such as Key attributes.
[0065] The table below shows service information that associates external communication URLs with services. This service information includes a Service Name column and an External URL column. In this example, the service name "AnalyticaFlow" is associated with the external communication URL "anotherdomain2.com" which is specified for accessing the service indicated by this service name.
[0066] In addition to service names, other service information may also be registered in the service database 60. Other service information may include, for example, the type of service such as advertising or access analysis, or the service provider of an external service.
[0067] The External Communication URL Matching Unit 521 is a functional unit that, when an analysis item obtained from the Analysis Item Database 40 includes an External Communication URL, extracts data that at least partially matches the External Communication URL and the corresponding service name from the Service Database 60, and obtains this service name as the service to be used. For example, the External Communication URL Matching Unit 521 obtains the data from the second row of the table below that has "anotherdomain2.com" in the ExternalURL column from the analysis information registered in the Analysis Item Database 40 (see Figure 5), performs a partial match search on the ExternalURL column of the service information below registered in the Service Database 60 using "anotherdomain2.com" as the key (see Figure 8A), and obtains the service name "AnalyticaFlow" from the first row of service information where the value of the ExternalURL column matches "anotherdomain2.com" as the service to be used.
[0068] The cookie matching unit 522 is a functional unit that, when an analysis item obtained from the analysis item database 40 includes a cookie, extracts services from the service database 60 that at least partially match the cookie in the Name attribute, and, if necessary, extracts data from the service database 60 that at least partially match the cookie in the Name attribute and completely match the domain attribute, and acquires this service as a service to be used. Here, "if necessary" means, for example, when the type of cookie is a third-party cookie. Furthermore, if there are multiple data in the cookie data of the analysis item that at least partially match in the Name attribute and completely match in the domain attribute, the cookie matching unit 522 acquires the most frequent service among the multiple services indicated by them as a service to be used.
[0069] Figure 8B shows a partial example of service information that associates cookies with services, registered in the service database 60. In this example, the cookie matching unit 522 extracts three cookies that specify InsightPulse and one cookie that specifies Service2, which exactly match the domain attribute example.com of the first row of the analysis item cookie obtained from the upper table of the analysis item database 40 (see Figure 5). Among these, InsightPulse is the service whose Name attribute matches the Name attribute portion app1 of the analysis item the most, so the cookie matching unit 522 obtains InsightPulse as the service being used. Cases in which cookies with matching domain attributes are distinguished by the Name attribute include, for example, InsightPulse managing the login status of the entire platform, and Service2 managing sub-services within the platform. The cookie matching unit 522 can identify the service being used even if there are multiple services that could be accessed by a given cookie.
[0070] The web storage matching unit 523 is a functional unit that, when web storage is included in the analysis items obtained from the analysis item database 40, extracts the service associated with the data where the web storage origin partially matches from the service database 60, and acquires this service as a service. For example, the web storage matching unit 523 obtains the first row of analysis items from the middle table of the analysis item database 40, extracts the data from the first row of the middle table of the service database 60 where the origin https: / / example1.com included in it partially matches (completely unique in this example), and acquires the corresponding service MetricVision as a service to be used.
[0071] The web storage matching unit 523 may extract services associated with data whose Origin attribute is an exact match. Alternatively, it may extract services associated with data whose Origin attribute is a partial or exact match, as well as whose Key attribute is a partial or exact match.
[0072] The Service Registration Unit 53 is a functional unit that, if the Service Identification Unit 52 can identify the service name, registers the site URL and the service used in the Service Database 70. The Service Registration Unit 53 also registers cookies, web storage, or external communication URLs for which the service name could not be identified as data not associated with a service (e.g., Unknown) in the Service Database 70. The Service Registration Unit 53 allows the identified service information to be stored for use by other devices. It can also detect cookies, etc., that are not associated with a service, i.e., cookies that are not functioning.
[0073] The service database 70 is a storage device that registers site URLs and the service names of the services used on those sites. It may include a hard disk drive (HDD) or similar device.
[0074] Figure 9 shows an example of service information registered in the service database 70 by the service registration unit 53. The service information is registered in a table format with a "UsingServiceName" column and a "Site URL" column. In this example, the aforementioned site URL "XXX.com" is associated with the service name "InsightPulse" which was identified as a service used on this site, the site URL "XXX.com" is associated with the service name "MetricVision" which was identified as a service used on this site, and the aforementioned site URL "XXX.com" is associated with the service name "AnalyticaFlow" which was identified as a service used on this site. Since the service corresponding to the external communication URL used by site URL "XXX.com" could not be identified, "Unknown," meaning that the service used is unknown, is associated with site URL "XXX.com" and registered.
[0075] According to the service identification device 50 of this embodiment, an analysis item acquisition unit 51 acquires analysis items including the correspondence between the page URL of at least one page within the site to be analyzed and the cookies issued on at least one page, the web storage set, or the external communication URL of the external communication that occurs; a service identification unit 52 matches the analysis items with a service database and identifies the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as service used at the site to be analyzed; and a service registration unit 53 registers the site URL and the service used in association. Thus, the device can acquire cookies, web storage, or external communication URLs for each site to be analyzed by the analysis device 10, identify the corresponding service used, and register the identified service used in the service database 70.
[0076] Figure 10 shows the flow of the service identification method performed by the service identification device 50.
[0077] In step S21, the service identification device 50 (analysis item acquisition unit 51) acquires all analysis information from the analysis item database 40 (see Figure 5) that has a correspondence between a cookie, web storage, or external communication URL and the site URL of the site to which the analysis item belongs.
[0078] In step S22, the service usage identification device 50 (service usage identification unit 52) matches the analysis items with the service database 60 (see Figures 8A and 8B) to identify the services corresponding to cookies, web storage, or external communication URLs included in the analysis items as services used on the site being analyzed. First, the external communication URL matching unit 521 extracts data from the service database 60 that at least partially matches the external communication URLs included in the analysis items obtained from the analysis item database 40, and the services that correspond to them. Next, the cookie matching unit 522 extracts data from the service database 60 that at least partially matches the Name attribute and completely matches the Domain attribute of the cookies included in each of the analysis items obtained from the analysis item database 40, and the services that correspond to them, and acquires these services as services used. Here, if there are multiple data in the cookie data of the analysis items that at least partially match the Name attribute and completely match the Domain attribute, the cookie matching unit 522 acquires the most frequent service among the multiple services indicated by them as the service used. Furthermore, the web storage matching unit 523 extracts services from the service database 60 that are associated with data where the Origin attribute of the web storage contained in each analysis item obtained from the analysis item database 40 partially matches, and acquires these services as services. Details are as described above. Thus, it is desirable to perform the matching with the service database 60 in the order of matching external communication URLs, matching cookies, and then matching web storage. The certainty of service identification is highest with matching external communication URLs, followed by cookies, and finally web storage, so efficient identification is possible by performing the matching in this order.
[0079] For example, for the analysis information in the second row of the lower table of the analysis item database 40 (see Figure 5) (URL column "XXX.com / ZZZ / ", ExternalURL column "anotherdomain2.com"), the service database 60 (see Figure 8A) is searched using the external URL "anotherdomain2.com" as the key, and the service name "AnalyticaFlow" is obtained as the service being used based on the information in the first row of the lower table. Similarly, for the analysis information in the first row of the upper table of the analysis item database 40 (see Figure 5) (URL column "XXX.com / ", COOKIE column "app1; domain=example.com"), the service database 60 (see Figure 8B) is searched, and three cookies specifying InsightPulse are extracted that exactly match the domain attribute example.com and partially match the attribute name app1 in the Name attribute, thereby obtaining InsightPulse as the service being used. Furthermore, the analysis item in the first row is obtained from the middle table of the analysis item database 40 (see Figure 5), and the data in the first row of the middle table of the service database 60 (Figure 8A) that partially matches (completely unique in this example) the Origin https: / / example1.com contained in this item is extracted, and the corresponding service MetricVision is obtained as the service used. Details of obtaining the service used are as described above.
[0080] In step S23, the service identification device 50 (service registration unit 53) registers service information, which associates the site URL with the service used, in the service database 70 (see Figure 9). As a result, for example, the site URL "XXX.com" is associated with the service name "InsightPulse" (see first line of Figure 9), the service name "AnalyticaFlow" (see fourth line of Figure 9), and the service name "MetricVision" (see second line of Figure 9). This allows for the accumulation of service information. Details of the accumulation of service information are as described above.
[0081] In step S24, the service identification device 50 (service registration unit 53) determines whether there is any unregistered analysis information. If there is, the process returns to step S21; otherwise, it terminates. This allows all analysis information to be registered.
[0082] According to the service identification method of this embodiment, the service identification method is executed by a computer and comprises the steps of: obtaining analysis items including the correspondence between a site URL within the site to be analyzed and a cookie, web storage, or external communication URL issued on at least one page within the site to be analyzed; matching the analysis items with a service database to identify the service name corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on the site to be analyzed; and registering the site URL and the service used in association. The service database contains data in which each of the cookies, web storage, and external communication URLs is paired with the service name. With this, it is possible to obtain cookies, web storage, or external communication URLs for each site analyzed by the analysis device 10, identify the corresponding service used, and register the identified service used in the service database 70.
[0083] The reference device 80 is a computer device that outputs services used on the target site, associating them with cookies, web storage, or external communication URLs for accessing those services. The reference device 80 includes a CPU and a communication device (neither of which are shown in the diagram). The reference device 80 may also be implemented using a cloud (multiple distributed servers or multiple subsystems, etc.). The CPU activates the function of outputting services used on the target site by executing a service reference program. The functional configuration of the reference device 80 will be described later. The service reference program is, for example, stored in ROM (not shown) and read by the CPU, or stored on a storage medium such as a CD-ROM and read by the CPU using a reader (not shown) and loaded into RAM to be activated. The communication device is a device that can communicate with the analysis device 10, the service identification device 50, and various databases via wired or wireless communication over the network 99, and can communicate using protocols such as TCP / IP as an example.
[0084] Figure 11 shows the functional configuration of the reference device 80. The reference device 80 includes a service reference unit 81 and an analysis item reference unit 82.
[0085] The service reference unit 81 is a functional unit that outputs the services used by the site to the user terminal 90. The output here may be in the form of output to the user terminal 90's display 91, in the form of transmission to the user terminal 90 as a file, or in any other form. In addition to the services used, the service reference unit 81 may also output cookies, web storage, or external communication URLs corresponding to the services used to the user terminal 90. The service reference unit 81 includes a service acquisition unit 811, a third analysis item acquisition unit 812, and a service output unit 813.
[0086] The service acquisition unit 811 is a functional unit that acquires service usage information from the service usage database 70, which has been registered by the service usage identification device 50 as a service used at the site to be analyzed. For example, if "XXX.com" is specified as the site to be analyzed, the service acquisition unit 811 acquires all rows from the service usage information registered in the service usage database 70 (see Figure 9) that contain "XXX.com" in the URL column.
[0087] The analysis item acquisition unit (an example of a third analysis item acquisition unit) 812 uses the name of the service used as the key to retrieve all the service information acquired by the service acquisition unit 811 from the service database 60. vinegar This is a functional unit that obtains the corresponding cookie, web storage, or external communication URL. For example, the analysis item acquisition unit 812 uses the service name "AnalyticaFlow" from the service database 60 shown in Figure 8A as a key to extract service information with a matching service name, and obtains the external communication URL "anotherdomain2.com" included in this service information.
[0088] The service usage output unit 813 is a functional unit that outputs the service usage acquired by the service usage acquisition unit 811 to the user terminal 90. The service usage output unit 813 further outputs cookies, web storage, or external communication URLs corresponding to the service usage acquired by the analysis item acquisition unit 812.
[0089] Figure 12 shows an example of the display screen of the display 91 showing cookies, web storage, or external communication URLs corresponding to the services used, acquired by the service acquisition unit 811. The screen has a target site display unit 911 and a service usage display unit 912. When a user specifies "XXX.com" as the target URL in the target site display unit 911, the reference device 80 displays the site URL "XXX.com" in the target site display unit 911 and also displays the service usage name used on "XXX.com" acquired by the service acquisition unit 811 from the service usage database 70, and the service usage name acquired by the analysis item acquisition unit 8212 from the service database 60 in the service usage display unit 912. vinegar The system displays the corresponding cookie, web storage, or external communication URL. For example, it will show that the InsightPulse service is used on the site "XXX.com", and that the cookie specifying InsightPulse has a Name attribute named "app1" and a Domain attribute value of example.com.
[0090] The analysis item reference unit 82 is a functional unit that outputs the site URL (which may also be the page URL of each page) and the corresponding cookie, web storage, or external communication URL to the user terminal 90. The output here may be in the format of output to the user terminal 90's display 91, sent to the user terminal 90 as a file, or in any other format. The analysis item reference unit 82 includes an analysis item acquisition unit 821 and an analysis item output unit 822.
[0091] The analysis item acquisition unit (an example of the second analysis item acquisition unit) 821 is a functional unit that refers to the analysis item database 40 and acquires the site URL (which may also be the page URL of each page) and the cookie, web storage, or external communication URL corresponding to the site URL. For example, the analysis item acquisition unit 821 acquires analysis information from the first row of the analysis item database 40 shown in Figure 5, where the page URL is "XXX.com", the Name attribute is app1, and the domain attribute is example.com.
[0092] The analysis item output unit 822 is a functional unit that outputs the site URL (which may also be the page URL of each page) acquired by the analysis item acquisition unit 821, along with the corresponding cookie, web storage, or external communication URL, to the user terminal 90.
[0093] Figure 13 shows an example of a display screen on the display 91 that shows the site URL (which may also be the page URL of each page) acquired by the analysis item acquisition unit 821, along with the corresponding cookie, web storage, or external communication URL. The screen has a target site display unit 913 and an analysis item display unit 914. When a user specifies "XXX.com" as the target URL in the target site display unit 913, the reference device 80 displays the site URL "XXX.com" in the target site display unit 913 and also displays the cookie, web storage, or external communication URL acquired by the analysis item acquisition unit 821 from the analysis item database 40 in correspondence with the page URL "XXX.com" in the analysis item display unit 914. As a result, for example, it will be displayed that a cookie with the Name attribute name app1 and the domain attribute example.com has been issued for the top page "XXX.com" on the site "XXX.com".
[0094] According to the reference device 80 of this embodiment, the reference device 81 has a service reference unit 811 which acquires service usage registered by the service usage identification device 50 as a service used on the site to be analyzed, an analysis item acquisition unit 812 which acquires cookies, web storage, or external communication URLs associated with the service usage by referring to the service database 60, and a service output unit 813 which outputs the service usage and cookies, web storage, or external communication URLs to the user terminal 90, and an analysis item acquisition unit 8 which acquires analysis items including the correspondence between the site URL of the site to be analyzed and the corresponding cookies, web storage, or external communication URLs 21 The system includes an analysis item reference unit 82 which has an analysis item output unit 822 that outputs the site URL included in the analysis items and the corresponding cookie, web storage, or external communication URL to the user terminal 90. This allows the system to output the services used on the target site in association with the cookie, web storage, or external communication URL used to access the services. Not only can the services used be listed, but the correspondence between the services used and the analysis items can also be provided to the user.
[0095] Figure 14A shows the flow of the service referencing method performed by the reference device 80.
[0096] In step S31, the user specifies the target site they wish to access. In this example, the user specifies the target site from an input screen output by the reference device 80 to the display 91 of the user terminal 90. Figure 14B shows the target input screen on which the user specifies the target site. The analysis target input screen has an input form 915 and displays all rows of data from the site database 20 in a pull-down format for the user to select.
[0097] In step S32, the reference device 80 (the service acquisition unit 811 of the service reference unit 81) acquires all of the service services registered by the service identification method (see Figure 13) as services used at the analysis target site specified by the user in step S31 from the service database 70 (see Figure 9).
[0098] In step S33, the reference device 80 (the analysis item acquisition unit (an example of the third analysis item acquisition unit) 812 of the service reference unit 81) refers to the service database 60 (see Figure 8B) and obtains cookies, web storage, or external communication URLs using the service name as the key. For example, it obtains a cookie with the Name attribute name "app1" and the domain attribute value "example.com" corresponding to the service name "InsightPulse". Details of obtaining cookies, etc., are as described above.
[0099] In step S34, the reference device 80 (the service output unit 813 of the service reference unit 81) outputs the service used, along with a cookie, web storage, or external communication URL, to the display of the user terminal 90 (see Figure 12). For example, the service name "InsightPulse" and the cookie corresponding to this service, with the Name attribute name "app1" and the domain attribute value "example.com", are output on a single line (see Figure 12).
[0100] The service reference method according to this embodiment is a method executed by a computer and includes the steps of: obtaining a service used by the aforementioned service identification method as a service used at the site to be analyzed; obtaining a cookie, web storage, or external communication URL associated with the service by referring to a service database; and outputting the service used and the cookie, web storage, or external communication URL. This makes it possible to output the services used at the target site in association with the cookie, web storage, or external communication URL for accessing the service. In addition to listing the services used within the site, it becomes possible to provide users with a list of services used and analysis items linked together.
[0101] Figure 15 shows the flow of the analysis information referencing method performed by the reference device 80.
[0102] In step S41, the user specifies the site to be analyzed that they wish to refer to. In this example, the user specifies the site to be analyzed from an input screen output by the reference device 80 to the display 91 of the user terminal 90. The analysis target input screen has an input form 915 and displays all rows of data from the site database 20 in a pull-down format (see Figure 14B).
[0103] In step S42, the reference device 80 (analysis item acquisition unit 821 of the service reference unit 81) acquires all analysis items registered by the analysis method (see Figure 6) as services used at the site to be analyzed from the analysis item database 40 (see Figure 5). For example, the analysis item acquisition unit 821 acquires analysis information from the first row of the upper table of the analysis item database 40 shown in Figure 5, where the site URL is "XXX.com", the Name attribute is app1, and the domain attribute is example.com.
[0104] In step S43, the reference device 80 (analysis item output unit 822 of the service reference unit 81) outputs all analysis information, which associates the site URL acquired by the analysis item acquisition unit 821 with cookies, web storage, or external communication URLs within the site, to the display of the user terminal 90 (see Figure 13). For example, the page URL "XXX.com" and the cookie issued on this page with the Name attribute name "app1" and domain attribute value "example.com" are output on a single line.
[0105] The analysis item referencing method according to this embodiment is a method executed by a computer and includes the steps of: acquiring analysis items registered by the aforementioned analysis method as analysis information of pages within the site to be analyzed; and outputting all acquired analysis information to the user terminal 90. This makes it possible to output the analysis items of the target site. It becomes possible to provide the user with a list of what analysis items the target site has.
[0106] The service identification system 1 according to this embodiment comprises an analysis device 10, a service identification device 50, a reference device 80, and a service database 60 in which data is registered, with cookies, web storage, and external communication URLs each associated with a service name. With this, the analysis device 10 extracts analysis items, the service identification device 50 matches these analysis items with the service database 60 to identify the services used on the site, and the reference device 80 provides information on these services to the user.
[0107] Furthermore, according to the service identification system 1 of this embodiment, the system includes: an analysis device 10 that obtains the site URL of a site to be analyzed, analyzes one or more pages within the site published at the site URL, extracts cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur, and registers the site URL of the page that issues cookies, sets web storage, or generates an external communication URL in association with the cookies issued by that page, web storage set, or external communication URL that occurs; a service identification device 50 that matches the analysis items, including the correspondence between the site URL and the cookies, web storage, or external communication URL registered by the analysis device 10, with the service database 60, identifies the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as service used on the page at the site URL, and registers the site URL and the service used in association; and a service database 60 in which data is registered that each of the cookies, web storage, and external communication URLs is associated with a service. This makes it possible to manage external services used by the site in association with cookies, etc., issued to access these external services.
[0108] Furthermore, the service identification system 1 according to this embodiment includes an analysis item database 40 in which the correspondence between site URLs and cookies, web storage, or external communication URLs is registered by an analysis device, and an analysis item database 40 in which analysis items including the correspondence are acquired by the analysis device 10.
[0109] Furthermore, the service usage identification system 1 according to this embodiment further includes a reference device 80 that acquires service usage registered by the service usage identification device 50 as a service used at the site to be analyzed, and outputs the service usage.
[0110] Furthermore, the service identification system 1 according to this embodiment further comprises a service identification device 50 that registers site URLs and services in association with each other, and a service identification device 80 that retrieves services from the service identification system 70.
[0111] Furthermore, the service identification system 1 according to this embodiment further comprises a site database 20 in which the site URL of at least one site to be analyzed is registered, and the site URL is obtained by the analysis device 10.
[0112] Furthermore, according to the service identification method of this embodiment, the method includes the steps of: obtaining the site URL of the site to be analyzed; analyzing one or more pages within the site published at the site URL to extract cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur; registering the site URL of the page that issues cookies, sets web storage, or generates an external communication URL in association with the cookies issued, web storage set, or external communication URL generated by that page; and matching the analysis items, including the correspondence between the site URL and cookies, web storage, or external communication URLs registered in the registration step, with the service database 60 to identify the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as services used on the pages at the site URL, and registering the site URL and the services used in association. The service database 60 contains data in which each of the cookies, web storage, and external communication URLs is associated with a service. This makes it possible to manage external services used by the site in association with cookies, etc., issued to access these external services.
[0113] Furthermore, according to the program of this embodiment, the following steps are performed on one or more computers: obtaining the site URL of the site to be analyzed, analyzing one or more pages within the site published at the site URL, extracting cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur, registering the site URL of the page that issues cookies, sets web storage, or generates an external communication URL in association with the cookies issued, web storage set, or external communication URL generated by that page, and matching the analysis items, including the correspondence between the site URL and cookies, web storage, or external communication URLs registered in the registration step, with the service database 60, identifying the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as services used on the pages at the site URL, and registering the site URL and the services used in association. The service database 60 contains data in which each of the cookies, web storage, and external communication URLs is associated with a service. This makes it possible to manage external services used by the site in association with cookies, etc., issued to access these external services.
[0114] Various embodiments of the present invention may be described with reference to flowcharts and block diagrams, where a block may represent (1) a stage in a process in which an operation is performed or (2) a section of a device having the role of performing the operation. Specific stages and sections may be implemented by dedicated circuits, programmable circuits supplied with computer-readable instructions stored on a computer-readable medium, and / or processors supplied with computer-readable instructions stored on a computer-readable medium. Dedicated circuits may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. Programmable circuits may include reconfigurable hardware circuits, including logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logic operations, flip-flops, registers, memory elements such as field-programmable gate arrays (FPGAs), programmable logic arrays (PLAs), etc.
[0115] Computer-readable media may include any tangible device capable of storing instructions to be executed by a suitable device, and as a result, computer-readable media having instructions stored therein will comprise a product containing instructions that can be executed to create means for performing operations specified in a flowchart or block diagram. Examples of computer-readable media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disk read-only memory (CD-ROM), digital multipurpose disc (DVD), Blu-ray® disc, memory stick, integrated circuit card, etc.
[0116] Computer-readable instructions may include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk®, Java®, C++, and traditional procedural programming languages such as the C programming language or similar programming languages.
[0117] Computer-readable instructions are provided locally or via a wide area network (WAN) such as a local area network (LAN) or the internet to the processor or programmable circuit of a programmable data processing device such as a computer, and may be executed to create means for performing operations specified in a flowchart or block diagram. Here, the computer may be a PC (personal computer), tablet computer, smartphone, workstation, server computer, general-purpose computer, or special-purpose computer, and may also be a computer system in which multiple computers are connected. Such a computer system in which multiple computers are connected is also called a distributed computing system and is a computer in a broad sense. In a distributed computing system, multiple computers execute a program collectively by each computer executing a part of the program and passing data during program execution between computers as needed.
[0118] Examples of processors include computer processors, central processing units (CPUs), processing units, microprocessors, digital signal processors, controllers, and microcontrollers. A computer may have one or more processors. In a multiprocessor system with multiple processors, each processor executes a portion of the program, and the processors collectively execute the program by passing program execution data between them as needed. For example, in the execution of multitasking, each of the multiple processors may execute a portion of each task in small chunks by switching tasks at each time slice. In this case, which part of a program each processor executes changes dynamically. Which part of a program each of the multiple processors executes may also be statically determined by multiprocessor-aware programming.
[0119] Figure 16 shows an example of a computer 1200 in which multiple aspects of the present invention may be embodied in whole or in part. A program installed on the computer 1200 can cause the computer 1200 to function as an operation or one or more sections of an apparatus according to an embodiment of the present invention, or to execute such operation or one or more sections, and / or to cause the computer 1200 to execute a process or a stage of such process according to an embodiment of the present invention. Such a program may be executed by the CPU 1212 to cause the computer 1200 to perform a particular operation associated with some or all of the blocks in the flowcharts and block diagrams described herein.
[0120] The computer 1200 according to this embodiment includes a CPU 1212, RAM 1214, a graphics controller 1216, and a display device 1218, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224 such as a hard disk drive, a DVD-ROM drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The computer also includes legacy input / output units such as a ROM 1230 and a keyboard 1242, which are connected to the input / output controller 1220 via an input / output chip 1240.
[0121] The CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires image data generated by the CPU 1212 from a frame buffer provided in RAM 1214 or from itself, and displays the image data on the display device 1218.
[0122] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD-ROM drive 1226 reads programs or data from the DVD-ROM 1227 and provides them to the storage device 1224 via the RAM 1214. The IC card drive reads programs and data from the IC card and / or writes programs and data to the IC card.
[0123] The ROM 1230 stores boot programs and / or programs that depend on the computer 1200's hardware, which are executed by the computer 1200 when activated. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via a parallel port, serial port, keyboard port, mouse port, etc.
[0124] The program is provided on a computer-readable medium such as a DVD-ROM 1227 or an IC card. The program is read from the computer-readable medium and installed on a storage device 1224, RAM 1214, or ROM 1230, which are also examples of computer-readable medium, and executed by the CPU 1212. The information processing described within these programs is read by the computer 1200, resulting in coordination between the program and the various types of hardware resources described above. The apparatus or method may be configured to realize the manipulation or processing of information in accordance with the use of the computer 1200.
[0125] For example, when communication is performed between a computer 1200 and an external device, the CPU 1212 may execute a communication program loaded into RAM 1214 and, based on the processing described in the communication program, instruct the communication interface 1222 to perform communication processing. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer processing area provided in a recording medium such as RAM 1214, storage device 1224, DVD-ROM 1227, or IC card, transmits the read transmission data to the network, or writes received data received from the network to a receive buffer processing area provided on the recording medium.
[0126] Furthermore, the CPU 1212 may read all or necessary parts of a file or database stored on an external storage medium such as the memory device 1224, DVD-ROM drive 1226 (DVD-ROM 1227), or IC card into the RAM 1214, and perform various types of processing on the data in the RAM 1214. The CPU 1212 then writes the processed data back to the external storage medium.
[0127] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and subjected to information processing. The CPU 1212 may perform various types of processing on the data read from RAM 1214, including various types of operations, information processing, conditional judgments, conditional branching, unconditional branching, information retrieval / replacement, etc., as described throughout this disclosure and specified by the program instruction sequence, and write the results back to RAM 1214. The CPU 1212 may also retrieve information in files, databases, etc., within the recording medium. For example, if multiple entries are stored in the recording medium, each having an attribute value of a first attribute associated with an attribute value of a second attribute, the CPU 1212 may search among the multiple entries for an entry that matches the condition for which the attribute value of the first attribute is specified, read the attribute value of the second attribute stored in that entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.
[0128] The programs or software modules described above may be stored on or near computer 1200 on a computer-readable medium. Alternatively, recording media such as hard disks or RAM provided within a server system connected to a dedicated communication network or the Internet can be used as computer-readable media, thereby providing programs to computer 1200 via the network.
[0129] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications or improvements can be made to the above embodiments. It will be clear from the claims that such modified or improved forms may also be included in the technical scope of the present invention.
[0130] It should be noted that the execution order of operations, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not explicitly stated as "before," "prior to," etc., and that these can be performed in any order unless the output of a previous process is used in a later process. Even if the operation flow in the claims, specifications, and drawings is described using phrases such as "first," "next," etc. for convenience, this does not mean that it is mandatory to perform the operations in that order.
[0131] According to this specification, the configurations described in the following sections are also disclosed. (Item 1) An analysis item acquisition unit acquires analysis items that include the correspondence between the site URL of the site to be analyzed and cookies issued on at least one page within the site to be analyzed, web storage set, or external communication URLs of external communications that occur. A service identification unit that matches the analysis items with a service database and identifies the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page. It includes a service registration unit that registers the aforementioned site URL and the aforementioned service being used in association, The aforementioned service database contains data in which cookies, web storage, and external communication URLs are associated with services. A device for identifying the services being used. (Item 2) The aforementioned analysis item acquisition unit acquires the analysis items from the analysis item database, The aforementioned analysis item database contains registered correspondences between the site URL and the cookie, the web storage, or the external communication URL, as described in Item 1, for the service identification device. (Item 3) The service registration unit registers the site URL, the cookie, the web storage, or the external communication URL as not being associated with a service, as described in item 1, if the service identification unit is unable to identify the service. (Item 4) The aforementioned service specification unit is: An external communication URL matching unit extracts data from the service database that at least partially matches the external communication URL included in the analysis item and the corresponding service, and acquires the service as a service. A cookie matching unit extracts data from the service database that at least partially matches the Name attribute of the cookie included in the analysis item and the service that corresponds to it, and acquires the service as a service. A web storage matching unit extracts data from the service database that partially matches the origin of the web storage included in the analysis item and the corresponding service, and acquires the service as a service. A service identification device according to item 1, having at least one of the following: (Item 5) The cookie matching unit, when it finds multiple data that at least partially match the cookie in the Name attribute, acquires the service that appears most frequently among the multiple services indicated by the multiple data as the service being used, as described in item 4. (Item 6) The service registration unit is a service identification device as described in item 1, which associates the site URL with the service used and registers them in the service database. (Item 7) The analysis target acquisition unit obtains the site URL of the site to be analyzed, An analysis execution unit analyzes one or more pages within the site published at the aforementioned site URL and extracts cookies issued by the said one or more pages, web storage set, or external communication URLs of external communications that occur. An analysis item registration unit that associates the site URL of the page from which the cookie, web storage, or external communication URL is extracted with the cookie, web storage, or external communication URL extracted from the page, and registers them in a manner that can be acquired by the service identification device described in item 1, An analytical device equipped with the following features. (Item 8) The aforementioned analysis execution unit, A site access unit that uses a virtual browser to specify the site URL and sends a request to the server operating the site to be analyzed, and receives a response from the server, An analysis item extraction unit extracts cookies issued by the one or more pages or external communication URLs of external communications that occur from the response, and further retrieves data stored in the web storage of the virtual browser. The analysis device according to item 7, further comprising: a script execution unit that, if the response contains a script, executes the script via the virtual browser to access the service. (Item 9) The system further includes a link extraction unit that extracts the page URL of the linked page from the aforementioned response. The analysis device described in item 8 further includes a site access unit that specifies the page URL of the linked page and sends a request to the server operating the site to be analyzed, and receives a response from the server. (Item 10) The analysis device described in item 8, wherein the analysis item registration unit registers the correspondence between the site URL and the cookie, the web storage, or the external communication URL in the analysis item database. (Item 11) The service acquisition unit acquires the aforementioned service registered by the service identification device described in item 1 as a service used at the site to be analyzed, The system includes a service reference unit having a service output unit that outputs the aforementioned service, Reference device. (Item 12) The aforementioned service acquisition unit acquires the aforementioned service from the service database, The aforementioned service database is a reference device described in item 11, in which the site URL and the service used are registered in association with each other by the service identification device. (Item 13) A second analysis item acquisition unit acquires analysis items including the correspondence between the site URL of the site to be analyzed and the cookies, web storage, or external communication URL associated with the site URL, An analysis item output unit that outputs the site URL included in the analysis item and the cookie, web storage, or external communication URL corresponding to the site URL, The reference device according to item 12, further comprising an analysis item reference unit having the following: (Item 14) The aforementioned second analysis item acquisition unit acquires the analysis items from the analysis item database, The aforementioned analysis item database is a reference device as described in item 13, in which the correspondence between the site URL and the cookie, the web storage, or the external communication URL is registered. (Item 15) A method for identifying services used by a computer, The steps include obtaining analysis items that include the correspondence between the site URL of the site to be analyzed and cookies issued on at least one page within the site to be analyzed, web storage set, or external communication URLs of external communications that occur, The steps include: comparing the analysis items with the service database to identify the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page; The system includes a step of registering the aforementioned site URL and the aforementioned service to be used, The aforementioned service database contains data in which cookies, web storage, and external communication URLs are associated with services. Method for identifying the services used. (Item 16) A computer-based analysis method, The first step is to obtain the site URL of the site to be analyzed, The steps include: analyzing one or more pages within the site published at the aforementioned site URL to extract cookies issued by the said one or more pages, web storage set, or external communication URLs of external communications that occur; The process includes the step of associating the site URL of the page on which the cookie is issued, the web storage is set, or the external communication URL is generated with the cookie issued on the page, the web storage that is set, or the external communication URL that is generated, and registering them in a way that can be obtained using the service identification method described in item 15. Analysis method. (Item 17) A method for referencing user services performed by a computer, The steps include obtaining the services used by the service identification method described in item 15 as services used on the site to be analyzed, The step of outputting the aforementioned service, A method for referencing services that have the following characteristics. (Item 18) A procedure for obtaining analysis items that include the correspondence between the site URL of the site to be analyzed and cookies issued on at least one page within the site to be analyzed, web storage set, or external communication URLs of external communications that occur, A procedure for matching the aforementioned analysis items with a service database to identify the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page, The computer is instructed to execute a service registration procedure that associates the aforementioned site URL with the aforementioned service, The aforementioned service database contains data in which cookies, web storage, and external communication URLs are associated with services. A program for identifying the services to be used. (Item 19) The procedure for obtaining the site URL of the site to be analyzed, A procedure for analyzing one or more pages within a site published at the aforementioned site URL and extracting cookies issued by the said one or more pages, web storage set, or external communication URLs of external communications that occur, A procedure for registering the site URL of a page on which the aforementioned cookie is issued, the aforementioned web storage is set, or the aforementioned external communication URL is generated, in association with the aforementioned cookie issued on the aforementioned page, the aforementioned web storage that is set, or the aforementioned external communication URL that is generated, so that it can be retrieved by the second computer when the service identification program described in item 18 is executed on the second computer, An analysis program that causes a computer to execute a command. (Item 20) The procedure for obtaining the registered services used at the site to be analyzed is to have the third computer execute the service identification program described in item 18, and The procedure for outputting the aforementioned service used, A reference program for using services to run on a computer. (Item 21) The service identification device described in item 1, The analysis device described in item 7, The reference device described in item 11, A service database in which data is registered that associates cookies, web storage, and external communication URLs with services, A service identification system equipped with the necessary features. (Item 22) An analysis device that obtains the site URL of a site to be analyzed, analyzes one or more pages within the site published at the said site URL, extracts cookies issued by the said one or more pages, sets web storage, or generates external communication URLs, and registers the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the said page, the web storage that is set, or the generated external communication URL. A service identification device that matches analysis items, including the correspondence between the site URL and the cookie, web storage, or external communication URL registered by the analysis device, with a service database, identifies the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on a page on the site URL, and registers the site URL and the service used in association. The service database contains data in which cookies, web storage, and external communication URLs are each associated with a service, A service identification system equipped with the necessary features. (Item 23) The service identification system described in item 22 further comprises an analysis item database in which the correspondence between the site URL and the cookie, the web storage, or the external communication URL is registered by the analysis device, and an analysis item database in which the analysis device acquires analysis items including the correspondence. (Item 24) The service identification system described in item 22, further comprising a reference device that acquires the service used as registered by the service used identification device and outputs the service used as a service used at the site to be analyzed. (Item 25) The service identification system described in item 24, further comprising a service identification device that registers the site URL and the service being used in association with each other, and a service identification device that retrieves the service being used from the service being used. (Item 26) A service identification system as described in item 22, further comprising a site database in which the site URL of at least one site to be analyzed is registered, and the site URL is obtained by the analysis device from the site database. (Item 27) The process involves obtaining the site URL of the site to be analyzed, analyzing one or more pages within the site published at the said site URL, extracting cookies issued by the said one or more pages, web storage set, or external communication URLs of external communications that occur, registering the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the said page, the web storage set, or the generated external communication URL, and The system includes a step of matching the analysis items, which include the correspondence between the registered site URL and the cookies, web storage, or external communication URL, with a service database, identifying the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as services used on the page on the site URL, and registering the site URL and the services used in association. The service database in question is a method for identifying the service being used, in which data is registered that is associated with each of the following services: cookies, web storage, and external communication URLs. (Item 28) A procedure for obtaining the site URL of a site to be analyzed, analyzing one or more pages within the site published at the said site URL, extracting cookies issued by the said one or more pages, web storage set, or external communication URLs of external communications that occur, registering the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the said page, the web storage set, or the generated external communication URL, and The procedure involves matching the analysis items, including the correspondence between the site URL registered by the registration procedure and the cookies, web storage, or external communication URL, with the service database, identifying the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as services used on the page on the site URL, and registering the site URL and the services used in association, and having one or more computers perform this procedure. The aforementioned service database contains data in which cookies, web storage, and external communication URLs are associated with services. A program for identifying the services to be used. [Explanation of symbols]
[0132] 1...System (Service Identification System), 10...Analysis Device, 11...Analysis Target Acquisition Unit, 12...Analysis Execution Unit, 13...Analysis Item Registration Unit, 20...Site Database, 30...Analysis Target Server, 31...Cookie Settings, 32...External Communication URL Settings, 33...Script Tag, 34...Link Tag, 35...Status Code Information, 40...Analysis Item Database, 50...Service Identification Device, 51...Analysis Item Acquisition Unit, 52...Service Identification Unit, 53...Service Registration Unit, 60...Service Database, 70...Service Database, 80...Reference Device, 81...Service Reference Unit, 82...Analysis Item Reference Unit, 90...User Terminal, 91...Display, 99...Network, 121...Site Access Unit, 122...Analysis Item Extraction Unit, 123...Script Execution Unit, 124...Link Extraction Unit, 521 …External communication URL matching unit, 522…Cookie matching unit, 523…Web storage matching unit, 811…Service acquisition unit, 812…Analysis item acquisition unit (third analysis item acquisition unit), 813…Service output unit, 821…Analysis item acquisition unit (second analysis item acquisition unit), 822…Analysis item output unit, 911…Target site display unit, 912…Service display unit, 913…Target site display unit, 914…Analysis item display unit, 915…Input form, 1200…Computer, 1210…Host controller, 1212…CPU, 1214…RAM, 1216…Graphics controller, 1218…Display device, 1220…Input / output controller, 1222…Communication interface, 1224…Storage device, 1226…DVD-ROM drive, 1240…Input / output chip, 1242…Keyboard.
Claims
1. An analysis item acquisition unit acquires analysis items that include the correspondence between the URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed. A service identification unit that matches the analysis items with a service database and identifies the service corresponding to the cookie included in the analysis items as a service used on at least one page, It includes a service registration unit that registers the aforementioned site URL and the aforementioned service being used in association, The aforementioned service database contains data in which cookies are associated with services. The aforementioned service specification unit is: The cookie matching unit extracts data from the service database that at least partially matches the Name attribute of the cookie included in the analysis item and the service corresponding to that data, and acquires the service as a service. The cookie matching unit, if it finds multiple data points that at least partially match the cookie in the Name attribute, retrieves the service that appears most frequently among the multiple services indicated by those data points as the service being used. A device for identifying the services being used.
2. The aforementioned analysis items further include the correspondence between the site URL of the site to be analyzed and the web storage set on at least one page within the site to be analyzed, or the external communication URL of the external communication that occurs. The aforementioned service identification unit further identifies the service corresponding to the web storage or the external communication URL as a service used on at least one page. The service identification device according to claim 1, wherein the service database further registers data in which the web storage and the external communication URL are associated with services.
3. The service registration unit registers the site URL, the cookie, the web storage, or the external communication URL as unassociated with a service if the service identification unit fails to identify the service, as described in claim 2.
4. The analysis item acquisition unit acquires the analysis items from the analysis item database, The service identification device according to claim 2, wherein the analysis item database contains registered correspondences between the site URL and the cookie, the web storage, or the external communication URL.
5. The aforementioned service specification unit is: An external communication URL matching unit extracts data from the service database that at least partially matches the external communication URL included in the analysis item and the corresponding service, and acquires the service as a service. A web storage matching unit extracts data from the service database that partially matches the origin of the web storage included in the analysis item and the corresponding service, and acquires the service as a service. The service identification device according to claim 2, further comprising at least one of the following.
6. The service registration unit registers the site URL and the service in a service database, as described in claim 1.
7. The analysis target acquisition unit acquires the site URL of the site to be analyzed, An analysis execution unit analyzes one or more pages within the site published at the aforementioned site URL and extracts cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur. An analysis item registration unit that associates the site URL of the page from which the cookie, web storage, or external communication URL is extracted with the cookie, web storage, or external communication URL extracted from the page, and registers them in a manner that can be acquired by the service identification device described in claim 2, An analytical device equipped with the following features.
8. The aforementioned analysis execution unit, A site access unit that uses a virtual browser to specify the site URL and sends a request to the server operating the site to be analyzed, and receives a response from the server, An analysis item extraction unit extracts cookies issued by the one or more pages or external communication URLs of external communications generated from the response, and further retrieves data stored in the web storage of the virtual browser. The analysis apparatus according to claim 7, further comprising: a script execution unit that, if the response includes a script, executes the script using the virtual browser to access the service.
9. The system further includes a link extraction unit that extracts the page URL of the linked page from the response, The analysis apparatus according to claim 8, wherein the site access unit further specifies the page URL of the linked page and sends a request to the server operating the site to be analyzed, and receives a response from the server.
10. The analysis device according to claim 8, wherein the analysis item registration unit registers the correspondence between the site URL and the cookie, the web storage, or the external communication URL in the analysis item database.
11. A service acquisition unit that acquires the service used by the service identification device described in claim 2 as a service used at the site to be analyzed, The system includes a service reference unit having a service output unit that outputs the aforementioned service, Reference device.
12. The aforementioned service acquisition unit acquires the aforementioned service from the service database, The reference device according to claim 11, wherein the service database is registered by associating the site URL with the service used using the service identification device.
13. A second analysis item acquisition unit acquires analysis items including the correspondence between the site URL of the site to be analyzed and the cookies, web storage, or external communication URL associated with the site URL, An analysis item output unit that outputs the site URL included in the analysis item and the cookie, web storage, or external communication URL corresponding to the site URL, The reference device according to claim 12, further comprising an analysis item reference unit having the following:
14. The aforementioned second analysis item acquisition unit acquires the analysis items from the analysis item database, The reference device according to claim 13, wherein the analysis item database contains registered correspondences between the site URL and the cookie, the web storage, or the external communication URL.
15. A method for identifying services used by a computer, The steps include obtaining analysis items that include the correspondence between the URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed, The steps include: comparing the analysis items with the service database to identify the service corresponding to the cookie included in the analysis items as a service used on at least one page; The process includes a step of registering the aforementioned site URL and the aforementioned service to be used, The aforementioned service database contains data in which cookies are associated with services. The step of identifying the aforementioned service to be used is The process includes extracting data from the service database that at least partially matches the Name attribute of the cookie included in the analysis item and the service corresponding to that data, and acquiring the service as a service. The stage in which a service is acquired is such that, if there are multiple data points in the Name attribute that at least partially match the aforementioned cookie, the service that appears most frequently among the multiple services indicated by those multiple data points is acquired as the service being acquired. Method for identifying the services used.
16. A computer-based analysis method, The first step is to obtain the URL of the site to be analyzed, The steps include: analyzing one or more pages within the site published at the aforementioned site URL to extract cookies issued by the said one or more pages, web storage set, or external communication URLs of external communications that occur; The method for identifying a service used according to claim 15 includes the step of associating the site URL of the page on which the cookie is issued, the web storage is set, or the external communication URL is generated with the cookie issued on the page, the web storage that is set, or the external communication URL that is generated, and registering them in a manner that can be acquired by the service used method described in claim 15. Analysis method.
17. A method for referencing user services performed by a computer, The steps include: acquiring the service used by the service identification method described in claim 15 as a service used at the site to be analyzed; The step of outputting the aforementioned service, A method for referencing services that have the following characteristics.
18. A procedure for obtaining analysis items that include the correspondence between the URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed, A procedure for matching the aforementioned analysis items with a service database to identify the service corresponding to the cookie included in the analysis items as a service used on at least one page, The computer is instructed to execute a service registration procedure that associates the aforementioned site URL with the aforementioned service, The aforementioned service database contains data in which cookies are associated with services. The procedure for identifying the aforementioned service is as follows: The procedure includes extracting data from the service database that at least partially matches the Name attribute of the cookie included in the analysis item and the service corresponding to that data, and acquiring the service as a service, The procedure for obtaining the aforementioned service is as follows: If there are multiple data points in the Name attribute that at least partially match the aforementioned cookie, the service that appears most frequently among the multiple services indicated by those multiple data points is obtained as the service used. A program for identifying the services to be used.
19. The procedure for obtaining the site URL of the site to be analyzed, A procedure for analyzing one or more pages within a site published at the aforementioned site URL and extracting cookies issued by the said one or more pages, web storage set, or external communication URLs of external communications that occur, A procedure for registering the site URL of a page on which the aforementioned cookie is issued, the aforementioned web storage is set, or the aforementioned external communication URL is generated, in association with the aforementioned cookie issued on the aforementioned page, the aforementioned web storage that is set, or the aforementioned external communication URL that is generated, so that it can be acquired by the second computer when the service identification program described in claim 18 is executed on the second computer, An analysis program that causes a computer to execute a command.
20. A procedure for obtaining the registered service used by the third computer by having the service use identification program described in claim 18 run as a service used at the site to be analyzed, The procedure for outputting the aforementioned service used, A reference program for using services to run on a computer.
21. The service-specific device described in claim 2, The analysis apparatus according to claim 7, The reference device according to claim 11, A service database in which data is registered that is associated with the service, each of the aforementioned cookies, web storage, and external communication URLs, A service identification system equipped with the necessary features.
22. An analysis item acquisition unit that acquires analysis items including the correspondence between the site URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed, the web storage set, or the external communication URL of the external communication that occurs, A service identification unit that matches the analysis items with a service database and identifies the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page. It includes a service registration unit that registers the aforementioned site URL and the aforementioned service being used in association, The aforementioned service database contains data in which cookies, web storage, and external communication URLs are associated with services. The aforementioned service database is a service identification device in which data is registered in which multiple cookies are associated with one service, multiple web storages are associated with one service, and multiple external communication URLs are associated with one service.
23. An analysis item acquisition unit that acquires analysis items including the correspondence between the site URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed, the web storage set, or the external communication URL of the external communication that occurs, A service identification unit that matches the analysis items with a service database and identifies the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page. It includes a service registration unit that registers the aforementioned site URL and the aforementioned service being used in association, The aforementioned service database contains data in which cookies, web storage, and external communication URLs are associated with services. The aforementioned analysis item acquisition unit acquires the analysis items from the analysis item database, The analysis item database includes a table in which the correspondence between the site URL and the cookie is registered, a table in which the correspondence between the site URL and the web storage is registered, and a table in which the correspondence between the site URL and the external communication URL is registered, in the service identification device.
24. An analysis item acquisition unit that acquires analysis items including the correspondence between the site URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed, the web storage set, or the external communication URL of the external communication that occurs, A service identification unit that matches the analysis items with a service database and identifies the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page. It includes a service registration unit that registers the aforementioned site URL and the aforementioned service being used in association, The service database contains data associating cookies with services, data associating web storage with services, and data associating external communication URLs with services, and the cookie information includes the domain, and is a service identification device.