Use service identification device, analysis device, reference device, and method executed by these devices, program, and system
The system addresses the ambiguity in service identification by associating cookies, web storage, and external communication URLs with service databases, enabling accurate service usage analysis and registration.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- INTERNET INITIATIVE JAPAN INC
- Filing Date
- 2024-10-28
- Publication Date
- 2026-05-07
AI Technical Summary
Existing service identification methods fail to accurately determine the services used on a website due to the ambiguity caused by factors such as cookies, web storage, and external communication URLs, without clear association with the actual services being utilized.
A system and method that includes an analysis device to extract cookies, web storage, and external communication URLs from website pages, associating them with site URLs, and matching these items with a service database to identify the corresponding services, using a service identification device to register and output the services used.
Enables accurate identification and registration of services used on a website by correlating cookies, web storage, and external communication URLs with their respective services, providing comprehensive service usage analysis.
Smart Images

Figure JP2024038430_07052026_PF_FP_ABST
Abstract
Description
Service identification device, analysis device, reference device, methods, programs, and systems executed by these devices
[0001] The present invention relates to a service identification device, an analysis device, a reference device, a service identification method, an analysis method, a service reference method, a service identification program, an analysis program, a service reference program, and a service identification system.
[0002] A service identification device is known that launches an internet browser, accesses a website to be analyzed, monitors HTTP requests to extract the URL of the external request, and identifies the service corresponding to the domain and path of the URL of the external request by referring to an external service database (see, for example, Patent Document 1). However, with such a method, it is unclear whether the external request was caused by any factor such as cookies. [Prior Art Documents] [Patent Documents] [Patent Document 1] Japanese Patent Application Publication No. 2018-185741 General disclosure
[0003] (Item 1) The service user identification device may include an analysis item acquisition unit that acquires analysis items including the correspondence between the site URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed, the web storage set, or the external communication URL of an external communication that occurs. The service user identification device may also include a service user identification unit that matches the analysis items with a service database and identifies the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page. The service user identification device may also include a service user registration unit that registers the site URL and the service user in association. The service database may contain data in which each of the cookies, web storage, and external communication URLs is associated with a service. (Item 2) The analysis item acquisition unit may acquire the analysis items from the analysis item database. The analysis item database may contain data in which the correspondence between the site URL and the cookie, web storage, or external communication URL is registered. (Item 3) If the service registration unit fails to identify the service, it may register the site URL, the cookie, the web storage, or the external communication URL as not being associated with a service. (Item 4) The service identification unit may include an external communication URL matching unit that extracts data from the service database that at least partially matches the external communication URL included in the analysis item and the service that corresponds to it, and acquires the service that it uses as a service. The service identification unit may include a cookie matching unit that extracts data from the service database that at least partially matches the cookie included in the analysis item in the Name attribute and the service that corresponds to it, and acquires the service that it uses as a service.The service identification unit may include a web storage matching unit that extracts, from the service database, a service corresponding to data that partially matches the Origin of the web storage included in the analysis item, and acquires the service as a service to be used. (Item 5) When there are a plurality of data that at least partially match the cookie in the Name attribute, the cookie matching unit may acquire, as a service to be used, the most frequently used service among the plurality of services indicated by the plurality of data. (Item 6) The service registration unit may register the site URL and the service to be used in a service database in association with each other.
[0004] (Item 7) The analysis device may include an analysis target acquisition unit that acquires the site URL of the site to be analyzed. The analysis device may include an analysis execution unit that analyzes one or more pages within the site published at the site URL and extracts cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur. The analysis device may include an analysis item registration unit that associates the site URL of the page from which the cookies, web storage, or external communication URLs were extracted with the cookies, web storage, or external communication URLs extracted from the page and registers them so that they can be acquired by the service identification device described in Item 1. (Item 8) The analysis execution unit may include a site access unit that uses a virtual browser to specify the site URL, sends a request to the server operating the site to be analyzed, and receives a response from the server. The analysis execution unit may further include an analysis item extraction unit that extracts cookies issued by the one or more pages or external communication URLs of external communications generated from the response, and further retrieves data stored in the web storage of the virtual browser. If the response contains a script, the analysis execution unit may also include a script execution unit that executes the script using the virtual browser to access the service. (Item 9) The analysis device may further include a link extraction unit that extracts the page URL of the linked page from the response. The site access unit may further specify the page URL of the linked page and send a request to the server operating the analysis target site, and receive a response from the server. (Item 10) The analysis item registration unit may register the correspondence between the site URL and the cookies, web storage, or external communication URL in the analysis item database.
[0005] (Item 11) The reference device may include a service acquisition unit that acquires the service used as a service used by the service used identification device described in Item 1, as a service used on the site to be analyzed. The reference device may also include a service reference unit that has a service used output unit that outputs the service used. (Item 12) The service acquisition unit may acquire the service used from a service database. The service used database may be one in which the site URL and the service used are registered in association with the service used by the service used identification device. (Item 13) The reference device may further include an analysis item reference unit. The analysis item reference unit may have a second analysis item acquisition unit that acquires an analysis item that includes the correspondence between the site URL of the site to be analyzed and a cookie, web storage, or external communication URL associated with the site URL. The analysis item reference unit may have an analysis item output unit that outputs the site URL included in the analysis item and the cookie, web storage, or external communication URL corresponding to the site URL. (Item 14) The second analysis item acquisition unit may acquire the analysis items from the analysis item database. The analysis item database may contain registered correspondences between the site URL and the cookie, the web storage, or the external communication URL.
[0006] (Item 15) A method for identifying services used by a computer may include a step of obtaining an analysis item that includes a correspondence between the site URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed, a web storage that is set, or an external communication URL of an external communication that occurs. The method for identifying services used may include a step of matching the analysis item with a service database to identify the service corresponding to the cookie, web storage, or external communication URL included in the analysis item as a service used on the at least one page. The method for identifying services used may include a step of registering the site URL and the service used in association. The service database may contain data in which each of the cookies, web storage, and external communication URLs is associated with a service.
[0007] (Item 16) The analysis method performed by a computer may include a step of obtaining the site URL of the site to be analyzed. The analysis method may include a step of analyzing one or more pages within the site published at the site URL and extracting cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur. The analysis method may include a step of associating the site URL of the page on which the cookie is issued, the web storage is set, or the external communication URL occurs with the cookie issued on the page, the web storage set, or the external communication URL that occurs, and registering them so that they can be obtained by the service identification method described in Item 15.
[0008] (Item 17) A service reference method executed by a computer may include a step of acquiring the service used by the service identification method described in Item 15 as a service used at the site to be analyzed. The service reference method may also include a step of outputting the service used.
[0009] (Item 18) The service identification program may cause the computer to execute a procedure to obtain analysis items that include the correspondence between the site URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed, the web storage set, or the external communication URL of an external communication that occurs. The service identification program may cause the computer to execute a procedure to match the analysis items with a service database and identify the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page. The service identification program may cause the computer to execute a service registration procedure that associates the site URL with the service used. The service database may contain data in which cookies, web storage, and external communication URLs are each associated with services.
[0010] (Item 19) The analysis program may cause the computer to perform a procedure to obtain the site URL of the site to be analyzed. The analysis program may cause the computer to perform a procedure to analyze one or more pages within the site published at the site URL and extract the cookies issued by the one or more pages, the web storage set, or the external communication URL of the external communication that occurs. The analysis program may cause the computer to perform a procedure to associate the site URL of the page on which the cookie was issued, the web storage was set, or the external communication URL occurred with the cookie issued on that page, the web storage set, or the external communication URL that occurs, and register them so that they can be obtained by the second computer when the service identification program described in Item 18 is executed on the second computer.
[0011] (Item 20) The service reference program may cause the computer to execute a procedure to obtain the registered service used by the third computer by having the service identification program described in Item 18 run on the third computer as a service used at the site to be analyzed. The service reference program may cause the computer to execute a procedure to output the service used.
[0012] (Item 21) The service identification system may include the service identification device described in Item 1. The service identification system may include the analysis device described in Item 7. The service identification system may include the reference device described in Item 11. The service identification system may include a service database in which data is registered that associates cookies, web storage, and external communication URLs with services.
[0013] (Item 22) The service usage identification system may include an analysis device that obtains the site URL of the site to be analyzed, analyzes one or more pages within the site published at the site URL, extracts cookies issued by the one or more pages, sets web storage, or generates external communication URLs, and registers the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the page, the web storage, or the generated external communication URL. The service usage identification system may also include a service usage identification device that matches analysis items, including the correspondence between the site URL and the cookie, web storage, or external communication URL registered by the analysis device, with a service database, identifies the service corresponding to the cookie, web storage, or external communication URL included in the analysis item as a service used on the page at the site URL, and registers the site URL and the service usage in association. The service identification system may include a service database in which data is registered that associates cookies, web storage, and external communication URLs with services. (Item 23) The service identification system may further include an analysis item database in which the analysis device registers the correspondence between the site URL and the cookies, web storage, or external communication URL, and the analysis device acquires analysis items including the correspondence. (Item 24) The service identification system may further include a reference device that acquires the service used as a service used by the service identification device and outputs the service used. (Item 25) The service identification system may further include a service database in which the service used device registers the site URL and the service used in correspondence, and the reference device acquires the service used.(Item 26) The service identification system is a site database in which the site URL of at least one site to be analyzed is registered, and may further comprise the site database from which the site URL is obtained by the analysis device.
[0014] (Item 27) The method for identifying services used may include the steps of obtaining the site URL of the site to be analyzed, analyzing one or more pages within the site published at the site URL to extract cookies issued by the one or more pages, web storage to be set, or external communication URLs of external communications that occur, registering the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the page, the web storage to be set, or the external communication URL that occurs. The method for identifying services used may include the steps of matching the analysis items, which include the correspondence between the site URL and the cookie, web storage, or external communication URL registered in the registration step, with a service database to identify the services corresponding to the cookie, web storage, or external communication URL included in the analysis items as services used on the page at the site URL, and registering the site URL and the services used in association. The aforementioned service database may contain data in which cookies, web storage, and external communication URLs are associated with services.
[0015] (Item 28) The service identification program may have one or more computers perform a procedure to obtain the site URL of the site to be analyzed, analyze one or more pages within the site published at the site URL, extract cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur, and register the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the page, the web storage set, or the external communication URL that occurs. The service identification program may match the analysis items, which include the correspondence between the site URL and the cookie, web storage, or external communication URL registered by the registration procedure, with a service database, identify the services corresponding to the cookie, web storage, or external communication URL included in the analysis items as services used on the page at the site URL, and have one or more computers perform a procedure to register the site URL and the service in association. The aforementioned service database may contain data in which cookies, web storage, and external communication URLs are associated with services.
[0016] It should be noted that the above summary of the invention does not enumerate all of its features. Furthermore, subcombinations of these features may also constitute an invention.
[0017] This document outlines the configuration of the service identification system according to this embodiment. It shows the functional configuration of the analysis device. An example of registration information in the site database is shown. An example of data included in the HTTP response transmitted from the server to be analyzed is shown. An example of registration information in the analysis item database is shown. The analysis flow is shown. The functional configuration of the service identification device is shown. An example of registration information in the service database is shown. An example of registration information in the service database is shown. An example of registration information in the service identification database is shown. The service identification flow is shown. The functional configuration of the reference device is shown. A screen displaying cookies, web storage, or external communication URLs corresponding to the service acquired by the analysis item acquisition unit is shown. A screen displaying the site URL acquired by the analysis item acquisition unit and cookies, web storage, or external communication URLs within the site is shown. The service reference flow is shown. The analysis target input screen is shown. The analysis item reference flow is shown. An example of the computer configuration is shown.
[0018] The present invention will be described below through embodiments, but these embodiments are not intended to limit the scope of the claims. Furthermore, not all combinations of features described in the embodiments are necessarily essential to the solution of the invention.
[0019] Figure 1 shows a schematic configuration of the first embodiment of the service utilization identification system (also simply called the system) 1. System 1 is a network system for analyzing a website (also simply called a site) to identify the services used on that site and providing information about the identified services to a user terminal 90 used by the website administrator. System 1 comprises an analysis device 10, a service utilization identification device 50, and a reference device 80. System 1 may further comprise a site database (site DB) 20, an analysis item database (analysis item DB) 40, a service database (service DB) 60, and a service utilization database (service utilization DB) 70. These are connected to each other so as to be able to communicate with each other via a network 99. Note that a database is also referred to as a DB.
[0020] Network 99 is a communication network that connects the analysis device 10, the service identification device 50, the reference device 80, and various databases such as the site database 20 in a manner that enables them to communicate with each other. Network 99 is, for example, the Internet, but is not limited to this. Any communication network that enables communication between these devices and databases may be used, such as a local area network or telephone line, or a network in which multiple communication networks coexist.
[0021] The server 30 to be analyzed is the server that operates the site to be analyzed, which is the target of identifying the services being used. Multiple sites may be analyzed, not just one. In such cases, system 1 accesses multiple servers 30 via network 99. For simplicity, this example shows only one server 30.
[0022] The user terminal 90 is, for example, a terminal device used by the administrator of a website operated by the analysis target server 30. The terminal device may be a computer terminal such as a personal computer, or a mobile terminal such as a smartphone or tablet computer. The user terminal 90 is equipped with a display 91 such as an LCD display and functions as a client terminal that communicates with the reference device 80 to acquire information such as the services used on the website and displays it on the display 91. Multiple user terminals 90, each owned by multiple users, may be included in the system 1, and multiple users may be able to use the system 1.
[0023] The analysis device 10 is a computer device that reads pages within the target site, sends an HTTP / HTTPS request (also simply called a request) to the target server 30 operating the site using a virtual browser, analyzes the received HTTP / HTTPS response (also simply called a response) to extract cookies or external communication URLs, retrieves data stored in the virtual browser's web storage, and registers these retrieved results as analysis items. The analysis items can be used by the service identification device 50, which will be described later. The analysis device 10 has a central processing unit (CPU) and a communication device (neither of which are shown). The analysis device 10 may also be implemented using a cloud (multiple distributed servers or multiple subsystems, etc.). The CPU executes an analysis program to analyze one or more pages within the target site and activates the function of extracting cookies issued on each page, web storage set, and external communication URLs of external communications that occur. The functional configuration of the analysis device 10 will be described later. The analysis program is stored in ROM (not shown), for example, and read by the CPU, or stored in a storage medium such as a CD-ROM, and then read by the CPU using a reading device (not shown) and loaded into RAM to be started. The communication device is a device that can communicate with the service identification device 50, the reference device 80, and various databases via wired or wireless communication over the network 99, and can communicate using protocols such as TCP / IP as an example.
[0024] A virtual browser is a browser that runs on one or more independent virtual machines, or on a container that shares the kernel of the host OS. All the functions of commonly used browsers are also available in virtual browsers, and all the functions of browsers described herein apply to virtual browsers as well.
[0025] Figure 2 shows the functional configuration of the analysis device 10. The analysis device 10 includes an analysis target acquisition unit 11, an analysis execution unit 12, and an analysis item registration unit 13.
[0026] The analysis target acquisition unit 11 is a functional unit that acquires the site URL of the site to be analyzed from the site database 20. However, the method by which the analysis target acquisition unit 11 acquires the site URL is not limited to this; for example, the operator of system 1 may acquire it by inputting the site URL via an input device (not shown).
[0027] The site database 20 is a storage device in which various information, such as the site URL of at least one site to be analyzed, operated by the server 30 to be analyzed, is registered (stored). The storage device may include a hard disk drive (HDD) or the like.
[0028] Figure 3 shows an example of site URL information (URL information) for sites to be analyzed, registered in the site database 20. In this example, three site URLs, such as XXX.com, are registered as sites to be analyzed. Here, a URL generally consists of a scheme, domain, path, parameters, and fragment. The format of the site URLs to be registered in the site database 20 is not particularly limited; for example, the part of the URL after the path (path, parameters, and fragment) may be represented by a regular expression. This URL information may be registered by the operator of system 1 via an input device (not shown).
[0029] The analysis execution unit 12 is a functional unit that analyzes one or more pages within a site that is publicly accessible on a site URL, targeting a site to be analyzed (for example, "XXX.com") obtained from the site database 20 by the analysis target acquisition unit 11, and extracts cookies issued by one or more pages, web storage that is set, or external communication URLs of external communications that occur. The analysis execution unit 12 includes a site access unit 121, an analysis item extraction unit 122, a script execution unit 123, and a link extraction unit 124.
[0030] Here, a cookie is data stored by a browser, and there are two types: persistent cookies and session cookies. Persistent cookies are stored in the storage of the device on which the browser is running for a specified period even after the browser is closed, and are used to retain information such as the contents of the user's shopping cart and language settings. Session cookies are temporary cookies that exist only during the session period and are automatically deleted when the browser is closed, and are used to retain login information when the user moves between pages. Cookies are extracted by parsing the response header and retrieving the browser's cookie storage. Cookies have attributes such as the identifier userPref attribute, Name attribute such as sessionId attribute, Domain attribute (domain attribute) that manages the domain where the cookie is valid, Path attribute (path attribute) that manages the path where the cookie is valid, Expires / Max-Age attribute that manages the expiration date (deletion time) of the cookie, Secure attribute that manages whether it is sent only via HTTPS communication, HttpOnly attribute that manages whether it is prevented from accessing via JavaScript (registered trademark), and SameSite attribute that manages whether it is allowed to send cross-site requests.
[0031] Cookies without a specified domain attribute are only valid for the origin in which they are set. The origin consists of the domain, protocol (such as HTTP or HTTPS), and port number. For example, a cookie set on sub.example.com without a specified domain attribute is only valid on sub.example.com and will not be valid on example.com or other subdomains.
[0032] Cookies with a specified domain attribute are valid for the specified domain and its subdomains. For example, a cookie with the domain attribute example.com is valid for example.com and its subdomains and will be sent for all requests under the specified domain.
[0033] Cookies that do not specify a domain attribute, or that specify the same domain as the website being accessed, are called first-party cookies, while cookies that specify a different domain (external domain) are called third-party cookies.
[0034] Web storage refers to APIs for saving data in a browser, and there are two types: local storage and session storage. Local storage is an API for saving data until it is explicitly deleted within the browser. The data is stored in the browser's data storage area and can be retained even when the browser is closed. Data stored in local storage is shared within the same origin. Session storage is an API for saving data within the browser only for the duration of a single session. The data is stored in the memory area allocated by the browser and is deleted when the browser tab is closed. Note that data stored in web storage is also simply referred to as web storage.
[0035] An external communication URL is a URL designated as the destination for communications occurring on a page, and it belongs to a different domain than the domain of this page.
[0036] The site access unit 121 is a functional unit that uses a virtual browser to specify the site URL (the URL of the site's top page) and sends a request to the analysis target server 30, which operates the site to be analyzed, and receives a response from the analysis target server 30. The site access unit 121 further determines whether there are any link URLs that have not yet been specified among the link URLs extracted by the link extraction unit 124. If there are any link URLs that have not yet been accessed, the site access unit 121 specifies these link URLs and sends a request to the analysis target server 30, and receives a response from the analysis target server 30. By the site access unit 121 specifying link URLs and sending requests to the analysis target server 30 and receiving responses from the analysis target server 30, all pages that can be accessed from the top page can be recursively analyzed.
[0037] The analysis item extraction unit 122 is a functional unit that extracts cookies issued by one or more pages or external communication URLs of external communications generated from the response received by the site access unit 121, and further retrieves data stored in the web storage set in the virtual browser.
[0038] Figure 4 shows an example of data included in an HTTP response sent in response to a request sent to the server 30 to be analyzed (for example, the site URL "XXX.com" registered in the site database 20 in Figure 3). The HTTP / HTTPS response consists of a response line (status line), a response header, and a response body. In this example, the response line contains information 35 about the HTTP protocol version and status code, indicating that the version is HTTP / 1.1 and the status code is 200, meaning the request was processed successfully. The response header contains the date and time the response was generated and the cookie settings 31, indicating that this response was generated at 10:18:14 on June 9, 2024, and that the set cookie is available under the example.com domain. The response body contains an HTML document with a script tag 33 embedded in it. The code in the script tag 33 sends JSON data to https: / / example.com / api and displays the response on the console.
[0039] The analysis item extraction unit 122 is a functional unit that extracts cookies and web storage stored in the virtual browser from the virtual browser, and extracts the external communication URL of external communications that occurred on the site from the virtual browser's communication log. The analysis item extraction unit 122 may also obtain this information from response data. In this case, for example, the analysis item extraction unit 122 extracts the cookie setting 31 "sessionId_app1=abc123; Domain=example.com;" from the response header of the data shown in Figure 4, and the external communication URL setting 32 "https: / / example.com / api" from the response body. Note that the method of extracting information contained in the virtual browser's cookies, web storage, communication log, or response is not particularly limited, and it is possible to extract the information by calling an API such as JavaScript (registered trademark), Python, or Java (registered trademark) from an interface driver that operates the virtual browser.
[0040] The script execution unit 123 is a functional unit that executes a script using a virtual browser if the response sent by the server 30 to be analyzed contains a script. Scripts are generally written in HTML documents, and HTML documents are included in the response body of the HTTP response (see script tag 33 in Figure 3). The execution result of the script can be confirmed, for example, by logs output from the interface driver that operates the virtual browser. This allows for confirmation of the success or failure of the script execution.
[0041] The link extraction unit 124 is a functional unit that extracts the page URL of the linked page from the response sent by the server 30 to be analyzed. The page URL is contained in the HTML document, and the HTML document is included in the response body of the HTTP response (see Figure 4). In this example, the link URL of the link to "page1.html" on the page is extracted by extracting the link tag 34 from the response body. This allows the site access unit 121 to access the linked page.
[0042] When the analysis item registration unit 13 extracts, by the analysis item extraction unit 122, cookies issued by pages or external communication URLs of external communications generated from pages within the analysis target site, or when it acquires data from the set web storage, it associates the site URL with the cookies issued by the pages within the site, the set web storage, or the external communication URLs of the external communications generated, and registers them in the analysis item database 40 so that they can be acquired by the usage service identification device 50. It is a functional unit.
[0043] The analysis item database 40 is a storage device in which the correspondence between the site URL and the cookies issued by the pages within the site, the set web storage, or the external communication URLs generated from the pages is registered (stored) by the analysis item registration unit 13. It may have a hard disk drive (HDD) or the like as the storage device.
[0044] FIG. 5 shows an example of analysis information in which the site URL registered in the analysis item database 40 is associated with the cookies issued by the pages within the site, the set web storage, or the external communication URLs generated on the page. The analysis item database 40 has three tables associating the site URL with the cookies, the site URL with the web storage, and the site URL with the external communication URL. Note that the analysis information may be managed in one table or by other methods.
[0045] The upper table shows the analysis information of the cookies. The analysis information of the cookies includes a site URL (Site URL) column, a page URL (Page URL) column of the page that issued the cookie, a Name attribute (cookie name) "Name" column of the cookie, a Domain attribute "Domain" column, and a control classification "Control Type" column. In this example, the page URL "XXX.com / " of the page with the site URL "XXX.com", the Name attribute "sessionId_app1" of the cookie issued by this page, the Domain attribute "example.com" (see the cookie setting 31 in FIG. 4), and the control classification "3" of this cookie
[0043] "Party Cookie" is registered in association. In addition to these, other attributes that the cookie can have may be registered in the table.
[0046] The middle table shows the analysis information of web storage. The analysis information of web storage includes a Site URL column, a Page URL column of the page where the web storage is set, an Origin "Origin" column, and a Storage Type "Storage Type" column. In this example, the Page URL "XXX.com / XXX" of the page with the Site URL "XXX.com", the Origin "https: / / example1.com" of the web storage set by this page, and the Storage Type "local Storage" are registered in association. In addition to these, other information that the web storage can have, such as Key attributes, may be registered in the table.
[0047] The lower table shows the analysis information of external communication URLs. The analysis information of external communication URLs includes a Site URL column, a Page URL column of the page where the web storage is set, and an External URL "External URL" column. In this example, the Page URL "XXX.com / YYY" of the page with the Site URL "XXX.com" and the External URL "http: / / anotherdomain1.com" of the external communication that occurs on this page are registered in association. Also, the Page URL "XXX.com / ZZZ" of the page with the Site URL "XXX.com" and the External URL "http: / / anotherdomain2.com" of the external communication that occurs on this page are registered in association.
[0048] According to the analysis device 10 of this embodiment, an analysis target acquisition unit 11 acquires the site URL of the site to be analyzed, an analysis execution unit 12 analyzes one or more pages within the site published at the site URL and extracts cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur, and an analysis item registration unit 13 associates the site URL with the cookies, web storage, or external communication URLs issued on the pages within the site and registers them so that they can be acquired by the service usage identification device described later. As a result, it is possible to extract cookies issued by one or more pages within the site published at the site URL, web storage set, or external communication URLs of external communications that occur, and to register this data for each site so that it can be acquired by the service usage identification device 50. Not only can the services used by the site to be analyzed be listed and registered, but it is also possible to analyze and examine whether cookies, web storage, or external transmissions are used to access the services used.
[0049] Figure 6 shows the flow of the analysis method performed by the analysis device 10.
[0050] In step S11, the analysis device 10 (analysis target acquisition unit 11) acquires the site URL of the site to be analyzed from the site database 20. There may be multiple sites to be analyzed. As mentioned above, the site database 20 has site URL information (URL information) of the sites to be analyzed registered in it. The URL information may also be acquired by the operator of system 1 via an input device (not shown).
[0051] In step S12, the analysis device 10 (analysis execution unit 12) analyzes the pages within the site published at the site URL and extracts all cookies issued by the pages, web storage settings, or external communication URLs for any external communications that occur. It also extracts all link URLs. First, the site access unit 121 uses a virtual browser to send a request to the analysis target server 30, which operates the analysis target site, specifying the site URL (the URL of the site's top page) or the page URL of the linked page extracted by the link extraction unit 124, and receives a response from the analysis target server 30. Next, the analysis item extraction unit 122 extracts cookies issued by one or more pages or external communication URLs for any external communications that occur from the response received by the site access unit 121, and further obtains data stored in the web storage set in the virtual browser. After that, if the response sent by the analysis target server 30 contains a script, the script execution unit 123 executes the script using the virtual browser. Then, the link extraction unit 124 extracts the page URL of the linked page from the response sent by the server 30 to be analyzed.
[0052] This extracts, for example, cookies with the Name attribute "sessionId_app1" and Domain attribute "example.com" issued by a page with the URL "XXX.com / " on the site being analyzed (see Cookie Settings 31 in Figure 4). Details of the extraction are as described above.
[0053] In step S13, the analysis device 10 (site access unit 121) determines whether there are any link URLs that have not yet been specified among the link URLs extracted by the link extraction unit 124. If there are any link URLs that have not yet been specified, the device returns to step S12; otherwise, it proceeds to S14.
[0054] In step S14, the analysis device 10 (site access unit 121) determines whether there are any unspecified site URLs among the site URLs extracted by the analysis target acquisition unit 11. If there are unspecified site URLs, for example, if the analysis of XXX.com (see Figure 3) has been completed but the analysis of YYY.com and ZZZ.com (see Figure 3) has not yet been completed, the device returns to step S12. If there are no unspecified site URLs (if the analysis of all analysis target sites has been completed), the device proceeds to step S15.
[0055] In step S15, the analysis device 10 (analysis item registration unit 13) associates the site URL with a cookie, web storage, or external communication URL and registers it in the analysis item database 40 (see Figure 5) so that it can be acquired by the service user identification device 50 (acquired by the service user identification method described later). As a result, for example, the site URL "XXX.com / " and the cookie with the Name attribute "sessionId_app1" and domain attribute "example.com" issued by a page on this site (see cookie settings 31 in Figure 4) are associated and registered. In this way, all analysis information is accumulated in the analysis item database 40. Details of the accumulation of analysis information are as described above.
[0056] According to the analysis method of this embodiment, the analysis method is performed by a computer and comprises the steps of: obtaining the site URL of the site to be analyzed; analyzing one or more pages within the site published at the site URL and extracting cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur; and associating the site URL of the site to be analyzed with the cookies issued by the pages within the site to be analyzed, the web storage set, or external communication URLs that occur on the pages, and registering them so that they can be obtained by the service usage identification method described later. This makes it possible not only to list and register the services used on the site to be analyzed, but also to analyze and examine which means such as cookies and web storage are used to access the services.
[0057] The service utilization identification device 50 is a computer device that identifies the services used by the site under analysis. The service utilization identification device 50 has a CPU and a communication device (neither of which are shown in the diagram). The service utilization identification device 50 may be implemented using a cloud (multiple distributed servers or multiple subsystems, etc.). The CPU performs the function of identifying the services used by the site under analysis by executing a service utilization identification program. The functional configuration of the service utilization identification device 50 will be described later. The service utilization identification program is stored in ROM (not shown), for example, and read by the CPU, or stored in a storage medium such as a CD-ROM, and then read by the CPU using a reader (not shown) and loaded into RAM to be activated. The communication device is a device that can communicate with the analysis device 10, the reference device 80, and various databases via wired or wireless communication over the network 99, and can communicate using protocols such as TCP / IP as an example.
[0058] Figure 7 shows the functional configuration of the service utilization identification device 50. The service utilization identification device 50 includes an analysis item acquisition unit 51, a service utilization identification unit 52, and a service utilization registration unit 53.
[0059] The analysis item acquisition unit 51 is a functional unit that acquires analysis items (correspondence information registered in each of the one or more rows shown in Figure 5) from the analysis item database 40, which include the correspondence between the page URL of the site to be analyzed and the cookies issued by at least one page within the site to be analyzed, the web storage set, or the external communication URL generated on the page. The analysis item acquisition unit 51 acquires analysis items one by one from the analysis item database 40 and transmits them to the service identification unit 52. The analysis item acquisition unit 51 makes it possible to use analysis items analyzed by a separate device (i.e., the analysis device 10) from the service identification device 50.
[0060] The Service Identification Unit 52 is a functional unit that matches cookies, web storage, or external communication URLs included in each analysis item acquired from the analysis item database 40 by the analysis item acquisition unit 51 with the service database 60, and identifies the matching data and corresponding service as a service used on the site. The Service Identification Unit 52 includes an external communication URL matching unit 521, a cookie matching unit 522, and a web storage matching unit 523. Here, a service refers to an external service such as an advertising service or an access analysis service that is executed when a request is sent specifying an external communication URL.
[0061] The service database 60 is a storage device in which one or more service information entries are registered (stored) where cookies, web storage, and external communication URLs are each associated with a service. The storage device may include a hard disk drive (HDD), etc. Associating cookies, web storage, and external communication URLs with a service means associating them with a service ID, name, etc., that can uniquely identify the service. Furthermore, a service is not limited to being represented by its name (referred to as the service name), but may also be represented by its ID. In this embodiment, as an example, a service is represented by its service name.
[0062] Figure 8A shows a portion of the service information registered in the service database 60. The service database 60 has three tables that associate service names with cookies, service names with web storage, and service names with external communication URLs.
[0063] The table in the upper section shows service information that associates cookies with services. This service information includes a Service Name column, a Name column for the cookie's Name attribute (cookie name), and a Domain attribute column. In this example, the service name "InsightPulse" is associated with a cookie whose Name attribute is "app1" and whose Domain attribute is "example.com". In addition to these, the table may also register other attributes that a cookie may have.
[0064] The middle table displays service information that associates web storage with a service. This service information includes a Service Name column and an Origin column for the web storage. In this example, the service name "MetricVision" is associated with the Web Storage Origin "https: / / example1.com" used by the service indicated by this service name. In addition to this, the table may also register other information that the web storage may have, such as Key attributes.
[0065] The table below shows service information that associates external communication URLs with services. This service information includes a "Service Name" column and an "External URL" column. In this example, the service name "AnalyticaFlow" is associated with the external communication URL "anotherdomain2.com" which is specified for accessing the service indicated by this service name.
[0066] In addition to service names, other service information may also be registered in the service database 60. Other service information may include, for example, the type of service such as advertising or access analysis, or the service provider of an external service.
[0067] The external communication URL matching unit 521 is a functional unit that, when an analysis item obtained from the analysis item database 40 includes an external communication URL, extracts data that at least partially matches the external communication URL and the corresponding service name from the service database 60, and obtains this service name as the service to be used. For example, the external communication URL matching unit 521 obtains the data from the second row of the table below that has "anotherdomain2.com" in the ExternalURL column from the analysis information registered in the analysis item database 40 (see Figure 5), performs a partial match search on the ExternalURL column of the service information below registered in the service database 60 using "anotherdomain2.com" as the key (see Figure 8A), and obtains the service name "AnalyticaFlow" from the first row of service information whose ExternalURL column value matches "anotherdomain2.com" as the service to be used.
[0068] The cookie matching unit 522 is a functional unit that, when an analysis item obtained from the analysis item database 40 includes a cookie, extracts services from the service database 60 that at least partially match the cookie in the Name attribute, and, if necessary, extracts data from the service database 60 that at least partially match the cookie in the Name attribute and completely match the Domain attribute, and acquires this service as a service to be used. Here, "if necessary" means, for example, when the type of cookie is a third-party cookie. Furthermore, if there are multiple data in the cookie data of the analysis item that at least partially match in the Name attribute and completely match in the Domain attribute, the cookie matching unit 522 acquires the most frequent service among the multiple services indicated by them as a service to be used.
[0069] Figure 8B shows a portion of an example of service information that associates cookies with services and is registered in the service database 60. In this example, the cookie matching unit 522 extracts three cookies that specify InsightPulse and one cookie that specifies Service2, which exactly match the domain attribute example.com of the cookie in the first row of the analysis item obtained from the upper table of the analysis item database 40 (see Figure 5). Among these, InsightPulse is the service whose Name attribute matches the Name attribute portion app1 of the analysis item the most, so the cookie matching unit 522 obtains InsightPulse as the service being used. Cases in which cookies with matching domain attributes are distinguished by the Name attribute include, for example, cases where InsightPulse manages the login status of the entire platform, and Service2 manages sub-services within the platform. The cookie matching unit 522 can identify the service being used even if there are multiple services that could be accessed by a given cookie.
[0070] The web storage matching unit 523 is a functional unit that, when web storage is included in the analysis items obtained from the analysis item database 40, extracts the service associated with the data in the service database 60 that has a partial match in the origin of the web storage, and acquires this service as a service. For example, the web storage matching unit 523 obtains the first row of analysis items from the middle table of the analysis item database 40, extracts the data from the first row of the middle table of the service database 60 where the origin https: / / example1.com included in it has a partial match (completely unique in this example), and acquires the corresponding service MetricVision as a service to be used.
[0071] The web storage matching unit 523 may extract services associated with data whose Origin attribute is an exact match. Alternatively, it may extract services associated with data whose Origin attribute is a partial or exact match, as well as whose Key attribute is a partial or exact match.
[0072] The Service Registration Unit 53 is a functional unit that, if the Service Identification Unit 52 can identify the service name, registers the site URL and the service used in the Service Database 70. The Service Registration Unit 53 also registers cookies, web storage, or external communication URLs for which the service name could not be identified as data not associated with a service (e.g., Unknown) in the Service Database 70. The Service Registration Unit 53 allows the identified service information to be stored for use by other devices. It can also detect cookies, etc., that are not associated with a service, i.e., cookies that are not functioning.
[0073] The service database 70 is a storage device that registers site URLs and the service names of the services used on those sites. The storage device may include a hard disk drive (HDD) or the like.
[0074] Figure 9 shows an example of service information registered in the service database 70 by the service registration unit 53. The service information is registered in a table format with a "UsingServiceName" column and a "Site URL" column. In this example, the aforementioned site URL "XXX.com" is associated with the service name "InsightPulse" which has been identified as a service used on this site, the site URL "XXX.com" is associated with the service name "MetricVision" which has been identified as a service used on this site, and the aforementioned site URL "XXX.com" is associated with the service name "AnalyticaFlow" which has been identified as a service used on this site. Since the service corresponding to the external communication URL used by the site URL "XXX.com" could not be identified, the site URL "XXX.com" is associated with "Unknown", meaning the service used is unknown.
[0075] According to the service identification device 50 of this embodiment, an analysis item acquisition unit 51 acquires analysis items including the correspondence between the page URL of at least one page within the site to be analyzed and the cookies issued on at least one page, the web storage set, or the external communication URL of the external communication that occurs; a service identification unit 52 matches the analysis items with a service database and identifies the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as service used at the site to be analyzed; and a service registration unit 53 registers the site URL in association with the service used. Thus, the device can acquire cookies, web storage, or external communication URLs for each site to be analyzed by the analysis device 10, identify the corresponding service used, and register the identified service used in the service database 70.
[0076] Figure 10 shows the flow of the service identification method performed by the service identification device 50.
[0077] In step S21, the service identification device 50 (analysis item acquisition unit 51) acquires all analysis information from the analysis item database 40 (see Figure 5) that has a correspondence between a cookie, web storage, or external communication URL and the site URL of the site to which the analysis item belongs.
[0078] In step S22, the service usage identification device 50 (service usage identification unit 52) matches the analysis items with the service database 60 (see Figures 8A and 8B) to identify the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as services used on the site being analyzed. First, the external communication URL matching unit 521 extracts data from the service database 60 that at least partially matches the external communication URLs included in the analysis items obtained from the analysis item database 40, and the services that correspond to them. Next, the cookie matching unit 522 extracts data from the service database 60 that at least partially matches the Name attribute and completely matches the Domain attribute of the cookies included in each of the analysis items obtained from the analysis item database 40, and the services that correspond to them, and acquires these services as services used. Here, if there are multiple data in the cookie data of the analysis items that at least partially match the Name attribute and completely match the Domain attribute, the cookie matching unit 522 acquires the most frequent service among the multiple services indicated by them as the service used. Furthermore, the web storage matching unit 523 extracts services from the service database 60 that are associated with data where the Origin attribute of the web storage included in each analysis item obtained from the analysis item database 40 partially matches, and acquires these services as services. Details are as described above. Thus, it is desirable to perform the matching with the service database 60 in the order of matching external communication URLs, matching cookies, and then matching web storage. The certainty of service identification is highest with matching external communication URLs, followed by cookies, and finally web storage, so efficient identification is possible by performing the matching in this order.
[0079] For example, for the analysis information in the second row of the lower table of the analysis item database 40 (see Figure 5) (URL column "XXX.com / ZZZ / ", ExternalURL column "anotherdomain2.com"), the service database 60 (see Figure 8A) is searched using the external URL "anotherdomain2.com" as the key, and the service name "AnalyticaFlow" is obtained as the service being used based on the information in the first row of the lower table. Similarly, for the analysis information in the first row of the upper table of the analysis item database 40 (see Figure 5) (URL column "XXX.com / ", COOKIE column "app1; domain=example.com"), the service database 60 (see Figure 8B) is searched, and three cookies that exactly match the domain attribute example.com and whose Name attribute partially matches app1, specifying InsightPulse, are extracted, thereby obtaining InsightPulse as the service being used. Furthermore, the analysis item in the first row is obtained from the middle table of the analysis item database 40 (see Figure 5), and the data in the first row of the middle table of the service database 60 (Figure 8A) where the Origin https: / / example1.com contained in it partially matches (completely unique in this example) is extracted, and the corresponding service MetricVision is obtained as the service used. Details of obtaining the service used are as described above.
[0080] In step S23, the service identification device 50 (service registration unit 53) registers service information, which associates the site URL with the service used, in the service database 70 (see Figure 9). As a result, for example, the site URL "XXX.com" is associated with the service name "InsightPulse" (see first line of Figure 9), the service name "AnalyticaFlow" (see fourth line of Figure 9), and the service name "MetricVision" (see second line of Figure 9). This allows for the accumulation of service information. Details of the accumulation of service information are as described above.
[0081] In step S24, the service identification device 50 (service registration unit 53) determines whether there is any unregistered analysis information. If there is, the process returns to step S21; otherwise, it terminates. This allows all analysis information to be registered.
[0082] According to the service identification method of this embodiment, the service identification method is executed by a computer and comprises the steps of: acquiring analysis items including the correspondence between a site URL within the site to be analyzed and a cookie, web storage, or external communication URL issued on at least one page within the site to be analyzed; matching the analysis items with a service database to identify the service name corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on the site to be analyzed; and registering the site URL and the service in association. The service database contains data that pairs each of the cookie, web storage, and external communication URL with the service name. With this, it is possible to acquire cookies, web storage, or external communication URLs for each site analyzed by the analysis device 10, identify the corresponding service, and register the identified service in the service database 70.
[0083] The reference device 80 is a computer device that outputs services used on the target site, associating them with cookies, web storage, or external communication URLs for accessing those services. The reference device 80 includes a CPU and a communication device (neither of which are shown in the diagram). The reference device 80 may be implemented using a cloud (multiple distributed servers or multiple subsystems, etc.). The CPU activates the function of outputting services used on the target site by executing a service reference program. The functional configuration of the reference device 80 will be described later. The service reference program is stored in ROM (not shown), for example, and read by the CPU, or stored in a storage medium such as a CD-ROM, and then read by the CPU using a reader (not shown) and loaded into RAM to be activated. The communication device is a device that can communicate with the analysis device 10, the service identification device 50, and various databases via wired or wireless communication over the network 99, and can communicate using protocols such as TCP / IP as an example.
[0084] Figure 11 shows the functional configuration of the reference device 80. The reference device 80 includes a service reference unit 81 and an analysis item reference unit 82.
[0085] The service reference unit 81 is a functional unit that outputs the services used by the site to the user terminal 90. The output here may be in the form of output to the user terminal 90's display 91, in the form of transmission to the user terminal 90 as a file, or in any other form. In addition to the services used, the service reference unit 81 may also output cookies, web storage, or external communication URLs corresponding to the services used to the user terminal 90. The service reference unit 81 includes a service acquisition unit 811, a third analysis item acquisition unit 812, and a service output unit 813.
[0086] The service acquisition unit 811 is a functional unit that acquires service usage information registered by the service usage identification device 50 as services used at the site to be analyzed from the service usage database 70. For example, if "XXX.com" is specified as the site to be analyzed, the service acquisition unit 811 acquires all rows from the service usage information registered in the service usage database 70 (see Figure 9) that contain "XXX.com" in the URL column.
[0087] The analysis item acquisition unit (an example of the third analysis item acquisition unit) 812 is a functional unit that, for all service usage information acquired by the service usage acquisition unit 811, uses the service usage name as a key to acquire cookies, web storage, or external communication URLs corresponding to the service used from the service database 60. For example, the analysis item acquisition unit 812 uses the service usage name "AnalyticaFlow" from the service usage information acquired by the service usage acquisition unit 811 as a key to extract service information with a matching service name from the service database 60 shown in Figure 8A, and acquires the external communication URL "anotherdomain2.com" included in this service information.
[0088] The service usage output unit 813 is a functional unit that outputs the service usage acquired by the service usage acquisition unit 811 to the user terminal 90. The service usage output unit 813 further outputs a cookie, web storage, or external communication URL corresponding to the service usage acquired by the analysis item acquisition unit 812.
[0089] Figure 12 shows an example of the display screen of the display 91 showing cookies, web storage, or external communication URLs corresponding to the services used, acquired by the service acquisition unit 811. The screen has a target site display unit 911 and a service usage display unit 912. When a user specifies "XXX.com" as the target URL in the target site display unit 911, the reference device 80 displays the site URL "XXX.com" in the target site display unit 911 and also displays in the service usage display unit 912 the service name used on "XXX.com" acquired by the service acquisition unit 811 from the service usage database 70, and the cookies, web storage, or external communication URLs acquired by the analysis item acquisition unit 812 from the service database 60 as corresponding to that service. As a result, for example, it is displayed that the service InsightPulse is used on the site "XXX.com", and that the cookie specifying InsightPulse has a Name attribute name of app1 and a domain attribute value of example.com.
[0090] The analysis item reference unit 82 is a functional unit that outputs the site URL (which may also be the page URL of each page) and the corresponding cookie, web storage, or external communication URL to the user terminal 90. The output here may be in the form of output to the user terminal 90's display 91, sent to the user terminal 90 as a file, or in any other format. The analysis item reference unit 82 includes an analysis item acquisition unit 821 and an analysis item output unit 822.
[0091] The analysis item acquisition unit (an example of a second analysis item acquisition unit) 821 is a functional unit that refers to the analysis item database 40 and acquires the site URL (which may also be the page URL of each page) and the cookie, web storage, or external communication URL corresponding to the site URL. For example, the analysis item acquisition unit 821 acquires analysis information from the first row of the analysis item database 40 shown in Figure 5, where the page URL is "XXX.com", the Name attribute name is app1, and the domain attribute is example.com.
[0092] The analysis item output unit 822 is a functional unit that outputs the site URL (which may also be the page URL of each page) acquired by the analysis item acquisition unit 821, along with the corresponding cookie, web storage, or external communication URL, to the user terminal 90.
[0093] Figure 13 shows an example of a display screen on a display 91 that shows the site URL (which may also be the page URL of each page) acquired by the analysis item acquisition unit 821, along with the corresponding cookie, web storage, or external communication URL. The screen has a target site display unit 913 and an analysis item display unit 914. When a user specifies "XXX.com" as the target URL in the target site display unit 913, the reference device 80 displays the site URL "XXX.com" in the target site display unit 913 and also displays the cookie, web storage, or external communication URL acquired by the analysis item acquisition unit 821 from the analysis item database 40 corresponding to the page URL "XXX.com" in the analysis item display unit 914. As a result, for example, it is displayed that a cookie with the Name attribute name app1 and the domain attribute example.com has been issued for the top page "XXX.com" on the site "XXX.com".
[0094] According to the reference device 80 of this embodiment, the reference device 81 has a service reference unit 81 which includes a service acquisition unit 811 that acquires service usage registered by the service usage identification device 50 as a service used on the site to be analyzed, an analysis item acquisition unit 812 that acquires cookies, web storage, or external communication URLs associated with the service usage by referring to the service database 60, and a service output unit 813 that outputs the service usage and cookies, web storage, or external communication URLs to the user terminal 90, and an analysis item reference unit 82 which includes an analysis item acquisition unit 812 that acquires analysis items including the correspondence between the site URL of the site to be analyzed and the corresponding cookies, web storage, or external communication URLs, and an analysis item output unit 822 that outputs the site URL included in the analysis items and the corresponding cookies, web storage, or external communication URLs to the user terminal 90. This makes it possible to output the services used on the target site in association with the cookies, web storage, or external communication URLs for accessing the service usage. Not only can the service usage be listed, but the correspondence between the service usage and the analysis items can also be provided to the user.
[0095] Figure 14A shows the flow of the service referencing method performed by the reference device 80.
[0096] In step S31, the user specifies the target site they wish to access. In this example, the user specifies the target site from an input screen output by the reference device 80 to the display 91 of the user terminal 90. Figure 14B shows the target input screen on which the user specifies the target site. The analysis target input screen has an input form 915 and displays all rows of data from the site database 20 in a pull-down format for the user to select.
[0097] In step S32, the reference device 80 (the service acquisition unit 811 of the service reference unit 81) acquires all of the service services registered by the service identification method (see Figure 13) as services used at the analysis target site specified by the user in step S31 from the service database 70 (see Figure 9).
[0098] In step S33, the reference device 80 (the analysis item acquisition unit (an example of a third analysis item acquisition unit) 812 of the service reference unit 81) refers to the service database 60 (see Figure 8B) and acquires cookies, web storage, or external communication URLs using the service name as the key. For example, it acquires a cookie with the Name attribute name "app1" and the domain attribute value "example.com" corresponding to the service name "InsightPulse". Details of acquiring cookies, etc., are as described above.
[0099] In step S34, the reference device 80 (the service output unit 813 of the service reference unit 81) outputs the service, along with a cookie, web storage, or external communication URL, to the display of the user terminal 90 (see Figure 12). For example, the service name "InsightPulse" and the cookie corresponding to this service, with the Name attribute name "app1" and the domain attribute value "example.com", are output on a single line (see Figure 12).
[0100] The service reference method according to this embodiment is a method executed by a computer and includes the steps of: acquiring a service used by the aforementioned service identification method as a service used at the site to be analyzed; acquiring a cookie, web storage, or external communication URL associated with the service by referring to a service database; and outputting the service used and the cookie, web storage, or external communication URL. This makes it possible to output the services used at the target site in association with the cookie, web storage, or external communication URL for accessing the service. In addition to listing the services used within the site, it becomes possible to provide users with a list of services used and analysis items linked together.
[0101] Figure 15 shows the flow of the analysis information referencing method performed by the reference device 80.
[0102] In step S41, the user specifies the site to be analyzed that they wish to refer to. In this example, the user specifies the site to be analyzed from an input screen output by the reference device 80 to the display 91 of the user terminal 90. The analysis target input screen has an input form 915 and displays all rows of data from the site database 20 in a pull-down format (see Figure 14B).
[0103] In step S42, the reference device 80 (analysis item acquisition unit 821 of the service reference unit 81) acquires all analysis items registered by the analysis method (see Figure 6) as services used at the site to be analyzed from the analysis item database 40 (see Figure 5). For example, the analysis item acquisition unit 821 acquires analysis information from the first row of the upper table of the analysis item database 40 shown in Figure 5, where the site URL is "XXX.com", the Name attribute is app1, and the domain attribute is example.com.
[0104] In step S43, the reference device 80 (analysis item output unit 822 of the service reference unit 81) outputs all analysis information, which associates the site URL acquired by the analysis item acquisition unit 821 with cookies, web storage, or external communication URLs within the site, to the display of the user terminal 90 (see Figure 13). For example, the page URL "XXX.com" and the cookie issued on this page with the Name attribute name "app1" and domain attribute value "example.com" are output on a single line.
[0105] The analysis item referencing method according to this embodiment is a method executed by a computer and includes the steps of: acquiring analysis items registered by the aforementioned analysis method as analysis information of pages within the site to be analyzed; and outputting all acquired analysis information to the user terminal 90. This makes it possible to output the analysis items of the target site. It becomes possible to provide the user with a list of what analysis items the target site has.
[0106] The service identification system 1 according to this embodiment comprises an analysis device 10, a service identification device 50, a reference device 80, and a service database 60 in which data is registered, with cookies, web storage, and external communication URLs each associated with a service name. With this, the analysis device 10 extracts analysis items, the service identification device 50 identifies the service used on the site by matching these analysis items with the service database 60, and the reference device 80 provides information on this service to the user.
[0107] Furthermore, according to the service identification system 1 of this embodiment, the system includes: an analysis device 10 that acquires the site URL of a site to be analyzed, analyzes one or more pages within the site published at the site URL, extracts cookies issued by one or more pages, web storage that is set, or external communication URLs of external communications that occur, and registers the site URL of the page that issues cookies, sets web storage, or generates an external communication URL in association with the cookies issued by that page, web storage that is set, or external communication URLs that occur; a service identification device 50 that matches analysis items, including the correspondence between the site URL registered by the analysis device 10 and the cookies, web storage, or external communication URLs, with a service database 60, identifies the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as service used on the page at the site URL, and registers the site URL and the service in association; and a service database 60 in which data is registered in which each of the cookies, web storage, and external communication URLs is associated with a service. This makes it possible to manage external services used on a site in conjunction with cookies and other data issued to access those external services.
[0108] Furthermore, the service identification system 1 according to this embodiment includes an analysis item database 40 in which the correspondence between site URLs and cookies, web storage, or external communication URLs is registered by an analysis device, and an analysis item database 40 in which analysis items including the correspondence are acquired by the analysis device 10.
[0109] Furthermore, the service usage identification system 1 according to this embodiment further includes a reference device 80 that acquires service usage registered by the service usage identification device 50 as a service used at the site to be analyzed, and outputs the service usage.
[0110] Furthermore, the service identification system 1 according to this embodiment further comprises a service identification device 50 that registers site URLs and services in association with each other, and a reference device 80 that acquires the services.
[0111] Furthermore, the service identification system 1 according to this embodiment further comprises a site database 20 in which the site URL of at least one site to be analyzed is registered, and the site URL is acquired by the analysis device 10.
[0112] Furthermore, according to the service identification method of this embodiment, the method includes the steps of: obtaining the site URL of the site to be analyzed; analyzing one or more pages within the site published at the site URL to extract cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur; registering the site URL of the page that issues cookies, sets web storage, or generates an external communication URL in association with the cookies issued by that page, web storage set, or external communication URL that occurs; and matching the analysis items, including the correspondence between the site URL and cookies, web storage, or external communication URLs registered in the registration step, with the service database 60 to identify the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as services used on the pages at the site URL, and registering the site URL and the services used in association. The service database 60 contains data in which each of the cookies, web storage, and external communication URLs is associated with a service. This makes it possible to manage external services used on a site in conjunction with cookies and other data issued to access those external services.
[0113] Furthermore, according to the program of this embodiment, the following steps are performed on one or more computers: obtaining the site URL of the site to be analyzed, analyzing one or more pages within the site published at the site URL, extracting cookies issued by one or more pages, web storage set, or external communication URLs of external communications that occur, registering the site URL of the page that issues cookies, sets web storage, or generates an external communication URL in association with the cookies issued by that page, the web storage set, or the external communication URL that occurs, and matching the analysis items, including the correspondence between the site URL and cookies, web storage, or external communication URLs registered in the registration step, with the service database 60, identifying the services corresponding to the cookies, web storage, or external communication URLs included in the analysis items as services used on the pages at the site URL, and registering the site URL and the services used in association. The service database 60 is a database in which data is registered in which each of the cookies, web storage, and external communication URLs is associated with a service. This makes it possible to manage external services used on a site in conjunction with cookies and other data issued to access those external services.
[0114] Various embodiments of the present invention may be described with reference to flowcharts and block diagrams, where a block may represent (1) a stage in a process in which an operation is performed, or (2) a section of a device having the role of performing the operation. Specific stages and sections may be implemented by dedicated circuits, programmable circuits supplied with computer-readable instructions stored on a computer-readable medium, and / or processors supplied with computer-readable instructions stored on a computer-readable medium. Dedicated circuits may include digital and / or analog hardware circuits, and may include integrated circuits (ICs) and / or discrete circuits. Programmable circuits may include reconfigurable hardware circuits, including logical AND, logical OR, logical XOR, logical NAND, logical NOR, and other logic operations, flip-flops, registers, memory elements such as field-programmable gate arrays (FPGAs), programmable logic arrays (PLAs), etc.
[0115] Computer-readable media may include any tangible device capable of storing instructions to be executed by a suitable device, and as a result, computer-readable media having instructions stored therein will comprise a product containing instructions that can be executed to create means for performing operations specified in a flowchart or block diagram. Examples of computer-readable media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable media may include floppy disks, diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disk read-only memory (CD-ROM), digital versatile disk (DVD), Blu-ray® disc, memory stick, integrated circuit card, etc.
[0116] Computer-readable instructions may include assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk®, Java®, C++, and conventional procedural programming languages such as the C programming language or similar programming languages.
[0117] Computer-readable instructions are provided locally or via a wide area network (WAN) such as a local area network (LAN) or the internet to the processor or programmable circuit of a programmable data processing device such as a computer, and may be executed to create means for performing operations specified in a flowchart or block diagram. Here, the computer may be a PC (personal computer), tablet computer, smartphone, workstation, server computer, general-purpose computer, or special-purpose computer, and may also be a computer system in which multiple computers are connected. Such a computer system in which multiple computers are connected is also called a distributed computing system and is a computer in a broad sense. In a distributed computing system, multiple computers execute a program by having each computer execute a part of the program and by passing data during program execution between computers as needed.
[0118] Examples of processors include computer processors, central processing units (CPUs), processing units, microprocessors, digital signal processors, controllers, and microcontrollers. A computer may have one or more processors. In a multiprocessor system with multiple processors, each processor executes a portion of the program, and the processors collectively execute the program by passing program execution data between them as needed. For example, in the execution of multitasks, each of the multiple processors may execute a portion of each task in small chunks by switching tasks at each time slice. In this case, which part of a program each processor executes changes dynamically. Which part of a program each of the multiple processors executes may also be statically determined by multiprocessor-aware programming.
[0119] Figure 16 shows an example of a computer 1200 in which multiple aspects of the present invention may be embodied in whole or in part. A program installed on the computer 1200 can cause the computer 1200 to function as an operation or one or more sections of an apparatus according to an embodiment of the present invention, or to execute such operation or one or more sections, and / or to cause the computer 1200 to execute a process or a stage of such process according to an embodiment of the present invention. Such a program may be executed by the CPU 1212 to cause the computer 1200 to perform a particular operation associated with some or all of the blocks in the flowcharts and block diagrams described herein.
[0120] The computer 1200 according to this embodiment includes a CPU 1212, RAM 1214, a graphics controller 1216, and a display device 1218, which are interconnected by a host controller 1210. The computer 1200 also includes input / output units such as a communication interface 1222, a storage device 1224 such as a hard disk drive, a DVD-ROM drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The computer also includes legacy input / output units such as a ROM 1230 and a keyboard 1242, which are connected to the input / output controller 1220 via an input / output chip 1240.
[0121] The CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. The graphics controller 1216 acquires image data generated by the CPU 1212 from the frame buffer provided in RAM 1214 or from itself, and displays the image data on the display device 1218.
[0122] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 in the computer 1200. The DVD-ROM drive 1226 reads programs or data from the DVD-ROM 1227 and provides them to the storage device 1224 via the RAM 1214. The IC card drive reads programs and data from the IC card and / or writes programs and data to the IC card.
[0123] The ROM 1230 stores boot programs and / or programs that depend on the computer 1200's hardware, which are executed by the computer 1200 when activated. The input / output chip 1240 may also connect various input / output units to the input / output controller 1220 via parallel ports, serial ports, keyboard ports, mouse ports, etc.
[0124] The program is provided on a computer-readable medium such as a DVD-ROM 1227 or an IC card. The program is read from the computer-readable medium and installed on a storage device 1224, RAM 1214, or ROM 1230, which are examples of computer-readable mediums, and executed by the CPU 1212. The information processing described within these programs is read by the computer 1200, resulting in coordination between the program and the various types of hardware resources described above. The apparatus or method may be configured to realize the manipulation or processing of information in accordance with the use of the computer 1200.
[0125] For example, when communication is performed between a computer 1200 and an external device, the CPU 1212 may execute a communication program loaded into the RAM 1214 and, based on the processing described in the communication program, instruct the communication interface 1222 to perform communication processing. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer processing area provided in a recording medium such as the RAM 1214, storage device 1224, DVD-ROM 1227, or IC card, transmits the read transmission data to the network, or writes received data received from the network to a receive buffer processing area provided on the recording medium.
[0126] Furthermore, the CPU 1212 may read all or necessary parts of a file or database stored on an external recording medium such as a storage device 1224, a DVD-ROM drive 1226 (DVD-ROM 1227), or an IC card into the RAM 1214, and perform various types of processing on the data in the RAM 1214. The CPU 1212 then writes the processed data back to the external recording medium.
[0127] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and subjected to information processing. The CPU 1212 may perform various types of processing on the data read from the RAM 1214, including various types of operations, information processing, conditional judgments, conditional branching, unconditional branching, information retrieval / replacement, etc., as described throughout this disclosure and specified by the program instruction sequence, and write the results back to the RAM 1214. The CPU 1212 may also retrieve information in files, databases, etc., within the recording medium. For example, if a plurality of entries having attribute values of a first attribute, each associated with an attribute value of a second attribute, are stored in the recording medium, the CPU 1212 may search among the plurality of entries for an entry that matches the condition for which the attribute value of the first attribute is specified, read the attribute value of the second attribute stored in that entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.
[0128] The program or software module described above may be stored on or near the computer 1200 on a computer-readable medium. Alternatively, a recording medium such as a hard disk or RAM provided within a server system connected to a dedicated communication network or the Internet can be used as a computer-readable medium, thereby providing the program to the computer 1200 via the network.
[0129] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications or improvements can be made to the above embodiments. It will be clear from the claims that such modified or improved forms may also be included in the technical scope of the present invention.
[0130] It should be noted that the execution order of operations, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not explicitly stated as "before," "prior to," etc., and that these can be performed in any order unless the output of a previous process is used in a later process. Even if the operation flow in the claims, specifications, and drawings is described using phrases such as "first," "next," etc. for convenience, this does not mean that it is mandatory to perform the operations in that order.
[0131] This specification also discloses the configurations described in the following items: (Item 1) A service identification device comprising: an analysis item acquisition unit that acquires analysis items including a correspondence between the site URL of a site to be analyzed and a cookie issued on at least one page within the site to be analyzed, a web storage that is set, or an external communication URL of an external communication that occurs; a service identification unit that matches the analysis items with a service database to identify the service corresponding to the cookie, the web storage, or the external communication URL included in the analysis items as a service used on the at least one page; and a service registration unit that registers the site URL and the service in association, wherein the service database contains data in which each of the cookies, web storage, and external communication URLs is associated with a service. (Item 2) The service identification device according to Item 1, wherein the analysis item acquisition unit acquires the analysis items from the analysis item database, and the analysis item database contains registered correspondences between the site URL and the cookie, the web storage, or the external communication URL. (Item 3) The service registration unit registers the site URL, the cookie, the web storage, or the external communication URL as not being associated with a service if the service identification unit is unable to identify the service, as described in Item 1.(Item 4) The service identification device according to Item 1, wherein the service identification unit includes at least one of the following: an external communication URL matching unit that extracts services corresponding to data that at least partially matches the external communication URL included in the analysis item from the service database and acquires the services as services; a cookie matching unit that extracts services corresponding to data that at least partially matches the Name attribute of the cookie included in the analysis item from the service database and acquires the services as services; and a web storage matching unit that extracts services corresponding to data that partially matches the Origin of the web storage included in the analysis item from the service database and acquires the services as services. (Item 5) The service identification device according to Item 4, wherein if there are multiple data that at least partially match the Name attribute of the cookie, the cookie matching unit acquires the most numerous services among the multiple services indicated by the multiple data as the service to be used. (Item 6) The service identification device according to Item 1, wherein the service registration unit registers the site URL and the service to be used in the service to be used in the service to be used database. (Item 7) An analysis device comprising: an analysis target acquisition unit that acquires the site URL of a site to be analyzed; an analysis execution unit that analyzes one or more pages within the site published at the site URL and extracts cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur; and an analysis item registration unit that associates the site URL of the page from which the cookies, web storage, or external communication URLs were extracted with the cookies, web storage, or external communication URLs extracted from the page and registers them so that they can be acquired by the service identification device described in Item 1.(Item 8) The analysis device according to Item 7, wherein the analysis execution unit comprises: a site access unit that uses a virtual browser to specify the site URL and sends a request to a server operating the site to be analyzed, and receives a response from the server; an analysis item extraction unit that extracts cookies issued by the one or more pages or external communication URLs of external communications generated from the response, and further acquires data stored in the web storage of the virtual browser; and a script execution unit that, if the response contains a script, executes the script using the virtual browser to access the service. (Item 9) The analysis device according to Item 8, further comprising a link extraction unit that extracts the page URL of a linked page from the response, wherein the site access unit further specifies the page URL of the linked page and sends a request to a server operating the site to be analyzed, and receives a response from the server. (Item 10) The analysis device according to Item 8, wherein the analysis item registration unit registers the correspondence between the site URL and the cookies, the web storage, or the external communication URL in the analysis item database. (Item 11) A reference device comprising a service reference unit having a service acquisition unit that acquires the service used as a service used by the service used identification device described in Item 1, and a service output unit that outputs the service used. (Item 12) The reference device according to Item 11, wherein the service acquisition unit acquires the service used from a service database, and the service used database is registered by the service used identification device in association with the site URL and the service used. (Item 13) The reference device according to Item 12, further comprising an analysis item reference unit having a second analysis item acquisition unit that acquires an analysis item including the correspondence between the site URL of the site to be analyzed and a cookie, web storage, or external communication URL associated with the site URL, and an analysis item output unit that outputs the site URL included in the analysis item and the cookie, web storage, or external communication URL corresponding to the site URL.(Item 14) The reference device described in Item 13, wherein the second analysis item acquisition unit acquires the analysis items from the analysis item database, and the analysis item database is in which the correspondence between the site URL and the cookie, the web storage, or the external communication URL is registered. (Item 15) A method for identifying a service being used, which is performed by a computer, comprising the steps of: acquiring an analysis item that includes a correspondence between the site URL of the site to be analyzed and a cookie issued on at least one page within the site to be analyzed, the web storage set, or the external communication URL of an external communication that occurs; matching the analysis item with a service database to identify a service corresponding to the cookie, the web storage, or the external communication URL included in the analysis item as a service being used on at least one page; and registering the site URL and the service being used in association, wherein the service database is in which data is registered in which each of the cookies, web storage, and external communication URLs is associated with a service. (Item 16) An analysis method performed by a computer, comprising: a step of obtaining the site URL of a site to be analyzed; a step of analyzing one or more pages within the site published at the site URL and extracting cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur; and a step of associating the site URL of the page on which the cookie is issued, the web storage is set, or the external communication URL occurs with the cookie issued on the page, the web storage set, or the external communication URL that occurs, and registering them in a manner that can be obtained by the service usage identification method described in Item 15. (Item 17) A service usage reference method performed by a computer, comprising: a step of obtaining the service usage registered by the service usage identification method described in Item 15 as a service used on a site to be analyzed; and a step of outputting the service usage.(Item 18) A service identification program that causes a computer to execute the following steps: a step to obtain an analysis item that includes the correspondence between the site URL of a site to be analyzed and a cookie issued on at least one page within the site to be analyzed, the web storage set, or the URL of an external communication that occurs; a step to match the analysis item with a service database to identify the service corresponding to the cookie, the web storage, or the external communication URL included in the analysis item as a service used on at least one page; and a service registration step that associates the site URL with the service used, wherein the service database contains data in which each of the cookies, web storage, and external communication URLs is associated with a service. (Item 19) An analysis program to cause a computer to execute the following: (Item 19) A procedure for obtaining the site URL of a site to be analyzed; a procedure for analyzing one or more pages within the site published at the site URL and extracting cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur; a procedure for associating the site URL of a page on which a cookie is issued, web storage is set, or an external communication URL occurs with the cookie issued on that page, the web storage set, or the external communication URL that occurs, and registering them so that they can be obtained by the second computer when the service identification program described in Item 18 is executed on the second computer. (Item 20) A service reference program to cause a computer to execute the following: a procedure for obtaining the service used as a service used on the site to be analyzed, which has been registered by having the service identification program described in Item 18 executed on the third computer; a procedure for outputting the service used.(Item 21) A service identification system comprising: a service identification device described in Item 1; an analysis device described in Item 7; a reference device described in Item 11; and a service database in which data is registered that each of cookies, web storage, and external communication URLs is associated with a service. (Item 22) A system for identifying services, comprising: an analysis device that obtains the site URL of a site to be analyzed, analyzes one or more pages within the site published at the site URL, extracts cookies issued by the one or more pages, sets web storage, or generates external communication URLs, and registers the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the page, the web storage, or the generated external communication URL; a service identification device that matches analysis items, including the correspondence between the site URL and the cookie, web storage, or external communication URL registered by the analysis device, with a service database, identifies the services corresponding to the cookie, web storage, or external communication URL included in the analysis items as services used on the page at the site URL, and registers the site URL and the service in association with the service; and a service database in which data is registered in which each of the cookies, web storage, and external communication URLs is associated with a service. (Item 23) The service identification system according to Item 22, further comprising the analysis item database in which the correspondence between the site URL and the cookie, the web storage, or the external communication URL is registered by the analysis device, and the analysis item including the correspondence is acquired by the analysis device. (Item 24) The service identification system according to Item 22, further comprising a reference device that acquires the service used as a service used by the service identification device and outputs the service used as a service used on the site to be analyzed.(Item 25) The service identification system according to Item 24, further comprising the service identification system, which is a service identification system, which registers the site URLs and the services used in association with the service used by the service identification system, and from which the services used are acquired by the reference system. (Item 26) The service identification system according to Item 22, which further comprises the site identification system, which is a site database in which the site URLs of at least one site to be analyzed are registered, and from which the site URLs are acquired by the analysis system. (Item 27) A method for identifying a service, comprising: obtaining the site URL of a site to be analyzed; analyzing one or more pages within the site published at the site URL to extract cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur; registering the site URL of a page that issues the cookie, sets the web storage, or generates the external communication URL in association with the cookie issued by the page, the web storage set, or the external communication URL that occurs; and matching the analysis items, including the correspondence between the site URL and the cookie, web storage, or external communication URL registered in the registration step, with a service database to identify the service corresponding to the cookie, web storage, or external communication URL included in the analysis item as a service used on a page at the site URL; and registering the site URL and the service used in association, wherein the service database contains data in which each of the cookies, web storage, and external communication URLs is associated with a service.(Item 28) A procedure to obtain the site URL of a site to be analyzed, analyze one or more pages within the site published at the site URL, extract cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur, register the site URL of the page that issues the cookie, sets the web storage, or generates the external communication URL, and associate the cookie issued, the web storage set, or the generated external communication URL with the page; and a procedure to match the analysis items, including the correspondence between the site URL and the cookie, web storage, or external communication URL registered by the registration procedure, with a service database, identify the services corresponding to the cookie, web storage, or external communication URL included in the analysis items as services used on the page at the site URL, and register the site URL and the service in association, wherein the service database contains data in which each of the cookies, web storage, and external communication URLs is associated with a service. A program for identifying the services to be used.
[0132] 1...System (Service Identification System), 10...Analysis Device, 11...Analysis Target Acquisition Unit, 12...Analysis Execution Unit, 13...Analysis Item Registration Unit, 20...Site Database, 30...Analysis Target Server, 31...Cookie Settings, 32...External Communication URL Settings, 33...Script Tag, 34...Link Tag, 35...Status Code Information, 40...Analysis Item Database, 50...Service Identification Device, 51...Analysis Item Acquisition Unit, 52...Service Identification Unit, 53...Service Registration Unit, 60...Service Database, 70...Service Database, 80...Reference Device, 81...Service Reference Unit, 82...Analysis Item Reference Unit, 90...User Terminal, 91...Display, 99...Network, 121...Site Access Unit, 122...Analysis Item Extraction Unit, 123...Script Execution Unit, 124...Link Extraction Unit, 521 ...External communication URL matching unit, 522...Cookie matching unit, 523...Web storage matching unit, 811...Service acquisition unit, 812...Analysis item acquisition unit (third analysis item acquisition unit), 813...Service output unit, 821...Analysis item acquisition unit (second analysis item acquisition unit), 822...Analysis item output unit, 911...Target site display unit, 912...Service display unit, 913...Target site display unit, 914...Analysis item display unit, 915...Input form, 1200...Computer, 1210...Host controller, 1212...CPU, 1214...RAM, 1216...Graphics controller, 1218...Display device, 1220...Input / output controller, 1222...Communication interface, 1224...Storage device, 1226...DVD-ROM drive, 1240...Input / output chip, 1242...Keyboard.
Claims
1. A service identification device comprising: an analysis item acquisition unit that acquires analysis items including the correspondence between the site URL of a site to be analyzed and a cookie issued, a web storage set, or an external communication URL of an external communication that occurs on at least one page within the site to be analyzed; a service identification unit that matches the analysis items with a service database to identify the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page; and a service registration unit that registers the site URL and the service in association, wherein the service database contains data in which each of the cookies, web storage, and external communication URLs is associated with a service.
2. The service identification device according to claim 1, wherein the analysis item acquisition unit acquires the analysis items from the analysis item database, and the analysis item database is a database in which the correspondence between the site URL and the cookie, the web storage, or the external communication URL is registered.
3. The service registration unit registers the site URL, the cookie, the web storage, or the external communication URL as not being associated with a service if the service identification unit is unable to identify the service, as described in claim 1.
4. The service identification device according to claim 1, wherein the service identification unit includes at least one of the following: an external communication URL matching unit that extracts a service from the service database that corresponds to data that at least partially matches the external communication URL included in the analysis item, and acquires the service as a service; a cookie matching unit that extracts a service from the service database that corresponds to data that at least partially matches the Name attribute of the cookie included in the analysis item, and acquires the service as a service; and a web storage matching unit that extracts a service from the service database that corresponds to data that partially matches the Origin of the web storage included in the analysis item, and acquires the service as a service.
5. The service utilization identification device according to claim 4, wherein if there are multiple data in the Name attribute that at least partially match the cookie, the cookie matching unit acquires the service that is most frequently used among the multiple services indicated by the multiple data as the service utilization service.
6. The service registration unit registers the site URL and the service in a service database, as described in claim 1.
7. An analysis device comprising: an analysis target acquisition unit that acquires the site URL of a site to be analyzed; an analysis execution unit that analyzes one or more pages within the site published at the site URL and extracts cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur; and an analysis item registration unit that associates the site URL of the page from which the cookies, web storage, or external communication URLs were extracted with the cookies, web storage, or external communication URLs extracted from the page and registers them in a manner that can be acquired by the service identification device described in claim 1.
8. The analysis device according to claim 7, wherein the analysis execution unit includes: a site access unit that sends a request to a server operating the site to be analyzed by specifying the site URL using a virtual browser and receives a response from the server; an analysis item extraction unit that extracts cookies issued by the one or more pages or external communication URLs of external communications generated from the response, and further obtains data stored in the web storage of the virtual browser; and a script execution unit that, if the response includes a script, executes the script using the virtual browser to access the service.
9. The analysis device according to claim 8, further comprising a link extraction unit that extracts the page URL of the linked page from the response, wherein the site access unit further specifies the page URL of the linked page and sends a request to a server operating the site to be analyzed, and receives a response from the server.
10. The analysis device according to claim 8, wherein the analysis item registration unit registers the correspondence between the site URL and the cookie, the web storage, or the external communication URL in the analysis item database.
11. A reference device comprising a service reference unit having a service acquisition unit that acquires the service used as a service used by the service used identification device described in claim 1, and a service output unit that outputs the service used.
12. The reference device according to claim 11, wherein the service acquisition unit acquires the service from the service database, and the service database is registered by the service identification device in association with the site URL and the service.
13. The reference device according to claim 12, further comprising: a second analysis item acquisition unit that acquires analysis items including the correspondence between the site URL of a site to be analyzed and a cookie, web storage, or external communication URL associated with the site URL; and an analysis item output unit that outputs the site URL included in the analysis items and the cookie, web storage, or external communication URL corresponding to the site URL.
14. The reference device according to claim 13, wherein the second analysis item acquisition unit acquires the analysis items from the analysis item database, and the analysis item database contains registered correspondences between the site URL and the cookie, the web storage, or the external communication URL.
15. A method for identifying a service being used, performed by a computer, comprising the steps of: obtaining an analysis item that includes a correspondence between the site URL of a site to be analyzed and a cookie issued, a web storage set, or an external communication URL of an external communication that occurs on at least one page within the site to be analyzed; matching the analysis item with a service database to identify a service corresponding to the cookie, the web storage, or the external communication URL included in the analysis item as a service being used on the at least one page; and registering the site URL and the service being used in association, wherein the service database contains data in which each of the cookies, web storage, and external communication URLs is associated with a service.
16. A computer-based analysis method comprising: obtaining the site URL of a site to be analyzed; analyzing one or more pages within the site published at the site URL to extract cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur; and registering the site URL of the page on which the cookie is issued, the web storage is set, or the external communication URL occurs, in association with the cookie issued on the page, the web storage set, or the external communication URL that occurs, so that it can be obtained by the service identification method described in claim 15.
17. A method for referencing user services executed by a computer, comprising the steps of: acquiring a user service registered by the user service identification method described in claim 15 as a service used at a site to be analyzed; and outputting the user service.
18. A service identification program that causes a computer to execute the following steps: a procedure for obtaining analysis items including the correspondence between the site URL of a site to be analyzed and a cookie issued, web storage set, or external communication URL of an external communication that occurs on at least one page within the site to be analyzed; a procedure for matching the analysis items with a service database to identify the service corresponding to the cookie, web storage, or external communication URL included in the analysis items as a service used on at least one page; and a service registration procedure for registering the site URL and the service used, wherein the service database contains data in which each of the cookies, web storage, and external communication URLs is associated with a service.
19. An analysis program for causing a computer to execute: a procedure for obtaining the site URL of a site to be analyzed; a procedure for analyzing one or more pages within the site published at the site URL and extracting cookies issued by the one or more pages, web storage set, or external communication URLs of external communications that occur; and a procedure for associating the site URL of a page on which a cookie is issued, web storage is set, or an external communication URL occurs with the cookie issued on that page, the web storage set, or the external communication URL that occurs, and registering them so that they can be obtained by the second computer when the service identification program described in claim 18 is executed on the second computer.
20. A service reference program for causing a computer to execute a procedure for obtaining a registered service used at a site to be analyzed by having a third computer execute the service use identification program described in claim 18, and a procedure for outputting the service use.
21. A service identification system comprising: a service identification device according to claim 1; an analysis device according to claim 7; a reference device according to claim 11; and a service database in which data is registered in which cookies, web storage, and external communication URLs are each associated with services.
Citation Information
Patent Citations
Use service identification apparatus
JP2018185741A
Methods and apparatus to identify session users with cookie information
US20150180991A1