Used service identification device, analysis device, reference device, and methods, programs, and systems executed by these devices
Patent Information
- Application Number
- TW114140470
- Authority / Receiving Office
- TW · TW
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2024-10-28
- Filing Date
- 2025-10-20
- Publication Date
- 2026-11-11
- Estimated Expiration
- 2045-10-19
AI Technical Summary
Existing service identification methods, such as those described in Patent Document 1, fail to determine the factors causing external requests, such as cookies, leading to incomplete service identification.
A service identification device equipped with an analysis item acquisition unit that extracts and compares cookies, web page storage, and external communication URLs with a service database to identify the corresponding services, along with a service login unit to associate website URLs with services, and a service identification unit to register and log in to these services.
Enables comprehensive identification of services used on a website by analyzing cookies, web storage, and external communication URLs, providing accurate service information to website administrators.
Smart Images

Figure TWG2TB001920860_001 
Figure TWG2TB001920860_002 
Figure TWG2TB001920860_003
Abstract
Description
Technical Field
[0001] This invention relates to a service identification device, an analysis device, a reference device, a service identification method, an analysis method, a service reference method, a service identification program, an analysis program, a service reference program, and a service identification system. Prior Technology
[0002] A known service identification device involves launching an internet browser, accessing the website of the target object, monitoring HTTP (Hyperfile Transfer Protocol) requests and extracting the URLs of external requests, and identifying the domain and path of the external request URL corresponding to the service (e.g., see Patent Document 1). However, this method cannot determine what factors, such as cookies, caused the external request. [Previous Technical Documents] [Patent Literature] [Patent Document 1] Japanese Patent Application Publication No. 2018-185741 Summary of the Invention
[0003] (Project 1) The service identification device can be equipped with an analysis item acquisition unit, which acquires analysis items containing the correspondence between the website URL of the analysis target website and the external communication URL of at least one page within the analysis target website, such as cookies issued, web page storage devices set, or external communications that occur. The service identification device may include a service identification unit that compares the analysis item with a service database and identifies the service corresponding to the cookie, web page storage, or external communication URL contained in the analysis item as a service used on at least one page. The service identification device may include a service login unit, which associates the website URL with the service and logs in. This service database contains data that associates cookies, web storage, and external communication URLs with the service. (Project 2) The analysis project can be obtained from the analysis project database. The database for this analysis project allows users to log in to the mapping between the website URL and the cookie, web page storage, or external communication URL. (Project 3) The service access registration unit may register the website URL and the cookie, web page storage, or external communication URL as not paired with the service if the service cannot be identified by the service access identification unit. (Project 4) The service identification unit may include an external communication URL comparison unit, which extracts the service corresponding to the data that is at least partially consistent with the external communication URL contained in the analysis item from the service database, and obtains the service as the service to be used. The service identification unit may include a cookie comparison unit, which extracts the service corresponding to the data in the service database that is at least partially consistent with the Name attribute of the cookie included in the analysis item, and obtains the service as the service to be used. The service identification unit may include a webpage storage comparison unit, which extracts the service corresponding to the data that matches the source (Origin) of the webpage storage included in the analysis item from the service database, and obtains the service as the service to be used. (Project 5) The cookie comparison unit can, when there are multiple pieces of information that are at least partially identical to the cookie in the Name attribute, select the service that is most frequently used among the multiple services represented by the multiple pieces of information. (Project 6) The service login section allows the website URL to be associated with the service and logged into the service database.
[0004] (Project 7) The analysis device may include an analysis object acquisition unit, which acquires the website URL of the analysis object's website. The analysis device may include an analysis execution unit that analyzes one or more pages within a website published by the website URL and extracts cookies issued by the one or more pages, web page storage settings, or external communication URLs of external communications that occur. The analysis device may include an analysis item registration unit that associates the website URL of the page from which the cookie, web page storage, or external communication URL has been extracted with the cookie, web page storage, or external communication URL extracted from the page, and registers the information in a manner that can be obtained using a service identification device as described in item 1. (Project 8) The analysis execution unit may have a website access unit that uses a virtual browser to specify the website URL, sends a request to the server operating the website of the analysis object, and receives a response from the server. The analysis execution unit may have an analysis item extraction unit, which extracts the external communication URL of the cookies issued by the one or more pages or the external communications that occurred from the response, and then obtains the data stored in the web page storage of the virtual browser. The analysis execution unit may have a script execution unit, which, if the response contains a script, accesses the service by executing the script through the virtual browser. (Project 9) The analysis device may further include a link extraction unit that extracts the page URL of the page with the link address from the response. The website access unit can further specify the page URL of the linked address, send a request to the server operating the website of the analysis object, and receive a response from the server. (Project 10) The analysis project login department can log the correspondence between the website URL and the cookie, web page storage, or external communication URL into the analysis project database.
[0005] (Project 11) The reference device may include a service acquisition unit that acquires the service registered by the service identification device as described in Item 1, and uses it as a service on the website of the target analysis. The reference device may include a service reference unit, which has a service output unit that outputs the service. (Project 12) The service provider can obtain the service from the service database. The service database can use the service identification device to associate the website URL with the service and register it. (Project 13) This reference device can be further equipped with an analysis project reference section. The analysis item reference unit may have a second analysis item acquisition unit, which acquires analysis items containing the correspondence between the website URL of the analysis target website and the corresponding cookies, web storage devices, or external communication URLs. The analysis project reference unit may have an analysis project output unit, which outputs the website URL contained in the analysis project and the corresponding cookie, web storage, or external communication URL of the website URL. (Project 14) The second analysis project can be obtained from the analysis project database. The database for this analysis project allows users to log in to the mapping between the website URL and the cookie, web page storage, or external communication URL.
[0006] (Project 15) A service identification method performed by a computer may include the following stages: obtaining an analysis item containing the correspondence between the website URL of the target website and the URL of an external communication issued by at least one page within the target website, a set web page storage device, or an external communication that occurs. The service identification method may include the following stages: comparing the analysis item with a service database, and identifying the service corresponding to the cookie, web page storage, or external communication URL contained in the analysis item as the service used on at least one page. The service identification method may include the following stages: associating the website URL with the service and logging in. This service database contains data that associates cookies, web storage, and external communication URLs with the service.
[0007] (Project 16) Computer-based analysis methods may include the following stages: obtaining the website URL of the target website. The analysis method may include the following stages: analyzing one or more pages within the website to which the website URL is published, and extracting the external communication URLs of cookies issued by the one or more pages, web page storage devices set, or external communications that occur. The analysis method may include the following stages: matching the website URL of the page that issues the cookie, sets the web page storage, or generates the external communication URL with the cookie issued by the page, the web page storage set, or the external communication URL generated, and logging in in a manner that can be obtained by using the service identification method as described in item 15.
[0008] (Project 17) The computer-executed service reference method may have the following stages: obtaining the service registered by means of the service identification method described in item 15, as a service used on the website of the analysis target. The service reference method may have a stage for outputting the service.
[0009] (Project 18) The service identification program can enable a computer to perform the following procedure: obtain an analysis item containing the correspondence between the URL of the target website and the URL of the external communication issued by at least one page within the target website, the set web storage, or the external communication that occurs. The service identification program enables a computer to perform the following procedure: compare the analysis item with a service database, and identify the service corresponding to the cookie, web page storage, or external communication URL contained in the analysis item as a service used on at least one page. This service identification program enables a computer to execute a service program that associates the website URL with the service and logs in. This service database contains data that associates cookies, web storage, and external communication URLs with the service.
[0010] (Project 19) The analysis program allows the computer to execute the following procedure: obtain the website URL of the website being analyzed. This analysis program enables a computer to perform the following procedures: analyze one or more pages within a website whose URL is published, and extract the external communication URLs of cookies issued by those one or more pages, web page storage settings, or external communications that occur. The analysis program enables a computer to perform the following procedures: to correspond the website URL of the page that issues the cookie, sets the web page storage, or generates the external communication URL with the cookie issued by that page, the web page storage set, or the external communication URL generated, and to log in using the service identification program as described in item 18 when the second computer is executed.
[0011] (Project 20) The service reference program can be used to enable a computer to perform the following procedure: obtain the service accessed by the service access identification program as described in item 18 by enabling a third computer to perform the service accessed on the target website. This service reference program allows the computer to execute a program that outputs the service.
[0012] (Project 21) The service identification system can have the service identification device described in Project 1. The service identification system may have the analytical apparatus described in Item 7. The service identification system may have a reference device as described in Item 11. The service identification system can be used to access a service database that maps cookies, web storage, and external communication URLs to services.
[0013] (Project 22) The service identification system can be equipped with an analysis device that obtains the website URL of the target website, analyzes one or more pages within the website published by the website URL, extracts the cookies issued by the one or more pages, the web storage set, or the external communication URLs of the external communications that occur, and makes the website URL of the page that issued the cookie, set the web storage, or the external communication URL correspond to the cookie issued by the page, the web storage set, or the external communication URL that occurred, and registers them. The service identification system may include a service identification device, which compares the analysis items containing the correspondence between the website URL and the cookie, web storage, or external communication URL registered by the analysis device with the service database, and identifies the service corresponding to the cookie, web storage, or external communication URL contained in the analysis item as the service used on the page of the website URL, so that the website URL is associated with the service and registered. The service identification system can be equipped with a service database that records information that associates cookies, web storage, and external communication URLs with services. (Project 23) The service identification system can further have an analysis item database, which is obtained by logging the correspondence between the website URL and the cookie, the web page storage, or the external communication URL through the analysis device, and obtaining the analysis items containing the correspondence through the analysis device. (Project 24) The service identification system may further include a reference device, which obtains the service registered by the service identification device as the service used on the website of the analysis target, and outputs the service. (Project 25) The service identification system can further include a service database, which is established by using the service identification device to associate the website URL with the service and register it, and by using the reference device to obtain the service. (Project 26) The service identification system can further include a website database, which records the website URL of at least one target website and obtains the website URL through the analysis device.
[0014] (Project 27) The service identification method can include the following stages: obtaining the website URL of the target website, analyzing one or more pages within the website published by the website URL, extracting the external communication URL of the cookies issued by the one or more pages, the web storage set by the page, or the external communication that occurs, and matching the website URL of the page that issued the cookie, set the web storage, or the external communication URL with the cookie issued by the page, the web storage set by the page, or the external communication URL that occurs, and logging in. The service identification method may include the following stages: comparing the analysis items containing the correspondence between the website URL and the cookie, web storage, or external communication URL registered through the registration stage with the service database, identifying the service corresponding to the cookie, web storage, or external communication URL contained in the analysis items as the service used on the page of the website URL, and registering the website URL with the service. This service database contains data that associates cookies, web storage, and external communication URLs with the service.
[0015] (Project 28) The service identification program can enable one or more computers to perform the following procedures: obtain the website URL of the target website, analyze one or more pages within the website published by the website URL, extract the external communication URL of the cookies issued by the one or more pages, the web storage set by the page, or the external communication URL that occurs, and match the website URL of the page that issued the cookie, set the web storage, or the external communication URL with the cookie issued by the page, the web storage set by the page, or the external communication URL that occurs, and register them. The service identification program enables one or more computers to perform the following procedure: compare the analysis items containing the correspondence between the website URL and the cookie, web storage, or external communication URL registered through the login program with the service database, identify the service corresponding to the cookie, web storage, or external communication URL contained in the analysis item as the service used on the page of the website URL, and register the website URL with the service. This service database contains data that associates cookies, web storage, and external communication URLs with the service.
[0016] Furthermore, the above description of the invention does not list all the features of the invention. Moreover, sub-combinations of these features can also constitute an invention. Simple Explanation of the Diagram
[0017] Figure 1 shows a schematic configuration of the service identification system in this embodiment. Figure 2 shows the functional composition of the analysis device. Figure 3 shows one example of login information for a website database. Figure 4 shows one example of the data contained in an HTTP response sent from the analysis object server. Figure 5 shows one example of login information for the analysis project database. Figure 6 shows the analysis process. Figure 7 shows the functional configuration of the service identification device. Figure 8A shows one example of login information for the service database. Figure 8B shows one example of login information for the service database. Figure 9 shows one example of login information using the service database. Figure 10 shows the service identification process. Figure 11 shows the functional configuration of the reference device. The screen shown in Figure 12 displays the cookies, web storage, or external communication URLs corresponding to the service obtained by the project acquisition department. The screen shown in Figure 13 displays the website URLs and cookies, web storage devices, or external communication URLs obtained by the analysis project acquisition department. Figure 14A shows the reference process for utilizing the service. Figure 14B shows the input screen for the analysis object. Figure 15 shows the reference flow for the analysis project. Figure 16 shows one example of the components of a computer. Implementation
[0018] The present invention will now be described through embodiments thereof, but these embodiments do not limit the scope of the invention for which a patent is sought. Furthermore, not all combinations of features described in the embodiments are necessary for the solution of the invention.
[0019] Figure 1 shows a schematic configuration of the service identification system (also referred to as System 1) in the first embodiment. System 1 is a network system used to analyze a website (also referred to as a site), identify the services used on the website, and provide information related to the identified services to user terminals 90 used by the website administrator. System 1 includes an analysis device 10, a service identification device 50, and a reference device 80. System 1 may further include a website database (website DB) 20, an analysis item database (analysis item DB) 40, a service database (service DB) 60, and a service utilization database (service utilization DB) 70. These databases are connected and can communicate with each other via a network 99. Furthermore, the database is also referred to as a DB.
[0020] Furthermore, Network 99 is a communication network that connects various databases, such as Analysis Device 10, Service Identification Device 50, Reference Device 80, and Website Database 20, enabling them to communicate with each other. One example of Network 99 is the Internet, but it is not limited to this. As long as these devices and databases can communicate with each other, any communication network, such as a local area network or telephone line, can be used, and a network that combines multiple communication networks can also be formed.
[0021] Furthermore, the analysis object server 30 is a server that operates the analysis object website, which identifies objects that utilize the service. Not limited to one analysis object website, multiple analysis object websites can be used as analysis objects. In this case, system 1 accesses multiple analysis object servers 30 via network 99. In this example, only one analysis object server 30 is shown for simplicity.
[0022] Furthermore, user terminal 90 is, for example, a terminal device used by the administrator of a website operated by the analysis object server 30. As a terminal device, it can be a computer terminal such as a personal computer, a mobile terminal such as a smartphone or tablet computer. User terminal 90 has a display 91 such as an LCD screen and functions as a client terminal. This client terminal communicates with reference device 80 to obtain information such as the services used on the website and displays it on the display 91. System 1 can also include multiple user terminals 90 held by multiple users, allowing multiple users to utilize system 1.
[0023] The analysis device 10 reads pages from the website of the target website, sends HTTP / HTTPS requests (also referred to as requests) to the server 30 operating the website using a virtual browser, analyzes the received HTTP / HTTPS responses (also referred to as responses), extracts cookies or external communication URLs, obtains data stored in the web storage of the virtual browser, and logs the obtained results as analysis items. Furthermore, the analysis items can be utilized by the service identification device 50 described later. The analysis device 10 has a central processing unit (CPU) and a communication device (neither shown in the figure). Additionally, the analysis device 10 can also be implemented via the cloud (multiple distributed servers or multiple subsystems, etc.). The CPU, by executing the analysis program, performs the function of analyzing one or more pages within the target website and extracting cookies issued by each page, the set web storage, and the external communication URLs of any external communications that occur. The functionality of the analysis device 10 is described below. Furthermore, the analysis program may be started by the CPU reading from a storage medium such as ROM (not shown in the figure), or by the CPU reading from a storage medium such as CD-ROM and expanding it into RAM using a reading device (not shown in the figure). The communication device is a device that can communicate with the service identification device 50 and the reference device 80 via the network 99 using wired or wireless communication with various databases. For example, it can communicate using protocols such as TCP / IP.
[0024] Furthermore, a virtual browser is a browser that runs on one or more independent virtual machines or a container sharing the core of a host operating system (OS). All the functions of a regular browser can also be used in a virtual browser, and all the functions described in this manual for a browser can also be applied to a virtual browser.
[0025] Figure 2 shows the functional configuration of the analysis device 10. The analysis device 10 includes an analysis object acquisition unit 11, an analysis execution unit 12, and an analysis item registration unit 13.
[0026] The analysis target acquisition unit 11 is a functional unit that obtains the website URL of the analysis target website from the website database 20. In addition, the method by which the analysis target acquisition unit 11 obtains the website URL is not limited to this. For example, it can also be obtained by the operator of system 1 by entering the website URL through an input device (not shown in the figure).
[0027] The website database 20 series stores various information, including the website URL of at least one analytics target website operated by the analytics target server 30. It may have a hard disk drive (HDD) or similar storage device.
[0028] Figure 3 shows an example of website URL information (URL information) for the target websites registered in website database 20. In this example, three website URLs, including XXX.com, are registered as target websites for analysis. Here, the URL is generally composed of a scheme, domain, path, parameters, and fragments. There are no particular restrictions on the format of the website URLs registered in website database 20; for example, regular expressions can also be used to represent the part of the URL after the path (path, parameters, and fragments). This URL information can be registered by the operator of System 1 through an input device (not shown in the figure).
[0029] The analysis execution unit 12 is a functional unit that uses the analysis target website (e.g., "XXX.com") obtained from the website database 20 by the analysis target acquisition unit 11 as the target, and analyzes one or more pages within the website published on the website URL to extract cookies issued by one or more pages, web page storage settings, or external communication URLs of external communications that occur. The analysis execution unit 12 has a website access unit 121, an analysis item extraction unit 122, a script execution unit 123, and a link extraction unit 124.
[0030] Here, cookies refer to data stored by the browser, and there are two types: persistent cookies and session cookies. Persistent cookies are stored in the storage of the device running the browser and are retained for a specified period even after the browser is closed. They are used to maintain information such as the user's shopping cart contents and language settings. Session cookies are temporary cookies that exist only during a session and are automatically deleted when the browser is closed. They are used to maintain login information when the user moves between pages. Cookies are retrieved by analyzing response headers and accessing the browser's cookie storage. Cookies have attributes such as the userPref attribute (used as an identifier), the sessionId attribute, the Domain attribute (managing the valid domain of the cookie), the Path attribute (managing the valid path of the cookie), the Expires / Max-Age attributes (managing the expiration time of the cookie), the Secure attribute (managing whether it is sent only in HTTPS communication), the HttpOnly attribute (managing whether JavaScript (registered trademark) access is prevented), and the SameSite attribute (managing whether cross-site requests are allowed).
[0031] Cookies without a specified domain attribute are only valid for the designated origin. An origin consists of a domain, HTTP, HTTPS protocols, and port number. For example, a cookie set on sub.example.com without a specified domain attribute is only valid on sub.example.com and not on example.com or other subdomains.
[0032] Cookies with a specified domain attribute are valid for the specified domain and its subdomains. For example, a cookie with the domain attribute specified as example.com is valid in example.com and its subdomains, and all requests to the specified domain will be sent.
[0033] In addition, cookies that do not specify a domain attribute or that are specified to be in the same domain as the accessed website are called first-party cookies, while cookies that are specified to be in a different domain (external domain) are called third-party cookies.
[0034] Web page storage is an API (Application Programming Interface) used to save data within a browser. There are two types: Local Storage and Session Storage. Local Storage is an API used to save data within the browser until it is explicitly deleted. Data is stored in the browser's data storage area and is retained even when the browser is closed. Data stored in Local Storage is shared within the same source. Session Storage is an API used to save data within a browser session. Data is stored in a storage area guaranteed by the browser and is deleted when the browser tab is closed. Furthermore, data stored in web page storage is simply referred to as web page storage.
[0035] An external communication URL is a URL that is specified as the address of a communication that occurs on the page and belongs to a different domain than the domain of this page.
[0036] The website access unit 121 is a functional unit that uses a virtual browser to specify the website URL (the URL of the website's homepage), sends a request to the analysis object server 30 of the website being analyzed, and receives a response from the analysis object server 30. The website access unit 121 further determines whether there are any unspecified link URLs among the link URLs extracted by the link extraction unit 124. If there are unspecified link URLs, it specifies these link URLs, sends a request to the analysis object server 30, and receives a response from the analysis object server 30. By specifying a link URL, sending a request to the analysis object server 30, and receiving a response from the analysis object server 30, the website access unit 121 can perform recursive analysis on all pages accessed from the homepage.
[0037] The analysis item extraction unit 122 is a functional unit that extracts the external communication URL of cookies issued by one or more pages or external communications that occur from the response received by the website access unit 121, and then obtains the data stored in the web page storage set by the virtual browser.
[0038] Figure 4 shows an example of the data contained in an HTTP response sent based on a request sent to the analysis object server 30 (e.g., the website URL "XXX.com" logged into the website database 20 in Figure 3). An HTTP / HTTPS response includes a response line (status line), response headers, and a response body. In this example, the response line contains information 35 indicating the HTTP protocol version and status code: version HTTP / 1.1, status code 200, meaning the request was processed normally. The response headers contain the response generation date and time and cookie settings 31, indicating that this response was generated on June 9, 2024 at 10:18:14 AM, and the set cookie can be used under the example.com domain. The response body contains an HTML file, with a script tag 33 embedded within the HTML file. The code in the script tag 33 sends JSON data to https: / / example.com / api and displays its response on the console.
[0039] The analysis item extraction unit 122 is a functional unit that extracts cookies and web page storage stored in the virtual browser from the virtual browser, and extracts external communication URLs of external communications occurring on the website from the virtual browser's communication logs. The analysis item extraction unit 122 can also obtain this information from response data. For example, in this case, the analysis item extraction unit 122 obtains the cookie setting 31 "sessionId_app1=abc123; Domain=example.com;" from the response header of the data shown in Figure 4, and the external communication URL setting 32 "https: / / example.com / api" from the response body. Furthermore, there are no particular limitations on the method for extracting information contained in the virtual browser's cookies, web page storage, communication logs, or responses; for example, extraction can be performed by calling APIs such as JavaScript (registered trademark), Python, or Java (registered trademark) from the interface driver operating the virtual browser.
[0040] The script execution unit 123 is a functional unit that executes scripts via a virtual browser when a script is included in the response sent by the analysis object server 30. Scripts are generally contained in HTML files, which are included in the response body of the HTTP response (see the script tag 33 in Figure 3). The execution result of the script can be confirmed, for example, by checking the logs output from the interface driver of the virtual browser. This confirms whether the script has executed successfully.
[0041] The link extraction unit 124 is a functional unit that extracts the page URL of the page whose link address is being retrieved from the response sent by the analysis object server 30. The page URL is recorded in an HTML file, which is contained in the response body of the HTTP response (see Figure 4). In this example, the link URL linking to "page1.html" in the page is extracted by extracting the link tag 34 from the response body. This allows the website access unit 121 to access the page with the linked address.
[0042] The analysis item registration unit 13 is a functional unit that uses the analysis item extraction unit 122 to extract cookies issued by pages or external communication URLs of external communications that occur within the website of the analysis target, or to obtain data from the set web page storage, and to make the website URL correspond to the cookies issued by pages within the website, the set web page storage, or the external communication URLs of external communications that occur, and to register it in the analysis item database 40 in a way that can be obtained by using the service identification device 50.
[0043] The analysis project database 40 uses the analysis project registration unit 13 to register (store) the corresponding storage devices containing website URLs and cookies issued by pages within the website, set web page storage devices, or external communication URLs originating from the pages. Storage devices may include hard disk drives (HDDs).
[0044] Figure 5 shows an example of analytics information that corresponds to website URLs registered in the analytics database 40 and cookies issued by pages within the website, web storage devices set, or external communication URLs occurring on the page. The analytics database 40 has three tables that map website URLs to cookies, website URLs to web storage devices, and website URLs to external communication URLs. Furthermore, analytics information can be managed using a single table or other methods.
[0045] The table above displays cookie analysis information. This information includes the Site URL column, the Page URL column of the page that issued the cookie, the Cookie's Name attribute (Name column), the Domain attribute, and the Control Type column. In this example, the Page URL "XXX.com / " of the page on the website "XXX.com" is matched and logged with the Name attribute "sessionId_app1", the Domain attribute "example.com" (refer to Cookie Settings 31 in Figure 4), and the Control Type "3rd Party Cookie" of the cookie issued by this page. In addition to this information, the table can also log other attributes that cookies may have.
[0046] The table in the middle section displays the analytics information for the web storage. This information includes a Site URL column, a Page URL column for the page that sets up the web storage, an Origin column, and a Storage Type column. In this example, the Page URL "XXX.com / XXX" of the page with the Site URL "XXX.com" is mapped and logged to the Origin "https: / / example1.com" and the Storage Type "local Storage" of the web storage set up on that page. In addition to this information, the table can also log other information that a web storage device may have, such as Key attributes.
[0047] The table below shows the analysis information for external communication URLs. This information includes a Site URL column, a Page URL column for the page hosting the webpage, and an External URL column. In this example, the Page URL "XXX.com / YYY" of the page on the website "XXX.com" is mapped and logged to the External URL "http: / / anotherdomain1.com" for the external communication that occurred on that page. Similarly, the Page URL "XXX.com / ZZZ" of the page on the website "XXX.com" is mapped and logged to the External URL "http: / / anotherdomain2.com" for the external communication that occurred on that page.
[0048] The analysis apparatus 10 according to this embodiment includes: an analysis target acquisition unit 11, which acquires the website URL of the analysis target website; an analysis execution unit 12, which analyzes one or more pages within the website published by the website URL, extracting cookies issued by one or more pages, set web storage devices, or external communication URLs of external communications that occur; and an analysis item registration unit 13, which maps the website URL to cookies, web storage devices, or external communication URLs issued by pages within the website, and registers them in a manner obtainable by the service identification device described later. This allows for the extraction of cookies issued by one or more pages within the website published by the website URL, set web storage devices, or external communication URLs of external communications, and registration in a manner obtainable by the service identification device 50 for each website. Not only can the services used on the analysis target website be listed and registered, but it can also analyze and study which type of cookie, web storage device, or externally sent service was used to access and utilize the service.
[0049] Figure 6 shows the flow of the analysis method performed by the analysis device 10.
[0050] In step S11, the analysis device 10 (analysis target acquisition unit 11) obtains the website URL of the analysis target website from the website database 20. There may be multiple analysis target websites. As described above, information (URL information) containing the website URLs of the analysis target websites is registered in the website database 20. The URL information can also be obtained by the operator of System 1 through an input device (not shown in the figure).
[0051] In step S12, the analysis device 10 (analysis execution unit 12) analyzes the pages within the website published by the website URL, extracting all cookies issued by the pages, web page storage settings, and external communication URLs of any external communications that occur. It also extracts all link URLs. First, the website access unit 121 uses a virtual browser to specify the website URL (the URL of the website homepage) or the page URL of the link address extracted by the link extraction unit 124, and sends a request to the analysis target server 30 operating the analysis target website, and receives a response from the analysis target server 30. Next, the analysis item extraction unit 122 extracts the external communication URLs of cookies issued by one or more pages or external communications that occur from the response received by the website access unit 121, thereby obtaining data stored in the web page storage settings of the virtual browser. Afterwards, the script execution unit 123 executes the script using the virtual browser when the response sent by the analysis target server 30 contains a script. Then, the link extraction unit 124 extracts the page URL of the page with the link address from the response sent by the analysis object server 30.
[0052] For example, we can extract the cookie with the Name attribute "sessionId_app1" and the Domain attribute "example.com" issued by the page URL "XXX.com / " of the website being analyzed (see Cookie Settings 31 in Figure 4). The details of the extraction are as described above.
[0053] In step S13, the analysis device 10 (website access unit 121) determines whether there is an unspecified link URL among the link URLs extracted by the link extraction unit 124. If there is an unspecified link URL, the process returns to step S12; otherwise, it proceeds to step S14.
[0054] In step S14, the analysis device 10 (website access unit 121) determines whether there are any unspecified website URLs among the website URLs extracted by the analysis object acquisition unit 11. If there are unspecified website URLs, for example, if the analysis of the analysis object website XXX.com (see Figure 3) has ended, but the analysis of YYY.com and ZZZ.com (see Figure 3) has not yet been performed, the process returns to step S12. If there are no unspecified website URLs (the analysis of all analysis object websites has ended), the process proceeds to step S15.
[0055] In step S15, the analysis device 10 (analysis item registration unit 13) associates the website URL with a cookie, web page storage, or external communication URL, and registers it in the analysis item database 40 (see Figure 5) in a manner obtainable via the service identification device 50 (obtainable via the service identification method described later). For example, it associates and registers the website URL "XXX.com / " with the cookie (see Cookie Setting 31 in Figure 4) issued by a page on that website, specifying the Name attribute "sessionId_app1" and the domain attribute "example.com". In this way, all analysis information is stored in the analysis item database 40. The details of the stored analysis information are as described above.
[0056] According to the analysis method of this embodiment, the computer-executed analysis method includes the following stages: obtaining the website URL of the target website; analyzing one or more pages within the website published by the website URL, extracting cookies issued by one or more pages, web storage devices set, or external communication URLs of external communications occurring; and mapping the website URL of the target website to the cookies issued by the pages within the target website, the web storage devices set, or the external communication URLs occurring on the pages, and registering them in a manner obtainable by the service identification method described later. In this way, not only can the services used on the target website be listed and registered, but it is also possible to analyze and study which means such as cookies and web storage devices were used to access and utilize these services.
[0057] The service identification device 50 is a computer device that identifies services used on the website being analyzed. The service identification device 50 includes a CPU and a communication device (neither shown in the figure). Alternatively, the service identification device 50 can be implemented via the cloud (multiple distributed servers or multiple subsystems, etc.). The CPU performs the function of identifying services used on the website being analyzed by executing a service identification program. The functionality of the service identification device 50 is described below. Furthermore, the service identification program is, for example, read by the CPU from a storage medium such as ROM (not shown in the figure), or read by the CPU from a storage medium such as a CD-ROM using a reading device (not shown in the figure) and expanded into RAM for startup. The communication device is a device capable of wired or wireless communication with the analysis device 10, the reference device 80, and various databases via a network 99. For example, communication can be conducted using protocols such as TCP / IP.
[0058] Figure 7 shows the functional configuration of the service identification device 50. The service identification device 50 includes an analysis item acquisition unit 51, a service identification unit 52, and a service registration unit 53.
[0059] The analysis item acquisition unit 51 is a functional unit that retrieves analysis items (corresponding information recorded in one or more rows as shown in Figure 5) from the analysis item database 40. These items include the URLs of the target website and the corresponding cookies issued by at least one page within the target website, the set web storage devices, or the URLs of external communications occurring on the page. The analysis item acquisition unit 51 retrieves each analysis item from the analysis item database 40 and sends it to the service identification unit 52. Through the analysis item acquisition unit 51, analysis items analyzed by a device different from the service identification device 50 (i.e., the analysis device 10) can be utilized.
[0060] The service identification unit 52 compares the cookies, web storage, or external communication URLs contained in each analysis item obtained from the analysis item database 40 by the analysis item acquisition unit 51 with the service database 60, and identifies the service corresponding to the matching data as a service used on the website. The service identification unit 52 includes an external communication URL comparison unit 521, a cookie comparison unit 522, and a web storage comparison unit 523. Here, "service" refers to external services such as advertising services and access analysis services performed by specifying an external communication URL and sending a request.
[0061] The service database 60 series stores one or more storage devices that associate cookies, web page storage, and external communication URLs with services. These storage devices may include hard drives (HDDs). Associating cookies, web page storage, and external communication URLs with services means associating them with service IDs, names, etc., that can uniquely identify the service. Furthermore, services are not limited to being represented by their names (called service names); they can also be represented by IDs. In this embodiment, as an example, the service is represented by its service name.
[0062] Figure 8A shows a portion of an example of service information logged into the service database 60. The service database 60 has three tables that map service names to cookies, service names to web page storage, and service names to external communication URLs.
[0063] The table above shows the service information that maps cookies to services. This service information includes a Service Name column, a Name attribute column for the cookie, and a Domain attribute column. In this example, the service name "InsightPulse" corresponds to the cookie used by the service represented by this service, which has the Name attribute "app1" and the Domain attribute "example.com". In addition to this, the table can record other attributes that cookies can have.
[0064] The table in the middle section represents service information that maps web storage to services. This service information includes a Service Name column and an Origin column for the web storage. In this example, the service name "MetricVision" corresponds to the Origin of the web storage used by the service represented by this service name, "https: / / example1.com". In addition to this, the table may record other information that web storage may have, such as Key attributes.
[0065] The table below shows the service information that maps external communication URLs to services. This service information includes a Service Name column and an External URL column. In this example, the service name "AnalyticaFlow" corresponds to the external communication URL "anotherdomain2.com" specified for accessing the service represented by this service name.
[0066] In addition to the service name, other service information can also be logged in the service database 60. Other service information includes, for example, the types of services provided, such as advertising and access analysis, and the service providers of external services.
[0067] When the external communication URL comparison unit 521 contains an external communication URL in the analysis items obtained from the analysis item database 40, it extracts the service name corresponding to the data that at least partially matches the external communication URL from the service database 60 and uses this service name as a functional unit for utilizing the service. For example, the external communication URL comparison unit 521 obtains the second row of data (see Figure 5) in the ExternalURL column of the table in the lower section of the analysis information registered in the analysis item database 40, which has "anotherdomain2.com" as the key value. Using "anotherdomain2.com" as the key value, it performs a partial match search on the ExternalURL column of the service information in the lower section of the service database 60 (see Figure 8A) and obtains the service name "AnalyticaFlow" of the first row of service information whose ExternalURL column value matches "anotherdomain2.com", and uses it as the service to utilize.
[0068] The Cookie Comparison Unit 522, when the analysis items obtained from the analysis item database 40 contain cookies, extracts services from the service database 60 that are at least partially identical to the cookies in the Name attribute. As needed, it extracts services corresponding to data from the service database 60 that are at least partially identical to the cookies in the Name attribute and completely identical in the domain attribute, and uses these services as the functional unit for using the service. Here, "as needed" means, for example, when the cookie type is a third-party cookie. Furthermore, when the Cookie Comparison Unit 522 has multiple pieces of data in the analysis item's cookie data that are at least partially identical in the Name attribute and completely identical in the domain attribute, it selects the service with the most instances of these multiple services as the service to use.
[0069] Figure 8B shows a portion of an example of service information corresponding to cookies registered in the service database 60. In this example, the cookie comparison unit 522 extracts three cookies for InsightPulse and one cookie for Service2 that have a domain attribute of example.com that are completely consistent with the first row of cookies in the analysis item obtained from the table in the upper part of the analysis item database 40 (see Figure 5). Among them, since the service whose Name attribute is most consistent with the Name attribute of the analysis item app1 is InsightPulse, the cookie comparison unit 522 selects InsightPulse as the service to be used. Thus, as an example of distinguishing cookies with consistent domain attributes by the Name attribute, for example, considering the overall login status of the InsightPulse management platform, and the case of sub-services in the Service2 management platform, etc. With the help of the cookie comparison unit 522, even if there are multiple services that can be accessed by a single cookie, the service to be used can be identified.
[0070] When the webpage storage comparison unit 523 contains a webpage storage item among the analysis items obtained from the analysis item database 40, it extracts the corresponding service from the service database 60 that matches the Origin portion of the webpage storage item, and obtains this service as a service to be used. For example, the webpage storage comparison unit 523 obtains the first row of the analysis item from the middle table of the analysis item database 40, extracts the first row of the middle table of the service database 60 whose Origin portion matches (in this example, is completely unique) the https: / / example1.com portion, and obtains the corresponding service MetricVision as a service to be used.
[0071] Furthermore, the webpage storage comparison unit 523 can also extract services that correspond to data whose Origin attributes are completely identical. It can also extract services that correspond to data whose Origin attributes are partially or completely identical, and whose Key attributes are partially or completely identical.
[0072] The service registration unit 53 is a functional unit that, when the service name can be identified by the service identification unit 52, associates the website URL with the service and registers it in the service database 70. The service registration unit 53 also registers cookies, web storage devices, or external communication URLs whose service names cannot be identified as unmatched data (e.g., Unknown) in the service database 70. The service registration unit 53 can retain information about identified services so that this information can be used on other devices. Furthermore, it can detect cookies that are not matched with a service, i.e., cookies that are not active.
[0073] The Service Database 70 is a storage device that uses a service database to map website URLs to the service names of services used on that website and register them. It can include a hard disk drive (HDD) or similar storage device.
[0074] Figure 9 shows an example of service information registered in the service database 70 via the service registration unit 53. The service information is registered in a table format with a UseServiceName column and a website URL column. In this example, the website URL "XXX.com" is matched with the service name "InsightPulse" identified as being used on this website, the website URL "XXX.com" is matched with the service name "MetricVision" identified as being used on this website, and the website URL "XXX.com" is matched with the service name "AnalyticaFlow" identified as being used on this website. Since the service corresponding to the external communication URL used on the website URL "XXX.com" cannot be identified, the website URL "XXX.com" is matched with "Unknown," indicating that the service used is unknown, and registered accordingly.
[0075] According to the service identification device 50 of this embodiment, it includes: an analysis item acquisition unit 51, which acquires analysis items containing the correspondence between the page URL of at least one page in the analysis target website and the external communication URL of the cookie issued by at least one page, the set web storage, or the external communication that occurs; a service identification unit 52, which compares the analysis items with a service database and identifies the service corresponding to the cookie, web storage, or external communication URL contained in the analysis items as a service used on the analysis target website; and a service registration unit 53, which associates the website URL with the service and registers it. In this way, the cookie, web storage, or external communication URL of each analysis target website analyzed by the analysis device 10 can be obtained, the corresponding service can be identified, and the identified service can be registered in the service database 70.
[0076] Figure 10 shows the flow of the service identification method performed by the service identification device 50.
[0077] In step S21, the service identification device 50 (analysis item acquisition unit 51) obtains all analysis information from the analysis item database 40 (see Figure 5) that corresponds to the website URL of the website to which this analysis item belongs, including cookies, web storage, or external communication URLs.
[0078] In step S22, the service identification device 50 (service identification unit 52) compares the analysis item with the service database 60 (see Figures 8A and 8B) to identify the services corresponding to cookies, web storage, or external communication URLs contained in the analysis item as services to be used on the analysis target website. First, the external communication URL comparison unit 521 extracts from the service database 60 the services corresponding to data that at least partially matches the external communication URLs contained in the analysis item obtained from the analysis item database 40. Next, the cookie comparison unit 522 extracts from the service database 60 the services corresponding to data that at least partially matches the Name attribute and completely matches the domain attribute of the cookies contained in each analysis item obtained from the analysis item database 40, and obtains these services as the services to be used. Here, when the cookie comparison unit 522 has multiple data that at least partially match the Name attribute and completely match the domain attribute in the cookie data of the analysis item, it obtains the service with the most represented services as the service to be used. Furthermore, the webpage storage comparison unit 523 retrieves services from the service database 60 that correspond to data that matches the Origin attribute portion of the webpage storage contained in each analysis item obtained from the analysis item database 40, and obtains these services as the service to be used. Details are as described above. Thus, the comparison with the service database 60 is expected to be performed in the order of external communication URL comparison, cookie comparison, and webpage storage comparison. Since the certainty of service identification is highest in terms of consistency with external communication URLs, followed by cookies, and finally webpage storage, performing the comparison in this order allows for more efficient identification.
[0079] For example, for the analysis information in the second row of the table in the lower section of the analysis project database 40 (see Figure 5) (URL column "XXX.com / ZZZ / ", ExternalURL column "anotherdomain2.com"), the service database 60 (see Figure 8A) is searched using the external URL "anotherdomain2.com" as the key value. Based on the information in the first row of the table in the lower section, the service name "AnalyticaFlow" is obtained as the service to be used. Furthermore, for the analysis information in the first row of the table in the upper section of the analysis project database 40 (see Figure 5) (URL column "XXX.com / ", COOKIE column "app1; domain=example.com"), the service database 60 (see Figure 8B) is searched to extract three cookies that are completely identical to the domain attribute example.com and whose Name attribute name is identical to part of app1, thereby obtaining InsightPulse as the service to be used. Furthermore, retrieve the first row of the analysis item from the table in the middle section of the analysis item database 40 (see Figure 5), and extract the data from the first row of the table in the middle section of the service database 60 (Figure 8A) that contains the same (completely unique) Origin service at https: / / example1.com. Obtain the corresponding service MetricVision as the exploit service. The details of obtaining the exploit service are as described above.
[0080] In step S23, the service identification device 50 (service registration unit 53) registers the service information corresponding to the website URL and the service in the service database 70 (see Figure 9). For example, the website URL "XXX.com" is matched with the service name "InsightPulse" (see line 1 of Figure 9), the website URL "XXX.com" is matched with the service name "AnalyticaFlow" (see line 4 of Figure 9), and the website URL "XXX.com" is matched with the service name "MetricVision" (see line 2 of Figure 9). This allows the service information to be retained. The details of the retained service information are as described above.
[0081] In step S24, the service identification device 50 (using the service registration unit 53) determines whether there is any unregistered analysis information. If so, the process returns to step S21; otherwise, it ends. This allows all analysis information to be registered.
[0082] According to the service identification method of this embodiment, the service identification method executed by a computer includes the following stages: obtaining analysis items containing the correspondence between website URLs within the target website and cookies, web storage devices, or external communication URLs issued by at least one page within the target website; comparing the analysis items with a service database, identifying the service names corresponding to the cookies, web storage devices, or external communication URLs contained in the analysis items as the services used on the target website; and associating and registering the website URLs with the services used, wherein the service database contains data that groups cookies, web storage devices, and external communication URLs with service names respectively. Accordingly, the cookies, web storage devices, or external communication URLs of each website analyzed by the analysis device 10 can be obtained, the corresponding services used can be identified, and the identified services used can be registered in the service database 70.
[0083] Reference device 80 is a computer device that maps and outputs the services used on the target website to cookies, web storage, or external communication URLs used to access and utilize the services. Reference device 80 includes a CPU and a communication device (neither shown in the figure). Furthermore, reference device 80 can also be implemented via the cloud (multiple distributed servers or multiple subsystems, etc.). The CPU executes the service reference program to perform the function of outputting the services used on the target website. The functionality of reference device 80 is described below. Furthermore, the service reference program is, for example, stored in ROM (not shown in the figure) and read by the CPU, or stored in storage media such as CD-ROM and read by the CPU using a reading device (not shown in the figure) and expanded into RAM for startup. The communication device is a device capable of wired or wireless communication with analysis device 10, service identification device 50, and various databases via network 99. For example, communication can be conducted using protocols such as TCP / IP.
[0084] Figure 11 shows the functional configuration of the reference device 80. The reference device 80 includes a service reference unit 81 and an analysis item reference unit 82.
[0085] The Service Reference Unit 81 is a functional unit that outputs the services used by the website to the user terminal 90. Furthermore, the term "output" here can refer to the format of output to the display 91 of the user terminal 90, the format of sending to the user terminal 90 as a file, or other formats. In addition to using the services, the Service Reference Unit 81 can also output cookies, web page storage, or external communication URLs corresponding to the used services to the user terminal 90. The Service Reference Unit 81 includes a Service Acquisition Unit 811, a Third Analysis Item Acquisition Unit 812, and a Service Output Unit 813.
[0086] The service acquisition unit 811 retrieves the services registered by the service identification device 50 from the service database 70 as a functional unit for services used on the target website. For example, when "XXX.com" is specified as the target website, the service acquisition unit 811 retrieves all rows in the service information registered in the service database 70 (see Figure 9) where the URL column contains "XXX.com".
[0087] The analysis item acquisition unit (an example of the third analysis item acquisition unit) 812 uses the service name as the key value to retrieve the corresponding cookie, web storage, or external communication URL from the service database 60 based on all service information obtained by the service acquisition unit 811. For example, the analysis item acquisition unit 812 uses the service name "AnalyticaFlow" from the service information obtained by the service acquisition unit 811 as the key value to extract service information with the same service name from the service database 60 shown in Figure 8A, and obtains the external communication URL "anotherdomain2.com" contained in this service information.
[0088] The service output unit 813 is a functional unit that outputs the service obtained by the service acquisition unit 811 to the user terminal 90. The service output unit 813 further outputs and analyzes the cookies, web storage, or external communication URLs corresponding to the service obtained by the item acquisition unit 812.
[0089] Figure 12 shows an example of a display screen on monitor 91, which displays cookies, web storage devices, or external communication URLs corresponding to the service obtained by the service acquisition unit 811. The screen has a target website display unit 911 and a service display unit 912. If the user specifies "XXX.com" as the reference target URL in the target website display unit 911, the reference device 80 displays the website URL "XXX.com" on the target website display unit 911, and displays the service name of "XXX.com" obtained by the service acquisition unit 811 from the service database 70 and the cookies, web storage devices, or external communication URLs corresponding to that service obtained by the analysis item acquisition unit 812 from the service database 60, corresponding to each other, on the service display unit 912. For example, it displays the InsightPulse service on the website "XXX.com", specifying the InsightPulse cookie display name attribute as app1 and the domain attribute value as example.com.
[0090] The analysis item reference unit 82 is a functional unit that outputs the website URL (or the page URLs of individual pages) and the corresponding cookies, web storage, or external communication URLs to the user terminal 90. Furthermore, the term "output" here can refer to output to the display 91 of the user terminal 90, or to sending the data to the user terminal 90 in file format, or to other formats. The analysis item reference unit 82 includes an analysis item acquisition unit 821 and an analysis item output unit 822.
[0091] The analysis item acquisition unit (an example of the second analysis item acquisition unit) 821 is a functional unit that refers to the analysis item database 40 to obtain the website URL (or the page URL of each page) and the corresponding cookies, web storage, or external communication URLs. For example, the analysis item acquisition unit 821 obtains analysis information from the first row of the analysis item database 40 shown in Figure 5, which has a page URL of "XXX.com", a Name attribute name of app1, and a domain attribute of example.com.
[0092] The analysis project output unit 822 is a functional unit that outputs the cookies, web page storage, or external communication URLs corresponding to the website URLs (or page URLs of each page) obtained by the analysis project acquisition unit 821 to the user terminal 90.
[0093] Figure 13 shows an example of a display screen on monitor 91, which displays cookies, web storage devices, or external communication URLs corresponding to the website URL (or page URLs of individual pages) obtained by the analysis item acquisition unit 821. The screen has a target website display unit 913 and an analysis item display unit 914. If the user specifies "XXX.com" as the reference target URL in the target website display unit 913, the reference device 80 displays the website URL "XXX.com" in the target website display unit 913, and displays the cookies, web storage devices, or external communication URLs obtained by the analysis item acquisition unit 821 from the analysis item database 40 that correspond to the page URL "XXX.com" in the analysis item display unit 914. For example, a cookie with the Name attribute name app1 and the domain attribute example.com that has been issued on the website "XXX.com" is displayed.
[0094] According to the reference device 80 of this embodiment, it has a service reference unit 81 and an analysis item reference unit 82. The service reference unit 81 has: a service acquisition unit 811, which acquires the service registered by the service identification device 50 as the service used on the target website; an analysis item acquisition unit 812, which refers to the service database 60 to acquire cookies, web storage devices, or external communication URLs corresponding to the service used; and a service output unit 813, which outputs the service used and the cookies, web storage devices, or external communication URLs to the user terminal 90. The analysis item reference unit 82 has: an analysis item acquisition unit 821, which acquires analysis items containing the correspondence between the website URL of the target website and its corresponding cookies, web storage devices, or external communication URLs; and an analysis item output unit 822, which outputs the website URLs contained in the analysis items and their corresponding cookies, web storage devices, or external communication URLs to the user terminal 90. This allows for the mapping and output of services used on a target website with the cookies, web storage devices, or external communication URLs used to access and utilize those services. Not only can the services used be listed, but the mapping between services and analytics items can also be provided to the user.
[0095] Figure 14A shows the process of using the service reference method executed by the reference device 80.
[0096] In step S31, the user specifies the target website to be referenced. In this example, the reference device 80 specifies the target website from the input screen of the display 91 of the user terminal 90. Figure 14B shows the target website input screen for user-specified target website. The target website input screen has an input form 915 that displays all rows of data from the website database 20 in a drop-down format, allowing the user to make selections.
[0097] In step S32, the reference device 80 (the service acquisition unit 811 of the service reference unit 81) retrieves all the services registered by the service identification method (see Figure 13) from the service database 70 (see Figure 9) as the services used by the analysis target website specified by the user in step S31.
[0098] In step S33, the reference device 80 (using the analysis item acquisition unit (an example of the third analysis item acquisition unit) 812 of the service reference unit 81) refers to the service database 60 (see Figure 8B) and obtains cookies, web page storage, or external communication URLs using the service name as the key. For example, it obtains the cookie with the Name attribute name "app1" and the domain attribute value "example.com" corresponding to the service name "InsightPulse". The details of obtaining cookies, etc., are as described above.
[0099] In step S34, the reference device 80 (the service output unit 813 of the service reference unit 81) groups the service with cookies, web page storage, or external communication URLs and outputs them to the display of the user terminal 90 (see Figure 12). For example, the service name "InsightPulse" and the cookie corresponding to this service, the Name attribute name "app1" and the domain attribute value "example.com", are output on a single line (see Figure 12).
[0100] According to the service utilization reference method of this embodiment, the method executed by a computer includes the following stages: obtaining the services registered by the aforementioned service utilization identification method as services utilized on the target website; referring to a service database, obtaining cookies, web storage devices, or external communication URLs corresponding to the utilized services; and outputting the utilized services and the cookies, web storage devices, or external communication URLs. Accordingly, services utilized on the target website can be correlated with and output to the cookies, web storage devices, or external communication URLs used to access the utilized services. This not only lists the utilized services within the website but also associates the utilized services with the analysis items and provides them to the user.
[0101] Figure 15 shows the flow of the analysis information reference method performed by the reference device 80.
[0102] In step S41, the user specifies the analysis target website they wish to refer to. In this example, the reference device 80 specifies the analysis target website from the input screen of the display 91 of the user terminal 90. The analysis target input screen has an input form 915 that displays all rows of data from the website database 20 in a drop-down format (see Figure 14B).
[0103] In step S42, the reference device 80 (using the analysis item acquisition unit 821 of the service reference unit 81) retrieves all analysis items registered by the analysis method (see Figure 6) from the analysis item database 40 (see Figure 5) as services used on the website of the analysis target. For example, the analysis item acquisition unit 821 retrieves analysis information from the first row of the table in the upper part of the analysis item database 40 shown in Figure 5, which has a website URL of "XXX.com", a Name attribute name of app1, and a domain attribute of example.com.
[0104] In step S43, the reference device 80 (using the analysis item output unit 822 of the service reference unit 81) outputs all the analysis information obtained by the analysis item acquisition unit 821, which corresponds to the website URL, cookies, web page storage, or external communication URLs within the website, to the display of the user terminal 90 (see Figure 13). For example, the page URL "XXX.com" and the cookies issued by this page, namely the Name attribute name "app1" and the domain attribute value "example.com", are output on a single line.
[0105] According to the analysis method of this embodiment, the computer-executed method has the following stages: obtaining the analysis items registered by the above analysis method as analysis information of the pages within the target website; and outputting all the obtained analysis information to the user terminal 90. Accordingly, the analysis items of the target website can be output. A list of the analysis items of the target website can be compiled and provided to the user.
[0106] Furthermore, the service identification system 1 according to this embodiment includes: an analysis device 10; a service identification device 50; a reference device 80; and a service database 60, which stores data that associates cookies, web page storage, and external communication URLs with service names. Accordingly, the analysis device 10 can extract analysis items, the service identification device 50 can compare these analysis items with the service database 60 to identify the website's service usage, and the reference device 80 can provide this service usage information to the user.
[0107] Furthermore, the service identification system 1 according to this embodiment includes: an analysis device 10, which obtains the website URL of the target website, analyzes one or more pages within the website published by the website URL, extracts the external communication URLs of cookies issued by one or more pages, web storage devices set, or external communications occurring, and maps and registers the website URLs of the pages that issue cookies, set web storage devices, or occur external communication URLs with the cookies issued by the pages, the web storage devices set, or the external communication URLs occurring; a service identification device 50, which compares the analysis items containing the mapping relationship between the website URL and the cookie, web storage device, or external communication URL registered by the analysis device 10 with the service database 60, identifies the services corresponding to the cookies, web storage devices, or external communication URLs contained in the analysis items as the service used by the page on the website URL, and maps and registers the website URL with the service; and a service database 60, which registers data that maps cookies, web storage devices, and external communication URLs to services respectively. Accordingly, external services used on a website can be associated with and managed with cookies issued for accessing those external services.
[0108] Furthermore, according to the service identification system 1 of this embodiment, it further includes an analysis item database 40, which is registered by the analysis device with the correspondence between website URLs and cookies, web page storage, or external communication URLs, and the analysis device 10 obtains analysis items containing the correspondence.
[0109] Furthermore, the service identification system 1 according to this embodiment further includes a reference device 80, which obtains the service accessed by the service identification device 50 as the service accessed on the analysis target website and outputs the service access.
[0110] Furthermore, the service identification system 1 according to this embodiment further includes a service database 70, which uses the service identification device 50 to associate and log in the website URL with the service, and uses the reference device 80 to obtain the service.
[0111] Furthermore, the service identification system 1 according to this embodiment further includes a website database 20, which has registered the website URL of at least one target website and obtains the website URL through the analysis device 10.
[0112] Furthermore, the service identification method according to this embodiment includes the following stages: obtaining the website URL of the target website; analyzing one or more pages within the website published by the website URL; extracting the external communication URLs of cookies issued by one or more pages, web storage devices set, or external communications occurring; matching and registering the website URLs of the pages that issued cookies, set web storage devices, or occurred with the cookies issued by the pages, the web storage devices set, or the external communication URLs occurring; and comparing the analysis items containing the correspondence between website URLs and cookies, web storage devices, or external communication URLs registered in the registration stage with the service database 60; identifying the services corresponding to cookies, web storage devices, or external communication URLs included in the analysis items as the services used by the pages on the website URL; matching and registering the website URL with the services used; wherein the service database 60 stores data that corresponds cookies, web storage devices, and external communication URLs with services respectively. Accordingly, external services used on a website can be associated with and managed with cookies issued for accessing those external services.
[0113] Furthermore, according to the program of this embodiment, one or more computers execute the following procedure: obtain the website URL of the target website; analyze one or more pages within the website published by the website URL; extract the external communication URLs of cookies issued by one or more pages, web storage devices set, or external communications occurring; match and register the website URLs of the pages that issued cookies, set web storage devices, or occurred with the cookies issued by the pages, the web storage devices set, or the external communication URLs occurring; and compare the analysis items containing the correspondence between website URLs and cookies, web storage devices, or external communication URLs registered through the registration procedure with the service database 60; identify the services corresponding to cookies, web storage devices, or external communication URLs contained in the analysis items as the services used by the pages on the website URL; match and register the website URLs with the services used; wherein the service database 60 registers data that corresponds cookies, web storage devices, and external communication URLs with services respectively. Accordingly, external services used on a website can be associated with and managed with cookies issued for accessing those external services.
[0114] Various embodiments of the present invention can be described with reference to flowcharts and block diagrams, where blocks may represent (1) a stage of the process of performing an operation or (2) a component of a device that performs the operation. The identified stages and components may be implemented by dedicated circuits, programmable circuits supplied together with computer-readable instructions stored on a computer-readable medium, and / or processors supplied together with computer-readable instructions stored on a computer-readable medium. Dedicated circuits may include digital and / or analog hardware circuits, and may also include integrated circuits (ICs) and / or discrete circuits. Programmable circuits may include reconfigurable hardware circuits, which may include logic AND, logic OR, logic XOR, logic NAND, logic NOR, and other logic operations, flip-flops, registers, field-programmable gate arrays (FPGAs), programmable logic arrays (PLAs), and other memory components.
[0115] Computer-readable media can include any tangible device capable of storing instructions that can be executed by a suitable means. As a result, a computer-readable medium having instructions stored therein comprises a product containing instructions executable for the purpose of creating means to perform operations specified in a flowchart or block diagram. Examples of computer-readable media include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable media include floppy disks (registered trademarks), magnetic disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electronically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), optical disc read-only memory (CD-ROM), digital multipurpose disc (DVD), Blu-ray discs (Blu-ray, registered trademark), memory sticks, integrated circuit cards, etc.
[0116] Computer-readable instructions may include any source code or object code written in any combination of one or more programming languages, including assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microinstructions, firmware instructions, status setting data, or object-oriented programming languages such as Smalltalk (registered trademark), JAVA (registered trademark), C++, and conventional programming languages such as the "C" programming language or similar programming languages.
[0117] Computer-readable instructions (CMIs) are provided locally or via wide area networks (WANs) such as local area networks (LANs) and the Internet to the processor or programmable circuitry of a programmable data processing device like a computer. These CMIs execute the instructions to create a means for performing the operations specified in a flowchart or block diagram. Here, "computer" can refer to a PC (personal computer), tablet computer, smartphone, workstation, server computer, general-purpose computer, or special-purpose computer, or it can be a computer system composed of multiple connected computers. Such a computer system composed of multiple connected computers is also called a distributed computing system, which is a broad definition of a computer. In a distributed computing system, each computer executes a part of a program, transferring data between the computers as needed, thereby enabling multiple computers to execute the program in a coordinated manner.
[0118] Examples of processors include computer processors, central processing units (CPUs), processing units, microprocessors, digital signal processors, controllers, and microcontrollers. A computer can have one or more processors. In a multiprocessor system with multiple processors, each processor executes a part of the program, transferring data between processors as needed, thereby enabling multiple processors to execute the program in a coordinated manner. For example, when performing multitasking, multiple processors can switch tasks at different times, thereby subdividing and executing each part of the task. In this case, which part of the program each processor executes is dynamically changing. The specific parts of the program that each processor can execute can also be statically determined by considering the multiprocessor programming design.
[0119] Figure 16 shows an example of a computer 1200 that can represent the various aspects of the present invention, either wholly or partially. A program installed on the computer 1200 enables the computer 1200 to perform operations associated with an apparatus of an embodiment of the present invention, or to function as one or more components of that apparatus, or to execute those operations or those one or more components, and / or to execute a process or stage of an embodiment of the present invention. The program can be executed in the computer 1200 by a CPU 1212 to perform identification operations associated with several or all of the blocks in the flowcharts and block diagrams described in this specification.
[0120] The computer 1200 according to this embodiment includes a CPU 1212, RAM 1214, a graphics controller 1216, and a display device 1218, which are interconnected via a host controller 1210. The computer 1200 further includes an input / output unit such as a communication interface 1222, a storage device 1224 (e.g., a hard disk drive), a DVD-ROM drive 1226, and an IC card drive, which are connected to the host controller 1210 via an input / output controller 1220. The computer further includes conventional input / output units such as a ROM 1230 and a keyboard 1242, which are connected to the input / output controller 1220 via an input / output chip 1240.
[0121] CPU 1212 runs according to the program stored in ROM 1230 and RAM 1214, thereby controlling each unit. Graphics controller 1216 obtains image data generated by CPU 1212 from the frame buffer provided to RAM 1214 or from its own storage, and displays the image data on display device 1218.
[0122] The communication interface 1222 communicates with other electronic devices via a network. The storage device 1224 stores programs and data used by the CPU 1212 within the computer 1200. The DVD-ROM drive 1226 reads programs or data from the DVD-ROM 1227 and provides the programs or data to the storage device 1224 via RAM 1214. The IC card driver reads programs and data from the IC card and / or writes programs and data to the IC card.
[0123] The ROM1230 stores the boot program executed by the computer 1200 during startup, and / or programs that are hardware-dependent on the computer 1200. The input / output chip 1240 can then connect various input / output units to the input / output controller 1220 through parallel ports, serial ports, keyboard ports, mouse ports, etc.
[0124] The program is provided by a computer-readable medium such as a DVD-ROM 1227 or an IC card. The program is read from the computer-readable medium, installed in a storage device 1224, RAM 1214, or ROM 1230 (also an example of a computer-readable medium), and executed by the CPU 1212. Information processing written within these programs is read by the computer 1200, enabling cooperation between the program and the aforementioned types of hardware resources. The apparatus or method can be configured to perform information manipulation or processing based on the use of the computer 1200.
[0125] For example, when communication is performed between the computer 1200 and external devices, the CPU 1212 can execute the communication program loaded into the RAM 1214 and issue communication processing instructions to the communication interface 1222 according to the processing written in the communication program. Under the control of the CPU 1212, the communication interface 1222 reads the transmission data stored in the transmission buffer processing area provided in the recording medium such as RAM 1214, storage device 1224, DVD-ROM 1227 or IC card, and sends the read transmission data to the network, or writes the received data received from the network into the receive buffer processing area provided on the recording medium, etc.
[0126] Furthermore, the CPU 1212 enables the RAM 1214 to read all or a portion of files or databases stored in external recording media such as storage device 1224, DVD-ROM drive 1226 (DVD-ROM 1227), IC card, etc., and to perform various types of processing on the data in the RAM 1214. The CPU 1212 then writes the processed data back to the external recording media.
[0127] Various types of information, such as programs, data, forms, and databases, can be stored in recording media and processed. The CPU 1212 can execute various types of processing on data read from RAM 1214, as specified in the instruction sequence of the program as described herein, including various types of operations, information processing, conditional judgments, conditional branches, unconditional branches, information search / replacement, etc., and write the results back to RAM 1214. Furthermore, the CPU 1212 can search for information in files, databases, etc., within the recording media. For example, when multiple entries, each having an attribute value of a first attribute associated with a second attribute value, are stored in the recording media, the CPU 1212 can search for entries from these entries that match the conditions specifying the first attribute value, read the attribute value of the second attribute already stored in that entry, thereby obtaining the attribute value of the second attribute associated with the first attribute that satisfies the predetermined conditions.
[0128] The programs or software modules described above can be stored on computer 1200 or on computer-readable media near computer 1200. Furthermore, hard drives or RAM provided in server systems connected to dedicated communication networks or the Internet can be used as computer-readable media to provide programs to computer 1200 via the network.
[0129] The present invention has been described above using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. Those skilled in the art will understand that various modifications or improvements can be made to the above embodiments. As can be understood from the description in the claims, the forms with such modifications or improvements can also be included within the technical scope of the present invention.
[0130] The execution order of processes such as operation, procedure, step, and stage in the apparatus, system, program, and method shown in the claims, specification, and drawings should be noted. Unless specifically stated as "before" or "before," and unless the output of the previous process is used for the subsequent process, they can be implemented in any order. Even if terms such as "firstly" or "next" are used for convenience in describing the operational flow in the claims, specification, and drawings, it does not mean that they must be implemented in this order.
[0131] According to this specification, the composition described in the following items is also disclosed. (Project 1) A service identification device comprising: The analysis project acquisition department acquires analysis projects containing the correspondence between the website URL of the analysis target website and the URL of external communication issued by at least one page within the analysis target website, the set web page storage, or the external communication that occurs. Using the service identification unit, the analyzed item is compared with the service database, and the service corresponding to the cookie, web page storage, or external communication URL contained in the analyzed item is identified as a service used on at least one page; and The service login department uses this function to associate the website URL with the service and log in. The service database contains information that associates cookies, web storage devices, and external communication URLs with the service. (Project 2) As described in Project 1, the use of a service identification device, wherein, The analysis project was obtained from the analysis project database. The database for this analysis project records the mapping between the website URL and the cookie, web page storage, or external communication URL. (Project 3) As described in Project 1, the use of a service identification device, wherein, If the service access registration unit is unable to identify the service through the service access identification unit, it will register the website URL and the cookie, web page storage, or external communication URL as not paired with the service. (Project 4) As described in Project 1, the use of a service identification device, wherein, The service identification unit has at least one of the following components: The external communication URL comparison unit extracts the service corresponding to the data that at least partially matches the external communication URL contained in the analysis item from the service database, and obtains the service as the service to be used; The cookie comparison unit retrieves the service corresponding to the data in the service database that at least partially matches the Name attribute of the cookie included in the analysis item, and obtains the service for use; and The webpage storage comparison unit extracts the service corresponding to the data that matches the Origin portion of the webpage storage included in the analysis item from the service database, and obtains the service as a service to be used. (Project 5) As described in Project 4, the use of a service identification device, in which, When the cookie comparison unit has multiple pieces of information that are at least partially identical to the cookie in the Name attribute, it selects the service that is most frequently represented by the multiple pieces of information as the service to be used. (Project 6) As described in Project 1, the use of a service identification device, wherein, The service login department associates the website URL with the service and registers it in the service database. (Project 7) An analytical device comprising: The analysis object acquisition department obtains the website URL of the analysis object's website. The analysis and execution unit analyzes one or more pages within the website whose URL is published, extracting external communication URLs for cookies issued by those one or more pages, web storage devices set, or external communications occurring; and The analysis project login unit matches the website URL of the page from which the cookie, web storage, or external communication URL has been extracted with the cookie, web storage, or external communication URL extracted from that page, and logs in in a manner that can be obtained by using a service identification device as described in Project 1. (Project 8) As described in Item 7, the analytical apparatus wherein the analytical execution unit has: The website access unit uses a virtual browser to specify the website URL, sends a request to the server operating the website being analyzed, and receives a response from the server. The analysis and extraction department extracts the external communication URLs of cookies issued by one or more pages or external communications that occurred from the response, thereby obtaining the data stored in the web page storage of the virtual browser; and The script execution unit, if the response contains a script, accesses the service by executing the script through the virtual browser. (Project 9) The analysis device described in Item 8 further includes a link extraction unit that extracts the page URL of the page with the link address from the response. The website access unit further specifies the page URL of the linked address, sends a request to the server operating the website of the analysis object, and receives a response from the server. (Project 10) As described in Item 8, the analysis device registers the correspondence between the website URL and the cookie, the web page storage, or the external communication URL in the analysis item database. (Project 11) A reference device comprising a service reference unit, the service reference unit having: The service acquisition unit acquires the service accessed via the service access identification device described in Item 1, and uses it as the service accessed on the target website; and The service output department has the function of outputting the service. (Project 12) As described in Item 11, the reference device, in which, The service acquisition department obtains the service from the service database. The service database uses the service identification device to associate the website URL with the service and register it. (Project 13) The reference device described in Item 12 further includes an analytical reference section, which has: The second analysis item acquisition department acquires analysis items containing the correspondence between the website URL of the target website and the corresponding cookies, web storage devices, or external communication URLs; and The analysis project output section outputs the website URL and the corresponding cookie, web storage, or external communication URL contained in the analysis project. (Project 14) As described in Item 13, the reference device, in which, The second analysis project was obtained from the analysis project database. The database for this analysis project records the mapping between the website URL and the cookie, web page storage, or external communication URL. (Project 15) A service identification method, executed by a computer, comprises the following stages: An analysis item that obtains a mapping between the URL of the target website and the URL of an external communication issued by at least one page within the target website, a configured web storage device, or an external communication that occurs; The analysis item is compared with the service database, and the service corresponding to the cookie, web storage, or external communication URL contained in the analysis item is identified as a service used on at least one page; and Configure the website URL to correspond with the service being used and log in. The service database contains information that associates cookies, web storage devices, and external communication URLs with the service. (Project 16) An analytical method, executed by a computer, comprises the following stages: Obtain the website URL of the target website; Analyze one or more pages within the website whose URL is published, and extract the external communication URLs of cookies issued by those one or more pages, web storage devices set, or external communications that occur; and The website URL of the page that issues the cookie, sets the web page storage, or generates the external communication URL corresponds to the cookie issued by that page, the web page storage set, or the external communication URL generated, and the user logs in a manner that can be obtained by means of the service identification method described in item 15. (Project 17) A service reference utilization method, executed by a computer, comprises the following stages: Obtain the service accessed by means of the service access identification method described in Item 15, as the service accessed on the target website; and Output the service used. (Project 18) A service identification program that causes a computer to execute the following program: An analysis item that obtains a mapping between the URL of the target website and the URL of an external communication issued by at least one page within the target website, a configured web storage device, or an external communication that occurs; The analysis item is compared with the service database, and the service corresponding to the cookie, web storage, or external communication URL contained in the analysis item is identified as a service used on at least one page; and The application program that links the website URL to the service and logs in. The service database contains information that associates cookies, web storage devices, and external communication URLs with the service. (Project 19) An analysis program that causes a computer to execute the following program: Obtain the website URL of the target website; Analyze one or more pages within the website whose URL is published, and extract the external communication URLs of cookies issued by those one or more pages, web storage devices set, or external communications that occur; and The website URL of the page that issues the cookie, sets the web page storage, or generates the external communication URL corresponds to the cookie issued by that page, the web page storage set, or the external communication URL generated, and is logged in in a manner that allows the second computer to obtain the service identification program as described in item 18 when the second computer is executed. (Project 20) A service reference program is used to cause a computer to execute the following program: Obtain the service accessed by causing a third computer to execute the service access identification program as described in Item 18, and use it as a service accessed on the target website; and Output the service used. (Project 21) A service identification system, which has: As described in Project 1, the use of service identification devices; The analytical apparatus described in Item 7; The reference device described in Item 11; and The service database contains information that associates cookies, web storage devices, and external communication URLs with services. (Project 22) A service identification system, which has: The analysis device obtains the website URL of the target website, analyzes one or more pages within the website published by that website URL, extracts cookies issued by those one or more pages, web storage settings, or external communication URLs of those external communications, and matches the website URL of the page that issued the cookie, set the web storage settings, or the external communication URL with the cookie issued by that page, the web storage settings, or the external communication URL of those pages, and then logs in the corresponding URL. Using a service identification device, the system compares the analysis items containing the correspondence between the website URL and the cookie, web storage, or external communication URL registered by the analysis device with a service database. It identifies the service corresponding to the cookie, web storage, or external communication URL in the analysis item as a service used on the page of the website URL, thus matching the website URL with the service and registering it. This service database contains information that associates cookies, web storage devices, and external communication URLs with the service. (Project 23) As described in Item 22, the service identification system further includes an analysis item database. This analysis item database is created by logging the correspondence between the website URL and the cookie, the web page storage, or the external communication URL using the analysis device, and obtaining the analysis items containing the correspondence using the analysis device. (Project 24) The service identification system described in Project 22 further includes a reference device that obtains the service accessed by the service identification device as the service accessed on the website being analyzed, and outputs the service access. (Project 25) As described in Item 24, the service identification system further includes a service database, which is used by the service identification device to associate the website URL with the service and log in, and by the reference device to obtain the service. (Project 26) As described in Project 22, the service identification system further includes a website database that records the website URL of at least one target website and obtains the website URL through the analysis device. (Project 27) A service identification method includes the following stages: Obtain the website URL of the target website, analyze one or more pages within the website published by that website URL, extract the external communication URLs of cookies issued by those one or more pages, web storage settings, or external communications that occur, and match the website URL of the page that issued the cookie, set the web storage setting, or the external communication URL with the cookie issued by that page, the web storage setting, or the external communication URL that occurred, and log in accordingly; and The database of analytics entries containing the mapping between the website URL and the corresponding cookies, web storage devices, or external communication URLs logged during the login phase is compared with a service database. The services corresponding to the cookies, web storage devices, or external communication URLs in the analytics entries are identified as the services used on the page at the website URL. This allows the website URL to be mapped to the corresponding service and logged in. The service database contains information that associates cookies, web storage devices, and external communication URLs with the service. (Project 28) A service identification program that causes one or more computers to execute the following program: Obtain the website URL of the target website, analyze one or more pages within the website published by that website URL, extract the external communication URLs of cookies issued by those one or more pages, web storage settings, or external communications that occur, and match the website URL of the page that issued the cookie, set the web storage setting, or the external communication URL with the cookie issued by that page, the web storage setting, or the external communication URL that occurred, and log in accordingly; and The system compares the database of analytics items containing the mapping between the website URL and the cookie, web storage, or external communication URL entered through the login procedure with a service database. It then identifies the service corresponding to the cookie, web storage, or external communication URL in the analytics item as the service used on the page of the website URL, thus mapping the website URL to the service and logging in. The service database contains information that associates cookies, web storage devices, and external communication URLs with the service.
[0132] 1: System (using service identification system) 10: Analytical apparatus 11: Analysis of the object acquisition section 12: Analysis and Execution Department 13: Analysis of Project Login Department 20: Website Database 30: Analysis Object Server 31: Cookie Settings 32: External Communication URL Settings 33: script tag 34: Link Tags 35: Information about status codes 40: Analyze the project database 50: Utilizing service identification devices 51: Analysis of Project Acquisition Department 52: Utilizing Service Identification Department 53: Utilizing the service login department 60: Service Database 70: Utilize the service database 80: Reference device 81: Utilizing the Service Reference Department 82: Analysis Project Reference Section 90: User Terminal 91: Monitor 99: Internet 121: Website Access Department 122: Analysis Project Extraction Department 123: Script Execution Department 124: Link Extraction Section 521: External Communication URL Comparison Department 522: Cookie Comparison Department 523: Webpage Storage Comparison Department 811: Obtaining services through the department 812: Analysis Project Acquisition Department (3rd Analysis Project Acquisition Department) 813: Utilizing the service output department 821: Analysis Project Acquisition Department (Second Analysis Project Acquisition Department) 822: Analysis Project Output Department 911: Object Website Display Department 912: Utilizing the service display department 913: Object Website Display Department 914: Analysis Project Display Department 915: Input Form 1200: Computer 1210: Host Controller 1212: CPU 1214:RAM 1216: Graphics Controller 1218: Display device 1220: Input / Output Controller 1222: Communication Interface 1224: Storage device 1226: DVD-ROM drive 1240: Input / Output Chip 1242: Keyboard
Claims
1. A service identification device comprising: a first analysis item acquisition unit that acquires analysis items containing the correspondence between website URLs of target websites and cookies issued by at least one page within the target website; a service identification unit that compares the analysis items with a service database and identifies the service corresponding to the cookie contained in the analysis items as a service used on the at least one page; and a service registration unit that associates the website URL with the service used and registers the user; wherein, The service database contains data that associates cookies with services. The service identification unit has a cookie comparison unit that extracts a service from the service database that corresponds to a cookie in the analysis item that is at least partially identical in the Name attribute. The service is then selected as the service to be used. If the cookie comparison unit has multiple cookies that are at least partially identical in the Name attribute, it selects the service that represents the most services among the multiple cookies as the service to be used.
2. The service identification device as described in claim 1, wherein, The analysis project further includes a correspondence between the website URL of the analysis target website and the web page storage set by at least one page in the analysis target website, or the external communication URL of the external communication that occurs. The service identification unit further identifies the service corresponding to the web page storage or the external communication URL as the service used on the at least one page. The service database further records the data that corresponds the web page storage and the external communication URL to the service respectively.
3. The service identification device as described in claim 2, wherein, If the service access registration unit is unable to identify the service through the service access identification unit, it will register the website URL and the cookie, web page storage, or external communication URL as not paired with the service.
4. The service identification device as described in claim 2, wherein, The first analysis item acquisition department obtains the analysis item from an analysis item database, which records the correspondence between the website URL and the cookie, the web page storage, or the external communication URL.
5. The service identification device as described in claim 2, wherein, The service identification unit further includes at least one of the following: an external communication URL comparison unit that extracts from the service database the service corresponding to the data that is at least partially consistent with the external communication URL included in the analysis project, and obtains the service as the service to be used. And a web storage Origin comparison unit, which extracts the service corresponding to the data that matches the Origin part of the web storage included in the analysis project from the service database, and obtains the service for use.
6. The service identification device as described in claim 1, wherein, The service login department associates the website URL with the service and registers it in the service database.
7. An analysis apparatus comprising: an analysis target acquisition unit that acquires the website URL of an analysis target website; an analysis execution unit that analyzes one or more pages within a website published by the website URL and extracts cookies issued by the one or more pages, web page storage settings, or external communication URLs of external communications occurring; and an analysis item registration unit that maps the website URL of the page from which the cookies, web page storage settings, or external communication URLs have been extracted to the cookies, web page storage settings, or external communication URLs extracted from the pages, and registers the items in a manner obtainable by means of a service identification device as described in claim 2.
8. The analytical apparatus as described in claim 7, wherein, The analysis execution unit comprises: a website access unit that uses a virtual browser to specify the website URL, sends a request to a server operating the website of the analysis target, and receives a response from the server; an analysis item extraction unit that extracts from the response the external communication URL of cookies issued by one or more pages or external communications that occur, thereby obtaining data stored in the web page storage of the virtual browser; and a script execution unit that, if the response contains a script, executes the script through the virtual browser to access the service.
9. The analysis apparatus as described in claim 8, further comprising a link extraction unit that extracts the page URL of the linked page from the response, and the website access unit that further specifies the page URL of the linked page, sends a request to the server operating the website of the analysis target, and receives a response from the server.
10. The analytical apparatus as described in claim 8, wherein, The analysis project login department logs the correspondence between the website URL and the cookie, web page storage, or external communication URL into the analysis project database.
11. A reference device comprising a service reference unit, the service reference unit having: a service acquisition unit that acquires the service registered by the service identification device as described in claim 2 as a service used on an analysis target website; and a service output unit that outputs the service.
12. The reference device as described in claim 11, wherein, The service acquisition unit obtains the service from the service database, and the service database uses the service identification device to match the website URL with the service and register it.
13. The reference apparatus as described in claim 12, further comprising an analysis item reference unit, the analysis item reference unit having: a second analysis item acquisition unit that acquires an analysis item containing a correspondence between the website URL of the analysis target website and a cookie, web storage device, or external communication URL corresponding to the website URL; and an analysis item output unit that outputs the website URL contained in the analysis item and the cookie, web storage device, or external communication URL corresponding to the website URL.
14. The reference device as described in claim 13, wherein, The second analysis project acquisition department obtains the analysis project from the analysis project database, which records the correspondence between the website URL and the cookie, the web page storage, or the external communication URL.
15. A service identification method, executed by a computer, comprising the following stages: obtaining an analysis item containing the correspondence between website URLs of an analysis target website and cookies issued by at least one page within the analysis target website; comparing the analysis item with a service database, identifying the service corresponding to the cookie contained in the analysis item as a service used on the at least one page; and associating the website URL with the service and logging in; wherein, The service database contains data that associates cookies with services; the stage of identifying a service for use includes the following steps: extracting a service from the service database that corresponds to data that is at least partially identical in the Name attribute of the cookie included in the analysis item, and obtaining the service as the service for use, wherein the step of obtaining the service as the service for use is, in the case of having multiple data that are at least partially identical in the Name attribute of the cookie, obtaining the service that represents the most among the multiple services represented by the multiple data as the service for use.
16. An analysis method performed by a computer, the analysis method comprising the following stages: obtaining the website URL of the target website; analyzing one or more pages within the website published by the website URL, extracting the external communication URL of cookies issued by the one or more pages, web storage devices set, or external communications occurring; and matching the website URL of the page that issued the cookie, set the web storage device, or occurred with the cookie issued by the page, the web storage device set, or the external communication URL occurring, and logging in in a manner obtainable by the service identification method as described in claim 15.
17. A service referencing method performed by a computer, the service referencing method comprising the following stages: obtaining the service accessed by means of the service access identification method as described in claim 15, as a service accessed on the target website; and outputting the service access.
18. A service identification program that causes a computer to execute the following procedures: obtaining an analysis item containing a mapping between the URL of a target website and cookies issued by at least one page within the target website; comparing the analysis item with a service database and identifying the service corresponding to the cookie contained in the analysis item as a service used on the at least one page; and a service identification program that maps the website URL to the service and logs in; wherein, The service database contains data that associates cookies with services. The procedure for identifying the service corresponding to the cookie included in the analysis item as a service to be used on at least one page includes the following steps: extracting a service corresponding to data that is at least partially identical in the Name attribute of the cookie included in the analysis item from the service database, and obtaining the service as a service to be used. The step of obtaining the service as a service to be used is, in the case of having multiple data that are at least partially identical in the Name attribute of the cookie, obtaining the service that represents the most services among the multiple data as the service to be used.
19. An analysis program for causing a first computer to execute the following procedures: obtaining the website URL of the target website; analyzing one or more pages within the website published by the website URL, extracting the external communication URL of cookies issued by the one or more pages, the web storage set by the pages, or the external communication that occurs; and making the website URL of the page that issued the cookie, set the web storage, or the external communication URL correspond to the cookie issued by the page, the web storage set by the page, or the external communication URL that occurs, and logging in in a manner that allows the second computer to obtain the service identification program as requested in claim 18 when the program is executed by a second computer.
20. A service reference program for causing a first computer to perform the following procedure: obtaining the service accessed by causing a third computer to execute the service access identification program as requested in claim 18, as a service accessed on the target website; and outputting the service access.
21. A service identification system comprising: a service identification device as described in claim 2; an analysis device as described in claim 7; a reference device as described in claim 11; and a service database containing data that associates the cookie, the web page storage, and the external communication URL with the service respectively.
22. A service identification apparatus comprising: a first analysis item acquisition unit that acquires analysis items containing a correspondence between a website URL of an analysis target website and an external communication URL of a cookie issued by at least one page within the analysis target website, a set web storage device, or an external communication URL of an external communication that occurs; a service identification unit that compares the analysis items with a service database and identifies the service corresponding to the cookie, the web storage device, or the external communication URL contained in the analysis items as a service used on the at least one page; and a service registration unit that associates the website URL with the service used and registers the service; wherein, The service database contains information that maps cookies, web storage devices, and external communication URLs to services. The service database also contains information that maps multiple cookies to a service, multiple web storage devices to a service, and multiple external communication URLs to a service.
23. A service identification apparatus comprising: a first analysis item acquisition unit that acquires analysis items containing a mapping relationship between a website URL of an analysis target website and an external communication URL of a cookie issued by at least one page within the analysis target website, a set web storage device, or an external communication URL of an external communication that occurs; a service identification unit that compares the analysis items with a service database and identifies the service corresponding to the cookie, web storage device, or external communication URL contained in the analysis items as a service used on the at least one page; and a service registration unit that registers the website URL with the service used; wherein, The service database contains data that maps cookies, web storage devices, and external communication URLs to services. The first analysis item acquisition unit retrieves the analysis item from the analysis item database, which includes a table that maps the website URL to the cookie, a table that maps the website URL to the aforementioned web storage device, and a table that maps the website URL to the external communication URL.
24. A service identification device comprising: a first analysis item acquisition unit that acquires analysis items containing a correspondence between a website URL of an analysis target website and an external communication URL of a cookie issued by at least one page within the analysis target website, a set web storage device, or an external communication URL of an external communication that occurs; a service identification unit that compares the analysis items with a service database and identifies the service corresponding to the cookie, the web storage device, or the external communication URL contained in the analysis items as a service used on the at least one page; and a service registration unit that associates the website URL with the service used and registers the service; wherein, The service database contains information that associates cookies with services, information that associates web storage with services, and information that associates external communication URLs with services. The information in the cookie includes the domain.
Citation Information
Patent Citations
Use service identification apparatus
JP2018185741A
Apparatus and method for remotely monitoring terminal
US20110153651A1
Methods and apparatus to identify session users with cookie information
US20150180991A1
Merchant classification based on content derived from web crawling merchant websites
US20200327548A1
Methods and apparatus to monitor online activity
US20220150318A1
