Inspection device, inspection method, and program

Abstract

To provide information for determining whether a visual effect is appropriately performed in an application for performing a specific visual effect to an original image to be updated.SOLUTION: An inspection device detects difference between a first image located in a first area of a first object image obtained by performing a visual effect to a first original image and a second image located in the first area of a second object image obtained by performing the visual effect to a second original image obtained by updating the first original image, detects difference between a first code for displaying a third image located in a second area of the first object image and a second code for displaying a fourth image located in the second area of the second object image, and generates and outputs notification information including difference information based on the difference between the first image and the second image and the difference between the first code and the second code.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a technique for inspecting an image obtained by applying a visual effect to an original image. [Background technology]

[0002] Digital adoption refers to eliminating the gap between the application (system) being introduced and the business, enabling users to master the application. Tools for achieving this kind of digital adoption are called digital adoption tools (see, for example, Patent Document 1 and Non-Patent Document 1). Digital adoption tools, for example, add visual effects (for example, extended UI (user interface) elements such as navigation displays, sticky notes, and warning displays) to the user interface images of an application, thereby guiding, assisting, and alerting users. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6557184 [Non-patent literature]

[0004] [Non-Patent Document 1] “BizFront / SmartUI for Digital Adoption”, [online], NTT Technocross Corporation, [Retrieved January 24, 2024], Internet <https: / / www.ntt-tx.co.jp / products / bizfront / sui / ad / LP05 / bizfrontsmartui_lp05.html?utm_source=google&utm_medium=cpc&utm_campaign=bizfront_shimei&gclid=EAIaIQobChMI_pHp-66JgwMVTtUWBR1UtgxMEAAYASAAEgLkw_D_BwE#problem> Summary of the Invention [Problem to be solved by the invention]

[0005] However, when a user interface image is updated, the visual effects may not be applied as expected. This problem is not limited to when visual effects are applied to a user interface image using a digital adaptation tool, but is common to all applications where specific visual effects are applied to an original image that is to be updated.

[0006] An object of the present invention is to provide information for determining whether a particular visual effect has been applied appropriately in an application where the visual effect is applied to an original image to be updated. [Means for solving the problem]

[0007] The inspection device detects a difference between a first image located in a first area of ​​a first target image obtained by applying a visual effect to a first original image, and a second image located in the first area of ​​a second target image obtained by applying the visual effect to a second original image obtained by updating the first original image; detects a difference between a first code for displaying a third image located in the second area of ​​the first target image, and a second code for displaying a fourth image located in the second area of ​​the second target image; and generates and outputs notification information including difference information based on the difference between the first image and the second image and the difference between the first code and the second code. [Effects of the Invention]

[0008] This makes it possible to provide information for determining whether a particular visual effect has been applied appropriately when the original image is updated in an application where the original image is to be subjected to a particular visual effect. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram illustrating the configuration of an information processing system according to an embodiment. [Figure 2]FIG. 2 is a block diagram illustrating the functional configuration of the application use device according to the embodiment. [Figure 3] FIG. 3 is a block diagram illustrating the functional configuration of the inspection apparatus according to the embodiment. [Figure 4] FIG. 4 is a flow diagram illustrating the setting process according to the embodiment. [Figure 5] FIG. 5 is a flow diagram for explaining the inspection process of the embodiment. [Figure 6] FIG. 6 is a flow diagram for explaining the inspection process of the embodiment. [Figure 7] Fig. 7A is a diagram illustrating a user interface image (first original image), and Fig. 7B is a diagram illustrating an extended user interface image (first target image) in which UI elements are added to the user interface image (visual effects are applied). [Figure 8] 8A and 8B are diagrams illustrating an extended user interface image (second target image) in which UI elements are added to an updated user interface image (second original image). [Figure 9] FIG. 9 is a diagram illustrating an extended user interface image (second target image) in which UI elements are added to the updated user interface image (second original image). [Figure 10] Fig. 10A is a diagram illustrating an example in which regions that are not to be compared are excluded, and Fig. 10B is a diagram illustrating an example in which regions that are not to be compared are masked. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [First embodiment] <Configuration> 1, information processing system 1 of this embodiment has application providing device 11, application utilization device 12, digital adaptation device 13, and inspection device 14. Application providing device 11 and application utilization device 12 are configured to be able to communicate with each other via network 10, and application utilization device 12 is configured to be able to exchange information with digital adaptation device 13 and inspection device 14.

[0011] The application providing device 11 of this embodiment is a device that provides a predetermined application. The application of this embodiment provides a service that involves inputting and outputting information to a user interface. Examples of the application include an approval system, an application system, an accounting system, and an attendance management system, but the present invention is not limited to these.

[0012] The application utilization device 12 of this embodiment is a device for utilizing an application provided by the application providing device 11. As illustrated in Fig. 2, the application utilization device 12 of this embodiment includes a communication interface 121, a user interface 122, a storage unit 123, an information providing unit 124, a browser 125, a setting information providing unit 126, and a control unit 128. The application utilization device 12 executes each process under the control of the control unit 128.

[0013] The digital adaptation device 13 of this embodiment is a device for adding UI elements to a user interface image of an application. Such a technique is disclosed in, for example, Patent Document 1 and Non-Patent Document 1.

[0014] The inspection device 14 of this embodiment is a device for inspecting whether UI elements are correctly added to a user interface image. As illustrated in Fig. 3, the inspection device 14 of this embodiment includes a storage unit 141, a setting unit 142, an information acquisition unit 143, an image difference detection unit 144, a code difference detection unit 145, a notification information generation unit 146, and a control unit 147. The inspection device 14 executes each process under the control of the control unit 147.

[0015] <Pre-processing> The pre-processing of this embodiment will be described. In this embodiment, application use device 12 (FIG. 1) downloads AP information for providing a predetermined application (AP) from application providing device 11. That is, application providing device 11 transmits the AP information to application use device 12 via network 10 in response to a request from application providing device 11. The AP information includes code for providing the predetermined application (for example, HTML source code, Javascript source code, etc.). The transmitted AP information is received by communication interface 121 of application use device 12 (FIG. 2) and stored (installed) in storage unit 123.

[0016] The digital adaptation device 13 (FIG. 1) extracts AP information from the storage unit 123 of the application use device 12 (FIG. 2). The digital adaptation device 13 generates digital adaptation (DA) information for displaying an extended user interface image (a first target image obtained by applying visual effects to the first original image) in which an extended UI element is added to a user interface image (a first original image) displayed based on the extracted AP information. For example, in the case of a user interface image 1011a as illustrated in FIG. 7A, the digital adaptation device 13 generates an extended user interface image 1011 in which an extended UI element 1011b as illustrated in FIG. 7B is added to the user interface image 1011a. The DA information is information for providing an application including a display function for the extended user interface image. The DA information includes code (e.g., HTML source code, Javascript source code, etc.) for providing such an application. The extended UI element is a UI element separate from the UI element of the user interface image displayed based on the AP information. UI elements are elements of a user interface image and elements of an extended user interface image. Examples of UI elements of a user interface image include an input field, a display field, an input button, a click button, and a pull-down list. Examples of extended UI elements include a navigation display, a sticky note display, a warning display, a pull-down list, and masking that prevents a button from being pressed unless a condition is met (see, for example, Non-Patent Document 1). An extended user interface image is, for example, an image in which an extended UI element is added to a specific position of a user interface image. One example of an extended user interface image is an image in which the UI elements of a user interface image remain, but an extended UI element is superimposed on the visual position of at least one of the UI elements.

[0017] A method for generating DA information from AP information is disclosed in Patent Document 1 and the like. For example, a rule (display rule) for adding a specific extended UI element to a specific position of a user interface image is set in advance, and the digital adaptation device 13 generates DA information by adding a rule file representing the rule and code for interpreting and executing the rule to the AP information. For example, a rule may be set such that "if AP information (including, for example, HTML source code) includes identification information (e.g., tag, ID, class, attribute, etc.) of a specific element (e.g., UI element) of a user interface image, add the specific extended UI element to a specific position of the user interface image determined based on the specific element." In the case of this rule, when generating DA information from AP information, the identification information of the specific element (selector) specified in this way is referenced. In this case, the DA information (including the first code) includes identification information of the specific element (first identification information of the specific element of the first image referenced to apply a visual effect to a specific position of the first image). The digital adaptation device 13 stores the generated DA information in the storage unit 123 of the application utilization device 12 (FIG. 2).

[0018] The AP information is updated periodically or irregularly. When the AP information is updated, the application providing device 11 (FIG. 1) transmits the updated AP information to the application use device 12 via the network 10. The updated AP information is received by the communication interface 121 of the application use device 12 (FIG. 2) and stored (installed) in the storage unit 123. This updates the AP information stored in the storage unit 123. Alternatively, when the AP information is updated, the application providing device 11 (FIG. 1) may transmit only the updated portion to the application use device 12 via the network 10. In this case, the communication interface 121 of the application use device 12 (FIG. 2) receives only the updated portion and updates the AP information stored in the storage unit 123. Note that updating the AP information may or may not visually change the user interface image. In the latter example, updating the AP information changes the code for displaying the user interface image but does not affect the user interface image. For example, an update of AP information may change the identification information (e.g., tag, ID, class, attribute, etc.) of a specific element of a user interface image, but this does not affect the user interface image. Another example of the latter is when an update of AP information changes part of the code, but the code for displaying the user interface image does not change. Also, an update of AP information may change the code for displaying a user interface image in a specific transition state, but the code for displaying user interface images in other transition states may not change.

[0019] When AP information is updated, the digital adaptation device 13 (FIG. 1) generates DA information for the updated AP information. That is, first, the digital adaptation device 13 extracts the updated AP information from the storage unit 123 of the application use device 12 (FIG. 2). The digital adaptation device 13 generates DA information for displaying an extended user interface image (a second target image in which a visual effect is applied to the second original image) in which an extended UI element is added to a user interface image (a second original image obtained by updating the first original image) displayed according to the extracted AP information. For example, when the user interface image 1011a illustrated in FIG. 7A is updated to the user interface image 1012a illustrated in FIG. 8A, an extended user interface image 1012 is generated in which an extended UI element 1011b is added to the user interface image 1012a. When the AP information is updated in this manner, the extended UI element 1011b may be added appropriately, or the extended UI element 1011b may not be added appropriately, as in the user interface image 1013 of FIG. 8B, or the extended UI element 1011b may disappear, as in the user interface image 1014 of FIG. 9.

[0020] A method for generating DA information from updated AP information is disclosed in Patent Document 1 and the like. For example, if there is no change in the set rule, the DA information is generated as described above. In the case of the above rule, the DA information (including the second code) includes the identification information of the specific element described above (second identification information of the specific element of the second image referenced to apply a visual effect to a specific position in the second image). The digital adaptation device 13 stores the generated DA information in the storage unit 123 of the application use device 12 (FIG. 2). In this way, the DA information is updated in accordance with updates to the AP information.

[0021] <Settings for testing> The setting process for the test will be illustrated with reference to FIG. The user 100 uses the application usage device 12 (FIG. 2) to perform initial settings of the inspection device 14 (FIG. 3). That is, the user 100 inputs information for the initial settings into the user interface 122 of the application usage device 12 (FIG. 2). The initial settings may be of any type, and may include, for example, operational settings for the inspection device 14 and / or the application usage device 12 related to inspection. Examples of the initial settings include setting a notification method (e.g., email notification, toast notification, etc.) for notification information indicating error information and inspection results, and setting the notification destination. The input content for the initial settings is sent to the setting information providing unit 126. The setting information providing unit 126 generates initial setting information indicating the contents of the initial settings and sends it to the setting unit 142 of the inspection device 14 (FIG. 3). The setting unit 142 stores the initial setting information in the storage unit 141 (step S101).

[0022] Next, the user 100 uses the application utilization device 12 (FIG. 2) to set up a test case. Setting up a test case involves determining which of the extended user interface images displayed by an application provided by executing DA information is to be inspected. For example, determining which of the extended user interface images that transition according to transition logic is to be inspected. Transition logic refers to the logic of screen transitions by an application. For example, the transition logic includes the trigger for a screen transition (an action such as clicking a button or tapping a link) and the definition of the transition for the trigger (such as which screen to move from when a button is clicked). The number of extended user interface images to be inspected may be one or more. Furthermore, if the display rules for extended user interface images vary depending on inputs, conditions, or collaboration with other devices, the extended user interface images to be inspected may be set for each display rule. The user 100 inputs information for setting up a test case into the user interface 122 of the application utilization device 12 (FIG. 2). For example, the user 100 inputs information for identifying the extended user interface image to be inspected into the user interface 122. For example, information (e.g., a selector) for selecting the extended user interface image to be inspected may be input to the user interface 122, or information (e.g., a URL: Uniform Resource Locator) representing the location of the extended user interface image to be inspected may be input to the user interface 122. The input content for test case setting is sent to the setting information providing unit 126. The setting information providing unit 126 generates test case setting information for identifying the extended user interface image to be inspected, and sends it to the setting unit 142 of the inspection device 14 (FIG. 3). The setting unit 142 stores the test case setting information in the storage unit 141 (step S102).

[0023] The information acquisition unit 143 of the inspection device 14 (FIG. 3) requests the information provision unit 124 of the application use device 12 (FIG. 2) to provide an original target image, which is an extended user interface image identified by the test case setting information extracted from the storage unit 141, and an original target code (original information), which is code for displaying the extended user interface image identified by the test case setting information. The information provision unit 124 inputs the DA information extracted from the storage unit 123 into the browser 125 and acquires the original target image (e.g., a browser display image) from the browser 125. This acquisition is performed, for example, by taking a screenshot of the original target image. The information provision unit 124 also acquires the original target code (e.g., HTML source code, etc.) from the DA information extracted from the storage unit 123. The information provision unit 124 sends the acquired original target image and original target code to the information acquisition unit 143 of the inspection device 14 (FIG. 3). The information acquisition unit 143 acquires the original object image and the original object code, and stores them in the storage unit 141 (step S103).

[0024] The information acquiring unit 143 extracts an original target image from the storage unit 141 and determines whether the original target image is appropriate. For example, the information acquiring unit 143 determines whether the original target image extracted from the storage unit 141 includes the extended user interface image to be inspected, which was set in step S102. This determination is made, for example, based on information (e.g., a URL) indicating the location of the extended user interface image to be inspected, which was set in step S102, and information (e.g., a selector) for selecting the extended user interface image to be inspected. Furthermore, if a specific area (e.g., a range of a screenshot) of the extended user interface image to be inspected is set as the inspection target, the information acquiring unit 143 may determine whether the original target image extracted from the storage unit 141 includes elements of the specific area. This determination is made, for example, based on the information (e.g., a URL) indicating the location of the extended user interface image to be inspected, which was set in step S102, and information (e.g., a selector) for selecting the extended user interface image to be inspected (step S104). If it is determined that the original target image is inappropriate (if there is an error), the information acquisition unit 143 notifies the user of error information according to the initial setting information extracted from the storage unit 141. For example, the information acquisition unit 143 sends the error information to the browser 125 of the application use device 12 (FIG. 2). In this case, the browser 125 sends an error display based on the error information to the user interface 122, and the user interface 122 displays the error (for example, a toast notification) (step S106). Thereafter, the process returns to step S102. On the other hand, if the original target image is appropriate (if there is no error), the process proceeds to the next step S108 (step S105).

[0025] In step S108, the user 100 sets a schedule for inspection using the application usage device 12 (FIG. 2). That is, the user 100 inputs information to the user interface 122 of the application usage device 12 (FIG. 2) to set a schedule for inspection. Any schedule may be set. For example, a schedule for inspection may be set to periodically inspect, a schedule for inspection at a specific date and time, or a schedule for inspection when a specific event occurs. An example of the occurrence of a specific event is when the application usage device 12 is started up or when AP information is updated. The input content for setting this schedule is sent to the setting information providing unit 126. The setting information providing unit 126 generates schedule setting information representing the contents of the schedule and sends it to the setting unit 142 of the inspection device 14 (FIG. 3). The setting unit 142 stores the schedule setting information in the storage unit 141 (step S108).

[0026] <Inspection processing> The inspection process will be illustrated with reference to FIG. The control unit 147 of the inspection device 14 (FIG. 3) monitors whether it is time to perform an inspection using the schedule setting information extracted from the storage unit 141. If the control unit 147 determines that it is not time to perform an inspection, it continues to monitor whether it is time to perform an inspection. On the other hand, if it determines that it is time to perform an inspection, it proceeds to the next step S112 (step S111).

[0027] In step S112, the information acquisition unit 143 of the inspection device 14 (FIG. 3) requests the information provision unit 124 of the application use device 12 (FIG. 2) to provide a test case object image, which is an extended user interface image identified by the test case setting information extracted from the storage unit 141, and a test case object code (test case information), which is code for displaying the extended user interface image identified by the test case setting information. These test case object images and test case object code are the inspection objects. The information provision unit 124 inputs the DA information extracted from the storage unit 123 into the browser 125 and acquires a test case object image (e.g., a browser display image) from the browser 125. This acquisition is performed, for example, by taking a screenshot of the test case object image. The information provision unit 124 also acquires the test case object code (e.g., HTML source code) from the DA information extracted from the storage unit 123. The information provision unit 124 sends the acquired test case object image and test case object code to the information acquisition unit 143 of the inspection device 14 (FIG. 3). The DA information extracted in step S112 may be the same as the DA information extracted in step S103, or may be updated from the DA information extracted in step S103. The information acquisition unit 143 acquires the test case target image and the test case target code, and stores them in the storage unit 141 (step S112).

[0028] The image difference detection unit 144 extracts pairs of corresponding original target images and test case target images from the storage unit 141. That is, the image difference detection unit 144 extracts pairs of original target images and test case target images identified by the same test case setting information. For example, the original target images and test case target images of this pair are in the same transition state, having transitioned according to the same transition logic. If the DA information extracted in step S112 is the same as the DA information extracted in step S103, the original target images and test case target images of this pair are identical. If the DA information extracted in step S112 is updated from the DA information extracted in step S103, the original target images and test case target images of this pair may not be identical. Furthermore, the image difference detection unit 144 may extract one or more pairs of corresponding original target images and test case target images. The image difference detection unit 144 compares each set of original target images with the test case target images, and detects a difference (e.g., a difference between images such as a browser display image) between the original target image (a first image located in a first region of a first target image obtained by applying a visual effect to a first original image) and the test case target image (a second image located in the first region of a second target image obtained by applying the visual effect to a second original image). Image difference information indicating the difference between each set of original target images and the test case target image is sent to the notification information generation unit 146 (step S113).

[0029] The code difference detection unit 145 extracts pairs of corresponding original subject code and test case subject code from the storage unit 141. That is, the code difference detection unit 145 extracts pairs of original subject code for displaying an original subject image and test case subject code for displaying a test case subject image, which are specified by the same test case setting information. In other words, the code difference detection unit 145 extracts pairs of original subject code and test case subject code corresponding to the pairs of original subject code and test case subject code extracted in step S112. The code difference detection unit 145 may extract one or more pairs of corresponding original subject code and test case subject code. If the DA information extracted in step S112 is the same as the DA information extracted in step S103, the original subject code and test case subject code of this pair are identical. If the DA information extracted in step S112 has been updated from the DA information extracted in step S103, the original subject code and test case subject code of this pair may not be identical. For example, the original subject code (first code) includes identification information of a specific element of the user interface image (first identification information of a specific element of the first original image referenced to apply a visual effect to a specific position of the first original image). For example, the test case subject code (second code) includes identification information of a specific element of the user interface image (second identification information of a specific element of the second original image referenced to apply a visual effect to a specific position of the second original image). The code difference detection unit 145 compares each set of original subject code with the test case subject code and detects differences (e.g., differences in code strings such as HTML source code) between the original subject code (first code for displaying a third image located in the second area of ​​the first subject image) and the test case subject code (second code for displaying a fourth image located in the second area of ​​the second subject image). Code difference information representing the differences between each set of original subject code and the test case subject code is sent to the notification information generation unit 146 (step S114).

[0030] The notification information generating unit 146 receives image difference information (step S113) representing the difference between each set of original target image and test case target image, and code difference information (step S114) representing the difference between each set of original target code and test case target code. The notification information generating unit 146 determines whether to generate notification information based on the image difference information and the code difference information. An example of this determination method is shown below.

[0031] <Example of judgment method 1> The notification information generation unit 146 determines not to generate notification information if there is no difference between the original target image and the test case target image of each set and no difference between the original target code and the test case target code of each set. On the other hand, the notification information generation unit 146 determines to generate notification information if there is a difference between the original target image and the test case target image of any set or if there is a difference between the original target code and the test case target code of any set.

[0032] <Example of judgment method 2> The notification information generating unit 146 determines not to generate notification information when there is no difference between the original target image and the test case target image of each set. On the other hand, the notification information generating unit 146 determines to generate notification information when there is a difference between the original target image and the test case target image of any set.

[0033] <Example 3 of judgment method> The notification information generating unit 146 determines not to generate notification information when there is no difference between the original subject code and the test case subject code of each set. On the other hand, the notification information generating unit 146 determines to generate notification information when there is a difference between the original subject code and the test case subject code of any set.

[0034] If it is determined that the notification information is not to be generated, the inspection process ends. On the other hand, if it is determined that the notification information is to be generated, the process proceeds to the next step S116 (step S115).

[0035] In step S116, the notification information generating unit 146 generates and outputs notification information (comparison result report) including difference information based on the image difference information (difference between the first image and the second image) and the code difference information (difference between the first code and the second code). Examples of notification information are shown below.

[0036] <Example of notification information 1> The notification information of Example 1 includes difference information that visually represents image difference information and difference information that visually represents code difference information.

[0037] An example of difference information visually representing image difference information: (1-1-1) Difference information representing an image obtained by aligning and overlaying grayscale transparent images of corresponding original target images and test case target images, and adding color (e.g., red) to the differences between the original target images and the test case target images. (1-1-2) Difference information representing an image obtained by aligning and overlaying a transparent image (e.g., 80% transparency) of the difference portion between the corresponding original target image and test case target image on the original target image. (1-1-3) Difference information in which the corresponding original target image and test case target image are aligned and overlaid without transparency, and the area where the original target image and the area where the test case target image are displayed change depending on the movement, scaling, deformation, etc. of a slider. The slider refers to the boundary between the area where the original target image is displayed and the area where the test case target image is displayed. There is no limitation on the direction of slider movement; the slider may move left and right, up and down, or diagonally. The slider may be a straight or curved boundary, or the boundary of any two-dimensional area such as a rectangle or circle. In the latter case, the two-dimensional area may be expanded, reduced, or deformed. Furthermore, the original target image may be placed in front of the test case target image, or the test case target image may be placed in front of the original target image. (1-1-4) Difference information representing an image obtained by arranging corresponding original and test case target images side by side and applying a color (e.g., red) to the difference between them. The color may be applied only to the test case target image, only to the original target image, or both to the original and test case target images. It may be possible to select which image to apply the color to.

[0038] An example of a diff that visually represents code diff information: (1-2-1) Difference information representing character strings obtained by aligning corresponding original subject code and test case subject code and applying special visual displays to character strings that differ between them. Special visual displays include, for example, changing the character font, adding correction lines, underlining, or applying a different color from other parts. For example, character strings in the test case subject code that were added to the original subject code may be bolded or colored red, and double correction lines may be added to character strings that were deleted from the original subject code. Conversely, character strings in the original subject code that were added to the test case subject code may be bolded or colored red, and character strings that were deleted from the test case subject code may be underlined. Furthermore, such special visual displays may be applied only to the test case subject code, only to the original subject code, or to both the original subject image and the test case subject image. It may be possible to select which of the following special visual displays to apply. (1-2-2) Difference information representing character strings obtained by applying a special visual display to character strings that differ between corresponding original subject code and test case subject code. Examples of the special visual display are the same as those in (1-2-1). It may be possible to select whether to apply such special visual display to the original subject code or the test case subject code.

[0039] <Example of notification information 2> The notification information of Example 2 includes at least one of difference information visually representing image difference information and difference information visually representing code difference information. For example, if there is a difference between corresponding original target code and test case target code, but no difference between the original target image and test case target image, the notification information includes difference information visually representing code difference information, but does not include difference information visually representing image difference information. Examples of each difference information are the same as those of Example 1 of the notification information.

[0040] <Example 3 of notification information> The notification information of Example 3 includes first visual information when a difference is detected between corresponding original subject code and test case subject code, and also between the corresponding original subject image and test case subject image. The notification information of Example 3 also includes second visual information when a difference is detected between corresponding original subject code and test case subject code, but no difference is detected between the corresponding original subject image and test case subject image. That is, the regions (first regions) of the original subject image and test case subject image include a multi-inspection region that overlaps with the regions (second regions) of the images represented by the original subject code and test case subject code. When both a difference between the original subject image (first image) and the test case subject image (second image) and a difference between the original subject code (first code) and the test case subject code (second code) corresponding to the multi-inspection region are detected, the notification information further includes first visual information. When a difference between the original object image (first image) and the test case object image (second image) in the multi-inspection area is not detected but a difference between the original object code (first code) and the test case object code (second code) corresponding to the multi-inspection area is detected, the notification information further includes second visual information. Note that the first visual information and the second visual information are different from each other. The first visual information and the second visual information may be, for example, text information, color information, or image information. For example, the first visual information may represent a high warning level, and the second visual information may represent a lower warning level than the first visual information. Furthermore, the notification information of Example 3 may include third visual information when a difference between the corresponding original object image and the test case object image is detected but a difference between the corresponding original object code and the test case object code is not detected. The third visual information is different from the first visual information and the second visual information. The third visual information may be, for example, text information, color information, or image information. For example, the first visual information may represent a high warning level, the second visual information may represent a lower warning level than the first visual information, and the third visual information may represent a lower warning level than the third visual information.The notification information example 3 may be combined with the notification information example 1 or example 2 (step S116).

[0041] The notification information generation unit 146 (FIG. 3) notifies the user of the notification information in accordance with the initial setting information extracted from the storage unit 141. For example, the notification information generation unit 146 sends the notification information to the browser 125 of the application use device 12 (FIG. 2). In this case, the browser 125 sends a notification information display based on the notification information to the user interface 122, and the user interface 122 displays the notification information (for example, a toast notification). Alternatively, for example, the notification information generation unit 146 may send the notification information by email to a predetermined terminal device, and the notification information may be displayed on the terminal device (step S117).

[0042] <Features of this form> The inspection device 14 of this embodiment detects a difference between an original object image (a first image located in a first region of a first object image obtained by applying a visual effect to a first original image) and a test case object image (a second image located in a first region of a second object image obtained by applying a visual effect to a second original image obtained by updating the first original image) (step S113). The inspection device 14 of this embodiment also detects a difference between an original object code (a first code for displaying a third image located in a second region of the first object image) and a test case object code (a second code for displaying a fourth image located in the second region of the second object image) (step S114). The inspection device 14 of this embodiment further generates and outputs notification information including difference information based on the difference between the original object image (first image) and the test case object image (second image) and the difference between the original object code (first code) and the test case object code (second code) (step S116).

[0043] The notification information in this embodiment includes difference information based on the difference between the original target image and the test case target image, and the difference between the original target code and the test case target code. By referring to this notification information, the user can determine whether the extended UI elements have been added appropriately (in the case of applying a specific visual effect to the updated original image, whether the visual effect has been applied appropriately).

[0044] For example, if there is a difference between the original target image and the test case target image, the difference is reflected in the notification information. If this difference is related to an extended UI element, the user can determine whether the extended UI element has been added appropriately based on the notification information. For example, if an extended UI element included in the original target image is not included in the test case target image or is positioned differently from the original target image, the user can intuitively discover the difference.

[0045] On the other hand, even if no difference between the original target image and the test case target image is detected, extended UI elements may not be properly added to the test case target image. For example, even if the selector of the display rule is changed, the extended UI elements (e.g., buttons, icons, fonts, graphs, charts, etc.) of the extended user interface image may not change, or the change may be below the minimum detection width (threshold for difference detection). In such cases, the change in the selector may cause the extended UI elements to not function properly, or there may be a defect in the test case target image of another transition state that is not being inspected. The notification information of this embodiment is based not only on the difference between the original target image and the test case target image but also on the difference between the original target code and the test case target code, making it easy to discover such defects. In other words, even if a defect cannot be detected solely based on the difference between the original target image and the test case target image, it may be possible to discover it based on the difference between the original target code and the test case target code. In particular, when generating DA information from AP information, extended UI elements may be added by referring to identification information (e.g., tag, ID, class, attribute, etc.) of a specific element (selector) of the user interface image specified by the display rule. In such a case, if the identification information (selector) specified by updating the AP information is changed, the extended UI element may not be added properly. Here, if the original target code (first code) includes identification information (first identification information) of a specific element of the user interface image and the test case target code (second code) includes identification information (second identification information) of a specific element of the user interface image, such a change in identification information can be reliably detected.

[0046] Conversely, if the extended user interface image is responsively designed, the extended UI elements may not be displayed properly after the DA information is updated, depending on the screen configuration of the device displaying the extended user interface image. Such defects can be visually and intuitively recognized based on the differences between the original target image and the test case target image, but they may be difficult to detect from the differences between the original target code and the test case target code.

[0047] In other words, judgment based on the difference between the original target image and the test case target image (image judgment) has the advantage of being able to visually and intuitively recognize differences in extended UI elements, but the disadvantage of being unable to recognize differences in the application structure. On the other hand, judgment based on the difference between the original target code and the test case target code (code judgment) has the advantage of being able to recognize differences in the application structure, but the disadvantage of being difficult to visually and intuitively recognize differences in extended UI elements. Because the notification information in this form is based on the difference between the original target image and the test case target image and the difference between the original target code and the test case target code, the disadvantages of image judgment can be compensated for by the advantages of code judgment, and vice versa. As a result, it is possible to efficiently and accurately determine whether extended UI elements have been added appropriately.

[0048] [Modification of the first embodiment] In the first embodiment, the original target image (step S103) and the test case target image (step S112) are acquired from a predetermined browser 125. However, a specific browser may be selected from multiple browsers, and the original target image and the test case target image may be acquired from the selected browser. Also, the original target image and the test case target image may be acquired from multiple browsers.

[0049] A tool for correcting DA information (including, for example, HTML source code) based on the notification information may be provided. For example, in addition to the notification information (for example, difference information visually representing image difference information and difference information visually representing code difference information), the code (for example, HTML source code) and display rule of the corresponding DA information may be displayed from the user interface 122 of the application use device 12 (FIG. 2). Furthermore, the code and display rule of the DA information may be corrected by input from the user interface 122. Furthermore, an extended user interface image based on the code and display rule of the DA information corrected in this way may be displayed from the user interface 122. Furthermore, after the code and display rule of the DA information are corrected, steps S112 to S117 (FIG. 5) of the inspection process may be executed again. In addition, information (for example, a file) representing the code and display rule of the corrected DA information may be transmitted to, distributed to, or stored in another terminal device.

[0050] At least some of the test case target code, test case target image, image difference information, code difference information, and notification information may be stored in a storage unit (for example, storage unit 123 or storage unit 141) in association with the number of times the inspection process has been executed, the date and time, the event that triggered the inspection, etc. The number of generations (number of times saved) of this stored information may be specified, and data older than the specified number of generations may be deleted. Furthermore, if necessary, a list of this past information may be displayed.

[0051] [Second embodiment] Some areas of the extended user interface image may contain areas that change dynamically, independently of the transition of the extended user interface image. Examples include areas where the content itself, such as video, animation, or real-time information, changes dynamically, or areas where the display content changes with scrolling. When the original target image and the test case target image contain such areas, differences between the original target image and the test case target image may be detected even if the extended UI elements are properly added. As a result, excessive notification information may be displayed even if the extended UI elements are properly added. Furthermore, when specific displayed content itself changes dynamically, when specific selectors or selector identification information (e.g., tags, IDs, classes, attributes, etc.) change dynamically depending on the session, external data, login status, etc., or when specific selectors are dynamically displayed or hidden (e.g., when a selector is dynamically displayed or hidden with scrolling), differences between the original target code and the test case target code may be detected even if the extended UI elements are properly added. In such cases, excessive notification information may be displayed even if the extended UI elements are properly added. In this embodiment, images and code in such specific areas are excluded from comparison. This prevents problems such as excessive notification even when extended UI elements are properly added. Furthermore, as described above, even when a display rule selector is changed, extended UI elements in the extended user interface image may not change, or the amount of change may be below the minimum detection width. In such specific areas, the process of detecting differences between the original target image and the test case target image becomes unnecessary. Therefore, by excluding images in such specific areas from comparison, the process for comparison can be reduced. Furthermore, if the extended user interface image includes UI elements with a large amount of data (e.g., a list with a large number of items (e.g., 100 or more items)), it may be difficult to properly compare the original target image with the test case target image.In such cases, it is desirable to exclude such UI elements with large amounts of data from the comparison exercise. Below, we will focus on the differences from the items explained so far, and will simplify the explanation by using the same reference numbers for common items.

[0052] <Configuration> 1, information processing system 2 of this embodiment has application providing device 11, application utilization device 12, digital adaptation device 13, and inspection device 24. Application providing device 11 and application utilization device 12 are configured to be able to communicate with each other via network 10, and application utilization device 12 is configured to be able to exchange information with digital adaptation device 13 and inspection device 24.

[0053] The inspection device 24 of this embodiment is a device for inspecting whether UI elements are correctly added to a user interface image. As illustrated in Fig. 3, the inspection device 24 of this embodiment includes a storage unit 141, a setting unit 242, an information acquisition unit 143, an image difference detection unit 244, a code difference detection unit 245, a notification information generation unit 146, and a control unit 147. The inspection device 24 executes each process under the control of the control unit 147.

[0054] <Pre-processing> The pre-processing in this embodiment is the same as that in the first embodiment.

[0055] <Settings for testing> The setting process for inspection will be illustrated using Fig. 4. The present embodiment differs from the first embodiment in that the inspection device 24 performs the process instead of the inspection device 14, that the setting unit 242 performs the process instead of the setting unit 142, and that in step S105, if the original target image is appropriate (if there are no errors), the process proceeds to the following step S207 instead of step S108.

[0056] In step S207, the user 100 uses the application use device 12 (FIG. 2) to set an area to be excluded from the comparison (exclusion area). That is, the user 100 performs input for setting the exclusion area to the user interface 122 of the application use device 12. The exclusion areas to be set are an image exclusion area, which is an exclusion area for the original target image and the test case target image, and a code exclusion area, which is an exclusion area for the original target code and the test case target code. The image exclusion area may or may not overlap at least partially with the image area corresponding to the code exclusion area. Examples of exclusion areas are shown below.

[0057] Example of exclusion regions (image exclusion regions) for original and test case target images: (2-1-1) An area that changes dynamically independent of the transition of the extended user interface image (first target image and / or second target image). For example, this is an area where the content itself, such as video, animation, or real-time information, changes dynamically, or an area where the display content changes by scrolling. (2-1-2) A region where the amount of change in the image is equal to or less than the reference value TH1, for example, a region where the amount of change in the image is below the minimum detection width. (2-1-3) A region of a UI element where the amount of data exceeds the reference value TH2, such as a list region with a large number of items.

[0058] Examples of excluded areas (code exclusion areas) for original subject code and test case subject code: (2-2-1) An area containing code that changes dynamically independent of the transition of the extended user interface image (first target image and / or second target image). For example, the code corresponds to an area whose content itself changes dynamically. (2-2-2) Areas for selectors and selector identification information that change depending on the situation. For example, areas for selectors and selector identification information that change depending on the situation such as session, external data, or login status, areas for selectors that are displayed or hidden by scrolling, etc.

[0059] There is no limitation on the method for specifying the exclusion area. For example, the user 100 may use a predetermined tool to specify a predetermined part on the HTML page of the DA information displayed on the user interface 122, thereby setting a selector corresponding to the exclusion area.

[0060] Information representing the contents of the exclusion area is sent to the setting information providing unit 126. The setting information providing unit 126 generates exclusion area setting information representing the contents of the exclusion area and sends it to the setting unit 242 of the inspection device 14 (FIG. 3). The setting unit 242 stores the exclusion area setting information in the storage unit 141 (step S207). Then, the process proceeds to step S108. The rest is the same as the setting process for inspection in the first embodiment.

[0061] <Inspection processing> The inspection process will be illustrated using Fig. 5. The differences between this embodiment and the first embodiment are that the inspection device 24 performs the process instead of the inspection device 14, that the image difference detection unit 144 performs the process of step S113 instead of the image difference detection unit 244 performing the process of step S213, and that the code difference detection unit 145 performs the process of step S114 instead of the code difference detection unit 245 performing the process of step S214.

[0062] In step S213, the image difference detection unit 244 first extracts pairs of corresponding original target images and test case target images from the storage unit 141. Next, the image difference detection unit 244 identifies the image exclusion area using the exclusion area setting information extracted from the storage unit 141. The image difference detection unit 244 obtains an excluded original target image by excluding at least the exclusion images belonging to the image exclusion area from the extracted original target image. The excluded original target image corresponds to a first image located in a first area of ​​a first target image obtained by applying a visual effect to a first original image, and corresponds to a first image obtained by excluding at least the first exclusion images belonging to the exclusion area from the first target image. Furthermore, the image difference detection unit 244 obtains an excluded test case target image by excluding at least the exclusion images belonging to the image exclusion area from the extracted test case target image. The excluded test case target image corresponds to a second image located in a first area of ​​a second target image obtained by applying a visual effect to a second original image, and corresponds to a second image obtained by excluding at least the second exclusion images belonging to the exclusion area from the second target image. Here, excluding the exclusion image belonging to the image exclusion area may mean removing the exclusion image or adding a predetermined masking (a mask image of a specified color, pattern, etc.) to the area including the exclusion image. For example, if the exclusion original target image is obtained by removing at least the exclusion image from the original target image, as illustrated in FIG. 10A, the exclusion test case target image 1021 is obtained by removing at least the exclusion image 1021c from the test case target image 1021a. For example, if the exclusion original target image is obtained by adding a masking to the area including the exclusion image of the original target image, as illustrated in FIG. 10B, the exclusion test case target image 1022 is obtained by adding a masking 1022c to the area including the exclusion image of the test case target image 1021a. The image difference detection unit 144 compares each pair of the exclusion original target image and the exclusion test case target image to detect the difference between the exclusion original target image and the exclusion test case target image. This comparison is a comparison in the first area, and the obtained difference is the difference in the first area.Image difference information representing the difference between each pair of the original target image to be excluded and the test case target image to be excluded is sent to the notification information generating unit 146 (step S213).

[0063] In step S214, the code difference detection unit 245 first extracts pairs of corresponding original subject codes and test case subject codes from the storage unit 141. Next, the code difference detection unit 245 identifies the code exclusion area using the exclusion area setting information extracted from the storage unit 141. The code difference detection unit 245 obtains excluded original subject codes by excluding at least exclusion codes (e.g., including selectors) belonging to the code exclusion area from the extracted original subject codes. The excluded original subject codes correspond to first codes for displaying a third image located in the second area of ​​the first object image, and correspond to the first codes obtained by excluding at least the first exclusion codes belonging to the exclusion area from the first object image codes. The code difference detection unit 245 also obtains excluded test case subject codes by excluding at least the exclusion codes belonging to the code exclusion area from the extracted test case subject codes. The excluded test case subject codes correspond to second codes for displaying a fourth image located in the second area of ​​the second object image, and correspond to the second codes obtained by excluding at least the second exclusion codes belonging to the exclusion area from the second object image codes. Here, excluding the exclusion code belonging to the code exclusion area means removing the exclusion code. The code difference detection unit 245 compares each set of the excluded original subject code with the excluded test case subject code, and detects the difference between the excluded original subject code and the excluded test case subject code. This comparison is a comparison of the code corresponding to the second area, and the obtained difference is the difference between the code corresponding to the second area. Code difference information indicating the difference between each set of the excluded original subject code and the excluded test case subject code is sent to the notification information generation unit 146 (step S214).

[0064] The other processes are the same as the inspection process of the first embodiment.

[0065] <Features of this form> This embodiment can also achieve the same effects as the first embodiment. That is, the notification information of this embodiment is based on the difference between the excluded original target image and the excluded test case target image and the difference between the excluded original target code and the excluded test case target code, so the disadvantages of image judgment can be compensated for by the advantages of code judgment, and vice versa. As a result, it is possible to efficiently and accurately determine whether or not the extended UI element has been appropriately added.

[0066] Furthermore, in this embodiment, a difference between an excluded original target image and an excluded test case target image, which are obtained by excluding at least the image exclusion region from the original target image and the test case target image, is detected, and image difference information representing the difference is obtained (step S213). Also, in this embodiment, a difference between an excluded original target code and an excluded test case target code, which are obtained by excluding at least the code exclusion region from the original target code and the test case target code, is detected, and code difference information representing the difference is obtained (step S214). Here, by appropriately setting the image exclusion region and the code exclusion region (e.g., the above-mentioned (2-1-1), (2-1-2), (2-1-3), (2-2-1), and (2-2-2)), it is possible to more efficiently and accurately determine whether the extended UI element has been appropriately added. For example, by setting the image exclusion region exemplified in (2-1-1) or the code exclusion region exemplified in (2-2-1) or (2-2-2), excessive notification information can be prevented from being sent even when the extended UI element has been appropriately added. For example, by setting the image exclusion area as exemplified in (2-1-2), it is possible to reduce unnecessary image comparison processing.For example, by setting the image exclusion area as exemplified in (2-1-3), it is possible to prevent the amount of data being too large to perform image comparison.

[0067] [Modification of the second embodiment] The second embodiment may also be modified in the same manner as the first embodiment.

[0068] [Third embodiment] Even if no difference is detected in the image determination, a difference may be detected in the code determination. On the other hand, if no difference is detected in the code determination, no difference will be detected in the image determination. In addition, the amount of processing required for image determination is generally greater than the amount of processing required for code determination. Therefore, it is possible to perform code determination first, and if a difference is detected in the code determination, perform image determination again, and if no difference is detected in the code determination, not perform image determination. This reduces the amount of calculation required for the inspection process without significantly reducing the efficiency or accuracy of determining whether or not an extended UI element has been appropriately added. An example of the inspection process of this embodiment is shown below.

[0069] <Inspection processing> The inspection process will be illustrated with reference to FIG. When the inspection device 14 or 24 (FIG. 3) executes the processes of steps S111 and S112, the code difference detection unit 145 then detects a difference between the original subject code and the test case subject code (step S114), or the code difference detection unit 245 detects a difference between the excluded original subject code and the excluded test case subject code (step S214). If no difference is detected, the inspection process ends. On the other hand, if a difference is detected, the process proceeds to step S113 or step S213, and then the processes of steps S115 to S117 are executed.

[0070] <Features of this form> This embodiment can also achieve the same effects as the first and second embodiments. Furthermore, this embodiment detects the difference between the original subject code and the test case subject code or the difference between the excluded original subject code and the excluded test case subject code (the difference between the first code and the second code). If a difference (the difference between the first code and the second code) is detected, the difference between the original subject image and the test case subject image or the difference between the excluded original subject image and the excluded test case subject image (the difference between the first image and the second image) is further detected. On the other hand, if a difference (the difference between the first image and the second image) is not detected, the difference between the original subject image and the test case subject image or the difference between the excluded original subject image and the excluded test case subject image (the difference between the first image and the second image) is not detected. This reduces the amount of computation required for the inspection process without significantly reducing the efficiency or accuracy of determining whether or not an extended UI element has been appropriately added. Such processing may be performed, for example, only in a multi-inspection area where the area (first area) of the original target image and test case target image overlaps with the area (second area) of the image represented by the original target code and test case target code, or in a multi-inspection area where the area (first area) of the excluded original target image and excluded test case target image overlaps with the area (second area) of the image represented by the excluded original target code and excluded test case target code.

[0071] [Hardware configuration] The application providing device 11, application utilization device 12, digital adaptation device 13, and inspection devices 14 and 24 in each embodiment are devices configured by a general-purpose or dedicated computer having, for example, a processor (hardware processor) such as a CPU (central processing unit) and memories such as RAM (random-access memory) and ROM (read-only memory) executing a predetermined program. That is, the application providing device 11, application utilization device 12, digital adaptation device 13, and inspection devices 14 and 24 in each embodiment have, for example, processing circuitry configured to implement each of the components possessed by each of them. This computer may have one processor and memory, or multiple processors and memories. This program may be installed on the computer or may be pre-recorded in a ROM or the like. Furthermore, some or all of the processing units may be configured using electronic circuits that independently realize processing functions, rather than electronic circuits that realize functional configurations by loading programs like a CPU. Furthermore, the electronic circuits constituting one device may include multiple CPUs. The user interface 122 is hardware that can input and output visual information, such as a display, touch panel, mouse, keyboard, etc.

[0072] The functions performed by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and / or combinations thereof, programmed to perform the described functions. A processor includes transistors and other circuits and is considered to be circuitry or processing circuitry. A processor may also be a programmed processor that executes programs stored in memory.

[0073] In this specification, a circuitry, unit, or means is hardware that is programmed to realize or performs the described functions, which may be any hardware disclosed herein or any hardware known to be programmed to realize or perform the described functions.

[0074] If the hardware is a processor considered to be a type of circuitry, the circuitry, means, or unit is a combination of the hardware and software used to configure the hardware and / or processor.

[0075] The program describing the processing contents can be recorded on a computer-readable recording medium, which may be, for example, a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, or any other suitable recording medium.

[0076] The program may be distributed, for example, by selling, transferring, lending, etc. a portable recording medium such as a DVD or CD-ROM on which the program is recorded. Furthermore, the program may be stored in a storage device of a server computer, and then transferred from the server computer to another computer via a network, thereby distributing the program.

[0077] A computer that executes such a program may first temporarily store the program recorded on a portable recording medium or transferred from a server computer in its own storage device. Then, when executing a process, the computer reads the program stored on its own recording medium and executes the process in accordance with the read program. Alternatively, the computer may read the program directly from a portable recording medium and execute the process in accordance with the program. Furthermore, the computer may execute the process in accordance with the program each time a program is transferred from a server computer to the computer. The server computer may not transfer the program to the computer, but may instead execute the process through a so-called ASP (Application Service Provider) service, which realizes the processing function by issuing an execution instruction and obtaining the results. Furthermore, the server computer may execute the process on a terminal using a so-called SaaS (Software as a Service) service, which allows users to use part of the server computer along with the program. In this embodiment, the program includes information used for computer processing that is equivalent to a program (such as data that is not a direct instruction to the computer but has properties that define computer processing).

[0078] Furthermore, in this embodiment, the device is configured by executing a predetermined program on a computer, but at least a part of the processing contents may be realized by hardware.

[0079] [Other variations] The present invention is not limited to the above-described embodiments. For example, in the above-described embodiments, DA information is generated after AP information is downloaded. However, DA information may also be generated from AP information provided online in real time. Furthermore, the inspection process in each embodiment is performed to determine whether extended UI elements are appropriately added when generating an extended user interface image in which extended UI elements are added to a user interface image. However, the above-described inspection process may be applied to any application in which a specific visual effect is applied to an updated original image, as long as it determines whether the visual effect is appropriately applied.

[0080] Furthermore, the various processes described above may not only be executed in chronological order as described, but may also be executed in parallel or individually depending on the processing capacity of the device executing the processes or as necessary. Needless to say, other modifications are possible within the scope of the present invention. [Explanation of symbols]

[0081] 11 Application provider 12 Application usage device 13 Digital Adaptation Device 14,24 Inspection equipment

Claims

1. an image difference detection unit that detects a difference between a first image located in a first region of a first target image obtained by applying a visual effect to a first original image, and a second image located in the first region of a second target image obtained by applying the visual effect to a second original image obtained by updating the first original image; a code difference detection unit that detects a difference between a first code for displaying a third image located in a second region of the first object image and a second code for displaying a fourth image located in the second region of the second object image; a notification information generating unit that generates and outputs notification information including difference information based on a difference between the first image and the second image and a difference between the first code and the second code; An inspection device having the above structure.

2. The inspection device of claim 1, the first image is an image obtained by excluding at least a first exclusion image belonging to an exclusion area from the first target image, the second image is an image obtained by excluding at least a second exclusion image that belongs to the exclusion area from the second target image, The exclusion area includes an image area in which the amount of change resulting from updating from the first original image to the second original image is equal to or less than a reference value.

3. The inspection device of claim 1, the first code is a code obtained by excluding at least a first exclusion code belonging to an exclusion area from a first target image code, the second code is a code obtained by excluding at least a second exclusion code that belongs to the exclusion area from a second target image code, the first target image code is a code for displaying the first target image, the second target image code is a code for displaying the second target image, the exclusion region is a region including a code that dynamically changes independently of transitions of the first target image and / or the second target image; Inspection equipment.

4. An inspection method using an inspection device, an image difference detection step of detecting a difference between a first image located in a first region of a first target image obtained by applying a visual effect to a first original image, and a second image located in the first region of a second target image obtained by applying the visual effect to a second original image obtained by updating the first original image; a code difference detection step of detecting a difference between a first code for displaying a third image located in a second region of the first target image and a second code for displaying a fourth image located in the second region of the second target image; a notification information generating step of generating and outputting notification information including difference information based on a difference between the first image and the second image and a difference between the first code and the second code; An inspection method having the following.

5. A program for causing a computer to function as the inspection device according to any one of claims 1 to 3.

Images