Generation method and generation program

Abstract

To prevent leakage of personal information.SOLUTION: A generation device stores a first component included in a first image in a storage device, and identifies the first component similar to a second component included in a second image acquired in accordance with acquisition operation of an image to a screen from the first component stored in the storage device. The generation device adjusts the size of the identified first component to the size of a similar second component, and generates a third image obtained by arranging the adjusted first component in accordance with an arrangement position of the similar second component.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a generation method and the like.

Background Art

[0002] Various evaluations are being carried out on application software (hereinafter referred to as apps) and systems. For example, when an app or system receives access from a user terminal, there are cases where a screen shot of the screen to be displayed on the user terminal, a capture image, etc. are acquired for UI (User Interface) evaluation. In the following description, screen shots, capture images, etc. are referred to as "UI images".

[0003] When acquiring a UI image of a user terminal, methods such as asking the user to acquire the UI image and requesting upload to the server, or incorporating a log collection function for acquiring the UI image into the app or system itself are used.

[0004] Here, when various personal information is included in an image such as a character string or a photograph displayed on the screen of the user terminal, there is a requirement to partially anonymize the UI image.

[0005] For example, as prior arts for anonymizing images, there are prior arts that assist the user in manually anonymizing, prior arts that incorporate an anonymization function into the app or system itself, and prior arts that automatically detect a confidential area and anonymize only the confidential area.

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0007] However, in the above-described conventional technology, there is a problem that leakage of personal information cannot be prevented.

[0008] For example, performing anonymization manually may result in leakage of personal information due to human error, and the burden on the user is also large. When incorporating a log collection function into an app or the system itself, the versatility is low and personal information may be leaked.

[0009] Even with a technology that automatically detects a confidential area and anonymizes only the confidential area, if a detection omission of the confidential area occurs, personal information will be leaked.

[0010] FIG. 16 is a diagram for explaining the problems of the conventional technology. In FIG. 16, in the conventional technology, for the UI image 10, a confidential area detection process is executed, and the areas 10a and 10b are determined as confidential areas, but the area 10c that should originally be determined as a confidential area is excluded from the confidential areas.

[0011] In the conventional technology, based on the result of the above-described confidential area detection process, an anonymized UI image 11 is generated. For example, by painting the areas 10a and 10b determined as confidential areas black, an anonymization process is executed to generate the anonymized UI image 11. However, in the anonymized UI image 11, an email address remains in the area 11a, and the anonymization has failed.

[0012] In one aspect, an object of the present invention is to provide a generation method and a generation program capable of preventing leakage of personal information.

Means for Solving the Problems

[0013] In the first proposal, the computer executes the following processes. The computer stores the first components included in the first image in a storage device. The computer identifies, from the first components stored in the storage device, the first components that are similar to the second components included in the second image acquired in response to an image acquisition operation on the screen. The computer adjusts the size of the identified first components to the size of the similar second components. The computer generates a third image in which the adjusted first components are arranged in accordance with the arrangement positions of the similar second components.

Advantages of the Invention

[0014] It is possible to prevent leakage of personal information.

Brief Description of the Drawings

[0015]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Embodiments for Carrying Out the Invention

[0016] Hereinafter, embodiments of the generation method and generation program disclosed in the present application will be described in detail with reference to the drawings. Note that the present invention is not limited by these embodiments.

Embodiment

[0017] An example of the system according to the present embodiment will be described. FIG. 1 is a diagram showing the system according to the present embodiment. As shown in FIG. 1, this system includes a server 50 and a generation apparatus 100. The server 50 and the generation apparatus 100 are connected via a network 5.

[0018] When the server 50 receives an access from the generation apparatus 100, the server 50 generates screen information for the generation apparatus 100 and causes the screen information to be displayed. Note that the present invention is not limited to a system that performs drawing on the server 50 side, and a normal application program or the like that operates on a single client may generate the screen information.

[0019] The generation device 100 displays the screen information received from the server 50 on the screen of the display device. When the generation device 100 receives an acquisition operation of a screenshot being displayed on the screen from the user, it generates an anonymous UI image and transmits the information of the generated anonymous UI image to the server 50. For example, the generation device 100 corresponds to a terminal device such as a PC (Personal Computer), a notebook PC, a smartphone, or a tablet terminal.

[0020] FIG. 2 is a diagram for explaining an example of the processing of the generation device according to the present embodiment. The generation device 100 holds an anonymous UI model 60. The anonymous UI model 60 includes anonymous UI components 60a and 60b. The anonymous UI model 60 is generated in advance based on a manual image and does not include personal information. The generation device 100 may acquire the information of the anonymous UI model 60 from the server 50 in advance, or the generation device 100 may generate it based on a manual image. Personal information corresponds to a character string, an image, etc. that can identify a specific individual.

[0021] When the generation device 100 receives an acquisition operation of a screenshot being displayed on the screen from the user, it generates an original UI image 12. The original UI image 12 may include the user's personal information.

[0022] The generation device 100 identifies UI components similar to the UI components 12a and 12b included in the original UI image 12 from the anonymous UI components 60a and 60b of the anonymous UI model 60. For example, the generation device 100 changes the positions and sizes of the anonymous UI components 60a and 60b to perform matching and identify anonymous UI components similar to the UI components 12a and 12b.

[0023] In the example shown in FIG. 2, the generation device 100 identifies the anonymous UI component 60a as the anonymous UI component similar to the UI component 12a. The generation device 100 identifies the anonymous UI component 60b as the anonymous UI component similar to the UI component 12b. The generation device 100 generates metadata 70 based on the matching result.

[0024] The metadata 70 is information that defines the position where the anonymous UI components are placed and the size of the anonymous UI components. The generation device 100 adjusts the size and placement position of the anonymous UI components 60a and 60b based on the metadata 70, and generates the anonymous UI image 13. The anonymous UI image 13 includes an anonymous UI component 13a corresponding to the anonymous UI component 60a and an anonymous UI component 13b corresponding to the anonymous UI component 60b.

[0025] As described above, the generation device 100 according to this embodiment selects a UI component similar to the UI component of the original UI image 12 including personal information from the anonymous UI components included in the anonymous UI model 60, and adjusts and arranges the selected anonymous UI components according to the metadata 70. In this way, since the anonymous UI image 13 is generated only using the anonymous UI components of the anonymous UI model 60 that do not include personal information, leakage of personal information can be prevented.

[0026] Next, an example of the configuration of the generation device 100 shown in FIG. 1 will be described. FIG. 3 is a functional block diagram showing the configuration of the generation device according to this embodiment. As shown in FIG. 3, this generation device 100 includes a communication unit 110, an input unit 120, a display unit 130, a storage unit 140, and a control unit 150.

[0027] The communication unit 110 is a communication interface that transmits and receives various types of information to and from the server 50 connected via the network 5. The communication unit 110 is realized by a NIC (Network Interface Card) or the like. The communication unit 110 receives screen information and the like from the server 50.

[0028] The input unit 120 is an input interface that receives various operations from the user of the generation device 100. For example, it is composed of an input device such as a keyboard or a mouse. For example, the user operates the input unit 120 to perform an operation such as acquiring a screen shot.

[0029] The display unit 130 is an output device that outputs the information acquired from the control unit 150, and is realized by a display device such as a liquid crystal display. For example, the display unit 130 displays the screen information output from the control unit 150.

[0030] The storage unit 140 has an anonymous UI model 60, a metadata table 141, and an anonymous UI image 142. The storage unit 140 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk.

[0031] The anonymous UI model 60 has a plurality of anonymous UI components extracted from a UI image such as a manual image that does not have personal information. FIG. 4 is a diagram for explaining the anonymous UI model according to the present embodiment. In the example shown in FIG. 4, the anonymous UI model 60 includes anonymous UI components 60a, 60b, 60c, and 60d detected from the UI image 15.

[0032] The anonymous UI component 60a is a component corresponding to the character string area 15a of the UI image 15. The anonymous UI component 60b is a component corresponding to the area 15b of the UI image 15. The anonymous UI component 60c is a component corresponding to the area 15c of the UI image 15. The anonymous UI component 60d is a component corresponding to the button in the area 15d of the UI image 15. Although not shown, each of the anonymous UI components 60a to 60d is given component identification information for uniquely identifying the anonymous UI component and information indicating the size of the anonymous UI component.

[0033] A plurality of metadata are stored in the metadata table 141. FIG. 5 is a diagram showing an example of the data structure of the metadata table according to the present embodiment. As shown in FIG. 5, this metadata table 141 has component identification information, an arrangement position, and a size. The component identification information is information for uniquely identifying an anonymous UI component. The arrangement position indicates the position (two-dimensional coordinates) when the anonymous UI component is arranged in the anonymous UI image 142. The size indicates the size (width, height) of the anonymous UI component when the anonymous UI component is arranged in the anonymous UI image 142.

[0034] The anonymous UI image 142 is a UI image generated by the processing of the control unit 150 described later.

[0035] The control unit 150 includes a display control unit 151, a model generation unit 152, a specifying unit 153, a generation unit 154, and a transmission unit 155. The control unit 150 is realized by, for example, a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). Further, the control unit 150 may be executed by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0036] The display control unit 151 causes the display unit 130 to display various screen information. For example, when the display control unit 151 acquires screen information from the server 50, the display control unit 151 outputs the acquired screen information to the display unit 130 for display.

[0037] Further, when the display control unit 151 receives an acquisition operation of a UI image such as a screenshot from a user operating the input unit 120, the display control unit 151 generates a UI image (original UI image) of the screen displayed on the display unit 130. The display control unit 151 outputs the generated original UI image to the specifying unit 153.

[0038] The model generation unit 152 generates an anonymous UI model 60 based on a UI image such as a manual image specified in advance. The processing of the model generation unit 152 will be described with reference to FIG. 4. The model generation unit 152 scans the UI image 15 to specify the regions 15a, 15b, 15c, 15d of the UI components. The model generation unit 152 detects the images of the specified regions 15a, 15b, 15c, 15d as anonymous UI components, and assigns a component identification number to the detected anonymous UI components. The model generation unit 152 associates the component identification number, the anonymous UI component (image of the anonymous UI component), and the size (width, height) of the anonymous UI component, and registers them in the anonymous UI model 60.

[0039] The specific part 153 identifies an anonymous UI component similar to the UI component included in the original UI image from the anonymous UI components of the anonymous UI model 60. Based on the identified result, the specific part 153 generates metadata and registers the generated metadata in the metadata table 141.

[0040] FIG. 6 is a diagram (1) for explaining the processing of the specific part according to this embodiment. The specific part 153 scans the original UI image 20 to detect the regions 20a, 20b, 20c, and 20d of the UI components. Here, as an example, the case where the specific part 153 selects the anonymous UI component 60b, changes the size of the anonymous UI component 60b, and performs matching with each of the regions 20a to 20d of the original UI image 20 will be described.

[0041] The specific part 153 adjusts the size of the anonymous UI component 60b by multiplying the initial value of the size of the anonymous UI component 60b by α. The specific part 153 calculates the difference between the size of the anonymously UI component 60b with the adjusted size and the sizes of the regions 20a to 20d, and when there is a region where the absolute value of the difference is less than the threshold value, associates such a region with the anonymous UI component 60b.

[0042] The specific part 153 performs matching by executing the above processing while changing the value of α. By such processing, for example, the region 20b and the anonymous UI component 60b are associated. In this case, the specific part 153 generates the metadata 141-1.

[0043] The specific part 153 sets the component identification information of the anonymous UI component 60b as the component identification information of the metadata 141-1. The specific part 153 sets the coordinates of the matched region 20b (for example, the center coordinates, the coordinates of the upper left point, etc.) as the arrangement position. The specific part 153 sets, as the size, the value obtained by multiplying the initial value of the anonymous UI component 60b by the value of α at the time of matching. The specific part 153 registers the metadata 141-1 in the metadata table 141.

[0044] Note that if there is no region where the absolute value of the difference is less than the threshold even when the above processing is repeated, the specific unit 153 determines that there is no region corresponding to the anonymous UI component 60b.

[0045] The specific unit 153 repeatedly executes the above processing for the other anonymous UI components 60a to 60d of the anonymous UI model 60 to generate metadata.

[0046] Returning to the description of FIG. 3, the generation unit 154 generates the anonymous UI image 142 by adjusting and arranging the size of the anonymous UI component based on the metadata table 141. The generation unit 154 stores the generated anonymous UI image 142 in the storage unit 140.

[0047] FIG. 7 is a diagram (1) for explaining the processing of the generation unit according to the present embodiment. The generation unit 154 selects metadata from the metadata table 141 and acquires an anonymous UI component corresponding to the component identification information set in the selected metadata from the anonymous UI model 60. The generation unit 154 adjusts the acquired anonymous UI component to the size set in the metadata. The generation unit 154 arranges the adjusted anonymous UI component at the arrangement position set in the metadata.

[0048] For example, the description will be made using the metadata 141-1 corresponding to the anonymous UI component 60b. The generation unit 154 acquires the anonymous UI component 60b corresponding to the component identification information of the metadata 141-1 from the anonymous UI model 60. The generation unit 154 generates the anonymous UI component 25b by adjusting the size of the anonymous UI component 60b to (w1, h1). The generation unit 154 arranges the anonymous UI component 25b (the center coordinates of the anonymous UI component 25b) at the arrangement position (x1, y1) of the anonymous UI image 142.

[0049] The generation unit 154 generates anonymized UI components 25a, 25c, 25d of adjusted sizes corresponding to the anonymized UI components 60a, 60c, 60d by executing the above processing for other metadata in the metadata table 141, and arranges them in the anonymized UI image 142. Note that the generation unit 154 makes the size of the anonymized UI image 142 the same as the size of the original UI image 20 described with reference to FIG. 6.

[0050] Subsequently, the processing of the specifying unit 153 and the generation unit 154 for an original UI image 21 different from the original UI image 20 in FIG. 6 will be described. FIG. 8 is a diagram (2) for explaining the processing of the specifying unit according to the present embodiment. The specifying unit 153 scans the original UI image 21 to detect the regions 21a, 21b, 21c of the UI components. The specifying unit 153 performs matching between the anonymized UI components 60a to 60d of the anonymized UI model 60 and the regions 21a, 21b, 21c of the original UI image 21 in the same manner as described with reference to FIG. 6, generates metadata, and registers it in the metadata table 141.

[0051] In the example shown in FIG. 8, the anonymized UI component 60a corresponds to the region 21a, the anonymized UI component 60b corresponds to the region 21b, and the anonymized UI component 60c corresponds to the region 21c, but there is no object corresponding to the anonymized UI component 60d. In this case, the specifying unit 153 registers the metadata 141-1´ corresponding to the anonymized UI component 60a, the metadata 141-1´ corresponding to the anonymized UI component 60b, and the metadata 141-3´ corresponding to the anonymized UI component 60c in the metadata table 141.

[0052] FIG. 9 is a diagram (2) for explaining the processing of the generation unit according to the present embodiment. The generation unit 154 selects metadata from the metadata table 141 and arranges the anonymized UI components in the anonymized UI image 142 in the same manner as described with reference to FIG. 7.

[0053] The generation unit 154 selects the metadata 141-1´, and acquires an anonymous UI component 60a corresponding to the component identification information of the metadata 141-1´ from the anonymous UI model 60. The generation unit 154 generates the anonymous UI component 26a by adjusting the size of the anonymous UI component 60a to (w1´, h1´). The generation unit 154 arranges the anonymous UI component 26a (the center coordinates of the anonymous UI component 26a) at the arrangement position (x1´, y1´) of the anonymous UI image 142.

[0054] The generation unit 154 executes the above processing for other metadata in the metadata table 141, thereby generating the resized anonymous UI components 26a and 26c corresponding to the anonymous UI components 60b and 60c, and arranging them in the anonymous UI image 142. In the anonymous UI image 142 of FIG. 9, the UI component corresponding to the anonymous UI component 60d is not arranged in the anonymous UI image 142, reproducing the fact that the save button is not arranged in the original UI image 21 of FIG. 8.

[0055] Subsequently, the processing of the specifying unit 153 and the generation unit 154 for the original UI image 22 different from the original UI images 20 and 21 will be described. FIG. 10 is a diagram (3) for explaining the processing of the specifying unit according to the present embodiment. In the example described with reference to FIG. 10, it is assumed that the anonymous UI model 60 includes the anonymous UI components 60a, 60b, 60c, 60d, and 60e. The specifying unit 153 performs matching between the anonymous UI components 60a to 60e of the anonymous UI model 60 and the regions 22a, 22b, 22c, and 22d of the original UI image 22, generates metadata, and registers it in the metadata table 141.

[0056] In the example shown in FIG. 10, the anonymous UI component 60e corresponds to the area 22a, the anonymous UI component 60b corresponds to the area 22b, the anonymous UI component 60c corresponds to the area 22c, and the anonymous UI component 60d corresponds to the area 22d. Note that it is assumed that there is no corresponding object for the anonymous UI component 60a in the original UI image 22. In this case, the specifying unit 153 registers the metadata 141-1´´ corresponding to the anonymous UI component 60e and the metadata 141-2´´ corresponding to the anonymous UI component 60b in the metadata table 141. Further, the specifying unit 153 registers the metadata 141-3´´ and the metadata 141-4´´ corresponding to the anonymous UI component 60c in the metadata table 141.

[0057] FIG. 11 is a diagram (3) for explaining the processing of the generation unit according to the present embodiment. The generation unit 154 selects metadata from the metadata table 141 and arranges anonymous UI components on the anonymous UI image 142 in the same manner as described in the case of FIG. 7.

[0058] The generation unit 154 selects the metadata 141-1´´ and acquires the anonymous UI component 60e corresponding to the component identification information of the metadata 141-1´´ from the anonymous UI model 60. The generation unit 154 generates the anonymous UI component 27a by adjusting the size of the anonymous UI component 60e to (w1´´, h1´´). The generation unit 154 arranges the anonymous UI component 27a (the center coordinates of the anonymous UI component 27a) at the arrangement position (x1´´, y1´´) of the anonymous UI image 142.

[0059] The generation unit 154 executes the above processing for the other metadata in the metadata table 141 to generate the resized anonymous UI components 27b, 27c, and 27d corresponding to the anonymous UI components 60b, 60c, and 60d and arranges them on the anonymous UI image 142. As a result, it is possible to reproduce, by the anonymous UI image 142, that an internal error has occurred on the user information setting screen or the like.

[0060] The transmission unit 155 transmits the anonymous UI image 142 stored in the storage unit 140 to the server 50.

[0061] Next, an example of the processing procedure of the generation device 100 according to this embodiment will be described. FIG. 12 is a flowchart showing the processing procedure of the generation device according to this embodiment. When the display control unit 151 of the generation device 100 receives an acquisition operation of a UI image via the input unit 120, it generates an original UI image (step S101). Note that in step S101, the generation device 100 may generate an original UI image triggered by an error occurrence, timer activation, or a startup command from the server even when it is not a user operation. The specifying unit 153 of the generation device 100 selects an anonymous UI component from the anonymous UI model 60 (step S102).

[0062] The specifying unit 153 matches the area of the UI component of the original UI image with the anonymous UI component (step S103). The specifying unit 153 generates metadata based on the matching result and registers it in the metadata table 141 (step S104).

[0063] If there are unselected anonymous UI components (step S105, Yes), the specifying unit 153 proceeds to step S102. On the other hand, if there are no unselected anonymous UI components (step S105, No), the specifying unit 153 proceeds to step S106.

[0064] The generation unit 154 of the generation device 100 selects metadata from the metadata table 141 (step S106). The generation unit 154 adjusts the size of the anonymous UI component and arranges the anonymous UI component based on the metadata (step S107).

[0065] If there is unselected metadata (step S108, Yes), the generation unit 154 proceeds to step S106. On the other hand, if there is no unselected metadata (step S108, No), the generation unit 154 proceeds to step S109. The transmission unit 155 of the generation device 100 transmits the anonymous UI image 142 to the server 50 (step S109).

[0066] Next, the effects of the generation device 100 according to this embodiment will be described. The generation device 100 selects UI components similar to the UI components of the original UI image including personal information from the anonymous UI components included in the anonymous UI model 60, and adjusts and arranges the selected anonymous UI components based on the similar UI components. In this way, since the anonymous UI image 142 is generated only using the anonymous UI components of the anonymous UI model 60 that do not include personal information, leakage of personal information (all information to be kept confidential such as personal information) can be prevented. For example, not only information that can identify an individual but also leakage of information input by the user in the input area can be prevented.

[0067] For example, even if a detection leak occurs in the UI components included in the original UI image, no personal information leakage occurs in the generation device 100. FIG. 13 is a diagram for explaining the behavior of the generation device according to this embodiment at the time of detection leak. As shown in FIG. 13, it is assumed that the specific part 153 fails in the matching for the UI components in the regions 20a to 20d of each UI component included in the original UI image 20 and succeeds in the matching for the UI components in the regions 20c and 20d. In this case, the metadata 70 of the anonymous UI components corresponding to the regions 20c and 20d of the UI components is generated. Here, personal information includes not only information that can identify an individual but also information input by the user in the input area.

[0068] When the generation unit 154 generates the anonymous UI image 142 based on the metadata 70, only the anonymous UI components 28a and 28b corresponding to the metadata 70 are arranged. In the anonymous UI image 142, the regions 20a and 20b of the UI components with detection leaks themselves disappear, and no personal information leakage occurs. On the other hand, in the prior art, as described with reference to FIG. 16, personal information may leak when the detection of the confidential area fails.

[0069] Incidentally, the processing of the generation device 100 described above is an example, and the generation device 100 may execute other processing. In the following, other processing of the generation device 100 will be described.

[0070] Fig. 14 is a diagram for explaining other processes of the generating device. For example, as explained in Fig. 10 and Fig. 11, the generating unit 154 of the generating device 100 generates an anonymous UI image 142 from the original UI image 22. Here, the generating unit 154 outputs the anonymous UI image 142 to the display unit 130 to display the anonymous UI image 142.

[0071] The user refers to the anonymous UI image 142 displayed on the display unit 130, and operates the input unit 120 to select a UI widget to be de-anonymized. The generation unit 154 de-anonymizes the UI widget for which a designation to de-anonymize has been accepted. For example, when the generation unit 154 accepts the selection of the anonymous UI widget 27a of the anonymous UI image 142, the generation unit 154 replaces the UI widget (image of the area 22a) of the original UI image 22 with the anonymous UI widget 27a to generate the anonymous UI image 142'. By generating the anonymous UI image 142', the relevant error location can be explicitly disclosed when submitting an error report, etc.

[0072] In addition, the specification unit 153 of the generating device generates metadata by associating part identification information, arrangement position, and size, but this is not limited to this. For example, the specification unit 153 may further specify attribute information of a UI widget in an original UI image and relationship information with other UI widgets, and set the information in the metadata.

[0073] The attribute information is information on whether or not the target UI widget includes a character string, whether or not it is an image of a person, etc. The relationship information is information on the layer structure of the UI widget of interest, the layout relationship between the UI widget of interest and other UI widgets, interdependencies, etc. When generating anonymous UI image 142 based on metadata, generating unit 154 may further use attribute information and relationship information of the metadata to arrange anonymous UI widgets. This can improve the degree of reproduction of anonymous UI image 142 with respect to the original UI image.

[0074] Note that, in this embodiment, as an example, the description has been given such that the generation device 100 has the model generation unit 152 and generates the anonymized UI model 60, but the present invention is not limited to this. For example, the server 50 may have the function of the model generation unit 152, and the generation device 100 may obtain the anonymized UI model 60 generated by the server 50 and perform the above-described processing.

[0075] Next, an example of the hardware configuration of a computer that realizes the same functions as the generation device 100 shown in the above embodiment will be described. FIG. 15 is a diagram showing an example of the hardware configuration of a computer that realizes the same functions as the generation device of the embodiment.

[0076] As shown in FIG. 15, the computer 200 includes a CPU 201 that executes various arithmetic processes, an input device 202 that receives input of data from a user, and a display 203. Further, the computer 200 includes a communication device 204 that exchanges data with an external device or the like via a wired or wireless network, and an interface device 205. Further, the computer 200 includes a RAM 206 that temporarily stores various information, and a hard disk device 207. Then, each of the devices 201 to 207 is connected to a bus 208.

[0077] The hard disk device 207 includes a display control program 207a, a model generation program 207b, a specifying program 207c, a generation program 207d, and a transmission program 207e. Further, the CPU 201 reads out each of the programs 207a to 207e and expands them in the RAM 206.

[0078] The display control program 207a functions as a display control process 206a. The model generation program 207b functions as a model generation process 206b. The specifying program 207c functions as a specifying process 206c. The generation program 207d functions as a generation process 206d. The transmission program 207e functions as a transmission process 206e.

[0079] The processing of the display control process 206a corresponds to the processing of the display control unit 151. The processing of the model generation process 206b corresponds to the processing of the model generation unit 152. The processing of the identification process 206c corresponds to the processing of the identification unit 153. The processing of the generation process 206d corresponds to the processing of the generation unit 154. The processing of the transmission process 206e corresponds to the processing of the transmission unit 155.

[0080] Note that for each of the programs 207a to 207e, it is not necessarily required to be stored in the hard disk device 207 from the beginning. For example, each program is stored in a "portable physical medium" such as a flexible disk (FD), CD-ROM, DVD, magneto-optical disk, or IC card inserted into the computer 200. Then, the computer 200 may read and execute each of the programs 207a to 207e.

[0081] Regarding the embodiments including the above-described embodiments, the following additional remarks are disclosed.

[0082] (Supplementary Note 1) A method for generating a screen executed by a computer, storing a first component included in a first image in a storage device, identifying a first component similar to a second component included in a second image acquired in response to an image acquisition operation on the screen from the first components stored in the storage device, adjusting the size of the identified first component to the size of the similar second component, generating a third image in which the adjusted first component is arranged in accordance with the arrangement position of the similar second component The generation method characterized by executing the processing.

[0083] (Supplementary Note 2) The generation method according to Supplementary Note 1, characterized in that the first image is an image having no personal information, and further executing a process of extracting a first component from the first image and storing the extracted first component in the storage device.

[0084] (Supplementary Note 3) The generation method according to Supplementary Note 1 or 2, further comprising, when receiving an indication of release for any first component included in the third image, performing a process of assigning information on a second component similar to the first component for which the indication was received, to the first component for which the indication was received.

[0085] (Supplementary Note 4) The generation method according to Supplementary Note 1, further comprising performing a process of generating definition information that defines the size and the placement position when placing the first component in the third image, based on the relationship between the first component identified by the identifying process and a second component similar to the first component.

[0086] (Supplementary Note 5) The generation method according to Supplementary Note 4, wherein the generating process sets at least one of the attributes of the first component or the relationship between the first component and another first component, in the definition information.

[0087] (Supplementary Note 6) A generation program, causing a computer to store the first component included in the first image in a storage device, identify, from the first components stored in the storage device, a first component similar to a second component included in a second image acquired in response to an image acquisition operation on a screen, adjust the size of the identified first component to the size of the similar second component, and generate a third image in which the adjusted first component is placed in accordance with the placement position of the similar second component. The generation program is characterized by causing the above-described process to be executed.

[0088] (Supplementary Note 7) The generation program according to Supplementary Note 6, wherein the first image is an image that does not have personal information, and further comprising performing a process of extracting the first component from the first image and storing the extracted first component in the storage device.

[0089] (Appendix 8) When receiving a pointing-out of release for any first component included in the third image, the generation program according to Appendix 6 or 7, further executes a process of assigning information of a second component similar to the first component for which the designation was received, to the first component for which the designation was received.

[0090] (Appendix 9) Based on the relationship between the first component identified by the identifying process and the second component similar to the first component, further executes a process of generating definition information that defines the size and the placement position when placing the first component in the third image, the generation program according to Appendix 6.

[0091] (Appendix 10) The generating process sets at least one of the attributes of the first component or the relationship between the first component and another first component, in the definition information, the generation program according to Appendix 9.

Explanation of Signs

[0092] 60 Anonymous UI Model 100 Generation Device 110 Communication Unit 120 Input Unit 130 Display Unit 141 Metadata Table 142 Anonymous UI Image 150 Control Unit 151 Display Control Unit 152 Model Generation Unit 153 Identification Unit 154 Generation Unit 155 Transmission Unit

Claims

1. A method for generating a screen executed by a computer, comprising: Storing a plurality of first components included in a first image in a storage device; Identifying a pair of a similar first component and a second component based on the plurality of second components included in a second image obtained in response to an image acquisition operation on the screen and the plurality of first components; Adjusting the size of the identified first component in the pair to the size of the similar second component; Generating a third image in which the adjusted first component is arranged at the arrangement position of the similar second component, the third image including only the adjusted first component and not including the second component; The generation method characterized by executing the process.

2. The first image is an image having no personal information, and the generation method according to claim 1, further comprising extracting a first component from the first image and storing the extracted first component in the storage device.

3. When receiving an indication of cancellation for any first component included in the third image, the generation method according to claim 1 or 2, further comprising executing a process of assigning information of a second component similar to the designated first component to the designated first component.

4. Based on the relationship between the first component identified by the identifying process and the second component similar to the first component, further executing a process of generating definition information that defines the size and arrangement position when arranging the first component in the third image. The generation method according to claim 1.

5. The generation method according to claim 4, wherein the generating process sets at least one of an attribute of the first component or a relationship between the first component and another first component in the definition information.

6. Causing a computer to Store a plurality of first components included in a first image in a storage device; Identify a pair of a similar first component and a second component based on the plurality of second components included in a second image obtained in response to an image acquisition operation on the screen and the plurality of first components; Adjust the size of the identified first component in the pair to the size of the similar second component; Generate a third image in which the adjusted first component is arranged at the arrangement position of the similar second component, the third image including only the adjusted first component and not including the second component; A generation program characterized by executing the process.

Images