Information processing method, program, and information processing device

Abstract

To provide a technology that enables a user (e.g., a company conducting exams to measure engineers' skills) to verify whether questions related to skill measurement identical or similar to received questions related to skill measurement (e.g., exam questions related to skill measurement) are published on web pages.SOLUTION: An information processing method executed by an information processing device comprises: receiving a first question related to skill assessment of engineers; receiving, from one or more web pages, a second question related to skill assessment of engineers published on the web pages; and determining the similarity between the first question and the second question.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an information processing method, a program, and an information processing device. [Background technology]

[0002] Conventionally, there is known a technique for evaluating an engineer's skills online. For example, Patent Document 1 discloses that a test for measuring an engineer's programming skills is conducted online. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-143890 A Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, an increasing number of companies are conducting skill measurement tests to evaluate the skills of engineers. By conducting skill measurement tests, it becomes possible to reduce mismatches in the hiring of engineers. However, for example, when a skill measurement test is conducted online, there are cases where a test creator sets questions without knowing that questions identical or similar to the test questions are published on a web page or the like. In such cases, there is a need for test creators to check in advance whether questions identical or similar to the test questions are published on a web page or the like when selecting or generating questions.

[0005] The disclosed technology has been developed in consideration of these circumstances, and aims to provide technology that enables a user (e.g., a company that conducts tests to measure engineer skills) to check whether skill measurement questions that are identical or similar to the skill measurement questions (e.g., skill measurement test questions) that a user has acquired are published on a web page. [Means for solving the problem]

[0006] One aspect of the disclosed technology is an information processing method in which an information processing device acquires a first question related to an engineer's skill measurement, acquires from one or more web pages a second question related to the engineer's skill measurement that is posted on the web page, and determines a similarity between the first question and the second question. Effect of the Invention

[0007] According to the present invention, a user (e.g., a company that conducts tests to measure engineer skills) can check whether questions related to engineer skill measurement that are identical or similar to the questions related to engineer skill measurement that a user has obtained are published on a web page. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a configuration of an information processing system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a block diagram illustrating an example of a server according to an embodiment of the present invention. [Diagram 3] An example of a first list of questions to be displayed on an information processing device used by a company that implements tests to measure the skills of engineers [Figure 4] FIG. 13 is a diagram showing an example of a first question displayed on an information processing device. [Diagram 5] A flowchart showing an example of a process of the information processing device according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0010] <System Overview> Fig. 1 is a diagram showing an example of the configuration of an information processing system 1 according to an embodiment of the present invention. In the example shown in Fig. 1, the information processing system 1 is illustratively configured to include an information processing device 10, an information processing device 20, an information processing device 30, and a network N. Furthermore, the number of the information processing devices 10, 20, and 30 may be one or more.

[0011] The information processing system 1 is used, for example, by a user (hereinafter also referred to as the administrator) who creates a test to measure the skills of engineers, a user (hereinafter also referred to as the examinee) who takes the test, and a user (hereinafter also referred to as the evaluator or company) who implements the test or evaluates the test results. The administrator and the evaluator may be the same user. When a user who implements a test or evaluates the test results is referred to as a "company," the "company" may include at least one of a company that wants to hire an engineer and a company that wants to measure the skills of its in-house engineers.

[0012] The information processing system 1 generates a coding test in a predetermined programming language, for example, in response to a request from an administrator or an evaluator. The predetermined programming language includes at least one of well-known programming languages ​​such as scripting languages ​​such as JavaScript (registered trademark), Python, and C language, Go language, Swift, and Kotlin (registered trademark). Note that the test for measuring the skills of engineers is not limited to a coding test.

[0013] The information processing system 1 provides the generated test to examinees or evaluators. The information processing system 1, for example, provides examinees with an environment for taking the test online and records the answers submitted by the examinees.

[0014] The information processing device 10 is an information processing device used when an examinee takes a test to measure skills. The information processing device 10 is, for example, a personal computer, a smartphone, a tablet terminal, etc. The information processing device 10 acquires test questions via a network N and presents them to the examinee. The information processing device 10 also transmits the contents of the examinee's answers to the test questions to at least one of the information processing device 20 and the server 30.

[0015] An application program (app) for utilizing an engineer skill measurement test service (hereinafter also referred to as the present service) provided by the server 30 may be installed in the information processing device 10. This app causes the information processing device 10 to execute at least a part of the processing related to the test of the engineer skill measurement disclosed in the embodiment described below in the present service provided by the server 30. By executing this app, the information processing device 10 may access the server 30 and transmit and receive information used to execute the app.

[0016] The information processing device 20 is an information processing device used by an evaluator or a company. The information processing device 20 is, for example, a personal computer, a smartphone, a tablet terminal, or the like. The information processing device 20 acquires a request for test questions from the evaluator or the company through user input, and transmits the request to the server 30. The information processing device 20 acquires test questions corresponding to the request or a list of selectable test questions from the server 30 via the network N. The information processing device 20 may transmit the finally determined test questions to the information processing device 10 via the network N. The information processing device 20 may acquire the contents of the answers given by the examinee to the test questions from the information processing device 10 or the server 30 via the network N.

[0017] The server 30 is an information processing device used by an administrator or the like, and may be a general-purpose computer or the like. The server 30 provides the present service disclosed in this embodiment. For example, the server 30 generates test questions related to measuring the skills of engineers. The server 30 transmits the generated test questions to at least one of the information processing device 10 or the information processing device 20 via the network N. The server 30 may obtain the contents of the answers given by the examinees to the test questions from the information processing device 10 via the network N, and transmit the contents to the information processing device 20. The server 30 may evaluate the contents of the answers, for example, by marking or correcting, and transmit the evaluated contents of the answers to at least one of the information processing device 10 or the information processing device 20. The detailed processing by the server 30 will be described later.

[0018] The network N is realized by, for example, a network such as the Internet or a mobile phone network, a LAN (Local Area Network), or a combination of these.

[0019] <Server configuration> 2 is a block diagram illustrating an example of a server 30 according to one embodiment of the disclosure. The server 30 includes one or more processors (e.g., CPUs) 310, one or more network communication interfaces 320, a storage device (storage unit) 330, and one or more communication buses 350 for interconnecting these components.

[0020] The server 30 may optionally include a user interface 340. The user interface 340 includes a display and / or an input device (such as a keyboard and / or a mouse or some other pointing device).

[0021] The storage device 330 is, for example, a high-speed random access memory (main storage device) such as a DRAM, an SRAM, or other random access solid-state storage device. The storage device 330 may also be a non-volatile memory (auxiliary storage device) such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The storage device 330 may also be a non-transitory computer-readable recording medium that stores programs and the like. The storage device 330 may also be either a main storage device (memory) or an auxiliary storage device (storage), or may include both.

[0022] The storage device 330 is a storage unit that stores data, programs, etc. used by the information processing system 1. For example, the storage device 130 stores questions that are the basis of the test given to the examinees, correct answers to the questions, evaluation criteria, test results, etc.

[0023] As another example, storage device 330 may be one or more storage devices located remotely from processor 310. In one embodiment, storage device 330 stores programs, modules and data structures, or a subset thereof, that are executed by processor 310.

[0024] The processor 310 executes a program stored in the storage device 330 to control, for example, the processing executed by the information processing unit 312 .

[0025] The information processing unit 312 includes, for example, an acquisition unit 313, a determination unit 314, an identification unit 315, an association unit 316, and a transmission unit 317.

[0026] The acquisition unit 313 acquires questions related to the skill measurement of an engineer (hereinafter, also referred to as first questions). For example, the acquisition unit 313 generates questions related to coding using one programming language selected from various programming languages. The acquisition unit 313 may acquire questions that satisfy the conditions requested by the company from a large number of questions stored in advance, or may generate the first questions using a generation AI (Artificial Intelligence). The acquisition unit 313 may acquire questions that satisfy the conditions requested by the administrator from a large number of questions stored in advance, or may acquire the first questions by having the administrator manually create questions. Note that the number of questions generated by the acquisition unit 313 is arbitrary, and one question or multiple questions may be generated.

[0027] The acquisition unit 313 also acquires questions (hereinafter also referred to as second questions) related to the engineer's skill measurement posted on one or more web pages. For example, the acquisition unit 313 performs scraping on a website consisting of one or more web pages. Specifically, the acquisition unit 313 acquires HTML data of the web page from the website and extracts questions related to the engineer's skill measurement. In addition, when scraping, the acquisition unit 313 may set a specific website or web page (e.g., Qiita, stackoverflow, leetcode) on which questions related to the skill measurement are posted, and extract questions from the website or web page. This eliminates the need to manually collect data from web pages, and can significantly reduce the time required to collect questions related to the engineer's skill measurement. Note that when the acquisition unit 313 performs scraping on a website, the scraping is performed in compliance with the terms of use and laws of the website.

[0028] The determination unit 314 determines the similarity between the first question and the second question. For example, the determination unit 314 may calculate the similarity between the first question and the second question. If the calculated similarity is equal to or greater than a predetermined value, the determination unit 314 may determine that the first question and the second question are highly similar. If the calculated similarity is less than a predetermined value, the determination unit 314 may determine that the first question and the second question are low similar.

[0029] The determination unit 314 may determine the similarity between the text of the question sentence in the generated first question and the text of the question sentence in the second question extracted from the web page, for example. The determination unit 314 may determine the similarity between the first question and the second question using a known natural language processing technology or other AI technology using a learning model trained from learning data labeled with the similarity of the questions.

[0030] The determination unit 314 may determine the similarity between the first problem and the second problem using a known technique, Measure of Software Similarity (MOSS), which measures the similarity of programs.

[0031] The above process makes it possible to determine the similarity between the first question and the second question. Therefore, for example, an administrator using server 30 can provide the company with similarity indicating whether the first question to be provided to the company is identical or similar to a question (second question) relating to an engineer's skill measurement published on a webpage. As a result, the company can grasp whether a question (second question) relating to an engineer's skill measurement that is identical or similar to the acquired question (first question) relating to an engineer's skill measurement is published on a webpage.

[0032] The transmission unit 317 may transmit the first question and the similarity determination result to another information processing device. The transmission unit 317 may transmit the first question and the similarity determination result by the determination unit 314 to the information processing device 20 via the network N, for example. Furthermore, when the transmission unit 317 receives a request for the first question and the similarity determination result from the information processing device 20 via the network N, it may transmit the first question and the similarity determination result to the information processing device 20. Note that the server 30 does not necessarily have to include the transmission unit 317.

[0033] By the above process, for example, a company using the information processing device 20 can obtain the first questions and the similarity judgment result via the network N. As a result, the company can select questions to be posed to the examinee from among the obtained first questions based on the similarity judgment result. For example, the company can prevent the examinee from committing fraud (so-called cheating) by answering the test questions while looking at the questions or answers posted on a web page by asking the examinee questions determined to have low similarity from among the obtained first questions. As a result, the company can appropriately measure the skills of the examinee. Also, for example, the company may purposely ask the examinee questions determined to have high similarity from among the obtained first questions.

[0034] Furthermore, if the determination unit 314 determines that the first question and the second question are highly similar, the transmission unit 317 may associate the first question with the similarity determination result and transmit them to the information processing device 10 used by the examinee via the network N. When transmitting the first question to the information processing device 10, the transmission unit 317 may also transmit a link that enables the examinee to access a web page for answering the first question on a browser. (The same applies to the processing of the transmission unit 317 described below.)

[0035] Through the above process, the examinee using the information processing device 10 can know that questions identical or similar to the test question to be asked have been published on the web page. Therefore, if the examinee can search the web page, he or she can answer the test question by referring to the answer to the second question. As a result, the company or administrator who sets the test questions to the examinee can measure the search skills of the examinee.

[0036] For example, when the judgment unit 314 judges that the first question and the second question have low similarity, the transmission unit 317 may associate the first question with the judgment result of the similarity and transmit it to the information processing device 10 via the network N.

[0037] Through the above process, the examinee using the information processing device 10 can understand that the same or similar questions as the test question to be asked have not been published on the web page. Therefore, the examinee can concentrate on answering the test question without feeling the need to search the web page. As a result, the company or administrator who issues the test questions to the examinee can measure the examinee's thinking ability regarding the first question that has not been published on the web page.

[0038] When the determination unit 314 determines that the first question has low similarity to the second question, the transmission unit 317 may transmit the first question to another information processing device. For example, the transmission unit 317 may identify first questions determined to have low similarity from one or more first questions whose similarity has been determined by the determination unit 314, and transmit a list of the identified first questions to the information processing device 20 via the network N. Furthermore, when the transmission unit 317 receives a request from the information processing device 20 requesting first questions determined to have low similarity, it may transmit a list of first questions determined to have low similarity to the information processing device 20.

[0039] Through the above process, a company using information processing device 20 can obtain only the first questions determined to have low similarity via network N. As a result, the company can save the effort of identifying the first questions determined to have low similarity from among the first questions received from server 30.

[0040] The first problem may include a problem regarding at least one of the coding skills, knowledge, and system design of the engineer. For example, when the first problem includes a problem regarding the coding skills of the engineer, the first problem may include a coding test problem using one programming language selected from various programming languages. For example, when the first problem includes a problem regarding the knowledge of the engineer, the first problem may include a test problem regarding knowledge regarding at least one of PC, server, cloud, security, network, database, web technology, and artificial intelligence. For example, when the first problem includes a problem regarding the system design of the engineer, the first problem may include a test problem regarding at least one of requirements definition, basic design, external design, functional design, internal design, and detailed design.

[0041] Through the above process, for example, a company or operator can check whether a web page contains questions that are identical or similar to test questions related to at least one of an engineer's coding skills, knowledge, and system design.

[0042] The identification unit 315 makes it possible to distinguish between similar and dissimilar first questions based on the similarity between the first and second questions. The identification unit 315 may, for example, associate information that makes it possible to identify the presence or absence of similarity between the first question and the second question, with each of one or more first questions. Furthermore, the transmission unit 317 may transmit the first question associated with the information in a format that can be displayed on the information processing device 10 or the information processing device 20. Note that the server 30 does not necessarily have to include the identification unit 315.

[0043] FIG. 3 is an example of a list of first problems displayed on the information processing device 20 used by a company. In the example shown in FIG. 3, problems related to "Designing a TODO application," "IT basics," "Searching for completed TODO tasks," "Calculating array elements," "Greeting application," and "Counting the number of likes" are displayed on the information processing device 20 as first problems. In addition, in the example shown in FIG. 3, each of the displayed first problems is associated with a "similarity" S, a "correct answer rate," a "number of uses," and an "average number of times of use." The "similarity" S represents the similarity between the first problem and the second problem. The "correct answer rate" represents the correct answer rate of other examinees who have answered the first problem. The "number of uses" represents the number of times the first problem has been asked to other examinees. The "average number of times of use" represents the average time it took other examinees to answer the first problem.

[0044] The "similarity" S may be displayed in association with all of the first questions displayed on the information processing device 20. In other words, the transmission unit 317 may associate the similarity calculated by the determination unit 314 with all of the first questions acquired by the acquisition unit 313 and transmit them to the information processing device 20. This enables the company to check, based on the similarity displayed on the information processing device 20, whether a second question that is identical or similar to the acquired first question has been published on a webpage.

[0045] When the "similarity" S is equal to or greater than a predetermined value, it may be displayed in association with the first question displayed on the information processing device 20. That is, when the similarity calculated by the determination unit 314 is equal to or greater than a predetermined value, the transmission unit 317 may associate the similarity with the first question and transmit it to the information processing device 20. This enables the company to easily recognize first questions that are highly similar among the first questions displayed.

[0046] When the "similarity" S is less than a predetermined value, it may be displayed in association with the first question displayed on the information processing device 20. That is, when the similarity calculated by the determination unit 314 is less than a predetermined value, the transmission unit 317 may associate the similarity with the first question and transmit it to the information processing device 20. This enables the company to easily recognize first questions that have low similarity among the first questions displayed.

[0047] The identification unit 315 may associate a mark indicating high similarity with the first question determined by the determination unit 314 to have high similarity. In the example shown in FIG. 3, the identification unit 315 associates "!" with the question about "greeting app" determined by the determination unit 314 to have high similarity. This allows the company to easily recognize the first question that has high similarity among the displayed first questions. In addition, the mark W associated with the first question is not limited to "!" and is arbitrary. As a non-limiting example, the mark W includes a character, a symbol, and an illustration.

[0048] When it is determined that there is a similarity between the first question and the second question, the associating unit 316 associates information related to the webpage with the first question. For example, when the determining unit 314 determines that there is a high similarity between the first question and a question posted on a webpage, the associating unit 316 associates the first question with a URL corresponding to the webpage. Note that the server 30 does not necessarily have to include the associating unit 316.

[0049] The transmission unit 317 may transmit the first question associated with the information related to the web page to another information processing device. For example, when the association unit 316 associates the first question with a URL corresponding to a web page, the transmission unit 317 may transmit the first question associated with the URL to the information processing device 10 or the information processing device 20.

[0050] In the example shown in FIG. 3, a URL corresponding to a question (second question) about a "greeting app" posted on a webpage is displayed as information U associated with a question (first question) about a "greeting app" that has been determined to have a high similarity by determination unit 314. This allows a company to view a second question that is the same as or similar to the first question by selecting the URL associated with the first question. Furthermore, the information about the webpage associated with the first question does not necessarily need to be a URL, and may be, for example, a hyperlink.

[0051] If the first problem includes a problem regarding coding skills, the determination unit 314 may identify variables included in the first problem and the second problem, and determine the similarity between the first problem and the second problem based on problems other than the identified variables.

[0052] For example, the method of determining similarity other than variables is given below. The problem statement of the first problem is "Create a program that outputs the area of ​​a rectangle when the length and width of the rectangle are input. The length of the rectangle is variable a, and the width is variable b." The problem statement of the second problem is "Create a program that outputs the area of ​​a rectangle when the length and width of the rectangle are input. The length of the rectangle is variable height, and the width is variable base." In this case, the determination unit 314 uses, for example, the "variable" included in the first problem and the second problem as a keyword and identifies alphanumeric characters such as "a," "b," "height," and "base" following the "variable" as variables. The determination unit 314 determines the similarity between the problem statement of the first problem excluding the identified variables "a" and "b" and the problem statement of the second problem excluding the identified variables "height" and "base." That is, in this case, the first problem and the second problem excluding the identified variable would both become "Please create a program that outputs the area of ​​a rectangle when the length and width of the rectangle are input. The length of the rectangle is variable x and the width is variable x.", and the determination unit 314 may determine that the similarity between the first problem and the second problem is 100%.

[0053] Through the above process, the determination unit 314 can appropriately determine the similarity even if the variables included in the first problem and the second problem are different. As a result, the operator can provide the company with coding problems that can be appropriately confirmed as being identical or similar to coding problems published on a webpage. Furthermore, as a result, the company can appropriately confirm whether a coding problem that is identical or similar to the provided coding problem is published on a webpage.

[0054] When the other information processing devices include an information processing device 10 used by an engineer, the transmission unit 317 may transmit the first question to the information processing device without transmitting the determination result by the determination unit 314 to the information processing device. For example, when the other information processing device is an information processing device 20 used by a company, the transmission unit 317 transmits the first question and the similarity determination result to the information processing device 20 via, for example, the network N. On the other hand, when the other information processing devices include an information processing device 10 used by an examinee, the transmission unit 317 may transmit the first question to the information processing device 10 without transmitting the determination result by the determination unit 314 to the information processing device 10.

[0055] The server 30 used by the administrator providing the present service may have a function of determining whether the other information processing device to which the first question is to be sent is the information processing device 10 or the information processing device 20. For example, when the server 30 receives information for identifying the information processing device 20 and a request requesting the first question from the information processing device 20 via the network N, the server 30 may transmit the first question and the similarity determination result to the information processing device 20. Also, for example, when the server 30 receives information for identifying the information processing device 10 and a request requesting the first question from the information processing device 10 via the network N, the server 30 may transmit the first question to the information processing device 10 without transmitting the similarity determination result.

[0056] Through the above process, the server 30 can transmit the first question to the information processing device 10 without transmitting the similarity determination result by the determination unit 314 to the information processing device 10. As a result, the company or administrator can prevent the examinee from answering the first question based on the similarity determination result.

[0057] <Screen example> Next, an example of the first problem displayed on the information processing device 20 will be described. Fig. 4 is a diagram showing an example of the first problem displayed on the information processing device 20. For example, a company implementing a test to measure the skills of engineers can select a problem "operation of array elements" from among the first problems (see Fig. 3) displayed on the information processing device 20, and view details of the problem "operation of array elements" as shown in Fig. 4. In the example shown in Fig. 4, the similarity S is also displayed on the screen showing the details of the problem.

[0058] <Operation> Next, an operation according to the embodiment will be described below. Fig. 4 is a flowchart showing an example of a process of the server 30 according to the embodiment.

[0059] In step S11, the acquisition unit 313 of the server 30 acquires a first question related to the skill measurement of an engineer. The acquisition unit 313 may acquire one or more first questions stored in the storage device 330, or may generate and acquire a first question by user input.

[0060] In step S12, the acquisition unit 313 of the server 30 acquires, from one or more web pages, second questions relating to the skill measurement of engineers that are posted on the web pages.

[0061] In step S13, the determination unit 314 of the server 30 determines the similarity between the first question and the second question.

[0062] In step S14, the identification unit 315 of the server 30 makes it possible to identify first questions that are similar and first questions that are not similar, based on the similarity between the first questions and the second questions. Note that step S14 is not necessarily a necessary process.

[0063] In step S15, when it is determined that there is a similarity between the first question and the second question, the associating unit 316 of the server 30 associates the information about the web page with the first question. Note that step S15 is not necessarily a necessary process.

[0064] In step S16, the transmitting unit 317 of the server 30 transmits the first question associated with the information related to the web page to another information processing device (for example, the information processing device 20). Note that step S16 is not necessarily a necessary process.

[0065] <Modification> The above-mentioned embodiment or each example is for facilitating understanding of the present invention, and is not to be construed as limiting the present invention. The present invention may be modified / improved without departing from the spirit thereof, and the present invention also includes equivalents thereof. In addition, the present invention can form various disclosures by appropriate combinations of multiple components disclosed in the above-mentioned embodiment or each example. For example, some components may be deleted from all components shown in the embodiment. Furthermore, components may be appropriately combined in different embodiments.

[0066] In the above embodiment, the transmitting unit 317 may associate the first question with the similarity judgment result and transmit it to the information processing device 10 used by the examinee, but this is not limited to the above. For example, the similarity judgment result is not basically notified to the examinee, but when the similarity judgment result is to be notified to the examinee for various reasons, the transmitting unit 317 may associate a judgment result different from the similarity judgment result by the judgment unit 314 with the first question and transmit it to the information processing device 10. More specifically, when the judgment unit 314 calculates the similarity between the first question and the second question, the transmitting unit 317 may associate a similarity of a value different from the calculated similarity with the first question and transmit it to the information processing device 10. As a non-limiting example, the similarity of a value different from the similarity calculated by the judgment unit 314 may be "100-similarity calculated by the judgment unit 314". For example, if the determination unit 314 determines that the similarity between the first question and the second question is 90%, the transmission unit 317 may determine that the similarity between the first question and the second question is 10%, associate the first question with the similarity, and transmit the result to the information processing device 10. This allows the examinee to recognize that even if a test question (first question) similar to the second question is given, the test question is not published on the web page. As a result, even if a company or operator gives a test question (first question) similar to the second question, it is possible to prevent the examinee from committing fraud by answering the test question while looking at the question published on the web page. [Explanation of symbols]

[0067] 1...information processing system, 10...information processing device, 20...information processing device, 30...server, 310...processor, 312...information processing unit, 313...acquisition unit, 314...determination unit, 315...identification unit, 316...association unit, 317...transmission unit, 320...network communication interface, 330...storage device, 340...user interface, 350...communication bus, N...network, S...similarity, U...information, W...print

Claims

1. An information processing device, To obtain the first problem of measuring the skills of engineers; acquiring, from one or more web pages, second questions relating to measuring the skills of engineers, the second questions being posted on the web pages; determining a similarity between the first problem and the second problem; An information processing method for performing the above.

2. The information processing method according to claim 1 , further comprising transmitting the first question and the similarity determination result to another information processing device.

3. The information processing method according to claim 1 , further comprising the step of: transmitting the first question to another information processing device when it is determined that the first question has a low similarity to the second question.

4. The information processing method according to claim 1 , wherein the first problem includes a problem related to at least one of an engineer's coding skill, knowledge, and system design.

5. The information processing method according to claim 1 or 2, further comprising making it possible to distinguish between a first question that has similarity and a first question that does not have similarity based on the similarity between the first question and the second question.

6. if a similarity is determined between the first problem and the second problem, associating information about the web page with the first problem; transmitting the first question associated with information about the web page to another information processing device; The information processing method according to claim 1 or 2, further comprising the steps of:

7. 2. The information processing method of claim 1, wherein, when the first problem includes a problem regarding coding skills, determining the similarity includes identifying variables included in the first problem and the second problem, and determining the similarity between the first problem and the second problem based on problems other than the identified variables.

8. The information processing method of claim 2, wherein when the other information processing device includes an information processing device used by the engineer, the sending includes sending the first problem to the information processing device without sending the judgment result to the information processing device.

9. In the information processing device, To obtain the first problem of measuring the skills of engineers; acquiring, from one or more web pages, second questions relating to measuring the skills of engineers, the second questions being posted on the web pages; determining a similarity between the first problem and the second problem; A program that executes the following.

10. An information processing device including a processor, The processor, To obtain the first problem of measuring the skills of engineers; acquiring, from one or more web pages, second questions relating to measuring the skills of engineers, the second questions being posted on the web pages; determining a similarity between the first problem and the second problem; An information processing device that executes the above.

Images