Examination device, examination method, and program

Abstract

To provide an examination device, an examination method and a program, which enable appropriate examination in each examination range even in the presence of examination ranges of a plurality of different examination types in an examination target.SOLUTION: An examination device provided herein comprises: an examination range detection unit configured to detect examination ranges based on examination type switching points in examination target data, and identify specific ranges including target positions of information within the examination target data as identified through examination of the examination target data; and a display unit configured to display one or more specific ranges including highlighted target positions.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an examination device, an examination method, and a program. [Background technology]

[0002] Commercial footage broadcast by broadcasting stations and advertisements placed on web pages are subject to various inspections, such as whether the text contained in commercial footage or advertising images is appropriate.

[0003] A technology for conducting such an advertisement review (screening) is disclosed in Patent Document 1. Patent Document 1 discloses a technology for suppressing an increase in the burden on content creators, and a technology for presenting information on the results of a pre-screening of content based on predetermined criteria. Furthermore, paragraph 0021 and other sections of Patent Document 1 disclose that, in addition to the approval or disapproval of an advertisement, a rejection reason to be selected from a plurality of rejection reasons depending on the content of the advertisement pre-screening is presented. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-49651 Summary of the Invention [Problem to be solved by the invention]

[0005] Even when the subject of the examination had multiple examination scopes for different types of examination, it was required to conduct examinations for each examination scope appropriately.

[0006] An object of the present disclosure is to provide an examination device, an examination method, and a program that solve the above-mentioned problems. [Means for solving the problem]

[0007] An examination device according to one embodiment of the present disclosure comprises a range identification means for identifying a specific range including a target position of information in the data to be examined that has been identified by examining the data to be examined, and a display means for displaying one or more of the specific ranges that include the target position and clearly indicate the target position.

[0008] An inspection method according to one embodiment of the present disclosure identifies specific ranges that include target positions of information within the data to be inspected, which are identified by inspecting the data to be inspected, and displays one or more of the specific ranges that include the target positions and clearly indicate the target positions.

[0009] A program according to one embodiment of the present disclosure causes a computer of an examination device to function as a range identification means for identifying a specific range including a target position of information in the data to be examined that has been identified by examining the data to be examined, and a display means for displaying one or more of the specific ranges that include the target position and clearly indicate the target position. [Effects of the Invention]

[0010] According to the above aspect, even if the test subject has test ranges of multiple different test types, it is possible to appropriately test each test range. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 2 is a functional block diagram of an examination device according to the present disclosure. [Figure 2] FIG. 2 is a hardware configuration diagram of an examination device according to the present disclosure. [Figure 3] FIG. 10 is a first diagram illustrating an example of processing by a switching detection unit according to the present disclosure. [Figure 4] FIG. 10 is a second diagram illustrating an example of processing by the switching detection unit according to the present disclosure. [Figure 5] A diagram showing the processing flow of the examination device according to the present disclosure. [Figure 6] This is the first figure showing an example of display data of the examination judgment results related to the present disclosure. [Figure 7]This is a second figure showing an example of display data of the examination judgment results related to the present disclosure. [Figure 8] This is a third figure showing an example of display data of the examination judgment results related to the present disclosure. [Figure 9] This is a fourth figure showing an example of display data of the examination judgment results related to the present disclosure. [Figure 10] This is the fifth figure showing an example of display data of the examination judgment results related to the present disclosure. [Figure 11] This is the sixth figure showing an example of display data of the examination judgment results related to the present disclosure. [Figure 12] This is the seventh figure showing an example of display data of the examination judgment results related to the present disclosure. [Figure 13] A figure showing another example of an examination system including an examination device according to the present disclosure. [Figure 14] FIG. 10 is another functional block diagram of the examination device according to the present disclosure. [Figure 15] A diagram showing the processing flow according to another functional block diagram of the examination device disclosed herein. DETAILED DESCRIPTION OF THE INVENTION

[0012] The examination device, examination method, and program of the present disclosure will be described below with reference to the drawings.

[0013] FIG. 1 is a functional block diagram of the examination device. The testing device 1 is a computer that performs testing based on the data being tested and outputs the testing results. The computer of the testing device 1 executes a testing program. As a result, the testing device 1 performs the functions of a control unit 11, an acquisition unit 12, a content analysis unit 13, a meta information generation unit 14, a switching detection unit 15, a testing range detection unit 16, and a testing processing unit 17. By executing the testing program, the computer of the testing device 1 also performs the functions of a display unit 21, a first registration unit 22, a second registration unit 23, a writing unit 24, and a linking unit 25. Testing refers to, for example, determining whether the information contained in the data being tested complies with legal regulations, whether it complies with the self-imposed restrictions of industry associations, and whether it complies with the self-imposed restrictions of each business that handles the data being tested. This determines whether the integrity of the data being tested is guaranteed. The testing device 1, for example, communicates with a terminal device 3.

[0014] The control unit 11 controls each functional unit. The acquisition unit 12 acquires the examination target data and attribute information linked to the examination target data. The content analysis unit 13 acquires predetermined content information contained in the data to be examined. The meta information generating unit 14 generates meta information that can identify the type of examination content indicated by the examination target data using the content information and attribute information. The change detection unit 15 detects a change point of the examination type in the examination target data based on at least one of the content information and attribute information of the examination target data. The test range detection unit 16 detects the test range based on the test type switching point in the test target data. The test range detection unit 16 further performs the function of range identification means for identifying a specific range including a target position determined to be a risky expression in the test target data identified by the test of the test target data. The examination processing unit 17 performs examination processing for each examination range.

[0015] The display unit 21 generates display data that displays one or more specific ranges that include the target positions determined to be risky expressions and clearly indicate the target positions. The first registration unit 22 registers, in a storage unit or the like, registration information including at least information within the data to be examined, the position where the information appears in the data to be examined, and comments related to the examination of the information. The second registration unit 23 registers re-learning information including the test target data, classification information of the test target data, information within the test target data, and one or more pieces of related information of the information. The writing unit 24 writes a comment in each specific range including the target position determined to be a risky expression in the data to be examined based on a user operation. The linking unit 25 links with external devices such as other SNS systems to receive data to be examined, and transmits access destination information indicating the access destination for the results of automatic examination of the data to be examined to the message transmitting / receiving device.

[0016] Figure 2 is a hardware configuration diagram of the examination device. As shown in Figure 2, the examination device 1 is a computer equipped with various hardware components such as a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a database 104, and a communication module 105. The examination device 1 may be composed of a single computer, or multiple computers may be connected via communication to form the examination device 1. The terminal device 3 may be a computer equipped with the same hardware configuration as the examination device 1. The terminal device 3 may also be equipped with a display function such as a display that displays information to the user, and input functions such as a mouse and keyboard. The examination device 1 may also be equipped with display and input functions.

[0017] FIG. 3 is a first diagram illustrating an example of processing by the switching detection unit. When the data to be examined is an advertising video, the transition detection unit 15 of the examination device 1 detects the playback time of a scene transition in the advertising video. For example, when a scene (31) with a forest background switches to a scene (32) of a specific beverage, which is the advertised product, the transition detection unit 15 detects the playback time of the scene transition. The playback time indicates the time elapsed from the start of the advertising video. The transition detection unit 15 may be a processing unit that detects the point in time when the examination type changes in the data to be examined based on at least one of the content information and attribute information of the data to be examined. In other words, the transition detection unit 15 is a processing unit that detects the point in time when the examination type changes in the advertising video, which is the data to be examined. In the example of Figure 3, the transition detection unit 15 detects the time when a scene of a forest, which is not subject to examination and does not particularly display the product name, switches to a scene that displays the product name of the beverage, which is the subject of examination.

[0018] FIG. 4 is a second diagram illustrating an example of processing by the switching detection unit. When the data to be examined is a storyboard, the transition detection unit 15 of the examination device 1 detects the position (coordinates) within the image of the transition between frames in the storyboard. For example, the transition detection unit 15 determines that the data is not eligible for examination based on the first picture (41) and the second picture (42) and the corresponding first picture description (410) and second picture description (420). Also, the transition detection unit 15 determines that the data is eligible for examination based on the third picture (43) and the fourth picture (44) and the corresponding third picture description (430) and fourth picture description (440). In this case, the change detection unit 15, for example, performs a process of detecting the position (coordinates) in the image of the storyboard 40 at the boundary between the range including the second picture (42) and the description of the second picture (420) and the range including the third picture (43) and the description of the third picture (430) as the position indicating the change point. Note that in this case too, the change detection unit 15 detects the change point of the test type in the test target data based on at least one of the content information and attribute information of the test target data. In other words, the change detection unit 15 is a processing unit that detects the position (coordinates) in the image that is the change point of the test type in the storyboard, which is the test target data.

[0019] Here, when the data to be examined is a video, the change detection unit 15 may detect the time indicating the change point of the examination type in the video based on at least one of the content information and the attribute information.

[0020] In addition, when the data to be examined is a storyboard, the transition detection unit 15 may detect the coordinates between multiple image diagrams in the storyboard that indicate the transition position of the examination type in the storyboard based on at least one of the content information and the attribute information.

[0021] The test data may be images other than storyboards. The transition detection unit 15 may detect coordinates between multiple images within an image that indicate the transition position of the test type in the image based on at least one of the content information and the attribute information. A storyboard may be an example of an image. Although the test data according to the present disclosure will be described as an advertising video or storyboard, the test data may be other data. For example, the test data may be data such as a script storyboard, a poster, a bulletin board, or text.

[0022] FIG. 5 is a first diagram showing the processing flow of the examination device. Next, the processing flow of the examination device will be explained step by step. First, the examination device 1 receives the data to be examined (step S101). The examination device 1 may receive the data to be examined from another device such as the terminal device 3, or may receive the data to be examined from the input interface of the examination device 1 based on the operation of the user using the examination device 1. Note that attribute information may be attached to the data to be examined. In this case, the examination device 1 receives the attribute information (step S102). The attribute information may be included in the data to be examined. The examination device 1 may not receive the attribute information. In that case, the examination device 1 may generate the attribute information from the information included in the data to be examined. The control unit 11 outputs the data to be examined and the attribute information to the acquisition unit 12. The acquisition unit 12 outputs the data to be examined to the content analysis unit 13. If the acquisition unit 12 acquires attribute information, it outputs it to the meta information generation unit 14.

[0023] The content analysis unit 13 detects the type of data to be examined. The content analysis unit 13 may detect the type based on the extension of the data to be examined, or may identify type information entered via an input interface based on a specification operation on a screen displayed on the user's display, and detect the type of data to be examined based on that type. The content analysis unit 13 may also acquire attribute information and detect the type from the attribute information.

[0024] The content analysis unit 13 analyzes the content of the data to be examined. The content analysis unit 13 outputs content information, which is the result of analyzing the content of the data to be examined (step S103). The content analysis unit 13 may input the data to be examined into a neural network using a content analysis model generated by prior machine learning, acquire content information contained in the data to be examined, and output the content information. The content analysis model may be one of multiple content analysis models that can be identified depending on the type of data to be examined. The content analysis unit 13 may input attribute information from the acquisition unit 12, input the data to be examined and the attribute information into a neural network using a content analysis model identified depending on the data to be examined and the attribute information, acquire content information contained in the data to be examined, and output the content information. Note that, as described above, when the examination device 1 generates attribute information based on the data to be examined, the content analysis unit 13 may generate the attribute information.

[0025] The content information may be information related to the subject of examination that is identified based on the character information of the audio or text included in the subject of examination data. For example, if the subject of examination data is an advertisement video, the content information may include the name of the product advertised in the advertisement video, the name of the advertising company that placed the advertisement, the conversation of people appearing in the advertisement video, and other sentences that appear in the video.

[0026] For example, if the data to be examined is a storyboard, the content information may include the name of the product being advertised as displayed in the storyboard image, the name of the advertising agency placing the advertisement, the content of the conversations between people in the image description, and text displayed in other images or in the image description.

[0027] The attribute information also includes information other than content information related to the advertising video or storyboard shown by the data under review, such as the creator of the data under review (name of the creating company), the type of advertising target, and the genre of the product under review.

[0028] The content analysis unit 13 outputs the content information to the meta information generation unit 14. When the content analysis unit 13 generates attribute information, it outputs the attribute information to the meta information generation unit 14. The meta information generation unit 14 generates meta information using the content information and attribute information. Meta information is information that classifies detailed information about the examination target contained in the content information and attribute information. In other words, the content analysis unit 13 classifies the examination target data based on the meta information and attribute information (step S104).

[0029] The meta information generating unit 14 generates meta information related to the text information based on the text information included in the content information. For example, if the text information includes a product name, the meta information related to the text information may be the product genre. The meta information generating unit 14 generates meta information related to the logo information based on the logo information included in the content information. For example, if the logo information is a company logo, the meta information related to the logo information may be the company's industry. The meta information generating unit 14 generates meta information related to the personal information based on the personal information included in the content information. For example, if the personal information is a person's name, the meta information may be related to the personal information or an occupation (actor, entertainer, etc.) corresponding to the person's name. The meta information generating unit 14 generates meta information related to the object information based on the object information included in the content information. For example, if the object information is an elephant or a giraffe, the meta information related to the object information may be the animal, and if the object information is a product name, the meta information related to the object information may be the product genre. The meta information generating unit 14 generates meta information related to the famous place information based on the famous place information included in the content information. For example, if the famous place information is the address of Tokyo Tower, the meta information related to the famous place information may be information such as Tokyo, which is the name of the prefecture that includes the address of Tokyo Tower. The meta information generating unit 14 generates meta information related to a border line based on the border line included in the content information. For example, when an object to be examined included in an advertising video or storyboard is surrounded by a border line, information such as the type of border line (dotted or solid, a numerical value indicating the thickness, color, presence or absence of a border line) may be generated as meta information related to the border line. The meta information generating unit 14 generates meta information related to the attribute information based on the text included in the attribute information.

[0030] The content information may also include OCR (Optical Character Recognition) information obtained from the video image, brightness, audio, subtitles, color, barcodes, two-dimensional codes, etc., and the meta information generation unit 14 may generate meta information by meta-converting this information.

[0031] The meta information generation unit 14 outputs the meta information as classification information to the switching detection unit 15 (step S105). As an example, it is assumed that, based on the analysis results and attribute information obtained by the content analysis unit 13, the information about the advertising video is that it is a "wine advertisement," the title is "N Wine," the production company is "A Company," and the creator is "Yamada Taro." In this case, the meta information generation unit 14 generates "CM," "alcohol," and "main information type for each frame in the video" as meta information and outputs them to the switching detection unit 15.

[0032] The transition detection unit 15 acquires meta information. Based on the meta information, the transition detection unit 15 identifies a transition detection model from one or more transition detection models. The transition detection unit 15 inputs the test target data and the meta information into a neural network that uses the transition detection model, and as a result, detects transition point information that indicates transition points in the test target data (step S106). The transition detection unit 15 outputs the transition point information to the test range detection unit 16 (step S107). As described above, the transition point information indicates the time within the advertising video and the position within the storyboard.

[0033] The test range detection unit 16 acquires switching point information. The test range detection unit 16 detects the test range in the data to be tested based on the switching points (step S108). For example, if the data to be tested is an advertising video, the test range detection unit 16 identifies the range of the video to be tested (from the start time to the end time) based on the time of the switching point. If there are multiple switching points, the test range is the range of the video separated by those times that includes the information of the test target. Furthermore, if the data to be tested is a storyboard, the test range detection unit 16 identifies the range within the image that includes the test target (such as a rectangular range or a circular range) based on the position of the switching point within the storyboard. If there are multiple positions (coordinates) that indicate the switching points, the test range is the range identified based on those positions that includes the information of the test target. The examination range detection unit 16 may detect the examination range using an examination range detection model identified based on the type of examination target data and meta information (or meta information of the examination range). If the examination target has multiple examination ranges, these examination ranges may be examination ranges of different examination types. By performing examination processing of different types for each examination range in this way, examination for each examination range can be carried out appropriately.

[0034] The examination range detection unit 16 links the examination target data, information on the specified examination range, the type of examination target data for which the examination range has been specified, and meta information, and records them in a database (steps S109, S110, and S111). The examination range detection unit 16 outputs the start of examination processing for this recorded information to the examination processing unit 17. This output may include an identifier that identifies the combination of the examination range information, the type of examination target data for which the examination range has been specified, and the meta information.

[0035] The examination processing unit 17 reads the examination target data, the examination range information, the type of the examination target data that specifies the examination range, and the meta information, which are linked to the identification information and recorded in the database. The examination processing unit 17 identifies one examination judgment model from among the multiple examination judgment models based on the type (step S112).

[0036] The inspection processing unit 17 inputs data within the inspection range of the inspection target data into a neural network using an inspection judgment model to obtain an inspection judgment result. This inspection judgment result includes information indicating NG in the inspection target data indicated by the inspection range. The NG information includes information on characters that are prohibited from being displayed, characters that are prohibited from being broadcast, parts that need to be corrected depending on the advertising company and the details of the corrections, and parts that need to be corrected depending on the type of advertising target and the details of the corrections. In other words, the NG information is information that has been determined to be a risky expression during inspection. The inspection judgment result may include an identifier indicating the reason for determining the expression as risky during inspection, a specified identifier corresponding to the reason for determining the expression as risky, information on the range and position of the expression determined to be risky (coordinates within the image and playback time), information identifying the inspection range (coordinate range within the image and playback time), etc. A risky expression may be an example of an expression that has been determined to be inappropriate or potentially inappropriate during inspection. On the other hand, a non-risky expression may be an example of an expression that has been determined to be appropriate or potentially appropriate during inspection.

[0037] The testing device 1 may only determine the presence or absence of information indicating risky expressions in the data to be tested. Alternatively, the testing device 1 may determine the presence or absence of both information indicating risky expressions and information indicating non-risky expressions in the data to be tested. When determining the presence or absence of information indicating risky expressions in the data to be tested, the testing device 1 may determine the presence or absence of information indicating specific risky expressions or related information recorded in a dictionary table or the like corresponding to the classification information or meta information of the data to be tested. When determining the presence or absence of information indicating non-risky expressions in the data to be tested, the testing device 1 may determine the presence or absence of information indicating specific non-risky expressions or related information recorded in a dictionary table or the like corresponding to the classification information or meta information of the data to be tested. Note that the processing of the testing device 1, which is the main configuration of the present disclosure, illustrates an example in which information indicating at least risky expressions in the data to be tested is detected using a testing judgment model without using a dictionary table.

[0038] The examination judgment result may include information indicating the position in the examination target data indicated by the examination range where information indicating NG exists. In the case of video, the position where the information indicating NG exists may be information indicating the coordinates of a predetermined shape such as a rectangle or circle indicating the playback time in the video and the position of the information in an image showing a part of the video at that time. The examination processing unit 17 outputs the examination judgment result to a predetermined output destination. The output destination may be a monitor, a memory unit, etc. If an examination range exists for one examination target data, the examination processing unit 17 may perform examination processing for each examination range in the same way.

[0039] According to the above process, even when the test object has a plurality of test ranges of different test types, the test device 1 can appropriately test each test range.

[0040] Furthermore, according to the above-described processing, the inspection device 1 can shorten the inspection time for each inspection range even when there are inspection ranges of multiple different inspection types in the inspection target data such as video, storyboards, and images, thereby reducing the burden on the inspector.

[0041] The content analysis model may be a machine learning model obtained by machine learning data on a large number of relationships between input and output, for example, when test subject data and attribute data are input and correct content information is output. The content analysis model may be a machine learning model generated by machine learning using the test device 1 or another device.

[0042] The above-mentioned switching detection model may be a machine learning model obtained by machine learning data on a large number of relationships between inputs and outputs, for example, where the test data, content information, and attribute information are input and the correct answer switching points are output. The switching detection model may be a machine learning model generated by machine learning using the test device 1 or another device.

[0043] The above-mentioned detection model for the test range may be a machine learning model obtained by machine learning data on a large number of relationships between input and output, for example, when the test target data, content information, attribute information, and test range switching points are input and the correct test range is output. The detection model for the test range may be a machine learning model generated by machine learning using the test device 1 or another device.

[0044] The above-mentioned examination judgment model may be, for example, a machine learning model obtained by machine learning data of many relationships between input and output, where the input is the examination target data, content information, attribute information, and information on the examination range, and the output is correct answer information including information that should be considered to be a risky expression in the examination of that examination range (such as characters, logos, colors, lines, and images), an identifier indicating the reason for determining the expression as a risky expression, and a specified identifier corresponding to the reason for determining the expression as a risky expression. The examination judgment model may be a machine learning model generated by machine learning using the examination device 1 or another device.

[0045] FIG. 6 is a first diagram showing an example of display data of the examination result output by the examination device to the terminal device. The first display data 60 of the inspection judgment result shown in Figure 6 is an example when the inspection target data is a storyboard. The first display data 60 displays an inspection target data display area 61, a risk area display area 62, an auxiliary display area 63, a past performance confirmation button 64, a handbook confirmation button 65, etc. The first display data 60 also displays buttons in the upper right corner or elsewhere that allow the user to give final approval (OK) or disapproval (NG) of the inspection judgment result by the inspection device 1. The display unit 21 generates the first display data 60 and outputs it to the terminal device 3 based on a request from the terminal device 3. The terminal device 3 displays the first display data 60 on a display.

[0046] The display of information in the display data such as the first display data 60 displayed on the terminal device 3 can be controlled by a control unit of the terminal device 3 using a program included in the display data or an application program corresponding to the examination device 1 installed on the terminal device 3. Alternatively, the program of the terminal device 3 may control the display of the terminal device 3 in cooperation with the display unit 21 of the examination device 1.

[0047] The test target data display area 61 of the first display data 60 may display all or part of the storyboard, which is the test target data. The user can specify the position of the storyboard displayed in the test target data display area 61 or enlarge or reduce the display by operating the input means of the terminal device 3. In other words, when the user uses the mouse of the terminal device 3 to position the cursor over part of the storyboard, specify the position by left-clicking or the like, and move the mouse left / right, up / down, the terminal device 3 sends an operation signal to the examination device 1. Based on the operation signal, the control unit of the terminal device 3 or the display unit 21 of the examination device 1 controls the movement of the display position of the storyboard left / right, up / down in the test target data display area 61 of the first display data 60 displayed on the terminal device 3.

[0048] Alternatively, when the user uses the mouse of the terminal device 3 to position the cursor on a part of the storyboard and move the mouse wheel in a first rotation direction or a second rotation direction, the terminal device 3 transmits an operation signal to the examination device 1. The control unit of the terminal device 3 or the display unit 21 of the examination device 1 performs control to enlarge or reduce the display range of the storyboard in the examination target data display area 61 of the first display data 60 displayed on the terminal device 3 based on the operation signal.

[0049] The risk location display area 62 of the first display data 60 may display one or more specific ranges including the target position in the data to be examined that has been identified by the examination device 1 through the examination of the data to be examined. As described above, the target position is a position that indicates information such as a sentence, character string, or image that has been determined to be a risky expression in the data to be examined that has been identified through the examination of the data to be examined.

[0050] For example, suppose the storyboard of the data to be inspected contains four risky expressions and character strings of the inspected expression. In this case, the display unit 21 of the inspection device 1 generates first display data 60 that displays images of rectangular specific ranges A, B, C, and D that contain the four risky expressions and the character strings of the inspected expression in the risk location display area 62. The images of the specific ranges A, B, C, and D may contain coordinates that indicate the specific ranges.

[0051] Suppose the user clicks on specific range A in the risk location display area 62 of the first display data 60 displayed on the terminal device 3. The specific range A includes the character string 600 "No. 1" of the expression that has been examined as a risky expression. The character string 600 is information that has been determined to be a risky expression. In this case, the control unit of the terminal device 3 acquires the coordinates indicating the specific range A, uses the coordinates to identify the position in the storyboard of the data to be examined that indicates the specific range A, and automatically controls the display of the entire range in the storyboard that corresponds to the specific range A in the data to be examined display area 61. The character string 600 "No. 1" of the expression that has been examined as a risky expression may be highlighted by being surrounded by a frame or the like so that its position can be identified.

[0052] If the risky expression and the information being examined is a logo, the logo may be highlighted by being surrounded by a frame or the like. If the risky expression and the information being examined is a diagram or picture, the diagram or picture may be highlighted by being surrounded by a frame or the like. If the risky expression and the information being examined is the color or thickness of the line surrounding the information, the frame may be highlighted by flashing.

[0053] This allows the user to immediately check information that has been determined to be a risky expression in the examination of the data to be examined. Furthermore, if there is more than one piece of information that has been determined to be a risky expression in the data to be examined, the user can specify a specific range corresponding to each piece of information about the risky expression, and immediately check enlarged information indicating the corresponding position that has been determined to be a risky expression in the examination of the data to be examined in the examination target data display area 61. This can improve the efficiency of the user's work of checking one or more pieces of information that have been determined to be a risky expression in the examination.

[0054] The specified range may correspond to the test range identified in the test data based on the switching points described above, or it may be a range of a predetermined size identified based on the risky expression and the tested information, regardless of the test range.

[0055] The auxiliary display area 63 of the first display data 60 is an area that displays risky expression information including information determined to be a risky expression as a result of an examination to determine whether the information contained in the data to be examined is a risky expression or a non-risky expression, related information recorded in association with that information, and the reason for determining that the information is a risky expression. Specifically, the display unit 21 of the examination device 1, as an example, acquires the character string "No. 1," which is a character string 600 of an expression that has been examined as a risky expression and is included in the specific range A, and related information that is recorded in the related word dictionary of the database 104 in association with the character string "No. 1," and generates the first display data 60 that is displayed in the auxiliary display area 63 as a character string (risky expression) that may be examined as a risky expression.

[0056] When the control unit of the terminal device 3 detects a designation operation (e.g., a click) of the position of information determined to be a risky expression and displayed in the examination target data display area 61, the control unit of the terminal device 3 may acquire the information and its related information from the examination device 1 and display them in the auxiliary display area 63. In this case, the terminal device 3 transmits to the examination device 1 a related information transmission request including the information determined to be a risky expression at the designated position. The examination device 1 acquires related information recorded in the thesaurus linked to the information determined to be a risky expression included in the related information transmission request, and transmits the related information to the terminal device 3. The terminal device 3 displays the information determined to be a risky expression at the position designated by the user and its related information side by side in the auxiliary display area 63. This allows the user to immediately check not only the information determined to be a risky expression in the examination process of the examination device 1, but also information that needs to be examined as a risky expression related to the risky expression.

[0057] The auxiliary display area 63 of the first display data 60 displays information indicating the target position determined to be a risky expression, and the reason for the determination that the expression is a risky expression is acquired. Specifically, the display unit 21 acquires an identifier indicating the reason for the determination that the expression is a risky expression in the examination, which is included in the examination determination result output by the examination processing unit 17 in the above-mentioned process. The display unit 21 acquires a sentence indicating the reason for the determination that the expression is a risky expression, which is linked to the identifier and recorded in the database 104. The display unit 21 generates the first display data 60 in which the sentence is displayed in the auxiliary display area 63 and outputs the first display data 60 to the terminal device 3. Alternatively, when the terminal device 3 detects a user's operation of specifying (clicking) the position of information determined to be a risky expression and displayed in the examination target data display area 61, the terminal device 3 acquires an "identifier indicating the reason for the determination that the expression is a risky expression in the examination" from the first display data 60 and transmits a reason acquisition request including the identifier to the examination device 1. The examination device 1 may then obtain a sentence indicating the reason for determining that the expression is risky, which is recorded in the database 104 in association with the identifier included in the reason acquisition request, and send it to the terminal device 3, so that the terminal device 3 may display the document in the auxiliary display area 63.

[0058] The past performance confirmation button 64 of the first display data 60 is a button icon for obtaining and displaying the results of past inspections of the information determined to be a risky expression as a result of an inspection to determine whether the information included in the inspection target data is a risky expression or a risky expression, and the related information recorded in association with that information. By operating the mouse or the like of the terminal device 3 to press this past performance confirmation button 64, the user can display the results of past inspections of the information determined to be a risky expression as a result of an inspection to determine whether the information included in the inspection target data is a risky expression or a risky expression, and the related information recorded in association with that information.

[0059] FIG. 7 is a second diagram showing an example of display data of the examination result output by the examination device to the terminal device. FIG. 7 shows an example of the display on the terminal device 3 when the past performance confirmation button 64 shown in FIG. 6 is pressed. Specifically, the terminal device 3 detects that the past performance confirmation button 64 has been pressed. In this case, the terminal device 3 transmits to the examination device 1 a request to send past performance, which includes the information determined to be a risky expression and its related information, which is displayed in the examination target data display area 61. More specifically, in the example of FIG. 7, a request to send past performance is transmitted which includes the character string "No. 1," which has been determined to be a risky expression in specific range A of the examination target data, and the character strings "Number 1" and "Number One," which are related information related to "No. 1." The request to send past performance may include the type of examination target data included in the first display data 60 and other meta information.

[0060] The inspection device 1 acquires past performance information registered in the past performance dictionary table of the database 104 in association with the character string included in the past performance transmission request and the combination of the character string with type and meta information. The inspection device 1 transmits the past performance information to the terminal device 3. The terminal device 3 displays the past performance information in the auxiliary display area 63. The past performance information includes information determined to be a risky expression in the inspection target data and identification information of other inspection target data containing related information (content name, production company, inspection target type (advertising video / storyboard, etc.)), the judgment result for the other inspection target data (judgment result of non-risky expression (OK) or risky expression (NG)), the information that was the subject of inspection, etc.

[0061] When the past performance confirmation button 64 is pressed, the terminal device 3 may display past performance information in the auxiliary display area 63 as described above, and may also display a risk expression confirmation button 66 instead of the past performance confirmation button 64 to return the information displayed in the auxiliary display area 63 to the display of risk expression information.

[0062] FIG. 8 is a third diagram showing an example of display data of the examination result output by the examination device to the terminal device. FIG. 8 shows an example of the display on the terminal device 3 when the handbook confirmation button 65 is pressed. The handbook confirmation button 65 of the first display data 60 acquires and displays specified information related to the reason why an expression was determined to be a risky expression. An example of specified information is information contained in a handbook about risky expressions. By operating the mouse of the terminal device 3 or the like to press this handbook confirmation button 65, the user can display specified information on the reason why information determined to be a risky expression as a result of reviewing the information contained in the data to be reviewed, and related information recorded in association with that information, in the auxiliary display area 63.

[0063] Specifically, the terminal device 3 detects that the handbook confirmation button 65 has been pressed. In this case, the terminal device 3 obtains an identifier indicating the reason why the expression was determined to be risky in the examination from the information on the examination judgment result included in the first display data 60. The terminal device 3 transmits a request to send stipulated information to the examination device 1, including an identifier indicating the reason why the expression was determined to be risky. When the display unit 21 of the examination device 1 receives the request to send stipulated information, it reads the identifier indicating the reason why the expression was determined to be risky from the information. The examination device 1 obtains the stipulated information recorded in the handbook table of the database 104, linked to the identifier indicating the reason why the expression was determined to be risky. Specifically, the stipulated information may be a sentence indicating the reason why the expression was determined to be risky. The display unit 21 transmits the stipulated information to the terminal device 3. The terminal device 3 displays the stipulated information (information recorded in the handbook table) in the auxiliary display area 63.

[0064] When the handbook confirmation button 65 is pressed, the terminal device 3 may display the specified information in the auxiliary display area 63 as described above, and may also display a past performance confirmation button 64 instead of the handbook confirmation button 65 to return the information displayed in the auxiliary display area 63 to the display of past performance information.

[0065] FIG. 9 is a fourth diagram showing an example of display data of the examination result output by the examination device to the terminal device. There are cases where the user recognizes that information in the data to be examined displayed in the data to be examined display area 61 that the examination device 1 has not detected as a risky expression may contain a risky expression, or where the user wishes to leave some kind of comment about the information in the data to be examined. In such cases, the user may use the terminal device 3 to register a comment about the information and output it as document data. The user may also use the terminal device 3 to leave some kind of comment about information in the data to be examined that the examination device 1 has detected as a risky expression.

[0066] Specifically, the user uses an input means such as a mouse on the terminal device 3 to specify the information to be commented on in the data display area 61 for review. For example, the range of information to be commented on is specified by left-clicking or dragging the mouse. When the terminal device 3 detects the operation of specifying the information to be commented on in the data display area 61 for review, it displays a comment registration field (risk area registration field) in the auxiliary display area 63. The comment registration field includes an input field 631 for the information to be commented on, an input field 632 for the review range, a comment input field 633, a registration button 67, and an output button 68.

[0067] Information designated by the user as a comment registration target may be automatically input into the comment registration target information input field 631. For example, when the terminal device 3 detects a designated range of information for which the user is to register a comment, it outputs a character string included in that range to the comment registration target information input field 631. If the information designated by the user as a comment registration target is an image such as a logo, the comment registration target information input field 631 may be a field for displaying the image.

[0068] Identification information of the examination range including the information designated by the user as the target for comment registration, and identification information indicating the position of the information designated by the user may be automatically input into the examination range input field 632. For example, when the terminal device 3 detects the designation of information for the target for comment registration by the user, it identifies information related to the designated range and position (coordinates within the image and playback time) based on the examination judgment result of the examination range of the data to be examined. The terminal device 3 outputs the information related to the identified designated range and position to the examination range input field 632.

[0069] The user inputs a comment regarding the information designated by the user as the target for comment registration in the comment input field 633. The comment may be the reason why the user believes that the expression may be risky, or a comment to provide instructions to other users who create data to be examined.

[0070] The user presses the registration button 67. The terminal device 3 then saves the information displayed in the comment registration information input field 631, the examination range input field 632, and the comment input field 633 as part of the first display data 60. Alternatively, the terminal device 3 transmits the information displayed in the comment registration information input field 631, the examination range input field 632, and the comment input field 633 to the examination device 1 as registration information. The first registration unit 22 of the examination device 1 associates the registration information with an identifier of the examination target data and registers it in a storage unit such as the database 104. Note that, upon pressing the registration button 67, the terminal device 3 may display the display range of the examination target data in the examination target data display area 61 in a manner in which the information displayed in the comment input field 633 is displayed at the position within the examination target data displayed in the examination range input field 632. Alternatively, the writing unit 24 of the examination device 1 may write the information displayed in the comment input field so that it is displayed at the position of the examination target data.

[0071] Assume that the user presses the output button 68 using a mouse or the like on the terminal device 3. The terminal device 3 can output all or part of the data to be examined as document data, in a manner in which the information displayed in the comment input field 633 is displayed at the position of the data to be examined displayed in the input field 632 for the examination range.

[0072] Through the above processing, information that the inspection device 1 was unable to detect or comments about the data being inspected that other users noticed can be saved as part of the data being inspected, or saved in the inspection device 1, and also output as document data, making it easy to give appropriate instructions to the creator who will be making corrections to the data being inspected.

[0073] 10 is a fifth diagram showing an example of display data of the examination judgment result output by the examination device to a terminal device. If the user recognizes that information that the examination device 1 has not detected as a risky expression in the examination target data displayed in the examination target data display area 61 may be a risky expression, the user may be able to retrain the examination judgment model so that the information that was not detected as a risky expression is detected as a risky expression in a learning device such as the examination device 1.

[0074] Specifically, the user uses input means such as a mouse on the terminal device 3 to specify the information to be studied in the examination target data display area 61. For example, the range of information to be studied is specified by left-clicking or dragging the mouse. When the terminal device 3 detects the operation of specifying the information to be studied in the examination target data display area 61, a study information registration field is displayed in the auxiliary display area 63. The study information registration field includes an input field 634 for the study target information specified by the user, a re-learning instruction button 67, and a database check button 68.

[0075] Information designated by the user as the study target may be automatically entered into the study target information input field 634. For example, when the terminal device 3 detects the range of information designated by the user as the study target, it outputs the character string included in that range to the study target information input field 634. If the information designated by the user as the study target is an image such as a logo, the study target information input field 634 may be a field for displaying the image. If the information designated by the user as the study target is a line such as a border line displayed in the data to be examined, the study target information input field 634 may be a field for displaying information explaining the line (explanatory text such as the line thickness and type).

[0076] The user presses the re-learning instruction button 67. The terminal device 3 may then save the information displayed in the learning target information input field 634, the identifier of the test target data, and information on the test scope including the learning target information, as re-learning data. The second registration unit 23 of the examination device 1 may receive the re-learning data from the terminal device 3. The second registration unit 23 records the re-learning data in a storage unit such as the database 104. The second registration unit 23 may register re-learning information including the test target data included in the re-learning data, classification information for the test target data, information within the test target data, and one or more pieces of related information for that information. A learning device such as the examination device 1 may then re-learn using this information. The learning device may periodically accumulate re-learning data received from multiple terminal devices 3 and re-learn the examination assessment model using the re-learning data at a predetermined timing.

[0077] Before pressing the database confirmation button 68 to save the information to be learned as re-learned data, the user may check whether the information to be learned is recorded in the database of the examination device 1. Specifically, the user presses the database confirmation button 68. The terminal device 3 then sends a database confirmation request including the information displayed in the input field 634 for information to be learned to the examination device 1. The display unit 21 of the examination device 1 determines whether the information included in the database confirmation request is recorded in the learned dictionary of the database 104. The examination device 1 sends a confirmation result indicating whether it is recorded to the terminal device 3. The terminal device 3 displays the confirmation result. This allows the user to immediately check whether the information to be learned has already been learned.

[0078] 10, similar to the example screen shown in Fig. 6, the auxiliary display area 63 of the first display data 60 may display risk expression information including information determined to be a risky expression as a result of an examination to determine whether the information contained in the data to be examined is a non-risky expression or a risky expression, related information (similar information) recorded in association with that information, and the reason for determining that the information is a risky expression. The user may be able to use check boxes to specify only the information determined to be a risky expression and its related information that the user wishes to relearn.

[0079] FIG. 11 is a sixth diagram showing an example of display data of the examination result output by the examination device to a terminal device. When the examination target data is video, the examination device 1 may generate the second display data 70 shown in FIG. 10, in which the examination target data display area 71, the risk location display area 72, and the auxiliary display area 73 are displayed in the same manner as in FIGS. 6 to 9. When the examination target data is video, the second display data 70 may be provided with a scene list display field 74, as shown in FIG. 10, in which a list of videos (scene list) for each examination range of the video detected by the switching detection unit 15 of the examination device 1 is displayed. The scene list display field 74 may sequentially display a list of videos whose playback sections are divided into predetermined ranges (e.g., 1 second) of the video. When a risky expression is present in the video for each playback section displayed in the scene list display field 74, the video may be highlighted by a highlight display 741. In the scene list display field 74, a comment addition button 742 and a meta information input button 743 may be displayed.

[0080] The user can input a comment to the video for each specified scene (playback section) by pressing the comment add button 742. The user can also register meta information such as the classification (genre) of the video displayed by the data to be examined by pressing the meta information input button 743. The second display data 70, like the first display data 60, may have functions corresponding to a past performance check button 64, a handbook check button 65, a risk expression check button 66, an input field 631 for comment registration information, an input field 632 for the examination scope, a comment input field 633, a register button 67, and an output button 68. The terminal device 3 and the examination device 1 may then perform the same processing as that described for the first display data 60 in response to a user operation using the second display data 70.

[0081] Fig. 12 is a seventh diagram showing an example of display data of the inspection judgment results output by the inspection device to a terminal device. As shown in Fig. 12, the first display data 60 and the second display data 70 have several display areas (for example, display areas 121 to 126 as shown in Fig. 12). Any of the display areas may be the inspection target data display area 61, risk area display area 62, or auxiliary display area 63 described above when the inspection target data is a storyboard, or the inspection target data display area 71, risk area display area 72, auxiliary display area 73, or scene list display field 74 described above when the inspection target data is video.

[0082] The user may operate the terminal device 3 to switch the display areas displayed in the first display data 60 and the second display data 70. In this case, the terminal device 3 accepts designation of the target display area and the destination position of the display area based on the user's operation. The control unit of the terminal device 3 changes the placement of each target area based on the target display area and the destination position of the display area. In this case, the terminal device 3 may be able to change the size of the display range on the screen of each display area based on a predetermined program. The process of changing the position of the display area may be performed by the display unit 21 of the examination device 1, and the first display data 60 and second display data 70 generated based on the change may be transmitted to the terminal device 3.

[0083] FIG. 13 is a diagram showing another example of an examination system including an examination device. The examination device 1 may be communicatively connected to a transmission / reception system 8 to form an examination system 100. The transmission / reception system 8 may be a system capable of transmitting and receiving information such as messages between the examination device 1 and a user using the examination device 1. The function of the transmission / reception system 8 may be a function provided by the examination device 1. The transmission / reception system 8 transmits a transmission / reception screen 81 to the terminal device 3. The terminal device 3 displays the transmission / reception screen 81 on a display.

[0084] The user operates the terminal device 3 to register the data to be examined on the transmitting / receiving screen 81 displayed on the terminal device 3 by the transmitting / receiving system 8. The terminal device 3 then uploads the data to be examined (e.g., advertising video) to the transmitting / receiving system 8. The transmitting / receiving system 8 transmits the data to be examined to the examination device 1. The linking unit 25 of the examination device 1 receives the data to be examined. The linking unit 25 outputs the data to be examined to the acquisition unit 12. The acquisition unit 12 acquires the data to be examined. Based on the control of the control unit 11, the examination device 1 uses the data to be examined to perform the processes of the content analysis unit 13, meta information generation unit 14, switch detection unit 15, examination range detection unit 16, and examination processing unit 17 in the same manner as described above. Based on the control of the control unit 11, the examination device 1 also performs the functions of the display unit 21, first registration unit 22, second registration unit 23, and writing unit 24.

[0085] Here, the examination device 1 may generate output information and transmit it to the transmission / reception system 8, and the output information may be displayed on the transmission / reception screen 81. For example, when the linking unit 25 of the examination device 1 receives the data to be examined from the transmission / reception system 8, it generates a message indicating "upload completed" as output information and transmits it to the transmission / reception system 8. The terminal device 3 displays the message indicating "upload completed" on the transmission / reception screen 81.

[0086] Furthermore, the linking unit 25 of the examination device 3 acquires information on the completion of the examination process when the examination processing unit 17 completes the examination process. The linking unit 25 then generates a message indicating that the examination process has been completed and a URL for accessing the examination judgment results as output information, and transmits these to the transmission / reception system 8. The terminal device 3 displays, on the transmission / reception screen 81, the message indicating that the examination process has been completed and the URL for accessing the examination judgment results.

[0087] The user of the terminal device 3 may be able to access the examination result by clicking on a URL for accessing the examination result. For example, when the terminal device 3 is clicked, the terminal device 3 accesses the examination device 1 and requests the display data corresponding to the URL, and the examination device 1 sends the display data to the terminal device 3. The terminal device 3 displays the above-mentioned first display data 60 and second display data 70 on the display. The display data on the terminal device 3 may be displayed by launching a dedicated application for the terminal device 3.

[0088] The linking unit 25 of the examination device 1 generates output information indicating whether or not a risky expression exists based on the processing of the examination processing unit 17, as well as output information to notify other users, and transmits this information to the transmission / reception system 8, and the terminal device 3 may display this information.

[0089] Multiple users may access the testing device 1 using different terminal devices 3 and view the testing results for the same test target data. In this case, multiple users may share the testing results for the test target data and comments registered by a user, and proceed with the creation of the test target data. A user may set up a user group in the transmission / reception system 8, and send and receive information between the user group and the testing device 1. This may allow the creation and testing process for one test target data to be performed in cooperation between the testing device 1 and multiple users.

[0090] The above has described the testing device 3 of the present disclosure, but according to the processing of the testing device 1, even if the testing target has multiple testing ranges of different test types, it is possible to appropriately test each testing range. Furthermore, according to the processing of the testing device 1 and terminal device 3 described above, it is possible to reduce the processing effort and response time required for the process in which the user checks the testing results of the data to be tested and accepts the final testing judgment result, and for providing feedback on problems in the testing judgment result to other users.

[0091] FIG. 14 is another functional block diagram of the examination device. FIG. 15 is a diagram showing a processing flow according to another functional block diagram of the examination device. As shown in FIG. 14, the examination device 1 may include a range specifying means 141 and a display means 142. The range specifying means 141 specifies a specific range including a target position in the test target data specified by testing the test target data (step S151). The display means 142 displays one or more specific ranges that include the target position and clearly indicate the target position (step S152).

[0092] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure.

[0093] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0094] (Appendix 1) A range specifying means for specifying a specific range including a target position of information in the data to be examined, which is specified by examining the data to be examined; a display means for displaying one or more of the specific ranges including the target position and clearly indicating the target position; An examination device comprising:

[0095] (Appendix 2) The display means displays information indicated by the target position determined to be inappropriate as a result of the examination for determining whether the information included in the examination target data is appropriate or inappropriate, and related information recorded in association with the information. 1. The testing device described in Appendix 1.

[0096] (Appendix 3) The display means acquires and displays a reason why the information indicated by the target position is determined to be inappropriate. 1. A testing device as described in Appendix 1 or Appendix 2.

[0097] (Appendix 4) The display means acquires and displays the results of an examination of the information determined to be inappropriate and the related information recorded in association with the information. 1. The testing device described in Appendix 2.

[0098] (Appendix 5) The display means acquires and displays stipulation information relating to the reason why the content is determined to be inappropriate. An examination device described in any one of appendices 2 to 4.

[0099] (Appendix 6) a first registration means for registering registration information including at least information in the data to be examined, a position where the information appears in the data to be examined, and a comment related to the examination of the information; An examination device according to any one of appendices 1 to 5, comprising:

[0100] (Appendix 7) A second registration means for registering re-learning information including the examination target data, classification information of the examination target data, information in the examination target data, and one or more pieces of related information of the information; An examination device according to any one of appendices 1 to 6, comprising:

[0101] (Appendix 8) A writing means for writing a comment in each of the specific ranges is provided. An examination device according to any one of appendices 1 to 7.

[0102] (Appendix 9) The display means is an examination device described in any one of appendices 1 to 8, which switches the display area of ​​each piece of information to be displayed based on user operation.

[0103] (Appendix 10) an examination processing means for examining the examination target data when the examination target data obtained from the message transmitting / receiving device is received; an access destination transmitting means for transmitting access destination information indicating the access destination of the result of the examination to the message transmitting / receiving device; An examination device according to any one of appendices 1 to 9, comprising:

[0104] (Appendix 11) Identifying a specific range including the target position of information in the data to be examined identified by examining the data to be examined; Display one or more of the specific ranges that include the target location and clearly indicate the target location. Examination method.

[0105] (Appendix 12) As a result of the examination that determines whether the information included in the examination target data is appropriate or inappropriate, the information indicated by the target position that is determined to be inappropriate and related information that is linked to and recorded with that information are displayed. The examination method is as set out in Appendix 11.

[0106] (Appendix 13) Obtain and display the reason why the information indicated by the target location was determined to be inappropriate The examination method described in either Appendix 11 or Appendix 12.

[0107] (Appendix 14) Acquire and display the results of an examination of the information determined to be inappropriate and the related information recorded in association with that information. The examination method is as set out in Appendix 12.

[0108] (Appendix 15) Obtain and display the regulation information related to the reason for the inappropriateness The examination method described in any one of Appendix 12 to Appendix 14.

[0109] (Appendix 16) Registering registration information including at least information in the data to be examined, a position where the information appears in the data to be examined, and a comment related to the examination of the information. The examination method described in any one of Appendix 11 to Appendix 15.

[0110] (Appendix 17) Registering re-learning information including the data to be examined, classification information of the data to be examined, information within the data to be examined, and one or more pieces of related information of the information. The examination method described in any one of Appendix 11 to Appendix 16.

[0111] (Appendix 18) Write a comment for each of the specific ranges. The examination method described in any one of Appendix 11 to Appendix 17.

[0112] (Appendix 19) An examination method described in any one of appendices 11 to 18, in which the display area of ​​each piece of information to be displayed is swapped based on user operation.

[0113] (Appendix 20) When receiving the data to be inspected obtained from the message transmitting / receiving device, inspect the data to be inspected; Access destination information indicating the access destination of the examination result is transmitted to the message transmitting / receiving device. The examination method described in any one of Appendix 11 to Appendix 19.

[0114] (Appendix 21) The testing device's computer, A range specifying means for specifying a specific range including a target position of information in the data to be examined, which is specified by examining the data to be examined; a display means for displaying one or more of the specific ranges including the target position and clearly indicating the target position; A program that functions as a

[0115] (Appendix 22) The display means displays information indicated by the target position determined to be inappropriate as a result of the examination for determining whether the information included in the examination target data is appropriate or inappropriate, and related information recorded in association with the information. 21. The program described in Appendix 21.

[0116] (Appendix 23) The display means acquires and displays a reason why the information indicated by the target position is determined to be inappropriate. 21. A program according to claim 21 or 22.

[0117] (Appendix 24) The display means acquires and displays the results of an examination of the information determined to be inappropriate and the related information recorded in association with the information. 22. The program of claim 1.

[0118] (Appendix 25) The display means acquires and displays stipulation information relating to the reason why the content is determined to be inappropriate. 25. A program according to any one of appendices 22 to 24.

[0119] (Appendix 26) a first registration means for registering registration information including at least information in the data to be examined, a position where the information appears in the data to be examined, and a comment related to the examination of the information; 26. The program of any one of claims 21 to 25, comprising:

[0120] (Appendix 27) A second registration means for registering re-learning information including the examination target data, classification information of the examination target data, information in the examination target data, and one or more pieces of related information of the information; 27. The program of any one of claims 21 to 26, comprising:

[0121] (Appendix 28) A writing means for writing a comment in each of the specific ranges is provided. 28. A program according to any one of appendices 21 to 27.

[0122] (Appendix 29) 29. The program according to any one of appendices 21 to 28, wherein the display means changes the display area of ​​each piece of information to be displayed based on a user operation.

[0123] (Appendix 30) an examination processing means for examining the examination target data when the examination target data obtained from the message transmitting / receiving device is received; an access destination transmitting means for transmitting access destination information indicating the access destination of the result of the examination to the message transmitting / receiving device; 29. The program according to claim 21, wherein the program functions as follows: [Explanation of symbols]

[0124] 1. Testing device 3. Terminal device 8. Transmitting and receiving system 11 Control section 12... Acquisition part 13...Content analysis department 14. Meta information generation unit 15 Switching detection unit 16. Test range detection unit 17 Examination Department 21...Display section 22. First Registration Section 23 Second Registration Section 24 Writing section 25. Collaboration Department

Claims

1. A range specifying means for specifying a specific range including a target position of information in the data to be examined, which is specified by examining the data to be examined; a display means for displaying one or more of the specific ranges including the target position and clearly indicating the target position; An examination device comprising:

2. The display means displays information indicated by the target position determined to be inappropriate as a result of the examination for determining whether the information included in the examination target data is appropriate or inappropriate, and related information recorded in association with the information. The examination device according to claim 1.

3. The display means acquires and displays a reason why the information indicated by the target position is determined to be inappropriate. The examination device according to claim 2.

4. The display means acquires and displays the results of an examination of the information determined to be inappropriate and the related information recorded in association with the information. The examination device according to claim 3.

5. The display means acquires and displays stipulation information relating to the reason why the content is determined to be inappropriate. The examination device according to claim 4.

6. a first registration means for registering registration information including at least information in the data to be examined, a position where the information appears in the data to be examined, and a comment related to the examination of the information; The examination device according to claim 5 .

7. a second registration means for registering re-learning information including the examination target data, classification information of the examination target data, information within the examination target data, and one or more pieces of related information of the information; The examination device according to claim 6, comprising:

8. an examination processing means for examining the examination target data when the examination target data obtained from the message transmitting / receiving device is received; an access destination transmitting means for transmitting access destination information indicating the access destination of the result of the examination to the message transmitting / receiving device; The examination device according to claim 6, comprising:

9. Identifying a specific range including the target position of information in the data to be examined identified by examining the data to be examined; Display one or more of the specific ranges that include the target location and clearly indicate the target location. Examination method.

10. The testing device's computer, A range specifying means for specifying a specific range including a target position of information in the data to be examined, which is specified by examining the data to be examined; a display means for displaying one or more of the specific ranges including the target position and clearly indicating the target position; A program that functions as a

Images