Facility-related knowledge acquisition system

Abstract

Provide a quick review of facility-related knowledge. [Solution] The control device 16 of the facility-related knowledge acquisition system 10 has a representative action recognition unit 19 that recognizes the response action of the representative 1 to the questions displayed on the first display device 11 in the learning area 4 based on the digital device 13, a most popular action recognition unit 20 that recognizes the response actions made by each individual in the group including the representative 1 and accompanying persons 2 to the questions and recognizes the most popular answering action which is the majority answering action in the group 3, a correct / incorrect judgment unit 21 that judges whether the most popular answering action is correct or incorrect and stores the judgment result in the memory device 15, and a question selection unit 18 that displays questions for which the judgment result of the most popular answering action is incorrect on the second display device 14 in the review area 5.

Description

[Technical field]

[0001] The present invention relates to a facility-related knowledge acquisition system for collectively acquiring knowledge related to facilities such as waste disposal plants. [Background technology]

[0002] Facilities such as waste incineration plants hold tours for schoolchildren from time to time. In addition, efforts have been made to allow each participant in the tour to learn knowledge related to the facility (hereinafter referred to as "facility-related knowledge") through explanations by animated characters using digital devices such as a smartphone (see Patent Document 1). On the other hand, technology has been developed that allows users to experience and learn actual operating procedures using virtual reality equipment (hereinafter referred to as "VR equipment") (see Patent Document 2), and technology that allows users to easily review what they have learned at experiential facilities at home using digital devices such as computers (see Patent Document 3). Furthermore, technology has been developed that can grasp the individual gestures of multiple participants, for example, the number of people who have raised their right hands and the number of people who have raised their left hands (see Patent Document 4). Furthermore, a system has been developed in which people, characters, etc. are displayed on a display device equipped with a built-in camera, microphone, speaker, and generation AI, and the user can ask questions verbally to the display device to obtain the desired answers in a conversational format (see Patent Document 5). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2023-171091 A [Patent Document 2] JP 2019-12154 A [Patent Document 3] JP 2010-225129 A [Patent Document 4] JP 2010-239327 A [Patent Document 5] JP 2020-182092 A Summary of the Invention [Problem to be solved by the invention]

[0004] During a facility tour, when a group of multiple participants is learning about facility-related knowledge for the first time, it is desirable to restrict the use of digital devices owned by each individual participant in the group, such as mobile terminals such as smartphones and tablets. This is because participants generally have their own apps (e.g., game apps) installed on their digital devices, and if the apps are started during the tour, it may cause a situation where the participants are unable to concentrate on their studies. Therefore, when holding a tour of a facility, it is advisable to restrict the use of digital devices owned by each participant and, instead, have the organizers of the tour lend participants digital devices exclusively for learning, which do not have any apps installed that are unnecessary for learning about the facility.

[0005] Incidentally, the number of participants in a group participating in a facility tour, for example, a waste incineration plant tour, is usually as large as 30 to 40 people in the case of a tour for schoolchildren. For this reason, it is not desirable from a cost perspective to lend dedicated digital devices to all participants in a group. From the viewpoint of reducing costs, a learning format is conceivable in which only a representative selected from among multiple participants in a group is allowed to use a dedicated digital device, while the other participants, i.e., accompanying persons, observe the actions of the representative. However, in this learning format, accompanying persons cannot use dedicated digital devices, so it is difficult for accompanying persons, not only schoolchildren but also adults, to maintain concentration on their studies. Therefore, in this learning format, there is a risk that the effect of acquiring facility-related knowledge will be reduced when viewed as a whole group.

[0006] In order to effectively acquire facility-related knowledge, it is desirable to carry out appropriate review. However, it is not easy to carry out review that will quickly improve the acquisition effect of facility-related knowledge for the entire group.

[0007] Therefore, the present invention aims to provide a facility-related knowledge acquisition system that has a learning format in which a representative learns facility-related knowledge using digital devices in the learning area and accompanying persons learn facility-related knowledge without using digital devices, yet is able to maintain the concentration of the entire group of the representative and accompanying persons when learning facility-related knowledge in the learning area, and can quickly improve the effectiveness of facility-related knowledge acquisition for the entire group when reviewing the facility-related knowledge in the review area. [Means for solving the problem]

[0008] The facility-related knowledge acquisition system of the present invention is a system for a group including a representative and accompanying persons to acquire facility-related knowledge. In the study area, a first imaging device for imaging the group, a digital device used only by the representative and not by the accompanying persons, and a first display device on which at least the same content as that seen by the representative and which can be seen by at least the accompanying persons are arranged. In addition, in the review area, a second display device is arranged on which at least the same content as that seen by the representative and the accompanying persons can be seen is arranged. The system further includes a storage device that stores a plurality of preset questions related to facility-related knowledge, a plurality of explanations corresponding to the correct answers to each of the plurality of questions, and respective correct action of the representative and accompanying persons corresponding to each correct answer, and a control device.

[0009] Among these, the control device comprises a question selection unit which selects at least one question from the plurality of questions stored in the storage device and displays it on the first display device, a representative action recognition unit which recognizes the representative's answering action to the question displayed on the first display device based on the digital device, and a representative action recognition unit which recognizes the answering action performed by each individual in the group using "large body movements" to the question displayed on the first display device based on the first imaging device, and corrects the recognition based on the first imaging device based on the representative's answering action recognized by the representative action recognition unit and difference information which indicates that the representative's answering action is a different action from the "large body movements", thereby The system is equipped with at least a most common answering action recognition unit that recognizes a most common answering action that indicates the answering action performed by the most people in the entire group, a correct / incorrect judgment unit that judges the correctness of the representative's answering action and the most common answering action by comparing the representative's answering action recognized by the representative action recognition unit and the most common answering action recognized by the most common action recognition unit with correct actions stored in a storage device, and stores the results of the correct / incorrect judgment in the storage device corresponding to each question, and a correct / incorrect explanation unit that displays the results of the representative's correct / incorrect judgment on a first display device, and displays an explanation corresponding to the judgment result on the first display device or outputs it as an audio from the first display device. Then, the question selection unit causes the second display device to display, among the plurality of questions, the questions for which the result of the judgment of the most popular answering action stored in the storage device was incorrect. Effect of the Invention

[0010] According to the facility-related knowledge acquisition system of the present invention, in the learning area where the group learns facility-related knowledge, not only the representative who can answer questions using a digital device, but also accompanying persons who do not use digital devices can participate in answering questions displayed on the first display device by making "large body movements" such as gestures using the first imaging device. As a result, not only the representative but also the accompanying persons can learn the facility-related knowledge while maintaining their concentration. Furthermore, according to the facility-related knowledge acquisition system of the present invention, in the review area where the group reviews the facility-related knowledge learned in the study area, the questions posed in the study area for which the result of the judgment of the most common answering action taken by the most number of members of the group was incorrect, i.e., the questions for which the majority of the group answered incorrectly, are displayed on at least the second display device and can be answered again. In other words, the questions that the majority of the group answered incorrectly can be selectively reviewed by the entire group, thereby enabling the entire group to quickly improve their understanding of the questions.

[0011] In other words, according to the facility-related knowledge acquisition system of the present invention, while a learning format is adopted in which the representative learns facility-related knowledge using digital devices in the learning area and the accompanying persons learn facility-related knowledge without using digital devices, the concentration of the entire group can be maintained when learning facility-related knowledge in the learning area, and the effectiveness of the group as a whole in acquiring facility-related knowledge can be improved early on when reviewing the facility-related knowledge in the review area. [Brief description of the drawings]

[0012] [Figure 1] 1 is a schematic configuration diagram showing a facility-related knowledge acquisition system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, a facility-related knowledge acquisition system 10 according to an embodiment of the present invention will be described with reference to FIG. 1. The configurations shown below are merely examples, and are not intended to exclude the application of various modifications or techniques not specifically described. Each configuration shown in the embodiment can be modified in various ways without departing from the spirit of the invention. Furthermore, each configuration can be selected as necessary, or can be combined as appropriate, except for the essential constituent elements of the present invention.

[0014] The facility-related knowledge acquisition system 10 is a system for a group 3 including a representative 1 and an accompanying person 2 to acquire facility-related knowledge. Acquiring facility-related knowledge means acquiring knowledge related to a specific facility, for example, a waste disposal facility such as a waste disposal plant, a plant or company such as a power plant or a chemical plant, or even an entertainment facility such as an amusement park. If the facility is a waste disposal plant, the group 3 can acquire facility-related knowledge such as waste (garbage) separation, disposal methods for each type of waste, and the operation and role of each piece of equipment in the waste disposal plant. That is, the facility-related knowledge acquisition system 10 can be used when a group including at least one representative and one accompanying person acquires knowledge related to a certain facility. Here, as an example, a group 3 consisting of 10 people, including two representatives (1-1, 1-2) and eight accompanying persons (2-1 to 2-8), will be described as shown in Figure 1. The number of representatives and accompanying persons can be changed as appropriate, provided that each is at least one. In learning area 4 described below, all members of group 3 are restricted from using their own digital devices such as smartphones; instead, representative 1 can use a dedicated digital device 13, but accompanying person 2 cannot use said digital device. Meanwhile, in review area 5, digital device 13 is not provided to begin with, so none of the members of group 3 can use said digital device 13. However, in review area 5, there are no restrictions on the use of digital devices owned by each member of group 3.

[0015] First, the basic configuration of the facility-related knowledge acquisition system 10 will be explained, and then each component will be described in detail. The overall operation of the facility-related knowledge acquisition system 10 will become clear in the description of the control device 16 given later. First, we will explain the basic configuration of the facility-related knowledge acquisition system 10. The facility-related knowledge acquisition system 10 has at least the following components. Within the learning area 4, there are disposed a first display device 11 that displays questions on facility-related knowledge as well as correct / incorrect answers and explanations for those questions, a first imaging device 12 that images all members of group 3, namely representative 1 and accompanying person 2, and a digital device 13 that can only be used by representative 1 and not accompanying person 2. Also, within the review area 5, a second display device 14 is arranged that displays questions that have been answered incorrectly by a majority of the group 3 at least in the study area. In addition, a memory device 15 that stores multiple questions displayed on the first display device 11 and the second display device 14, explanations corresponding to the correct answers to each question, and the correct actions of the person corresponding to the correct answers to each question, and a control device 16 that exchanges various information with the above-mentioned devices and equipment arranged in the study area 4 and the review area 5, as well as the memory device 15, and controls them, are located in either the study area 4, the review area 5, or a location other than these. The exchange of various information between the control device 16 and the devices and equipment described above arranged in the study area 4 and review area 5, as well as the storage device 15, i.e., the transmission and reception of these various pieces of information, may be performed either wired or wirelessly. Information does not have to be transmitted and received directly between the control device 16 and the devices and equipment arranged in the study area 4 and review area 5, but may be transmitted and received indirectly via a communication network such as the Internet.

[0016] The learning area 4 is a specific location where all members of the group 3 gather to learn facility-related knowledge. That is, the learning area 4 is a specific location. As long as the first imaging device 12 can capture images of all members of the group 3, including the representative 1 and the accompanying person 2, the specific location may be indoors, outdoors, inside the facility, or outside the facility. For example, if the learning area 4 is a specific location, it may be a conference room or multipurpose hall within the facility, a corridor or plaza within the facility, or a specific space outside the facility, such as a school classroom or an event venue such as an exhibition. The review area 5 is a place where each of the members of the group 3, the representative 1 and the accompanying person 2, reviews the facility-related knowledge learned in the study area 4. The review area 5 may be a specific place where all the members of the group 3 gather, like the study area 4, or may be a plurality of places where each individual member of the group 3 or each group of the group 3 is dispersed in different places, unlike the study area 4. That is, the review area 5 may be a specific place or a plurality of places. For example, the review area 5 may be a conference room or a multipurpose hall in the facility, a corridor or a square in the facility, a specific space in a school classroom or an event venue such as an exhibition outside the facility, or each member's home. Furthermore, the review area 5 may be in the same place as the learning area 4. For example, after the group 3 learns facility-related knowledge in the learning area 4, the group 3 may use the same place as the learning area 4 as the review area 5 to review the facility-related knowledge learned in the learning area 4.

[0017] [About the structure of Learning Area 4] Each component will now be described in turn. First, the components of the facility-related knowledge acquisition system 10 in the learning area 4 shown in FIG. The first display device 11 is a device that receives and displays information such as questions on facility-related knowledge, correct answers, and explanations for the questions, transmitted by the control device 16 described below, and also a device that allows the representative 1 to share with the accompanying person 2 information such as images that can be viewed by the digital device 13 described below. Therefore, the first display device 11 may be any type of display device, and may be single or multiple, as long as all members of the group 3 can see the same content displayed on the digital device 13. However, if there are multiple first display devices 11, the same content is displayed on all first display devices 11 at the same time. The first display device 11 may be, for example, a display device such as a liquid crystal monitor, a screen combined with a projector, or an "air display" which has been developed in recent years. The first display device 11 may be equipped with a speaker and configured to be capable of outputting audio for reading out the questions, explanations, etc. The first imaging device 12 is a device that captures images of all members of the group 3, including the representative 1 and accompanying persons 2, and transmits the captured information to the control device 16 described below, and is, for example, a wide-angle camera or a panoramic camera. Since the first imaging device 12 needs to capture the body movements of each member of the group 3, it is desirable for it to be a video camera that captures videos or multiple still images that are consecutive in time. The microphone 17 is a device that collects the voices of the entire group 3 in the study area 4 and transmits information related to the collected voices to the control device 16 described below.

[0018] Digital devices 13 (two devices, 13-1 and 13-2 in FIG. 1) are digital devices that can be operated only by representative 1 (only two people, 1-1 and 1-2 in FIG. 1), not by accompanying person 2, among the members of group 3, and receive and display information such as the above-mentioned questions and explanations from control device 16 described below, and transmit the representative 1's response to the questions to control device 16. Digital devices 13 are lent only to representative 1, for example, by the facility manager, only when learning facility-related knowledge in learning area 4. Digital devices 13 may also be lent to representative 1 when reviewing facility-related knowledge in review area 5 described below, but in principle, digital devices 13 are not lent to any member of group 3 for such review. In addition, the representative 1 can answer the question without using the digital device 13 by having the first imaging device 12 (or the second imaging device 24 in the review area 5) capture his or her body movements, just like the accompanying person 2.

[0019] Among the above-mentioned components in the study area 4, the digital device 13 will be described in detail. The digital device 13 may be any device that is capable of transmitting information regarding the answering movements ("large body movements" and "small body movements" described below) that the representative 1 uses to answer the above-mentioned questions to the control device 16 described below. Therefore, the digital device 13 may be, for example, a tablet-type mobile terminal (hereinafter referred to as a "tablet") or a smartphone. The digital device 13 may also be a device for virtual reality, i.e., a VR device, or a device for augmented reality, i.e., an AR device. The digital device 13 may also be a device for mixed reality, i.e., an MR device, or a device for substitutional reality, i.e., an SR device. For example, in the case where representative 1 is presented with questions while experiencing VR in order to acquire facility-related knowledge, digital device 13 is a VR device, and the VR device may be (a) VR goggles only, (b) a set of VR goggles and a VR module that is operated by hand with switches, etc., or (c) a VR module only.

[0020] It is preferable that the digital device 13 is equipped with at least one of a camera, a motion sensor, or a switch in order to obtain the representative 1's answering action as information. The digital device 13 equipped with a camera and a motion sensor recognizes that the representative 1 has answered with a "large body movement" described below from the image captured by the camera and the change in acceleration detected by the motion sensor, and transmits information related to the answering action to the control device 16. Furthermore, the digital device 13 equipped with a switch recognizes that the representative 1 has answered with a "small body movement" described below from the contact of the switch with a finger (for example, touching a touch panel) or the depression of the switch with a finger, and transmits information related to the answering action to the control device 16.

[0021] Here, "large body movements" refer to movements that involve large body parts such as the arms and legs, such as raising and lowering the arms, squatting, standing up, etc. Raising the right hand or raising the left hand is also a "large body movement." On the other hand, "small body movements" are movements that do not involve large movements of large parts of the body such as the arms or legs, but rather movements that involve small parts of the body such as the fingertips, such as finger movements. Note that, here, we will proceed under the assumption that the control device 16 can recognize "large body movements" as answering movements based on the information captured by the first imaging device 12, but that the control device 16 cannot or has difficulty recognizing "small body movements" as answering movements based on the information captured by the first imaging device 12. Furthermore, if the digital device 13 is equipped with both the above-mentioned camera and switch, the representative 1 can answer using both "large body movements" and "small body movements" at the same time, which may result in contradictory answering actions. In this case, the facility-related knowledge acquisition system 10 deals with this by pre-establishing a rule, for example, to give priority to answering actions using "small body movements." In the following, for ease of explanation, it will be assumed that the answering action by the digital device 13 is not a simultaneous "large body movement" and "small body movement", but rather that only one of the answering actions is performed for a given question.

[0022] [About the structure of Review Area 5] Next, a description will be given of the configuration of the facility-related knowledge acquisition system 10 in the review area 5 shown in Fig. 1. The review area 5 in Fig. 1 is a diagram showing, as an example, a state in which all members of a group 3 are gathered and seated in a classroom in a school or the like. As mentioned above, in the review area 5, unlike the study area 4, digital devices 13 are not in principle lent to any of the members of the group 3, so there is no point in distinguishing between the representative 1 and the accompanying person 2. In other words, in this case, all of the members perform the answering action corresponding to the accompanying person in the study area 4. However, here, for the sake of convenience, the same numbers as those of the members of the study area 4 in FIG. 1 are used for the members of the review area 5.

[0023] First, the second display device 14 is a device that receives and displays information such as questions on facility-related knowledge transmitted by the control device 16 described below, at least questions asked in the learning area 4 that were answered incorrectly by a majority of the members of group 3, and the correct answers and explanations for those questions. As with the first display device 11, the second display device 14 may be any type of display device, such as an LCD monitor or an aerial display, as long as all the members of group 3 can see the same content, and may be a single or multiple device. In addition, in the study area 4, none of the members of group 3 could use their own digital devices as the first display device 11, but in the review area 5, they can use their own digital devices, such as smartphones, tablets, or laptops, as the second display device 14. In this case, unlike the first display device 11, the contents and timing of display of questions, explanations, etc. on the second display device 14 do not need to be the same, and may be different for each member. In other words, each member of group 3 can access the control device 16 using his or her own digital device and review at his or her own desired speed. The second display device 14, like the first display device 11, may be provided with a speaker and configured to be capable of outputting audio reading out the questions, explanations, and the like.

[0024] Next, like the first imaging device 12, the second imaging device 24 is a device that captures images of the members of group 3 and transmits the captured information to the control device 16 described below, and is, for example, a wide-angle or all-around video camera. In FIG. 1, the second imaging device 24 captures "large body movements" (for example, raising the right or left hand) of the upper body of all the seated members of group 3. As described above, in the review area 5, the members of group 3 can use their own digital devices, so the second imaging device 24 may be a camera built into each member's own digital device. In addition, if the study area 4 and the review area 5 are in the same location, the second display device 14 may be the first display device 11, and the second imaging device 24 may be the first imaging device 12.

[0025] [Regarding the storage device 15 and the control device 16] Next, we will explain the storage device 15 and the control device 16 provided in the facility-related knowledge acquisition system 10. As described above, the storage device 15 and the control device 16 are placed in either the learning area 4, the review area 5, or a location other than these, but if the learning area 4 is placed within the facility, it is desirable to place them in the learning area 4 or within the facility in order to facilitate management and maintenance of the facility-related knowledge acquisition system 10. First, the storage device 15 prestores at least a plurality of questions for acquiring facility-related knowledge, a plurality of explanations corresponding to the correct answers to each of the plurality of questions, and information regarding each "correct action" for each question.

[0026] Here, the "correct action" for a certain question means an answer action that corresponds to the correct answer to the question among the answer actions that the representative or accompanying person can perform. As described above, the representative 1 can answer each question with two answering actions, either a "large body movement" answering action or a "small body movement". On the other hand, the accompanying person 2 answers each question only with an answering action using "large body movements". Therefore, the storage device 15 stores in advance two correct answer actions, either a "large body movement" answering action or a "small body movement" answering action, corresponding to each question. For example, in response to the question "Which is correct, right or left?", if the correct answer is "right", the correct body movement action of "moving your arm to point to the right", which is a type of "large body movement", is pre-stored in storage device 15. In addition to this information, information on the correct body movement action of "pushing down the switch corresponding to 'right' on digital device 13" or "touching a finger to the switch corresponding to 'right' on the touch panel", which is a type of "small body movement", is pre-stored in storage device 15.

[0027] When control is performed using microphone 17, which will be described later, information regarding the voice of the word (vocabulary) corresponding to the correct action for each question (hereinafter referred to as "voice information") is stored in advance in storage device 15 in association with the correct action for that question. For example, in the case of a correct action of "pointing to the right by moving the arm," voice information of the word "right" is stored in advance in storage device 15 in association with the correct action. Similarly, in the case of a correct action of "pointing to the left by moving the arm," voice information of the word "left" is stored in advance in storage device 15 in association with the correct action.

[0028] Next, the control device 16 will be described. The control device 16 includes at least a question selection unit 18, a representative action recognition unit 19, a most popular person action recognition unit 20, a correct / incorrect determination unit 21, and a correct answer explanation unit 22. The control device 16 may further include a group voice recognition unit 23. These configurations will be explained in turn below.

[0029] [About Question Selection Section 18] The question selection unit 18 selects at least some of the questions stored in the memory device 15, and displays them on the first display device 11 and the digital device 13 in the study area 4. The question selection unit 18 may select each question sequentially in the order in which the questions are stored in the memory device 15, or may select each question randomly. In addition, the question selection unit 18 selects from the memory device 15 the questions for which the "most common answering action", which is the answering action performed by the most number of all members of group 3, was incorrect as a result of questions asked in the learning area 4, and displays the questions on the second display device 14 in the review area 5.

[0030] [About Representative Action Recognition Unit 19] First, the representative action recognition unit 19 receives information about the representative 1's answer action using "large body movements" or "small body movements" to answer the question that the question selection unit 18 has displayed on the first display device 11 in the study area 4 from the digital device 13. When there are multiple representatives 1, for example, when there are two representatives, representative 1-1 and representative 1-2 as shown in FIG. 1, the representative action recognition unit 19 receives information about each representative's answer action separately from the digital devices 13 (13-1, 13-2) used by each representative. For example, in the case of a question such as "Which is correct, right or left?", the representative action recognition unit 19 recognizes, based on the received information, what kind of response action the representative 1 made by "large body action" or "small body action", i.e., (1) whether the representative made a response action corresponding to "right", (2) whether the representative made a response action corresponding to "left", or (3) whether the representative made a response action not corresponding to "right" or "left" (for example, whether the representative made a response action corresponding to "up" or "down"). When there are multiple representatives 1, the representative action recognition unit 19 performs this recognition for each representative.

[0031] Next, the representative action recognition unit 19 transmits information regarding the recognized answer action of the representative 1 (here, information regarding any one of the above (1), (2), and (3)) to the correctness determination unit 21 described below, and also to the most numerous people action recognition unit 20 described below. When there are multiple representatives 1, the representative action recognition unit 19 transmits information regarding the recognized answer action of each representative to the correctness determination unit 21 and the most numerous people action recognition unit 20, respectively, for each representative. Here, if the recognized answering action of representative 1 is an answering action made by a "small body movement," the representative action recognition unit 19 transmits information about the recognized answering action of representative 1 (here, information about any one of (1), (2), or (3) above) together with "difference information" indicating that the answering action is not a "large body movement" to the most number of people action recognition unit 20.

[0032] [About the Largest Number of People Action Recognition Unit 20] First, the most number of people action recognition unit 20 receives the information captured by the first imaging device 12 in the learning area 4, individually recognizes the answering actions using "large body movements" of all members of the group 3, and counts the number of people who performed the specified answering action. For example, in the case of a question such as "Which is correct, right or left?", based on the information captured by the first imaging device 12, the largest-person action recognition unit 20 individually recognizes for each member of group 3 whether they (1) made an answering action corresponding to "right," (2) made an answering action corresponding to "left," or (3) made an answering action that did not correspond to "right" or "left." Now, assume that the representative 1 and the accompanying person 2 make a response action by raising their hands as a "large body movement" as shown in the learning area 4 in Fig. 1. Then, based on the information captured by the first imaging device 12, the most-populated-person action recognition unit 20 recognizes that, of all 10 members of the group 3, 6 people made a response action corresponding to "right" in (1) (i.e., the number of people corresponding to accompanying people 2-1, 2-2, 2-3, 2-4, 2-5, and 2-6 in Fig. 1), 2 people made a response action corresponding to "left" in (2) (i.e., the number of people corresponding to representative 1-2 and accompanying person 2-7 in Fig. 1), and 2 people made a response action not corresponding to "right" or "left" in (3) (i.e., the number of people corresponding to representative 1-1 and accompanying person 2-8). At this time, if there is an answering action by the representative 1-1 accompanied by "difference information", since it is not an answering action by a "large body movement", the counting result recognized by the most numerous people action recognition unit 20 based only on the information photographed by the first imaging device 12 (hereinafter referred to as "counting result based only on photographing information") will be inaccurate. In this example, in the recognition result of the most numerous people action recognition unit 20 based only on the information photographed by the first imaging device 12, the representative 1-1 is counted as being included in those who made answering actions that do not correspond to "right" or "left" in (3), which are different from the actual answering actions.

[0033] Therefore, the most numerous person action recognizing unit 20 uses the “difference information” received from the representative action recognizing unit 19 to correct the counting result recognized based only on the information related to the image capturing by the first imaging device 12 . For example, assume that at this time, the most-person action recognition unit 20 receives from the representative action recognition unit 19 an answer action (1) accompanied by “difference information” for one of the two representatives, representative 1-1 and representative 1-2 (here, representative 1-1), and an answer action (2) without “difference information” for the other representative (here, representative 1-2). Then, since the answering action of one person is accompanied by "difference information", the most numerous person action recognition unit 20 subtracts one person from the counting result for (3) among the counting results based only on the photographing information, and corrects the counting result for (3) to be (2-1)=1, which is 1 person. Also, since it is clear from the information received from the representative action recognition unit 19 that the answering action accompanied by "difference information" for the one person subtracted is the answering action of (1), the most numerous person action recognition unit 20 adds one person to the counting result for (1) among the counting results based only on the information photographed by the first imaging device 12, and corrects the counting result for (1) to be (6+1)=7, which is 7 people (i.e., the number of people corresponding to the representative 1-1 and the accompanying persons 2-1, 2-2, 2-3, 2-4, 2-5, and 2-6 in FIG. 1).

[0034] In other words, with this correction, the most common action recognition unit 20 accurately recognizes that the number of people who made the answering action corresponding to "right" in (1) was 7, the number of people who made the answering action corresponding to "left" in (2) was 2, and the number of people who made the answering action not corresponding to "right" or "left" in (3) was 1. The most popular action recognition unit 20 then compares the counting results of (1), (2), and (3) after the correction, and recognizes that the most popular answer action, which is the most common answer action among all the answer actions of all the members of group 3, is answer action (1), and transmits information about answer action (1) as the “most popular answer action” to the correctness determination unit 21 described below.

[0035] Here, in this example, the answering action of the most people is the answering action of seven people, which is the majority of the members constituting group 3, but depending on the question, for example a multiple-choice question, the answering action that is the majority in group 3 is not necessarily recognized as the answering action of the most people by most person action recognition unit 20. As a result of performing the above-mentioned correction, most person action recognition unit 20 recognizes the answering action of the most majority in group 3 as the answering action of the most people. However, there may be cases where the answering actions of all the members of group 3 are divided into multiple groups with the same number of answering actions. For example, in the above example, there may be cases where, out of the 10 members of group 3, the counting result of (1) is 5 and the counting result of (2) is 5. In this case, the most-popular-person-action recognition unit 20 may select either the answering action of (1) or (2) as the "most-popular-person answering action." As described above, the question selection unit 18 displays the questions that the "most-popular-person answering action" answered incorrectly on the second display device 14 in the review area 5 and has all the members of group 3 review them. However, compared with questions that the majority of group 3 answered incorrectly, questions that are divided into the same number of answers regardless of whether they are correct or incorrect are not given a high priority from the viewpoint of improving the effect of acquiring facility-related knowledge as a whole of group 3, and may or may not be selected as a review question.

[0036] When transmitting the most popular answering action to the correctness determining unit 21 described later, the most popular action recognizing unit 20 may also transmit "first compulsory information" linked to the most popular answering action. The "first compulsory information" is information indicating whether the "action answered by the most people" is performed by a predetermined percentage or less of the number of members of group 3, and if the percentage or less of the number of members is the predetermined percentage or less, the most common action recognition unit 20 transmits the "first compulsory information" together with information about the "action answered by the most people" to the correctness determination unit 21. Note that the question regarding the "action answered by the most people" linked to the "first compulsory information" is information indicating that the "action answered by the most people" is to be reviewed by all members of group 3 in the review area 5, regardless of whether the "action answered by the most people" was actually correct or incorrect. In this case, the most numerous action recognition unit 20 calculates the proportion of the number of people who performed the most numerous answering action in group 3 from the ratio between the number of people who performed the most numerous answering action and the total number of members constituting group 3.

[0037] As mentioned above, if the answering actions of all members of group 3 are divided equally, it may or may not be selected as a review question. However, for example, if the above-mentioned specified ratio of the “first compulsory information” is set to 50%, and assuming that, out of the 10 members of group 3, the counting results of (1) are 5 and the counting results of (2) are 5, then regardless of whether the “answering action of the most people” was actually correct or not, all members of group 3 can be made to review the question corresponding to the “answering action of the most people” in review area 5. Furthermore, for example, if the predetermined ratio is set to 70%, even if the "most popular answer action" taken by 70% of the participants is correct, it can be reviewed by all members of group 3 in review area 5. That is, when the configuration in which the most-populated-person action recognition unit 20 transmits the "first compulsory information" is adopted, the result of the group 3 acquiring facility-related knowledge can be made more solid.

[0038] During review in the review area 5, the most numerous person action recognition unit 20 receives information captured by the second imaging device 24 in the review area 5 and performs the same operations as those in the learning area 4. However, with regard to the review area 5, the most numerous person action recognition unit 20 does not receive information from the representative action recognition unit 19, and in this respect, the operations are different from those in the learning area 4.

[0039] [About the correctness check unit 21] In the learning area 4, the correctness determining unit 21 receives information regarding the representative 1's answering action recognized by the representative action recognizing unit 19 and information regarding the answering action of the most number of people recognized by the most number of people action recognizing unit 20. Then, the correctness determining unit 21 compares each of these received pieces of information with information regarding the correct action stored in the storage device 15, thereby determining whether the representative 1's answering action and the most number of people's answering action for each question are correct or incorrect, and transmits the determination result of either correct or incorrect to the correct answer explaining unit 22 described below. Furthermore, correctness judgment unit 21 stores the judgment results of the correctness of representative 1's answering action and the correctness of the most popular answering action (i.e., the judgment result of either correct or incorrect answer) in storage device 15, in association with the corresponding question. Here, control device 16 can know whether it is learning time in learning area 4 or review time in review area 5, depending on whether the judgment result is stored in storage device 15 or not. In other words, control device 16 can recognize that it is learning time when the judgment result is stored in storage device 15 for the first time, and that it is review time when the judgment result is saved by overwriting an already saved judgment result and then saved. In addition, the correctness judgment unit 21 judges the most popular answer action received along with the "mandatory information" (including not only the "first mandatory information" but also the "second mandatory information" described below) as an incorrect answer regardless of whether it is actually correct or incorrect. Furthermore, when reviewing in the review area 5, the correctness judging unit 21 performs the same operations as in the learning area 4. However, at this time, the correctness judging unit 21 does not receive information from the representative action recognizing unit 19, which is different from the operations in the learning area 4.

[0040] [About Answer Explanation Section 22] During learning in the learning area 4, the correct answer explanation unit 22 displays the judgment result of the representative 1 on the first display device 11 in the learning area 4 based on at least information on the judgment result of the answering action of the representative 1, among the information on the judgment result received or the information on the judgment result stored in the storage device 15. The correct answer explanation unit 22 may also display the judgment result on the answering action of the most people on the first display device 11. Then, the correct answer explanation unit 22 displays an explanation corresponding to the judgment result (for example, an explanation of the correct answer to the question) on the first display device 11, or outputs it as audio from a speaker or the like of the first display device 11 using a generation AI or the like. In addition, during review in the review area 5, the correct answer explanation unit 22 displays the judgment result regarding the most popular answer action and an explanation corresponding to the judgment result on the second display device 14, or outputs it as audio from a speaker or the like of the second display device 14 using a generation AI or the like.

[0041] [About the Group Voice Recognition Unit 23] The group voice recognition unit 23 receives voice information collected by the microphone 17 in the learning area 4 and words corresponding to the correct action for each question stored in advance in the storage device 15, and performs a voice analysis. For example, in the case of a question such as "Which is correct, right or left?", the collective voice recognition unit 23 has received in advance voice information, for example, "right" as a word corresponding to the correct action from the storage device 15. Then, when the collective voice recognition unit 23 receives input of voice information collected by the microphone 17 and cannot recognize voice information corresponding to "right", which is a word corresponding to the correct action, at a volume equal to or greater than a predetermined volume, it recognizes that the majority of the members of the group 3 are not confident that the answer is correct, that there is a dispute of opinion within the group 3, or that the answer is incorrect. Therefore, in this case, the collective voice recognition unit 23 transmits "second compulsory information" to the correctness determination unit 21 as information linked to information related to the most popular action transmitted by the most popular action recognition unit 20. The "second compulsory information", like the first compulsory information, is information that means that regardless of whether the "action to answer with the most people" is actually correct or not, all members of group 3 are to review it in the review area 5. Therefore, even if the "action to answer with the most people" for a certain question is correct, if the majority of members of group 3 are not confident that it is correct or if there is a dispute of opinion, all members of group 3 can be made to review it in the review area 5. That is, when the group speech recognition unit 23 is configured to transmit the "second compulsory information", the result of acquiring facility-related knowledge for group 3 can be made more solid. When the collective voice recognition unit 23 recognizes the voice information corresponding to the word “right” that corresponds to the correct action at a volume equal to or greater than a predetermined volume, it recognizes that the majority of the members of the group 3 are confident that the answer is correct. In this case, the collective voice recognition unit 23 does not transmit the “second compulsory information” to the correctness determination unit 21.

[0042] As described above, according to the facility-related knowledge acquisition system of the present invention, while a learning format is adopted in which the representative learns facility-related knowledge using digital devices in the learning area and the accompanying persons learn facility-related knowledge without using digital devices, the concentration of the entire group can be maintained when learning facility-related knowledge in the learning area, and the effectiveness of the facility-related knowledge acquisition of the entire group can be improved early on when reviewing the facility-related knowledge in the review area. In addition, the first display device 11 may be configured as a single panel-type device in which the first display device 11, the first imaging device 12, the microphone 17, and a speaker (not shown) are integrated together, and similarly, the second display device 14 may be configured as a single panel-type device in which the second display device 14, the second imaging device 24, and a speaker (not shown) are integrated together. In addition, the first display device 11 and the second display device 14 may be provided with a function for printing correct answers and explanations for each question. Furthermore, each of the first imaging device 12 and the second imaging device 24 is not limited to a single imaging device, and may be a system made up of a plurality of imaging devices. [Explanation of symbols]

[0043] 1, 1-1~1-2 Representative 2, 2-1~2―8 Accompanying Person 3. Group 4. Study Area 5 Review Area 10 Facility-related knowledge acquisition system 11 First display device 12 First imaging device 13, 13-1, 13-2 Digital devices 14 Second display device 15 Storage device 16 Control device 17. Mike 18 Question Selection Section 19 Representative action recognition unit 20 Maximum number of people motion recognition unit 21 Correctness Check Section 22 Answer Explanation Section 23 Mass Voice Recognition Unit 24 Second imaging device

Claims

1. A facility-related knowledge acquisition system for a group including a representative and accompanying persons to acquire facility-related knowledge, The learning area includes a first imaging device that images the group, a digital device that is not used by the accompanying person but is used only by the representative, and a first display device that displays at least the same content that the representative can view on the digital device and that can be viewed by at least the accompanying person. The review area has a second display device where the representative and the accompanying person can view the same content. With a storage device that stores a plurality of questions previously set regarding the facility-related knowledge, a plurality of explanations corresponding to the respective correct answers to the plurality of questions, and respective correct actions of the representative and the accompanying person corresponding to the respective correct answers; Control device and having The control device includes: a question selection unit that selects at least one question from the plurality of questions stored in the storage device and displays it on the first display device; a representative action recognition unit that recognizes an answer action of the representative to a question displayed on the first display device based on the digital device; a most-populated action recognition unit that recognizes, based on the first imaging device, each answering action performed by each individual of the group using large body movements in response to a question displayed on the first display device, and corrects the recognition based on the first imaging device based on difference information indicating that the answering action of the representative is a small body movement of the representative different from the large body movement of the representative recognized by the representative action recognition unit, thereby recognizing a most-populated answering action that indicates the answering action performed by the most number of people in the entire group; a correctness / incorrectness determination unit which determines whether the representative's answering action and the most popular answering action are correct by comparing the representative's answering action recognized by the representative action recognition unit and the most popular answering action recognized by the most popular action recognition unit with the correct actions stored in the storage device, and stores the correctness / incorrectness determination results in the storage device in correspondence with the questions, respectively; a correct answer explanation unit that displays a result of the judgment of the representative on the first display device and displays the explanation corresponding to the result of the judgment on the first display device or outputs it by voice from the first display device; Equipped with The question selection unit is a facility-related knowledge acquisition system that displays on the second display device those questions among the plurality of questions for which the result of the judgment of the most popular answer action stored in the memory device is incorrect.

2. the most-populated-person action recognition unit transmits required information indicating that the ratio of people who performed the most-populated answer action is equal to or less than a predetermined ratio to the correct / incorrect determination unit; 2. The facility-related knowledge acquisition system according to claim 1, wherein the correctness determining unit determines that the most popular answering action is incorrect when the required information is received.

3. the study area being a single location where all members of the group gather; The facility-related knowledge acquisition system of claim 2, wherein the review area is either the same location as the study area, a single location different from the study area where all members of the group gather, or a plurality of locations where each individual of the group is dispersed.

4. the review area being a single location where everyone in the group gathers; the review area further includes a second imaging device for imaging the group; the most common person action recognition unit recognizes, based on the second imaging device, each answering action performed by each individual in the group with a large body movement in response to a question displayed on the second display device by the question selection unit, thereby recognizing a most common answering action that indicates an answering action performed by the most number of people in the entire group; The correctness determining unit determines whether the most popular answering action is correct or not, The facility-related knowledge acquisition system described in claim 3, wherein the correct answer explanation unit displays the result of the correct / incorrect judgment on the second display device, and displays the explanation corresponding to the result of the judgment on the second display device or outputs it as audio from the second display device.

5. A microphone located in the study area; a group voice recognition unit that recognizes voices collected by the microphone; and The correctness determining unit is When the group voice recognition unit recognizes the word corresponding to the correct action at a volume equal to or greater than a predetermined volume, the group voice recognition unit judges whether the word is correct or incorrect based on the most popular answering action; A facility-related knowledge acquisition system as described in any one of claims 1 to 4, wherein if the collective voice recognition unit cannot recognize the words corresponding to the correct action at a volume equal to or higher than the predetermined amount, it determines that the action answered by the most people is incorrect regardless of whether it is actually correct or not.

Images