Recognition system, collective entrance device, intercom system, control method and control program

Abstract

To provide a recognition system capable of operating an intercom system without touching the numeric keys or buttons of an intercom entrance device, a collective entrance device, an intercom system including them.SOLUTION: A recognition system 100 includes: an acquisition unit 34 that acquires information about an image including a state formed by moving at least part of a person picked up by an imaging unit 11d of an entrance hall 10 included in the intercom system 1 provided in a facility; and an output unit 35 that outputs information for operating the intercom system 1 depending on the result of the recognition of at least one of the letters, numbers, or control commands indicated by the state formed by moving at least part of the person based on the information acquired by the acquisition unit 34.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to a recognition system, a collective entrance device, an intercom system, a control method, and a control program. [Background technology]

[0002] Conventionally, in apartment complexes and other multi-unit facilities, an intercom system has been widely known, which includes an intercom entrance device installed at the common entrance, multiple intercom master units installed in each dwelling unit, and a control unit that controls these devices. In the intercom system, residents can unlock the electric lock at the common entrance by entering a personal identification number using a numeric keypad installed on the intercom entrance device. Visitors can also call the dwelling unit they are visiting by entering the dwelling unit number using the numeric keypad and pressing a call button.

[0003] In an intercom system, the numeric keypad installed in the intercom entrance device is likely to be touched by many people, including residents and visitors. As a measure against the recent spread of infectious diseases, there is a demand for the ability to operate the intercom system without touching the buttons on the numeric keypad or other devices.

[0004] Patent document 1 describes an intercom device in which an indoor image recognition unit recognizes the sign language of a person inside the room based on the image recognition results, converts the sign language content into Japanese, and displays the Japanese corresponding to the sign language content on the display unit of the outdoor unit. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-254217 Summary of the Invention [Problem to be solved by the invention]

[0006] The intercom device described in Patent Document 1 recognizes sign language images and displays the corresponding Japanese words, but does not operate an intercom system.

[0007] There is a demand for an intercom system that allows visitors to unlock an electric lock or call the residence they are visiting without touching any buttons on the intercom entrance device, such as a numeric keypad.

[0008] An object of the present disclosure is to provide a numeric keypad for an intercom entrance device, a recognition system for operating the intercom system without touching buttons, a collective entrance device, and an intercom system including these. [Means for solving the problem]

[0009] The recognition system of the present disclosure is characterized by comprising an acquisition unit that acquires information regarding an image including a state formed by moving at least a part of a person captured by an imaging unit of a collective entrance device included in an intercom system installed in a collective facility, and an output unit that outputs information for operating the intercom system in accordance with at least one recognition result of a letter, number, or control command indicated by the state formed by moving at least a part of the person, based on the information acquired by the acquisition unit.

[0010] The collective entrance device according to the present disclosure is characterized by comprising an imaging unit and a control unit that controls operation in accordance with at least one recognition result of a letter, number, or control command indicated by a state formed by moving at least a part of a person, based on information about an image including a state formed by moving at least a part of the person that has been photographed.

[0011] The intercom system according to the present disclosure is characterized by including a collective entrance device and an information terminal that communicates with the collective entrance device.

[0012] The control method of the present disclosure is a control method for a collective entrance device equipped with an imaging unit, characterized in that it includes a step of controlling operation in accordance with at least one recognition result of a letter, number, or control command indicated by a state formed by moving at least a part of a person, based on information regarding an image including a state formed by moving at least a part of the person that has been photographed.

[0013] A control program according to the present disclosure is a program for realizing the above control method on a computer. [Effects of the Invention]

[0014] The recognition system, entrance device, and intercom system according to the present disclosure allow the intercom system to be operated without touching the numeric keypad or buttons on the entrance device. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a schematic diagram of an intercom system including a recognition system according to an embodiment; [Figure 2] 1 is a schematic diagram of a collective entrance device of an embodiment of the collective entrance. [Figure 3] 1 is a block diagram showing a configuration of a control device according to an embodiment; [Figure 4] FIG. 10 is a diagram illustrating an example of a hand state according to the embodiment. [Figure 5] 10A and 10B are diagrams illustrating examples of recognition assistance information of the collective entrance device of the embodiment. [Figure 6] FIG. 10 is a diagram illustrating an example of an operation flowchart of the recognition system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0016] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following description, specific shapes, materials, directions, numerical values, etc. are examples for facilitating understanding of the present disclosure and can be appropriately changed according to the application, purpose, specifications, etc. Furthermore, it is originally anticipated that the components of the embodiments and modified examples described below can be selectively combined.

[0017] The subject of the device and system of the present disclosure includes a computer. The computer executes a program to realize the functions of the subject of the device and system of the present disclosure. The computer includes, as its main hardware component, a processor that operates according to the program. The processor may be of any type, as long as it can realize the above functions by executing the program. The processor is composed of one or more electronic circuits, including an integrated circuit (IC) or a large-scale integrated circuit (LSI). The electronic circuits may be integrated into a single chip or may be provided on multiple chips. The multiple chips may be integrated into a single device or may be provided on multiple devices. The program is stored in a non-transitory storage medium, such as a computer-readable ROM, optical disk, or hard disk drive. The program may be pre-stored in the storage medium or may be supplied to the storage medium via a wide-area communication network, including the Internet.

[0018] <Intercom system> An intercom system 1 as an example of an embodiment will be described below with reference to FIGS.

[0019] Fig. 1 is a diagram schematically illustrating the configuration of an intercom system 1 according to a first embodiment. As shown in Fig. 1, the intercom system 1 is a system installed in a collective facility such as an apartment building. The intercom system 1 includes a collective entrance hall 10 installed in a common area of ​​the collective facility, a plurality of private area devices 20 installed in each dwelling unit, which is the private area, and a control device 30 that controls these devices. The collective entrance hall 10, the private area devices 20, and the control device 30 are all connected to each other so that they can communicate with each other.

[0020] The intercom system 1 may include a control room device 40 provided in a control room. The control room device 40 is communicably connected to the collective entrance device 11 and the intercom master unit 21 via the control device 30. The control room device 40 can transmit various information to the collective entrance device 11 and the multiple intercom master units 21, for example. In the example shown in FIG. 1 , the control device 30 is connected to a server 60 via a gateway 50. The gateway 50 functions as a router. The control device 30 may obtain information (including the results of arithmetic processing) necessary for controlling the intercom system 1 from the server 60.

[0021] Specific examples of collective facilities to which the intercom system 1 can be applied include apartment complexes, dormitories, company housing, and other collective housing, but collective facilities are not limited to collective housing and may also be facilities consisting of multiple facilities (multiple companies, departments, divisions, etc.) gathered together, such as offices, factories, research facilities, medical facilities, and accommodation facilities.

[0022] First, each device constituting the main entrance 10 will be described.

[0023] The common entrance 10 comprises a common entrance device 11 and a front door 12. The front door 12 includes an electric lock 14 that automatically locks the front door 12 when the front door 12 is closed. The common entrance device 11 is installed outside the front door 12. The front door 12 is, for example, an automatic door, and is basically kept locked under normal circumstances.

[0024] The collective entrance device 11 is used by visitors to call each dwelling unit. The visitor calls the dwelling unit he or she is visiting using the collective entrance device 11 and asks the resident of that dwelling unit to unlock the electric lock 14 on the front door 12. This allows the visitor to enter the inside of the collective facility through the front door 12.

[0025] The collective entrance device 11 is used by an authorized person to unlock the electric lock 14 of the front door 12. Here, the authorized person refers to a resident or a visitor who is permitted to enter the collective facility. The authorized person can unlock the electric lock 14 of the front door 12 and enter the area inside the front door 12 of the collective facility by performing a predetermined unlocking operation for the electric lock 14. For example, the authorized person can unlock the electric lock 14 of the front door 12 by inputting a predetermined number (hereinafter referred to as a PIN number) into the collective entrance device 11. Since people other than the authorized person do not know the unlocking operation, they basically cannot unlock the electric lock 14 of the front door 12 and enter the inside of the collective facility. In the present disclosure, inputting information into the collective entrance device 11 includes having an imaging unit read the state of the operator's hand or mouth and having the device acquire corresponding information. This will be described in detail below.

[0026] In the example shown in FIG. 1, the common entrance 10 further includes a contactless key detection device 15. Similar to the common entrance device 11, the contactless key detection device 15 is installed outside the front door 12. The contactless key detection device 15 is configured, for example, with an IC card reader, and when it detects a pre-registered card key, it sends an unlocking signal to the electric lock 14. This unlocks the electric lock 14 and opens the front door 12. The card key is owned by the resident or the like.

[0027] <Intercom entrance device> The collective entrance device 11 of the collective entrance 10 will be described with reference to Fig. 2. Fig. 2 is a front view of the collective entrance device 11. As shown in Fig. 2, the collective entrance device 11 includes a numeric keypad 11a, a call button 11b, a reverse master key insertion portion 11c, a camera 11d, a speaker 11e, a microphone 11f, a monitor 11g, and a sensor 11h.

[0028] In this embodiment, the collective entrance device 11 uses the camera 11d to capture an image of a state formed by the movement of at least a part of the person, such as the state of the operator's hands or mouth, in front of the collective entrance device 11. The image is then used to acquire information corresponding to the state of the operator's hands or mouth, and the intercom system 1 can perform the necessary operations based on the acquired information. The information acquired from the image of the operator's hand or mouth state is, but is not limited to, numerical information conventionally entered using the numeric keypad 11a or information indicating the pressing of the call button 11b. For example, the information may be text information containing an operation command for the intercom system 1. Note that the state formed by the movement of at least a part of the person is not limited to the state of the person's hands or mouth, but may also be represented by a gesture of the entire body, crossing arms in front of the chest, shaking the head up or down, or the number of blinks. The following description primarily focuses on the example of the state of the person's hands or mouth, but other aspects are also applicable.

[0029] The numeric keypad 11a is a user interface that can be operated by residents or visitors, and in the intercom entrance device of this embodiment, it is also possible to operate the intercom system 1 by directly operating the numeric keypad. An authorized person can unlock the electric lock 14 of the front door 12, for example, by inputting a personal identification number using the numeric keypad 11a. Also, a visitor can call the home they are visiting by inputting the dwelling unit number using the numeric keypad 11a and pressing the call button 11b. A resident or other person who has a key can also insert the key into the reverse master key insertion portion 11c to unlock the electric lock 14 of the front door 12.

[0030] The camera 11d captures an image of the operator operating the collective entrance device 11. When a visitor uses the collective entrance device 11 to call the residence they are visiting, the collective entrance device 11 captures an image of the visitor with the camera 11d and transmits the image to the private section device 20 from which the call was made. Furthermore, the collective entrance device 11 of this embodiment captures an image of the operator's hand or mouth state and transmits the image to, for example, the control device 30. The control device 30 processes the received image and calculates numbers or text information corresponding to the hand or mouth state. However, this image processing is not limited to being performed by the control device 30. For example, the collective entrance device 11 may be configured to have a processor inside it so that the calculations are performed by the collective entrance device 11. Alternatively, the image may be transmitted to the server 60 via the gateway 50, where it is processed by the server 60.

[0031] The speaker 11e and microphone 11f are used by visitors to communicate with residents via the intercom master unit 21 installed in each dwelling unit. The speaker 11e outputs a ring tone, and when a resident answers, the visitor's voice. The visitor's voice is picked up by the microphone 11f and transmitted to the private section device 20, allowing the visitor to converse with the resident they are visiting. Furthermore, when an operator operates the collective entrance device 11, the speaker 11e may output necessary information or announcements in response to the operator's operation.

[0032] The monitor 11g displays, for example, an image captured by the camera 11d. Furthermore, the common entrance device 11 of this embodiment may display information corresponding to an image captured by the camera 11d of the state of the operator's hands or mouth on the monitor 11g. For example, information corresponding to numbers or call buttons may be displayed.

[0033] The control device 30 calculates information corresponding to the state of the operator's hands or mouth from the image captured by the camera 11d. Alternatively, the common entrance device 11 may be provided with this information. Alternatively, the intercom system 1 may not be provided with this information, and the image data may be analyzed by an external system. In this case, the intercom system 1 has a means for communicating with the external system.

[0034] The camera 11d can operate as the imaging section in the present disclosure. The imaging section may also be configured with an imaging device installed separately from the camera 11d.

[0035] The sensor 11h detects that the operator is in front of the collective entrance device 11. The camera 11d and the sensor 11h may function in conjunction with each other, and when the sensor 11h detects the operator, the camera 11d may capture an image of the operator even before the operator operates the numeric keypad 11a. As will be described later, when the operator performs an operation based on the state of their hands or mouth, the camera 11d captures an image of the state of their hands or mouth. The timing to start capturing this image can be obtained by the sensor 11h. In the present disclosure, the hand state refers to a hand shape associated with a number or letter. FIG. 4 shows examples of hand shapes corresponding to the numbers 0 to 9, but the present invention is not limited to this. Similarly, the mouth state refers to a mouth shape associated with a number or letter.

[0036] The electric lock 14 on the front door 12 is unlocked by entering information associated with a facility included in the complex or an intercom device installed in the facility. An authorized person can unlock the electric lock 14 on the front door 12 by entering a personal identification number into the collective entrance device 11. The unlocking operation is performed by making a hand or mouth shape that represents the number corresponding to the personal identification number and having the camera 11d read it. In this case, the read number information may be displayed on the monitor 11g, or an asterisk (*) may be displayed to obscure the content. The personal identification number may be freely set to any combination of numbers, numbers, or letters.

[0037] 3 is a block diagram showing the configuration of the control device 30. As shown in FIG. 3, the control device 30 includes a processor 31 that executes arithmetic processing for controlling the intercom system 1 and a memory 32 that stores a control program and the like. The control device 30 is a device that comprehensively controls the intercom system 1 and is communicatively connected to the common entrance device 11, the intercom master unit 21, the management room device 40, and the like, receives signals from each device to acquire various information, and outputs control signals to each device to control each device. The control device 30 is also communicatively connected to the intercom slave unit 22 via the intercom master unit 21. As described above, the control device 30 may also be connected to the server 60 via the gateway 50.

[0038] The control device 30 includes a processing unit 33 that, in response to a call from a visitor, calls the intercom master unit 21, unlocks the electric lock 14 of the front door 12, and so forth. The processing unit 33 is configured to call a predetermined intercom master unit 21 when a call operation is performed on the collective entrance device 11, and to output an unlock signal to the electric lock 14 based on the operation of the intercom master unit 21. When the unlock signal is output to the electric lock 14, the electric lock 14 of the front door 12 is unlocked. The processing unit 33 also executes a call to the intercom master unit 21 when the call button 22a of the intercom slave unit 22 is operated.

[0039] The control device 30 further includes an acquisition unit 34 and an output unit 35. The acquisition unit 34 inputs an image captured by the camera 11d (imaging unit) of the common entrance device 11 and performs computational processing to obtain information corresponding to a state formed by at least a part of a person's movement, such as the state of the person's hands or mouth, included in the image. The output unit 35 outputs information for operating the intercom system in accordance with the recognition result of the characters, numbers, or control commands indicated by the state formed by at least a part of a person's movement, based on the information acquired by the acquisition unit 34. The recognition result of the characters, numbers, or control commands indicated by the state formed by at least a part of a person's movement specifically includes information on a PIN number entered by an authorized person to unlock an electric lock, and information on a room number and a call button for a visitor to call the residence of the person they are visiting. The intercom system 1 receives the output from the output unit 35 and performs the unlocking operation or the call operation in the same way as when the numeric keypad 11a or the call button 11b is operated.

[0040] The control device 30 is configured by a computer including a processor 31. The memory 32 is configured by, for example, RAM, ROM, a hard disk, etc., and is built into the computer including the processor 31. The control device 30 may be configured by one computer or by multiple computers.

[0041] 3 do not necessarily have to be implemented in a single device. The components of the control device 30 may be distributed across multiple devices connected via a network. In this case, the components operate in cooperation with each other via the network to act as a single control device 30 in the intercom system 1.

[0042] <Recognition System> Next, the operation of the recognition system 100 included in the intercom system 1 or the common entrance 10 of the present disclosure will be described with reference to Fig. 5. Fig. 5 is also the common entrance device 11, which operates in cooperation with the recognition system 100.

[0043] The recognition system 100 of the present disclosure includes an acquisition unit 101 that acquires information about an image captured by an imaging unit (camera 11d) of a collective entrance 10 included in an intercom system 1 installed in a collective facility, the image including a state formed by moving at least a part of a person, and an output unit 102 that outputs information for operating the intercom system 1 in accordance with the recognition result of a character, number, or control command indicated by the state formed by moving at least a part of the person, based on the information acquired by the acquisition unit 101. The information for operating the intercom system is, for example, but is not limited to, a PIN number for unlocking an electric lock or a call room number for a visitor to call the residence of the person they are visiting.

[0044] The information about the image acquired by the acquisition unit 101 of the recognition system 100 of the present disclosure may be configured to include the results of arithmetic processing performed by the server 60. Alternatively, it may include the results of processing performed by the control device 30 of the intercom system 1.

[0045] <Notification of recognition results> The recognition system 100 may include a notification unit 104 for notifying the recognition result of an image including a state formed by moving at least a part of a person, such as the state of a person's hands or mouth. Specifically, the recognition result of an image including a state formed by moving at least a part of a person may be displayed on the monitor 11g of the common entrance device 11. For example, when an operator indicates a corresponding number with the state of their hand, the recognition result is displayed on the monitor 11g, allowing the operator to confirm whether the input indicated by the hand state is correct. If the recognition result is correct, the operator can continue inputting. If the displayed recognition result is different from the intended content, the operator can cancel the input and cancel the previously entered number. This cancel operation may also be performed with the hand. When unlocking a resident's electric lock, displaying a PIN code can cause problems, so the initial state may display a "*" or similar symbol to obscure the input content and indicate that the recognition system 100 has recognized the input. In this embodiment, the monitor 11g corresponds to the notification unit 104.

[0046] Alternatively, the speaker 11e may output a voice message to notify the operator of the recognition result for an image including a state formed by moving at least a part of a person. That is, when the operator, for example, indicates a corresponding number with the shape of his or her hand, the speaker 11e may output the recognition result as a voice message, allowing the operator to confirm whether the input indicated by the hand shape is correct. If the recognition result is correct, the operator can continue inputting. If the displayed recognition result differs from the intended content, the operator can cancel the input and remove the previously entered number. This cancellation operation may also be input by the hand movement. When a resident unlocks an electric lock, since issuing a PIN code can cause problems, the initial state is not output as a voice message from the speaker 11e, but is instead displayed on the monitor 11g, or only "*" is displayed. In this embodiment, the monitor 11g and the speaker 11e correspond to the notification unit 104.

[0047] <Change recognition target settings> The recognition system 100 is designed to be able to recognize both the state of a person's hands and the state of their mouth, for example, but a setting unit may be provided to change the recognition target to either the hands or the mouth. The recognition target is configured to be set, for example, from the control room device 40. This is to prevent the recognition target from being easily changed. However, the common entrance device 11 may be provided with a numeric keypad 11a or special keys to change the recognition target.

[0048] Furthermore, while the recognition results are typically in Japanese, they may be configured to be changed to other languages, such as English. While this is often not an issue when recognizing numbers, it is preferable that the recognition results be displayed in a language the operator can understand when displaying text guidance or instructions. While the display language for the recognition results may be set from the control room device 40, it may be preferable for the operator to be able to change the language directly at the collective entrance device 11. Therefore, a numeric keypad 11a or a dedicated key for changing the recognition language may be provided on the collective entrance device 11 to allow for this change. The recognition language setting may be configured to reset to the initial recognition language if no operation is performed for a predetermined period of time after the change. The key for changing the recognition target setting or the key for changing the recognition language setting may be changed not by a physical key, but by input created by moving at least a part of the person.

[0049] <Presenting cognitive support information> The collective entrance device 11 of this embodiment may be provided with a presentation unit 106 that presents auxiliary information for recognition. It is anticipated that an operator, such as a visitor, may not know how to input information due to a state formed by at least a portion of the person's movement in the system. In this case, the collective entrance device 11 may prompt the operator to input information by voice, for example, from the speaker 11e. Alternatively, an example of a hand state may be displayed on the monitor 11g, and the speaker 11e may prompt the operator to input information according to the display on the monitor 11g. Furthermore, a picture representing a hand state may be engraved or attached to the numeric keypad 11a or the call button 11b. This makes it easy to confirm the hand state required for inputting the corresponding numeric keypad 11a or the call button 11b. Figure 5 shows an example of the auxiliary information for recognition corresponding to the numbers on the numeric keypad 11a. A diagram of the corresponding hand state is displayed next to the number on the numeric keypad 11a. In this embodiment, the numeric keypad 11a corresponds to the presentation unit 106.

[0050] <Providing guidance information> Furthermore, the auxiliary information displayed by the collective entrance device 11 on the display unit 106 may include information for guiding the user to perform the recognition operation. In some cases, the positional relationship between the operator and the camera 11d is inappropriate, making it impossible to recognize the corresponding letters or numbers from an image containing a state formed by at least a portion of the person moving. This can occur for various reasons, including the operator being too far from the camera 11d or being outside the camera's 11d imaging range. In such cases, the operator must approach the camera 11d directly in front of it. Therefore, a message can be displayed on the display unit or a sound can be emitted from the speaker 11e to encourage the operator to approach the center of the monitor 11g. Alternatively, a message can be displayed or a sound can be emitted from the speaker 11e to simply inform the user that the operation could not be recognized. Furthermore, a fixed message can be displayed in a visible position on the collective entrance device 11, encouraging the operator to approach the monitor 11g directly in front of it and perform the operation. Figure 5 shows an example of guidance information displayed on the monitor 11g. In this embodiment, the speaker 11e and the monitor 11g correspond to the display unit 106.

[0051] An example of an operation flowchart of the recognition system 100 is shown in FIG.

[0052] When the sensor 11h of the common entrance device 11 detects an operator (S11), the camera 11d is activated and starts capturing an image of the front of the common entrance device 11 (S12). The camera 11d periodically captures images of the front. The camera 11d may automatically correct its position so that the operator is within the capturing range.

[0053] Next, camera 11d transmits the captured image to control device 30 (S13). Upon receiving the image from camera 11d, control device 30 performs image analysis (S14), and acquisition unit 34 acquires information corresponding to a state formed by moving at least a part of the person included in the image (S15). Output unit 35 outputs information for operation to intercom system 1 according to the recognition result of the characters or numbers indicated by the information acquired by acquisition unit 34 (S16).

[0054] The image analysis may be configured to be executed by the processor 31 of the control device 30, or may be configured to be processed by the server 60. In image analysis, information corresponding to a single image alone may not be meaningful, so the image analysis is performed on the states formed by sequentially moving at least a part of the person, and when the information becomes meaningful, the acquisition unit 34 acquires the information.

[0055] It should be noted that the present invention is not limited to the above-described embodiment and its modifications, and various changes and modifications are possible within the scope of the claims of this application. [Explanation of symbols]

[0056] 1 intercom system, 10 common entrance, 11 common entrance device, 11a numeric keypad, 11b call button, 11c reverse master key insertion unit, 11d camera, 11e speaker, 11f microphone, 11g monitor, 11h sensor, 12 entrance door, 14 electric lock, 15 non-contact key detection device, 20 exclusive area device, 21 intercom master unit, 22 intercom slave unit, 22a call button, 30 control device, 31 processor, 32 memory, 33 processing unit, 34 acquisition unit, 35 output unit, 40 management room device, 50 gateway, 60 server, 100 recognition system, 101 acquisition unit, 102 output unit, 103 imaging unit, 104 notification unit, 105 setting unit, 106 presentation unit

Claims

1. an acquisition unit that acquires information about an image including a state formed by moving at least a part of a person captured by an imaging unit of a collective entrance device included in an intercom system installed in the collective facility; an output unit that outputs information for operating the intercom system in accordance with a recognition result of a character, number, or control command that is indicated by a state formed by moving at least a part of the person, based on the information acquired by the acquisition unit; the state formed by moving at least a part of the person includes at least one selected from the group consisting of a state of the person's hand, a gesture of the whole body, a movement of crossing arms in front of a chest, a movement of nodding / shaking head, and a blink; A recognition system in which the information for operating the intercom system includes information regarding a call that designates a predetermined information terminal included in the intercom system.

2. the information for operating the intercom system includes information for unlocking an electric lock controllable from the intercom system; The recognition system of claim 1 .

3. the information for operating the intercom system includes information for causing a notification unit of the public entrance device to notify information related to the recognition result; 3. A recognition system according to claim 1 or 2.

4. a setting unit that sets a recognition target for a character, a number, or a control command that is indicated by a state formed by moving at least a part of the person; The recognition system according to any one of claims 1 to 3.

5. The recognition target includes a recognition language. The recognition system of claim 4.

6. An imaging unit; a control unit that controls an operation in accordance with a recognition result of at least one of a letter, a number, or a control command indicated by a state formed by moving at least a part of the person, based on information about an image including the state formed by moving at least a part of the captured person; The state formed by moving at least a part of the person includes at least one selected from the group consisting of a state of the person's hand, a gesture of the whole body, a movement of crossing arms in front of the chest, a movement of nodding / shaking the head, and a blinking movement.

7. a presentation unit that presents auxiliary information for obtaining the recognition result by sound or display; The collective entrance device according to claim 6.

8. the auxiliary information includes information for guiding an action to obtain the recognition result; The collective entrance device according to claim 7.

9. The collective entrance device according to any one of claims 6 to 8, an information terminal that communicates with the collective entrance device; An intercom system comprising:

10. A control method for a collective entrance device equipped with an imaging unit, controlling an operation in accordance with at least one of a recognition result of a character, a number, or a control command indicated by a state formed by moving at least a part of the person, based on information about an image including the state formed by moving at least a part of the person captured; A control method in which the state formed by moving at least a part of the person includes at least one selected from the group consisting of a state of the person's hand, a gesture of the entire body, a movement of crossing arms in front of the chest, a movement of nodding / shaking the head, and a blink.

11. A control program for implementing the control method according to claim 10 on a computer.

Images