Switching control system, switching device, and switching control method

Abstract

The opening / closing control system is an opening / closing control system that controls the opening and closing of an object to be opened / closed, and includes a recognition unit that recognizes an opener / closer who performs an opening / closing action on the object to be opened / closed, an output control unit that performs output control to output notification content to the opener / closer in accordance with the opener / closer recognized by the recognition unit, and a lock control unit that performs lock control to lock or unlock the object to be opened / closed in accordance with the opener / closer recognized by the recognition unit.

Description

[Technical field]

[0001] The present disclosure relates to a switching control system, a switching device, and a switching control method. [Background technology]

[0002] In recent years, a system has become known that provides information such as advice and warnings to users who open and close doors to allow items to be put in and taken out, or users to enter and exit, for example, from the perspective of education and danger avoidance (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2004-78304 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the above-mentioned conventional system, information such as advice and caution is provided to the opener who performs the opening and closing action, and it is difficult to appropriately manage the opening and closing action of the opener.

[0005] The present disclosure has been made to solve the above problems, and its purpose is to provide an opening and closing control system, an opening and closing device, and an opening and closing control method that can appropriately manage the opening and closing actions of an opener while providing information according to the opener performing the opening and closing action. [Means for solving the problem]

[0006] In order to solve the above problem, one aspect of the present disclosure is an opening / closing control system for controlling the opening and closing of an opening / closing object, the system including: a recognition unit that recognizes an opening / closing person who performs an opening / closing action on the opening / closing object; an output control unit that performs output control to output a notification content to the opening / closing person according to the opening / closing person recognized by the recognition unit; and a lock control unit that performs lock control to control unlocking or locking the opening / closing object according to the opening / closing person recognized by the recognition unit. The output control unit performs the output control based on the notification content according to the personality of the object to be opened or closed or the lock, which is a personality set in correspondence with the opener / closer, and the lock control unit performs the lock control according to the personality. It is an opening and closing control system. One aspect of the present disclosure is an opening / closing control system for controlling the opening and closing of an opening / closing object, the system including: a recognition unit that recognizes an opening / closing person who performs an opening / closing action on the opening / closing object; an output control unit that performs output control to output a notification content for the opening / closing person according to the opening / closing person recognized by the recognition unit; a lock control unit that performs lock control to control unlocking or locking of the opening / closing object according to the opening / closing person recognized by the recognition unit; and a determination unit that performs a notification determination to determine the notification content and a lock determination to determine unlocking control or locking control of the opening / closing object according to the opening / closing person. The output control unit performs the output control based on the alarm determination, and the lock control unit performs the lock control in response to the lock determination, and the alarm determination includes a first alarm determination for determining a first alarm content and a second alarm determination for determining a second alarm content different from the first alarm content, and when the recognition unit re-recognizes the opener / closer after the output control unit outputs an alarm based on the first alarm content, the determination unit performs the second alarm determination, and the output control unit outputs an alarm based on the second alarm content. Moreover, one aspect of the present disclosure is an opening / closing control system for controlling the opening and closing of an opening / closing object, the opening / closing control system including: a recognition unit that recognizes an opener / closer who performs an opening / closing action with respect to the opening / closing object; an output control unit that performs output control to output a notification content for the opener / closer in accordance with the opener / closer recognized by the recognition unit; a lock control unit that performs lock control to unlock or lock the opening / closing object in accordance with the opener / closer recognized by the recognition unit; a judgment unit that performs a notification judgment to determine the notification content in accordance with the opener / closer and a lock judgment to determine the unlock control or lock control for the opening / closing object; and a model memory unit that stores a learned model that is learned for each locking status of the opening / closing object and that determines the notification content for each locking status of the opening / closing object, wherein the output control unit performs the output control based on the notification judgment, the lock control unit performs the lock control in accordance with the lock judgment, and the judgment unit performs the notification judgment for each locking status of the opening / closing object based on the learned model stored in the model memory unit.

[0007] Further, one aspect of the present disclosure is an opening / closing device that controls the opening and closing of an opening / closing object, the opening / closing device including a recognition unit that recognizes an opening / closing person who performs an opening / closing action on the opening / closing object, an output control unit that performs output control to output a notification content to the opening / closing person according to the opening / closing person recognized by the recognition unit, and a lock control unit that performs lock control to control unlocking or locking the opening / closing object according to the opening / closing person recognized by the recognition unit. The output control unit performs the output control based on the notification content according to the personality of the object to be opened or closed or the lock, which is a personality set in correspondence with the opener / closer, and the lock control unit performs the lock control according to the personality. It is an opening and closing device. One aspect of the present disclosure is an opening / closing control system for controlling the opening and closing of an opening / closing object, the system including: a recognition unit that recognizes an opening / closing person performing an opening / closing action on the opening / closing object; an output control unit that performs output control to output notification content for the opening / closing person in accordance with the opening / closing person recognized by the recognition unit; a lock control unit that performs lock control to control unlocking or locking of the opening / closing object in accordance with the opening / closing person recognized by the recognition unit; and a determination unit that performs notification determination to determine the notification content in accordance with the opening / closing person and lock determination to determine unlocking control or locking control of the opening / closing object. The output control unit performs the output control based on the alarm determination, and the lock control unit performs the lock control in response to the lock determination, and the alarm determination includes a first alarm determination for determining a first alarm content and a second alarm determination for determining a second alarm content different from the first alarm content, and when the recognition unit re-recognizes the opener / closer after the output control unit outputs an alarm based on the first alarm content, the determination unit performs the second alarm determination, and the output control unit outputs an alarm based on the second alarm content. Moreover, one aspect of the present disclosure is an opening / closing control system for controlling the opening and closing of an opening / closing object, the opening / closing control system including: a recognition unit that recognizes an opener / closer performing an opening / closing action with respect to the opening / closing object; an output control unit that performs output control to output a notification content for the opener / closer in accordance with the opener / closer recognized by the recognition unit; a lock control unit that performs lock control to unlock or lock the opening / closing object in accordance with the opener / closer recognized by the recognition unit; a judgment unit that performs a notification judgment to determine the notification content in accordance with the opener / closer and a lock judgment to determine the unlock control or lock control for the opening / closing object; and a model storage unit that stores a learned model that is learned for each locking status of the opening / closing object and that determines the notification content for each locking status of the opening / closing object, wherein the output control unit performs the output control based on the notification judgment, the lock control unit performs the lock control in accordance with the lock judgment, and the judgment unit performs the notification judgment for each locking status of the opening / closing object based on the learned model stored in the model storage unit.

[0008] Another aspect of the present disclosure is an opening / closing control method for an opening / closing control system that controls the opening and closing of an opening / closing object, in which a recognition unit recognizes an opener who performs an opening / closing action on the opening / closing object, an output control unit performs output control to output a notification content to the opener / closing object according to the opener / closing object recognized by the recognition unit, and a lock control unit performs lock control to lock or unlock the opening / closing object according to the opener / closing object recognized by the recognition unit. The output control unit performs the output control based on the notification content according to the personality of the object to be opened or closed or the lock, which is a personality set in correspondence with the opener / closer, and the lock control unit performs the lock control according to the personality. This is an opening and closing control method. One aspect of the present disclosure is an opening / closing control method for an opening / closing control system that controls the opening and closing of an opening / closing object, in which a recognition unit recognizes an opener / closer who performs an opening / closing action on the opening / closing object, an output control unit performs output control to output notification content for the opener / closer in accordance with the opener / closer recognized by the recognition unit, a lock control unit performs lock control to control unlocking or locking the opening / closing object in accordance with the opener / closer recognized by the recognition unit, and a determination unit performs a notification determination to determine the notification content in accordance with the opener / closer, and a lock determination to determine unlocking control or locking control for the opening / closing object. the output control unit performs the output control based on the notification determination, and the lock control unit performs the lock control in response to the lock determination, the notification determination including a first notification determination for determining a first notification content and a second notification determination for determining a second notification content different from the first notification content, and when the recognition unit re-recognizes the opener / closer after the output control unit outputs a notification based on the first notification content, the determination unit performs the second notification determination, and the output control unit outputs the notification based on the second notification content. Moreover, one aspect of the present disclosure is an opening / closing control method for an opening / closing control system that controls the opening and closing of an opening / closing object, in which a recognition unit recognizes an opener / closer who performs an opening / closing action with respect to the opening / closing object, an output control unit performs output control to output notification content for the opener / closer in accordance with the opener / closer recognized by the recognition unit, a lock control unit performs lock control to control unlocking or locking of the opening / closing object in accordance with the opener / closer recognized by the recognition unit, and a determination unit performs notification determination to determine the notification content and lock determination to determine unlocking control or lock control of the opening / closing object in accordance with the opener / closer, the opening / closing control system is a trained model learned for each locking status of the opening / closing object, and includes a model storage unit that stores the trained model that determines the notification content for each locking status of the opening / closing object, the output control unit performs the output control based on the notification determination, the lock control unit performs the lock control in accordance with the lock determination, and the determination unit performs the notification determination for each locking status of the opening / closing object based on the trained model stored in the model storage unit. Effect of the Invention

[0009] According to the present disclosure, it is possible to appropriately manage the opening and closing actions of an opener while providing information according to the opener performing the opening and closing action. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a conceptual diagram showing an overview of an opening and closing control system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of the installation of an electronic lock in the opening / closing control system according to the present embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of the structure of an electronic lock in the present embodiment. [Figure 4] 2 is a block diagram showing an example of an electronic lock in the present embodiment. FIG. [Diagram 5] 1 is a first diagram showing an example of data in a scenario storage unit in this embodiment. FIG. [Figure 6] FIG. 2 is a second diagram showing an example of data in the scenario memory unit in this embodiment. [Figure 7] 4 is a flowchart showing an example of the operation of an electronic lock in the present embodiment. [Figure 8] FIG. 2 is a conceptual diagram showing an overview of additional services of the opening and closing control system in this embodiment. [Figure 9] 1 is a configuration diagram showing an example of an opening / closing control system according to an embodiment of the present invention; [Figure 10] FIG. 2 is a block diagram showing an example of a mobile terminal according to the present embodiment. [Figure 11] 5 is a diagram showing an example of data in a user information storage unit in the present embodiment. FIG. [Figure 12] 13 is a diagram showing an example of data of target setting information in a lock setting storage unit in this embodiment. FIG. [Figure 13] A figure showing an example of data of lock setting information in a lock setting memory unit in this embodiment. [Figure 14] A figure showing an example of data of scenario setting information in a lock setting memory unit in this embodiment. [Figure 15] A figure showing an example of data in a lock log storage unit in this embodiment. [Figure 16] 11A and 11B are diagrams showing examples of screen displays for lock setting in the opening / closing control system according to the present embodiment. [Figure 17] FIG. 2 is a block diagram showing an example of an application server according to the present embodiment. [Figure 18] FIG. 2 is a block diagram showing an example of an SNS server in the present embodiment. [Figure 19] FIG. 2 is a block diagram showing an example of a distribution server according to the present embodiment. [Figure 20] 1 is a first diagram showing an example of data in a distribution information storage unit in the present embodiment. FIG. [Figure 21] FIG. 2 is a second diagram showing an example of data in the distribution information storage unit in this embodiment. [Figure 22] 11A to 11C are diagrams illustrating examples of screen displays in a distribution process of the opening and closing control system according to the present embodiment. [Diagram 23] FIG. 2 is a block diagram illustrating an example of a management server according to the present embodiment. [Figure 24] FIG. 4 is a diagram showing an example of the operation of the opening and closing control system according to the present embodiment. [Diagram 25] FIG. 4 is a diagram showing an example of a learning process of the opening and closing control system according to the present embodiment. [Figure 26] FIG. 2 is an explanatory diagram illustrating the hardware configuration of each device in the opening and closing control system according to the present embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an opening / closing control system, an opening / closing device, and an opening / closing control method according to an embodiment of the present disclosure will be described with reference to the drawings.

[0012] FIG. 1 is a conceptual diagram showing an overview of an opening and closing control system 100 according to this embodiment. As shown in Fig. 1, in the opening / closing control system 100 according to the present embodiment, an electronic lock 1 is installed on an object to be opened or closed, such as a refrigerator O1, and when the electronic lock 1 recognizes an opener who opens or closes the object, it outputs various "admonishing" notification contents (e.g., speech contents) according to the opener. Also, the electronic lock 1 controls the locking or unlocking of the electronic lock 1 according to the opener. It should be noted that "outputting the notification content" includes output by sound, display, light, and the like.

[0013] The opening / closing control system 100 outputs notification content and controls the locking or unlocking of the electronic lock 1, for example, from the standpoint of education, danger avoidance, behavior suppression, and support. Here, "education" refers to, for example, a case where desirable behavior related to an object to be opened or closed is notified, regardless of whether the electronic lock 1 is locked or unlocked. Or, "education" refers to, for example, a case where desirable behavior related to an object to be opened or closed or the contents of the object to be opened or closed is notified, regardless of whether the electronic lock 1 is locked or unlocked. In addition, "danger avoidance" refers to cases where the electronic lock 1 is forcibly locked because opening and closing the door may pose a danger to children.

[0014] "Behavior restraint" refers to cases where the electronic lock 1 is forcibly locked, mainly for adults, for health reasons, etc. "Support" refers to cases where a notification is output to help or assist with education, danger avoidance, behavior restraint, etc.

[0015] For example, when a child between 0 and 3 years old approaches the refrigerator O1, the opening / closing control system 100 outputs a warning such as "It's dangerous, don't touch it," and forcibly locks the electronic lock 1. This prevents the child from opening the refrigerator O1, and by repeatedly hearing the warning, the child can understand the danger.

[0016] Also, for example, when a child between 3 and 12 years old approaches the refrigerator O1, the opening and closing control system 100 outputs a notification such as "You can only have one ice cream a day," or "If you eat now, you won't be able to eat dinner," and does not forcibly lock the electronic lock 1. This encourages the child to improve his or her eating behavior voluntarily by listening to the repeated "admonitions."

[0017] Next, an example of installation of the electronic lock 1 of the opening / closing control system 100 according to this embodiment will be described with reference to FIG. FIG. 2 is a diagram showing an example of installation of the electronic lock 1 of the opening and closing control system 100 according to this embodiment.

[0018] In the example shown in FIG. 2, electronic locks 1 (1-1a to 1-1c and 1-2) are installed at each opening and closing point of a refrigerator O1. Electronic locks 1-1a, 1-1b, and 1-1c are installed at opening and closing locations of drawers such as the vegetable compartment, freezer compartment, and ice compartment of refrigerator O1, and control the opening and closing (locking or unlocking) of these opening and closing locations.

[0019] Moreover, the electronic lock 1-2 is installed on the main door of the refrigerator O1 and controls the opening and closing (locking or unlocking) of the door. In this embodiment, electronic lock 1-1a, electronic lock 1-1b, and electronic lock 1-1c, and electronic lock 1-2 will each be described as electronic lock 1 when referring to any electronic lock provided in opening / closing control system 100, or when no particular distinction is made between them.

[0020] Furthermore, the electronic locks 1-1a, 1-1b, and 1-1c have the same configuration, and when there is no need to distinguish between their installation locations, they will be described as electronic lock 1-1.

[0021] Moreover, the electronic lock 1 is an example of an opening / closing device that controls the opening and closing of an object to be opened and closed (for example, a refrigerator O1). Note that the object to be opened and closed is not limited to the refrigerator O1, but may be an opening and closing location such as a home appliance, furniture, home equipment (for example, a window, a door), a room, a store, etc. Moreover, the electronic lock 1 is configured to be detachable from the object to be opened and closed (for example, a refrigerator O1).

[0022] Next, the configuration of the electronic lock 1 will be described with reference to FIG. Fig. 3 is a diagram showing an example of the structure of the electronic lock 1 in this embodiment. As an example, Fig. 3 illustrates the configuration and locking mechanism of the electronic lock 1-1.

[0023] As shown in FIG. 3, the electronic lock 1-1 includes a lock unit 14, a power source 15, a communication unit 111, an imaging unit 112, an output unit 113, a processor P1, and a memory M1.

[0024] The lock unit 14 is a lock mechanism that opens and closes (locks or unlocks) the electronic lock 1-1. The lock unit 14 includes a plate 141, a rotating shaft 142, a protrusion 143, a lock bolt 144, and a drive unit 145.

[0025] Plate 141 is a metal plate that can be rotated by rotating shaft 142, and when the object to be opened and closed is closed, it is fixed by protrusion 143. Furthermore, by rotating about rotating shaft 142, plate 141 comes off protrusion 143, making it possible to open the object to be opened and closed.

[0026] Furthermore, the plate 141 is in a rotatable state when the electronic lock 1-1 is in an unlocked state, and is in a non-rotatable state by the lock bolt 144 when the electronic lock 1-1 is in a locked state.

[0027] The lock bolt 144 is driven by a drive unit 145, and when the electronic lock 1-1 is in a locked state, the lock bolt 144 fixes the plate 141 to make it unrotatable. When the electronic lock 1-1 is in an unlocked state, the lock bolt 144 releases the fixation of the plate 141 to make it rotatable.

[0028] The drive unit 145 is constituted by, for example, an actuator, and drives the lock bolt 144 under the control of a processor P1, which will be described later. The power source 15 is, for example, a battery, and supplies power to each component of the electronic lock 1-1. The power source 15 is configured to be removable, and the electronic lock 1-1 is configured to be in an unlocked state during battery replacement (when no power is being supplied).

[0029] The communication unit 111 is, for example, a communication module for a wireless LAN (Local Area Network), Bluetooth (registered trademark), etc. The communication unit 111 communicates with a mobile terminal 2 (FIG. 9) described later.

[0030] The imaging unit 112 is, for example, a camera having a CCD (Charge Coupled Device) image sensor, etc. The imaging unit 112 captures an image for recognizing a person who opens and closes the door. The output unit 113 is, for example, a speaker, and outputs various sounds including notification contents.

[0031] The processor P1 is, for example, a processing circuit including a CPU (Central Processing Unit). The processor P1 executes various processes of the electronic lock 1-1 by executing programs stored in an internal memory (not shown) or a memory M1.

[0032] The memory M1 is, for example, a storage device such as a RAM, a flash memory, or a HDD, and stores various information and programs used by the electronic lock 1-1, etc. The memory M1 may be a removable flash memory card.

[0033] Next, the functional configuration of the electronic lock 1 in this embodiment will be described with reference to FIG. FIG. 4 is a block diagram showing an example of the electronic lock 1 in this embodiment.

[0034] As shown in Figure 4, the electronic lock 1 of the opening / closing control system 100 according to this embodiment includes a lock unit 14, a power source 15, a communication unit 111, an imaging unit 112, an output unit 113, a lock setting memory unit 121, a scenario memory unit 122, a model memory unit 123, a collected information memory unit 124, a log memory unit 125, a setting update unit 131, an information collection unit 132, a recognition unit 133, a judgment unit 134, an output control unit 135, and a lock control unit 136.

[0035] The configurations of the lock unit 14, power supply 15, communication unit 111, imaging unit 112, and output unit 113 have been described with reference to Fig. 3 above, and therefore will not be described here. Note that the power supply 15, communication unit 111, imaging unit 112, and output unit 113 are included in the input / output module I1.

[0036] Moreover, the lock setting storage unit 121, the scenario storage unit 122, the model storage unit 123, the collected information storage unit 124, and the log storage unit 125 are storage units realized by the above-mentioned memory M1.

[0037] The lock setting storage unit 121 stores setting information of the electronic lock 1. The lock setting storage unit 121 stores, for example, as setting information of the electronic lock 1, setting scenario information, target person information of the opener, and information of the opener target to be locked, etc.

[0038] The scenario storage unit 122 stores scenario information for determining the contents of the notification to be output by the electronic lock 1 and for determining lock control. Here, an example of data in the scenario storage unit 122 will be described with reference to Figs. 5 and 6.

[0039] Fig. 5 and Fig. 6 are diagrams showing examples of data in the scenario storage unit 122 in this embodiment. Fig. 5 shows the notification content and the lock control scenario when the lock unit 14 is in an unlocked state. Fig. 6 shows the notification content and the lock control scenario when the lock unit 14 is in a locked state.

[0040] As shown in Figure 5, the scenario memory unit 122 stores, in association with each other, a scenario ID (SID), a condition, an unlocked state output (first output), a locking judgment, and a post-locking output (second output) as scenario information when the lock unit 14 is in an unlocked state.

[0041] Here, SID is identification information for identifying a scenario, and conditions include a detection subject, a position / speed, a date and time, and a sensing result. A detection subject indicates an opener / closer, which is a recognition target. Detection subjects include specific targets such as infants (preschoolers) and children (elementary school students), as well as alcoholics, dementia patients, visually impaired people, and hearing impaired people. In the sensing results shown in FIG. 5, "interest" indicates that a behavior showing interest, such as approaching an open / closed object, has been detected.

[0042] The unlocked state output (first output) indicates learned model information for determining the notification contents when the electronic lock 1 is in the unlocked state. In addition, the unlocked state output (first output) is set with information indicating "no output" when the notification contents are not to be output.

[0043] The lock determination indicates the result of determination as to whether or not the lock unit 14 is to be locked. Moreover, the post-locking output (second output) indicates learned model information for determining the notification content after the electronic lock 1 is locked.

[0044] For example, in the example shown in Figure 5, when electronic lock 1 is in an unlocked state, the scenario information for SID "1001" indicates that when a small child (preschool child) approaches within 1 meter (meter) of the object to be opened and closed without being accompanied by an adult, the notification content determined using "Model Ma111" is output and lock unit 14 is locked, and further, after locking, the notification content determined using "Model Ma121" is output.

[0045] Also, as shown in FIG. 6, the scenario memory unit 122 stores, in association with each other, a scenario ID (SID), a condition, a locked state output (third output), an unlocking judgment, and an output after unlocking (fourth output) as scenario information when the lock unit 14 is in a locked state.

[0046] Here, the SID and conditions are the same as those in FIG. The locking status output (third output) indicates learned model information for determining the notification content when the electronic lock 1 is in the locked state. The locking status output (third output) is set with information indicating "no output" when the notification content is not to be output.

[0047] The unlocking determination indicates the result of the determination as to whether or not the lock 14 should be unlocked. Moreover, the post-unlocking output (fourth output) indicates learned model information for determining the notification content after the electronic lock 1 is unlocked.

[0048] For example, in the example shown in Figure 6, when the electronic lock 1 is in a locked state, the scenario information with a SID of "1001" indicates that when a small child (preschool child) accompanied by an adult approaches within 1 meter of the object to be opened and closed, the notification content determined using "Model Ma111" is output and the lock 14 is unlocked, and further, no notification content is output after the lock is unlocked.

[0049] Returning to the explanation of Fig. 4, the model storage unit 123 stores, for example, trained model information (face recognition model, etc.) for recognizing an opener / closer from an image captured by the imaging unit 112, other sensing information, etc. The model storage unit 123 also stores trained model information (alarm determination model) for determining the above-mentioned alarm content. The model storage unit 123 stores, for example, a model ID (an example of model identification information) and each piece of trained model information in association with each other.

[0050] The model storage unit 123 also stores a trained model (notification decision model) that is trained for each locking status of the opening / closing target and determines the notification content for each locking status of the opening / closing target. Here, the locking status of the opening / closing target includes, for example, an unlocked state of the lock unit 14, a state after the lock unit 14 is changed from the unlocked state to the locked state (post-locked state), a locked state of the lock unit 14, and a state after the lock unit 14 is changed from the locked state to the unlocked state (post-unlocked state). The model storage unit 123 stores trained models (notification decision models) corresponding to each of these four statuses.

[0051] The collected information storage unit 124 stores image data captured by the imaging unit 112 and various types of sensing information acquired from other devices via the communication unit 111. The log storage unit 125 stores history information on openers / closers (locked persons) recognized by the electronic lock 1, output notifications, and lock determinations (lock controls) in association with date and time information.

[0052] The setting update unit 131, the information collection unit 132, the recognition unit 133, the judgment unit 134, the output control unit 135, and the lock control unit 136 are functional units realized by having the processor P1 execute programs stored in the built-in memory (not shown) or in the memory M1.

[0053] The setting update unit 131 updates the lock setting information, scenario information, and model information based on information acquired from outside via the communication unit 111. The setting update unit 131 performs update processing such as adding, changing, and deleting the setting information of the electronic lock 1 stored in the lock setting storage unit 121 based on the acquired information. Also, the setting update unit 131 performs update processing such as adding, changing, and deleting the scenario information stored in the scenario storage unit 122 based on the acquired information. Also, the setting update unit 131 performs update processing such as adding, changing, and deleting the model information stored in the model storage unit 123 based on the acquired information.

[0054] The information collecting unit 132 collects image data captured by the imaging unit 112 and various sensing information acquired from other devices via the communication unit 111. The information collecting unit 132 stores the collected image data and various sensing information in the collected information storage unit 124. The information collected by the information collecting unit 132 is used to recognize the person who opened and closed the refrigerator. The information collected by the information collecting unit 132 may also include, for example, images acquired by an external home appliance such as an air conditioner, information acquired by a human presence sensor, and information detected about the contents or state of the refrigerator O1.

[0055] The recognition unit 133 recognizes an opener / closer who performs an opening / closing action on an open / close target. The recognition unit 133 recognizes the opener / closer from the collected information stored in the information collection unit 132, for example, by using learned model information (such as a face recognition model) for recognizing the opener / closer stored in the model storage unit 123. The recognition unit 133 may identify the opener / closer, as well as recognize attribute information such as the age and height of the opener / closer.

[0056] Furthermore, the recognition unit 133 may recognize the person who opens and closes the door by combining image data captured by the imaging unit 112 with various types of sensing information acquired from other home electrical appliances.

[0057] The determination unit 134 performs notification determination (e.g., speech determination) to determine notification content according to the opener / closer recognized by the recognition unit 133, and lock determination to determine unlock control or lock control for the open / close target. The determination unit 134 performs notification determination and lock determination based on the setting information of the electronic lock 1 stored in the lock setting storage unit 121.

[0058] For example, the determination unit 134 acquires scenario information set as setting information of the electronic lock 1 from the scenario storage unit 122, and when a condition included in the scenario information is satisfied, determines the notification content using a trained model stored in the model storage unit 123. Furthermore, the determination unit 134 determines lock control based on the scenario information.

[0059] The judgment unit 134 can perform notification judgment and lock judgment according to various situations by changing the set scenario information according to the setting information of the electronic lock 1.

[0060] For example, the determination unit 134 performs a notification determination and a lock determination according to the personality set in association with the opener by changing the scenario information according to the setting information of the electronic lock 1. Here, the set personality is, for example, a personality such as calm, bullish, liking / disliking the opener / closer, etc. The determination unit 134 determines the notification content according to the set personality by using a trained model included in the set scenario information.

[0061] Furthermore, as shown in Fig. 5, when the target for opening and closing is in an unlocked state, the determination unit 134 may determine whether or not to perform lock control as a lock determination. Furthermore, as shown in Fig. 6, when the target for opening and closing is in a locked state, the determination unit 134 may determine whether or not to perform unlock control as a lock determination depending on whether or not an unlocking condition is satisfied. Examples of the unlocking condition include the passage of a specific time period, the presence of another accompanying person such as an adult in the vicinity of the opener / closer, such as the presence of the accompanying person in the home, and the like. Note that whether or not the accompanying person is nearby may be determined in conjunction with, for example, the operation history or scheduling function of the accompanying person's smartphone. In addition, the determination unit 134 may perform a notification determination for each locking state of the opening / closing target based on the learned model stored in the model storage unit 123.

[0062] In addition, the determination unit 134 determines the notification contents to deter or warn the opening and closing action according to the recognized opening and closing person by setting the scenario information for each opening and closing person (detection subject) using the setting information of the electronic lock 1. For example, when the opening and closing person is an infant, a child, or an alcoholic, the determination unit 134 determines the notification contents to deter or warn the opening and closing action according to each opening and closing person.

[0063] Furthermore, the determination unit 134 may determine whether to make an alarm determination or a lock determination according to the recognized opener / closer by setting scenario information for each opener / closer (detector) using the setting information of the electronic lock 1. For example, the determination unit 134 may make an alarm determination or a lock determination if the opener / closer is a child, but may not make an alarm determination or a lock determination if the opener is an adult.

[0064] Furthermore, the determination unit 134 may determine the content of the notification depending on the object to be opened and closed or the contents held by the object to be opened and closed by changing the setting information of the electronic lock 1. The determination unit 134 changes the content of the notification depending on, for example, whether the object to be opened and closed is the refrigerator O1 or a balcony window. The determination unit 134 may also change the content of the notification to a child depending on, for example, whether ice cream is stored in the refrigerator O1 (object to be opened and closed).

[0065] Furthermore, the determination unit 134 may determine the content of the notification according to the state of the opening and closing action against the target by changing the setting information of the electronic lock 1. For example, when the acceleration or speed of the opening and closing is high, the determination unit 134 may issue a notification that the refrigerator O1 is "ouch" to prevent rough handling, or may issue a notification to caution the way of opening and closing. Furthermore, the determination unit 134 may issue a notification to caution a child who leaves the refrigerator O1 open to close the refrigerator O1.

[0066] Furthermore, the determination unit 134 may change the scenario information according to the setting information of the electronic lock 1, and may further perform the following determinations (a1) to (a4).

[0067] (a1) The determination unit 134 performs a first notification determination, and when the recognition unit 133 recognizes the opener / closer again after the output control unit 135 described later outputs a notification based on the first notification content, the determination unit 134 performs a second notification determination different from the first notification determination. This example is a case where the electronic lock 1 issues a warning to the opener / closer based on the first notification content, and then outputs a different notification (second notification content) depending on the behavior of the opener / closer after the warning.

[0068] (a2) The determination unit 134 performs a first lock determination, and the lock control unit 136, which will be described later, performs lock control based on the first lock determination, and then performs a second lock determination when the recognition unit 133 recognizes the opener / closer again. This example is a case where the electronic lock 1 first leaves the door unlocked, issues a warning, and then performs control to lock the door after the warning.

[0069] (a3) The determination unit 134 performs a second lock determination and a second notification determination based on the re-recognized open / closer and the result of the first notification determination. This example is a case where the determination unit 134 performs a lock determination and a notification determination based on the contents of the warning and the behavior of the open / closer after the warning, for example, after giving a warning once.

[0070] (a4) The determination unit 134 performs a lock determination according to the position where the recognized opener / closer touched the open / close object, the approaching speed of the opener / closer, or the date and time information when the opener / closer was recognized. This example is a case where the determination unit 134 performs a further lock determination and notification determination when the opener / closer approaches even after warning the opener once. In addition, it includes a case where the determination unit 134 performs a second lock determination to lock and a second notification determination to notify the reason for locking when the recognized opener / closer touches the open / close object (for example, refrigerator O1) again, and a case where the lock determination and notification determination are changed according to the time period or the day of the week.

[0071] The output control unit 135 performs output control to output a notification to the open / close person based on the notification content determined by the determination unit 134. That is, the output control unit 135 performs output control to output the notification content to the open / close person according to the open / close person recognized by the recognition unit 133. As the output control, for example, the output control unit 135 causes the output unit 113, which is a speaker, to output a sound based on the notification content. Note that the output control unit 135 may cause the display unit to output display content (for example, a message) based on the notification content, assuming that the output unit 113 includes a display unit.

[0072] The lock control unit 136 performs lock control to control unlocking or locking according to the lock determination. That is, the lock control unit 136 performs lock control to control unlocking or locking of the opening / closing target according to the opening / closing person recognized by the recognition unit 133. The lock control unit 136 controls the drive unit 145 of the lock unit 14 to fix the plate 141 with the lock bolt 144 to make it unrotatable, thereby setting the electronic lock 1 in a locked state. The lock control unit 136 also controls the drive unit 145 of the lock unit 14 to release the fixation of the plate 141 with the lock bolt 144, thereby setting the plate 141 in a rotatable state, thereby setting the electronic lock 1 in an unlocked state.

[0073] Next, the operation of the electronic lock 1 in this embodiment will be described with reference to FIG. FIG. 7 is a flowchart showing an example of the operation of the electronic lock 1 in this embodiment.

[0074] 7, the electronic lock 1 is first set to an unlocked state (step S101). The lock control unit 136 of the electronic lock 1 controls the lock unit 14 to set the electronic lock 1 to an unlocked state as an initial state.

[0075] Next, the recognition unit 133 of the electronic lock 1 determines whether or not a person (opener / closer) is detected (step S102). The recognition unit 133 determines whether or not a person (opener / closer) is detected based on information collected by the information collection unit 132 (e.g., image data captured by the imaging unit 112, etc.). If the recognition unit 133 detects a person (opener / closer) (step S102: YES), the process proceeds to step S103. If the recognition unit 133 does not detect a person (opener / closer) (step S102: NO), the process returns to step S102.

[0076] In step S103, the recognition unit 133 executes an identification process. For example, the recognition unit 133 executes a process of identifying and recognizing the detected open / close person by using a face recognition model stored in the model storage unit. Note that, when the recognition unit 133 detects multiple people, it identifies and recognizes the open / close person and the accompanying person, respectively.

[0077] Next, the determination unit 134 of the electronic lock 1 performs an output determination (output determination of the unlocked state) (step S104). The determination unit 134 refers to the scenario information set in the lock setting storage unit 121 from the scenario storage unit 122 according to the opener / closer recognized by the recognition unit 133, and performs a notification determination to determine the content of the notification as an output determination (output determination of the unlocked state) based on the set scenario information.

[0078] Next, the determination unit 134 performs a lock determination (step S105). The determination unit 134 performs a lock determination as to whether or not to perform lock control based on the set scenario information.

[0079] Next, the output control unit 135 of the electronic lock 1 determines whether or not to output a notification (step S106). The output control unit 135 determines whether or not to output a notification (e.g., sound) based on the result of the notification determination. If the output control unit 135 determines that a notification (e.g., sound) is to be output (step S106: YES), the process proceeds to step S107. If the output control unit 135 determines that a notification (e.g., sound) is not to be output (step S106: NO), the process proceeds to step S108.

[0080] In step S107, the output control unit 135 performs a first output control (output of an unlocked state). The output control unit 135 causes the output unit 113 to output a sound in the unlocked state based on the notification content of the notification determination. After the process of step S107, the output control unit 135 advances the process to step S108.

[0081] In addition, in step S107, the output of the unlocked state output by the output control unit 135 is, for example, the notification output determined by the judgment unit 134 based on the notification determination model set to the unlocked state output (first output) in the scenario information shown in Figure 5.

[0082] Furthermore, in step S108, the lock control unit 136 determines whether or not to lock. The lock control unit 136 determines whether or not to lock the electronic lock 1 based on the result of the lock determination. If the lock control unit 136 determines to lock the electronic lock 1 (step S108: YES), the lock control unit 136 advances the process to step S109. If the lock control unit 136 determines not to lock the electronic lock 1 (step S108: NO), the lock control unit 136 returns the process to step S102.

[0083] In step S109, the lock control unit 136 performs lock control. The lock control unit 136 controls the lock unit 14 to change the electronic lock 1 from an unlocked state to a locked state.

[0084] Next, the output control unit 135 performs the second output control (output after locking) (step S110). The output control unit 135 causes the output unit 113 to output a sound after locking based on the notification content of the notification determination. Before the process of step S110, the output control unit 135 may perform an output determination process for determining whether or not to output, similar to the above-mentioned step S106.

[0085] In addition, in step S110, the post-locking output output by the output control unit 135 is, for example, the notification output determined by the judgment unit 134 based on the notification determination model set to the post-locking output (second output) in the scenario information shown in Figure 5.

[0086] Next, the recognition unit 133 executes an identification process (step S111). The recognition unit 133 executes a re-recognition process for identifying and recognizing the detected open / close person, for example, by using a face recognition model stored in the model storage unit.

[0087] Next, the determination unit 134 performs an output determination (output determination of the locked state) (step S112). The determination unit 134 refers to the scenario information set in the lock setting storage unit 121 from the scenario storage unit 122 according to the opener / closer re-recognized by the recognition unit 133, and performs a notification determination to determine the content of the notification as an output determination (output determination of the locked state) based on the set scenario information.

[0088] Next, the determination unit 134 performs a lock determination (step S113). The determination unit 134 performs a lock determination as to whether or not to perform unlock control based on the set scenario information.

[0089] Next, the output control unit 135 determines whether or not to output a notification (step S114). The output control unit 135 determines whether or not to output a notification (e.g., sound) based on the result of the notification determination. If the output control unit 135 determines that a notification (e.g., sound) is to be output (step S114: YES), the output control unit 135 advances the process to step S115. If the output control unit 135 determines that a notification (e.g., sound) is not to be output (step S114: NO), the output control unit 135 advances the process to step S116.

[0090] In step S115, the output control unit 135 performs a third output control (output of the locked state). The output control unit 135 causes the output unit 113 to output a sound in the locked state based on the notification content of the notification determination. After the process of step S115, the output control unit 135 advances the process to step S116.

[0091] In step S115, the locking status output by the output control unit 135 is, for example, the notification output determined by the judgment unit 134 based on the notification determination model set to the locking status output (third output) in the scenario information shown in Figure 6.

[0092] Furthermore, in step S116, the lock control unit 136 determines whether or not to unlock. The lock control unit 136 determines whether or not to unlock the electronic lock 1 based on the result of the lock determination. If the lock control unit 136 determines that the electronic lock 1 is to be unlocked (step S116: YES), the lock control unit 136 advances the process to step S117. If the lock control unit 136 determines that the electronic lock 1 is not to be unlocked (step S116: NO), the lock control unit 136 returns the process to step S111.

[0093] In step S117, the lock control unit 136 performs unlocking control. The lock control unit 136 controls the lock unit 14 to change the electronic lock 1 from the locked state to the unlocked state.

[0094] Next, the output control unit 135 determines whether to output a notification (for example, sound) after unlocking based on the result of the notification determination. If the output control unit 135 determines that a notification (for example, sound) after unlocking is to be output (step S118: YES), the output control unit 135 advances the process to step S119. If the output control unit 135 determines that a notification (for example, sound) after unlocking is not to be output (step S118: NO), the output control unit 135 returns the process to step S102.

[0095] In step S119, the output control unit 135 performs a fourth output control (output after unlocking). The output control unit 135 causes the output unit 113 to output a sound after unlocking based on the notification content of the notification determination. After the process of step S119, the output control unit 135 returns the process to step S102.

[0096] In addition, in step S119, the post-unlocking output output by the output control unit 135 is, for example, the notification output determined by the judgment unit 134 based on the notification determination model set to the post-unlocking output (fourth output) in the scenario information shown in Figure 6.

[0097] 7, the electronic lock 1 may perform the identification process and the output determination process again before the process of step S110. Also, the electronic lock 1 may perform the identification process and the output determination process again before the process of step S117.

[0098] Next, additional services of the opening and closing control system 100 in this embodiment will be described with reference to the drawings. FIG. 8 is an image diagram showing an overview of additional services of opening and closing control system 100 in this embodiment.

[0099] As shown in FIG. 8, in the opening / closing control system 100 according to this embodiment, the electronic lock 1 can be periodically removed from the object to be opened / closed (refrigerator O1) to charge the battery of the power supply 15.

[0100] In addition, the electronic lock 1 makes it possible to check the history of the open / close actions of the opener / closer, for example, using a mobile terminal 2 described below, and can download the most appropriate "prompts" (alert content) depending on usage conditions.

[0101] Next, a configuration example of the opening and closing control system 100 according to this embodiment including additional services will be described with reference to FIG. FIG. 9 is a configuration diagram showing an example of an opening and closing control system 100 according to this embodiment.

[0102] As shown in FIG. 9, the opening and closing control system 100 includes an electronic lock 1, a mobile terminal 2, an application server 3, an SNS server 4, a distribution server 5, and a management server 6. The application server 3, the SNS server 4, the distribution server 5, and the management server 6 are connected to a network NW. The mobile terminal 2 can be connected to the network NW via a base station BS.

[0103] The mobile terminal 2 is, for example, a mobile terminal device such as a smartphone or a tablet terminal. The mobile terminal 2 communicates with the communication unit 111 of the electronic lock 1 by executing a management app (application program) for the electronic lock 1. The mobile terminal 2 performs lock settings for the electronic lock 1 and acquires log information on opening and closing control from the electronic lock 1. The mobile terminal 2 can display and check the log information acquired from the electronic lock 1.

[0104] In addition, the mobile terminal 2 executes a dedicated application for the electronic lock 1, thereby connecting to the application server 3, the SNS server 4, the distribution server 5, and the management server 6 via the network NW. The mobile terminal 2 transmits log information of opening and closing control to the application server 3, and also obtains reports and articles of incorporation from the application server 3.

[0105] In addition, the mobile terminal 2 acquires various model information, scenario information, setting information, voice data, etc. from the distribution server 5. The mobile terminal 2 transmits the information acquired from the distribution server 5 to the electronic lock 1 and uses it to set the electronic lock 1.

[0106] Here, the configuration of the mobile terminal 2 will be described with reference to FIG. FIG. 10 is a block diagram showing an example of the mobile terminal 2 in this embodiment.

[0107] As shown in FIG. 10, the mobile terminal 2 includes a communication unit 211, an input unit 212, an output unit 213, an imaging unit 214, a sensor unit 215, an application memory unit 221, a user information memory unit 222, a lock setting memory unit 223, a lock log memory unit 224, an application control unit 231, a user information management unit 232, a lock setting unit 233, a lock log acquisition unit 234, and a display control unit 235.

[0108] The communication unit 211, the input unit 212, the output unit 213, the imaging unit 214, and the sensor unit 215 are included in an input / output module I2.

[0109] The communication unit 211 is a communication module for mobile communication, wireless LAN, Bluetooth (registered trademark), etc. The communication unit 211 communicates with the electronic lock 1, and connects to the network NW via a base station BS, for example, by mobile communication. The communication unit 211 communicates with the application server 3, the SNS server 4, the distribution server 5, and the management server 6 via the network NW.

[0110] The input unit 212 is an input device such as a keyboard, a touch screen, a button, etc. The input unit 212 accepts various input information in response to an operation by a user. The input unit 212 is used when setting the electronic lock 1.

[0111] The output unit 213 is, for example, a display unit such as a liquid crystal display, a speaker, etc. The output unit 213 is used to output the setting screen of the electronic lock 1, log information, and the like.

[0112] The imaging unit 214 is a camera having a CCD image sensor, etc. The imaging unit 214 is capable of acquiring various types of image information. The sensor unit 215 is, for example, an acceleration sensor, and detects various types of sensor information.

[0113] The application storage unit 221, the user information storage unit 222, the lock setting storage unit 223, and the lock log storage unit 224 are storage units realized by the memory M2. The memory M2 is, for example, a storage device such as a RAM, a flash memory, or a HDD, and stores various types of information and programs used by the mobile terminal 2.

[0114] The application storage unit 221 stores the program of the management application for the electronic lock 1 and usage information. The user information storage unit 222 stores, for example, user information that is information about a user who uses the electronic lock 1. Here, an example of data in the user information storage unit 222 will be described with reference to FIG.

[0115] FIG. 11 is a diagram showing an example of data in the user information storage unit 222 in this embodiment. 11, the user information storage unit 222 stores, for example, a user ID, user information, and a lock ID in association with each other. Here, the user ID is user identification information that identifies the user of the lock ID. In addition, the user information includes, for example, basic information (for example, name, address, email, etc.), SNS information, and billing information.

[0116] The SNS information is, for example, information related to the SNS, such as the group to which the user belongs, follower information, etc. The billing information is, for example, billing information such as the usage fee for the management application, additional scenarios, model information, and additional services.

[0117] Returning to the explanation of Fig. 10, the lock setting storage unit 223 stores information related to the lock setting set in the electronic lock 1 using the management application. The lock setting storage unit 223 stores, for example, information as shown in Figs. 12 to 14.

[0118] FIG. 12 is a diagram showing an example of data of the target user setting information of the lock setting storage unit 223 in this embodiment. As shown in Fig. 12, the lock setting storage unit 223 stores, for example, a lock ID, a target ID, a target of care, a care type, and a care policy in association with each other as target of care setting information. Here, the target ID is, for example, identification information for identifying the opener, and the target of care is a parent, a caregiver, etc. who manages (takes care of) the opener. The type of care is, for example, child care, nursing care, alcoholism support, etc. The care policy is, for example, strict, kind, etc.

[0119] FIG. 13 is a diagram showing an example of data of the lock setting information in the lock setting storage unit 223 in this embodiment. 13, the lock setting storage unit 223 stores, as lock setting information, for example, a lock ID, a lock target, a target ID, and a scenario ID in association with each other. Here, the lock target is information indicating an object to be opened and closed on which the electronic lock 1 is installed, such as a refrigerator, a balcony window, etc.

[0120] FIG. 14 is a diagram showing an example of data of scenario setting information in the lock setting storage unit 223 in this embodiment. As shown in Figure 14, the lock setting memory unit 223 stores, for example, a scenario ID, a condition, an unlocked state output, a locking judgment, a post-locking output, a locked state output, an unlocking judgment, and a post-unlocking output in association with each other as scenario setting information.

[0121] Returning to the explanation of Fig. 10, the lock log storage unit 224 stores lock log information. An example of data in the lock log storage unit 224 will now be explained with reference to Fig. 15. FIG. 15 is a diagram showing an example of data in the lock log storage unit 224 in this embodiment.

[0122] 15, the lock log storage unit 224 stores log information that associates, for example, a lock ID, a lock target, a date and time, a scenario, a detection subject, a position and speed, an output type, an output content, and an opening and closing. Here, the output content is a notification content. Also, the opening and closing indicates the lock control history of the locking or unlocking of the electronic lock 1.

[0123] Returning to the explanation of Figure 10, the application control unit 231, the user information management unit 232, the lock setting unit 233, the lock log acquisition unit 234, and the display control unit 235 are functional units realized by causing the processor P2 to execute programs stored in the built-in memory (not shown) or the memory M2.

[0124] The processor P2 is, for example, a processing circuit including a CPU. The processor P2 executes various processes of the mobile terminal 2 by executing programs stored in an internal memory (not shown) or the memory M2.

[0125] The application control unit 231 executes processing of the management application for the electronic lock 1. The application control unit 231 is realized by causing the processor P2 to execute the program of the management application stored in the application storage unit 221. The application control unit 231 cooperates with the application server 3, the SNS server 4, the distribution server 5, and the management server 6 to provide various services related to the electronic lock 1.

[0126] In response to a setting request for the electronic lock 1 received by the input unit 212, the application control unit 231 causes the lock setting unit 233 to execute setting processing. Furthermore, in response to a request to display log information received by the input unit 212, the application control unit 231 causes the lock log acquisition unit 234 to execute a process of acquiring log information, and causes the display control unit 235 to display the log information.

[0127] Furthermore, the application control unit 231 executes acquisition of various types of distribution information from the distribution server 5 via the communication unit 211 in response to a download request for distribution information received by the input unit 212 .

[0128] The user information management unit 232 uses the user information storage unit 222 to execute a process of managing user information. The lock setting unit 233 executes setting processing of the electronic lock 1. The lock setting unit 233 acquires setting information of the electronic lock 1 via the communication unit 211, and causes the display control unit 235 to display the setting information of the electronic lock 1, while storing the setting information of the electronic lock 1 in the lock setting storage unit 223. The lock setting unit 233 also changes the setting information of the electronic lock 1 based on the input information received by the input unit 212, and transmits the changed setting information of the electronic lock 1 via the communication unit 211.

[0129] The lock log acquisition unit 234 acquires log information of the electronic lock 1 via the communication unit 211, stores the acquired log information in the lock log memory unit 224, and transmits it to the management server 6 via the communication unit 211.

[0130] The display control unit 235 outputs various types of information to the output unit 213 in response to requests from each unit such as the application control unit 231. Next, with reference to FIG. 16, a screen display example for setting the electronic lock 1 using the mobile terminal 2 will be described.

[0131] FIG. 16 is a diagram showing an example of a screen display for lock setting in opening / closing control system 100 according to this embodiment. In FIG. 16, a display screen G1 shows a lock setting display screen that is displayed when the mobile terminal 2 executes the management application and the lock button BT14 is pressed.

[0132] When the user presses the basic settings button BT11 on the display screen G1, the mobile terminal 2 displays a basic settings screen on the display screen G11. The user can set the basic settings of the electronic lock 1 on this display screen G11.

[0133] When the user presses the target setting button BT12 on the display screen G1, the mobile terminal 2 displays a target person setting screen on the display screen G12. The user can set the target person of the electronic lock 1 on this display screen G12.

[0134] When the user presses the detailed settings button BT13 on the display screen G1, the mobile terminal 2 displays a detailed settings screen on the display screen G13. The user can set detailed settings of the electronic lock 1 on this display screen G13.

[0135] The application server 3 is a server device that provides a service of a management application for the electronic lock 1. The application server 3 is connectable to the mobile terminal 2 via the network NW.

[0136] Here, the configuration of the application server 3 in this embodiment will be described with reference to FIG. FIG. 17 is a block diagram showing an example of the application server 3 in this embodiment.

[0137] As shown in FIG. 17, the application server 3 includes a communication unit 311, a management application storage unit 321, and a management application control unit 331. The communication unit 311 is included in the input / output module I2. The communication unit 311 is, for example, a network communication module such as a LAN module. The communication unit 311 connects to the network NW and performs communication with the mobile terminal 2.

[0138] The management application storage unit 321 is a storage unit realized by the memory M3. The management application storage unit 321 stores usage information of the management application of the electronic lock 1. The memory M3 is, for example, a storage device such as a RAM, a flash memory, or a HDD, and stores various types of information and programs used by the application server 3.

[0139] The management application control unit 331 is a functional unit that is realized by making the processor P3 execute a program stored in an internal memory (not shown) or the memory M3. The management application control unit 331 executes processing of various services provided by the management application of the electronic lock 1.

[0140] The processor P3 is, for example, a processing circuit including a CPU. The processor P3 executes various processes of the application server 3 by executing programs stored in an internal memory (not shown) or the memory M3.

[0141] The SNS server 4 is a server device that provides SNS (Social Networking Service) information related to the electronic lock 1. The SNS server 4 is connectable to the mobile terminal 2 via the network NW.

[0142] Here, the configuration of the SNS server 4 in this embodiment will be described with reference to FIG. FIG. 18 is a block diagram showing an example of the SNS server 4 in this embodiment.

[0143] As shown in FIG. 18, the SNS server 4 includes a communication unit 411, an SNS information storage unit 421, and an SNS control unit 431. The communication unit 411 is included in the input / output module I4. The communication unit 411 is, for example, a network communication module such as a LAN module. The communication unit 411 connects to the network NW and performs communication with the mobile terminal 2.

[0144] The SNS information storage unit 421 is a storage unit realized by the memory M4. The SNS information storage unit 421 stores SNS usage information related to the electronic lock 1. The memory M4 is, for example, a storage device such as a RAM, a flash memory, or a HDD, and stores various types of information and programs used by the SNS server 4.

[0145] The SNS control unit 431 is a functional unit that is realized by having the processor P4 execute a program stored in an internal memory (not shown) or memory M4. The SNS control unit 431 executes processing for providing SNS services related to the electronic lock 1. The SNS control unit 431 executes processing such as posting, notification, and viewing of information (e.g., messages, content, etc.) for sharing information, exchanging opinions, etc. between users of the electronic lock 1. In the opening and closing control system 100 of this embodiment, by using the SNS, it is possible to share information between users on common concerns such as education, how to deal with them, and how to deal with them (such as usage models), for example.

[0146] The processor P4 is, for example, a processing circuit including a CPU. The processor P4 executes various processes of the SNS server 4 by executing programs stored in an internal memory (not shown) or the memory M4.

[0147] The distribution server 5 is a server device that distributes various information such as scenario information, model information, and voice data used in the electronic lock 1. The distribution server 5 is connectable to the mobile terminal 2 via the network NW.

[0148] Here, the configuration of the distribution server 5 in this embodiment will be described with reference to FIG. FIG. 19 is a block diagram showing an example of the distribution server 5 in this embodiment.

[0149] As shown in FIG. 19, the distribution server 5 includes a communication unit 511, a distribution information storage unit 521, and a distribution control unit 531. The communication unit 511 is included in the input / output module I5. The communication unit 511 is, for example, a network communication module such as a LAN module. The communication unit 511 connects to the network NW and performs communication with the mobile terminal 2.

[0150] The distributed information storage unit 521 is a storage unit realized by the memory M5. The distributed information storage unit 521 stores distributed information related to the electronic lock 1. The distributed information includes, for example, scenario information, model information, audio data, and the like of the electronic lock 1. Here, an example of data in the distribution information storage unit 521 will be described with reference to FIGS.

[0151] 20 and 21 are diagrams showing examples of data in the distribution information storage unit 521 in this embodiment. As shown in FIG. 20, the distribution information storage unit 521 stores scenario information in which a scenario ID, a care recipient, a care type, and a care policy are associated with each other.

[0152] As shown in FIG. 21, the delivery information storage unit 521 stores model information in which a model ID, a person to be cared for, a personality type, and an output type are associated with each other. The memory M5 is, for example, a storage device such as a RAM, a flash memory, or a HDD, and stores various types of information and programs used by the distribution server 5.

[0153] The distribution control unit 531 is a functional unit that is realized by making the processor P5 execute a program stored in an internal memory (not shown) or the memory M5. The distribution control unit 531 executes a process of distributing distribution information (scenario information, model information, etc.) related to the electronic lock 1.

[0154] The processor P5 is, for example, a processing circuit including a CPU. The processor P5 executes various processes of the distribution server 5 by executing programs stored in an internal memory (not shown) or a memory M5.

[0155] Here, with reference to FIG. 22, an example of a display screen on the mobile terminal 2 in the process of downloading a celebrity personality model from the distribution server 5 will be described. FIG. 22 is a diagram showing an example of a screen display in the distribution process of the opening and closing control system 100 according to this embodiment.

[0156] 22, display screen G3 shows an example of a display screen of the management application. This display screen G3 displays a notification that a personality model of comedian XX has been added, a notification that voice data of voice actor XX has been added, and the like.

[0157] When the user designates the selection of learning material on the display screen G3, the mobile terminal 2 displays a character selection screen (character purchase screen) on the display screen G31. Next, when the user selects to purchase "Comedian XX" on the display screen G31, the mobile terminal 2 displays a purchase completion screen on the display screen G32.

[0158] Next, when the user selects the setting of the electronic lock 1 on the display screen G32, the mobile terminal 2 displays a setting screen for comedian XX on the display screen G33. Next, when the user completes the setting of the electronic lock 1 on the display screen G33, the mobile terminal 2 displays a confirmation screen for the setting information of the electronic lock 1 on the display screen G34. In this manner, in the opening / closing control system 100 according to this embodiment, various types of distribution information can be purchased from the distribution server 5.

[0159] The management server 6 is a server device that manages the electronic lock 1 and executes model learning processing. The management server 6 is connectable to the mobile terminal 2, the application server 3, the SNS server 4, and the distribution server 5 via the network NW.

[0160] Here, the configuration of the management server 6 in this embodiment will be described with reference to FIG. FIG. 23 is a block diagram showing an example of the management server 6 in this embodiment.

[0161] As shown in FIG. 23, the management server 6 includes a communication unit 611, a learning information storage unit 621, a management information storage unit 622, a learning processing unit 631, and a management control unit 632.

[0162] The communication unit 611 is included in the input / output module I6. The communication unit 611 is, for example, a network communication module such as a LAN module. The communication unit 611 is connected to the network NW and performs communication with the mobile terminal 2, the application server 3, the SNS server 4, and the distribution server 5.

[0163] The learning information storage unit 621 and the management information storage unit 622 are storage units realized by the memory M6. The memory M6 is, for example, a storage device such as a RAM, a flash memory, or a HDD, and stores various types of information and programs used by the management server 6.

[0164] The learning information storage unit 621 stores learning information for generating a trained model by machine learning. The learning information includes, for example, learning data for generating a trained model for determining the content of notification. The management information storage unit 622 stores management information for the electronic lock 1. The management information includes user information, lock information such as a lock ID, lock setting information, and billing information.

[0165] The learning processing unit 631 and the management control unit 632 are functional units that are realized by causing the processor P6 to execute a program stored in an internal memory (not shown) or memory M6.

[0166] The processor P6 is, for example, a processing circuit including a CPU. The processor P6 executes various processes of the management server 6 by executing programs stored in an internal memory (not shown) or a memory M6.

[0167] The learning processing unit 631 executes a learning process to generate a trained model by machine learning. The learning processing unit 631 extracts learning data from log information stored in the management information storage unit 622, stores the data in the learning information storage unit 621, and generates a trained model from the learning data by machine learning. The learning processing unit 631 generates, for example, a trained model that determines the content of the notification for each locking state of the opening and closing object by machine learning. The locking states of the opening and closing object include, for example, a state in which the lock unit 14 is unlocked, a state immediately after the lock unit 14 is changed from an unlocked state to a locked state (a state after locking), a state in which the lock unit 14 is locked, and a state immediately after the lock unit 14 is changed from a locked state to an unlocked state (a state after unlocking).

[0168] In addition, the learning processing unit 631 transmits the generated trained model to the distribution server 5 via the communication unit 611, and stores it in the distribution information storage unit 521 of the distribution server 5. The management control unit 632 executes various management processes related to the electronic lock 1.

[0169] Next, the operation of opening and closing control system 100 including additional services will be described with reference to FIG. FIG. 24 is a diagram showing an example of the operation of the opening and closing control system 100 according to this embodiment.

[0170] 24, in the setting process of the electronic lock 1, first, the mobile terminal 2 downloads an application (management application) from the distribution server 5 (step S201). The mobile terminal 2 stores the downloaded application in the application storage unit 221.

[0171] Next, the mobile terminal 2 transmits the user information to the application server 3 (step S202). The application control unit 231 of the mobile terminal 2 transmits the user information to the application server 3 and performs user registration. The application server 3 stores the user information in the management application storage unit 321.

[0172] Next, the application server 3 transmits the user information to the management server 6 (step S203). The management server 6 registers the user information and generates a user ID.

[0173] Next, the management server 6 transmits the user ID to the application server 3 (step S204). The application server 3 stores the received user ID and the user information in the management application storage unit 321 in association with each other.

[0174] Next, the application server 3 transmits the user ID to the mobile terminal 2 (step S205). The mobile terminal 2 stores the received user ID and user information in the user information storage unit 222 in association with each other.

[0175] Next, the mobile terminal 2 acquires the lock ID from the electronic lock 1 (step S211). The electronic lock 1 transmits the lock ID to the mobile terminal 2 in response to a request from the mobile terminal 2, for example.

[0176] Next, the mobile terminal 2 transmits to the electronic lock 1 (step S212). The mobile terminal 2 accepts the settings by the user and transmits the setting information of the electronic lock 1 set by the user to the electronic lock 1. The mobile terminal 2 also stores the setting information of the electronic lock 1 in the lock setting memory unit 223. The electronic lock 1 also stores the setting information of the electronic lock 1 in the lock setting memory unit 121.

[0177] Next, the mobile terminal 2 transmits the user ID, the lock ID, and the setting information to the application server 3 (step S213).

[0178] Next, the application server 3 transmits the user ID, lock ID, and setting information received from the mobile terminal 2 to the management server 6 (step S214). The management server 6 associates the received user ID, lock ID, and setting information with each other and stores them in the management information storage unit 622.

[0179] Next, as a log checking process, first, the mobile terminal 2 transmits a synchronization request to the electronic lock 1 (step S221).

[0180] Next, in response to the received synchronization request, the electronic lock 1 transmits the lock ID and the log to the mobile terminal 2 (step S222). The electronic lock 1 transmits the log and the lock ID stored in the log storage unit 125 to the mobile terminal 2.

[0181] Next, the mobile terminal 2 transmits the user ID, the lock ID, and the log to the application server 3 (step S223). The mobile terminal 2 stores the received lock ID and log in the lock log storage unit 224, and transmits the user ID, the lock ID, and the log to the application server 3.

[0182] Next, the application server 3 transmits the user ID, the lock ID, and the log to the management server 6 (step S224). The management server 6 stores the received user ID, the lock ID, and the log in the management information storage unit 622 in association with each other.

[0183] Next, the application server 3 transmits the report and the proposal to the mobile terminal 2 (step S225). The management application control unit 331 of the application server 3 generates a report and a proposal based on the log, and transmits the report and the proposal to the mobile terminal 2 to display them.

[0184] Next, as an SNS process (content reference process), the mobile terminal 2 transmits a user ID and a reference request to the SNS server 4 (step S231).

[0185] Next, the SNS server 4 executes a process of confirming the access authority between the SNS server 4 and the management server 6 (step S232).

[0186] Next, the SNS server 4 transmits the content to the mobile terminal 2 (step S233). The mobile terminal 2 displays the received SNS content (message, etc.).

[0187] Furthermore, as an SNS process (posting process), the mobile terminal 2 transmits the user ID and a posting request to the SNS server 4 (step S234).

[0188] Next, the SNS server 4 executes a process of confirming the update authority with the management server 6 (step S235).

[0189] Next, the SNS server 4 transmits a posting completion to the mobile terminal 2 (step S236). The mobile terminal 2 executes posting to the SNS in response to the received posting request, and transmits a posting completion to the mobile terminal 2.

[0190] Next, as a distribution process, the mobile terminal 2 transmits the user ID and the setting information of the electronic lock 1 to the distribution server 5 (step S241).

[0191] Next, the distribution server 5 transmits the additional function information to the mobile terminal 2 (step S242). The distribution server 5 checks the received user ID and the setting information of the electronic lock 1, extracts the additional function information, and transmits it to the mobile terminal 2.

[0192] Next, the mobile terminal 2 transmits the user ID and the addition request to the distribution server 5 (step S243). The mobile terminal 2 displays the additional function information received from the distribution server 5, and transmits the user ID and the addition request to the distribution server 5 in response to the operation of the addition request by the user.

[0193] Next, the distribution server 5 executes a process of confirming the additional authority with the management server 6 (step S244).

[0194] Next, the distribution server 5 transmits the additional function to the mobile terminal 2 (step S245). The distribution server 5 confirms the adding authority with the management server 6, and then transmits the additional function in response to the adding request to the mobile terminal 2.

[0195] Next, the mobile terminal 2 sets the received additional function in the electronic lock 1 (step S246).

[0196] Next, the learning process of the opening and closing control system 100 according to this embodiment will be described with reference to FIG. 25 is a diagram showing an example of the learning process of the opening and closing control system 100 according to this embodiment. Here, an example in which the management server 6 executes the learning process will be described.

[0197] 25, the learning processing unit 631 of the management server 6 first classifies the collected captured images according to the locking status (step S301). The learning processing unit 631 classifies the collected captured images into the following locking statuses: the lock unit 14 is unlocked, the state immediately after the lock unit 14 is changed from the unlocked state to the locked state (post-locking state), the lock unit 14 is locked, and the state immediately after the lock unit 14 is changed from the locked state to the unlocked state (post-unlocking state).

[0198] Next, the learning processing unit 631 selects notification contents for each captured image for each lock state (step S302). That is, the learning processing unit 631 associates each captured image with the notification contents.

[0199] Next, the learning processing unit 631 estimates the subject attribute of each captured image (step S303). Here, the subject attribute is, for example, an attribute such as an infant, a child, an elderly person, a visually impaired person, or a hearing impaired person.

[0200] Next, the learning processing unit 631 executes machine learning using a set of the captured image, the notification content, and the subject attribute for each locking state as learning data (step S304). The learning processing unit 631 stores the generated learning data in the learning information storage unit 621. The learning processing unit 631 executes a learning process of a trained model that determines the notification content by machine learning using the learning data stored in the learning information storage unit 621.

[0201] Next, the learning processing unit 631 generates a trained model for each locking state (step S305). The learning processing unit 631 transmits the generated trained model for each locking state to the distribution server 5.

[0202] FIG. 26 is an explanatory diagram illustrating the hardware configuration of each device of the opening and closing control system 100 according to this embodiment. The devices are a mobile terminal 2, an application server 3, an SNS server 4, a distribution server 5, and a management server 6. Each device is configured to include an input / output module I, a storage module M, and a control module P.

[0203] The input / output module I is realized by including some or all of the communication module H11, the connection module H12, the pointing device H21, the keyboard H22, the display H23, the button H3, the microphone H41, the speaker H42, the camera H51, and the sensor H52. The storage module M is realized by including the drive H7.

[0204] The storage module M may further be configured to include a part or all of the memory H8. The control module P is realized by including a memory H8 and a processor H9. These hardware components are communicatively connected to each other via a bus.

[0205] The connection module H12 is a digital input / output port such as a USB (Universal Serial Bus). In the case of a portable device, the pointing device H21, the keyboard H22, and the display H23 are touch panels. The sensor H52 is an acceleration sensor, a gyro sensor, a GPS receiving module, a proximity sensor, or the like. The drive H7 is an auxiliary storage medium such as a hard disk drive or a solid state drive. The drive H7 may be a non-volatile memory such as an EEPROM or a flash memory, or a magneto-optical disk drive or a flexible disk drive. The drive H7 is not limited to a drive built into each device, but may be an external storage device connected to a connector of the connection module H12. The memory H8 is a main storage medium such as a random access memory. The memory H8 may be a cache memory. The memory H8 stores instructions when the instructions are executed by one or more processors H9. The processor H9 is a CPU (Central Processing Unit). The processor H9 may be an MPU (Micro Processing Unit) or a GPU (Graphics Processing Unit). The processor H9 reads out programs and various data from the drive H7 via the memory H8 and performs calculations to execute instructions stored in one or more memories H8.

[0206] As described above, the opening / closing control system 100 according to the present embodiment is an opening / closing control system that controls the opening / closing of an opening / closing object, and includes the recognition unit 133, the determination unit 134, the lock control unit 136, and the output control unit 135. The recognition unit 133 recognizes an opener who performs an opening / closing action on an opening / closing object (for example, the refrigerator O1). The determination unit 134 performs a notification determination to determine notification contents and a lock determination to determine unlocking control or locking control on the opening / closing object according to the opener recognized by the recognition unit 133. The lock control unit 136 performs lock control to control unlocking or locking according to the lock determination. The output control unit 135 performs output control to output a notification to the opener based on the notification contents. That is, the output control unit 135 performs output control to output notification contents to the opener according to the opener recognized by the recognition unit 133. Also, the lock control unit 136 performs lock control to control unlocking or locking on the opening / closing object according to the opener recognized by the recognition unit 133.

[0207] As a result, the opening / closing control system 100 according to this embodiment determines appropriate notification content, such as advice or a warning, according to the opener performing the opening / closing action, outputs the notification to the opener, and performs lock control to control unlocking or locking according to the opener. Therefore, the opening / closing control system 100 according to this embodiment can appropriately manage the opening / closing action of the opener while providing appropriate information according to the opener performing the opening / closing action.

[0208] In this embodiment, the determination unit 134 performs notification determination and lock determination according to the personality set in association with the open / close person. That is, the output control unit 135 performs output control according to the personality set in association with the open / close person. The lock control unit 136 controls the lock according to the personality set in association with the opener / closer.

[0209] As a result, the opening and closing control system 100 according to this embodiment can output a notification to the opener / closer according to the set personality, and can output notification content according to an appropriate personality suited to the opener / closer. Therefore, the opening and closing control system 100 according to this embodiment can provide more appropriate information according to the opener / closer.

[0210] In this embodiment, the notification determination includes a first notification determination for determining the first notification content, and a second notification determination for determining the second notification content different from the first notification content. After the output control unit 135 outputs a notification based on the first notification content, if the recognition unit 133 recognizes the opener / closer again, the determination unit 134 performs a second notification determination. The output control unit 135 outputs a notification based on the second notification content.

[0211] As a result, the opening and closing control system 100 according to this embodiment can provide more appropriate information according to the opener / closer, for example, by warning the opener / closer and then explaining the reason.

[0212] In this embodiment, the lock judgment includes a first lock judgment and a second lock judgment. The judgment unit 134 performs the second lock judgment when the recognition unit 133 recognizes the opener / closer again. The lock control unit 136 performs lock control according to the second lock judgment.

[0213] As a result, the opening / closing control system 100 of this embodiment can make flexible lock judgments according to the situation, for example, by first making a lock judgment to keep the door unlocked and then making a lock judgment to lock the door, thereby enabling more appropriate management of the opening and closing actions of the opener / closer.

[0214] Furthermore, in this embodiment, the determination unit 134 performs a second lock determination and a second notification determination based on the re-recognized opener / closer and the result of the first notification determination. As a result, the opening and closing control system 100 according to this embodiment can, for example, after issuing a single warning, further make a lock judgment and an alarm judgment based on the content of the warning given by the opener / closer and their actions after the warning, thereby making flexible judgments according to the situation.

[0215] In addition, in this embodiment, the determination unit 134 performs a second lock determination and a second notification determination according to the position of the opener / closer who has been re-recognized. As a result, the opening and closing control system 100 according to this embodiment can further perform lock judgment and alarm judgment, for example, when the person approaches the object to be opened and closed after being warned once, and can make flexible judgments according to the situation.

[0216] In this embodiment, when the opening / closing target is in an unlocked state, the determination unit 134 determines whether or not to perform lock control as a lock determination. When it is determined that lock control is to be performed, the lock control unit 136 changes the opening / closing target from an unlocked state to a locked state. When the opening / closing target is in a locked state, the determination unit 134 determines whether or not to perform unlock control as a lock determination depending on whether an unlocking condition is satisfied. When it is determined that unlock control is to be performed, the lock control unit 136 changes the opening / closing target from a locked state to an unlocked state.

[0217] As a result, the opening / closing control system 100 of this embodiment can appropriately determine the lock status by distinguishing between when the opening / closing target is in an unlocked state and when the opening / closing target is in a locked state, and can flexibly change the lock control depending on the locking status of the opening / closing target.

[0218] Furthermore, the opening / closing control system 100 according to this embodiment includes a model storage unit 123 that stores a trained model that is trained for each locking status of the opening / closing target and determines the content of the notification for each locking status of the opening / closing target. The determination unit 134 performs a notification determination for each locking status of the opening / closing target based on the trained model stored in the model storage unit 123.

[0219] As a result, opening / closing control system 100 according to this embodiment can flexibly change the notification content for each locking status of the opening / closing object, and can provide more appropriate information according to the locking status of the opening / closing object.

[0220] The opening / closing control system 100 according to this embodiment also includes a learning processing unit 631 that generates a trained model by machine learning for each locking state of the opening / closing target. As a result, the opening / closing control system 100 of this embodiment can flexibly change the notification content for each locking status of the opening / closing target, and can generate a trained model, thereby enabling it to flexibly respond to changes in the situation.

[0221] In this embodiment, the determination unit 134 performs lock determination according to the position where the recognized open / close person touched the open / close object, the approach speed of the open / close person, or the date and time information when the open / close person was recognized. That is, the lock control unit 136 performs lock control according to the position where the recognized open / close person touched the open / close object, the approach speed of the open / close person, or the date and time information when the open / close person was recognized.

[0222] This allows the opening / closing control system 100 according to this embodiment to perform lock control more flexibly and appropriately depending on the behavior of the opener or the situation such as the date and time (day of the week or time period).

[0223] In this embodiment, the determination unit 134 determines the notification content to suppress or caution the opening / closing action according to the recognized opening / closing person. That is, the output control unit 135 outputs the notification content to suppress or caution the opening / closing action according to the recognized opening / closing person.

[0224] As a result, the opening and closing control system 100 according to this embodiment can appropriately manage the opening and closing behavior of an opener from the standpoint of danger avoidance, education, or behavioral restraint, for example, when the opener is an infant, a child, or an alcoholic.

[0225] In the present embodiment, the determination unit 134 determines the notification content according to the open / close target or the contents held by the open / close target. That is, the output control unit 135 outputs the notification content according to the open / close target or the contents held by the open / close target.

[0226] As a result, opening and closing control system 100 according to this embodiment can, for example, change the content of the notification to a child or an infant depending on whether the object to be opened and closed is refrigerator O1 and whether the contents held in refrigerator O1 include ice cream. In other words, opening and closing control system 100 according to this embodiment can appropriately and flexibly change the content of the notification depending on the object to be opened and closed or the contents held by the object to be opened and closed.

[0227] In this embodiment, the determination unit 134 determines whether to perform a notification determination or a lock determination depending on the recognized opener / closer. As a result, the opening / closing control system 100 according to this embodiment can make flexible decisions according to the situation, for example not making an alarm decision or a lock decision if the opener is an adult.

[0228] In the present embodiment, the determination unit 134 determines the notification content according to the status of the opening / closing action on the open / close object. That is, the output control unit 135 outputs the notification content according to the status of the opening / closing action on the open / close object.

[0229] As a result, the opening / closing control system 100 according to this embodiment can output an appropriate notification (admonition), such as a warning when the refrigerator O1 is violently closed, and can flexibly make a notification decision according to the situation.

[0230] The electronic lock 1 (opening / closing device) according to the present embodiment is an opening / closing device that controls the opening and closing of an opening / closing object, and includes a recognition unit 133, a determination unit 134, a lock control unit 136, and an output control unit 135. The recognition unit 133 recognizes an opener who performs an opening / closing action on an opening / closing object (for example, a refrigerator O1). The determination unit 134 performs a notification determination to determine notification contents and a lock determination to determine unlocking control or locking control on the opening / closing object according to the opener recognized by the recognition unit 133. The lock control unit 136 performs lock control to control unlocking or locking according to the lock determination. The output control unit 135 performs output control to output a notification to the opener based on the notification contents. That is, the output control unit 135 performs output control to output notification contents to the opener according to the opener recognized by the recognition unit 133. The lock control unit 136 performs lock control to control unlocking or locking on the opening / closing object according to the opener recognized by the recognition unit 133.

[0231] As a result, the electronic lock 1 of this embodiment achieves the same effect as the opening and closing control system 100 described above, and can appropriately manage the opening and closing actions of the opener while providing appropriate information according to the opener performing the opening and closing action.

[0232] The opening / closing control method according to the present embodiment is an opening / closing control method of the opening / closing control system 100 that controls the opening / closing of an opening / closing target, and includes a recognition step, a determination step, a lock control step, and an output control step. In the recognition step, the recognition unit 133 recognizes an opener who performs an opening / closing action on the opening / closing target. In the determination step, the determination unit 134 performs a notification determination to determine notification content and a lock determination to determine unlocking control or locking control on the opening / closing target according to the opener recognized by the recognition unit 133. In the lock control step, the lock control unit 136 performs lock control to control unlocking or locking according to the lock determination. In the output control step, the output control unit 135 performs output control to output a notification to the opener based on the notification content. That is, in the output control step, the output control unit 135 performs output control to output notification content to the opener according to the opener recognized by the recognition unit 133. In addition, in the lock control step, the lock control unit 136 performs lock control to control unlocking or locking of the opening / closing target according to the opener recognized by the recognition unit 133.

[0233] As a result, the opening and closing control method according to this embodiment has the same effect as the opening and closing control system 100 described above, and can appropriately manage the opening and closing actions of the opener while providing appropriate information according to the opener performing the opening and closing action.

[0234] The present disclosure is not limited to the above-described embodiments, and can be modified without departing from the spirit and scope of the present disclosure. For example, in the above embodiment, the electronic lock 1 is provided with the recognition unit 133, the determination unit 134, the lock control unit 136, and the output control unit 135, but this is not limited to the above. The recognition unit 133, the determination unit 134, the lock control unit 136, and the output control unit 135 may be provided in part or in whole outside the electronic lock 1. For example, the electronic lock 1 may be capable of communicating with the application server 3, the SNS server 4, the distribution server 5, and the management server 6 without the mobile terminal 2, and the recognition unit 133, the determination unit 134, the lock control unit 136, and the output control unit 135 may be provided in part or in whole in any of the application server 3, the SNS server 4, the distribution server 5, and the management server 6. That is, the electronic lock 1 may be directly connected to the network NW without the mobile terminal 2. In addition, the electronic lock 1 directly connects to the network NW when transmitting and receiving data, but the electronic lock 1 may be set or viewed through the mobile terminal 2.

[0235] In addition, in the above embodiment, an example has been described in which the application server 3, the SNS server 4, the distribution server 5, and the management server 6 are each different server devices, but this is not limited to this, and some or all of the application server 3, the SNS server 4, the distribution server 5, and the management server 6 may be configured as a single server device.

[0236] In the above embodiment, the object to be opened and closed on which the electronic lock 1 is installed is a refrigerator O1, but the present invention is not limited to this and may be, for example, a home appliance such as a rice cooker, a microwave oven, an oven, or a remote control (for a television or air conditioner), or may be furniture such as a shelf, a drawer, or a safe. The object to be opened and closed may be a door or window of a shared house, a hospital, a childcare facility, a balcony, a room, a bathroom, a toilet, or may be home equipment such as a stove, a bath, or a floor heating system. The object to be opened and closed may also be a vehicle such as a car, a motorcycle, or a bicycle.

[0237] In the above embodiment, when the recognition unit 133 recognizes a plurality of open / close persons, for example, the youngest person may be recognized as the open / close person. When the recognition unit 133 recognizes a plurality of open / close persons, for example, one open / close person may be recognized according to a positional relationship with the open / close target or a behavior. The recognition unit 133 may preferentially recognize, for example, a person who is close to the open / close target or a person who is stopped near the open / close target as the open / close person.

[0238] In the above embodiment, an example has been described in which the management server 6 executes the learning process, but this is not limited thereto, and other devices (e.g., the electronic lock 1, the mobile terminal 2, the application server 3, the SNS server 4, and the distribution server 5, etc.) may execute the learning process. In other words, other devices (e.g., the electronic lock 1, the mobile terminal 2, the application server 3, the SNS server 4, and the distribution server 5, etc.) may be provided with the learning processing unit 631 instead of the management server 6.

[0239] In addition, in the above embodiment, an example has been described in which the alert content is output to the opener / closer by voice, but this is not limited to this, and a message may be displayed on the display unit, or a combination of voice and display may be output to the opener / closer.

[0240] In the above embodiment, the notification content output to the opener / closer may be configured so that the notification timing (output timing) or the lock control timing can be set according to the object of opening and closing.

[0241] The electronic lock 1 may also determine whether to make a notification determination or a lock determination depending on the date and time information (day of the week or time period). That is, the electronic lock 1 may not make a notification determination or a lock determination during times when there are no children or on days when the parents are present, for example.

[0242] The electronic lock 1 (determination unit 134) may determine the content of the notification depending on the manner of opening and closing. For example, the electronic lock 1 may warn the user about the manner of closing if the lock is closed improperly, or warn the user about the manner of closing if the lock is closed with the foot, etc. The electronic lock 1 (determination unit 134) may also determine whether to issue a notification depending on the attributes of the person who opens and closes the door. For example, it may be possible to not notify an adult and to give a stern warning to a child.

[0243] The electronic lock 1 (output control unit 135) may also change the volume of the notification output depending on the person who opens and closes the door, or the content of the notification. For example, the output control unit 135 may increase the volume when a warning is required, and return it to normal volume when education is required. The electronic lock 1 (output control unit 135) may also increase the volume when calling people in the vicinity.

[0244] In addition, the electronic lock 1 (output control unit 135) may change the speed, tone, manner, etc. of speech depending on the content of the notification. For example, the output control unit 135 may increase the speed when warning, and may speak slowly when educating. For example, the output control unit 135 may output in a high tone when warning, and in a low tone when educating.

[0245] In the above embodiment, the setting of the person who opens and closes the notification determination may be, for example, a child, a person on a diet, a person being cared for, or a specific person.

[0246] The electronic lock 1 may be set so that the voice of the notification (utterance) is changed depending on the person who opens and closes the door, or so that notification determination is made depending on the type of care. In addition, the settings of the electronic lock 1 may be set according to the object to be opened and closed, and the notification content may be set to notifications that represent human sensations such as hot, cold, pain, etc.

[0247] In addition, in the above embodiment, an example was described in which the electronic lock 1 is configured to be detachable from the object to be opened and closed (e.g., refrigerator O1), but this is not limited to this and the electronic lock 1 may be built into the object to be opened and closed.

[0248] The electronic lock 1 may be configured to be in an unlocked state when it is removed from the object to be opened or closed. The electronic lock 1 may be configured to be in an unlocked state when the battery is charged or when the battery is removed.

[0249] In addition, in the above embodiment, an example has been described in which the electronic lock 1 controls unlocking and locking, but this is not limited to this. For example, an actuator or the like may be provided in the opening and closing part to increase the force required for opening and closing, and control the opening and closing slowly.

[0250] In the above embodiment, an example has been described in which the voice, model, scenario, and the like are downloaded from the distribution server 5, but a fee may be charged at the time of downloading.

[0251] In the above embodiment, the electronic lock 1 may be configured to set the notification contents to simple English questions for language learning, simple questions for learning general knowledge, or explanations. The electronic lock 1 may display, for example, "What day is it today (family member's birthday, home visit, school open day, etc.)" or "Weather forecast."

[0252] In the above embodiment, an example was described in which sensing information was included in the conditions for the recognition of the opener / closer, or the notification judgment, and the lock judgment, but a sensor may be provided on the door or handle to be opened and closed, and the recognition of the opener, or the notification judgment, and the lock judgment may be performed according to the position touched by the opener / closer. For example, a condition for recognizing a child as an opener / closer may be that the position touched by the opener / closer is lower than a specific position.

[0253] 5 and 6, the number of times of notification or the number of times of locking / unlocking made to the same detection subject within a specific period may be included as one of the conditions for changing the notification content or the locking / unlocking status. That is, for example, it is necessary to properly educate a small child the first time, but after multiple times, if there is an improvement in the behavior, it is considered that notification for the purpose of education is unnecessary, or education with different notification content is effective. Therefore, the electronic lock 1 may change the notification content or the locking / unlocking status according to the number of times of notification or the number of times of locking / unlocking, using the scenario information.

[0254] In addition, while Fig. 5 above shows an example in which the scenario information outputs the notification content before and after locking, this is not necessarily limited thereto, and the scenario information may output the notification content only either before locking or after locking. In that case, it is preferable for the electronic lock 1 to lock before outputting the notification content, for example, in consideration of the safety of small children (preschool children). Alternatively, the electronic lock 1 may determine whether to issue the notification before or after locking depending on the type of notification content to be output or the recognized opener / closer.

[0255] In the opening / closing control system 100 of the above embodiment, the object to be opened / closed may be a shared trash can provided for a shared residence such as an apartment building, a door to a trash dumping area managed by a ward, city, town, or village, etc. In this case, the electronic lock 1 may be set to open only on designated days or during designated hours, such as burnable trash collection days, or may be set to open only for the intended resident or manager.

[0256] In addition, in the opening and closing control system 100 of the above embodiment, for example, when an alcoholic removes alcohol from the refrigerator O1 or shelf that is the target of opening and closing, a notification may be sent to a manager such as a psychological surgeon / psychological counselor.

[0257] In addition, as an optional contract or a fee-paying service, if an alcoholic, for example, manages to refrain from drinking alcohol, the psychological surgeon / psychological counselor may send a praising comment to the alcoholic, or the date and time or the number of drinks consumed may be digitized and sent to the psychological surgeon / psychological counselor. In this case, the psychological surgeon / psychological counselor can effectively use the data and appropriately manage the alcoholic's drinking behavior.

[0258] Each of the components of the opening / closing control system 100 and electronic lock 1 described above has an internal computer system. A program for realizing the functions of each of the components of the opening / closing control system 100 and electronic lock 1 described above may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing in each of the components of the opening / closing control system 100 and electronic lock 1 described above. Here, "reading a program recorded on a recording medium into a computer system and executing it" includes installing a program into a computer system. The "computer system" referred to here includes hardware such as an OS and peripheral devices. Furthermore, a "computer system" may include multiple computer devices connected via a network including communication lines such as the Internet, WAN, LAN, and dedicated lines. Furthermore, a "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, and storage devices such as hard disks built into a computer system. In this way, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM.

[0259] The recording medium also includes a recording medium installed inside or outside and accessible from a distribution server to distribute the program. The program may be divided into a plurality of parts, downloaded at different times, and then combined with each of the components of the opening / closing control system 100 and the electronic lock 1, or each of the divided programs may be distributed by a different distribution server. Furthermore, the "computer-readable recording medium" includes a recording medium that holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that becomes a server or a client when a program is transmitted via a network. The above program may also be a recording medium for realizing part of the above-mentioned functions. Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called difference file (difference program). [Explanation of symbols]

[0260] 1, 1-1, 1-1a, 1-1b, 1-1c...electronic lock, 2...mobile terminal, 3...application server, 4...SNS server, 5...distribution server, 6...management server, 14...lock unit, 15...power supply, 100...opening / closing control system, 111, 211, 311, 411, 511, 611...communication unit, 112, 214...imaging unit, 113, 213...output unit, 121...lock setting memory unit, 122...scenario memory unit, 123...model memory unit, 124...collected information memory unit, 125...log memory unit, 131...setting update unit, 132...information collection unit, 133...recognition unit, 134...determination unit, 135...output control unit, 136...lock control unit, 141...plate, 142...rotating shaft, 143...projection unit, 144...lock bolt, 145...drive unit, 212...input unit, 215...sensor unit, 221...application storage unit, 222...user information storage unit, 223...lock setting storage unit, 224...lock log storage unit, 231...application control unit, 232...user information management unit, 233...lock setting unit, 234...lock log acquisition unit, 235...display control unit, 321...management application storage unit, 331...management application control unit, 421...SNS information storage unit, 431...SNS control unit, 521...distribution information storage unit, 531...distribution control unit, 621...learning information storage unit, 622...management information storage unit, 631...learning processing unit, 632...management control unit, I1, I2, I3, I4, I5, I6...input / output modules, M1, M2, M3, M4, M5, M6...memory, P1, P2, P3, P4, P5, P6...processor, O1...refrigerator

Claims

1. An opening and closing control system for controlling opening and closing of an opening and closing object, A recognition unit that recognizes an opener / closer who performs an opening / closing action on the open / close object; an output control unit that performs output control to output a notification content for the opener / closer according to the opener / closer recognized by the recognition unit; a lock control unit that performs lock control to control unlocking or locking of the object to be opened and closed in accordance with the opener / closer recognized by the recognition unit; An opening and closing control system comprising:

2. The output control unit is a personality set in correspondence with the opener / closer, and performs the output control based on the notification content corresponding to the personality of the open / close target or the lock, The lock control unit performs the lock control in accordance with the personality. The opening and closing control system according to claim 1 .

3. A determination unit performs a notification determination to determine the notification content according to the opener / closer, and a lock determination to determine whether to perform unlock control or lock control for the open / close target, The output control unit performs the output control based on the notification determination. The lock control unit performs the lock control in response to the lock determination. The opening and closing control system according to claim 1 .

4. The notification determination includes a first notification determination for determining a first notification content and a second notification determination for determining a second notification content different from the first notification content, When the recognition unit recognizes the opener / closer again after the output control unit outputs the notification based on the first notification content, the determination unit performs the second notification determination, The output control unit outputs a notification based on the second notification content. The opening and closing control system according to claim 3 .

5. The lock determination includes a first lock determination and a second lock determination, The determination unit performs the second lock determination when the recognition unit re-recognizes the opener / closer, The lock control unit performs the lock control in response to the second lock determination. The opening and closing control system according to claim 4.

6. The determination unit performs the second lock determination and the second notification determination based on the re-recognized opener / closer and the result of the first notification determination. The opening and closing control system according to claim 5 .

7. The determination unit performs the second lock determination and the second notification determination according to the re-recognized position of the opener / closer. The opening and closing control system according to claim 5 or 6.

8. The determination unit determines whether or not to perform the lock control as the lock determination when the opening / closing target is in an unlocked state, The lock control unit changes the opening / closing target from the unlocked state to the locked state when it is determined that the lock control is to be performed. The opening and closing control system according to claim 4.

9. The determination unit determines whether to perform the unlocking control as the lock determination depending on whether an unlocking condition is satisfied when the opening / closing target is in a locked state, When it is determined that the unlocking control is to be performed, the lock control unit changes the opening / closing target from the locked state to the unlocked state. The opening and closing control system according to claim 8.

10. A model storage unit stores a trained model that is trained for each locking state of the opening / closing object and determines the content of the notification for each locking state of the opening / closing object, The determination unit performs the notification determination for each locking state of the opening / closing object based on the learned model stored in the model storage unit. The opening and closing control system according to claim 3 .

11. A learning processing unit that generates the trained model by machine learning for each locking state of the locking / unlocking target The opening and closing control system according to claim 10.

12. A lock that performs the unlocking or locking of the object to be opened and closed, At least a portion of the lock is removable, including a battery that powers the lock. The opening and closing control system according to claim 1 .

13. The detachable part includes an imaging unit that captures images for recognizing the opener / closer. The opening and closing control system according to claim 12.

14. The detachable part includes the battery alone, When the battery is attached or detached, the lock is unlocked. The opening and closing control system according to claim 12.

15. The output control unit outputs the notification content for encouraging the opener / closer to improve their behavior in accordance with their usage status. The opening and closing control system according to any one of claims 2, 4, 10 and 12.

16. The determination unit determines whether to perform the notification determination or the lock determination depending on the recognized opener / closer. The opening and closing control system according to claim 4 or 10.

17. The lock control unit performs the lock control according to a position where the recognized opener / closer touched the opening / closing object, an approach speed of the opener / closer, or date and time information when the opener / closer was recognized. The opening and closing control system according to any one of claims 2, 4, 10 and 12.

18. The output control unit outputs the notification content to suppress or warn the opening / closing action according to the recognized opening / closing person. The opening and closing control system according to any one of claims 2, 4, 10 and 12.

19. The output control unit outputs the notification content according to the opening and closing object or a content held by the opening and closing object. The opening and closing control system according to any one of claims 2, 4, 10 and 12.

20. The output control unit outputs the notification content according to a state of the opening / closing action with respect to the opening / closing object. The opening and closing control system according to any one of claims 2, 4, 10 and 12.

21. An opening and closing device for controlling opening and closing of an opening and closing object, A recognition unit that recognizes an opener / closer who performs an opening / closing action on the open / close object; an output control unit that performs output control to output a notification content for the opener / closer according to the opener / closer recognized by the recognition unit; a lock control unit that performs lock control to control unlocking or locking of the object to be opened and closed in accordance with the opener / closer recognized by the recognition unit; An opening and closing device comprising:

22. A switching control method for a switching control system that controls switching of an object to be switched, comprising the steps of: The recognition unit recognizes an opener / closer who performs an opening / closing action on an open / close target, The output control unit performs output control to output a notification content for the opener / closer according to the opener / closer recognized by the recognition unit, A lock control unit performs lock control for controlling unlocking or locking of the object to be opened or closed in accordance with the opener / closer recognized by the recognition unit. Opening and closing control method.

Images