Method for controlling of locker based on face recognition and apparatus therefor

Abstract

The embodiments disclosed in this document relate to a device and method capable of tracking objects and recognizing emotions. More specifically, the embodiments disclosed in this document include a plurality of lockers and a camera that acquires a user's face image, and relate to a locker control method in a face recognition type electronic locker device that controls the opening and closing of lockers using the face image acquired from the camera, and a face recognition type electronic locker device for the same.

Description

Technology Field

[0001] The embodiments disclosed in this document relate to a locker control method and a face recognition type electronic locker device for the same. Background Technology

[0002] Generally, lockers are installed in schools and academies to store users' belongings, while general companies have lockers installed to store documents or items.

[0003] Lockers used in schools and academies are assigned users to ensure only those assigned can use them, and in the case of companies where multiple people use lockers, electronic locker management systems are used to electronically manage lockers so that only authorized individuals can use them.

[0004] A conventional locker management system, as disclosed in Korean Registered Patent Publication 10-1615187 (April 19, 2016), includes a locker control unit that opens a locker box and a mobile key management server that checks whether an authentication key and an identification number identical to the authentication key and identification number corresponding to the mobile terminal received from the mobile terminal are stored in a database (DB), and if the same authentication key and identification number are stored, requests the locker control unit to open the locker box corresponding to the identification number. The mobile key management server is configured to send a rejection message to the mobile terminal refusing the opening of the locker box requested by the mobile terminal if the difference between the location of the mobile terminal that transmitted the authentication key and the identification number corresponding to the mobile terminal and the location of the locker box is greater than or equal to a set distance, and to request the locker control unit to open the locker box if the number of times the authentication key and the identification number corresponding to the mobile terminal requesting the opening of the locker box are re-received from the mobile terminal after sending the rejection message to the mobile terminal is greater than or equal to a set number.

[0005] Conventional locker management systems of this type provide users with RFID cards or keys, and are structured so that lockers can be used by employing specific means (RFID cards, keys, or password entry).

[0006] However, if the RFID card or key is lost, or the password is forgotten, problems arise where the locker cannot be used or requires additional production.

[0007] In addition, if an RFID card or key is lost and found by someone other than the locker owner, there is a problem where privacy protection is difficult because the locker can be opened without permission.

[0008] In addition, facilities such as schools are facing a problem where high maintenance costs are incurred even though the lockers are not defective, as students do not return their cards or keys when changing grades or graduating, resulting in the cost of replacing lockers or repairing locks. Prior art literature

[0009] Korean Registered Patent No. 10-1615187 The problem to be solved

[0010] According to one embodiment disclosed in this document, a locker control method and a face recognition type electronic locker device for the same are provided, wherein a user's face image is acquired through a camera of an electronic locker device and the opening and closing of the locker is controlled using the acquired face image.

[0011] The technical problems of the embodiments disclosed in this document are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0012] A locker control method in a face recognition type electronic locker device according to an embodiment of the present invention, comprising a plurality of lockers and a camera for acquiring a user's face image, wherein the opening and closing of the lockers is controlled using the face image acquired from the camera, wherein the electronic locker device comprises: a step of acquiring a face image through the camera; a step of transmitting the acquired face image to a pre-linked linked server to support attendance processing of a user corresponding to the face image; a step of receiving a timetable and a locker number of the user from the linked server upon completion of the user's attendance processing; and a step of controlling the opening and closing of a locker corresponding to the locker number based on the received timetable.

[0013] A locker control method in a face recognition type electronic locker device according to an embodiment of the present invention, comprising a plurality of lockers and a camera for acquiring a user's face image, wherein the opening and closing of the lockers is controlled using the face image acquired from the camera, wherein the electronic locker device comprises: a step of acquiring a face image through the camera; a step of transmitting the acquired face image to a pre-linked linked server to receive user information corresponding to the face image; a step of configuring and outputting a list of items available for rent by the user among items stored in the locker using the user information; a step of opening a locker corresponding to the selected item when the user confirms the selection input for at least one item among the item list; a step of setting item rental information corresponding to the user when the withdrawal of the item from the opened locker is confirmed; and a step of closing the locker after storing the set item rental information corresponding to the face image.

[0014] A locker control method in a face recognition type electronic locker device according to an embodiment of the present invention, comprising a plurality of lockers and a camera for acquiring a user's face image, wherein the opening and closing of the lockers is controlled using the face image acquired from the camera, wherein the electronic locker device comprises: a step of acquiring a face image through the camera; a step of transmitting the acquired face image to a pre-linked linked server to verify user information corresponding to the face image; a step of identifying a locker in an unoccupied state among the plurality of lockers and allocating an optimal locker among the identified unoccupied lockers based on the verified user information; and a step of storing the allocated locker corresponding to the face image and opening the locker.

[0015] Additionally, the present invention may provide a computer-readable recording medium that records a program for executing the method described above.

[0016] According to an embodiment of the present invention, a face recognition type electronic locker device comprising a plurality of lockers and a camera for acquiring a user's face image, wherein the opening and closing of the lockers is controlled using the face image acquired from the camera, wherein the electronic locker device checks a linked server, and if the requirement of the checked linked server is academic management, after the face image is acquired through the camera, supports attendance processing for the user corresponding to the acquired face image, and upon completion of the user's attendance processing, receives the user's timetable and locker number from the linked server, controls the opening and closing of the locker corresponding to the locker number based on the received timetable, and if the requirement of the checked linked server is management of item rental and return, after the face image is acquired through the camera, checks user information corresponding to the face image, and uses the user information to construct and output a list of items available for rental by the user among the items stored in the locker, and if the user confirms the selection input for at least one item from the item list, opens the locker corresponding to the selected item, and if the withdrawal of the item from the opened locker is confirmed, provides item rental information corresponding to the user. After setting, the closing of the locker is controlled, and if the requirement of the confirmed linked server is management for optimal locker allocation, after a face image is acquired through the camera, user information corresponding to the acquired face image is verified, unoccupied lockers among a plurality of lockers are verified, the optimal locker among the verified unoccupied lockers is allocated based on the verified user information, the allocated locker is stored corresponding to the face image, and the opening of the locker can be controlled. Effects of the invention

[0017] According to an embodiment of the present invention, by acquiring a user's face image through a camera of an electronic locker device and controlling the opening and closing of the locker using the acquired face image, the possibility of theft and fraudulent use is significantly reduced compared to conventional methods using general means (RFID CARD, key, password input), and since there are no issues such as card loss or password reset, more efficient locker management can be achieved.

[0018] In addition, according to an embodiment of the present invention, the electronic locker device can maximize the convenience of a user who wishes to use the locker by supporting the attendance processing of a user who wishes to use the electronic locker according to the requirements of the linked server, controlling the rental and return of items, or assigning the optimal locker among unoccupied lockers to the user.

[0019] In addition, various effects other than those described above may be disclosed directly or implicitly in the detailed description according to an embodiment of the present invention to be described below. Brief explanation of the drawing

[0020] FIGS. 1 to 7 are drawings for explaining a face recognition type electronic locker device according to an embodiment of the present invention. FIGS. 8 and 9 are drawings for explaining the process of controlling an electronic locker device in conjunction with an interlocking server according to an embodiment of the present invention. FIGS. 10 and FIGS. 11 are drawings for explaining a locker control method in a face recognition type electronic locker device according to a first embodiment of the present invention. FIGS. 12 to 14 are drawings for explaining a locker control method in a face recognition type electronic locker device according to a second embodiment of the present invention. FIG. 15 is a drawing for explaining a locker control method in a face recognition type electronic locker device according to a third embodiment of the present invention. Specific details for implementing the invention

[0021] Hereinafter, various embodiments disclosed in this document will be described in detail with reference to the attached drawings. In this document, the same reference numerals are used for identical components in the drawings, and redundant descriptions of identical components are omitted.

[0022] With respect to the various embodiments disclosed in this document, specific structural or functional descriptions are provided merely for the purpose of explaining the embodiments, and the various embodiments disclosed in this document may be implemented in various forms and should not be interpreted as being limited to the embodiments described in this document.

[0023] Expressions such as "first," "second," "first," or "second" used in various embodiments may modify various components regardless of order and / or importance and do not limit said components. For example, without departing from the scope of the embodiments disclosed herein, the first component may be named the second component, and similarly, the second component may be renamed the first component.

[0024] The terms used in this document are used merely to describe specific embodiments and are not intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly indicates otherwise.

[0025] All terms used herein, including technical or scientific terms, may have the same meaning as generally understood by those skilled in the art of the embodiments disclosed herein. Terms defined in commonly used dictionaries may be interpreted as having the same or similar meaning as they have in the context of the relevant technology, and are not to be interpreted in an ideal or overly formal sense unless explicitly defined in this document. In some cases, even terms defined in this document shall not be interpreted to exclude the embodiments disclosed herein.

[0026] Hereinafter, a locker control method according to an embodiment of the present invention and a face recognition type electronic locker device for the same will be described with reference to the drawings.

[0027] First, a face recognition type electronic locker device according to one embodiment of the present invention will be described with reference to FIGS. 1 to 7.

[0028] FIGS. 1 to 7 are drawings for explaining a face recognition type electronic locker device according to an embodiment of the present invention.

[0029] First, referring to FIG. 1, a face recognition type electronic locker device (10) according to one embodiment of the present invention may be configured to include a plurality of lockers (G) equipped with door locks and switching, a face recognition module (F, not shown) that is electrically connected to the lockers (G), transmits and receives control signals via wired and wireless communication, analyzes a face image captured by a camera (110), and controls the switching operation of the lockers (G), and a display (D) that outputs various information.

[0030] A face recognition type electronic locker device (10) according to one embodiment of the present invention may be provided with a structure in which a plurality of individual lockers are stacked, and each individual locker (G) includes a door lock (X) and is assigned a locker number. Such a locker (10) may include a display (D) and enable the operation of opening and closing the locker to be performed through the display (D).

[0031] At this time, the display (D) according to one embodiment of the present invention may be equipped with a camera (110) at a predetermined location, and may capture and acquire a user's face image through the provided camera (110), and control the opening and closing of the door of an individual locker (G) using the acquired face image.

[0032] In addition, the camera (110) according to one embodiment of the present invention may be positioned on the display (D), but is not necessarily limited thereto, and may be positioned in a locker near the display (D) or near a corner.

[0033] Referring more specifically to FIG. 2, a locker control module (F) according to an embodiment of the present invention may be described in more detail. In an embodiment of the present invention, the locker control module (F) may be configured to include a first camera unit (110) that controls the process of capturing a user's face image through a camera, an angle control unit (120) that adjusts the angle of the camera according to the user's movement, an infrared sensor unit (130) that detects whether the user is close according to a temperature change, a judgment control unit (140) that performs various locker controls using the face image, and a switching drive unit (150) that controls the switching unit (210) of the locker (G) according to the control of the judgment control unit (140). It may also be configured to include a first communication unit (160) that performs communication with a linked server (30) or a user's terminal (20). However, it is not limited to the components described above, and some components may not be included depending on the implementation method. For example, the angle control unit (120) may be omitted. Additionally, some components may be included further. For example, any component necessary for performing the locker control method of the present invention described below, such as an audio output unit (not shown) for outputting various information, may be included in the locker control module (F) of the present invention.

[0034] In one embodiment, the first camera unit (110) may be equipped with a face recognition camera, and may be configured as, for example, a face recognition dual camera module, and may use the dual camera module to detect and photograph the user's face and transmit it to be output to the display (D).

[0035] In one embodiment, the angle adjustment unit (120) can adjust the shooting angle, shooting direction, or angle of the infrared sensor (110) of the camera of the first camera unit (110) according to the movement of the user.

[0036] In one embodiment, the infrared sensor unit (130) may be configured to include an infrared sensor that detects infrared radiation emitted from a user's body and an infrared array sensor driving unit (not shown) that converts a measurement value from the infrared sensor (not shown) into an electrical signal.

[0037] The infrared sensor of the infrared sensor unit (130) is composed of an infrared array sensor and can acquire thermal image information of a user composed of thermal image pixels, and the infrared array sensor driving unit can calculate the output voltage of the infrared sensor by a signal from a thermocouple. The infrared sensor is composed of 32x32 pixels and can acquire thermal image information of the subject's thermal image pixels 1 (T1,1) to 1024 (T32,32), and the infrared sensor converts infrared rays emitted through a person's skin into electricity.

[0038] That is, the infrared array sensor driver can perform ambient temperature compensation through an amplified temperature reference voltage and a separate corrected sensor voltage, and the temperature compensation value can also be increased or decreased manually depending on the surrounding environment.

[0039] At this time, the judgment control unit (140) described later can analyze the transmitted temperature and, if it is an abnormal case that deviates from the transmitted temperature and the set reference temperature range, transmit a temperature measurement command again to control the infrared sensor and the infrared array sensor driving unit to perform a re-temperature measurement.

[0040] Referring to FIG. 3, the infrared sensor measures the temperature of a pixel within a set range based on a fixed point corresponding to the user's forehead area displayed through the display (D), and the infrared array sensor driving unit can provide the highest value among the measured values ​​of the pixels within the set range to the judgment control unit (140).

[0041] For example, a person entering the building may measure their body temperature by standing on a platform 30 cm away from the sensor, and at this time, the person may position the center of their forehead on a fixed red dot on the screen displayed through the display (D), and only the 64 pixels fixed at the center of the forehead can be measured.

[0042] Accordingly, the infrared array sensor driving unit can transmit only the maximum value of the calculated temperature value from the effective pixels (64 pixels) to the judgment control unit, and can calculate the transmitted maximum value and display it through the information display unit.

[0043] In addition, the infrared sensor unit (130) of the present invention can always remain active even when the electronic locker device (10) is in a low-power state, and can also perform the process of waking up the camera first by detecting a temperature change in a low-power state.

[0044] In one embodiment, the judgment control unit (140) performs the role of controlling the locker opening and closing process using a face image and can perform the locker control process according to the first to third embodiments described below. To this end, it may include a process for processing user face recognition, and after specifying the location of a person's face, it recognizes different faces by analyzing the number of combinations of identifiable detailed face components, such as the shape and number of eyebrows and the shape and number of wrinkles. Other components may include various variables such as the size of the forehead area, differences in eye shape, length / shape of the nose, shape of the lips, shape of the ears, etc., to recognize the user's face.

[0045] At this time, the judgment control unit (140) of the present invention may analyze the user's face image using an artificial intelligence model (300). The artificial intelligence model (300) at this time may be a lightweight artificial intelligence model stored in the electronic locker device (10), or may be stored in a linked server (30) or a management server (not shown) for managing a separate electronic locker device (10).

[0046] For example, the artificial intelligence model (300) of the present invention may include a multi-stage neural network structure based on a Convolutional Neural Network (CNN), and may generate feature vectors by extracting a whole or partial facial region (eyes, eyebrows, distance between eyes, forehead contour, position of cheekbones, etc.) from a user's face image.

[0047] In particular, even when a user is wearing a mask, a sophisticated matching process can be performed focusing on upper facial feature points not obscured by the mask (eye shape, eye position, eyebrow thickness, forehead curvature and proportion, etc.), including training data from when the user is not wearing a mask. This enables the identification of entrants with high accuracy, regardless of whether a mask is worn.

[0048] The results of such analysis can be linked with an internal database (not shown) or a linked server (30) to determine whether they match, and users can be identified and analyzed using cases where a similarity of a certain standard or higher (e.g., 95% or higher) is confirmed.

[0049] In addition, the judgment control unit (140) according to one embodiment of the present invention can basically support the storage and retrieval process of items. For example, as shown in FIG. 4, a user who wishes to store items in the electronic locker device (10) of the present invention may access the display (D). Depending on the implementation method, the display (D) in a low-power state may detect the user's access by using a temperature change, activate the display (D), and select input necessary content, such as item storage (1) and item retrieval (20), or output a message (3) guiding the shooting location. Additionally, shooting may be performed according to the user's touch input. The message at this time may vary depending on the implementation method; for example, if the electronic locker device (10) manages the rental and return of items, message 1 may be displayed as item rental and message 2 as item return.

[0050] Additionally, a user's face image can be acquired through a camera (110) and matched with the locker and the face image, and depending on the implementation method, various information related to locker control may be output from the terminal (20) through a user's terminal (20) that can be linked as shown in FIGS. 5 and 6. In order for the electronic locker device (10) to communicate with the terminal (20), depending on the implementation method, the terminal (20) identification information may be entered into the electronic locker device (10).

[0051] In addition, when the electronic locker device (10) is linked with the terminal (20), if face image-based authentication is unavoidable, for example, if it is impossible to obtain an accurate face image through a camera, user authentication can be attempted based on a security code. In this case, according to the implementation method as shown in FIG. 7, a security code can be transmitted to the terminal (20) and a guidance message (4) can be output. The user can also attempt to open the locker (6) by directly selecting and inputting the security code received through the terminal (20) using a button (5).

[0052] Meanwhile, in FIG. 2, the locker (G) of the present invention may be configured to include a switching unit (210) that controls the switching of the locker door, a door lock (220) that controls the locking and unlocking of the door, and a second camera unit (230) that controls an internal camera for recognizing items inside the locker. Depending on the implementation method, it may also be configured to include an alarm display unit (240) that displays an alarm and a second communication unit (250) that communicates with a locker control module (F) or communicates with a terminal (20).

[0053] The basic configuration and operation of the electronic locker device (10) according to one embodiment of the present invention have been described above.

[0054] An electronic locker device (10) according to one embodiment of the present invention can be installed in various places such as schools, academies, companies, and research institutes, and after being installed in various places, can perform locker control corresponding to the requirements of the linked server (30).

[0055] This will be explained with reference to Figs. 8 and 9.

[0056] FIGS. 8 and 9 are drawings for explaining the process of controlling an electronic locker device in conjunction with a linkage server according to an embodiment of the present invention. First, as shown in FIG. 8, the electronic locker device (10) according to an embodiment of the present invention can check the requirements of the linkage server (30) when communicating with the linkage server (30) after being initially installed, for example, at a specific location. The requirements at this time can be set by an administrator managing the linkage server (30), for example, academic management, management of the rental and return of items, and management for optimal locker allocation.

[0057] At this time, the electronic locker device (10) according to an embodiment of the present invention may receive control logic corresponding to the requirements from a separate management server (not shown) after confirming the requirements of the linkage server (30), and may be distributed with all control logic included according to the implementation method, and may perform operation in a form that deletes unnecessary control logic in consideration of the requirements of the linkage server (30).

[0058] The control logic performed by the electronic locker device (10) according to one embodiment of the present invention is a locker control method according to the first to third embodiments described below, which is linked with a linkage server (30) and locker control according to the requirements of the linkage server (30). For example, if the requirement is academic management, locker control can be performed according to the first embodiment; if the requirement is management of the rental and return of items, locker control can be performed according to the second embodiment; and if the requirement is management for optimal locker allocation, locker control can be performed according to the third embodiment.

[0059] In this case, if the entity selling the electronic locker device (10) and the entity operating the linkage server (30) are different, the entity operating the linkage server (30) may be a customer of the entity selling the electronic locker device (10), and the electronic locker device (10) may perform locker control processes according to various additional embodiments other than the first to third embodiments according to the requirements of the customer.

[0060] Meanwhile, the electronic locker device (10) linked to the linked server (30) according to one embodiment of the present invention may be implemented in a single form, but the linked server (30) and a plurality of electronic locker devices (10) may be linked.

[0061] In addition, in a locker control method using an electronic locker device (10) according to an embodiment of the present invention, the locker control includes the process of the electronic locker device (10) opening or closing a specific locker, and the meaning of opening a locker as defined in this specification means a state transition in which the locking state of the locker is released so that the door can be opened, and the meaning of closing a locker means a state in which the locker is set to a locked state so that the door is not opened. That is, opening a locker does not mean a state in which the door is completely opened, but rather a state in which the lock is unlocked.

[0062] As described with reference to FIG. 1, the electronic locker device (10) according to the embodiment of the present invention includes a plurality of lockers (G) and a camera (110) that acquires a user's face image, and can control the opening and closing of the lockers using the face image acquired from the camera (110). It is installed in a specific location such as a school, company, or research institute and performs locker control in response to a linked server (30). In this case, the electronic locker device (10) may preferably perform power control based on whether a user accesses it.

[0063] For example, power control in the electronic locker device (10) according to an embodiment of the present invention is performed using an infrared sensor as described above. Referring to FIG. 9, a locker control method considering power control in the electronic locker device according to an embodiment of the present invention can be switched to a low-power state when it is determined that there is no user access for a certain period, such as 5 minutes or more (S10). At this time, when switching to a low-power state, all modules except the infrared sensor, such as the camera, locker, and locker control module, can be switched to a sleep state, and only the infrared sensor is activated in an ultra-low power state.

[0064] Then, using an infrared sensor included in the electronic locker device (10), it can first check whether a user is approaching within a certain radius, for example, 2.5m. When a temperature change caused by the user's approach within the certain radius is detected through the infrared sensor (S11), the electronic locker device (10) wakes up the camera (S12), and then, when the user's face image is acquired through the camera (S13), all modules of the electronic locker device (10), such as the sound output module, communication module, locker, etc., all controllable modules are woke up so that the subsequent locker control method can be processed (S14).

[0065] Hereinafter, a process of performing locker control when the requirements of the linked server (30) are academic management is described, while the face recognition type electronic locker device (10) according to one embodiment of the present invention is assigned to one user for a certain period (semester, grade, etc.) such as a high school or university.

[0066] FIGS. 10 and FIGS. 11 are drawings for explaining a locker control method in a face recognition type electronic locker device according to a first embodiment of the present invention.

[0067] First, referring to FIG. 10, the electronic locker device (10) according to the first embodiment of the present invention is preferably installed in a specific location (classroom, lecture room, etc.) and may be occupied by matching each locker with a user in advance by semester or grade.

[0068] In this state, the electronic locker device (10) according to an embodiment of the present invention can acquire a user's face image through a camera (S100). At this time, the electronic locker device (10) according to an embodiment of the present invention can wake up the camera by detecting a temperature change of an infrared sensor in a low-power state, as described in FIG. 9, and when a face image is acquired through the camera, all modules are activated and can be switched to a state where they can communicate with the linked server (30).

[0069] Afterwards, the electronic locker device (10) according to the embodiment of the present invention can store the acquired face image internally and can transmit the face image and electronic locker location information (e.g., identification information for the classroom or classroom location coordinate information) to the linked server (30) (S110).

[0070] Subsequently, the linkage server (30) performs user authentication using face images and electronic locker location information (S120). For this purpose, the linkage server (30) according to a preferred embodiment of the present invention may have all user information and face images matched and stored in advance. The linkage server (30) in the first embodiment is, for example, a system server that performs academic management, and has all user information matched and stored with face images in advance. When a face image is transmitted from the electronic locker device (10) of the present invention, the face image is compared with the face image stored in advance, thereby enabling user authentication to be easily performed.

[0071] Subsequently, if user authentication is successfully completed, the linkage server (30) determines whether the user authentication is the first user authentication of the day, and if it is the first user authentication, the user can be processed as having attended the place (school) (S130 ~ S140). Through this, the linkage server (30) according to the embodiment of the present invention can perform academic management more efficiently using the face recognition type electronic locker device (10).

[0072] Afterward, the linkage server (30) transmits the user authentication result to the electronic locker device (10) (S150), and the electronic locker device (10) can output the authentication result (S160). At this time, the authentication result may be output as voice through a speaker or through a display (D). For example, as shown in FIG. 11, the authentication result is output through the display (D). If user authentication is successful, the linkage server (30) transmits user information and the locker number of the user to the electronic locker device (10), and the electronic locker device (10) may compose a message (1010) including user information and the locker number of the user, and may also query whether to open the locker (1020, 1030). Here, the query regarding whether to open the locker is a query regarding whether to open the locker immediately, and even if the user selects No (1030), the electronic locker device (10) can control the opening and closing of the locker based on a subsequent timetable.

[0073] Subsequently, the electronic locker device (10) according to an embodiment of the present invention may analyze the user's emotions (S170). This may involve analyzing the emotions by further acquiring a face image of the user who is continuously looking at the display (D) in FIG. 11 through a camera (1030), or by analyzing the emotions using only the face image acquired and stored in step S100. Additionally, if the user is having a conversation with another user, the user's voice may be further collected through a microphone (not shown), or sounds from the surrounding environment may be further collected to analyze the user's emotional state. Since the process of analyzing the user's emotions can utilize various known configurations, a detailed description is omitted.

[0074] Subsequently, the electronic locker device (10) according to an embodiment of the present invention may transmit the analyzed emotion to the linked server (30) when the analyzed emotion corresponds to a preset emotion (S180), for example, a negative emotion such as irritation, anger, or depression. At this time, the grade of the negative emotion may be determined so that negative emotions with a low grade (e.g., irritation) are not transmitted, and only negative emotions with a high grade (e.g., depression, anger, etc.) are transmitted to the linked server (30) (S190).

[0075] The linked server (30) that receives this may allocate counseling time in a pre-set timetable corresponding to the user, and may adjust the timetable based on user emotional information by replacing break time with counseling time, or selecting a subject based on pre-set criteria during class time, such as arts and physical education subjects like physical education and music, or subjects for self-study among subjects where the user's academic achievement is high, such as mathematics and English, and replacing the selected time with counseling time (S200).

[0076] In this way, the linked server (30) capable of linking with the electronic locker device (10) according to the embodiment of the present invention can more easily identify the emotions of the user (student) through the electronic locker device (10), and automatically set a counseling time based on the identified emotions, thereby enabling the effect of preventing depression, school violence, etc. that may occur among student users.

[0077] Afterwards, the linked server (30) according to the embodiment of the present invention can transmit the timetable adjusted based on user emotion information to the electronic locker device (10) (S210).

[0078] Upon receiving this, the electronic locker device (10) can control the opening and closing of the locker based on the timetable. At this time, the locker opening and closing control can preferably be performed on a daily basis; for example, if the corresponding day is Monday, the locker opening and closing control for users who have completed attendance can be performed based on the Monday timetable. When controlling the opening and closing of the locker, in one embodiment, the locker of the user can be closed during a time interval not defined as a break time, and the locker of the user can be opened during a time interval defined as a break time. This allows for more effective control of locker opening and closing even when users perform activities based on different timetables, and allows the user to use the locker more conveniently as the locker is automatically opened without having to enter a password every time during break time.

[0079] In addition, the electronic locker device (10) according to one embodiment of the present invention can further acquire an image of the inside of the locker through a camera inside the locker (S220), and control the opening and closing of the locker using a timetable and the image of the inside of the locker (S230). The electronic locker device (10) according to the embodiment of the present invention may keep the locker open during break time based on the timetable, but if it is determined that an item needed for the next class has not yet been retrieved, the locker may be kept open for a predetermined period even after the break time has ended. Through this, if a user forgets to retrieve an item needed for the next class during break time, the item can be retrieved more quickly from the opened locker within 5 minutes immediately after the class starts.

[0080] In addition, the electronic locker device (10) of the present invention may further link with the user's terminal (20) to transmit various information related to locker control to the terminal (20), and after the user's attendance processing is completed and a timetable is received from the linkage server (30), the image inside the locker can be checked through an internal camera to determine whether the items needed for the day are in the locker, and if the items needed for the day are not in the locker, a notification regarding this may be transmitted to the terminal (20) or an alarm (indicator light) may be displayed on the locker (G).

[0081] In addition, the electronic locker device (10) of the present invention may support opening the locker based on a door lock password in preparation for emergency situations. If locker opening based on a door lock password is confirmed before acquiring the face image of the first user of the day through the camera (110) in step S100, a notification may be output indicating that acquiring a face image using the camera is necessary or that attendance processing based on the face image is necessary. At this time, the notification may be output in text form through the display (D), output through a provided sound output module (not shown), or output to the user's terminal (20).

[0082] Above, a locker control method in a face recognition type electronic locker device (10) according to the first embodiment of the present invention has been described.

[0083] Hereinafter, a locker control method in a face recognition type electronic locker device (10) according to the second embodiment of the present invention will be described.

[0084] FIGS. 12 to 14 are drawings for explaining a locker control method in a face recognition type electronic locker device according to a second embodiment of the present invention.

[0085] First, referring to FIG. 12, the electronic locker device (10) according to the second embodiment of the present invention is preferably installed in a specific location (company, research institute, etc.) and is an embodiment of performing locker control according to the requirements of an interconnected server (30) that wishes to manage the rental of items to users who wish to store and rent items.

[0086] To this end, the electronic locker device (10) according to an embodiment of the present invention can first acquire a user's face image through a camera while storing items (S300). At this time, the electronic locker device (10) according to an embodiment of the present invention can wake up the camera by detecting a temperature change of an infrared sensor in a low-power state, as described in FIG. 9, and when a face image is acquired through the camera, all modules can be activated and the device can be converted to a state where it can communicate with the linked server (30).

[0087] In addition, the electronic locker device (10) according to the second embodiment of the present invention can output a display (D) as shown in FIG. 4 above as a user approaches, and after the user selects to start shooting (3), a face image can be acquired through the camera (11), and depending on the implementation method, the screen shown in FIG. 4 can be output after the face image is first acquired through the camera (110). At this time, the message for starting shooting (3) may be changed.

[0088] Subsequently, the electronic locker device (10) according to an embodiment of the present invention may store the acquired face image internally and transmit the face image and electronic locker location information (e.g., identification information regarding the installation location, physical coordinate information, etc.) to the linkage server (30) (S310). At this time, if the electronic locker device (10) linked to the linkage server (30) is a single unit, the electronic locker location information may be omitted and only the face image may be transmitted.

[0089] Subsequently, the linkage server (30) checks user information using face images and electronic locker location information (S320). For this purpose, the linkage server (30) according to a preferred embodiment of the present invention is a server that manages users registered with a specific institution such as a company or research institute, and stores the information and face images of all affiliated users by matching them. When a face image is transmitted from the electronic locker device (10), the user information can be checked by comparing the face image with the stored face image (S320).

[0090] Then, the linkage server (30) transmits the verified user information to the electronic locker device (10) (S330). The user information according to the embodiment of the present invention may include, for example, basic user information such as name, affiliation, and position.

[0091] Subsequently, the electronic locker device (10) according to an embodiment of the present invention can configure a message (1040) as shown in FIG. 12 based on user information received from the linkage server (30) and output it to the display (D), and output a list of items available for rent (1050) of the user using the user information (S340).

[0092] For example, when the electronic locker device (10) is storing experimental tools, protective clothing, sensor kits, and expensive analysis equipment, if the user information is checked and the user is a principal researcher, the principal researcher can compile and output a list of items available for rent, and the user can select items they wish to rent from among them (S350).

[0093] At this time, although the electronic locker device (10) of the present invention has been described as an example of outputting a message and a list of rentable items through a display (D) in FIG. 12, it is not necessarily limited thereto. If it is possible to link with a user's terminal (20), it may be output through the terminal (20). Depending on the implementation method, if the electronic locker device (10) supports voice, it may output a list of rentable items in voice and confirm selection input through the user's voice.

[0094] Subsequently, the electronic locker device (10) of the present invention can open a locker corresponding to an item selected by the user (S360). For example, if the items are of different sizes and cannot fit into a single locker, item A can be placed in locker A001 and item B can be placed in locker B001, and when the selection input for items A and B is confirmed by the user, each of the corresponding lockers can be opened.

[0095] Subsequently, the electronic locker device (10) of the present invention can confirm the withdrawal of an item from the locker (S370). Confirmation of the withdrawal of an item may be performed using an internal camera or a weight sensor located inside each locker, and when the withdrawal of an item is confirmed (S370), the electronic locker device (10) can set item rental information and output it (S280).

[0096] The process of setting item rental information can be set using user information. For example, by checking the position in the verified user information, if the position is from employee to assistant manager, the corresponding grade can be confirmed as '1', and if the position is from manager to team leader, the grade can be confirmed as '2'. These grades may be changed through prior consultation with the linked server (30), as an example.

[0097] Subsequently, the electronic locker device (10) of the present invention can check the user's grade and, considering the confirmed grade and the type of item, set at least one of the following rental information: rental period for the item, whether and how many times extension is possible, penalty information for overdue return, and whether return by proxy is possible. For example, if the grade is '1' and the item has a short usage period, the item rental information can be set in the form of 'one day, no extension possible, penalty for overdue return, return by proxy impossible'.

[0098] In addition, the electronic locker device (10) of the present invention can output set item rental information through the display (D) of the electronic locker device (10), transmit it to the user's terminal (20), and transmit it to the linkage server (30) so that the linkage server (30) can perform management by linking it with user information.

[0099] Afterwards, the electronic locker device (10) of the present invention stores item rental information and closes the locker (S390 ~ S400).

[0100] The subsequent item return process will be explained with reference to Fig. 14.

[0101] In FIG. 14, the electronic locker device (10) according to an embodiment of the present invention can confirm a request to return an item (S410). At this time, the confirmation of the item return request can be confirmed by the user selecting and inputting 'item return' on a user interface screen displayed through the display (D), and depending on the implementation method, the item return request can also be confirmed when an image of an item, rather than an image of the user's face, is captured by the camera.

[0102] Subsequently, the electronic locker device (10) of the present invention acquires a new face image upon confirmation of a request to return an item (S420), and compares the acquired face image with a face image stored in correspondence with the item rental information for the item to determine whether they are the same face image (S440). At this time, if they are not the same face image, the device can query the linkage server (30) to check whether a representative return is set for the item requested for return (S450). Then, if the electronic locker device (10) of the present invention confirms that a representative return is set for the item, it opens the locker of the item (S470) and confirms the entry of the item into the locker (S480). The entry of the item can be confirmed through an internal camera or through an internal sensor.

[0103] In addition, if it is confirmed in step S460 that a prior agent return setting has not been configured for the item, the electronic locker device (10) does not open the locker of the item, and since a agent return setting has not been configured, it may inform the user who rented the item and the user who brought the item to return it that the user who rented the item must return it directly.

[0104] In addition, the electronic locker device (10) may automatically learn the agent relationships that are frequently set according to the implementation method, calculate the reliability, and automatically set the next automatic agent return authority according to the reliability.

[0105] Afterward, the electronic locker device (10) according to an embodiment of the present invention can check whether it is a valid return (S490). Here, a valid return is determined based on item rental information stored corresponding to the face image. For example, if, as a result of checking the item rental information, the rental period is 1 day and the item is returned normally within 1 day, a predetermined score can be given to the user who rented the item (S500), and the score can be used to manage the user in the linked server (30).

[0106] On the other hand, if it is found that the rental information of the item is checked and the rental period is 1 day and cannot be extended, but the return is overdue by 3 days, a certain penalty may be imposed on the user who rented the item to the electronic locker device (10) of the present invention, and the penalty may be used to manage the user in the linked server (30), just like a score.

[0107] In addition, the aforementioned score or penalty can also be used to set the rental period of the corresponding user's items in the electronic locker device (10). For example, a user with a high score assigned based on past item rentals may set a longer rental period when renting other items in the future, and if the penalty exceeds a certain amount, item rental may be prohibited.

[0108] Afterward, the electronic locker device (10) of the present invention can close the locker, and the user can more conveniently rent and return items in a non-face-to-face manner based on a face image.

[0109] In addition, the linked server (30) that intends to manage users can perform user management using scores and penalties calculated based on the rental or return of items, and can dynamically apply user policies such as assigning grades, restricting usage, and setting priorities for user management.

[0110] Above, a locker control method in a face recognition type electronic locker device (10) according to the third embodiment of the present invention has been described.

[0111] Hereinafter, a locker control method in a face recognition type electronic locker device (10) according to the third embodiment of the present invention will be described.

[0112] FIG. 15 is a drawing for explaining a locker control method in a face recognition type electronic locker device according to a third embodiment of the present invention.

[0113] First, the electronic locker device (10) according to the third embodiment of the present invention is preferably installed in advance at a specific location (university, company, research institute, gym, etc.), and unlike the first embodiment in which a locker and a user are matched and fixed for a predetermined period, this embodiment allows the user who wishes to use the locker when needed to be assigned an optimal locker through face image-based authentication.

[0114] To this end, the electronic locker device (10) according to an embodiment of the present invention can first acquire a user's face image through a camera (S600). At this time, the electronic locker device (10) according to an embodiment of the present invention can wake up the camera by detecting a temperature change of an infrared sensor in a low-power state, as described in FIG. 9, and when a face image is acquired through the camera, all modules can be activated and the device can be converted to a state where it can communicate with the linked server (30).

[0115] Afterwards, the electronic locker device (10) according to the embodiment of the present invention can transmit a face image and electronic locker location information (e.g., identification information about the installation location, physical coordinate information, etc.) to the linked server (30) (S610).

[0116] Afterwards, the linkage server (30) checks user information using a face image and electronic locker location information (S620). To do this, the linkage server (30) according to a preferred embodiment of the present invention may store information about a user who wishes to use the locker by matching it with a face image.

[0117] At this time, the linkage server (30) may be a management server capable of managing information about users affiliated with a university, company, etc., and thus may have information about all affiliated users and face images pre-matched and stored.

[0118] In addition, the linkage server (30) may be a management server that intends to provide a locker rental service using an electronic locker device (10) installed at a specific location, and may provide a service application for this purpose to a terminal (20) of a user who intends to use the locker in advance, and the user who intends to use the locker may be in a state where the application supported by the linkage server (30) is installed on the terminal (20) in advance and is directly subscribed to the service provided by the linkage server (30) through the user's terminal (20).

[0119] When a face image is transmitted from the electronic locker device (10), the linked server (30) verifies user information by comparing it with a previously stored face image and transmits the user information to the electronic locker device (10) (S630). The user information according to an embodiment of the present invention may include at least one of user basic information (e.g., name, gender, height, age, tendencies, etc.), past usage information, schedule information, item information, and environmental information (e.g., weather, temperature, etc.).

[0120] However, it is not necessarily limited to this, and the linkage server (30) transmits only basic user-related information, such as user basic information and past usage information, to the electronic locker device (10), and other schedule information and item information may be entered directly by the user in the electronic locker device (10) or set immediately through the terminal (20).

[0121] When user information is obtained through this process, the electronic locker device (10) can predict the time spent using the user information (S640).

[0122] In this case, the duration of stay can basically be predicted by utilizing certain information from the user data. Additionally, if past usage data is available, the average duration of stay based on that data can be calculated and used to predict the duration of stay; furthermore, environmental information, such as whether it is raining, can be additionally considered to predict the duration of stay.

[0123] Meanwhile, if the user information includes only basic user information, the electronic locker device (10) may use the basic user information to predict the user's stay time or allocate a locker, for example, whether the user has a fast movement speed of 20s, a slow movement speed of 60s, or whether the user is tall or short.

[0124] In addition, the electronic locker device (10) according to an embodiment of the present invention may predict the user's stay time by inputting confirmed user information into a pre-trained artificial intelligence model (300). At this time, depending on the implementation method, the input values ​​input into the artificial intelligence model (300) may be the day of the week, time of day, basic user information, past usage information (average stay time, etc.), schedule information, electronic locker location information, environmental information (weather, etc.).

[0125] In addition, the artificial intelligence model (300) of the present invention can be a time series prediction model, and through the artificial intelligence model (300), it can be predicted that a user who intends to use the locker at 10 o'clock will retrieve an item from the locker at 2 o'clock.

[0126] After predicting the user's stay time through this process, the electronic locker device (10) of the present invention can assign an optimal locker among the unoccupied lockers by considering the predicted stay time (S650). At this time, the electronic locker device (10) of the present invention can assign an optimal locker by considering at least one of a defined compensation function regarding the degree of congestion or the efficiency of locker usage regarding whether other users are using the locker at the time of use according to the predicted stay time. For example, assuming that the user's predicted stay time is predicted to be until 2:00 PM and there are unoccupied lockers A002 and B001, the electronic locker device (10) considers the case where users occupying other lockers among the unoccupied lockers are expected to use the locker at 2:00 PM. If it is determined that A002 has a low degree of congestion regarding users occupying other lockers at 2:00 PM and B001 has a high degree of congestion at 2:00 PM, the electronic locker device (10) can select A002, which has a low degree of congestion, as the optimal locker and assign it to the user.

[0127] In addition, the electronic locker device (10) of the present invention may use an artificial intelligence model (300) that has been trained to input user information into the artificial intelligence model (300) and output an optimal locker as an output value, and the artificial intelligence model (300) may be in a state of optimized training by considering a defined compensation function for locker usage efficiency. At this time, the defined compensation function may define a compensation function that considers locker turnover rate, minimization of collisions between users, and prediction error penalty, and may assign a locker optimized by the compensation function.

[0128] Once the optimal locker is assigned through this process, the assigned locker is stored corresponding to the face image (S660), and the locker is opened (S670) to support the storage of the user's items.

[0129] Meanwhile, when storing in correspondence with the face image at the S660 stage, feature vectors can be extracted based on the face image, and then the extracted feature vectors can be mapped and stored in correspondence with user information.

[0130] This can enhance personal information protection. For example, when the electronic locker device (10) of the present invention is located in a gym, sauna, etc., assigning an optimal locker considering the user's stay time, congestion level, etc. can increase user convenience. However, since there is a possibility of personal information leakage by storing the user's face image itself, depending on the implementation method, the face image itself may not be stored, and only vector values ​​may be extracted and stored. In this case, preferably, without linking with the linking server (30), user information may be verified based on the face image extracted in step S600, and an optimal locker may be assigned using only basic user information such as gender, height, etc.

[0131] Meanwhile, the electronic locker device (10) that has verified user information in step S650 checks the user's schedule, and if it is determined that there is another electronic locker device at the location corresponding to the verified schedule, it may request the linkage server (30) to make a reservation for the other electronic locker device. For example, even if the user has taken a face image at the electronic locker device located at location A, the optimal electronic locker device can be determined based on the user's meeting schedule, whether there is a meeting today, etc., and a request can be made to make a locker reservation to that electronic locker device.

[0132] This allows for the allocation of more optimized lockers by considering various user environments, thereby enhancing user convenience.

[0133] For the above, a locker control method according to an embodiment of the present invention has been described.

[0134] The locker control method according to the embodiment of the present invention as described above may be provided in the form of a computer-readable medium suitable for storing computer program instructions and data.

[0135] Computer-readable media suitable for storing such computer program instructions and data include, for example, recording media such as magnetic media (e.g., hard disks, floppy disks, and magnetic tapes), optical recording media (e.g., CD-ROM, Digital Video Disk), and floptical disks (e.g., magneto-optical media), and semiconductor memories such as ROM (Read Only Memory), RAM (Random Access Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM). Processors and memory may be supplemented by or integrated with special-purpose logic circuits.

[0136] Furthermore, computer-readable recording media may be distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner. Additionally, the functional program for implementing the present invention, along with related code and code segments, may be easily inferred or modified by programmers skilled in the art to which the present invention pertains, taking into account the system environment of the computer that reads the recording media to execute the program.

[0137] In addition, a computer program recorded on a computer-readable recording medium as described above includes instructions that perform the functions described above, and can execute the aforementioned functions by being distributed and circulated through the recording medium, read, installed, and executed on a specific device or specific computer.

[0138] The present invention has been described with reference to embodiments illustrated in the drawings, but this is merely illustrative, and those skilled in the art will understand that various modifications and equivalent alternative embodiments are possible therefrom. Accordingly, the true technical scope of protection of the present invention should be determined by the technical concept of the claims. Explanation of the symbols

[0139] 10: Electronic locker device 20: Terminal 30: Integration Server

Claims

Claim 1 A locker control method in a face recognition type electronic locker device comprising a plurality of lockers and a camera for acquiring a user's face image, wherein the opening and closing of the lockers is controlled using the face image acquired from the camera, the method comprising: a step of the electronic locker device acquiring a face image through the camera; a step of transmitting the acquired face image to a pre-linked linked server to support attendance processing of a user corresponding to the face image; a step of receiving the user's timetable and locker number from the linked server upon completion of the user's attendance processing; and a step of controlling the opening and closing of a locker corresponding to the locker number based on the received timetable; wherein the step of controlling the opening and closing of the lockers controls the locker to be closed during a time interval not defined as a break time in the timetable and to be opened during a time interval defined as a break time, and further controls the opening and closing of the lockers by utilizing an internal image of the locker acquired through an internal camera of the locker. Claim 2 A locker control method according to claim 1, wherein the step of supporting the attendance processing of the user comprises: a step of requesting user authentication by transmitting the acquired face image and electronic locker location information to the linkage server; and a step of receiving and outputting a user authentication result from the linkage server that occurs when user authentication is successful and the user authentication is the first user authentication of the day, thereby completing the attendance processing. Claim 3 A locker control method characterized by comprising: a step of analyzing user emotion information based on the acquired face image after the step of supporting the user's attendance processing in claim 1; and a step of transmitting the user emotion information to the linked server so that a timetable adjustment based on the user emotion information is performed when the analyzed user emotion information corresponds to a preset emotion. Claim 4 delete Claim 5 A locker control method according to claim 1, further comprising the step of outputting a notification that face image acquisition using the camera is required when locker opening is confirmed based on a door lock password provided in the locker prior to the step of acquiring the face image. Claim 6 A locker control method in a face recognition type electronic locker device comprising a plurality of lockers and a camera for acquiring a user's face image, wherein the opening and closing of the lockers is controlled using the face image acquired from the camera, the method comprising: a step of the electronic locker device acquiring a face image through the camera; a step of transmitting the acquired face image to a pre-linked linked server to receive user information corresponding to the face image; a step of constructing and outputting a list of items available for rent by the user among the items stored in the lockers using the user information; a step of opening a locker corresponding to the selected item when the user confirms the selection input for at least one item among the item list; a step of setting item rental information corresponding to the user when the withdrawal of the item from the opened locker is confirmed; and a step of storing the set item rental information corresponding to the face image and then closing the locker. Claim 7 A locker control method according to claim 6, wherein the step of configuring and outputting the item list is characterized by outputting the list of rentable items through at least one of a display equipped with the list of rentable items and a user's terminal. Claim 8 A locker control method according to claim 6, wherein the step of setting the item rental information comprises: a step of verifying the user's grade through the user information; and a step of setting item rental information including at least one of a rental period, whether extension is possible and the number of times, penalty information for overdue return, and whether return by proxy is possible, taking into consideration the verified grade and the type of item. Claim 9 A locker control method according to claim 6, further comprising: a step of confirming a return request for the item after the step of closing the locker; a step of obtaining a face image of a user who wishes to return the item; a step of comparing the face image of the user who wishes to return the item with the face image of the user who rented the item; a step of opening the locker corresponding to the item if the comparison result indicates that the face images are the same; a step of, if the entry of the item into the opened locker is confirmed, checking the item rental information stored corresponding to the user's face image to determine whether it is a valid return; and a step of assigning a score to the user who rented the item if it is determined to be a valid return. Claim 10 A locker control method according to claim 9, further comprising: a step of opening a locker corresponding to the item, wherein if the comparison result is not the same face image, querying the linked server to check whether an agent return is set corresponding to the item requested for return; and if the confirmation result is that an agent return is set, opening the locker corresponding to the item. Claim 11 A locker control method in a face recognition type electronic locker device comprising a plurality of lockers and a camera for acquiring a user's face image, wherein the opening and closing of the lockers is controlled using the face image acquired from the camera, the method comprising: a step of the electronic locker device acquiring a face image through the camera; a step of transmitting the acquired face image to a pre-linked linked server to verify user information corresponding to the face image; a step of identifying an unoccupied locker among the plurality of lockers and assigning an optimal locker among the identified unoccupied lockers based on the verified user information; and a step of storing the assigned locker corresponding to the face image and opening the locker. Claim 12 A locker control method according to claim 11, characterized in that user information corresponding to the face image includes at least one of user basic information, past usage information, schedule information, item information, and environment information. Claim 13 A locker control method according to claim 11, wherein the allocating step comprises: a step of inputting the identified user information into a pre-trained artificial intelligence model to predict the user's dwell time; and a step of allocating an optimal locker by considering the predicted dwell time, while considering the congestion level regarding whether other users are using the locker at the time of use according to the predicted dwell time. Claim 14 A locker control method according to claim 11, further comprising the step of the allocating step of verifying the user's schedule through the verified user information, and if it is determined that there is another electronic locker device at the corresponding location according to the verified schedule, requesting a reservation for the other electronic locker device from the linked server. Claim 15 A locker control method according to claim 12, wherein the step of opening the locker is characterized by extracting a feature vector based on the face image, mapping and storing the extracted feature vector in correspondence with user information, and opening the locker. Claim 16 A computer-readable recording medium having a program that executes a method described in any one of paragraphs 1 through 3 and paragraphs 5 through 15. Claim 17 A face recognition type electronic locker device comprising a plurality of lockers and a camera for acquiring a user's face image, wherein the opening and closing of the lockers is controlled using the face image acquired from the camera, wherein the electronic locker device checks a linked server, and if the requirement of the checked linked server is academic management, after the face image is acquired through the camera, supports attendance processing for the user corresponding to the acquired face image, and upon completion of the user's attendance processing, receives the user's timetable and locker number from the linked server, controls the opening and closing of the locker corresponding to the locker number based on the received timetable, and if the requirement of the checked linked server is management of item rental and return, after the face image is acquired through the camera, checks user information corresponding to the face image, constructs and outputs a list of items available for rental by the user among the items stored in the locker using the user information, and if the user confirms the selection input for at least one item from the item list, opens the locker corresponding to the selected item, and if the withdrawal of the item from the opened locker is confirmed, sets item rental information corresponding to the user and then the locker An electronic locker device characterized by controlling closure, and if the requirement of a verified linked server is management for optimal locker allocation, after a face image is acquired through the camera, verifying user information corresponding to the acquired face image, identifying a locker in an unoccupied state among a plurality of lockers, allocating the optimal locker among the identified unoccupied lockers based on the verified user information, storing the allocated locker corresponding to the face image, and controlling the opening of the locker. Claim 18 An electronic locker device according to claim 17, characterized in that, if a temperature change is detected through an infrared sensor before acquiring the face image, a camera in a low-power state is activated, and then the face image is acquired through the activated camera.

Images