Smart mirror kiosk system capable of face recognition

Abstract

A smart mirror kiosk system capable of face recognition, according to the present invention, comprises: a smart mirror that performs a general mirror function during normal times, and when a user approaches, activates a face recognition means to recognize the user's face, and then activates an interface touch screen that enables the user to perform a subsequent operation; a plurality of local servers that are connected to the smart mirror via the Internet and store facility management, data (information) and image file management, access control based on face recognition, and various types of data and information related to a common residential facility or a public facility where the smart mirror is installed for use; and a community server that relays the plurality of local servers with an external cloud server, and connects the external cloud server to a community device of the common residential facility or the public facility.

Description

Smart Mirror Kiosk System with Facial Recognition

[0001] The present invention relates to a smart mirror kiosk system capable of facial recognition, and more specifically, to a smart mirror kiosk system capable of facial recognition, which performs a general mirror function in normal times, controls entry only to registered persons through a built-in facial recognition device when a user enters and exits, thereby maintaining security, and provides the convenience of a one-stop solution for use by automatically charging and paying the cost of using community facilities to the management fee.

[0002] Typically, mirrors are constructed by applying a reflective material to the back of a glass panel so that the image in front of the glass panel is reflected by the reflective material, and a supporting frame is provided around the perimeter of the glass panel to protect the glass panel. Such mirrors are installed indoors in bathrooms, living rooms, bedrooms, etc., and are used for various purposes, such as when a user applies makeup, dries their body or hair, or dresses up while looking at themselves, or when performing yoga, gymnastics, dancing, or performing certain movements indoors.

[0003] However, mirrors like the above only function as a standard mirror, reflecting the exact image of an object and lacking any other functionality. Recently, attempts have been made to gain additional functionality beyond their original mirror function by recognizing specific pre-registered (or registered) users and performing subsequent actions or actions accordingly.

[0004] However, such attempts are still limited to providing simple functions, such as simply recognizing the user's face and head shape and providing auxiliary functions that allow the user to style their makeup or hairstyle as desired.

[0005] Meanwhile, Korean Patent Publication No. 10-2022-0088219 discloses "Smart Mirror and Operating Method Thereof," wherein the smart mirror comprises: a display unit on which a user's face image is projected and a frame for a makeup area is superimposed on the user's face image; an image processing unit that analyzes the user's face image and generates a frame for the makeup area in response thereto; and a control unit that extracts feature points from the user's face image and synchronizes the user's face image and the frame for the makeup area based on the feature points.

[0006] In the case of patent document 1 as described above, there is an advantage in that it can recommend a makeup style that suits the user's facial features and provide a tutorial so that the user can easily follow along, and can provide a makeup guide that suits the user's face by changing the makeup frame area in response to the user's movements. However, this also has the limitation of only providing an auxiliary function in makeup.

[0007] The present invention has been created by comprehensively considering the above matters, and the purpose of the present invention is to provide a smart mirror kiosk system capable of facial recognition that performs a general mirror function in normal times, recognizes the user's face through a built-in facial recognition device when the user enters a building, and allows only registered persons (residents) to enter, and allows only registered persons (residents or members) to search or register information through a touch screen display device built into the mirror, thereby maintaining security.

[0008] In addition, another purpose of the present invention is to provide the convenience of a one-stop solution for use by configuring that when a registrant (resident or member) uses a community facility, purchases a product, or receives a service, the corresponding fee is automatically charged to the management fee and paid, thereby eliminating the need for the user to make a separate credit card payment or cash payment.

[0009] In order to achieve the above purpose, the smart mirror kiosk system capable of facial recognition according to the present invention is:

[0010] A smart mirror that performs normal mirror functions in normal times, and when a user approaches, activates a facial recognition means to recognize the face and then activates an interface touch screen that allows the user to perform subsequent actions;

[0011] A plurality of local servers that are connected to the smart mirror and the Internet, and manage facilities of a public residential facility or public facility that uses the smart mirror, manage data (information) and image files, control access based on facial recognition, and store various data and information; and

[0012] Its characteristic is that it relays between the above-mentioned multiple local servers and external cloud servers, and includes a community server that connects the cloud server with community devices in shared residential facilities or public facilities.

[0013] Here, the smart mirror is equipped with a facial recognition device (facial recognition sensor) that is not normally visible but is activated when a user approaches and recognizes the user's face, a first display device that is not normally visible but is activated when the facial recognition device is activated and displayed on a glass surface and has a touch screen function for input by the user, and a second display device that is not normally visible but is activated when the facial recognition device is activated and displayed on a glass surface and posts notices, news, weather, advertisements, etc.

[0014] At this time, the facial recognition device (facial recognition sensor) may be configured in a structure in which only the facial recognition device (facial recognition sensor) can be detached from the mirror body at the rear of the smart mirror to facilitate aftercare and maintenance.

[0015] At this time, the first display device and the second display device may also be configured as LCD (Liquid Crystal Display) panels.

[0016] In addition, the smart mirror may be provided with a first light and a second light that are respectively provided at the upper and lower parts of the mirror and indirectly illuminate the upper and lower parts of the mirror so that the user's face can be clearly recognized when the user's face is recognized by the facial recognition device, an outer frame that protects the outer sides of both sides of the mirror, a standing support frame that is provided at the lower part of the mirror to maintain and support the standing posture of the mirror, and a light diffusion prevention frame that is provided at the upper part of the mirror to prevent the light from the first light from diffusing upward while protecting the upper part of the mirror.

[0017] At this time, the first lighting lamp and the second lighting lamp may be composed of LEDs (Light Emitting Diodes).

[0018] Here, a power on / off switch for supplying or cutting off power to the facial recognition device, the first and second display devices, and the first and second lighting devices may be further provided at a predetermined location of the smart mirror.

[0019] Additionally, a USB port for connecting an external electronic device or a USB (Universal Serial Bus) and a voice recognition microphone for recognizing the user's voice may be further provided in a predetermined portion of the smart mirror.

[0020] In addition, the local server may be configured to include a management server that manages facilities of a public residential facility or public facility that installs and uses the smart mirror; a file server that manages data (information) and image files of the facility; a gate server that performs a user access control function based on facial recognition; and a DB server that stores various data and information.

[0021] At this time, the gate server may be equipped with a registered user authentication app (application) that registers various users and authenticates only registered users, including gate passage, member authentication, household head authentication, and company employee authentication.

[0022] In addition, the community server performs functions of access control, electronic key, electric control, and book management, and in relation to this, a desk POS (Point of Sales), a facial recognition mirror kiosk, menu and bulletin board DID (Decentralized Identifiers), a community operator terminal, and an administrative office operator terminal can be connected via the Internet.

[0023] In addition, the community server may be equipped with a fee payment app (application) that automatically charges and pays the management fee when a registrant (resident or member) uses the community facilities, purchases a product, or receives a service.

[0024] According to the present invention, when a user enters a building, the user's face is recognized through a built-in facial recognition device, so that only registered users (residents) can enter, and only registered users (residents or members) can search or register information through a touch screen display device built into the mirror, so that there is an advantage in that security can be maintained.

[0025] In addition, when a registrant (resident or member) uses community facilities, purchases goods, or receives services, the corresponding fee is automatically charged to the management fee and paid, so the user does not have to pay separately by credit card or cash, which provides the advantage of providing the convenience of a one-stop solution for use.

[0026] FIG. 1 is a schematic diagram illustrating the configuration of a smart mirror kiosk system capable of facial recognition according to the present invention.

[0027] FIG. 2 is a drawing showing an overview of the operation of a smart mirror kiosk system capable of facial recognition according to the present invention.

[0028] FIGS. 3 to 5 are drawings showing examples in which a smart mirror kiosk system capable of facial recognition according to the present invention is applied to a commercial building (or a mixed-use building, office building, or hotel) within an apartment complex.

[0029] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[0030] FIG. 1 is a schematic diagram illustrating the configuration of a smart mirror kiosk system capable of facial recognition according to an embodiment of the present invention.

[0031] Referring to FIG. 1, a smart mirror kiosk system (100) capable of facial recognition according to the present invention is configured to include a smart mirror (110), a plurality of local servers (120), and a community server (130).

[0032] The smart mirror (110) normally performs a general mirror function, and when a user approaches, it activates a facial recognition means (a facial recognition device (111) described later) to recognize the face, and then activates an interface touch screen (a first display device (112) described later) that allows the user to perform subsequent actions. Here, such a smart mirror (110) may be composed of special glass having a predetermined reflectivity and transmittance (for example, having a reflectivity of 65% and a transmittance of 35%) that exhibits a mirror function, and special deposited glass on which a touch sensor is deposited. In addition, the smart mirror (110) is equipped with a facial recognition device (facial recognition sensor) (111) that is normally invisible but is activated when a user approaches and recognizes the user's face, a first display device (112) that is normally invisible but is activated when the facial recognition device (111) is activated and displayed on the glass surface and has a touch screen function for input by the user, and a second display device (113) that is normally invisible but is activated when the facial recognition device (111) is activated and displayed on the glass surface and posts notices, news, weather, advertisements, etc. Here, the second display device (113) may be omitted in some cases. In this case, the facial recognition device (facial recognition sensor) (111) may be configured in a structure in which only the facial recognition device (facial recognition sensor) (111) can be detachably attached to the mirror body from the rear of the smart mirror (110) in order to facilitate aftercare and maintenance. At this time, the first display device (112) and the second display device (113) may also be configured as LCD (Liquid Crystal Display) panels.

[0033] In addition, the smart mirror (110) may be provided with a first light (114) and a second light (115) which are respectively provided at the upper and lower parts of the mirror and indirectly illuminate the upper and lower parts of the mirror so that the user's face can be clearly recognized when the face recognition device (111) recognizes the user's face, an outer frame (116) which protects the outer sides of both sides of the mirror, a standing support frame (117) which is provided at the lower part of the mirror to maintain and support the standing posture of the mirror, and a light diffusion prevention frame (118) which is provided at the upper part of the mirror to prevent the light from the first light (114) from diffusing upward while protecting the upper part of the mirror. At this time, the first light (114) and the second light (115) may be composed of a light emitting diode (LED).

[0034] Here, a power on / off switch for supplying or cutting off power to the facial recognition device (111), the first and second display devices (112) (113), and the first and second lighting devices (114) (115) may be further provided at a predetermined portion of the smart mirror (110). In addition, a USB port for connecting an external electronic device or a USB (Universal Serial Bus) and a voice recognition microphone for recognizing the user's voice may be further provided at a predetermined portion of the smart mirror (110). Here, the voice recognition microphone as described above is for responding when a user orders a product or requests provision of a service by voice.

[0035] The local server (120) is connected to the smart mirror (110) via the Internet, and manages facilities of a joint residential facility or public facility that uses the smart mirror (110), manages data (information) and image files, controls access based on facial recognition, and stores various data and information. The local server (120) is composed of a plurality of servers. That is, the local server (120) may include a management server (121) that manages facilities of a joint residential facility (e.g., apartments, residential officetels, company office buildings, hotels, etc.) or public facility (e.g., cafes, restaurants, gyms, swimming pools, saunas, beauty salons, reading rooms, golf practice ranges, etc.) that uses the smart mirror (110); a file server (122) that manages data (information) and image files of the facilities; a gate server (123) that performs a user access control function based on facial recognition; and a DB server (124) that stores various data and information. At this time, the gate server (123) may be equipped with a registered user authentication app (application) that registers various users and authenticates only registered users, including gate passage, member authentication, household head authentication, and company employee authentication.

[0036] Here, the local server (120) described above may further include, in addition to the servers (121 to 124) described above, a user authentication server involved in user authentication, a generation server for management of each generation, a usage history server for storing and managing usage history information of the facility, etc., depending on the case.

[0037] The community server (130) relays the plurality of local servers (120) and the external cloud server (140), and connects the cloud server (140) with community devices of joint residential facilities or public facilities. The community server (130) performs functions such as access control, electronic keys, electric control, and book management, and in relation to these, it can connect a desk POS (Point of Sales), a facial recognition mirror kiosk, menu and bulletin board DID (Decentralized Identifiers), a community operator terminal, and a management office operator terminal via the Internet. In addition, the community server (130) as described above can be equipped with a fee payment application that automatically charges and pays the management fee when a registrant (resident or member) uses the community facilities, purchases a product, or receives a service.

[0038] FIG. 2 is a drawing showing an overview of the operation of a smart mirror kiosk system capable of facial recognition according to the present invention.

[0039] Referring to FIG. 2, in the smart mirror kiosk system (100) capable of facial recognition according to the present invention as described above, community users may include anyone of any age, gender, or sexual orientation, including adults, children, and the elderly. In particular, a facial recognition device (facial recognition sensor) (111) is configured at a height of 1300 mm from the floor, thereby implementing an optimal position based on ergonomics that allows sensing by anyone, regardless of gender or age.

[0040] The smart mirror (110) normally performs the function of a general mirror in a public space, as in (a). Then, when a user approaches, it activates a facial recognition device (facial recognition sensor) (111) to recognize the user's face, as in (b). When the user's face is recognized (sensed) by the facial recognition device (facial recognition sensor) (111), the recognition (sensing) signal is transmitted to the community server (130). Then, the community server (130) authenticates the resident (or registered member) through facial recognition, as in (c), and performs a multi-touch function (i.e., activates the first display device (112)). At this time, when the user wishes to use the community facilities (e.g., apply for a golf practice range, purchase a meal ticket, etc.), the cost for use (if paid) is automatically charged to the management fee and paid. Thereafter, the community server (130) authenticates the user through facial recognition, and then allows the user to enter as in (d) (at this time, unauthenticated outsiders are not allowed to enter), and automatically charges the user a management fee for using the community facilities. In addition, it performs a dual function (i.e., activates the second display device (113)) to post notices, news, weather, advertisements, etc. on the screen area of ​​the second display device (113).

[0041] FIGS. 3 to 5 are drawings showing examples in which a smart mirror kiosk system capable of facial recognition according to the present invention is applied to a commercial building (or a mixed-use building) within an apartment complex.

[0042] Referring to Fig. 3, a smart mirror (110) as in (a) is installed in the lobby or entrance of a commercial building (or a mixed-use building) within an apartment complex and normally performs the function of a general mirror. In such a situation, when a user approaches, a facial recognition device (facial recognition sensor) (111) is activated to recognize the user's face as in (b). When the user's face is recognized (sensed) by the facial recognition device (facial recognition sensor) (111), the recognition (sensing) signal is transmitted to the community server (130) as described above. Then, the community server (130) authenticates the resident (or registered member) through facial recognition as in Fig. 4 (a) and (b), and performs a multi-touch function (i.e., activates the first display device (112)) so that the user can perform an input operation by touch. And, along with this, it performs a dual function (i.e., activates the second display device (113)) to post notices, news, weather, advertisements, etc. on the screen area of ​​the second display device (113). This example illustrates a case where a user uses a cafe among community facilities.

[0043] Thereafter, when a user purchases an item (e.g., a coffee order), the community server (130) automatically charges the cost (amount) for the purchase (coffee order) to the management fee, as shown in FIG. 5, and the payment is made accordingly. Accordingly, the user does not need to make a separate credit card or cash payment for the purchase (coffee order).

[0044] As described above, the smart mirror kiosk system capable of facial recognition according to the present invention is configured to accommodate a general mirror function in normal times, and to recognize the user's face through a facial recognition device built into the smart mirror when the user enters the building so that only registered persons (residents) can enter, and is configured so that only registered persons (residents or members) can search or register information through a touch screen display device built into the mirror, thereby having the advantage of maintaining security.

[0045] In addition, when a registrant (resident or member) uses community facilities, purchases goods, or receives services, the corresponding fee is automatically charged to the management fee and paid, so that the user does not have to pay separately by credit card or cash, which provides the advantage of providing the convenience of a one-stop solution for use.

[0046] While the present invention has been described in detail through preferred embodiments, it is apparent to those skilled in the art that the present invention is not limited thereto, and various modifications and applications can be made without departing from the technical spirit of the present invention. Therefore, the true scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included within the scope of the rights of the present invention.

Claims

1. A smart mirror that performs normal mirror functions in normal times, and when a user approaches, activates a facial recognition means to recognize the face and then activates an interface touch screen that allows the user to perform subsequent actions; A plurality of local servers that are connected to the smart mirror and the Internet, and manage facilities of a public residential facility or public facility that uses the smart mirror, manage data (information) and image files, control access based on facial recognition, and store various data and information; and A smart mirror kiosk system capable of facial recognition, which relays the above-mentioned multiple local servers and an external cloud server, and includes a community server that connects the cloud server and community devices of a shared residential facility or public facility.

2. In paragraph 1, In the above smart mirror, A facial recognition device (facial recognition sensor) that is not visible during normal times but is activated when a user approaches and recognizes the user's face, A first display device that is not normally visible but is activated when the facial recognition device is activated and displayed on the glass surface, and has a touch screen function for input by the user; A smart mirror kiosk system capable of facial recognition, characterized in that a second display device is built-in and displayed on a glass surface, which is not normally visible but is activated when the facial recognition device is activated, and which posts notices, news, weather, and advertisements.

3. In paragraph 2, A smart mirror kiosk system capable of facial recognition, characterized in that the facial recognition device (facial recognition sensor) is configured in a structure in which only the facial recognition device (facial recognition sensor) can be detached from the mirror body at the rear of the smart mirror to facilitate aftercare and maintenance.

4. In paragraph 2, A smart mirror kiosk system capable of facial recognition, characterized in that the first display device and the second display device are composed of LCD (Liquid Crystal Display) panels.

5. In paragraph 2, In the above smart mirror, A first light and a second light are provided at the upper and lower parts of the mirror, respectively, and when the user's face is recognized by the facial recognition device, they indirectly illuminate the upper and lower parts of the mirror, respectively, so that the user's face can be clearly recognized. An outer frame that protects the outer edges of both sides of the mirror, A standing support frame provided at the bottom of the mirror to maintain and support the mirror's standing position, A smart mirror kiosk system capable of facial recognition, characterized in that it is provided with a light diffusion prevention frame that is installed on the upper part of the mirror and prevents the light from the first light from diffusing upward while protecting the upper part of the mirror.

6. In paragraph 5, A smart mirror kiosk system capable of facial recognition, characterized in that the first and second lights are composed of LEDs (Light Emitting Diodes).

7. In paragraph 2, A smart mirror kiosk system capable of facial recognition, characterized in that a power on / off switch for supplying or cutting off power to the facial recognition device, the first and second display devices, and the first and second lighting lights is further provided at a predetermined portion of the smart mirror.

8. In paragraph 2, A smart mirror kiosk system capable of facial recognition, characterized in that a predetermined part of the above smart mirror is further equipped with a USB port for connecting an external electronic device or a USB (Universal Serial Bus) and a voice recognition microphone for recognizing the user's voice.

9. In paragraph 1, The above local server is, A management server that manages facilities of a public residential facility or public facility that uses the above smart mirror; A file server that manages facility data (information) and image files; A gate server that performs user access control functions based on facial recognition; and A smart mirror kiosk system capable of facial recognition, characterized by including a DB server that stores various data and information.

10. In paragraph 9, A smart mirror kiosk system capable of facial recognition, characterized in that the above gate server is equipped with a registered user authentication app (application) that registers various users and authenticates only registered users, including gate passage, member authentication, household head authentication, and company employee authentication.

11. In paragraph 1, The above community server performs the functions of access control, electronic key, electric control, and book management, and in relation to this, a smart mirror kiosk system capable of facial recognition characterized by connecting a desk POS (Point of Sales), a facial recognition mirror kiosk, menu and bulletin board DID (Decentralized Identifiers), a community operator terminal, and a management office operator terminal via the Internet.

12. In paragraph 1, A smart mirror kiosk system capable of facial recognition, characterized in that the above community server is equipped with a fee payment app (application) that automatically charges and pays the management fee when a registrant (resident or member) uses the community facilities, purchases a product, or receives a service.

Images