Method for operating user-customized kiosk

Abstract

The present disclosure relates to a method for operating a user-customized kiosk. The method for operating a kiosk according to an embodiment may comprise the steps of: obtaining user identification information on a user having approached the kiosk within a predetermined distance; acquiring position information about the height and the front and rear position of a display for outputting at least one piece of content and user interface information about the output method of the display by inputting the user identification information to an artificial intelligence model that outputs the position information and the user interface information when the acquired user identification information is input; controlling a driving unit for adjusting the position of the display on the basis of the acquired position information; and outputting the at least one piece of content to the display on the basis of the acquired user interface information.

Description

How a custom kiosk works

[0001] The present disclosure relates to an operating method of a user-customizable kiosk. More specifically, the present disclosure relates to an operating method of a user-customizable kiosk that provides an interface optimized for the user based on the user's physical characteristics.

[0002] Recently, the use of kiosks, automated service delivery devices, has been expanding across various fields. Typical kiosks perform functions such as providing information, ordering products, and making payments, and are frequently used in public spaces and commercial facilities. However, existing kiosks primarily offer standardized designs and interfaces, which can limit accessibility for users with special needs, such as those with physical limitations, the elderly, or those with visual or hearing impairments.

[0003] To address these issues, various technological attempts have been made to improve the usability of kiosks. For example, mechanical structures that allow screen height adjustments and systems that automatically adjust the interface based on user physical characteristics have been developed. However, these existing technologies have largely remained fragmentary solutions, and methods for comprehensively optimizing kiosk operation based on the detailed physical characteristics or defects of an individual are still lacking.

[0004] Against this backdrop, the present invention provides a novel method and system that enables users to utilize kiosks more effectively. Specifically, the invention focuses on automatically detecting a user's physical and visual characteristics and, based on these, adjusting the display's position, size, spacing, and output method to provide a customized interface tailored to each user's individual needs. Through this, the invention aims to significantly enhance the accessibility and convenience of kiosks, taking into account the diversity of users.

[0005] According to one embodiment, a method for operating a user-customizable kiosk may be provided. More specifically, a method for operating a user-customizable kiosk that outputs a display position and user interface based on a user's physical characteristics may be provided.

[0006] According to one embodiment of the present disclosure for achieving the above-described technical problem, a method for operating a user-customized kiosk may be provided, comprising: a step of obtaining user identification information regarding a user who has approached the kiosk within a predetermined distance; a step of inputting the user identification information into an artificial intelligence model that outputs position information regarding the height and front-rear position of a display that outputs at least one content and user interface information regarding an output method of the display, thereby obtaining the position information and the user interface information; a step of controlling a driving unit that adjusts the position of the display based on the obtained position information; and a step of outputting the at least one content to the display based on the obtained user interface information.

[0007] According to another embodiment of the present disclosure for solving the above technical problem, a user-customizable kiosk may be provided, comprising: a camera; a display; a driving unit; a network interface; a memory storing one or more instructions; and at least one processor executing the one or more instructions, wherein the at least one processor obtains user identification information regarding a user who has approached the kiosk within a predetermined distance, and when the obtained user identification information is input, inputs the user identification information into an artificial intelligence model that outputs position information regarding the height and front-rear position of a display that outputs at least one content and user interface information regarding an output method of the display, thereby obtaining the position information and the user interface information, and controlling a driving unit that adjusts the position of the display based on the obtained position information, and outputting the at least one content to the display based on the obtained user interface information.

[0008] According to another embodiment of the present disclosure for solving the above technical problem, a method for operating a user-customized kiosk is provided, comprising: obtaining user identification information regarding a user who has approached the kiosk within a predetermined distance; inputting the user identification information into an artificial intelligence model that outputs position information regarding the height and front-rear position of a display that outputs at least one content and user interface information regarding an output method of the display, thereby obtaining the position information and the user interface information; controlling a driving unit that adjusts the position of the display based on the obtained position information; and outputting the at least one content to the display based on the obtained user interface information; A computer-readable recording medium storing a program for causing the method to be performed may be provided.

[0009] In one embodiment, an optimized interface can be provided to the user by adjusting the position and output method of the display based on the physical characteristics of the user approaching the kiosk.

[0010] In one embodiment, when a user approaches a kiosk, the user's physical characteristics are automatically recognized and analyzed through built-in cameras and sensors, and then an artificial intelligence model adjusts the height and position of the display and outputs content in a manner most suitable for the user's environment.

[0011] FIG. 1 is a schematic diagram illustrating a user-customizable kiosk system according to one embodiment.

[0012] Figure 2 is a flowchart of an operation method of a user-customized kiosk according to one embodiment.

[0013] Figure 3 is a flowchart of an operation method of a user-customized kiosk according to another embodiment.

[0014] Figure 4 is a flowchart of a process for obtaining user identification information of a kiosk according to one embodiment.

[0015] Figure 5 is a flowchart of a process for obtaining user characteristic information of a kiosk according to one embodiment.

[0016] Figure 6 is a flowchart showing a process for controlling a driving unit of a kiosk according to one embodiment.

[0017] FIG. 7 is a diagram illustrating an artificial intelligence model of a kiosk according to one embodiment.

[0018] Figure 8 is a block diagram of a kiosk according to one embodiment.

[0019] Figure 9 is a block diagram of a kiosk according to another embodiment.

[0020] Figure 10 is a block diagram of a server according to one embodiment.

[0021] According to one embodiment, a method for operating a user-customized kiosk may include: obtaining user identification information regarding a user who has approached the kiosk within a predetermined distance; inputting the user identification information into an artificial intelligence model that outputs position information regarding the height and front-rear position of a display that outputs at least one content and user interface information regarding an output method of the display, thereby obtaining the position information and the user interface information; controlling a driving unit that adjusts the position of the display based on the obtained position information; and outputting the at least one content to the display based on the obtained user interface information.

[0022] Hereinafter, terms used in this specification will be briefly explained, and the present disclosure will be described in detail.

[0023] The terms used in this disclosure are selected from widely used, common terms, taking into account the functions of the disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant invention. Therefore, the terms used in this disclosure should not be defined simply as names, but rather based on the meanings of the terms and the overall content of the disclosure.

[0024] When a part of the specification is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "part," "module," etc., used throughout the specification refer to a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0025] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts irrelevant to the description are omitted for clarity of description of the present disclosure, and similar parts are designated with similar reference numerals throughout the specification.

[0026]

[0027] FIG. 1 is a schematic diagram illustrating a user-customizable kiosk system according to one embodiment.

[0028] According to one embodiment, a user-customized kiosk system (10) can input user identification information (132) regarding the characteristics of the user into an artificial intelligence model (130), thereby obtaining location information (134) and interface information (136) of a display (120) suitable for the user, and control the driving unit (140) and the display (120) based on the obtained location information (134) and interface information (136).

[0029] According to one embodiment, a user-customized kiosk system (10) may include a kiosk (1000) and a server (2000). However, the present invention is not limited to the above-described example, and according to another embodiment, the user-customized kiosk system (10) may further include an electronic device (4000) connected via a network (3000). The kiosk (1000) and the electronic device (4000) illustrated in FIG. 1 may be terminals or computer devices used by different users who utilize content provided by the user-customized kiosk system (10).

[0030] According to one embodiment, the kiosk (1000) is a terminal that outputs content related to a service menu or civil complaint form and includes a touch screen capable of touch operation, and may include a touch-type display module including a display with a touch function, a communication module, a processor, and the like. For example, the kiosk (1000) may have built-in firmware programmed by an administrator and may further include hardware and software related to a Braille sensor and a payment system for the disabled.

[0031] According to one embodiment, the kiosk (1000) obtains user identification information (132) about a user who has approached the kiosk within a predetermined distance, and when the obtained user identification information (132) is input, the kiosk inputs the user identification information (132) into an artificial intelligence model (130) that outputs location information (134) about the height and front-back position of a display (120) that outputs at least one content and user interface information (136) about an output method of the display, thereby obtaining the location information (134) and the user interface information (136), and based on the obtained location information (134), controlling a driving unit (140) that adjusts the location of the display, and based on the obtained user interface information, outputting the at least one content to the display (120).

[0032] In one embodiment, the server (2000) may store user identification information (132) obtained from an external server (not shown) and transmit it to the kiosk (1000). For example, the external server (not shown) may be a server utilized by a mobile carrier or a local government administrative welfare center. The above-described operations may be performed by the server (2000) or the kiosk (1000).

[0033]

[0034] Figure 2 is a flowchart of an operation method of a user-customized kiosk according to one embodiment.

[0035] In S210, the kiosk (1000) can obtain user identification information regarding a user who has approached the kiosk within a predetermined distance. According to one embodiment, the kiosk (1000) can identify a user who has approached the kiosk based on a captured image or a short-range network signal collected by a camera or network interface provided in the kiosk, and then obtain user identification information of the user from a server based on whether the user has consented to the collection of personal information. For example, the user identification information can include information regarding at least one of the user's age, gender, height, or disability level.

[0036] In S220, the kiosk (1000) inputs the user identification information into an artificial intelligence model that outputs position information about the height and front-back position of a display that outputs at least one content and user interface information about an output method of the display, thereby obtaining the position information and the user interface information. According to one embodiment, the artificial intelligence model may output the position information of the display based on information about the height and disability level (whether or not a wheelchair is used) included in the user identification information, and output user interface information based on the user's age and disability level (whether or not the user is visually or hearing impaired).

[0037] In one embodiment, the position information may include information regarding one of a plurality of preset height levels for the display and whether the forward / backward position is controlled. In another embodiment, the position information may include the center coordinates of the display determined by the height and forward / backward projection control of the display. For example, whether the forward / backward position is controlled may be determined based on the disability level (whether or not a user uses a wheelchair) included in the user characteristic information.

[0038] In one embodiment, the user interface information may include information regarding at least one of the size, position, or spacing of at least one content displayed on the display. In another embodiment, the user interface information may include a voice-only interface or a visual-only interface, depending on whether the user is visually or hearing impaired.

[0039] In S230, the kiosk (1000) can control a driving unit that adjusts the position of the display based on the acquired position information. According to one embodiment, the kiosk (1000) can change the height by controlling the operation of a height adjustment unit provided at the rear of the display according to the height step and forward / backward position control included in the position information, and can control the arm located between the display and the height adjustment unit to protrude forward.

[0040] In S240, the kiosk (1000) can output at least one content to the display based on the acquired user interface information. According to one embodiment, the kiosk (1000) can output the content based on at least one of the size, position, spacing, voice-only, or visual-only interface of the content included in the user interface information. For example, the kiosk (1000) can enlarge the font or image to be output according to the size of the content, thereby enabling an older user to easily identify the content being output, and can increase the spacing between the output contents according to the spacing between the contents, thereby improving the ability of a user with tremors or difficulty using touch due to a physical disability to identify which content has been selected.

[0041]

[0042] Figure 3 is a flowchart of an operation method of a user-customized kiosk according to another embodiment.

[0043] In S310, the kiosk (1000) can obtain user characteristic information including at least one of body characteristic information regarding the physical characteristics of the user or eye characteristic information regarding the eyes of the user based on a captured image captured by a camera provided in the kiosk. According to one embodiment, if there is no user identification information regarding the user stored in the server (2000), or the user identification information is older than a preset period of time, or consent to use personal information has not been obtained from the user terminal, the kiosk (1000) can obtain the captured image using the camera and obtain user characteristic information based on the obtained captured image.

[0044] According to one embodiment, the captured image may include multiple frames of images captured of a user who has stayed in front of the kiosk (1000) for a predetermined period of time, and the kiosk (1000) may obtain user characteristic information corresponding to the user identification information through image analysis of each frame image of the captured image. For example, the user characteristic information may include at least one of body characteristic information including the user's age group, height, gender, whether the user is in a wheelchair, and whether the user is visually impaired, or eye characteristic information regarding the user's eye focus direction, which are determined based on image analysis of the captured image. For example, the user's height may be determined based on the height at which the user's eyes are located relative to the user's body.

[0045] According to another embodiment, the kiosk (1000) can output a guidance message regarding whether a user is visually impaired through voice guidance when the user remains in front of the kiosk for a predetermined period of time but there is no touch input, and can also determine whether the user is visually impaired based on the user's response.

[0046] In S320, the kiosk (1000) can obtain the location information and the user interface information by inputting the user characteristic information into the artificial intelligence model. According to one embodiment, the artificial intelligence model can output the location information of the display based on the information on the height (eye height) and whether the user uses a wheelchair, which are included in the user characteristic information, and can output the user interface information based on the user's age group and whether the user has a visual or hearing impairment.

[0047] In S330, the kiosk (1000) can control the driving unit based on the acquired location information.

[0048] In S340, the kiosk (1000) can output at least one content to the display based on the acquired user interface information.

[0049]

[0050] Figure 4 is a flowchart of a process for obtaining user identification information of a kiosk according to one embodiment.

[0051] In S410, the kiosk (1000) can identify whether the user intends to use the kiosk based on the captured image or the local area network signal of the user terminal. In one embodiment, the kiosk (1000) can identify whether the user intends to use the kiosk based on image analysis of the captured image described above. In another embodiment, the kiosk (1000) can also identify whether the user intends to use the kiosk based on the duration of the local area network signal when the user approaches within a predetermined range of the kiosk.

[0052] In S420, if the kiosk (1000) identifies the user as using the kiosk, it may transmit a notification to the user terminal regarding whether or not the user consents to the collection of personal information. In one embodiment, if the short-range network signal of the user terminal is maintained for a predetermined threshold period of time or longer, the kiosk (1000) may transmit a notification text message or SNS message to the user terminal regarding whether or not the user consents to the collection of personal information.

[0053] In S430, the kiosk (1000) may obtain the user identification information from a server connected to the kiosk based on the user's response to the transmitted notification. According to one embodiment, if the kiosk (1000) obtains a consent response for the notification text or SNS message from the user, the kiosk (1000) may obtain the user identification information for the user from the server (2000). According to another embodiment, if the kiosk (1000) does not obtain the consent response from the user, the kiosk (1000) may obtain a captured image of the user from a camera installed in the kiosk (1000) and obtain the user characteristic information based on the captured image.

[0054]

[0055] Figure 5 is a flowchart of a process for obtaining user characteristic information of a kiosk according to one embodiment.

[0056] In S510, the kiosk (1000) can obtain the user's eye height and physical feature information regarding the presence or absence of a physical defect from the captured image. According to one embodiment, the kiosk (1000) can identify the eye height and the presence or absence of a physical defect from a plurality of image frames including the user. For example, the kiosk (1000) can analyze the user's physical features in each image frame by using object recognition technology, and a deep learning-based convolutional neural network (CNN) can be used in this process. The convolutional neural network can be pre-trained to identify various body parts and conditions (e.g., abnormal posture, physical deformity, etc.).

[0057] Additionally, according to one embodiment, the kiosk (1000) can determine in real time whether a physical defect exists by continuously analyzing image frames and identifying consistent data patterns. For example, the kiosk (1000) can classify a physical defect if it detects abnormal movements in the user's walking pattern or if the shape of a specific body part deviates from the normal range.

[0058] In S520, the kiosk (1000) can obtain eye feature information regarding the focus direction of the user's eyes with respect to guidance content output on the display. According to one embodiment, the kiosk (1000) can collect the position and movement of the user's eyes in real time using an infrared sensor and a camera, and can obtain eye feature information regarding the focus direction of the user's eyes by analyzing the pattern of an optical signal reflected from an infrared light source onto the retina of the eye. For example, the guidance content can be output in one of preset patterns to enhance the ability to identify the focus direction of the eyes.

[0059] In one embodiment, the kiosk (1000) may identify whether the user is visually impaired based on the eye characteristic information obtained by analyzing the pattern of the optical signal for the guidance content. For example, the kiosk (1000) may identify the user as visually impaired if the user's eye focus direction does not match the pattern of the guidance content or if an irregular pattern is identified more than a threshold number of times.

[0060] For example, the kiosk (1000) can obtain the eye characteristic information by displaying the guidance message “Please look at the star to use the kiosk” as the initial screen on the display, and outputting a pattern in which a star pattern moves clockwise along the periphery of the display, and analyzing the degree to which the pattern of the user’s eye focus direction matches the clockwise direction.

[0061] In one embodiment, eye characteristic information may identify the user's area of ​​interest by identifying not only the focus direction of the user's eyes, but also whether the user blinks or changes focus, and where the user's gaze lingers on the display. For example, if the kiosk (1000) detects frequent blinking or frequent focus changes in the user's eye movement pattern, it may determine this as a sign of visual fatigue and utilize it as a parameter for adjusting the display brightness or content display time.

[0062]

[0063] Figure 6 is a flowchart showing a process for controlling a driving unit of a kiosk according to one embodiment.

[0064] In S610, the kiosk (1000) can adjust the height of the display based on the height steps included in the location information. In one embodiment, the kiosk (1000) can adjust the height of the display by utilizing a linear actuator or electric motor built into the height adjustment unit. In one embodiment, the kiosk (1000) can control the height adjustment unit so that the display can move to one of the preset height steps determined based on the location information.

[0065] In S620, the kiosk (1000) can control the display to protrude forward at the height level based on whether the forward / backward position is controlled. According to one embodiment, the kiosk (1000) can control the display to protrude forward by controlling an arm provided between the display and the height adjustment unit. For example, the arm includes a linear actuator and at least one servo motor, and can protrude forward by the operation of the linear actuator, and the position or angle of the display can also be adjusted by controlling the servo motor.

[0066] In S630, the kiosk (1000) can control the driving unit to stop the display when the distance value measured by the proximity sensor provided on the front of the display is determined to be less than or equal to a threshold distance value. According to one embodiment, the proximity sensor can detect the approach of a user or another object using infrared, ultrasonic, or capacitive methods. For example, the kiosk (1000) can calculate a precise distance by measuring the time it takes for an ultrasonic signal generated using an ultrasonic sensor to be reflected by a surrounding object and return. At this time, if the distance calculation result is detected to be less than a set threshold value, that is, if it is determined that the user has approached too close to the display, the driving unit can be immediately stopped.

[0067] Although not illustrated in FIG. 6, in one embodiment, the kiosk (1000) may control the tilt of the display based on the eye characteristic information after the display is stopped when the display is controlled to protrude forward. For example, the kiosk (1000) may analyze the user's eye position and focus direction in real time through a camera and determine a display angle optimized for the user's eye height and gaze angle.

[0068] According to one embodiment, the kiosk (1000) can adjust the angle of the display so that the angle formed between the user's gaze direction looking at the center of the display and the display is perpendicular. For example, if the kiosk (1000) determines that the display is positioned relatively higher than the user's eye position, the kiosk (1000) can adjust the angle of the display so that the angle formed between the user's gaze direction and the display plane is perpendicular. Through the above-described method, the kiosk (1000) can provide a personalized user experience by adjusting the angle of the display optimized for the user's eye level as well as the height.

[0069]

[0070] FIG. 7 is a diagram illustrating an artificial intelligence model of a kiosk according to one embodiment.

[0071] According to one embodiment, the artificial intelligence model (740) may include a deep neural network (DNN), and may include, but is not limited to, a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or deep Q-networks.

[0072] An artificial intelligence model (740) according to an embodiment of the present disclosure may include at least one layer and a weight regarding the connection strength of the at least one layer. In addition, according to an embodiment, the artificial intelligence model (740) may be pre-trained by modifying and updating the weight so as to output display location information (752) and user interface information (754) when at least one of user identification information (720) or user characteristic information (730) is input. According to an embodiment, the user identification information (720) may be obtained from a server (2000) connected to the kiosk (1000), and the user characteristic information (730) may be obtained from a camera (710) installed in the kiosk (1000).

[0073] Additionally, according to one embodiment, the kiosk (1000) may acquire a learning data set including learning user identification information and learning user characteristic information for training an artificial intelligence model (740) from the server (2000), and train the artificial intelligence model based on the acquired learning data set. According to one embodiment, the learning data set may include location information or user interface information of a display optimized for various ages, genders, heights, and disabilities.

[0074] In another embodiment, the kiosk (1000) may train the artificial intelligence model (740) on its own, but may also obtain an artificial intelligence model pre-trained by an external server from the server (2000).

[0075] According to one embodiment, the artificial intelligence model (740) may be trained to determine the size of at least one content based on the user's age included in the user identification information (720) or the user characteristic information (730). For example, the kiosk (1000) may calculate a touch error rate for content displayed on the display according to the user's age group, and may modify and update the weights of the layers so that the calculated error rate is minimized. For example, the artificial intelligence model (740) may collect and analyze kiosk touch data according to the age group for a predetermined period of time, thereby learning statistical patterns for each age group and automatically learning the size of content appropriate for each age group.

[0076] In one embodiment, the AI ​​model (740) may be trained to determine the location and spacing of at least one piece of content based on whether the user has a physical defect included in the user characteristic information. In another embodiment, the AI ​​model (740) may be trained to optimize the placement of content to improve accessibility for individual users based on the user's physical defect information. For example, considering the user's physical limitations, content requiring touch may be placed on the user's available arm side to ensure ease of use. For example, if the user has difficulty using their right arm, essential touch elements may be trained to be moved to the left to facilitate accessibility.

[0077] In one embodiment, the AI ​​model (740) can be trained to adjust the spacing between contents according to the user's physical condition. For example, the AI ​​model (740) can be trained to allow a user with limited arm control to select specific content simply by focusing their eyes by widening the spacing between contents. For example, the AI ​​model (740) can be trained to allow a user with long reaction times or frequent selection errors to further widen the spacing between contents to more clearly distinguish each option. A kiosk including the aforementioned AI model can provide users with physical limitations with an environment where they can operate the interface solely with their eyes instead of touch, thereby dramatically improving the user experience.

[0078] In one embodiment, the artificial intelligence model (740) may be trained to convert visual content output on the display into voice if the user is identified as visually impaired based on the disability level included in the user identification information (720) or the eye characteristic information (734). For example, the content converted into voice is output as an artificial voice generated by the artificial intelligence model, and the artificial voice may be trained to be set differently for each age group.

[0079] In one embodiment, the kiosk (1000) can capture a user's facial expressions via a camera and analyze them to recognize the user's emotional state. In one embodiment, the kiosk (1000) can analyze the user's emotions, such as joy, sadness, surprise, and anger, using a facial expression recognition algorithm. The aforementioned emotional data can be used to tailor the kiosk's responses to the user.

[0080] Additionally, according to one embodiment, the kiosk (1000) can adjust the content displayed on the display based on the emotional data. For example, if the user is perceived as stressed, the kiosk can improve the user experience by displaying content such as playing relaxing music or displaying positive messages.

[0081]

[0082] Figure 8 is a block diagram of a kiosk according to one embodiment.

[0083] Figure 9 is a block diagram of a kiosk according to another embodiment.

[0084] According to one embodiment, the kiosk (1000) may include a network interface (1500), a display (1210), a memory (1700), and a processor (1300). However, not all of the illustrated components are essential components. The kiosk (1000) may be implemented with more components than the illustrated components, or may be implemented with fewer components. For example, the kiosk (1000) may further include a camera and a driving unit for performing the operations of the kiosk described above.

[0085] In addition, for example, as illustrated in FIG. 9, the kiosk (1000) may further include a user input interface (1100), an output unit (1200), a sensing unit (1400), and an A / V input unit (1600) in addition to a processor (1300), a display (1210), a memory (1700), and a network interface (1500).

[0086] The user input interface (1100) refers to a means for a user to input a sequence for controlling the kiosk (1000). For example, the user input interface (1100) may include, but is not limited to, a key pad, a dome switch, a touch pad (contact electrostatic capacitance type, pressure resistive film type, infrared detection type, surface ultrasonic conduction type, integral tension measurement type, piezo effect type, etc.), a jog wheel, a jog switch, etc. The user input interface (1100) may receive a user's input sequence for a screen output on the display of the kiosk (1000). In addition, the user input interface (1100) may also receive a user's touch input touching the display or a key input through a graphical user interface on the display.

[0087] The output unit (1200) can output an audio signal, a video signal, or a vibration signal, and the output unit (1200) can include a display (1210), an audio output unit (1220), and a vibration motor (1230).

[0088] The display (1210) includes a screen for displaying and outputting information processed in the kiosk (1000). The audio output unit (1220) outputs audio data received from the network interface (1500) or stored in the memory (1700). In addition, the audio output unit (1220) outputs audio signals related to functions performed in the kiosk (1000). The vibration motor (1230) can output vibration signals.

[0089] The processor (1300) typically controls the overall operation of the kiosk (1000). For example, the processor (1300) can control the user input unit (1100), output unit (1200), sensing unit (1400), network interface (1500), A / V input unit (1600), etc., by executing programs stored in the memory (1700). In addition, the processor (1300) can perform the functions of the kiosk (1000) described in FIGS. 1 to 7 by executing programs stored in the memory (1700).

[0090] Specifically, the processor (1300) can obtain input from a user touching the screen of the kiosk (1000) by controlling the user input unit. In one embodiment, the processor (1300) can also control a microphone to obtain the user's voice.

[0091] According to one embodiment, the processor (1300) obtains user identification information about a user who has approached the kiosk within a predetermined distance, and when the obtained user identification information is input, inputs the user identification information into an artificial intelligence model that outputs position information about the height and front-back position of a display that outputs at least one content and user interface information about an output method of the display, thereby obtaining the position information and the user interface information, and controlling a driving unit that adjusts the position of the display based on the obtained position information, and outputting the at least one content to the display based on the obtained user interface information.

[0092] The sensing unit (1400) can detect the status of the kiosk (1000) or the status around the kiosk (1000) and transmit the detected information to the processor (1300). The sensing unit (1400) can include at least one of a magnetic sensor (1410), an acceleration sensor (1420), a temperature / humidity sensor (1430), an infrared sensor (1440), a gyroscope sensor (1450), a position sensor (e.g., GPS) (1460), a pressure sensor (1470), a proximity sensor (1480), and an RGB sensor (illuminance sensor) (1490), but is not limited thereto. Since the function of each sensor can be intuitively inferred from its name by a person skilled in the art, a detailed description thereof will be omitted.

[0093] The network interface (1500) may include one or more components that enable the kiosk (1000) to communicate with other devices (not shown) and a server (2000). The other devices (not shown) may be computing devices such as the kiosk (1000) or sensing devices, but are not limited thereto. For example, the network interface (1500) may include a wireless communication interface (1510), a wired communication interface (1520), and a mobile communication unit (530).

[0094] The wireless communication interface (1510) may include, but is not limited to, a short-range wireless communication unit, a Bluetooth communication unit, a near field communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared (IrDA, infrared Data Association) communication unit, a WFD (Wi-Fi Direct) communication unit, etc. The wired communication interface (1520) may connect a server (2000) or a kiosk (1000) via a wire.

[0095] The mobile communication unit (1530) transmits and receives wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signals may include various types of data, such as voice signals, video call signals, or text / multimedia message transmission and reception.

[0096] The A / V (Audio / Video) input unit (1600) is for inputting audio signals or video signals, and may include a camera (1610) and a microphone (1620), etc. The camera (1610) can obtain image frames, such as still images or moving images, through an image sensor in video call mode or shooting mode. Images captured through the image sensor can be processed through a processor (1300) or a separate image processing unit (not shown).

[0097] The microphone (1620) receives an external acoustic signal and processes it into electrical voice data. For example, the microphone (1620) can receive an acoustic signal from an external device or a user. The microphone (1620) can receive a user's voice input. The microphone (1620) can utilize various noise removal algorithms to remove noise generated during the process of receiving an external acoustic signal.

[0098] The memory (1700) can store a program for processing and controlling the processor (1300), and can also store data input or output to the kiosk (1000). In addition, the memory (1700) can also store a prompt obtained by the kiosk (1000) from an external device.

[0099] The memory (1700) may include at least one type of storage medium among a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory, etc.), a RAM (Random Access Memory), a SRAM (Static Random Access Memory), a ROM (Read-Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a PROM (Programmable Read-Only Memory), a magnetic memory, a magnetic disk, and an optical disk.

[0100] The programs stored in the memory (1700) can be classified into a plurality of modules according to their functions, for example, a UI module (1710), a touch screen module (1720), a notification module (1730), etc. The UI module (1710) can provide a specialized UI, GUI, etc. that is linked to the kiosk (1000) for each application. The touch screen module (1720) can detect a user's touch gesture on the touch screen and transmit information about the touch gesture to the processor (1300). The touch screen module (1720) according to some embodiments can recognize and analyze a touch code. The touch screen module (1720) may also be configured as separate hardware including a controller.

[0101] The notification module (1730) can generate a signal to notify the occurrence of an event in the kiosk (1000). Examples of events occurring in the kiosk (1000) include reception of a call signal, reception of a message, input of a key signal, and schedule notification. The notification module (1730) can output a notification signal in the form of a video signal through the display unit (1210), output a notification signal in the form of an audio signal through the sound output unit (1220), or output a notification signal in the form of a vibration signal through the vibration motor (1230).

[0102]

[0103] Figure 10 is a block diagram of a server according to one embodiment.

[0104] In one embodiment, the server (2000) may include a network interface (2100), a database (2200), and a processor (2300). The network interface (2100) may correspond to the network interface (1500) of the kiosk (1000) illustrated in FIGS. 8 and 9. In one embodiment, the database (2200) may correspond to the memory (1700) of the kiosk (1000) illustrated in FIGS.

[0105] According to one embodiment, the processor (2300) may provide the interface of the kiosk of FIG. 9 to administrators who are users of the server device. In addition, the processor (2300) typically controls the overall operation of the server (2000). For example, the processor (2300) may control the DB (2200) and the network interface (2100) by executing programs stored in the DB (2200) of the server (2000). In addition, the processor (2300) may perform all or part of the functions of the kiosk (1000) described above in FIGS. 1 to 9 by executing programs stored in the DB (2100).

[0106]

[0107] The method of operating a user-customized kiosk according to the present disclosure may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, and the like, either singly or in combination. The program commands recorded on the medium may be those specifically designed and configured for the present invention, or may be known and usable by those skilled in the art of computer software.

[0108] Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and hardware devices specifically configured to store and execute program instructions, such as ROMs, RAMs, and flash memories. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements made by those skilled in the art using the basic concepts of the present invention defined in the following claims also fall within the scope of the present invention.

Claims

1. In the method of operating a user-customized kiosk, A step of obtaining user identification information about a user who approaches within a predetermined distance to the kiosk; When the user identification information obtained above is input, a step of obtaining the position information and the user interface information by inputting the user identification information into an artificial intelligence model that outputs position information regarding the height and front-back position of a display that outputs at least one content and user interface information regarding the output method of the display; A step of controlling a driving unit that adjusts the position of the display based on the acquired position information; and A method comprising: a step of outputting at least one content to the display based on the acquired user interface information; 2. In the first paragraph, the method, A step of obtaining user characteristic information including at least one of body characteristic information regarding the physical characteristics of the user or eye characteristic information regarding the eyes of the user based on a captured image captured by a camera provided in the kiosk; A step of obtaining the location information and the user interface information by inputting the user characteristic information into the artificial intelligence model; A step of controlling the driving unit based on the acquired position information; and A method comprising: a step of outputting at least one content to the display based on the acquired user interface information; 3. In the second paragraph, the step of obtaining the user identification information is: A step of identifying whether the user uses the kiosk based on the above-described captured image or the short-range network signal of the user terminal; When the user is identified as using the kiosk, a step of sending a notification to the user terminal regarding consent to the collection of personal information; and A method comprising: obtaining user identification information from a server connected to the kiosk based on the user's response to the transmitted notification; 4. In paragraph 3, the user identification information is: A method characterized in that it includes information about at least one of the user's age, gender, height, or disability level.

5. In the second paragraph, the step of obtaining the user characteristic information is: A step of obtaining the body characteristic information regarding the eye height and physical defect of the user from the above-mentioned captured image; and A method comprising: a step of obtaining eye characteristic information regarding the focus direction of the user's eyes with respect to guidance content output on the display; 6. In paragraph 5, the location information is: A method comprising information regarding one of a plurality of preset height steps for the display and whether to control the forward and backward position.

7. In paragraph 5, the user interface information is: A method characterized in that it includes information regarding at least one of the size, position or spacing of at least one content output to the display.

8. In the 6th paragraph, the step of controlling the driving unit is: A step of adjusting the height of the display based on the above height step; A step of controlling the display to protrude forward at the height stage based on whether the forward / backward position is controlled; and A method comprising: a step of controlling the driving unit to stop the display when a distance value measured by a proximity sensor provided on the front of the display is identified as being less than a threshold distance value; 9. In paragraph 7, the artificial intelligence model, Learned to determine the size of at least one content based on the user's age included in the user identification information or the user characteristic information, Learn to determine the location and spacing of at least one content based on whether the user has a physical defect included in the user characteristic information, A method characterized in that, when the user is identified as being visually impaired based on the disability level included in the user identification information or the eye characteristic information, the method is trained to convert visual content output on the display into voice.

10. In the 8th paragraph, the step of controlling the driving unit is: A method further comprising: a step of controlling the tilt of the display based on the eye feature information after the display is stopped, when the display is controlled to protrude forward; 11. For user-customized kiosks, camera; display; drive unit; network interface; Memory that stores one or more instructions; At least one processor performing one or more of the above instructions; At least one processor, Obtain user identification information about users who have approached the above kiosk within a certain distance, When the user identification information obtained above is input, the user identification information is input into an artificial intelligence model that outputs positional information about the height and front / rear position of a display that outputs at least one content and user interface information about the output method of the display, thereby obtaining the positional information and the user interface information. Based on the acquired position information, a driving unit for adjusting the position of the display is controlled, A user-customized kiosk that outputs at least one content to the display based on the acquired user interface information.

12. In the method of operating a user-customized kiosk, A step of obtaining user identification information about a user who approaches within a predetermined distance to the kiosk; When the user identification information obtained above is input, a step of obtaining the position information and the user interface information by inputting the user identification information into an artificial intelligence model that outputs position information regarding the height and front-back position of a display that outputs at least one content and user interface information regarding the output method of the display; A step of controlling a driving unit that adjusts the position of the display based on the acquired position information; and A computer-readable recording medium storing a program for performing a method, including a step of outputting at least one content to the display based on the acquired user interface information.

Images