Display apparatus including non-touch sensor module and method for inputting using the same

Abstract

The present invention relates to a display device including a non-touch sensor module and a non-touch input method using the same. More specifically, the invention relates to a display device including a non-touch sensor module and a non-touch input method using the same, wherein, when supporting non-touch input during an epidemic of infectious diseases such as COVID-19 by utilizing a non-touch sensor module using a reflective optical sensor, the output of a light reception signal from a single air layer without changing the air layer is determined to be noise and can be deleted at the non-touch input location.

Description

Technology Field

[0001] The present invention relates to a display device including a non-touch sensor module and a non-touch input method using the same. Background Technology

[0002] In the event of an infectious disease outbreak, the disease can spread through objects shared by multiple people. For example, if an infected person places an order through a kiosk equipped with a touchscreen, the touchscreen can become contaminated with pathogens, and the infectious disease can spread through the contaminated touchscreen.

[0003] To solve this problem, Korean Patent No. 2372045 presents a contactless air-touch based kiosk, comprising the steps of: setting the tilt of a plurality of air sensors that detect air touch inputs; detecting the air touch inputs based on a sensing area formed by infrared rays output from the set plurality of air sensors; determining the validity of the detected air touch inputs; if the air touch inputs are determined to be valid inputs, converting the valid touch inputs, which are the air touch inputs determined to be valid inputs, into communication protocol signals of a kiosk control system; and transmitting the converted communication protocol signals to a computing device of the kiosk control system.

[0004] However, this method has a problem in that the air sensor (AS2) that detects the position of the finger prior to clicking and the detection area (SA2) form a horizontal plane horizontal to the kiosk screen, so in order to separate the detection area by a certain distance from the touchscreen, the light-emitting and light-receiving sensors must be installed protruding by a certain distance vertically from the touchscreen.

[0005] In addition, there is a problem in that it is difficult to determine whether an input is an actual command or an incorrect input when a user operates a kiosk non-touchwise. The problem to be solved

[0006] The problem to be solved by the present invention is to provide a new non-touch sensor module having a sensing area sufficiently spaced apart from a touchscreen and a wide vertical width of the sensing area, which facilitates the detection of fingers.

[0007] Another problem to be solved by the present invention is to provide a display device including a non-touch sensor module and a non-touch input method using the same, which can perform more accurate input when a non-touch input is performed using a display device including a non-touch sensor module. means of solving the problem

[0008] A display device including a non-touch sensor module according to an embodiment of the present invention for achieving the purpose described above comprises: a touchscreen; a non-touch sensor module including first and second inclined plates having polygonal inclined surfaces and formed along the side of the touchscreen, and forming a plurality of air layers by the polygonal inclined surfaces; wherein the first inclined plate and the second inclined plate each include a first reflective optical sensor array and a second reflective optical sensor array, each comprising a plurality of light-emitting and light-receiving elements symmetrically arranged along the polygonal inclined surfaces, and a control unit that determines a non-touch input position according to the position of a light-receiving element that outputs a light-receiving signal by reflected light by sequentially emitting light from the light-emitting elements of the first reflective optical sensor array and the second reflective optical sensor array; wherein, if the control unit is in a state where a designated input screen is being displayed through the touchscreen, the output of a light-receiving signal in a single air layer without a change in the air layer is determined to be noise and deleted at the non-touch input position.

[0009] At this time, the control unit can set a detection area spaced apart from the touchscreen at a predetermined distance and determine whether there is a change in the air layer based on the air layer corresponding to the detection area.

[0010] At this time, the control unit can set the detection area in response to the quarantine guidelines.

[0011] In addition, the polygonal slope surface includes a high slope surface, a medium slope surface, and a low slope surface, and the plurality of air layers may include a high slope surface air layer, a medium slope surface air layer, and a low slope surface air layer.

[0012] In addition, the above-mentioned input screen may be a keypad input screen.

[0013] A non-touch input method in a display device comprising: a touch screen according to an embodiment of the present invention for achieving the purpose described above; a first and second inclined plate having a polygonal inclined surface and formed along the side of the touch screen and forming a plurality of air layers by the polygonal inclined surface; wherein the first inclined plate and the second inclined plate each include a first reflective optical sensor array and a second reflective optical sensor array each comprising a plurality of light-emitting and light-receiving elements symmetrically arranged along the polygonal inclined surface, and a control unit determining a non-touch input position according to the position of a light-receiving element that outputs a light-receiving signal by reflected light by sequentially emitting light from the light-emitting elements of the first reflective optical sensor array and the second reflective optical sensor array; wherein the control unit determines whether a designated input screen is output through the touch screen; and if it is determined that a designated input screen is being output through the touchscreen, the method may include the step of determining that the output of a light reception signal in a single air layer without a change in the air layer during the output of the light reception signal is noise and deleting it at a non-touch input location.

[0014] In addition, the method further includes the step of setting a detection area spaced apart at a predetermined interval on the touchscreen; and the deletion step can determine whether there is a change in the air layer based on the air layer corresponding to the detection area.

[0015] In addition, the above-mentioned input screen may be a keypad input screen. Effects of the invention

[0016] According to the present invention, a new non-touch sensor module with an improved recognition distance is provided. Additionally, according to the present invention, a display device including a new non-touch sensor module with an improved recognition distance is provided.

[0017] The display device according to the present invention has a sensing area sufficiently spaced apart from the touchscreen, and can more accurately distinguish and process non-touch user inputs, such as clicks and movements like keypad operation, in a non-touch manner. Brief explanation of the drawing

[0018] FIGS. 1 to 3 are drawings for explaining a display device including a non-touch sensor module according to an embodiment of the present invention. FIGS. 4 and FIGS. 5 are drawings for explaining the process of determining a non-touch input position according to an embodiment of the present invention. FIG. 6 is a drawing for explaining an air layer formed in a non-touch sensor module according to one embodiment of the present invention. FIG. 7 is a diagram illustrating non-touch input in a keypad input screen according to an embodiment of the present invention. FIG. 8 is a diagram illustrating the process of transmitting a signal generated from a light receiving element of a non-touch sensor module according to the present invention to a control unit. FIG. 9 is a drawing showing an example of a display device including a non-touch sensor module according to an embodiment of the present invention. FIG. 10 is a drawing showing a screen that operates in a non-touch manner when a display device including a non-touch sensor module according to one embodiment of the present invention operates as a kiosk. Specific details for implementing the invention

[0019] In order to clarify the features and advantages of the means for solving the problem of the present invention, the present invention will be described in more detail with reference to specific embodiments of the present invention illustrated in the attached drawings.

[0020] However, detailed descriptions of known functions or configurations that may obscure the essence of the invention are omitted in the following description and the attached drawings. Additionally, it should be noted that identical components throughout the drawings are indicated by the same reference numerals whenever possible.

[0021] Terms and words used in the following description and drawings should not be interpreted as being limited to their ordinary or dictionary meanings, but should be interpreted in a meaning and concept consistent with the technical spirit of the invention, based on the principle that the inventor can appropriately define the concept of terms to best describe his invention. Accordingly, the embodiments described in this specification and the configurations illustrated in the drawings are merely the most preferred embodiments of the invention and do not represent all aspects of the technical spirit of the invention; therefore, it should be understood that various equivalents and modifications capable of replacing them may exist at the time of filing this application.

[0022] The use of terms such as 'first, second, third' preceding the components mentioned in the following description is intended solely to avoid confusion regarding the components being referred to, and is unrelated to the order, importance, or master-subordinate relationship between the components. For example, an invention including only the second component without the first component can also be implemented.

[0023] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0024] FIGS. 1 to 3 are drawings for explaining a display device including a non-touch sensor module according to an embodiment of the present invention.

[0025] Referring to FIGS. 1 to 3, a display device (1000) according to the present invention comprises a touchscreen (10), a non-touch sensor module (1) having polygonal inclined surfaces (101, 201) and first and second inclined plates formed along the side of the touchscreen (10) and forming a plurality of air layers by the polygonal inclined surfaces (101, 201); wherein, the first inclined plate and the second inclined plate each comprise a first reflective optical sensor array (100) and a second reflective optical sensor array (200), each comprising a plurality of light-emitting and light-receiving elements symmetrically arranged along the polygonal inclined surfaces (101, 201).

[0026] It is characterized by comprising a control unit (300) that determines a non-touch input position according to the position of a light receiving element that outputs a light receiving signal by reflected light by sequentially emitting light from the light-emitting elements of the first reflective light sensor array (100) and the second reflective light sensor array (200).

[0027] The first reflective optical sensor array (100) refers to a set of first reflective optical sensors (102) mounted on a first inclined plate having a polygonal inclined surface (101) disposed on one side of a touchscreen (10). The polygonal inclined surface (101) of the first reflective optical sensor array (100) is composed of a high inclined surface (101'), a medium inclined surface (101"), and a low inclined surface (101"'), and each of the first reflective optical sensors (102) has the same illumination range. The first reflective light sensors mounted on the high slope surface (101') form a low-angle first reflective light sensor (110) that illuminates light at a low angle and receives reflected light, the first reflective light sensors mounted on the medium slope surface (101") form a medium-angle first reflective light sensor (120) that illuminates light at a medium angle and receives reflected light, and the first reflective light sensors mounted on the low slope surface (101"') form a high-angle first reflective light sensor (130) that illuminates light at a high angle and receives reflected light.

[0028] The second reflective optical sensor array (200) refers to a set of second reflective optical sensors (202) mounted on a second inclined plate having a polygonal inclined surface (201) disposed on the other side of the touchscreen (10). Similar to the first reflective optical sensor array (100), the polygonal inclined surface (201) of the second reflective optical sensor array (200) consists of a high inclined surface (201'), a medium inclined surface (201"), and a low inclined surface (201"'), and each of the second reflective optical sensors (202) has the same illumination range. The second reflective optical sensors mounted on the high slope surface (201') form a second reflective optical sensor (210) for low angles that illuminates light at a low angle and receives reflected light, the second reflective optical sensors mounted on the medium slope surface (201") form a second reflective optical sensor (220) for medium angles that illuminates light at a medium angle and receives reflected light, and the second reflective optical sensors mounted on the low slope surface (101"') form a second reflective optical sensor (230) for high angles that illuminates light at a high angle and receives reflected light.

[0029] To explain the first and second reflective optical sensors (102, 202) in more detail, FIG. 3a illustrates the first reflective optical sensor (102) forming the first reflective optical sensor array (100), and FIG. 3b illustrates the second reflective optical sensor (202) forming the second reflective optical sensor array (200). The first reflective optical sensor (102) and the second reflective optical sensor (202) are classified as first and second for convenience of explanation, and their configuration and operation can be performed identically.

[0030] When describing the first reflective optical sensor (102) forming the first reflective optical sensor array (100) of FIG. 3a, the first reflective optical sensor (102) is an integrated reflective optical sensor in which a light-emitting element and a light-receiving element are formed as one through a single mold, and comprises a substrate (103), a light-emitting chip (104) which is a light-emitting element mounted on the substrate and emits infrared light, a light-receiving chip (105) which is a light-receiving element mounted alongside the light-emitting chip (104) and receives reflected light, a molding (106) surrounding the light-emitting chip (104) and the light-receiving chip (105), and a lens (107) which refracts and / or concentrates the light emitted or received for inclined light emission and reception. The molding (106) of the first reflective optical sensor (102) of the first reflective optical sensor array (100) is made of black epoxy resin to block extraneous light, and the light-emitting chip (104) is made of a light-emitting diode chip, and an infrared photodiode chip that emits infrared light is used so that it can be separated from general visible light. The light-receiving chip (105) is a photodiode that outputs an electrical signal when infrared light is incident. The lens (107) can be formed in various shapes, and for example, a hemispherical lens may be used, but is not limited thereto. A light-blocking barrier (108) is formed between the light-emitting chip (104) and the light-receiving chip (105) to prevent direct crosstalk.

[0031] Light emitted from the light-emitting chip (104) diffuses and reaches the lens (107), and is refracted at the lens surface and concentrated within a predetermined range and emitted. Then, when the finger (f) is positioned, the reflected light reflected from the finger (f) is refracted at the lens surface and concentrated.

[0032] A method for determining a non-touch input position in a non-touch sensor module (1) including such a first reflective optical sensor array (100) and a second reflective optical sensor array (200) will be explained with further reference to FIGS. 4 and 5.

[0033] FIGS. 4 and FIGS. 5 are drawings for explaining the process of determining a non-touch input position according to an embodiment of the present invention.

[0034] Referring to FIGS. 1 to 5, the control unit (300) sequentially lights up the first reflective light sensor (110) for low angle in the first reflective light sensor array (100) along the y direction to emit light, and checks the first reflective light sensors (102) for which a light reception signal is output by the reflected light reflected from the finger in the first reflective light sensor (110) for low angle. Next, it sequentially lights up the first reflective light sensor (120) for medium angle in the y direction to emit light, and checks the first reflective light sensors (102) for which a light reception signal is output by the reflected light reflected from the finger. Next, it sequentially lights up the first reflective light sensor (130) for high angle in the y direction to emit light, and checks the first reflective light sensors (102) for which a light reception signal is output by the reflected light reflected from the finger, and through this, determines the first position and movement of the finger.

[0035] At the same time, the control unit (300) sequentially lights up the first reflective light sensor (210) for low angle in the second reflective light sensor array (200) along the y direction to emit light, and checks the second reflective light sensors (202) that output a light reception signal based on the reflected light reflected from the finger. Next, it sequentially lights up the second reflective light sensor (220) for medium angle to emit light, and checks the second reflective light sensors (202) that output a light reception signal based on the reflected light reflected from the finger. Next, it sequentially lights up the second reflective light sensor (230) for high angle to emit light, and checks the reflective light sensors that output a light reception signal based on the reflected light reflected from the finger, and determines the position and movement of the finger through this.

[0036] Here, the control unit (300) can simultaneously or sequentially emit light from each of the second reflective light sensors (202) of the second reflective light sensor array (200) which are symmetrically arranged with the first reflective light sensors (102) of the first reflective light sensor array (100).

[0037] For example, if the control unit (300) emits an n=1 reflective light sensor among the first reflective light sensors (110) for low angle in the first reflective light sensor array (100), it may simultaneously emit an n=1 reflective light sensor among the second reflective light sensors (210) for low angle in the corresponding second reflective light sensor array (200). Additionally, the control unit (300) may emit all the second reflective light sensors (202) in the second reflective light sensor array (200) after emitting all the first reflective light sensors (102) in the first reflective light sensor array (100).

[0038] In addition, the control unit (300) can emit light from the first reflective light sensor (102) of the first reflective light sensor (110) for low angle of the first reflective light sensor array (100), then emit light from the first reflective light sensor (102) of the first reflective light sensor (120) for medium angle, and then emit light from the first reflective light sensor (102) of the first reflective light sensor (130) for high angle, and can also emit light from all reflective light sensors (102) of the first reflective light sensor array (100) without distinction between low angle, medium angle, and high angle.

[0039] To explain more specifically the determination of the non-touch input position in the control unit (300), for example, as shown in FIG. 4, if a finger is at position f1, the light emitted when the first (n=1) reflective light sensor of the first reflective light sensor array (100) and / or the second reflective light sensor array (200) emits light is not reflected and passes through the detection area, so no light reception signal is output. Likewise, when the second (n=2) and third (n=3) reflective light sensors emit light, no light reception signal is recognized.

[0040] However, when the fourth (n=4) reflective light sensor emits light, the light emission signal is reflected by the finger (f1), and a light reception signal is generated by the reflected light. On the other hand, the light reception signal is not recognized by the fifth (n=5), sixth (n=6), and seventh (n=7) reflective light sensors. Through this, the control unit (300) can confirm that the y-coordinate position of the finger is the fourth (n=4) reflective light sensor.

[0041] In order to determine the x-coordinate position of the finger, the control unit (300) uses the width of the light receiving element into which reflected light is incident. In FIG. 4, the first reflective optical sensors (102) forming the first reflective optical sensor array (100) have an optical path that extends parallel across the touchscreen (10). When a finger (f1) is not positioned in front (n=1, 2, 3, 5, 6, 7), the light emitted from the first reflective optical sensor (102) forming the first reflective optical sensor array (100) is not reflected and passes through the detection area. When a finger (f1) is positioned in front of the first reflective optical sensor array (100) (n=4), the light emitted from the light-emitting element of the fourth reflective optical sensor is reflected by the finger (f1). The reflected light is diffused and incident on the light-receiving elements of the first reflective optical sensors (102) at the b1 area, i.e., n=3, n=4, n=5, and is output as a light-receiving signal.

[0042] In addition, light emitted from the second reflective light sensor (202) forming the second reflective light sensor array (200) is reflected from the finger (f1), and the reflected light diffuses and is incident on the light receiving elements of the second reflective light sensors (202) of the b1' region, i.e., n=3, n=4, and n=5, and is output as a light receiving signal.

[0043] Meanwhile, when the finger is at position f2, the reflected light from the first reflective light sensor array (100) spreads into a wider b2 area, and light reception signals are generated in five first reflective light sensors (n=2, 3, 4, 5, 6), including the n=4 reflective light sensor element that emitted light. On the other hand, when the finger is at position f2, since it is closer to the second reflective light sensor array (200), the reflected light spreads into a narrower b2' area.

[0044] In this way, the control unit (300) can determine the x-coordinate of the finger because the width of the reflective light sensor (100, 200) that generates the light reception signal corresponds to the distance from the finger. To this end, the control unit (300) stores data regarding the number of light-receiving reflective light sensors (100, 200) in advance in a database according to the position and distance of the finger, and can quickly determine the position of the finger by comparing it with the light reception signal.

[0045] In order to determine the precise z-position and movement of the finger, light is irradiated sequentially from the first reflective light sensor (110) for low angle, the first reflective light sensor (120) for medium angle, and the first reflective light sensor (130) for high angle, as illustrated in FIG. 5. Likewise, light is irradiated sequentially from the corresponding second reflective light sensor (210) for low angle, the second reflective light sensor (220) for medium angle, and the second reflective light sensor (130) for high angle.

[0046] When the low-angle reflective optical sensor (110, 210) and the high-angle reflective optical sensor (130, 230) emit light, there is no reflected light, so it is determined that there is no finger in the z-axis detection area of ​​the low-angle reflective optical sensor (110, 210) and the z-axis detection area of ​​the high-angle reflective optical sensor (130, 230), and when the medium-angle reflective optical sensor (120, 220) emits light, a light reception signal is detected from the low-angle reflective optical sensor (110, 210), the medium-angle reflective optical sensor (120, 220), and the high-angle reflective optical sensor (130, 230), so it is determined that there is a finger in the z-axis direction detection range using this.

[0047] Additionally, when clicking or selecting, the position of the finger momentarily moves down in the z-axis direction and then up again, causing the amount of light received incident on the low-angle reflective light sensor (110, 210), the medium-angle reflective light sensor (120, 220), and the high-angle reflective light sensor (130, 230) to change momentarily, and it is determined that a click or selection action has been performed using this. Through this process, the position and movement of the finger can be determined, and furthermore, the control unit (300) may determine the final position of the finger, i.e., the non-touch input position, by comprehensively considering the first position of the finger confirmed through the first reflective light sensor array (100) and the second position of the finger confirmed through the second reflective light sensor array (200).

[0048] A method for determining a non-touch input location in a display device (1000) including such a non-touch sensor module (1) will be described.

[0049] FIG. 6 is a drawing for explaining an air layer formed in a non-touch sensor module according to an embodiment of the present invention, and FIG. 7 is a drawing for explaining non-touch input in a keypad input screen according to an embodiment of the present invention.

[0050] First, referring to FIGS. 1 to 6, each of the first inclined plate and the second inclined plate of the present invention includes a polygonal inclined surface (101, 201), and the polygonal inclined surface (101, 201) is composed of a high inclined surface (101', 201'), a medium inclined surface (101", 201"), and a low inclined surface (101"', 201"').

[0051] A plurality of air layers are formed by these polygonal slopes, and the air layer formed by the high slope (101', 201') can be the high slope air layer (A), the air layer formed by the medium slope (101", 201") can be the medium slope air layer (B), and the air layer formed by the low slope (101"', 201"') can be the low slope air layer (C). At this time, as the number of polygonal slopes increases, more air layers can also be formed.

[0052] In this state, the control unit (300) can set a detection area spaced apart at a predetermined distance. Here, the detection area is an area described for detecting non-touch input from a user, and can be set, for example, spaced 10 cm to 15 cm or more away from the touchscreen (10). The setting of this detection area may vary depending on disease prevention guidelines; for example, if strict disease prevention guidelines such as social distancing are being implemented, the detection area can be set at a distance of 30 cm or more away from the touchscreen (10).

[0053] The control unit (300) checks the air layer corresponding to the set detection area. For example, if the detection area is set to be spaced 10 cm to 15 cm or more apart, it can be confirmed that the corresponding air layer is the medium slope air layer (B). Afterwards, the control unit (300) determines whether a light reception signal output is generated in the medium slope air layer (B). That is, the control unit (300) determines whether a light reception signal output is generated by the reflected light by emitting light from the light-emitting element of the first reflective light sensor (120) for medium angle.

[0054] If a light signal output is generated, as explained with reference to FIGS. 4 and FIGS. 5, the control unit (300) can determine the finger input position, that is, the non-touch input position.

[0055] And the control unit (300) determines whether the non-touch input is a click through a change in the z-axis direction as described with reference to FIG. 5. In the case of a click, the air layer changes, that is, as the finger changes from f1 to f2, the air layer that recognizes the finger position also changes from the medium slope air layer (B) to the high slope air layer (A), and the control unit (300) determines this as a click input.

[0056] In this situation, the control unit (300) of the present invention may determine that the light reception signal output in a single air layer is noise and delete it at a non-touch input location depending on whether a designated input screen is output through the touchscreen (10).

[0057] At this time, the designated input screen may be, for example, a keypad input screen. As shown in FIG. 7, when an input screen including multiple keypads is being displayed through a touchscreen (10), if a user wishes to input keypad 1 and keypad 9 non-touch, non-touch input operations such as clicking keypad 1, moving, and clicking keypad 9 can be performed.

[0058] At this time, in the case of clicking, as described above, it is a motion that requires a change in the air layer, and in the case of movement, a single air layer without a change in the air layer, that is, only a change in the x-axis and y-axis will occur without a change in the z-axis.

[0059] In order to process such non-touch inputs of clicking and moving more accurately, the control unit (300) according to an embodiment of the present invention determines whether it is a click or a move by checking whether there is a change in the air layer. That is, in the example described above, if the user wants to click keypad number 9 after clicking keypad number 1, the user moves to keypad number 5. Since a light receiving signal is output at the position corresponding to keypad number 5, the control unit (300) of the present invention determines that the output of the light receiving signal in a single air layer without a change in the air layer is noise and deletes it at the non-touch input position.

[0060] At this time, the control unit (300) of the present invention determines whether there is a change in the air layer based on the air layer corresponding to the detection area. If the air layer corresponding to the detection area is a medium slope air layer (B), it can determine whether there is a change in the air layer from the medium slope air layer (B) to the high slope air layer (A). If the air layer corresponding to the detection area is a low slope air layer (C), it determines whether there is a change in the air layer from the low slope air layer (C) to the medium slope air layer (B).

[0061] The control unit (300) of the present invention can accurately distinguish whether the non-touch input is a click or a movement through the change in the air layer, and can process more accurate non-touch input by deleting the input due to movement as noise on the keypad input screen.

[0062] In addition, although the designated input screen according to the embodiment of the present invention has been described as an example of a keypad input screen, if it is an input screen that includes a set of multiple command buttons similar to a keypad input screen and processes click and movement inputs separately, it may be deleted at a non-touch input location by determining it as noise based on whether there is a change in the air layer, not only on a keypad input screen but also on various other input screens.

[0063] Hereinafter, the process of transmitting a signal generated from a light receiving element of a non-touch sensor module according to an embodiment of the present invention to a control unit will be described.

[0064] FIG. 8 is a diagram illustrating the process of transmitting a signal generated from a light receiving element of a non-touch sensor module according to the present invention to a control unit.

[0065] As illustrated in FIG. 8, reflected light reflected from the finger and incident on the light receiving chip (220) is provided to the control unit (300) through a photo-current conversion process. First, since the light receiving chip (220), which is made of a photodiode, generates a microcurrent in proportion to the amount of light received, when a large amount of reflected light from the finger is incident on the light receiving chip (220), the amount of microcurrent increases, and when a small amount of reflected light from the finger is incident on the light receiving chip (220) or not incident, the amount of microcurrent decreases or only dark current flows.

[0066] The output microcurrent is converted into a voltage and amplified in the amplification / conversion unit (230) and output as a voltage signal. The voltage signal amplified and output by the amplification unit (230) is converted from an analog signal to a digital signal in the digital conversion unit (240) and then transmitted to the control unit (300). Through the input value, the control unit (300) determines the amount of light incident on the light receiving element.

[0067] In addition, a display device including a non-touch sensor module (1) according to an embodiment of the present invention may be, for example, a kiosk.

[0068] This will be explained with reference to FIGS. 9 and FIGS. 10.

[0069] FIG. 9 is a drawing showing an example of a display device including a non-touch sensor module according to an embodiment of the present invention.

[0070] FIG. 10 is a drawing showing a screen that operates in a non-touch manner when a display device including a non-touch sensor module according to one embodiment of the present invention operates as a kiosk.

[0071] As illustrated in FIGS. 9 and 10, a display device (1000) including a non-touch sensor module according to the present invention has a size of about 10 to 30 inches, and a rectangular touchscreen (10) is formed on the upper front of a body part (1002). The touchscreen (10) uses a pressure-sensitive touchscreen that detects the location where the screen is touched by using the pressure applied by the finger to the surface of the screen when a user touches the screen with a finger, or a capacitive touchscreen that detects the location where the screen is touched by using the electrical change applied by the finger to the surface of the screen.

[0072] A plurality of menu bars (110) are formed on the desktop of the above-mentioned touchscreen (10). The menu bars (1100) are formed in a rectangular shape and are spaced apart from each other at a predetermined distance. The internal area of ​​the menu bar (1100) has touch and non-touch operation functions activated, while the external area of ​​the menu bar has touch and non-touch operation functions deactivated. The menu bars (1100) are formed differently for each screen.

[0073] A first reflective optical sensor array (100) is installed on one side of the touchscreen (10) to detect the position and movement of a finger, and a second reflective optical sensor array (200) is installed on the other side to verify the position and movement of a finger detected by the first reflective optical sensor array (100) or to detect the position and movement of a finger located in an area not detected by the first reflective optical sensor array (100).

[0074] The control unit (300) includes a non-touch signal input unit (310) that identifies the position and movement of a finger using signals input from a first reflective optical sensor array (100) and a second reflective optical sensor array (200), a touch signal input unit (320) that inputs a signal input by touching a screen, an execution unit (330) that controls the operation of a kiosk using signals input from the non-touch signal input unit (310) and / or the touch signal input unit (320), and an input signal selection unit (340) that selects a signal input to the execution unit (330).

[0075] In the input signal selection unit (340), the administrator selects a signal input to the execution unit (330) from a touch signal, a non-touch signal, and a combination of a touch signal and a non-touch signal.

[0076] In a general situation, for example, when there are no separate quarantine guidelines such as social distancing, the manager sets the signal input from the input signal selection unit (340) to the execution unit (330) as a touch signal, and uses the signal input from the touch signal input unit (320) when executing.

[0077] In a situation where disease prevention is strengthened, for example, when strict disease prevention guidelines such as social distancing are being implemented, the manager sets the signal input from the input signal selection unit (340) to the execution unit (330) as a non-touch signal, and uses the signal input from the non-touch signal input unit (310) during execution.

[0078] When the level of quarantine reinforcement is low, for example, when social distancing is recommended, the manager sets the signal input from the input signal selection unit (340) to the execution unit (330) as a non-touch signal and a touch signal, so that when executed, the signal input by touch and the signal input by non-touch are adjusted to be possible simultaneously.

[0079] When a non-touch signal is selected by the input signal selection unit (340), the execution unit (330) provides a guidance screen containing a message announcing that the touchscreen (10) is in a non-touch input state and a message guiding the usage method. When the user touches the touchscreen from a distance of about 10 to 20 cm according to the guided usage method, it switches to the start screen. The user operates the start screen by moving their hand from a predetermined distance from the touchscreen in a manner that switches the guidance screen to the start screen.

[0080] Additionally, when the signal input from the input signal selection unit (340) to the execution unit (330) is set as a non-touch signal, power is supplied to the first reflective optical sensor array (100) and the second reflective optical sensor array (200), and the height and position of the finger are checked using the signals input from the first reflective optical sensor array (100) and the second reflective optical sensor array (200).

[0081] In addition, when the finger is within the normal range, that is, when the finger is positioned at a specified distance from the touchscreen, the finger is displayed on the touchscreen screen; and when the finger is not positioned at the specified distance from the touchscreen, for example, when it is too close or too far away, the finger is not displayed on the screen, or a finger with a different shape, for example, a dotted line, color, fill, etc., is displayed that is different from the finger when it is within the normal range, so that the user can check for themselves whether their hand is positioned at an appropriate distance from the touchscreen.

[0082] When the user moves their hand to select a menu bar formed on the touchscreen, the kiosk moves to the next screen and completes the order.

[0083] In addition, when multiple kiosks as described above are installed in stores at different locations and connected to a single central management server, the signal input method is remotely controlled by the management server. The management server (not shown) can uniformly change the kiosk input method in accordance with government quarantine guidelines, thereby adjusting the kiosk to operate as either touch-type or non-touch-type.

[0084] A non-touch input method in a display device including a non-touch sensor module of the present invention as described above may be provided in the form of a computer-readable medium suitable for storing computer program instructions and data.

[0085] In particular, the computer program of the present invention comprises a touchscreen; a non-touch sensor module including first and second inclined plates having polygonal inclined surfaces and formed along the side of the touchscreen, and forming a plurality of air layers by the polygonal inclined surfaces; wherein the first inclined plate and the second inclined plate each include a first reflective optical sensor array and a second reflective optical sensor array, each comprising a plurality of light-emitting and light-receiving elements symmetrically arranged along the polygonal inclined surfaces, and a control unit that determines a non-touch input position according to the position of a light-receiving element that outputs a light-receiving signal by reflected light by sequentially emitting light from the light-emitting elements of the first reflective optical sensor array and the second reflective optical sensor array. The method may execute steps such as determining whether a designated input screen is output through the touchscreen, and if it is determined that the designated input screen is output through the touchscreen, determining that the output of the light-receiving signal in a single air layer without a change in the air layer during the output of the light-receiving signal is noise and deleting it at the non-touch input position.

[0086] Computer-readable media suitable for storing such computer program instructions and data include, for example, recording media such as magnetic media (e.g., hard disks, floppy disks, and magnetic tapes), optical recording media (e.g., CD-ROM, Digital Video Disk), and floptical disks (e.g., magneto-optical media), and semiconductor memories such as ROM (Read Only Memory), RAM (Random Access Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM). Processors and memory may be supplemented by or integrated with special-purpose logic circuits.

[0087] Furthermore, computer-readable recording media may be distributed across networked computer systems, allowing computer-readable code to be stored and executed in a distributed manner. Additionally, the functional program for implementing the present invention, along with related code and code segments, may be easily inferred or modified by programmers skilled in the art to which the present invention pertains, taking into account the system environment of the computer that reads the recording media to execute the program.

[0088] In addition, a computer program recorded on a computer-readable recording medium as described above includes instructions that perform the functions described above, and can execute the aforementioned functions by being distributed and circulated through the recording medium, read, installed, and executed on a specific device or specific computer.

[0089] The present invention has been described with reference to embodiments illustrated in the drawings, but this is merely illustrative, and those skilled in the art will understand that various modifications and equivalent alternative embodiments are possible therefrom. Accordingly, the true technical scope of protection of the present invention should be determined by the technical concept of the claims. Explanation of the symbols

[0090] 10: Touchscreen 100: First reflective optical sensor array 200: Second reflective optical sensor array 300: Control unit 1000: Display device

Claims

Claim 1 A non-touch sensor module comprising a touchscreen; and first and second inclined plates having polygonal inclined surfaces and formed along the side of the touchscreen, and forming a plurality of air layers by the polygonal inclined surfaces; A display device comprising a non-touch sensor module, wherein the first inclined plate and the second inclined plate each include a first reflective optical sensor array and a second reflective optical sensor array, each comprising a plurality of light-emitting and light-receiving elements symmetrically arranged along the polygonal inclined surface, and a control unit that determines a non-touch input position according to the position of a light-receiving element that outputs a light-receiving signal by reflected light by sequentially emitting light from the light-emitting elements of the first reflective optical sensor array and the second reflective optical sensor array; wherein, while a keypad input screen is being displayed through the touchscreen, the control unit determines whether there is a change in the air layer based on the air layer corresponding to a detection area set at a predetermined distance from the touchscreen among the plurality of air layers, and determines that the output of a light-receiving signal in a single air layer without a change in the air layer is noise, which is an input due to movement on the keypad input screen, and deletes it at the non-touch input position. Claim 2 delete Claim 3 A display device comprising a non-touch sensor module, wherein, in claim 1, the control unit sets the detection area in response to quarantine guidelines. Claim 4 A display device comprising a non-touch sensor module, characterized in that, in claim 1, the polygonal inclined surface includes a high inclined surface, a medium inclined surface, and a low inclined surface, and the plurality of air layers include a high inclined surface air layer, a medium inclined surface air layer, and a low inclined surface air layer. Claim 5 delete Claim 6 A non-touch input method in a display device comprising: a touchscreen; a non-touch sensor module including first and second inclined plates having polygonal inclined surfaces and formed along the side of the touchscreen, and forming a plurality of air layers by the polygonal inclined surfaces; wherein the first inclined plate and the second inclined plate each include a first reflective optical sensor array and a second reflective optical sensor array, each comprising a plurality of light-emitting and light-receiving elements symmetrically arranged along the polygonal inclined surfaces, and a control unit that determines a non-touch input position according to the position of a light-receiving element that outputs a light-receiving signal by reflected light by sequentially emitting light from the light-emitting elements of the first reflective optical sensor array and the second reflective optical sensor array; wherein the control unit comprises the steps of: setting a detection area spaced apart from the touchscreen by a predetermined distance; determining whether a keypad input screen is output through the touchscreen; and, if it is determined that a keypad input screen is output through the touchscreen, determining whether there is a change in the air layer based on the air layer corresponding to the detection area among the plurality of air layers. A non-touch input method characterized by including the step of determining, based on the above judgment result, that the output of a light reception signal in a single air layer without a change in the air layer is noise that is input due to movement on the keypad input screen, and deleting it at a non-touch input location. Claim 7 delete Claim 8 delete

Images