Digital input interface device

Abstract

This enables processing of screen press directions using charged particles. [Solution] A digital input interface device comprising: a light-emitting device having a screen that can emit light by a light-emitting layer; a light-receiving device that recognizes the screen; and a control device that analyzes data relating to the screen obtained by the light-receiving device, wherein the screen constitutes an information input unit, the light-emitting layer is capable of changing the light-emitting state of the screen in accordance with the operation of an object that can be operated non-contact with the screen in order to input information to the input unit, the light-emitting layer has a charged particle emission unit that emits charged particles into a non-vacuum, and a charged particle detection unit disposed between the charged particle emission unit and the object, and the control device detects the position information of the object in the direction perpendicular to the surface of the light-emitting layer based on any of the pixel values ​​of the data relating to the screen, color components, hue, saturation, and brightness.

Description

[Technical Field]

[0001] This invention relates to a digital input interface device. [Background technology]

[0002] While touch panels are fundamentally contact-based input interfaces, recent social trends have led to expectations for contactless input interfaces. In contactless input interfaces, if the input interface device is not far enough from the fingers used to transmit information, there is a risk of accidental contact with the device panel. Therefore, a distance of 2 cm or more is required for contactless operation.

[0003] Non-contact input interface devices include infrared camera-based aerial input devices and wearable aerial input devices (for example, Non-Patent Document 1).

[0004] An infrared camera-based aerial input device is equipped with a display device that shows the input area and multiple CMOS camera modules that detect reflected light from an infrared laser, with an infrared semiconductor laser module for position detection located at the bottom. In the infrared camera-based aerial input device, when the object being input crosses the infrared laser used for position detection, the position information of the object is acquired by multiple camera units using methods such as triangulation, and the information input by the object is detected.

[0005] Known wearable air input devices include "Gest," among others. Wearable air input devices are input interfaces that are worn on a person's hand. A wearable air input device consists of attachment parts that are attached to several of the five fingers, and a main unit that is attached to the back of the hand and electrically connected to the attachment parts. Each attachment part is equipped with a sensor, and information about the movement of the five fingers acquired by the sensors is input to the main unit.

[0006] Other air input devices utilizing electrostatic luminescence are known (for example, Patent Documents 1 and 2). Patent Documents 1 and 2 disclose a charged particle detection method comprising a charged particle emission unit that emits charged particles into a non-vacuum, a charged particle injection unit into which charged particles are incident, and a charged particle detection film or charged particle detection liquid containing a luminescent substance disposed between them. Example 2 of these prior art documents describes SrAl2O4:Eu 2+ The text, accompanied by photographs, explains that when a voltage is applied to a stainless steel rod on which a charged particle detection film containing luminescent materials is formed, and a person's hand is moved, the luminescent part moves in the direction of the hand's movement. [Prior art documents] [Patent Documents]

[0007] [Patent Document 1] Patent No. 6980282 [Patent Document 2] U.S. Patent No. 11004572 [Non-patent literature]

[0008] [Non-Patent Document 1] Optical Touch Interface (Course: Display User Interface) [Overview of the project] [Problems that the invention aims to solve]

[0009] However, in infrared camera-based aerial input devices such as Non-Patent Document 1, the irradiation range of the infrared laser used for position detection is limited, resulting in cases of non-detection even when a key is typed, or false detection when foreign objects such as dust cross the infrared laser used for position detection. Furthermore, there are problems such as the inability to accommodate flexible shapes and the reaction to foreign objects such as dust. In addition, in applications of virtual keyboards, since the fingertips do not react when a key is typed, it is difficult to tell where the key is when the fingers are far apart, and there are issues such as mistyping when the keys are closely spaced.

[0010] When using wearable aerial input devices, the person operating them must wear the device, which means they are not particularly useful in the field of aerial input devices where there is a demand for contactless operation.

[0011] Since the airborne input device utilizing electrostatic emission does not use an infrared laser for position detection, it is less prone to the aforementioned non-detection and false detection, and can accommodate flexible shapes. However, there are also challenges with the devices utilizing electrostatic emission described in Patent Documents 1 and 2. Patent Documents 1 and 2 do not disclose anything about the operation of moving a human hand in a pressing direction against a charged particle detection film, and pressing processes utilizing charged particles were not known.

[0012] This invention was made in view of the above circumstances, and aims to provide a digital input interface device that utilizes charged particles and is capable of processing screen pressing directions. [Means for solving the problem]

[0013] The inventors have discovered that when an object used to operate a digital input interface device is brought close to a screen equipped with a light-emitting layer having a charged particle emission section, such that it is within a predetermined range, the way the light-emitting layer emits light changes significantly. In other words, the present invention provides the following means to solve the above problem.

[0014] [1] A digital input interface device according to one aspect of the present invention includes a light-emitting device having a screen that can emit light by a light-emitting layer, a light-receiving device that recognizes the screen, and a control device that analyzes data regarding the screen obtained by the light-receiving device. The screen constitutes an information input part, the light-emitting layer is capable of changing the light-emitting state of the screen in response to the operation of an object that can be operated on the screen in a non-contact manner to input information to the input part, the light-emitting layer has a charged particle emitting part that emits charged particles into a non-vacuum and a charged particle detecting part disposed between the charged particle emitting part and the object, the control device detects the position information of the object in the plane normal direction of the light-emitting layer based on any one of the pixel values, color components, hue, saturation, and lightness of the data regarding the screen.

[0015] [2] In the digital input interface device of [1] above, the control device detects the position information of the object in the plane normal direction of the light-emitting layer based on the number of pixels identified as pixels indicating light emission among the pixel values, color components, hue, saturation, and lightness of the data regarding the screen.

[0016] [3] In the digital input interface device of [1] or [2] above, the control device may perform binarization processing on the data regarding the screen and detect the position information based on the area of the light-emitting region in the binarized image data.

[0017] [4] In the digital input interface device of [l] to [3] above, the light-emitting layer may have a region where the change in the pixel value of the data regarding the screen is 10 or more or the change in the color component of the data regarding the screen is 10 or more with respect to a change in the distance between the object and the screen in the plane normal direction of the light-emitting layer of 5 (mm) or less.

[0018] [5] In the digital input interface devices described in [1] to [4] above, the data relating to the screen is monochrome image data or RGB image data, and the control device converts the data relating to the screen into HSV image data and detects the position information based on the hue, saturation and brightness of the HSV image data.

[0019] [6] In the digital input interface devices described in [1] to [5] above, when a finger is brought close to the object in the direction perpendicular to the surface of the light-emitting layer, the change in the number of pixels in the light-emitting region of the binarized image data of the HSV image data for a change in the distance between the object and the screen of 5 mm or less may have a region of 100 pixels or more.

[0020] [7] In the digital input interface device described in [1] to [6] above, a display device is further provided that projects an input screen onto the screen, and the control device holds position information of the input screen and processes the position information of the object and the position information of the input screen in association.

[0021] [8] In the digital input interface devices described in [1] to [7] above, the light receiving device may acquire positional information of the screen, and the control device may identify that a push operation has been performed when the number of pixels in the light-emitting region of the binarized image data relating to the screen increases by 200% or more.

[0022] [9] Any of the digital input interface devices described in [1] to [8] above includes a display device that projects an input screen onto the screen, and the control device may control the display device to switch the input screen projected when the position of the light emission of the screen is moved in the in-plane direction while the push operation is performed.

[0023]

[10] The control device may process the digital input interface devices described in [1] to [9] above as having received information corresponding to the movement path of the light emission position when the position of the light emission on the screen is moved in the in-plane direction while the push operation is performed. [Effects of the Invention]

[0024] According to the present invention, it is possible to provide a digital input interface device, a control method, and an operation method for the digital input interface device that are capable of processing screen pressing directions using charged particles. [Brief explanation of the drawing]

[0025] [Figure 1] This is a conceptual diagram showing an example of the configuration of a digital input interface device relating to one embodiment of the present invention. [Figure 2] Figure 1 is a cross-sectional view showing an example of the configuration of a light-emitting device provided in the digital input interface device. [Figure 3] Figure 2 is a perspective view illustrating the operation of the light-emitting device, and is a perspective view showing an example of the operating state during input. [Figure 4] This graph, according to Example 1, shows the correlation between the area of ​​the white-displayed region (luminescent region) in the binarized image data and the distance between the screen and the object in the direction perpendicular to the screen surface. [Figure 5] This graph, according to Example 2, shows the correlation between the color component G in RGB image data and the distance between the screen and the object in the direction perpendicular to the screen surface. [Figure 6] This graph, according to Example 2, shows the correlation between the area of ​​the light-emitting region corresponding to the number of pixels in a binarized image of RGB image data with respect to the distance between the screen and the object in the direction perpendicular to the screen surface. [Modes for carrying out the invention]

[0026] The following describes this embodiment in detail. The following description is an example of the present invention, and the present invention is not limited thereto. It can be modified as appropriate without changing the essence of the invention. In addition, the drawings used in the following description may be enlarged for convenience in order to make the features of the present invention easier to understand, and the dimensional ratios of each component may not be the same as in reality.

[0027] [Digital Input Interface Device] Figure 1 is a conceptual diagram showing an example of the configuration of a digital input interface device according to one embodiment of the present invention. The digital input interface device 10 shown in Figure 1 comprises a light-emitting device 11 having a screen 14 that can emit light using a light-emitting layer 12, a light-receiving device 16 that recognizes the screen 14, a control device 17 that analyzes data related to the screen 14 obtained by the light-receiving device 16, and a display device 18 that projects a predetermined input screen onto the screen 14. In the digital input interface device 10, the position information of an object 15 in the direction perpendicular to the surface of the light-emitting layer 12 is detected based on the pixel values ​​of the screen 14, the color components, or the hue, saturation, and brightness. As described later, in this embodiment, detecting the position information of an object 15 in the direction perpendicular to the surface of the light-emitting layer 12 based on the pixel value of the screen 14, the color component, the hue, saturation, and the brightness means that the configuration is not limited to detecting the position information of an object 15 directly from the numerical values ​​of the pixel value of the screen 14, the color component, the hue, saturation, and the brightness, but also includes configurations that detect the position information of an object 15 based on other criteria that reflect the pixel value of the screen 14, the color component, the hue, saturation, and the brightness. For example, the configuration includes detecting the position information of an object 15 from the number of pixels (area of ​​the light-emitting region) of the light-emitting state of each pixel, which can be identified by whether or not a criterion is met in the pixel value of each pixel of the screen 14, the color component, the hue, saturation, and the brightness.

[0028] The screen 14 of the light-emitting device 11 constitutes the information input unit 13 for the digital input interface device 10. The light-receiving device 16 is a data acquisition device for acquiring data related to the screen 14. The control device 17 is an analysis device capable of analyzing the information input to the input unit 13.

[0029] In this specification, "apparatus" is a term that can be interpreted in a broad sense and may refer to machines, instruments, etc., or elements, components, etc., contained within machines, instruments, etc. An apparatus may be a configuration obtained by combining multiple machines, instruments, etc. An apparatus may include intangible things such as programs and data.

[0030] The input unit 13 allows for contactless information input. Therefore, the light-emitting layer 12 can be operated contactlessly with respect to the screen 14 in order to input information to the input unit 13. Specifically, the light-emitting layer 12 is configured to change the illumination state of the screen 14 in accordance with the movement of an object 15 that is attempting to input information to the input unit 13. The control device 17 detects the information to be input to the input unit 13 according to the illumination state of the screen 14. The light-emitting device 11, including the input unit 13, will be described below.

[0031] <Light-emitting devices> Figure 2 is a cross-sectional view showing an example of the configuration of a light-emitting device 11 provided in the digital input interface device of Figure 1. In Figure 2, the directions that constitute the plane on which the screen 14 and the light-emitting layer 12 extend are defined as the y-direction and z-direction, and the direction perpendicular to the screen 14 and the light-emitting layer 12 is defined as the x-direction. The light-emitting device 11 consists of, for example, a light-emitting layer 12 connected to an electrostatic generator 20. The light-emitting device 11 can emit light by, for example, electrostatic electricity applied by the electrostatic generator 20. The light-emitting layer 12 includes a charged particle emission unit 21 connected to the electrostatic generator 20 and a charged particle detection unit 22 formed on the charged particle emission unit 21, as shown in Figure 2.

[0032] The shape of the light-emitting device 11 may be selected from planar, curved, convex, or concave shapes. Examples of non-planar shapes include conical (the shape of the conical surface constituting the side of the cone) and cylindrical (the shape of the cylindrical surface constituting the side of the cylinder). When the light-emitting device 11 is in the shape of a cone or prism, the screen 14 may be formed along the side of the cone or prism, and the screen 14 does not need to be formed on the bottom surface of the cone or prism. On the other hand, from the viewpoint of improving the accuracy of detecting the position information of the object 15 in the direction perpendicular to the surface of the screen 14, it is preferable that the shape of the light-emitting device 11 is smooth and has a small curvature. For example, it is preferable that the curvature is 1 rad / mm or less.

[0033] The thickness of the light-emitting layer 12 is not particularly limited, but is preferably 1 μm or more and 10 mm or less, and more preferably 10 μm or more and 200 μm or less. The light-emitting device 11 may have one or more light-emitting layers 12. If there are two or more light-emitting layers 12, the light-emitting materials 23 contained in each light-emitting layer 12 may be the same or different. The number of light-emitting layers 12 is not particularly limited, but may be limited to five layers or less from the viewpoint of cost, etc.

[0034] The light-emitting layer 12 preferably contains a light-emitting material 23 that emits light in at least a portion of the wavelength range selected from ultraviolet light, visible light, and infrared light. If the light emitted from the light-emitting layer 12 includes at least a portion of the wavelength range of visible light, the light emission of the light-emitting layer 12 can be perceived by the user's naked eye.

[0035] The charged particle emission unit 21 may be spread across the entire screen 14, or it may be placed in a part of the screen 14. Regardless of the position of the object 15 relative to the screen 14, directionality relative to the object 15 is not necessary for the charged particles to act on the object 15. For example, charged particles may be emitted uniformly from the screen 14. The number density (per area) of charged particles emitted in the direction normal to the screen 14 may be approximately uniform within the plane, or it may have a distribution within the plane.

[0036] (Charged particle emission section) The charged particle emission section 21 is not particularly limited as long as charged particles are emitted from its surface. Typical materials that can constitute the charged particle emission section 21 include, but are not limited to, conductors such as metals with high electrical conductivity such as tungsten, stainless steel, gold, silver, and copper, and semiconductors such as silicon. For example, if the charged particles are electrons, aluminum may be used as the charged particle emission section 21.

[0037] The charged particles emitted from the charged particle emission unit 21 are incident on an object 15 that can serve as a charged particle incident unit. The charged particle incident unit is not particularly limited as long as charged particles can be incident on its surface. Typical materials that constitute the charged particle incident unit include, but are not limited to, conductors such as metals with high electrical conductivity such as tungsten, stainless steel, gold, silver, and copper, and semiconductors such as silicon. If the charged particles are electrons and the charged particle emission unit 21 contains a conductor such as a metal, an electrostatic generator 20 may be connected to the charged particle emission unit 21.

[0038] The object 15 may be an artificial object such as a rod or pen, or it may be a part of a living organism such as a human finger. Examples of objects 15 include touch pens and stylus pens. The object 15 may be an accessory to the digital input interface device 10, or it may be an external component.

[0039] (Charged particle detection unit) The charged particle detection unit 22 is positioned between the charged particle emission unit 21 and the object 15. Since the position of the object 15 is arbitrary as long as it is non-contact and not in close proximity, the charged particle emission unit 21 emits charged particles toward the object 15 so that the charged particles pass through the charged particle detection unit 22. As a result, the charged particle detection unit 22 can change the illumination state of the screen 14 according to the distance from the object 15 in the direction perpendicular to the surface.

[0040] The charged particle detection unit 22 includes a base material 24 and a light-emitting substance 23. Examples of the base material 24 include paper, cloth, projection paper, metal, resin, silicon, plastic, or combinations thereof. The luminescent material containing the luminescent substance 23 may be coated or laminated on the base material 24, or may be impregnated or dispersed in the base material 24.

[0041] The luminescent substance 23 is not particularly limited, but is preferably a luminescent substance other than the fluorescent substance described later, and may be a substance that emits light by X-rays, ultraviolet rays, visible light, etc., or a substance that emits light by chemical changes or biological enzymes. Here, the "fluorescent substance" refers to a substance that emits light by absorbing energy such as irradiated X-rays, ultraviolet rays, or visible light. If the luminescent substance 23 is the luminescent substance described in Patent Document 1, it can be appropriately selected and used. Also, substances not described in Patent Document 1 can be adopted as the luminescent substance 23.

[0042] A "stress luminescent substance" may be used as the luminescent substance 23. The "stress luminescent substance" refers to a substance that emits light (including visible light, ultraviolet light, and near-infrared light) due to deformation caused by mechanical external force. Examples of the stress luminescent substance include those mainly composed of oxides, sulfides, selenides, or tellurides having a spinel structure, a corundum structure, a β-alumina structure, a silicate, a defect-controlled aluminate, a structure in which a wurtzite structure and a sphalerite structure coexist, etc., and those in which at least a part of the alkali metal ions and alkaline earth metal ions constituting these are substituted with at least one metal ion of a rare earth metal ion and a transition metal ion.

[0043] The "stress luminescent substance" is not particularly limited, but specific examples include LiSrPO4:Eu 2+ , LiBaPO4:Eu 2+ , BaTiO 3― CaTiO3:Pr 3+ , ZnS:Mn 2+ , ZnS:Ga 2+ , ZnS:Cu 2+ , CaAl2Si2O^8:Eu 2+ , Ca2Al2SiO7:Ce 3+ , SrAl2O4:Ce3+ SrAl2O4:Eu 2+ SrAl2O4:Eu 2+ ,Dy 3+ SrAl2O4:Eu 2+ ,Ho 3+ SrAl2O4:Ho 3+ Ce 3+ Sr3Al2O6:Eu 2+ CaYAl3O7:Eu 2+ SrAl2O4:Eu 2+ ,Cr 3+ ,Nd 3+ These are some examples.

[0044] A "afterglow substance" may be used as the luminescent substance 23. An "afterglow substance" is a substance that stores irradiated visible light, ultraviolet light, or other light (electromagnetic waves) and continues to emit light even after irradiation is stopped. Specific examples of afterglow substances include radium compounds, promethium compounds, zinc sulfide (ZnS system), and strontium aluminate (SrAl2O4 system), with zinc sulfide (ZnS system) or strontium aluminate (SrAl2O4 system) having 1- to 3-valent metal ions such as Dy or Eu added in any proportion being preferred. Here, "addition" is a concept that also includes "co-addition" and "activation," which involve adding two or more substances simultaneously.

[0045] The term "afterglow substance" is not particularly limited, but a specific example is SrAl2O4:Eu 2+ ,Dy 3+ These are some examples.

[0046] The light emitted by the light-emitting layer 12 is projected onto the screen 14.

[0047] It is preferable that the light-emitting layer 12 can change its light emission state even if the distance from the screen 14 to the object 15 in the direction perpendicular to the surface of the light-emitting layer 12 is 200 mm or less, and it is more preferable that the distance is 50 mm or less. However, it is acceptable for the object 15 to temporarily come into contact with the screen 14 during operation of the input unit 13. It is also possible to adopt a configuration that allows operation even when in contact with the screen 14, as a screen 14 that can be operated without contact. Here, the digital input interface device 10 is configured such that the pixel values, color components, and brightness of the screen 14 change based on the distance between the screen 14 and the object 15 in the direction perpendicular to the surface of the screen 14. For example, the pixel values, color components, and brightness of the screen 14 are configured to increase as the distance decreases, within a range where the distance between the screen 14 and the object 15 in the direction perpendicular to the surface of the screen 14 is greater than or equal to a predetermined value. Therefore, if a criterion is set for each pixel to determine whether or not it is in an emitting state based on either the pixel value, the color component, or the brightness (with respect to brightness, along with hue and saturation), then as the distance between the screen 14 and the object 15 decreases, the number of pixels in an emitting state increases, and the area of ​​pixels in an emitting state increases. The control device 17 is configured to detect the position information of the object 15 in the direction perpendicular to the surface of the light-emitting layer 12 based on the pixel value, color component, and brightness of the data relating to the screen. Here, a criterion may be set for brightness (V) together with hue (H) and saturation (S). In this embodiment, the configuration for detecting the position information of the object 15 in the direction perpendicular to the surface of the light-emitting layer 12 based on either the pixel value, color component, hue, saturation, or brightness includes a configuration for detecting the position information of the object in the direction perpendicular to the surface of the light-emitting layer 12 by the number of pixels that satisfy the criterion of whether or not the pixel value, color component, hue, saturation, and brightness are in an emitting state within a predetermined area. In other words, this embodiment may be configured to detect the positional information of the object 15 based on the number of pixels that are emitting light within a predetermined area. The reference values ​​for the pixel value in a monochrome image, the color component in an RGB image, and the hue, saturation, and brightness in an HSV image, used to determine whether each pixel is emitting light, can be appropriately set according to the configuration of the light-emitting layer 12 that affects the way light is emitted.

[0048] The screen 14 is recognized by the light receiving device 16. That is, the light receiving device 16 acquires data related to the screen 14.

[0049] (Light receiving device) The light-receiving device 16 is not particularly limited, but examples include a visible light camera, an infrared camera, an ultraviolet camera, a photodetector, etc. The light-receiving device 16 may also be an imaging device or a photoelectric converter. The light-receiving device 16 may also have functions other than light-receiving or imaging functions, such as communication functions or recording functions.

[0050] The light-receiving device 16 is preferably capable of simultaneously observing at least a portion of the screen 14, but may observe at least one point on the screen 14. The number of light-receiving devices 16 is not particularly limited and may be one or two or more. Two or more light-receiving devices 16 may each observe different areas of the screen 14.

[0051] The detection of light emission on the screen 14 by the light receiving device 16 can be distinguished by using a color space such as a monochrome model, an RGB color model, or an HSV model, or by using binarized image data obtained by binarizing an image of any of these.

[0052] A monochrome model is image data represented by a single color, where brightness is expressed by the difference in the value of each pixel. For example, in an 8-bit image where one pixel is represented by 8 bits, the brightness is expressed by 256 gradations of pixel values ​​from 0 to 255. A pixel value of 0 is black, and a pixel value of 255 is white. When light is emitted from the light-emitting device 11, the pixel value of the area corresponding to the light-emitting area in the data related to the screen 14 becomes a high value.

[0053] In the RGB color model, color is described by the amount of each element (color component) of red (R), green (G), and blue (B) present in the image data. The red (R), green (G), and blue (B) color components are represented by 256 numbers ranging from a minimum of 0 to a maximum of 255. For example, in the RGB color model, (R,G,B) being (0,0,0) is black, (255,255,255) is white, and (255,0,0) is red. The brightness (V) of each pixel can be calculated from each element of the RGB color model, as will be explained later.

[0054] The HSV model is image data in a color space composed of three components: hue (H), saturation (S), and lightness (V). The values ​​of each component in the HSV model can be calculated from the color components of the RGB color model.

[0055] Hue (H) is expressed by the following formula (1) when the R value in the RGB color model is at its maximum, by the following formula (2) when the G value is at its maximum, and by the following formula (3) when the B value is at its maximum. In the following formulas, R, G, and B represent the red (R), green (G), and blue (B) color components in 256 levels, MAX represents the maximum value for red (R), green (G), and blue (B), and min represents the minimum value for red (R), green (G), and blue (B). Also, in the following formulas, if the value is negative, the hue (H) is the value obtained by adding 360 to that value. Hue (H) takes a value within the range of 0 to 359. H=60×{(BG) / (MAX-min)}···(1) H=60×〔2+{(RB) / (MAX-min)}〕···(2) H=60×〔4+{(GR) / (MAX-min)}〕···(3)

[0056] Saturation (S) is expressed by the following formula (4). S=255×{(MAX-min) / MAX}···(4)

[0057] Brightness (V) is the maximum value of any of the RGB values ​​in the RGB color model. That is, Brightness (V) is the value of equation (5) below. V = MAX ···(5)

[0058] The reference value in binarized image data can be calculated from one of the following: the monochrome model, the RGB color model, or the HSV model.

[0059] (a) A binarized image using a monochrome model can be obtained using a criterion for determining whether or not each pixel shows light emission based on whether or not the pixel value of each pixel is equal to or greater than a reference C. In the binarization of an 8-bit image, the reference C for the pixel value is, for example, 50. In the binarization process, for example, pixels that are equal to or greater than the reference C are set to white, and pixels that are less than the reference C are set to black to obtain binarized image data. Note that the way light is emitted detected by the light receiving device 16 differs depending on the light-emitting material and environment, so the value of reference C can be adjusted as appropriate depending on the light-emitting material, environment, etc.

[0060] (b) A binarized image using the RGB color model can be obtained, for example, by determining whether any of the R, G, or B color components of each pixel is greater than or equal to a reference C. For example, the reference C is 50. In the binarization process, for example, pixels that are greater than or equal to the reference C can be set to white, and pixels that are less than the reference C can be set to black to obtain binarized image data. Note that the way light is emitted, such as the emitted color and brightness, differs depending on the light-emitting material and environment, so which of the R, G, or B color component values ​​to refer to, and the value of the reference C can be adjusted as appropriate depending on the light-emitting material and environment.

[0061] (c) A binarized image using the HSV model can be obtained by determining whether the hue (H), saturation (S), and lightness (V) values ​​of each pixel are within a predetermined range. For example, binarization can be performed by determining whether the hue (H) is within the range of 35 to 80, the saturation (S) is within the range of 35 to 255, and the lightness (V) is within the range of 35 to 255. In the binarization process, for example, pixels within the above range can be set to white and pixels outside the range to black to obtain binarized image data. Note that the way light is emitted, such as the emitted color, differs depending on the light-emitting material, environment, etc., so the ranges of hue (H), saturation (S), and lightness (V) can be adjusted as appropriate depending on the light-emitting material, etc.

[0062] Common color spaces correspond to the wavelength range of visible light, as they define physical quantities related to human visual and psychological perception. Appropriate methods can be used for the wavelength ranges of infrared or ultraviolet light.

[0063] For example, using the electrostatic light emission technology described in Patent Document 1, light emission occurs when a finger is brought close to an electrostatic light emission material and a device to which static electricity has been applied. The input unit 13 of the embodiment utilizes the electrostatic light emission technology to react to an object 15 such as a fingertip without contact (not in close proximity) and cause the screen 14 to emit light, which can then be recognized by the light receiving device 16.

[0064] Even when the fingertip is away from the screen 14, i.e., non-contact, the user can recognize that they are pointing to the illuminated area on the screen 14, thus reducing the likelihood of incorrect input. The aforementioned light-emitting device 11 can also meet the requirements for a flexible device and is less susceptible to foreign objects such as dust. Furthermore, because it has high accuracy in detecting the position of the light-emitting element in conjunction with the finger at non-proximity distances (5 cm or more is possible) (less than 1 mm is possible), it is possible to enlarge the input section 13 consisting of the screen 14.

[0065] If the light emitted from the light-emitting layer 12 is ultraviolet or infrared light that does not include visible light, the light emission can be detected by the light-receiving device 16 without being perceived by the user's naked eye. Even if the user does not perceive the light emission from the light-emitting layer 12 itself, the user can easily confirm the input content by changing the content displayed on the screen 14 according to the input content. The content displayed on the screen 14 can include, for example, characters, symbols, icons, images, etc.

[0066] (display device) The display device 18 presents a predetermined display on the screen 14. For example, the display device 18 presents an input screen on the screen 14. The display device 18 is, for example, a projector capable of projecting a predetermined display onto the screen 14. The display device 18 may also be a display device provided separately from the light-emitting layer 12 on the light-emitting device 11.

[0067] The display device 18, for example, displays information transmitted from the control device 17 on the screen 14. The display device 18 is controlled by the control device 17 to display an input screen on the screen 14, for example.

[0068] (Control device) The control device 17 is, for example, a computer device having a program capable of image analysis. The control device 17 may include an arithmetic unit, a memory unit, a control unit, etc. At least some of these components may be realized by hardware such as large-scale integrated circuits (LSIs) and integrated circuits (ICs), or by the cooperation of software such as programs and hardware.

[0069] The control device 17 has the function of receiving data related to the screen 14 obtained by the light receiving device 16. Preferably, the light receiving device 16 has at least a transmitting function and the control device 17 has at least a receiving function. Furthermore, the light receiving device 16 may also have a receiving function, or the control device 17 may have a transmitting function. The light receiving device 16 and the control device 17 may have bidirectional transmitting and receiving functions. The transmitting and receiving functions may use wireless methods such as radio waves or electromagnetic waves, or wired methods such as electric wires or optical fibers.

[0070] By analyzing the data related to the screen 14 obtained by the light receiving device 16 with the control device 17, the distance in the x-direction between the screen 14 and the object 15 can be obtained. Furthermore, the position of the object 15 in the yz-direction can be obtained with respect to coordinates appropriately set on the screen 14. The control device 17 can, for example, store information from the input screen displayed on the screen 14, and process this information as linked information to the position information in the yz-direction of the light emitted in the data related to the screen 14 obtained by the light receiving device 16.

[0071] The control device 17 converts the data related to the screen 14 acquired by the light receiving device 16 into other data as appropriate, and detects the position information of the object 15 in the x direction based on the pixel value, color component, hue, saturation, and brightness, or the number of pixels (area of ​​the light-emitting region) based on these values.

[0072] If the data relating to screen 14 is monochrome image data, the position information of the object 15 in the x-direction can be detected by its pixel value, or by the number of pixels whose pixel value is equal to or greater than a predetermined value. As described above, in the data relating to screen 14, the region corresponding to the light-emitting area of ​​the light-emitting device 11 shows a high pixel value. For example, the region with the highest pixel value in the data relating to screen 14 is considered to be the data of the region closest to the object 15 in the x-direction. Also, as screen 14 and the object 15 get closer, the light-emitting area expands, so the number of pixels (pixel count) showing a high pixel value increases. Therefore, if the data relating to screen 14 is monochrome image data, the position information of the object 15 in the x-direction can be detected based on the pixel value. For example, among the data relating to screen 14, (i) the position information of the object 15 in the x direction can be detected from the highest pixel value, (ii) the position information of the object can be detected from the average value of the pixel values ​​of multiple pixels within a predetermined range in the yz direction of the screen, and (iii) the position information of the object can be detected from the number of pixels that emit light within a predetermined range in the yz direction of the screen. When detecting the position information of the object based on (ii) and (iii) the average value of the pixel values ​​of multiple pixels within a predetermined range or information of pixels that emit light, for example, the position information of the object can also be detected based on the average value of the pixel values ​​or the number of pixels that emit light in a range of 60 × 60 pixels = 3600 pixels centered on pixels that show high pixel values, which is considered to be located directly below the object 15.

[0073] If the data related to screen 14 is RGB image data, for example, the position information of the object 15 can be detected by the values ​​of red (R), green (G), and blue (B). The control device 17 prefers to use RGB image data to detect the position information of the object 15 rather than using monochrome image data.

[0074] If the data relating to screen 14 is RGB image data, for example, (i) the position information of the object 15 in the x-direction can be detected by the maximum value of any of the color components R, G, or B in each pixel. (ii) Alternatively, the position information of the object 15 can be detected by the average value of any of the color components R, G, or B in a region within a predetermined range in the yz direction of the screen, from the data relating to screen 14. For example, the position information of the object 15 can be detected based on the average value of the values ​​in a region within a range of 60 × 60 pixels = 3600 pixels in a strongly luminescent area that is thought to be located directly below the object 15. (iii) Alternatively, the position information of the object 15 can be detected by the number of pixels (number of pixels) that show light emission in a region within a predetermined range in the yz direction of the screen, for example, within a range of 3600 pixels. Here, for example, if the value of a reference color component among the color components R, G, and B is 50 or more out of 0 to 255, it can be identified that the pixel is showing light emission. Since the way light is emitted, including the color of emission, differs depending on the light-emitting material and environment, the method described above allows for adjustment of which of the color components R, G, or B is selected as the basis, and how the criteria value (or range) for whether or not light emission is observed can be determined, according to the light-emitting material. When identifying whether or not light emission is observed based on whether or not the color components R, G, and B of a pixel are within a predetermined range, the identification may be performed using one value of the color components R, G, and B, or using two values, or using three values.

[0075] If the data related to the screen is HSV image data, for example, the position information of the object 15 in the x-direction can be detected based on the parameter ranges of hue, saturation, and brightness described above. Alternatively, the position information of the object 15 can also be detected based on the hue, saturation, and brightness parameters of a region within a predetermined range in the yz direction of the screen, using the data related to the screen 14. For example, the position information of the object 15 can be detected by the number of pixels within a predetermined range in which the hue, saturation, and brightness parameters are identifiable as emitting light in a 60x60 pixel = 3600 pixel region that is thought to be directly below the object 15.

[0076] It is more preferable for the control device 17 to binarize one of the monochrome image data, RGB image data, or HSV image data, and to detect the position information of the object 15 based on the area (number of pixels) of the light-emitting region in the binarized image data. The larger the area of ​​the light-emitting region in the binarized image data, and the higher the total brightness, the smaller the distance of the object 15 from the light-emitting layer 12 in the x direction. The binarized image data using HSV image data is image data that has been binarized according to the criteria for identifying whether or not each pixel is in a light-emitting state, as shown in (a) to (c) above.

[0077] From the viewpoint of accurately acquiring the positional information of the object 15, it is preferable that the area of ​​the light-emitting region in the binarized image data of the screen 14 obtained by the light-receiving device 16 increases gradually as the x-direction distance of the object 15 approaches the light-emitting layer 12, but it is sufficient to confirm that the area of ​​the light-emitting region gradually increases as the distance decreases. On the other hand, from the viewpoint of easily identifying click operations, it is preferable that the area of ​​the light-emitting region in the binarized image data changes sharply as the x-direction distance of the light-emitting layer 12 approaches. Furthermore, it is preferable that the pixel values, color components, and area of ​​the binarized image data change significantly in accordance with the x-direction distance of the object 15.

[0078] For example, it is preferable that the light-emitting layer 12 has a region in which the change in pixel values ​​of the data relating to the screen 14 is 10 or more for a change in the distance between the object 15 and the screen 14 in the x direction of 5 (mm) or less, or in which the change in any of the R, G, or B color components of the data relating to the screen 14 is 10 or more.

[0079] Furthermore, for example, it is preferable that the light-emitting layer 12 has an area within a 60 × 60 (px) range of the screen 14 in which the change in the area of ​​the light-emitting region in the binarized image data relating to the screen 14 is 100 (px) or more in response to a change in the distance between the object 15 and the screen 14 in the x direction of 5 (mm) or less.

[0080] As described above, the light emission from the light-emitting layer 12 changes abruptly according to the x-direction distance from the object 15, making it suitable for adding a push function to a digital input interface device, such as a click operation by the object 15. Whether or not the object 15 has performed a push operation can be identified, for example, by checking whether the pixel value or color component has reached 110% or more, or whether it has reached 200% or more. The pixel value or color component used as the criterion for identifying whether or not the above ratio has been reached is the pixel value or color component at which light emission was first confirmed at the same position (same pixel) on the screen 14. Furthermore, whether or not the object 15 has performed a push operation can be determined, for example, by checking whether the number of pixels in the light-emitting region of the binarized image data exceeds a certain threshold (pixels) within a 60 × 60 pixels = 3600 pixels on an arbitrary planar rectangle. This threshold is, for example, a number of pixels in the range of 400 to 3000 pixels, preferably in the range of 750 to 2800 pixels, and more preferably in the range of 1000 to 2500 pixels. These methods utilize the fact that when an object 15 is gradually brought closer to the screen 14 from a sufficiently far distance in the x-direction, light emission is detected from a state of no light emission. Subsequently, even if the object 15 is brought closer, the light emission does not change much. If the object 15 continues to be brought closer in the x-direction, the light emission changes significantly within a predetermined range of x-direction distance from the screen 14.

[0081] Alternatively, the correlation of how the light-emitting device 11 emits light when the object 15 approaches the screen 14 in the x-direction may be confirmed in advance, and identification may be made based on whether or not it exceeds a reference value set based on that correlation, such as the pixel value, color component, or area of ​​the binarized image data related to the screen 14. For example, in a light-emitting layer 12 having a steep change region in which the pixel value, color component, and area of ​​the light-emitting region in the binarized image data related to the screen change sharply in response to a change in the x-direction distance between the object 15 and the screen 14, the reference may be set to 110% of the pixel value, color component, and area of ​​the light-emitting region in the binarized image data at the starting point of the steep change region, or it may be set to 200%. Here, a steep change region is a region in the light-emitting layer 12 where, as the x-direction distance between the object 15 and the screen 14 approaches, the pixel value, color component, and area of ​​the light-emitting region in the binarized image data increase monotonically, and where the change in pixel value, color component, and area of ​​the light-emitting region is 50% or more of the total, between the starting point (i.e., the point where monotonically increasing begins with a decrease in x-direction distance) and the ending point (i.e., the point where monotonically increasing ends with a decrease in x-direction distance). In the case of pixel value and color component, since they are expressed in 255 steps from 0 to 255, any region where the amount of monotonically increasing change is 128 or more can be considered a steep change region. Also, in the case of the area of ​​the light-emitting region, any region where the amount of monotonically increasing change is 1800px or more out of 60 × 60 = 3600px (3600 pixels) can be considered a steep change region. Here, the distance between the screen 14 and the object 15 at the starting point of the steep change region (hereinafter also referred to as the starting point distance) is measured in advance, and when the distance between the screen 14 and the object 15 in the x direction is smaller than the starting point distance, and the above criteria are met with respect to the value when it is the starting point distance, it is possible to identify that a push function such as a click operation has been performed.

[0082] Alternatively, the ratio of the pixel value, color component, or area of ​​the light-emitting region in the binarized image data of the light-emitting device 11 to the maximum value when the object 15 approaches the screen 14 in the z direction may be used as a reference. The ratio set as a reference is, for example, a value in the range of 10 to 90% of the maximum value, and preferably a value in the range of 20 to 50%. Here, in the range where the x-direction distance of the object 15 to the screen 14 is less than or equal to a predetermined value, the value tends to decrease gradually from the maximum value as the object 15 approaches the screen 14 in the x direction, so it is possible to identify the maximum value. In this embodiment, the point where the maximum value is taken may be called the endpoint of the steep change region, and the point where the minimum value of the steep change region is taken may be called the starting point of the steep change region.

[0083] The control device 17 is configured to switch screens according to the position on the input screen where a push operation was performed, for example, when a push operation is performed.

[0084] Furthermore, it is preferable that the control device 17 switches the input screen projected by the display device 18 in response to the in-plane movement of the light emission position on the screen 14 when a push operation is performed. For example, it may be controlled to scroll, swipe, or zoom in / out in response to the in-plane movement of the light emission position.

[0085] Furthermore, the control device 17 may be configured to process information corresponding to the movement path of the light emission position when the position of the light emission on the screen 14 is moved in the in-plane direction while a push operation is performed. For example, this processing enables the input of characters.

[0086] Figure 3 is a perspective view illustrating the operation of the light-emitting device shown in Figure 2, and is a perspective view showing an example of the operating state during input.

[0087] As shown in Figure 3, by moving the object 15, the area indicated by the object 15 at this moment can be extracted as the current position 31 from the illuminated area 30 that appears on the screen 14. Furthermore, it is possible to project a display 32 from the display device 18 toward the current position 31 of the illuminated area 30.

[0088] The display 32 can be presented on the screen 14 in an appropriate shape, such as a frame surrounding the current position 31, a line near the current position 31, or an arrow pointing to the current position 31. By looking at the display 32 on the screen 14, the user can confirm that their operation is being properly recognized by the input unit 13.

[0089] In Figure 3, the distance between the object 15 and the screen 14 in the x-direction is indicated by the symbol L. Within a certain range, as the distance L decreases, the light emitted by the light-emitting device 11 becomes stronger and the light-emitting area increases.

[0090] According to the digital input interface device of the above embodiment, it is possible to perform processing in the screen pressing direction, i.e., the x-direction, by utilizing charged particles.

[0091] Although the present invention has been described above based on preferred embodiments, the present invention is not limited to the embodiments described above, and various modifications are possible without departing from the spirit of the invention.

[0092] For example, in the above embodiment, the light-emitting device 11 is connected to an electrostatic generator 20 and emits light by applying electrostatic charge to the light-emitting layer 12. However, this embodiment is not limited to this example, and the light-emitting layer 12 may also emit light by applying a DC voltage.

[0093] Furthermore, the shape of the light-emitting layer 12 on the screen 14 is not particularly limited; the light-emitting layer 12 may be spread across the entire screen 14, or it may be formed in a part of the screen 14. The light-emitting layer 12 may be composed of, for example, 1 μm to 10 mm square in a direction along the screen 14. If multiple light-emitting layers 12 are arranged on a single screen 14, each light-emitting layer 12 may be configured to be able to be independently subjected to electrostatic or DC voltage. The screen 14 may have at least a short side of 10 mm or 100 mm or more, or it may be large, for example, 1 m or more. [Examples]

[0094] The present invention will be specifically described below with reference to examples. However, the present invention is not limited to these examples.

[0095] (Example 1) Luminescent material (SrAl2O4:Eu 2+ A mixture of a resin (substrate) containing ) and an aluminum foil was laminated to create an emissive layer, and an electrostatic generator was connected to the aluminum foil to form a thin light-emitting device. At this time, the emissive layer of the thin light-emitting device was installed horizontally.

[0096] A projector connected to the PC was used to project the PC screen onto a thin light-emitting device.

[0097] A user wearing an Earthband brought their finger vertically close to a thin light-emitting device. The light emission as the user's finger approached the device was captured by an RGB camera connected to a PC, and the movement of the user's finger as it approached the device was also captured by a camera placed to the side.

[0098] The screen data obtained from the RGB camera was converted to HSV image data using a PC. The conversion of RGB image data to HSV image data was performed based on the following formulas (1) to (5). (In the formula, R, G, and B represent the brightness levels of red (R), green (G), and blue (B) in 256 steps, MAX represents the maximum brightness level of red (R), green (G), and blue (B), and min represents the minimum brightness level of red (R), green (G), and blue (B).)

[0099] The hue (H) was converted using the following formula (1) in the region where the brightness of R is maximum in the RGB color model, the following formula (2) in the region where the brightness of G is maximum, and the following formula (3) in the region where the brightness of B is maximum. Note that the luminescent material (SrAl2O4:Eu) used in Example 1 2+ Since it exhibits yellowish-green emission, equation (2) was adopted from the following equations (1) to (3) for most of the region. H=60×{(BG) / (MAX-min)}···(1) H=60×〔2+{(RB) / (MAX-min)}〕···(2) H=60×〔4+{(GR) / (MAX-min)}〕···(3)

[0100] Saturation (S) is expressed by the following formula (4). S=255×{(MAX-min) / MAX}···(4)

[0101] The brightness (V) is the value of formula (5) below. V = MAX ···(5)

[0102] Next, the HSV image data was converted to binarized image data using a PC. The conversion of HSV image data to binarized image data was performed based on whether the hue (H) of the HSV image was within the range of 35 to 80, the saturation (S) was within the range of 35 to 255, and the lightness (V) was within the range of 35 to 255. Images within this range (i.e., those satisfying all conditions for H, S, and V) were displayed in white, and those outside the range were displayed in black. The binarization process was performed considering the environment in which Example 1 was implemented, and was adjusted to reduce the influence of light from the surrounding environment other than light emitted by the light-emitting device.

[0103] We calculated the correlation between the area (number of pixels) of white regions within a 60x60=3600 (px) range, centered on the brightest region located directly below the user's finger, in the binarized image data with respect to the distance between the user's finger and the screen perpendicular to the screen surface. Figure 4 is a graph showing the correlation between the area (number of pixels) of white regions in the binarized image data with respect to the distance between the screen and the user's finger perpendicular to the screen surface.

[0104] (Example 2) A thin light-emitting device was fabricated again in the same manner as in Example 1 and installed horizontally. Also in the same manner as in Example 1, a PC screen was projected onto the thin light-emitting device using a projector connected to a PC. A user wearing an earth band brought their finger vertically close to the thin light-emitting device. The light emission as the user's finger approached the thin light-emitting device was captured using an RGB camera connected to the PC, and the movement of the user's finger as it approached the thin light-emitting device was captured using a camera placed to the side. In the RGB image data obtained in this way, the correlation between the color component G of the pixel located directly below the user's finger and the distance between the user's finger and the screen in the direction perpendicular to the screen surface was determined. Furthermore, the RGB image was binarized, and the correlation between the number of pixels in the emitting state and the above distance in the obtained binarized image data was determined. Here, in the binarization process, pixels with G in the range of 50 to 255 were represented as emitting light and shown in white, and pixels outside this range were represented as not emitting light and shown in black. Furthermore, the above pixel count represents the number of pixels in an illuminated state in a 60 × 60 = 3600 (px) area centered around pixels with a high color component G located directly below the user's finger. Figures 5 and 6 are graphs showing the correlation of the color component G in RGB image data with respect to the distance between the screen and the user's finger in the direction perpendicular to the screen surface, and graphs showing the correlation of the number of pixels (px) in an illuminated state with respect to the distance between the screen and the user's finger in the direction perpendicular to the screen surface, respectively, in Example 2.

[0105] In both the graphs of Example 1 and Example 2, it was confirmed that, in the direction perpendicular to the screen surface, when the distance between the user's finger and the screen is within a predetermined range (approximately 24mm to 28mm in Example 1 and approximately 25mm to 32mm in Example 2), as the user's finger approaches the screen of the thin light-emitting device, there is a region (steep change region) where the light emission intensity in the light-emitting layer increases, and the area of ​​the light-emitting region in the color component and binarized image data increases. Since the color component G in the RGB image data increased significantly, it is inferred that even when a monochrome color model image is received by the light-receiving device, the pixel value in the light-emitting layer increases as the user's finger approaches the screen of the light-emitting device within the above range. Therefore, the digital input interface device according to the above embodiment can detect the position information of an object in the direction perpendicular to the surface of the light-emitting layer. Furthermore, in any of the monochrome image data, RGB color model image data, and HSV image data, by setting an ON / OFF reference within the steep change region, a push function can be provided that functions with only slight changes in the distance between the object, such as the user's finger, and the light-emitting layer in the direction perpendicular to the surface.

[0106] Furthermore, in both the graphs for Example 1 and Example 2, within a predetermined range (less than approximately 24 mm in Example 1 and less than approximately 25 mm in Example 2) where the distance between the user's finger and the screen perpendicular to the screen surface, there is a region where the luminescence intensity in the light-emitting layer slightly decreases as the user's finger approaches the screen of the thin light-emitting device. This is thought to be due to the effect of afterglow. However, the decrease in luminescence intensity is slight, and the luminescence intensity itself is approximately the same as the maximum value. Therefore, it can be said that the luminescence intensity of the thin light-emitting device has a region where it saturates with respect to the distance between the user's finger and the screen perpendicular to the screen surface. [Explanation of symbols]

[0107] 10: Digital input interface device, 11: Light-emitting device, 12: Light-emitting layer, 13: Input unit, 14: Screen, 15: Object, 16: Light receiving device, 17: Control device, 20: Electrostatic generator, 21: Charged particle emission unit, 22: Charged particle detection unit, 23: Luminescent material, 24: Substrate

Claims

1. The device comprises a light-emitting device having a screen capable of emitting light through a light-emitting layer, a light-receiving device that recognizes the screen, and a control device that analyzes data related to the screen obtained by the light-receiving device. The aforementioned screen constitutes the information input section. The light-emitting layer is capable of changing the light-emitting state of the screen in accordance with the operation of an object that can be operated non-contact with the screen in order to input information to the input unit. The light-emitting layer includes a charged particle emission unit that emits charged particles into a non-vacuum, and a charged particle detection unit that is disposed between the charged particle emission unit and the object. The control device is a digital input interface device characterized by detecting the position information of the object in the direction perpendicular to the surface of the light-emitting layer based on any of the pixel values ​​of the data relating to the screen, the color components, the hue, saturation, and the brightness.

2. The digital input interface device according to claim 1, wherein the control device detects the position information of the object in the direction perpendicular to the surface of the light-emitting layer based on the number of pixels identified as emitting light based on the pixel values ​​of the data relating to the screen, the color components, the hue, saturation, and brightness.

3. The control device performs a binarization process on the data relating to the screen and detects the position information based on the area of ​​the light-emitting region in the binarized image data, according to claim 1 or 2.

4. The digital input interface device according to claim 1, wherein the light-emitting layer has a region in which the change in pixel values ​​of data relating to the screen is 10 or more, or the change in color components of data relating to the screen is 10 or more, for a change in the distance of the object and the screen in the direction perpendicular to the surface of the light-emitting layer of 5 mm or less.

5. The data relating to the aforementioned screen is either monochrome image data or RGB image data. The control device converts data relating to the screen into HSV image data and detects the position information based on the hue, saturation, and brightness of the HSV image data, according to claim 1.

6. The digital input interface device according to claim 5, wherein when a finger is brought close to the object in the direction perpendicular to the surface of the light-emitting layer, the change in the number of pixels in the light-emitting region of the binarized image data of the HSV image data for a change in the distance between the object and the screen of 5 mm or less has a region of 100 px or more within a 60 x 60 (px) area of ​​the screen.

7. The device further comprises a display device that projects an input screen onto the aforementioned screen, The control device holds the position information of the input screen and processes the position information of the object and the position information of the input screen in association, as described in claim 1.

8. The light receiving device acquires the position information of the screen, The digital input interface device according to claim 1, wherein the control device identifies that a push operation has been performed when the number of pixels in the light-emitting region of the binarized image data relating to the screen increases by 200% or more.

9. The device further comprises a display device that projects an input screen onto the aforementioned screen, The digital input interface device according to claim 8, wherein the control device controls the display device to switch the input screen projected onto the screen when the position of the light emission of the screen is moved in the in-plane direction while the push operation is performed.

10. The control device processes information corresponding to the movement path of the light emission position as input when the position of the light emission on the screen is moved in the in-plane direction while the push operation is performed, according to claim 8.

Images