Information processing device and program

Abstract

To provide an information processing apparatus and a program which allow touch operation and touchless operation to be used for an image display device.SOLUTION: A processor of an image processing apparatus acquires information of a height from an operation surface to a pointer, and overlap-displays an operator for touchless operation and an operator for touch operation in a display screen if the pointer is not in contact with the operation surface and a distance of deviation of the pointer from a height range in a height direction is equal to or shorter than a preliminarily set distance, and displays only the operator for touch operation in the display screen if the pointer is in contact with the operation surface.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and a program.

Background Art

[0002] Patent Document 1 discloses an information processing apparatus that enables an intuitive operation feeling of the position where each finger or pen approaches before the finger or pen contacts the operation device when the operation device and the display device are separate.

[0003] Patent Document 2 discloses an operation device that facilitates input within an operation space separated from an operation surface.

[0004] Patent Document 3 discloses a display control device that enables comfortable operation of display means for displaying a plurality of objects in an overlapping manner.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0006] An image display device in which an operation surface is laminated on a display screen and a contact operation can be performed for an operation element displayed on the display screen in a state where an indicator contacts the operation surface is used in various electronic devices.

[0007] Furthermore, an image display device has been proposed that enables non-contact operation, where the indicator does not come into contact with the operating surface and the indicator is within a preset height range from the operating surface, while the operation is performed on an operator displayed on the display screen.

[0008] However, none of the image display devices utilized a combination of contact and non-contact operation.

[0009] The purpose of this disclosure is to provide an information processing device and program that enables the combined use of contact and non-contact operations on an image display device. [Means for solving the problem]

[0010] An information processing apparatus in a first aspect of the present disclosure includes a processor, the processor and when displaying an operator on the display screen of an image display device in which an operating surface is superimposed on the display screen and an operating surface is superimposed on the display screen, the processor acquires height information from the operating surface to the operating surface, and when the operating surface is not in contact with the operating surface and an operating operator displayed on the display screen is performed when the operating surface is in contact with the operating surface, the processor displays an operating operator for non-contact operation and an operating operator for contact operation superimposed on the display screen, and when the operating surface is in contact with the operating surface, the processor acquires height information from the operating surface to the operating surface, and when the operating surface is not in contact with the operating surface and the distance from the operating surface to the operating surface is within a predetermined distance, the processor displays an operating operator for non-contact operation and an operating operator for contact operation superimposed on the display screen, and when the operating surface is in contact with the operating surface, the processor displays only an operating operator for contact operation on the display screen.

[0011] An information processing apparatus in a second aspect of the present disclosure, in an information processing apparatus in a first aspect, the processor displays only the operator for contact operation on the display screen when the indicator is located at a distance greater than or equal to a preset distance from the position furthest from the operating surface in the height range relative to the operating surface.

[0012] An information processing apparatus in a third aspect of the present disclosure, in an information processing apparatus in a first aspect, the processor displays a non-contact operator and a contact operator superimposed on the display screen when the indicator is located at a distance greater than or equal to a preset distance from the position furthest from the operating surface in the height range relative to the operating surface.

[0013] An information processing device according to a fourth aspect of the present disclosure, in an information processing device according to any one of the first to third aspects, the height range is set as a plurality of non-overlapping ranges in the height direction, each of the plurality of height ranges corresponds to a different non-contact operation element, and the processor displays on the display screen the non-contact operation element corresponding to the height range closest to the indicator among the plurality of height ranges.

[0014] In the fifth aspect of the present disclosure, in an information processing device according to any one of the first to fourth aspects, the processor superimposes non-contact operation controls and contact operation controls on the display screen, with the non-contact operation controls superimposed on the contact operation controls.

[0015] In the sixth aspect of the present disclosure, the information processing apparatus, in the fifth aspect of the present disclosure, displays the non-contact operation operator in a semi-transparent state when the processor superimposes and displays the non-contact operation operator on the display screen.

[0016] In the seventh aspect of the present disclosure, in an information processing device according to any one of the first to sixth aspects, the processor performs a process to reduce the visibility of the non-contact operation operator corresponding to the height range as the indicator moves away from the height range when displaying a non-contact operation operator and a contact operation operator superimposed on the display screen.

[0017] In the information processing apparatus of the eighth aspect of this disclosure, in the information processing apparatus of the seventh aspect, the process that reduces visibility is the process that improves transparency.

[0018] In the ninth aspect of this disclosure, the information processing device in the seventh or eighth aspect is one in which the process of reducing visibility is a process of reducing sharpness.

[0019] The information processing apparatus of the tenth embodiment of the present disclosure, in any one embodiment of the first to ninth embodiments, wherein the processor does not display the non-contact operation operator even when the movement status of the indicator satisfies a preset condition and the non-contact operation operator and the contact operation operator are superimposed on the display screen.

[0020] An information processing apparatus according to the 11th aspect of this disclosure, in an information processing apparatus according to the 10th aspect, the processor does not display the non-contact operation operator even when the non-contact operation operator and the contact operation operator are superimposed on the display screen when the indicator is approaching the operation surface at a speed greater than or equal to a preset speed.

[0021] A program according to a twelfth aspect of this disclosure causes a computer to perform the following steps when displaying an operator on the display screen of an image display device in which an operating surface is superimposed on the display screen, and an operating surface is superimposed on the display screen, and an operating operation is performed on an operator displayed on the display screen while the indicator is in contact with the operating surface, and a non-contact operation is performed on an operator displayed on the display screen while the indicator is not in contact with the operating surface and the indicator is within a preset height range from the operating surface: the program causes a computer to perform the following steps when displaying an operator on the display screen: the program causes a computer to perform the following steps: when the indicator is not in contact with the operating surface and the distance from the indicator outside the height range in the height direction is within a preset distance, the program causes a non-contact operator and an operating operator for contact operation to be superimposed on the display screen; and when the indicator is in contact with the operating surface, the program causes a computer to perform the following steps: [Effects of the Invention]

[0022] According to the information processing apparatus of the first aspect of the present disclosure, it is possible to use both contact operations and non-contact operations on an image display device.

[0023] According to the information processing apparatus of the second aspect of the present disclosure, when the indicator is away from the non-contact operation possible range from the operation surface, it is possible to prompt the operator to perform a contact operation.

[0024] According to the information processing apparatus of the third aspect of the present disclosure, when the indicator is away from the non-contact operation possible range from the operation surface, it is possible to prompt the operator to perform both non-contact operations and contact operations.

[0025] According to the information processing apparatus of the fourth aspect of the present disclosure, it is possible to use both contact operations and non-contact operations on an image display device in which a plurality of non-contact operation possible ranges are set in the height direction.

[0026] According to the information processing apparatus of the fifth aspect of the present disclosure, when viewed from the operator, the operator can be provided with a display that conforms to the operator's sense, with the operator for non-contact operation in the foreground.

[0027] According to the information processing apparatus of the sixth aspect of the present disclosure, when viewed from the operator, the operator can visually recognize the operator for contact operation on the back side.

[0028] According to the information processing apparatus of the seventh aspect of the present disclosure, when the indicator is away from the non-contact operation possible range, it is possible to enhance the visibility of the operator for contact operation rather than the operator for non-contact operation.

[0029] According to the information processing apparatus of the eighth aspect of the present disclosure, even when the operator for non-contact operation and the operator for contact operation overlap, it is possible to visually recognize the operator for contact operation.

[0030] According to the information processing apparatus of the ninth aspect of the present disclosure, it is possible to provide a display mode that conforms to the characteristic of the human eye that an object appears blurred when out of focus.

[0031] According to the information processing device of the tenth aspect of this disclosure, even in a situation where non-contact operation controls and contact operation controls are superimposed on the display screen, it is possible to exceptionally display only the contact operation controls.

[0032] According to the information processing device of the 11th aspect of this disclosure, in situations where it is expected that an operator will perform a contact operation, only the control elements for contact operation can be displayed.

[0033] According to the program of the twelfth aspect of this disclosure, it is possible to enable a combination of contact and non-contact operations on an image display device. [Brief explanation of the drawing]

[0034] [Figure 1] This is an external view of an image forming apparatus according to one embodiment of the present disclosure. [Figure 2] This block diagram shows the hardware configuration of an image forming apparatus according to one embodiment of the present disclosure. [Figure 3] This figure shows the configuration of a touch panel and a height detection device for an image forming apparatus according to one embodiment of the present disclosure. [Figure 4] This block diagram shows the functional configuration of an image forming apparatus according to one embodiment of the present disclosure. [Figure 5] This figure shows an example of how icons for touch operation are displayed on a touch panel screen. [Figure 6] This figure shows an example of how icons for contactless operation are displayed on a touch panel screen. [Figure 7] This figure shows an example of a display where icons for touch operation and icons for non-contact operation are superimposed on the touch panel display screen. [Figure 8] This diagram illustrates the process of displaying operation icons on a touch panel screen. [Figure 9] This diagram illustrates an alternative process for displaying operation icons on a touch panel screen. [Figure 10]This figure shows an example of displaying icons for contact operation and contactless operation superimposed, with the contactless operation icon being semi-transparent. [Figure 11] This diagram illustrates a process that reduces the visibility of icons used for contactless operation. [Figure 12] This figure shows an example of a display where the visibility of the contactless operation icon is reduced when contact operation icons and contactless operation icons are displayed superimposed. [Figure 13] This diagram illustrates the process of switching the icons displayed for non-contact operation depending on the height from the operating surface of the indicator. [Figure 14] This is a flowchart illustrating the processing flow when displaying an operation icon in an image forming apparatus according to one embodiment of the present disclosure. [Modes for carrying out the invention]

[0035] Hereinafter, examples of embodiments for implementing this disclosure will be described in detail with reference to the drawings. Figure 1 is an external view of an image forming apparatus of one embodiment.

[0036] The image forming apparatus 10 is a so-called multifunction device that has multiple functions such as scanning, copying, and facsimile. The image forming apparatus 10 also has a printing function that receives print data transmitted from an external device and outputs an image on paper according to the print data. The image forming apparatus 10 is also equipped with a touch panel 15. The image forming apparatus 10 is an example of an information processing device in the technology of this disclosure. The touch panel 15 is an example of an image display device in the technology of this disclosure.

[0037] Figure 2 is a block diagram showing the hardware configuration of the image forming apparatus 10 of this embodiment. As shown in Figure 2, the image forming apparatus 10 includes a CPU (Central Processing Unit) 11, RAM (Random Access Memory) 12, a storage device 13 such as a hard disk drive, a communication interface (abbreviated as IF) 14, a touch panel 15, a height detection device 16, a user interface (abbreviated as UI) device 17 such as various buttons, a scanner 18, and a print engine 19. These components are connected to each other via a control bus 20.

[0038] The touch panel 15 combines the functions of a display unit for displaying information about the device and icons for operation, and an input unit for receiving instructions for the icons.

[0039] Figure 3 shows the configuration of the touch panel 15 and height detection device 16 of the image forming apparatus 10 of this embodiment. As shown in Figure 3, the touch panel 15 has a structure in which an operating surface 15b is stacked on a display screen 15a. The touch panel 15 allows for contact operations, in which an operation is performed on an icon displayed on the display screen 15a while the indicator D is in contact with the operating surface 15b. The touch panel 15 also allows for non-contact operations, in which an operation is performed on an icon displayed on the display screen 15a while the indicator D is not in contact with the operating surface 15b and the indicator D is within a preset height range from the operating surface.

[0040] For contact operations, one example is to touch the contact operation icon displayed on the display screen 15a of the touch panel 15 to perform an input operation. For non-contact operations, one example is to have the indicator D wait for a predetermined time or longer within a predetermined height range HR above the non-contact operation icon displayed on the display screen 15a of the touch panel 15.

[0041] The indicator D used to operate the touch panel 15 can be anything that allows for operation of the touch panel 15, such as the operator's hand or finger, or a stylus pen.

[0042] The height detection device 16 is a device that detects the height H from the operating surface 15b to the indicator D. This height detection device 16 may be integrated with the touch panel 15 or it may be configured separately from the touch panel 15. Furthermore, the height detection device 16 can be of any type, for example, a capacitive type, a type that analyzes the position and movement of the indicator D from an image captured by a camera, or a type that shines a measuring light such as infrared or laser light onto the indicator D and measures the position and movement from the reflected light.

[0043] The height direction is the direction that intersects with respect to the operating surface 15b. In this embodiment, as an example, when the operating surface 15b is considered to be the XY plane, the height direction is defined as the Z axis direction perpendicular to the operating surface 15b.

[0044] The communication interface 14 transmits and receives data to and from external devices via the network. The UI device 17 receives user input from sources other than the touch panel 15. The scanner 18 reads the original document loaded into the image forming apparatus 10 as image data. The print engine 19 prints the image onto a recording medium such as printing paper through processes such as charging, exposure, development, transfer, and fixing.

[0045] The CPU 11 is a processor that controls the operation of the image forming apparatus 10 by executing predetermined processes based on a control program stored in the RAM 12 or storage device 13. In this embodiment, the CPU 11 is described as reading and executing a control program stored in the RAM 12 or storage device 13, but it is not limited to this. This control program may be provided in the form of a computer-readable recording medium. For example, this program may be provided in the form of a CD (Compact Disc)-ROM (Read Only Memory) or DVD (Digital Versatile Disc)-ROM recorded on an optical disc, or in the form of a USB (Universal Serial Bus) memory or memory card recorded on a semiconductor memory. Alternatively, this control program may be acquired from an external device via a communication line connected to the communication IF 14.

[0046] Figure 4 is a block diagram showing the functional configuration of the image forming apparatus 10 realized by the execution of the control program described above.

[0047] As shown in Figure 4, the image forming apparatus 10 of this embodiment includes an authentication unit 31, an operation input unit 32, a data transmission / reception unit 33, a control unit 34, a storage unit 35, an image reading unit 36, an image output unit 37, a height detection unit 38, and a touch panel 15.

[0048] The authentication unit 31 performs authentication processing for users who intend to use the image forming apparatus 10. The operation input unit 32 inputs information on various operations performed by the user. The data transmission / reception unit 33 transmits and receives data with external devices.

[0049] The control unit 34 controls the overall operation of the image forming apparatus 10, and based on user input, it controls the image reading unit 36 ​​to read the original image, and controls the output of print data from the image output unit 37, etc. The storage unit 35 stores the control program as well as various information necessary for the operation of the image forming apparatus 10.

[0050] The image reading unit 36 ​​reads the original image from the loaded original based on the control unit 34. The image output unit 37 outputs the image onto a recording medium such as printing paper based on the control unit 34. The height detection unit 38 detects the height H from the operating surface 15b to the indicator D.

[0051] As described above, the touch panel 15 of the image forming apparatus 10 in this embodiment can be operated by both contact and non-contact methods. For example, contact operation can be performed by touching the contact operation icon displayed on the display screen 15a of the touch panel 15. For example, non-contact operation can be performed by waiting for a predetermined time or longer within a predetermined height range HR above the non-contact operation icon displayed on the display screen 15a of the touch panel 15.

[0052] Figure 5 shows an example of the display of icons ICT for contact operation. When a contact operation is performed, icons ICT for contact operation are displayed on the display screen 15a of the touch panel 15, as shown in Figure 5. In this embodiment, as an example, six icons ICT for contact operation, from buttons A to F, are displayed. Icons ICT for contact operation are examples of touch operation controls in the technology of this disclosure.

[0053] Figure 6 shows an example of the display of the ICN icon for contactless operation. During contactless operation, the ICN icon for contactless operation is displayed on the display screen 15a of the touch panel 15, as shown in Figure 6. In this embodiment, as an example, the ICN icons for contactless operation of the nine numeric keypad keys from 0 to 9 are displayed. The ICN icon for contactless operation is an example of a contactless operation element in the technology of this disclosure.

[0054] Figure 7 shows an example of a display where the contact operation icon ICT and the contactless operation icon ICN are displayed superimposed. Figure 8 is a diagram illustrating the process of displaying operation icons on the display screen 15a of the touch panel 15.

[0055] When the control unit 34 displays operation icons on the display screen 15a of the touch panel 15, it acquires height information from the operating surface 15b to the indicator D. If the indicator D is not in contact with the operating surface 15b and the distance from the indicator D outside the height range HR in the height direction Z is within a preset distance, the control unit 34 displays the non-contact operation icon ICN and the contact operation icon ICT superimposed on the display screen 15a, as shown in Figure 7. If the indicator D is in contact with the operating surface 15b, the control unit 34 displays only the contact operation icon ICT on the display screen 15a, as shown in Figure 5.

[0056] For example, suppose a pre-set height range HR for non-contact operation is set to be between 2 cm and 4 cm, and a threshold of 1 cm is set as the acceptable range for displaying the non-contact operation icon ICN when the indicator D is outside the height range HR.

[0057] In this case, as shown in Figure 8, the control unit 34 displays the non-contact operation icon ICN and the contact operation icon ICT superimposed on the display screen 15a when the height from the operating surface 15b to the indicator D is in the range of 1 cm to 5 cm.

[0058] Furthermore, the control unit 34 displays only the icon ICT for contact operation on the display screen 15a when the indicator D is in contact with the operating surface 15b, or when the indicator D is not in contact with the operating surface 15b but is outside the allowable range on the operating surface 15b side from the height range HR, that is, when the height from the operating surface 15b to the indicator D is in the range of 0 cm or more and less than 1 cm.

[0059] Furthermore, as shown in Figure 8, the control unit 34 may, with respect to the operating surface 15b, display only the icon ICT for contact operation on the display screen 15a if the indicator D is located at a distance greater than or equal to a preset distance from the position furthest from the operating surface 15b within the height range HR in the height direction Z.

[0060] Furthermore, as shown in Figure 9, the control unit 34 may superimpose the non-contact operation icon ICN and the contact operation icon ICT on the display screen 15a when the indicator D is located at a distance greater than or equal to a preset distance from the position furthest from the operation surface 15b within the height range HR in the height direction Z, relative to the operation surface 15b.

[0061] Furthermore, when the control unit 34 displays the contactless operation icon ICN and the contact operation icon ICT superimposed on the display screen 15a, it may superimpose the contactless operation icon ICN on top of the contact operation icon ICT, as shown in Figure 7.

[0062] Furthermore, as shown in Figure 10, when the control unit 34 displays the contactless operation icon ICN superimposed on the contact operation icon ICT on the display screen 15a, the contactless operation icon ICN may be displayed in a semi-transparent state.

[0063] Here, "semi-transparent" does not mean 50% transparency, but rather a state between transparent (i.e., 100% transparency) and opaque (i.e., 0% transparency).

[0064] Furthermore, when the control unit 34 displays the contactless operation icon ICN and the contact operation icon ICT superimposed on the display screen 15a, it may perform a process to reduce the visibility of the contactless operation icon ICN corresponding to the height range HR as the indicator D moves away from the height range HR.

[0065] Here, the process that reduces visibility may be a process that improves transparency, a process that reduces sharpness, or both. Regarding the process that reduces sharpness, any image processing that reduces sharpness is acceptable, such as blurring using a Gaussian filter.

[0066] An example of the processing in this case is described below. Figure 11 is a diagram illustrating the process of reducing the visibility of the ICN icon for non-contact operation. In the graph in Figure 11, the vertical axis represents the height H from the operating surface 15b of the indicator D, and the horizontal axis represents the amount of image processing to reduce the sharpness of the ICN icon for non-contact operation. In addition, the solid line in the graph represents the amount of sharpness reduction processing, and the dashed line represents the amount of transparency improvement processing.

[0067] The amount of sharpness reduction processing is 0 when the indicator object D is within the height range HR, and the amount of image processing increases as it moves away from the height range HR. In other words, when the indicator object D is within the height range HR, the icon ICN for non-contact operation is not blurred at all, and as it moves away from the height range HR, the icon ICN for non-contact operation becomes blurred.

[0068] The amount of transparency enhancement processing is not zero even when the indicator D is within the height range HR, but rather involves a certain amount of image processing, and the amount of image processing increases as it moves away from the height range HR. In other words, when the indicator D is within the height range HR, the icon ICN for contactless operation is displayed in a semi-transparent state, and as it moves away from the height range HR, the icon ICN for contactless operation becomes more transparent.

[0069] Therefore, when the indicator D is within the height range HR, the contactless operation icon ICN is displayed semi-transparent and completely in focus, as shown in Figure 10. When the indicator D moves away from the height range HR, the contactless operation icon ICN is displayed with greater transparency and in a blurred state than in Figure 10, as shown in Figure 12.

[0070] Furthermore, multiple height ranges HR are set as non-overlapping ranges in the height direction Z, and each of the multiple height ranges HR corresponds to a different non-contact operation icon ICN. The control unit 34 may display the non-contact operation icon ICN corresponding to the height range closest to the indicator from among the multiple height ranges HR on the display screen 15a.

[0071] An example of the process in this case is described below. Figure 13 is a diagram illustrating the process of switching the non-contact operation icon ICN displayed according to the height H from the operating surface 15b of the indicator D.

[0072] In the graph in Figure 13, the vertical axis represents the height H from the operating surface 15b of the indicator D, and the horizontal axis represents the transparency of the non-contact operation icon ICN. The solid line in the graph represents the transparency of the non-contact operation icon ICN1, the dotted line represents the transparency of the non-contact operation icon ICN2, and the dashed line represents the transparency of the non-contact operation icon ICN3. When the transparency of each icon reaches 100, that icon is completely hidden.

[0073] For example, suppose that three height ranges are set as the height range in which non-contact operation is possible: HR1, which is between 2 cm and 4 cm; HR2, which is between 6 cm and 8 cm; and HR3, which is between 10 cm and 12 cm.

[0074] Furthermore, it is assumed that the icon ICN1 for contactless operation is set for height range HR1, the icon ICN2 for contactless operation is set for height range HR2, and the icon ICN3 for contactless operation is set for height range HR3.

[0075] Furthermore, it is assumed that 1 cm is set as the threshold for the acceptable range in which the display of the corresponding non-contact operation icon is permitted when the indicator D falls outside the height range HR.

[0076] In this case, if the height from the operating surface 15b to the indicator D is in the range of more than 1 cm and less than 5 cm, the control unit 34 superimposes the icon ICN1 for non-contact operation and the icon ICT for contact operation on the display screen 15a.

[0077] Furthermore, if the height from the operating surface 15b to the indicator D is 5 cm, the control unit 34 displays only the icon ICT for contact operation on the display screen 15a.

[0078] Furthermore, if the height from the operating surface 15b to the indicator D is greater than 5 cm but less than 9 cm, the control unit 34 superimposes the icon ICN2 for non-contact operation and the icon ICT for contact operation on the display screen 15a.

[0079] Furthermore, if the height from the operating surface 15b to the indicator D is 9 cm, the control unit 34 displays only the icon ICT for contact operation on the display screen 15a.

[0080] Furthermore, if the height from the operating surface 15b to the indicator D is greater than 9 cm but less than 13 cm, the control unit 34 superimposes the icon ICN3 for non-contact operation and the icon ICT for contact operation on the display screen 15a.

[0081] Furthermore, even if the control unit 34 is in a situation where the movement status of the indicator D satisfies a preset condition and displays the contactless operation icon ICN and the contact operation icon ICT superimposed on the display screen 15a, it may choose not to display the contactless operation icon ICN.

[0082] In this case, for example, if the indicator D is approaching the operating surface 15b at a speed greater than or equal to a preset speed, the control unit 34 may choose not to display the non-contact operation icon ICN on the display screen 15a, even if it is in a situation where the non-contact operation icon ICN and the contact operation icon ICT are superimposed on each other.

[0083] Next, the processing flow for displaying operation icons in the image forming apparatus 10 of this embodiment will be explained with reference to the flowchart in Figure 14.

[0084] In step S11, the control unit 34 determines whether or not the image forming apparatus 10 is in a state where it can be operated without contact.

[0085] If, in step S11, it is determined that the image forming apparatus 10 is not in a state where it can be operated without contact, the control unit 34 will terminate the process in step S15 by displaying only the contact operation icon ICT on the display screen 15a.

[0086] If, in step S11, it is determined that the image forming apparatus 10 is in a state where it can be operated without contact, then in step S12, the control unit 34 determines whether or not contact of the indicator D has been detected on the operating surface 15b of the touch panel 15.

[0087] In step S12, if it is determined that contact of the indicator D has been detected on the operating surface 15b, the control unit 34 displays only the contact operation icon ICT on the display screen 15a in step S15 and terminates the process.

[0088] If, in step S12, it is determined that contact of the indicator D is not detected on the operating surface 15b, the control unit 34 determines in step S13 whether or not the indicator D is within a predetermined height range.

[0089] Here, the specified height range includes the height range HR in which non-contact operation is possible, and the allowable range in which the display of the non-contact operation icon ICN is permitted when the indicator D is outside the height range HR.

[0090] If, in step S13, it is determined that the indicator D is not within a predetermined height range, the control unit 34 terminates the process in step S15 by displaying only the contact operation icon ICT on the display screen 15a.

[0091] In step S13, if it is determined that the indicator D is within a predetermined height range, the control unit 34 displays the icon ICN for contactless operation on the display screen 15a in step S14, and further displays the icon ICT for contact operation on the display screen 15a in step S15.

[0092] In other words, the control unit 34 displays the icon ICN for contactless operation and the icon ICT for contact operation superimposed on the display screen 15a and then terminates the process.

[0093] [Differentiation] Although an image forming apparatus according to one embodiment of the present disclosure has been described above, the present disclosure is not limited to the above embodiment and can be modified as appropriate.

[0094] In each of the embodiments described above, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0095] Furthermore, the processor operations in each of the above embodiments may not be performed by a single processor, but may also be performed by multiple processors located in physically separate locations working together. Also, the order of the processor operations is not limited to the order described in each of the above embodiments, and may be changed as appropriate.

[0096] Furthermore, the information processing apparatus disclosed herein is not limited to image forming apparatuses, but may be applied to other types of apparatuses as well. [Explanation of Symbols]

[0097] 10 Image forming apparatus 11 CPU 12 RAM 13 Storage device 14. Communication Interface 15 Touch panel 15a display screen 15b Operation surface 16 Height detection device 17. User Interface Device 18 Scanners 19 Print Engine 20 control bus 31. Certification Department 32 Operation Input Section 33 Data transmission and reception unit 34 Control Unit 35 Storage section 36 Image reading unit 37 Image output section 38 Height detection unit ICN icon for contactless operation Icons for ICT contact operation

Claims

1. Equipped with a processor, The aforementioned processor, When displaying an operator on the display screen of an image display device, in which an operating surface is stacked on the display screen and an operator is operated on the operator displayed on the display screen while an indicator is in contact with the operating surface, and a non-contact operation is performed on the operator displayed on the display screen while the indicator is not in contact with the operating surface and the indicator is within a preset height range from the operating surface, The height information from the operating surface to the indicator is acquired. If the indicator is not in contact with the operating surface, and the distance from the indicator to the height range in the height direction is within a preset distance, the non-contact operation indicator and the contact operation indicator are superimposed and displayed on the display screen. When the indicator is in contact with the operating surface, only the operator for contact operation is displayed on the display screen. If the indicator is approaching the operating surface at a speed exceeding a preset speed, even if the non-contact operation indicator and the contact operation indicator are superimposed on the display screen, the non-contact operation indicator will not be displayed. Information processing device.

2. The aforementioned processor, With respect to the aforementioned operating surface, if the indicator is located at a distance greater than or equal to a preset distance from the position furthest from the operating surface within the aforementioned height range, only the control element for contact operation will be displayed on the display screen. The information processing apparatus according to claim 1.

3. The aforementioned processor, With respect to the aforementioned operating surface, if the indicator is located at a distance greater than or equal to a preset distance from the position furthest from the operating surface within the aforementioned height range, the non-contact operation indicator and the contact operation indicator will be superimposed on the display screen. The information processing apparatus according to claim 1.

4. The aforementioned height range is set as multiple ranges that do not overlap with each other in the height direction. Each of the aforementioned height ranges corresponds to a different non-contact operation element. The aforementioned processor, The control element for non-contact operation corresponding to the height range closest to the indicator from among the multiple height ranges is displayed on the display screen. The information processing apparatus according to any one of claims 1 to 3.

5. The aforementioned processor, When displaying non-contact operation controls and contact operation controls superimposed on the display screen, the non-contact operation controls are superimposed on the contact operation controls. The information processing apparatus according to any one of claims 1 to 4.

6. The aforementioned processor, When displaying non-contact and contact controls on the display screen, the non-contact controls are displayed in a semi-transparent state. The information processing apparatus according to claim 5.

7. The aforementioned processor, When displaying non-contact and contact controls on the display screen, the visibility of the non-contact controls corresponding to a given height range is reduced as the indicator moves away from that height range. The information processing apparatus according to any one of claims 1 to 6.

8. A process that reduces visibility is a process that improves transparency. The information processing apparatus according to claim 7.

9. A process that reduces visibility is a process that reduces sharpness. The information processing apparatus according to claim 7 or 8.

10. When displaying an operator on the display screen of an image display device, in which an operating surface is stacked on the display screen and an operator is operated on the operator displayed on the display screen while an indicator is in contact with the operating surface, and a non-contact operation is performed on the operator displayed on the display screen while the indicator is not in contact with the operating surface and the indicator is within a preset height range from the operating surface, The steps include: acquiring information on the height from the operating surface to the indicator; If the indicator is not in contact with the operating surface and the distance from which the indicator is outside the height range in the height direction is within a predetermined distance, the steps of displaying the non-contact operation operator and the contact operation operator superimposed on the display screen, When the indicator is in contact with the operating surface, the step of displaying only the operator for contact operation on the display screen, When the indicator is approaching the operating surface at a speed exceeding a preset speed, even if the non-contact operating element and the contact operating element are superimposed on the display screen, the non-contact operating element is not displayed. A program that causes a computer to execute something.

Images