Information Processing Apparatus and Program
The information processing apparatus addresses the challenge of managing contaminated touch panel areas by using an imaging device to identify contact objects and setting reset times for these areas, ensuring operation reception images can be displayed and reducing infection risks.
Patent Information
- Application Number
- JP2021149846
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-09-15
- Publication Date
- 2025-06-18
- Estimated Expiration
- 2041-09-15
AI Technical Summary
Existing touch panel systems face challenges in managing contaminated areas, leading to a risk of infection and potential operational failures when contaminated areas increase and there are no available non-contaminated areas for displaying operation reception images.
An information processing apparatus equipped with a processor and memory that identifies contact objects using an imaging device, stores contaminated areas, and controls the display of operation reception images on non-contaminated areas. The system sets a reset time for contaminated areas based on the identified contact object, changing the area to non-contaminated when the time elapses.
This solution effectively reduces the risk of infection by ensuring operation reception images can be displayed even when contaminated areas increase, by dynamically managing contaminated areas and resetting them based on contact object characteristics.
Smart Images

Figure 0007694281000001 
Figure 0007694281000002 
Figure 0007694281000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus and a program.
Background Art
[0002] Patent Document 1 discloses a display input device that counts the number of finger touches on a transmissive touch panel input surface, and when the counted number of finger touches reaches a preset specified value, sets the transmissive touch panel to a cleaning mode and changes the display on the display surface corresponding to the touch coordinates where the transmissive touch panel input surface has been touched.
[0003] Patent Document 2 discloses an operating device that acquires video and audio in which a user is reflected, and when the user performs an operation that contaminates the user, such as sneezing, identifies the contaminated part of the user, and when it detects that the contaminated part is approaching the operation unit, creates notification information for enabling the operation unit to be operated without touching the contaminated part and notifies the user.
[0004] Patent Document 3 discloses an operating device that discriminates between a contaminated area where a touch panel is contaminated and a non-contaminated area where the touch panel is not contaminated, and when a screen display button displayed in the contaminated area can be displayed in the non-contaminated area, moves the screen display button to the non-contaminated area determined to be displayable and displays it on the display panel.
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Patent Document 2
Patent Document 3
Summary of the Invention
Problems to be Solved by the Invention
[0006] When an unspecified user uses a touch panel, there is a risk of infection due to contact via the touch panel.
[0007] As one method of reducing the above risk, the contact position on the touch panel is stored as a contaminated area, which is an area where there is a possibility of infection, and when different users operate it, an operation reception image such as an operation button is displayed in a non-contaminated area, which is an area other than the stored contaminated area.
[0008] However, according to the above configuration, when the contaminated area increases, there may be no non-contaminated area where the operation reception image can be displayed. In this case, for example, unless the history of the contaminated area is erased along with cleaning or the like, the operation will become impossible.
[0009] An object of the present invention is to provide an information processing apparatus and a program capable of reducing the possibility that an operation reception image cannot be displayed on a touch panel as compared with a configuration that maintains a contaminated area unless the history of the contaminated area is erased along with cleaning or the like.
Means for Solving the Problems
[0010] The information processing apparatus according to the first aspect of the present invention includes a memory and a processor. The processor When a user attempts to use the own device, causes an operation reception image for receiving an input by the user to be displayed on the touch panel. Stores, in the memory, an area including a location where a contact object has contacted and been operated on the touch panel as a contaminated area. Identifies the contact object from an image of the contact object captured by an imaging device. When a new user attempts to use the own device, controls to display an operation reception image on a non-contaminated area, which is an area other than the contaminated area of the touch panel. When the set time set according to the identified contact object has elapsed since the last time the location included in the contamination area was operated, the contamination area stored in the memory is changed to a non-contamination area.
[0011] The information processing apparatus according to the second aspect of the present invention is the information processing apparatus according to the first aspect, wherein the processor sets times of different lengths as the set time according to the material of the contact object.
[0012] The information processing apparatus according to the third aspect of the present invention is the information processing apparatus according to the second aspect, wherein when the contact object is a finger, the processor sets a longer time as the set time than when the contact object is an object other than a finger.
[0013] The information processing apparatus according to the fourth aspect of the present invention is the information processing apparatus according to the second aspect, wherein when the contact object is a finger not wearing a glove, the processor sets a longer time as the set time than when the contact object is a finger wearing a glove.
[0014] The information processing apparatus according to the fifth aspect of the present invention is the information processing apparatus according to the first aspect, wherein when the contact object is a finger, the processor sets times of different lengths as the set time according to the manner of contact of the contact object with the touch panel.
[0015] The information processing apparatus according to the sixth aspect of the present invention is the information processing apparatus according to the fifth aspect, wherein when an operation is performed by contacting the touch panel with the belly part of the fingertip, the processor sets a longer time as the set time than when an operation is performed by contacting the touch panel with the joint part on the back side of the finger.
[0016] The information processing apparatus according to the seventh aspect of the present invention is the information processing apparatus according to any one of the first to sixth aspects, wherein the imaging device is an infrared camera capable of detecting the temperature of the imaged object, the processor identifies the material of the contact object by referring to the temperature of the contact object detected by the imaging device.
[0017] The information processing apparatus according to the eighth aspect of the present invention is the information processing apparatus according to any one of the first to seventh aspects, wherein when the processor receives that the touch panel has been cleaned, the processor changes the entire area on the touch panel to a non-contaminated area.
[0018] The information processing apparatus according to the ninth aspect of the present invention is the information processing apparatus according to any one of the first to seventh aspects, wherein when the processor detects from an image captured by the imaging device that the touch panel has been cleaned, the processor changes the entire area on the touch panel to a non-contaminated area.
[0019] The information processing apparatus according to the tenth aspect of the present invention is the information processing apparatus according to any one of the first to ninth aspects, wherein the memory stores information of a user who has performed an operation when a non-contaminated area is set as a contaminated area, for each contaminated area. When a certain user operates the own device, the processor displays an operation reception image with an area that has become a contaminated area due to the operation by the user set as a non-contaminated area.
[0020] The program according to the eleventh aspect of the present invention causes a computer to execute steps of: displaying, on a touch panel, an operation reception image for receiving an input by a user when the user attempts to use the own device; storing, as a contaminated area, an area including a location where a contacting object has contacted and been operated on the touch panel; identifying the contacting object from an image of the contacting object captured by an imaging device; controlling to display an operation reception image on a non-contaminated area, which is an area other than the contaminated area of the touch panel, when a new user attempts to use the own device; changing the stored contaminated area to a non-contaminated area when a set time set according to the identified contacting object has elapsed since a last time when a location included in the contaminated area was operated.
Advantages of the Invention
[0021] According to the information processing apparatus of the first aspect of the present invention, it is possible to reduce the possibility that the operation reception image cannot be displayed on the touch panel as compared with a configuration that maintains the contaminated area unless the history of the contaminated area is erased due to cleaning or the like.
[0022] According to the information processing apparatus of the second aspect of the present invention, the set time until the contaminated area is changed to a non-contaminated area can be set to a length according to the characteristics of the material of the contacting object when the user operates the touch panel.
[0023] According to the information processing apparatus of the third aspect of the present invention, the area operated by the user with a finger on the touch panel can be set as the contaminated area for a longer time than the area operated by an object other than the finger.
[0024] According to the information processing apparatus of the fourth aspect of the present invention, the area directly operated by the user with a finger on the touch panel can be set as the contaminated area for a longer time than the area operated while wearing gloves.
[0025] According to the information processing apparatus of the fifth aspect of the present invention, the set time until the contaminated area is changed to a non-contaminated area can be set to different lengths depending on the way of contact when the user operates the touch panel with a finger.
[0026] According to the information processing apparatus of the sixth aspect of the present invention, the area operated by the user with the belly part of the fingertip on the touch panel can be set as the contaminated area for a longer time than the area operated with the joint part on the back side of the finger.
[0027] According to the information processing apparatus of the seventh aspect of the present invention, it is possible to identify the material of the contacting object with higher accuracy as compared with the case of identifying the material of the contacting object only from the captured image.
[0028] According to the information processing apparatus of the eighth aspect of the present invention, it is possible to prevent a situation in which the entire area of the touch panel becomes a contaminated area and the operation reception image cannot be displayed.
[0029] According to the information processing apparatus of the ninth aspect of the present invention, even if the user does not input that the touch panel has been cleaned, it is possible to detect that the touch panel has been cleaned and prevent a situation where the entire area of the touch panel becomes a contaminated area and the operation reception image cannot be displayed.
[0030] According to the information processing apparatus of the tenth aspect of the present invention, when the same user operates the touch panel a plurality of times, it is possible to prevent an unnecessary increase in the contaminated area.
[0031] According to the program of the eleventh aspect of the present invention, it is possible to reduce the possibility that the operation reception image cannot be displayed on the touch panel as compared with a configuration in which the contaminated area is maintained unless the history of the contaminated area is erased due to cleaning or the like.
Brief Description of the Drawings
[0032]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
[0033] Next, embodiments of the present invention will be described in detail with reference to the drawings.
[0034] FIG. 1 is a diagram showing the system configuration of an information processing system according to an embodiment of the present invention.
[0035] As shown in FIG. 1, the information processing system according to an embodiment of the present invention includes an image forming apparatus 10, a terminal device 20, and a camera 40 that are interconnected by a network 30.
[0036] The image forming apparatus 10 is an information processing apparatus called a so-called multi-function peripheral having a plurality of functions such as a printing function, a scanning function, a copying function, and a facsimile function.
[0037] And the image forming apparatus 10 is installed, for example, in stores such as convenience stores or offices, and is used by an unspecified number of users.
[0038] The terminal device 20 is connected to the image forming apparatus 10 via the network 30 to transmit and receive data. Further, the camera 40 is an imaging device installed, for example, on the ceiling to photograph a user who operates the image forming apparatus 10.
[0039] A state in which the camera 40 photographs a user who operates the image forming apparatus 10 is shown in FIG. 2. Referring to FIG. 2, it can be seen that the camera 40 is photographing a state in which the user is operating the touch panel 70 of the image forming apparatus 10.
[0040] In addition, in FIG. 2, a case where the camera 40 is configured as a device separate from the image forming apparatus 10 is shown, but the camera 40 may be attached as a part of the configuration of the image forming apparatus 10.
[0041] Next, the hardware configuration of the image forming apparatus 10 in the information processing system of the present embodiment is shown in FIG. 3.
[0042] As shown in FIG. 3, the image forming apparatus 10 includes a CPU 11, a memory 12, a storage device 13 such as a hard disk drive, a communication interface (abbreviated as IF) 14 that transmits and receives data to and from external devices via the network 30, a user interface (abbreviated as UI) device 15 including a touch panel or a liquid crystal display and a keyboard, a scanning unit 16, and an image forming unit 17. These components are connected to each other via a control bus 18.
[0043] The CPU 11 is a processor that executes predetermined processing based on a control program stored in the memory 12 or the storage device 13 to control the operation of the image forming apparatus 10. In the present embodiment, the CPU 11 has been described as reading and executing a control program stored in the memory 12 or the storage device 13, but it is not limited thereto. This control program may be provided in a form recorded on a computer-readable recording medium. For example, this program may be provided in a form recorded on an optical disc such as a CD (Compact Disc)-ROM and a DVD (Digital Versatile Disc)-ROM, or in a form recorded on a semiconductor memory such as a USB (Universal Serial Bus) memory and a memory card. Further, this control program may be acquired from an external device via a communication line connected to the communication interface 14.
[0044] FIG. 4 is a block diagram showing a functional configuration of the image forming apparatus 10 realized by executing the above control program.
[0045] As shown in FIG. 4, the image forming apparatus 10 of the present embodiment includes an authentication unit 31, an operation input unit 32, a display unit 33, a data transmission / reception unit 34, a control unit 35, a data storage unit 36, an image output unit 37, and an image reading unit 38.
[0046] The authentication unit 31 authenticates a user who is a user using the image forming apparatus 10 and identifies the user. For example, the authentication unit 31 may authenticate the user by inputting an ID and a password, or may authenticate the user by reading identification information of an IC card via proximity wireless communication. Further, the authentication unit 31 may execute face authentication processing on a face image of the user captured by the camera 40 to authenticate the user.
[0047] The display unit 33 is controlled by the control unit 35 and displays various information to the user. The operation input unit 32 inputs various operation information performed by the user. Then, the touch panel 70 is constituted by the operation input unit 32 and the display unit 33. Here, the touch panel 70 is a component in which a display device such as a liquid crystal panel and an operation input device capable of detecting a contact position on the liquid crystal panel are configured as one component.
[0048] The data transmission / reception unit 34 performs data transmission and reception with external devices such as the terminal device 20 and the camera 40.
[0049] The control unit 35 controls the overall operation of the image forming apparatus 10, and based on instructions from the user input from the operation input unit 32, controls component units such as the image output unit 37 and the image reading unit 38 to execute various processes such as copying, printing, and scanning. Further, the control unit 35 manages, as a contaminated area, the area including the location where the user has performed an operation for a set period, and controls the position of the operation buttons displayed on the display unit 33 so that the operation buttons are displayed in a non-contaminated area other than the contaminated area. Note that the operation buttons are an example of operation reception images displayed on the touch panel 70, and scroll bars and the like other than the operation buttons are also included in the operation reception images.
[0050] The image output unit 37 outputs an image onto a recording medium such as printing paper based on control by the control unit 35. The image reading unit 38 reads a document image from a set document based on control by the control unit 35.
[0051] The data storage unit 36 temporarily stores various data such as print data generated by the control unit 35, and stores a contaminated area management table and a reset time management table. The contaminated area management table is a table for managing the contaminated area described above. The reset time management table is a table for managing the reset time, which is the time to return the contaminated area to a non-contaminated area, according to the type of the object in contact with the touch panel 70.
[0052] Here, when the virus that causes an infectious disease is separated from the human body and a certain period of time elapses, it becomes inactive and loses its infectivity to infect the human body. And it is known that the time from when the virus leaves the human body until it becomes inactive varies depending on the type of virus, the environment such as the surrounding temperature and humidity, the type of object to which the virus adheres, and so on. For example, in the case of the novel coronavirus, it is known to maintain an active state for a maximum of 72 hours on the surface of plastic, 24 hours on cardboard, and 9 hours on human skin.
[0053] Therefore, even if a certain user is infected with a certain virus and attaches the virus when operating the touch panel 70, if the operation button is not displayed at that location until the virus becomes inactive, it can prevent other users from operating the location where the active virus adheres. Also, even if the virus does not completely become inactive, it is considered that the possibility of infecting the human body decreases over time.
[0054] That is, the reset time means the set time until the contaminated area is considered to return to a non-contaminated area when a certain user operates a location and the area is treated as a contaminated area assuming that a pathogen such as a virus adheres to it, due to the loss of infectivity of the pathogen. Therefore, when a certain user operates the touch panel 70, the control unit 35 of the present embodiment does not display the operation button assuming that the area including that location is a contaminated area. And when the set reset time elapses after the non-contaminated area is changed to a contaminated area, the control unit 35 returns the contaminated area to a non-contaminated area and enables the display of the operation button. Note that the above-mentioned pathogens include not only viruses but also various bacteria and the like that cause infectious diseases.
[0055] An example of a reset time management table for managing the above-mentioned reset time is shown in FIG. 5.
[0056] As shown in FIG. 5, the reset time management table associates the type of contact object when the touch panel 70 is operated with the reset time. For example, when the contact object is "finger (without gloves)", the reset time is set to "9 hours". On the other hand, for example, when the contact object is a "touch pen", the reset time is set to "4 hours". That is, the reset time when the contact object is a "touch pen" is set shorter than the reset time when the contact object is a "finger (without gloves)".
[0057] In this way, the control unit 35 sets times of different lengths as the reset time depending on the material of the contact object. Specifically, the control unit 35 sets times of different lengths as the reset time when the contact object is a finger and when the contact object is an object other than a finger. For example, when the contact object is a finger, the control unit 35 sets a longer time as the reset time than when the contact object is an object other than a finger.
[0058] The reason for making the lengths of the reset time when the user operates the touch panel 70 with a finger and the reset time when the user operates the touch panel 70 using an object other than a finger different in this way is that the possibility of pathogens such as viruses adhering to the touch panel 70 is different. Generally, the possibility of a virus adhering to a human finger is higher than the possibility of a virus adhering to a touch pen or the like.
[0059] That is, when the user directly touches and operates the touch panel 70 with a finger, the possibility of a virus adhering to the touch panel 70 is higher than when the touch panel 70 is touched and operated with an object such as a touch pen. Therefore, by setting times of different lengths as the reset time when the object touching the touch panel 70 is a finger and when it is other than a finger, a reset time corresponding to the possibility of virus adhesion is set.
[0060] Further, the control unit 35 sets different lengths of time as the reset time depending on whether the contacting object is a finger without a glove or a finger with a glove. For example, when the contacting object is a finger without a glove, the control unit 35 sets a longer time as the reset time than when the contacting object is a finger with a glove. This is also because it is considered that the possibility of the virus adhering to the touch panel 70 is lower when the touch panel 70 is operated with a finger wearing a glove than when it is operated with a finger without a glove.
[0061] In addition, when the contacting object is a finger, the control unit 35 may set different lengths of time as the reset time depending on the way of contacting the touch panel 70 by the contacting object. For example, when the operation is performed by contacting the touch panel 70 with the belly part of the fingertip, the control unit 35 may set a longer time as the reset time than when the operation is performed by contacting the touch panel 70 with the joint part on the back side of the finger. Setting the reset time according to the way of contacting the touch panel 70 by such a contacting object is an aspect of setting the reset time according to the contacting object.
[0062] The reason for making the length of the reset time different according to the way of contacting the touch panel 70 when the user operates the touch panel 70 with a finger in this way is that the possibility of the virus adhering varies depending on the location even with the same finger. When not being conscious of anything, a person grabs or operates an object using the belly part of the fingertip. Therefore, it is considered that the possibility of the virus adhering to the belly part of the fingertip is higher than that of other places. Also, since the joint part on the back side of the finger generally has a low possibility of touching an object, it is considered that the possibility of the virus adhering to it is lower than that of the belly part of the fingertip.
[0063] That is, when an operation is performed by contacting the touch panel 70 with the abdominal part of the fingertip, the possibility of pathogens such as viruses adhering to the touch panel 70 is higher than when an operation is performed by contacting the touch panel 70 with the joint part on the back side of the finger. Therefore, by setting different lengths of time as the reset time according to the way of contacting the touch panel 70 with the finger, a reset time corresponding to the possibility of virus adhesion will be set.
[0064] When the user attempts to use the own device, the control unit 35 causes an operation button for receiving an input from the user to be displayed on the touch panel 70. Here, the control unit 35 stores, in the data storage unit 36, an area including the location where the contact object contacts and operates on the touch panel 70 as a contaminated area. Then, the control unit 35 identifies the contact object from the image of the contact object captured by the camera 40. Then, the control unit 35 refers to the reset time management table and sets a reset time corresponding to the identified contact object for the contaminated area.
[0065] Here, the camera 40 may be an infrared camera capable of detecting the temperature of the imaged object by visualizing infrared rays radiated from the object. In this case, the control unit 35 identifies the material of the contact object by referring to the temperature of the contact object detected by the camera 40. Specifically, even when the user is operating the touch panel 70 with a finger, the control unit 35 determines whether the finger is wearing gloves based on the surface temperature of the finger, or whether the user is directly operating the touch panel 70 without wearing gloves.
[0066] Note that when a new user attempts to use the own device, the control unit 35 controls to display an operation button on a non-contaminated area, which is an area other than the contaminated area of the touch panel 70.
[0067] Here, the control unit 35 associates the information of the area including the operation position where the contact object touches and operates on the touch panel 70, the operation date and time, and the operation user with the reset time, and stores them in the data storage unit 36 as a contamination area management table. Then, the control unit 35 refers to this contamination area management table, and when the reset time set according to the specified contact object has elapsed since the last operation time of the location included in the contamination area, it changes the contamination area to a non-contamination area.
[0068] An example of the contamination area management table stored in the data storage unit 36 is shown in FIG. 6.
[0069] In the contamination area management table shown in FIG. 6, for the sake of facilitating the management of the contamination area, the operation screen of the touch panel 70 is divided into six areas 1 to 6 as shown in FIG. 7 for management. For the sake of simplicity of explanation, FIG. 7 shows the case where the operation screen of the touch panel 70 is divided into six areas, but in actuality, it may be divided more finely into more areas.
[0070] Referring to the contamination area management table in FIG. 6, it can be seen that for each contamination area where the operation button cannot be displayed, the area number indicating the location of the contamination area, the reset time, the operation date and time, and the information of the operation user are associated and stored.
[0071] When a certain area on the touch panel 70 is operated by a certain user, the operated area is registered in the contamination area management table in association with the operation date and time and the information of the operation user as a contamination area, and a reset time corresponding to the type of the contact object is set for the contamination area.
[0072] In the contamination area management table shown in FIG. 6, for example, it can be seen that "Area 6" is registered as a contamination area, the reset time is 9 hours, the operation date and time is 9:23 on July 15, 2021, and the user who operated is User B.
[0073] Note that this pollution area management table is updated regularly, and pollution areas for which the reset time has elapsed since the operation date and time are deleted from the pollution area management table. For example, "Area 6" registered as a pollution area is deleted after 9 hours from 9:23 on July 15, 2021, which is the operation date and time, that is, after 18:23 on July 15, 2021. Such update processing of the pollution area management table may be performed regularly every 30 minutes or every hour, or may be performed every time the image forming apparatus 10 returns from the power saving state.
[0074] Note that instead of performing such management of pollution areas in units of preset areas, it may be managed according to the coordinates on the touch panel 70.
[0075] An example of coordinates when managing the pollution area according to the coordinates on the operation screen of the touch panel 70 is shown in FIG. 8.
[0076] In the coordinate example shown in FIG. 8, the X coordinate and the Y coordinate are each expressed in pixel units with the upper left of the display area of the operation screen as a reference point. That is, since the width of the display area is 1000 pixels and the height is 800 pixels, the coordinates of the upper right position are expressed as (1000, 0). Similarly, the coordinates of the lower left position of the display area are expressed as (0, 800), and the coordinates of the lower right position of the display area are expressed as (1000, 800).
[0077] When managing the pollution area on the operation screen as a rectangular area, for example, it is represented by the upper left X coordinate, the upper left Y coordinate, the lower right X coordinate, and the lower right Y coordinate of the pollution area. The pollution area shown in FIG. 8 is represented by the coordinates (200, 650, 400, 750).
[0078] An example of the pollution area management table when managing the pollution area by coordinates is shown in FIG. 9.
[0079] Referring to the pollution area management table shown in FIG. 9, it can be seen that for each pollution area, the coordinate information indicating the range of the pollution area, the reset time, the operation date and time, and the information of the operating user are stored in association with each other.
[0080] In addition, when the control unit 35 receives that the touch panel 70 has been cleaned, it changes the entire area on the touch panel 70 to a non-pollution area.
[0081] Also, when the control unit 35 detects from the image captured by the camera 40 that the touch panel 70 has been cleaned, it may change the entire area on the touch panel 70 to a non-pollution area.
[0082] Furthermore, in the pollution area management tables shown in FIGS. 6 and 9, the information of the user who performed the operation when the non-pollution area was set as the pollution area is stored for each pollution area. Therefore, when a certain user operates the own device, the control unit 35 may display an operation button on the touch panel 70 with the area that has become a pollution area due to the operation of that user set as a non-pollution area.
[0083] For example, even if a certain area becomes a pollution area from a non-pollution area due to user A operating the touch panel 70, when user A tries to operate the image forming apparatus 10 again later, an operation button may be displayed on that pollution area. Such control is because there is no need to prevent infection between the same users, and if the same user is involved, displaying the operation button in the same area can prevent an increase in the pollution area. That is, when user A performs an operation, in addition to the area originally registered as a non-pollution area, the area that has become a pollution area due to user A's operation also becomes an area for which an operation button is to be displayed.
[0084] Next, the operation of the image forming apparatus 10 of the present embodiment will be described in detail with reference to the drawings.
[0085] In the following, for the sake of simplicity, a case will be described where the contaminated area is specified by a preset area.
[0086] First, the operations when a user approaches and operates the image forming apparatus 10 of the present embodiment are shown in the flowchart of FIG. 10.
[0087] First, when the control unit 35 detects the approach of a user in step S101, it detects the user in step S102. Specifically, the control unit 35 detects and identifies the user who intends to operate the own apparatus based on the authentication result by the authentication unit 31 or the face authentication result based on the image captured by the camera 40.
[0088] Then, the control unit 35 determines in step S103 whether or not the user detection has been successful. If it is determined in step S103 that the user detection has not been successful, the control unit 35 ends the process because the user cannot be identified.
[0089] If the user detection is successful in step S103, the control unit 35 displays operation buttons in the non-contaminated area on the touch panel 70 in step S104.
[0090] For example, when areas 4 to 6 are registered as contaminated areas as in the contaminated area management table shown in FIG. 6, a display example when operation buttons are displayed avoiding the contaminated area is shown in FIG. 11. Referring to FIG. 11, it can be seen that since areas 4 to 6 on the operation screen of the touch panel 70 are contaminated areas, the operation buttons 50 are displayed on the other non-contaminated areas.
[0091] Then, in step S105, the control unit 35 determines whether it has detected a user operation on the touch panel 70. If the control unit 35 does not detect a user operation on the touch panel 70 in step S105, it repeats the determination until the determination result in step S105 becomes affirmative. And when the control unit 35 detects a user operation on the touch panel 70 in step S105, in step S106, it stores information such as the operating user, operation date and time, contacting object, and operation location during the operation.
[0092] Then, the control unit 35 refers to the above-described reset time management table, specifies the reset time corresponding to the type of the contacting object on the touch panel 70, and registers it in the contamination area management table together with the information on the range of the contamination area based on the operating user, operation date and time, and operation location.
[0093] Note that when a user operation on the touch panel 70 is performed, in step S107, the control unit 35 determines whether the operation is a cleaning operation on the touch panel 70 from the image captured by the camera 40.
[0094] And when it is determined in step S107 that the user operation is a cleaning operation on the touch panel 70, the control unit 35, in step S108, deletes all the contamination areas registered in the contamination area management table and returns them to non-contaminated areas. Then, the control unit 35 returns to the process of step S104 and displays operation buttons on the non-contaminated areas on the touch panel 70. That is, the control unit 35 arranges and displays operation buttons on the entire area of the touch panel 70.
[0095] Note that when it is determined in step S107 that the user operation is not a cleaning operation on the touch panel 70, the control unit 35 determines in step S109 whether the user operation has ended.
[0096] In step S109, when it is determined that the operation by the user has ended, the control unit 35 ends the process. Also, in step S109, when it is determined that the operation by the user has not ended, the control unit 35 returns to the process of step S105 and waits for the detection of the next operation by the user.
[0097] By executing the above-described process, in the image forming apparatus 10, when a new user attempts to start an operation, operation buttons are displayed on the non-contaminated area of the touch panel 70, and the area including the location where the user operated is newly registered as a contaminated area.
[0098] Next, the state in which the contaminated area is newly registered as the user operates the touch panel 70 of the image forming apparatus 10 in this way will be described with reference to FIGS. 11 to 16.
[0099] In the following description, it is assumed that the contaminated area management table shown in FIG. 6 is registered in the data storage unit 36.
[0100] In this state, if user A approaches the image forming apparatus 10 and performs an operation, when it is determined that the user attempting to perform the operation is user A, an operation screen as shown in FIG. 11 is displayed on the touch panel 70. In FIG. 11, since areas 4 to 6 are registered as contaminated areas, operation buttons 50 are arranged on areas 1 to 3 other than areas 4 to 6.
[0101] Then, it is described that user A performs an operation on the touch panel 70 in such a state as shown in FIG. 12. FIG. 12 shows a state in which user A directly touches and operates the operation button 50 arranged on area 1 with a finger.
[0102] FIG. 13 shows the contaminated area management table after a contaminated area is added due to such an operation by user A. Referring to FIG. 13, it can be seen that area 1 is added to the contaminated area management table as a new contaminated area.
[0103] Since User A directly operated the touch panel 70 with the finger not wearing the glove, the control unit 35 registers the information that the reset time is 9 hours as the reset time in the contamination area management table from the reset time management table shown in FIG. 5. Further, the control unit 35 registers the information that the operating user is User A in the contamination area management table.
[0104] Next, when User D approaches the image forming apparatus 10 and performs an operation in such a state, if it is determined that the user who attempts to perform the operation is User D, an operation screen as shown in FIG. 14 is displayed on the touch panel 70. In FIG. 14, since areas 1, 4 to 6 are registered as contamination areas, the operation buttons 50 are arranged on areas 2 and 3 other than areas 1, 4 to 6.
[0105] Then, it is described that User D performs an operation as shown in FIG. 14 on the touch panel 70 in such a state. In FIG. 14, a state where User D operates the operation button 50 arranged on area 2 with the touch pen 80 is shown.
[0106] FIG. 15 shows the contamination area management table after a contamination area is added due to such an operation by User D. Referring to FIG. 15, it can be seen that area 2 is added to the contamination area management table as a new contamination area.
[0107] Since User D operated the touch panel 70 with the touch pen 80, the control unit 35 registers the information that the reset time is 4 hours as the reset time in the contamination area management table from the reset time management table shown in FIG. 5. Further, the control unit 35 registers the information that the operating user is User D in the contamination area management table.
[0108] When user E approaches the image forming apparatus 10 and performs an operation in this state, if it is determined that the user attempting to perform the operation is user E, an operation screen as shown in FIG. 16 is displayed on the touch panel 70. In FIG. 16, since areas 1, 2, 4 to 6 are registered as contamination areas, the operation buttons 50 are arranged on area 3 other than areas 1, 2, 4 to 6.
[0109] Note that the contamination areas registered in the contamination area management table described above are deleted and returned to non - contamination areas after the reset time has elapsed from the operation date and time. However, it is also assumed that if operations are performed by many users in a short period, the non - contamination areas where the operation buttons 50 can be displayed will decrease.
[0110] Therefore, when the non - contamination areas become less than the preset conditions, for example, when they become less than the preset area, ratio, or number of areas, a notification to perform cleaning may be displayed on the touch panel 70.
[0111] Alternatively, the user who determines that the area where the operation button 50 is displayed has become narrow may voluntarily clean the touch panel 70 with alcohol or the like. In this case, from the operation screen as shown in FIG. 17, the touch panel 70 may be operated to input that cleaning has been performed.
[0112] When the control unit 35 receives an input from the user that the touch panel 70 has been cleaned or detects the user's cleaning operation, it deletes the information of all the contamination areas registered in the contamination area management table. As a result, the operation buttons 50 are displayed in all areas of the operation screen on the touch panel 70.
[0113] In each of the above embodiments, the processor refers to a processor in a broad sense, including a general-purpose processor (e.g., CPU: Central Processing Unit, etc.) and a dedicated processor (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).
[0114] Also, the operation of the processor in each of the above embodiments may be achieved not only by one processor but also by a plurality of physically separated processors cooperating with each other. Also, the order of each operation of the processor is not limited to the order described in each of the above embodiments and may be changed as appropriate.
[0115] [Modification Example] In the above embodiment, the case where the present invention is applied to the image forming apparatus 10 provided with a touch panel has been described, but the present invention is not limited thereto. The present invention can be similarly applied to an information processing apparatus provided with a touch panel operated by unspecified users such as a ticket vending machine provided at a railway station and a vending machine installed in the street.
Explanation of Reference Numerals
[0116] 10 Image forming apparatus 11 CPU 12 Memory 13 Storage device 14 Communication interface 15 User interface device 16 Scan unit 17 Image forming unit 18 Control bus 20 Terminal device 30 Network 31 Authentication unit 32 Operation input unit 33 Display unit 34 Data transmission / reception unit 35 Control Unit 36 Data Storage Unit 37 Image Output Unit 38 Image Reading Unit 40 Camera 50 Operation Button 70 Touch Panel 80 Touch Pen
Claims
1. A memory, and a processor, wherein the processor, when a user attempts to use the device, displays an operation reception image for receiving an input from the user on a touch panel, stores, in the memory, as a contamination area, an area including a location where a contacting object contacts and operates on the touch panel, identifies the contacting object from an image of the contacting object captured by an imaging device, when a new user attempts to use the device, controls to display an operation reception image on a non - contamination area, which is an area other than the contamination area of the touch panel, when a set time set according to the identified contacting object has elapsed since the last time the location included in the contamination area was operated, changes the contamination area stored in the memory to a non - contamination area An information processing device.
2. The information processing device according to claim 1, wherein the processor sets, as the set time, times having different lengths depending on the material of the contacting object.
3. The information processing device according to claim 2, wherein when the contacting object is a finger, the processor sets, as the set time, a longer time than when the contacting object is an object other than a finger.
4. The information processing device according to claim 2, wherein when the contacting object is a finger not wearing a glove, the processor sets, as the set time, a longer time than when the contacting object is a finger wearing a glove.
5. The information processing device according to claim 1, wherein when the contacting object is a finger, the processor sets, as the set time, times having different lengths depending on the way the contacting object contacts the touch panel.
6. The information processing apparatus according to claim 5, wherein when an operation is performed by contacting the touch panel with the abdominal part of the fingertip, the processor sets a longer time as the set time than when an operation is performed by contacting the touch panel with the joint part on the back side of the finger.
7. The imaging device is an infrared camera capable of detecting the temperature of the imaged object, The information processing apparatus according to any one of claims 1 to 6, wherein the processor identifies the material of the contacted object by referring to the temperature of the contacted object detected by the imaging device.
8. The information processing apparatus according to any one of claims 1 to 7, wherein when the processor receives that the touch panel has been cleaned, the processor changes the entire area on the touch panel to a non-contaminated area.
9. The information processing apparatus according to any one of claims 1 to 7, wherein when the processor detects from the image captured by the imaging device that the touch panel has been cleaned, the processor changes the entire area on the touch panel to a non-contaminated area.
10. The memory stores information of a user who has performed an operation when a non-contaminated area is set as a contaminated area, for each contaminated area, The information processing apparatus according to any one of claims 1 to 9, wherein when a certain user operates the own device, the processor displays an operation reception image with an area that has become a contaminated area due to the operation by the user set as a non-contaminated area.
11. A step of displaying an operation reception image for receiving an input by the user on the touch panel when the user attempts to use the own device; A step of storing, as a contaminated area, an area including a location where a contacted object has contacted and been operated on the touch panel; A step of identifying the contacted object from an image of the contacted object captured by the imaging device; When a new user attempts to use the device, controlling to display an operation reception image on a non-contaminated area, which is an area other than the contaminated area of the touch panel; When the set time set according to the identified contact object has elapsed since the last time the location included in the contaminated area was operated, changing the stored contaminated area to a non-contaminated area; A program for causing a computer to execute the above steps.
Citation Information
Patent Citations
Touch panel type input device
JP2002073278A
Display input device
JP2004265383A
Input device, and medical equipment
JP2010033433A
Manipulation device, program, and contamination monitoring system
JP2018084974A
Manipulation device, program, and contamination monitoring system
JP2018084975A