Information processing device, information processing method and program

The information processing device addresses camera occlusion in telework by detecting and responding to shielding conditions, ensuring appropriate measures are taken based on the situation to maintain efficiency and security.

JP2024164226APending Publication Date: 2024-11-26CANON MARKETING JAPAN INC +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024146344
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-28
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

In telework environments, unintentional or malicious obstruction of cameras by users can lead to decreased work efficiency and security risks, respectively, necessitating a mechanism to differentiate and respond appropriately to such situations.

Method used

An information processing device equipped with an image capturing means to detect shielding conditions, specifying the terminal state, and a determining means to execute response processes based on the detected shielding state, allowing for differentiated measures.

Benefits of technology

Enables appropriate measures to be taken depending on the situation when camera occlusion is detected, balancing work efficiency and security by distinguishing between unintentional and malicious obstructions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024164226000001_ABST
    Figure 2024164226000001_ABST
Patent Text Reader

Abstract

To provide a mechanism capable of properly taking action according to a situation on detecting a camera being shielded.SOLUTION: The present invention relates to an information processing device which comprises imaging means, and the information processing device comprises: specifying means for specifying a terminal front state, associated with a person captured in an image of the front of the information processing device picked up by the imaging means, from the image; detecting means for detecting a shielded state against photography by the imaging means; and determining means for determining coping processing based upon a terminal front state specified before the shielded state is detected if a shielding occurrence state is determined according to the detected shielded state.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] In recent years, teleworking has become widespread among companies. When teleworking, it is necessary to prevent confidential information from being leaked to third parties and to properly manage the work of teleworkers.

[0003] As a result, telework management systems that use facial recognition technology have been developed. In these systems, teleworkers capture images of the teleworking environment using cameras attached or external to the devices (PCs, tablets, etc.) they use, and the captured images are used to verify the identity of the person and detect the occurrence of incidents, and appropriate processing is then carried out to properly manage the telework environment.

[0004] However, regardless of whether this is malicious or not, if the camera is blocked and filming is prevented, it will not be possible to capture footage of the telework situation, making proper management impossible.

[0005] Therefore, Patent Document 1 describes that in a device conducting a specified transaction, if it is determined that an image captured by a connected surveillance camera has been obstructed by an obstruction, the transaction will be interrupted and a monitoring center will be notified. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2008-123013 A DISCLOSURE OF THEINVENTION [Problem to be solved by the invention]

[0007] In a telework environment, if the terminal functions are stopped (such as by blacking out the screen) every time a user unintentionally blocks the camera, as described in Reference 1, work efficiency will decrease.

[0008] On the other hand, if a third party maliciously blocks the camera, more severe measures will be required.

[0009] Therefore, an object of the present invention is to provide a mechanism that can take appropriate action according to the situation when it is detected that the camera is occluded. [Means for solving the problem]

[0010] The information processing device is equipped with an imaging means, and is characterized in that it comprises: an identification means for identifying a front state of the terminal related to a person appearing in an image of the front of the information processing device captured by the imaging means; a detection means for detecting an obscuration state with respect to imaging by the imaging means; and a decision means for deciding a corresponding process based on the front state of the terminal identified before the obscuration state was detected when it is determined that an obscuration has occurred in accordance with the detected obscuration state. Effect of the Invention

[0011] According to the present invention, it is possible to provide a mechanism that can take appropriate action according to the situation when it is detected that the camera is occluded. [Brief description of the drawings]

[0012] [Figure 1] System configuration diagram showing an example of the configuration of a telework management system [Diagram 2] A block diagram showing the hardware configuration of an information processing device applicable to a management server 101, a teleworker PC 111, and an administrator PC 121. [Diagram 3] A flowchart showing an example of a control process executed by the teleworker PC 111. [Figure 4] Flowchart showing an example of normal processing [Diagram 5]Flowchart showing an example of processing during occlusion [Figure 6] Flowchart showing an example of detailed processing during occlusion (common) [Figure 7] FIG. 13 is a diagram showing an example of a parameter setting screen. [Figure 8] FIG. 1 shows an example of tables for storing parameters. [Figure 9] A diagram showing an example of a screen display during a blackout [Figure 10] FIG. 13 is a diagram showing an example of a warning display screen. [Figure 11] FIG. 13 shows an example of a confirmation screen on an administrator PC 121. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

[0014] FIG. 1 is a diagram showing an example of a system configuration of a telework management system 100 according to the present invention.

[0015] The telework management system 100 is configured such that one or more management servers 101, one or more teleworker PCs 111, and one or more administrator PCs 121 are connected via the Internet 130.

[0016] The management server 101 is a server that centrally manages information regarding the presence / absence status of teleworkers, information regarding snooping by third parties, impersonation, etc. (telework information (trail information)), and is constructed on a service environment network 104.

[0017] The teleworker PC 111 and the administrator PC 121 connect to the management server 101 through authentication processing using an account ID (user ID) and a password, and when the management server 101 receives telework information from the teleworker PC 111, it stores the information in the database of the management server 101. When the management server 101 receives a request to obtain telework information from the administrator PC 121, it obtains the necessary telework information from the database of the management server 101 and transmits it to the administrator PC 121 for display.

[0018] The teleworker PC 111 is a terminal that accepts applications (declarations) from teleworkers as to whether they are on or off duty, and detects the state in front of the terminal (the state in front of the terminal (whether the teleworker is present or absent, and whether peeking or impersonation is occurring)) from video (images) captured by a camera 113 (imaging device) connected to the teleworker PC 111. The teleworker PC 111 exists on a remote home network 110 (which may not be a home network but may be a network in a cafe, for example), and the state in front of the terminal is transmitted to the management server 101 via a router 112, the Internet 130, and router 103. The camera 113 (imaging device) is a camera that captures images in front of the teleworker PC 111.

[0019] The teleworker PC 111 is an application example of the information processing device of the present invention, and is a terminal used by a user who performs telework.

[0020] The administrator's PC 121 is a terminal for checking telework information and exists on the in-house network 120. To check the telework information, a web management console (which runs on a web browser) is used and the administrator's PC 121 is connected to the management server 101 via router 122, the Internet 130, and router 103.

[0021] In this embodiment, the configuration is described as one in which the teleworker PC 111 detects the forward state of the terminal and transmits information to the management server 101, but it may also be configured so that only video (images) are transmitted from the teleworker PC 111 to the management server 101, and the management server 101 detects the forward state of the terminal from the video (images).

[0022] 2 is a block diagram showing an example of a hardware configuration of an information processing device applicable to the management server 101, the teleworker PC 111, and the administrator PC 121 in the embodiment of the present invention. Since each device has a similar configuration, the same reference numerals will be used for the explanation.

[0023] As shown in FIG. 2, the information processing device has a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a storage device 204, an input controller 205, an audio input controller 206, a video controller 207, a memory controller 208, and a communication I / F controller 209 connected via a system bus 200.

[0024] The CPU 201 comprehensively controls each device and controller connected to the system bus 200 .

[0025] ROM 202 or storage device 204 holds the BIOS (Basic Input / Output System) and OS (Operating System), which are control programs executed by CPU 201, computer-readable and executable programs for realizing this information processing method, and various necessary data (including data tables).

[0026] The RAM 203 functions as a main memory, a work area, etc., for the CPU 201. The CPU 201 loads programs and the like required for executing processes from the ROM 202 or the storage device 204 into the RAM 203, and executes the loaded programs to realize various operations.

[0027] The input controller 205 controls input from the input device 210. Examples of the input device 210 include a keyboard, a touch panel, a pointing device such as a mouse, an imaging device such as the camera 113, and the like.

[0028] An imaging device such as camera 113 is a camera that captures an image in front of the terminal, and the teleworker PC 111 can identify the state in front of the terminal (terminal front state (whether the teleworker is present or absent, and whether peeking or impersonation is occurring)) from the captured image.

[0029] When the input device 210 is a touch panel, the user can give various instructions by pressing (touching with a finger or the like) an icon, cursor, or button displayed on the touch panel.

[0030] The touch panel may be a touch panel capable of detecting positions touched by multiple fingers, such as a multi-touch screen.

[0031] When the microphone / speaker 211 operates as a microphone, the voice input controller 206 controls the voice input from the microphone / speaker 211 and is capable of recognizing the voice input from the microphone / speaker 211. When the microphone / speaker 211 operates as a speaker, the voice input controller 206 controls the voice output to the microphone / speaker 211 and is capable of outputting voice to the microphone / speaker 211.

[0032] The video controller 207 controls display on an external output device such as a display 212. The display also includes the display of a notebook computer integrated with the main body. Note that the external output device is not limited to a display, and may be, for example, a projector. In addition, an input device 210 is provided for devices that can accept the above-mentioned touch operation.

[0033] The video controller 207 is capable of controlling a video memory (VRAM) for display control, and can use part of the RAM 203 as the video memory area, or can provide a separate dedicated video memory.

[0034] In the present invention, the information processing device has a first video memory area used for display when the user normally uses the information processing device, and a second video memory area used for displaying a predetermined screen by superimposing the display content of the first video memory area. The number of video memory areas is not limited to two, and the information processing device may have multiple video memory areas as long as the resources of the information processing device permit.

[0035] The memory controller 208 controls access to the external memory 213. As the external memory, an external storage device (hard disk) for storing a boot program, various applications, font data, user files, edit files, and various data, a flexible disk (FD), or a compact flash (registered trademark) memory connected to a PCMCIA card slot via an adapter, etc., can be used.

[0036] The communication I / F controller 209 connects to and communicates with external devices via a network 214 (104, 110, 120) and executes communication control processing on the network. For example, communication using TCP / IP, telephone lines such as ISDN, and 3G lines for mobile phones are possible.

[0037] The storage device 204 is a medium for permanently storing information, and is not limited to a storage device such as a hard disk. For example, the storage device 204 may be a medium such as an SSD (Solid State Drive).

[0038] It can also be used as a temporary memory area during various processes carried out by the communication terminal in this embodiment.

[0039] The CPU 201 enables display on the display 212 by, for example, executing a process of expanding (rasterizing) an outline font in a display information area in the RAM 203. The CPU 201 also enables a user to give instructions using a mouse cursor (not shown) or the like on the display 212.

[0040] FIG. 3 is a flowchart showing an example of a control process executed by the teleworker's PC 111 used by the teleworker.

[0041] The processing shown in each step in FIG. 3 is realized by the CPU 201 of the teleworker PC 111 loading a telework management program stored in a storage unit such as the external memory 213 into the RAM 203 and executing it.

[0042] In step S301, when the teleworker PC 111 is started, a telework management program is started and parameters for executing the program that are set and stored in advance are obtained.

[0043] Here, the parameters will be explained with reference to Fig. 7. Fig. 7 shows an example of a parameter setting screen 700.

[0044] Reference numeral 710 denotes a setting field for a response action in normal "not obstructed" situations, in which a corresponding action (blackout, warning output, transmission of evidence data) or no action is specified according to the terminal front state (personal user, peeking, spoofing, away from the desk) identified from the camera image. One or more corresponding actions can be specified. Note that the terminal front state and response actions shown above are merely examples, and are not limited to these.

[0045] In addition, when the terminal forward state is determined, if the corresponding action is to be executed after a grace period has elapsed, rather than immediately, a setting field for the grace period may be provided, or a default grace period may be set.

[0046] Reference numeral 720 denotes a setting field for the hold time until occlusion determination, and sets the hold time 721 from when occlusion is detected until it is determined that "occluded." This is the time to give a grace period before immediately determining that "occluded" when the user unintentionally blocks the camera (for example, when a hand unconsciously reaches in front of the camera, or when a part of the body blocks the camera when standing up). If you want to determine that "occluded" immediately, just set it to 0.

[0047] Note that the hold time may not be set in common, but may be set for each of the following states immediately before occlusion, or a default hold time may be set. This allows the readiness of the response to be adjusted according to the risk of the state immediately before occlusion.

[0048] Reference numeral 730 denotes a setting field for a response action when the camera is detected as being "blocked" and the camera is determined to be "blocked." In this field, a corresponding action (blackout, warning output, trace data transmission) or no action is specified according to the state immediately before the blocking (the person himself / herself, peeping, spoofing, away from the desk). One or more corresponding actions can be specified. The reason for specifying the state immediately before the blocking is that, when the camera is blocked, an appropriate camera image cannot be obtained and the state in front of the terminal cannot be specified from the camera image, so that a response action can be specified according to the state in front of the terminal specified immediately before the blocking occurs. Note that the state immediately before the blocking and the response action shown above are only examples and are not limited to these. For example, the state immediately before the blocking can be divided into whether the person himself / herself is captured (the person himself / herself, peeping) and whether the person himself / herself is not captured (spoofing, away from the desk), and a response action can be set for each of them. This makes it possible to set a priority on work efficiency when the person himself / herself is captured, and a priority on security when the person himself / herself is not captured.

[0049] Note that the normal response action and the obstruction response action may be set to a common setting rather than being set separately. In that case, even if a grace period is set for the normal response action, the terminal front state cannot be determined when obstructed, so the response action may be executed immediately or in a shorter time. Also, the same operation can be performed by setting the hold time 721 to 0 or a shorter time.

[0050] 740 is a setting field for the allowable time for continued occlusion and the corresponding action when it exceeds the allowable time. The allowable time 741 is the time for which the corresponding action specified in 730 is continued after it is determined that the occlusion time exceeds the allowable time 741, and the corresponding action (blackout, sign-out, shutdown) to be executed when the occlusion time exceeds the allowable time 741 is specified in 742. If the exceedance determination is not to be performed, a sufficiently large value (for example, 99999) may be set in the allowable time 741. This is because if the occlusion time is prolonged, there is a risk that a serious security incident has occurred, and in order to avoid the worst case scenario, a stronger response can be taken. Even if no action is specified in 730, if the occlusion time exceeds the allowable time 741, the corresponding action specified in 742 is executed, thereby ensuring security. Note that the above-mentioned corresponding actions are merely examples, and are not limited to these.

[0051] After the above settings are made, the setting contents are reflected in the table shown in FIG. 8 by pressing the register / update button 750.

[0052] Fig. 8(a) is a normal action setting table 800, in which the contents set in 710 in Fig. 7 are stored. Fig. 8(b) is an occlusion determination pending time setting table 810, in which the contents set in 720 in Fig. 7 are stored. Fig. 8(c) is an occlusion action setting table 820, in which the contents set in 730 in Fig. 7 are stored. Fig. 8(d) is a continued occlusion allowance setting table, in which the contents set in 740 in Fig. 7 are stored.

[0053] Returning to the explanation of Figure 3.

[0054] In step S301, parameters are obtained from each table shown in FIG.

[0055] In step S302, the shooting state is set to "normal" and the occlusion detection time is reset, that is, set to 0. Here, the shooting state is set to either "normal" or "occluded", indicating "not occluded" or "occluded". Also, the occlusion detection time indicates the time that detection has continued since the first detection of occlusion.

[0056] In step S303, an image of the front of the terminal captured by the camera is acquired. The acquired images may be frame images extracted at a predetermined time interval from a continuously captured video, or may be still images captured at a predetermined time interval.

[0057] In step S304, the image acquired in step S303 is analyzed to detect occlusion (presence or absence of occlusion). Here, occlusion is detected by a known occlusion detection method using image analysis technology such as the amount of edges in the image, the number and distribution of colors, etc.

[0058] In step S305, it is determined whether occlusion was detected in step S304. If occlusion was detected, the process proceeds to step S306, and if not, the process proceeds to step S311.

[0059] In step S306, the occlusion detection time is added. The time added here is the elapsed time from the previous occlusion detection process, assuming that occlusion occurred immediately after the previous occlusion detection process. When performing occlusion detection process by acquiring camera images at a fixed time interval, a fixed time is added.

[0060] In step S306, it is determined whether the shooting state is "normal." In other words, it is determined whether the shooting state is already set to "obstructed." If the shooting state is "normal," the process proceeds to step S308. If not, that is, if the shooting state is "obstructed," the process proceeds to step S310.

[0061] In step S307, it is determined whether the occlusion detection time has exceeded the hold time 721. As described above, this determination is made to provide a grace period from occlusion detection until it is determined that the object is "occluded." Note that if the hold time 721 is set to 0, it is determined that the time has been exceeded unconditionally, that is, immediately. If the occlusion detection time has exceeded the hold time 721, the process proceeds to step S309; ​​if not, the process returns to step S303.

[0062] In addition, if a hold time is set for each state immediately before the obstruction, it is determined whether the hold time for the state immediately before the obstruction has been exceeded.

[0063] Also, if a grace period is set for the corresponding action of the normal action, and even if the grace period is in progress, if the hold time 721 is set to 0 or a time shorter than the remaining grace period, the process proceeds to step S309 immediately or in a shorter time, and the corresponding action is executed immediately or in a shorter time. Also, a similar operation may be performed as a program process instead of a setting.

[0064] In step S309, it is determined that the object is "obstructed," and the shooting state is set to "obstructed."

[0065] In step S310, the occlusion process is executed, which will be described later with reference to Fig. 5. After the process is executed, the process proceeds to step S315.

[0066] In step S311, it is determined whether the shooting state is "obstructed." In other words, it is determined whether it has already been determined to be "obstructed." If the shooting state is "obstructed," the process proceeds to step S312. If not, that is, if the shooting state is "normal," the process proceeds to step S314.

[0067] In step S312, the shooting state is set to "normal" and the occlusion detection time is reset, that is, set to 0. Here, the shooting state previously set was "occlusion", and the fact that occlusion was not detected means that the occlusion has been removed, so the shooting state is returned to "normal" and the occlusion detection time is reset.

[0068] In step S313, the obstruction process is cancelled. In this embodiment, the obstruction process can be selected from among the following actions: blackout, warning output, and trace data transmission. In this step, for a blackout, a blackout release is performed, i.e., a process to return to the normal screen display is performed, for a warning output, a process to erase (non-output) the warning output is performed, and for trace data transmission, a process to stop sending trace data is performed.

[0069] In step S314, if the object is "not blocked," that is, normal processing is executed. The normal processing will be described later with reference to FIG.

[0070] In step S315, it is determined whether the program has ended. Specifically, it is determined that the program has ended when a user performs a sign-out or shutdown operation, or when a sign-out or shutdown is executed by the program in the occlusion processing in step S310. If it is determined that the program has ended, this processing flow ends, and if not, it returns to step S303.

[0071] This completes the explanation of FIG.

[0072] Next, the normal process in step S314 will be described in detail with reference to FIG.

[0073] FIG. 4 is a flowchart showing an example of the normal process in step S314.

[0074] The processing shown in each step in FIG. 4 is realized by the CPU 201 of the teleworker PC 111 loading a program stored in a storage unit such as the external memory 213 into the RAM 203 and executing the program.

[0075] In step S401, the camera image acquired in step S303 is analyzed using face recognition technology, etc. to identify the state in front of the terminal. The state in front of the terminal is the presence state of a person in front of the display of the teleworker PC 111, and in this embodiment, it is classified into "self" where only the teleworker is present, "peeping" where both the teleworker and other people are present, "impersonation" where only other people are present, and "away from the desk" where no person is present.

[0076] In step S403, the process branches depending on the terminal front state identified in step S401. If the terminal is "self", the process proceeds to step S403; if the terminal is "peeping", the process proceeds to step S404; if the terminal is "spoofing", the process proceeds to step S406; if the terminal is "away", the process proceeds to step S408.

[0077] In step S403, the state is set to "self". The state is a variable that indicates the identified terminal front state. When the terminal front state is "self", it is a normal state and basically no corresponding action is executed, but evidence data such as camera images and screen shots may be sent to the server at regular intervals and recorded on the server. After processing, proceed to step S410.

[0078] In step S404, the state is set to "peek."

[0079] In step S405, normal processing for "Peeking" is executed. The normal processing for "Peeking" is the response action specified for "Peeking" in the setting field (710) for normal response actions on the parameter setting screen 700 in FIG. 7, and registered in the normal action setting table 800 in FIG. 8. If no action is specified, nothing is done in this step. Also, instead of executing the response action immediately, a predetermined grace period may be set, and the response action may be executed after the grace period has elapsed. After executing the processing, proceed to step S410.

[0080] In step S406, the status is set to "impersonation."

[0081] In step S407, normal processing for "impersonation" is executed. Details are the same as in the case of "peeping" in step S405. After the processing is executed, the process proceeds to step S410.

[0082] In step S408, the status is set to "Away."

[0083] In step S409, normal processing for "Away" is executed. Details are the same as for "Peek" in step S405. After the processing is executed, the process proceeds to step S410.

[0084] In step S410, for the purpose of subsequent processing, the state set above is set as the previous state, and the camera image used to identify the state in front of the terminal is recorded in the RAM 203 or the like as the previous camera image.

[0085] This completes the explanation of FIG.

[0086] Next, the occlusion process in step S310 will be described in detail with reference to FIG.

[0087] FIG. 5 is a flowchart showing an example of the normal occlusion process in step S310.

[0088] The processing shown in each step in FIG. 5 is implemented by the CPU 201 of the teleworker PC 111 loading a program stored in a storage unit such as the external memory 213 into the RAM 203 and executing the program.

[0089] In step S501, the previous state and the previous camera image recorded in step S401 are acquired. These are the state in front of the terminal and the camera image immediately before it is determined that the terminal is "obstructed."

[0090] In step S502, it is determined whether this is the first processing after it has been determined that the object is “obstructed.” If this is the first processing when the object is obscured, the process proceeds to step S503. If this is not the case, that is, if the processing when the object is obscured has already been executed, the process proceeds to step S505.

[0091] In step S503, the occlusion time is reset, that is, set to 0. Here, the occlusion time indicates the time during which the "occluded" state continues after it is determined that the object is "occluded."

[0092] In step S504, the acquired previous state and previous camera image are transmitted to the management server 101. The management server 101 stores the received previous state and previous camera image, and makes them available for confirmation from the administrator PC 121 as the terminal front state and camera image immediately before the occlusion determination.

[0093] In step S505, since this is the second or subsequent occlusion processing, the elapsed time since the previous processing is added to the occlusion time, thereby calculating the time that this state has continued since it was determined to be "occluded."

[0094] In step S506, it is determined whether the occlusion time exceeds the allowable time 741. As described above, if the occlusion time is prolonged, there is a possibility that a serious security incident may have occurred, and this determination is made to deal with that risk. If the occlusion time exceeds the allowable time 741, the process proceeds to step S507, and if not, the process proceeds to step S508.

[0095] In step S507, processing for when the occlusion time has elapsed is executed. The processing for when the occlusion time has elapsed is the processing for when the occlusion time has elapsed that is specified as a corresponding action (742) on the parameter setting screen 700 in Fig. 7 and is registered in 832 of the occlusion continuation allowance setting table 830 in Fig. 8. After the processing is executed, this processing flow ends, but if a sign-out or shutdown is executed as the corresponding action, it is determined in step S315 in Fig. 3 that the program has ended.

[0096] In step S508, the process branches depending on the previous state acquired in step S501. If the state is "self", the process proceeds to step S509, if the state is "peeping", the process proceeds to step S510, if the state is "impersonation", the process proceeds to step S511, and if the state is "away", the process proceeds to step S512.

[0097] Steps S509 to S512 are processes corresponding to the previous state, that is, the state immediately before the occlusion determination, but the process contents are common, so they will be collectively described as occlusion time process (common) with reference to FIG.

[0098] FIG. 6 is a flowchart showing an example of the detailed process during occlusion (common) common to steps S509 to S512.

[0099] The processing shown in each step in FIG. 6 is implemented by the CPU 201 of the teleworker PC 111 loading a program stored in a storage unit such as the external memory 213 into the RAM 203 and executing the program.

[0100] In step S601, a response action to be taken in the event of obstruction is determined based on the previous state. The response action to be taken in the event of obstruction is specified for each immediately preceding state (previous state) in the setting field (730) for response action to obstruction on the parameter setting screen 700 in Fig. 7, and is registered in the action setting table 820 in Fig. 8. If the response action is "blackout", proceed to step S602; if it is "warning output", proceed to step S603; if it is "trail data transmission", proceed to step S604; and if there is no action, do nothing. If multiple response actions are specified, the process branches to multiple processes.

[0101] In step S602, the display screen is blacked out. Any method that makes the original screen invisible may be used, such as displaying or hiding a lock screen at the OS level, or superimposing a mask image at the program level. If this is the first time the occlusion process is performed, blackout is executed, and the blackout state is maintained thereafter.

[0102] An example of a screen display during a blackout is shown in Fig. 9. The entire screen 900 is blacked out, and a message such as 901 may be displayed.

[0103] In step S603, a warning is output on the screen. If this is the first time the occlusion process is performed, the warning is output, and thereafter the state in which the warning is output is continued.

[0104] An example of a screen display of a warning output is shown in Fig. 10. In a warning display window 1000, a warning is displayed that an occlusion has been detected, and further, a warning may be displayed that the above-mentioned occlusion time exceeding process will be executed if the occlusion is not eliminated.

[0105] In step S604, the trace data is acquired and transmitted to the management server 101. The management server 101 stores the received trace data, and the trace data can be confirmed from the administrator PC 121 as trace data at the time of occlusion. Here, the trace data refers to data such as camera images, screen shots, executed application lists, operation logs, etc., that can trace events occurring around and inside the teleworker PC 111. Furthermore, since continuous transmission of trace data can cause network overload and storage capacity pressure, the trace data may be transmitted at a determined transmission timing, such as at regular intervals or the moment when there is a change in the trace data.

[0106] This is the end of the explanation of FIG.

[0107] Here, an example of a screen that the management server 101 displays on the display of the manager's PC 121 using the evidence data and the like transmitted from the teleworker's PC 111 to the management server 101 will be described with reference to FIG.

[0108] FIG. 11 shows examples of a user status confirmation screen 1100 and an obstruction status confirmation screen 1110 displayed on the administrator PC 121. In FIG.

[0109] On a user status confirmation screen 1100, the user and confirmation date are displayed in 1101, and the identified terminal forward state, the detected occlusion state, and the corresponding actions are displayed as a time series chart in 1102. These data are transmitted from the teleworker PC 111 to the management server 101 each time. By specifying an occlusion time period 1103, an occlusion status confirmation screen 1110 is displayed.

[0110] On the occlusion status confirmation screen 1110, the user and the date and time when the occlusion occurred are displayed in 1111, the previous state transmitted in step S504 is displayed in 1112, and the previous camera image is displayed in 1113. Furthermore, as the evidence data transmitted in step S604, the camera image is displayed in 1114, and the screen shot is displayed in 1115 in the order of acquisition timing.

[0111] This is the end of the explanation of FIG.

[0112] As described above, according to the present invention, when it is detected that the camera is blocked, it becomes possible to take an appropriate action according to the situation.

[0113] In this embodiment, the processing of each step shown in each flowchart in the figure has been described as being executed by the teleworker PC 111, but it may also be configured to execute any of the processing (part of the processing) in the management server 101.

[0114] The present invention can be embodied, for example, as a system, an apparatus, a method, a program, or a recording medium, etc. Specifically, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.

[0115] The program of the present invention is a program that enables a computer to execute the processing method of each flowchart, and the storage medium of the present invention stores a program that enables a computer to execute the processing method of each flowchart. Note that the program of the present invention may be a program for each processing method of each device of each flowchart.

[0116] As described above, it goes without saying that the object of the present invention can be achieved by supplying a recording medium on which a program that realizes the functions of the above-mentioned embodiments is recorded to a system or device, and having the computer (or CPU or MPU) of that system or device read and execute the program stored on the recording medium.

[0117] In this case, the program itself read out from the recording medium will realize the novel functions of the present invention, and the recording medium on which the program is recorded will constitute the present invention.

[0118] Examples of recording media for supplying the program include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EPROMs, silicon disks, etc.

[0119] Furthermore, it goes without saying that the functions of the above-mentioned embodiments are not only realized by the computer executing a program it has read, but also includes cases where an OS (operating system) running on the computer performs some or all of the actual processing based on the instructions of the program, and the functions of the above-mentioned embodiments are realized through that processing.

[0120] Furthermore, it goes without saying that this also includes cases where a program read from a recording medium is written into a memory provided on a function expansion board inserted into a computer or a function expansion unit connected to a computer, and then a CPU or the like provided on the function expansion board or function expansion unit performs some or all of the actual processing based on the instructions of the program code, thereby realizing the functions of the above-mentioned embodiments.

[0121] The present invention may be applied to a system consisting of multiple devices, or to an apparatus consisting of a single device. Needless to say, the present invention can also be applied to a case where the object is achieved by supplying a program to a system or apparatus. In this case, the effect of the present invention can be enjoyed by the system or apparatus by reading a recording medium storing a program for achieving the present invention into the system or apparatus.

[0122] Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or device can enjoy the effects of the present invention. Note that the present invention also includes configurations that combine the above-mentioned embodiments and their modified examples. [Explanation of symbols]

[0123] 101 Management Server 111 Teleworker PC 121 Administrator PC

Claims

1. An information processing device including an imaging means, an identification means for identifying a state in front of the information processing device relating to a person appearing in an image captured by the imaging means; a detection means for detecting a blocking state with respect to imaging by the imaging means; a determination means for determining a corresponding process based on a terminal front state identified before the occlusion state is detected when the occlusion state is determined to be an occlusion occurring state according to the detected occlusion state; An information processing device comprising:

2. an execution control means for controlling the execution of the determined response process; The information processing apparatus according to claim 1 , wherein the execution control means controls the execution of the countermeasure processing so as to continue if the occlusion occurring state continues.

3. 3 . The information processing apparatus according to claim 2 , wherein the execution control means controls to execute a predetermined process in addition to the response process determined by the determination means when the occlusion occurring state continues for a predetermined period of time.

4. The information processing device according to claim 2 , wherein, when the occlusion state is detected, the execution control means executes the response process in accordance with a waiting time based on a terminal front state identified before the occlusion state is detected.

5. The information processing apparatus according to claim 2 , wherein the execution control means immediately executes the corresponding process when the occlusion state is detected.

6. The information processing apparatus according to claim 2 , wherein the execution control means executes the corresponding process in a standby time, when the occlusion state is detected, that is shorter than a standby time when the occlusion state is not detected.

7. The information processing apparatus according to claim 1 , further comprising a reception unit configured to receive a designation of a response process to be determined for a terminal forward state identified before the obstruction state is detected.

8. 2 . The information processing apparatus according to claim 1 , further comprising a determination unit that determines that an occlusion has occurred when the occlusion state detected by the detection unit continues for a predetermined period of time.

9. The information processing device according to claim 1 , wherein the determining unit determines the corresponding process based on whether or not the user of the information processing device is included in a terminal forward state before the obstruction state is detected.

10. A method for controlling an information processing device having an imaging means, comprising: a specifying step of specifying a state in front of the information processing device, the state relating to a person appearing in an image captured by the imaging means; A detection step in which a detection means detects a blocking state against imaging by the imaging means; a determining step of determining a corresponding process based on a terminal front state identified before the obstruction state is detected, when the determining means determines that the obstruction state is an obstruction occurring state according to the detected obstruction state; 23. A method for controlling an information processing apparatus comprising:

11. A program executable in an information processing device having an imaging means, The information processing device, an identification means for identifying a state in front of the information processing device relating to a person appearing in an image captured by the imaging means; a detection means for detecting a blocking state with respect to imaging by the imaging means; a determination means for determining a corresponding process based on a terminal front state identified before the occlusion state is detected when the occlusion state is determined to be an occlusion occurring state according to the detected occlusion state; A program to function as a

Citation Information

Patent Citations

  • Automatic teller machine with function of detecting interference with photographing with monitoring camera

    JP2008123013A