Information processing device and control method

Abstract

This invention provides an information processing device and control method that can prevent the display of information unintended by the user. [Solution] The information processing device comprises a communication device that communicates with an external device, a display that displays information, a detector that detects a user in front of the display, and a processor. The processor receives an instruction from the external device via the communication device to activate the function that displays the information, and activates the function when the instruction is received and the detector detects the user, and cancels the activation of the function when the instruction is received and the detector does not detect the user.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and a control method.

Background Art

[0002] Applications that cooperate multiple devices are in use. For example, an application that connects an information device such as a PC (Personal Computer) and a smartphone and operates the information device from the PC is in use. For example, an application on a PC can cause an information device to make an outgoing or incoming call, acquire data from the information device, and send or receive a message to / from the information device. When using such an application, images, contact information, messages, etc. stored in the information device are shared between the PC and the information device. Since such information is related to privacy, it is necessary to prevent malicious users from viewing the information.

[0003] The device disclosed in Patent Document 1 authenticates a user by determining whether face information input from a camera matches pre-stored face information. If the authentication is successful, the device controls writing of information to a storage device and access to a network according to the user's security policy.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] If an information device is locked by the user, a third party cannot operate the device and access the data on it. However, there are applications that can access data on an information device from a PC even when the device is locked. Therefore, data obtained from the information device may be displayed on the PC, potentially allowing a malicious user to view the data.

[0006] The present invention aims to provide an information processing device and control method that can avoid displaying information unintended by the user. [Means for solving the problem]

[0007] One aspect of the present invention is an information processing device comprising: a communication device that performs communication with an external device; a display that displays information; a detector that detects a user in front of the display; and a processor, wherein the processor receives an instruction from the external device via the communication device to activate the function of displaying the information, and activates the function when the instruction is received and the detector detects the user, and cancels the activation of the function when the instruction is received and the detector does not detect the user.

[0008] In one embodiment of the present invention, the detector may detect the user's face, and the processor may activate the function when the instruction is received and the face is the same as a pre-registered face, and may cancel the activation of the function when the instruction is received and the face is different from a pre-registered face.

[0009] In one embodiment of the present invention, when the external device is not locked, the processor may activate the function regardless of the user's detection result.

[0010] One aspect of the present invention is a control method comprising: receiving an instruction from an external device via a communication device to activate a function for displaying information; activating the function when the instruction has been received and a detector has detected a user in front of a display for displaying the information; and canceling the activation of the function when the instruction has been received and the detector has not detected the user. [Effects of the Invention]

[0011] According to the above-described embodiment of the present invention, it is possible to avoid displaying information that the user did not intend. [Brief explanation of the drawing]

[0012] [Figure 1] This is a perspective view showing an example of the external configuration of an information processing device according to an embodiment. [Figure 2] This is a block diagram showing an example of the hardware configuration of an information processing device according to an embodiment. [Figure 3] This is a block diagram showing an example of the functional configuration of an information processing device and an external device according to an embodiment. [Figure 4] This flowchart shows an example of the operation of the information processing device according to the embodiment. [Figure 5] This flowchart shows an example of the operation of an information processing device based on a modified embodiment. [Modes for carrying out the invention]

[0013] Embodiments of the present invention will be described below with reference to the drawings.

[0014] First, an overview of the information processing device according to this embodiment will be described. Figure 1 is a perspective view showing an example of the external configuration of the information processing device 1 according to this embodiment.

[0015] The information processing device 1 is, for example, a notebook-type (clamshell-type) PC (Personal Computer). The information processing device 1 comprises a first housing 10, a second housing 20, and a hinge mechanism 30. The first housing 10 and the second housing 20 are connected using the hinge mechanism 30. The first housing 10 is rotatable relative to the second housing 20 around the axis of rotation formed by the hinge mechanism 30. The opening angle due to the rotation of the first housing 10 and the second housing 20 is shown as "θ".

[0016] The first enclosure 10 is also called the A cover or display enclosure. The second enclosure 20 is also called the C cover or system enclosure. The state in which the first enclosure 10 and the second enclosure 20 overlap and are completely closed (opening angle θ = 0°) is called the "closed state". In the closed state, the faces of the first enclosure 10 and the second enclosure 20 facing each other are called the "inner surfaces", and the faces opposite to the inner surfaces are called the "outer surfaces". The state in which the first enclosure 10 and the second enclosure 20 are open relative to the closed state is called the "open state".

[0017] The external appearance of the information processing device 1 shown in Figure 1 is an example of the open state. In the open state, the first housing 10 and the second housing 20 are separated. In the open state, the inner surfaces of the first housing 10 and the second housing 20 are exposed. The open state is one of the states in which the user uses the information processing device 1, and is typically used with an opening angle θ of approximately 100 to 130°. The range of the opening angle θ in the open state can be arbitrarily determined according to the range of angles that the hinge mechanism 30 can rotate, etc.

[0018] On the inner surface of the first housing 10, a display 12 is provided. The display 12 is configured to include a liquid crystal display (LCD) or an organic EL (Electro Luminescence) display or the like. Also, a camera 13 is provided in a region of the inner surface of the first housing 10 around the periphery of the display 12. For example, the camera 13 is arranged on the side surface 20a side in the peripheral region of the display 12. Note that the position where the camera 13 is arranged is an example, and other locations may be possible as long as it can face the direction of the display screen of the display 12.

[0019] When in the open state, the camera 13 captures a predetermined imaging range in the direction facing the display screen of the display 12 (i.e., in front of the information processing apparatus 1). The predetermined imaging range is a range of an angle of view determined by an imaging element of the camera 13 and an optical lens provided in front of the imaging surface of the imaging element. For example, the camera 13 can capture an image including a person (user) existing in front of (the front side of) the information processing apparatus 1.

[0020] Also, on the inner surface of the second housing 20, a keyboard 170 and a touch pad 171 are provided as input devices for receiving user operation inputs. Note that as input devices, instead of or in addition to the keyboard 170 and the touch pad 171, a touch sensor may be provided, or a mouse or an external keyboard may be connected. In the case of a configuration in which a touch sensor is provided, a region corresponding to the display screen of the display 12 may be configured as a touch panel for receiving operations. Also, the input device may include a microphone for inputting sound.

[0021] Note that in the closed state where the first housing 10 and the second housing 20 are closed, the display 12 and the camera 13 provided on the inner surface of the first housing 10, and the keyboard 170 and the touch pad 171 provided on the inner surface of the second housing 20 are covered by the other housing surface and cannot perform their functions.

[0022] The information processing device 1 performs Human Presence Detection (HPD) processing to detect a person in front of the information processing device 1 based on the image captured by the camera 13. The information processing device 1 may also detect a person by emitting ultrasound or infrared light around itself and detecting the reflected waves.

[0023] Figure 2 is a block diagram showing an example of the hardware configuration of the information processing device 1. The information processing device 1 includes a CPU (Central Processing Unit) 11, a display 12, a camera 13, an image processing circuit 14, a storage medium 15, a communication device 16, and an input device 17.

[0024] The CPU 11 controls various parts within the information processing device 1. The display 12 displays various information. The camera 13 photographs the user in front of the display 12 and generates an image of the user. The image processing circuit 14 performs HPD processing using the image generated by the camera 13 to detect the user in the image. The storage medium 15 includes HDD (Hard Disk Drive), SSD (Solid State Drive), RAM (Random Access Memory), and ROM (Read Only Memory). The communication device 16 communicates with external devices. The input device 17 accepts user input.

[0025] The image processing circuit 14 is an example of a detector that detects a user in front of the display 12. When ultrasound or infrared light is used, the information processing device 1 has an ultrasonic detector or an infrared detector.

[0026] Figure 3 is a block diagram showing an example of the functional configuration of the information processing device 1 and the external device 2. The external device 2 is a smartphone or tablet terminal, for example.

[0027] The information processing device 1 includes a display unit 100, a storage unit 101, a face detection unit 102, a user detection unit 103, a communication unit 104, and an application 105. The external device 2 includes a lock state detection unit 200, an application 201, and a communication unit 202.

[0028] The display unit 100 corresponds to the display 12. The storage unit 101 corresponds to the storage medium 15. The face detection unit 102 and the user detection unit 103 correspond to the image processing circuit 14. The communication unit 104 corresponds to the communication device 16. The application 105 is started when the CPU 11 executes a program stored in the storage medium 15, and then performs processing according to that program.

[0029] The user detection unit 103 performs HPD processing to detect users in the image. The face detection unit 102 detects the face of a specific user from the image in which that user is present and registers the detected face image in the storage unit 101. The face detection unit 102 also detects the face of a user to be determined from the image in which that user is present and compares the detected face image with the face image registered in the storage unit 101. As a result, the face detection unit 102 performs face authentication.

[0030] Application 105 is an application for sharing data with external device 2. Application 105 works in conjunction with application 201 on external device 2 to retrieve information from external device 2 and perform other tasks. Application 105 includes a display control unit 106, a control unit 107, a communication control unit 108, and an event reception unit 109.

[0031] The display control unit 106 provides a user interface for data sharing. The display control unit 106 displays information acquired from the external device 2 on the display unit 100. The control unit 107 controls the activation of the display control unit 106 based on the results of HPD processing performed by the user detection unit 103 and the results of face authentication performed by the face detection unit 102. The communication control unit 108 controls the communication performed by the communication unit 104 with the communication unit 202 of the external device 2. The event reception unit 109 receives events generated in response to user operations such as keyboard 170 or touchpad 171, and notifies the control unit 107 of the occurrence of the event. For example, the event indicates an instruction to activate the display control unit 106.

[0032] The lock state detection unit 200 detects whether the external device 2 is locked or not, and outputs information indicating the locked or unlocked state to application 201. Application 201 receives events such as an instruction to start the display control unit 106, and cooperates with application 105 of the information processing device 1. The communication unit 202 communicates with the communication unit 104 of the information processing device 1.

[0033] Referring to Figure 4, the process performed by the information processing device 1 will be explained. Figure 4 is a flowchart showing an example of the operation of the information processing device 1.

[0034] (Step S100) The application 201 of the external device 2 outputs an instruction to the communication unit 202 to activate the display control unit 106. The communication unit 202 transmits the instruction to the communication unit 104 of the information processing device 1. The communication control unit 108 outputs the instruction received by the communication unit 104 to the control unit 107. The control unit 107 accepts the instruction. Alternatively, the control unit 107 accepts an instruction to activate the display control unit 106 in response to an event received by the event reception unit 109.

[0035] (Step S105) The control unit 107 determines whether the cover is closed or not. The state in which the cover is closed is the closed state described above.

[0036] (Step S110) If the cover is closed, the control unit 107 performs password authentication, biometric authentication, or both. In this way, the control unit 107 authenticates the user.

[0037] In password authentication, the control unit 107 compares the password entered by the user by operating the input device 17 (input password) with a password previously registered in the storage unit 101 (registered password). If the input password matches the registered password, user authentication is successful. If the input password does not match the registered password, user authentication fails.

[0038] In biometric authentication, the control unit 107 compares biometric information such as fingerprints entered by the user (input biometric information) with biometric information previously registered in the storage unit 101 (registered biometric information). If the input biometric information matches the registered biometric information, user authentication is successful. If the input biometric information does not match the registered biometric information, user authentication fails. The method of user authentication may be other than the method described above. Authentication in step S110 is not mandatory.

[0039] (Step S115) If user authentication is successful, the control unit 107 activates the display control unit 106.

[0040] (Step S120) If the cover is open, the control unit 107 instructs the user detection unit 103 to perform HPD processing. The state in which the cover is open is the open state described above. The user detection unit 103 detects users in the image generated by the camera 13 and outputs the detection result to the control unit 107. The control unit 107 refers to the detection result and determines whether or not a specific user has been detected.

[0041] (Step S125) If a user is detected, the control unit 107 instructs the face detection unit 102 to perform face authentication. The face detection unit 102 detects the user's face from the image generated by the camera 13 and compares the detected face image (target face image) with face images registered in the storage unit 101 (registered face images). If the target face image matches the registered face image, face authentication is successful. If the target face image does not match the registered face image, face authentication fails. The face detection unit 102 outputs the authentication result to the control unit 107. The control unit 107 refers to the authentication result and determines whether or not face authentication was successful.

[0042] If facial recognition is successful, user authentication is performed in step S110. If user authentication is successful, the display control unit 106 is activated in step S115.

[0043] (Step S130) If the HPD processing fails to detect a user, or if facial recognition fails, or if user authentication fails, the control unit 107 refers to the time elapsed since it received the instruction to start the display control unit 106. If that time reaches a predetermined time, a timeout occurs, and the process shown in Figure 4 ends without the display control unit 106 starting. If that time has not reached the predetermined time, step S105 is executed.

[0044] After the display control unit 106 is activated, the control unit 107 outputs an instruction to the communication control unit 108 to transmit information held by the external device 2 as needed. The communication control unit 108 controls the communication unit 104 and transmits its instruction to the communication unit 202 of the external device 2. The communication unit 202 outputs the instruction to the application 201. The application 201 outputs information stored in a storage unit (not shown) to the communication unit 202. The communication unit 202 transmits that information to the communication unit 104 of the information processing device 1.

[0045] The communication control unit 108 outputs the information received by the communication unit 104 to the control unit 107. The control unit 107 stores that information in the storage unit 101. The control unit 107 outputs that information to the display control unit 106, and the display control unit 106 displays that information on the display unit 100.

[0046] When a user connects the information processing device 1 and the external device 2, it is assumed that the user will perform operations while looking at the display 12 of the information processing device 1. If the user is detected through HPD processing, the display control unit 106 will be activated, and the information acquired from the external device 2 will be displayed. If the user is not detected through HPD processing, there is a possibility that a malicious user is attempting to use the information processing device 1 and the external device 2. In that case, the display control unit 106 will not be activated, and the information acquired from the external device 2 will not be displayed.

[0047] If the cover is open, any user can view the information displayed on display 12. Therefore, the user detected through HPD processing may not be a legitimate user. Since the display control unit 106 is activated only when facial recognition is successful, it is possible to prevent malicious users from viewing the information.

[0048] As described above, the information processing device 1 comprises a communication device 16 that communicates with an external device 2, a display 12 that displays information, an image processing circuit 14 (detector) that detects a user in front of the display 12, and a CPU 11 (processor). The CPU 11 receives an instruction from the external device 2 via the communication device 16 to activate the function that displays information (display control unit 106). When the instruction is received and the image processing circuit 14 detects a user, the CPU 11 activates the function. When the instruction is received and the image processing circuit 14 does not detect a user, the CPU 11 cancels the activation of the function. In this way, the information processing device 1 can avoid displaying information that the user did not intend.

[0049] The image processing circuit 14 detects the user's face. When the above instruction is received and the detected face is the same as a pre-registered face, the CPU 11 activates the function to display information. When the instruction is received and the detected face is different from a pre-registered face, the CPU 11 cancels the activation of that function. In this way, the information processing device 1 can reliably avoid displaying information that the user did not intend.

[0050] (modified version) Figure 5 is a flowchart showing an example of operation of the information processing device 1 according to a modified version of this embodiment. In Figure 5, the same reference numerals are used for the same processes as shown in Figure 4. The explanation of the same processes as shown in Figure 4 is omitted.

[0051] (Step S140) After receiving an instruction to activate the display control unit 106, the control unit 107 acquires information indicating the lock status of the external device 2. The lock status detection unit 200 of the external device 2 detects whether the external device 2 is locked or not and outputs information indicating the locked or unlocked state to the application 201. The application 201 outputs the status information indicating the locked or unlocked state to the communication unit 202. The communication unit 202 transmits the status information to the communication unit 104 of the information processing device 1. The communication control unit 108 outputs the status information received by the communication unit 104 to the control unit 107. The control unit 107 refers to the status information and determines whether the lock on the external device 2 has been released or not. In other words, the control unit 107 determines whether the external device 2 is in an unlocked state or not.

[0052] If external device 2 is in an unlocked state, step S115 is executed. If external device 2 is in a locked state, step S105 is executed.

[0053] When external device 2 is unlocked, it is assumed that a user is operating external device 2. That user may view the information displayed on display 12. Therefore, steps S105, S110, S120, and S125 are skipped, and the control unit 107 activates the display control unit 106. In other words, when external device 2 is not locked, the control unit 107 activates the display control unit 106 regardless of the user detection result. This reduces the delay time required to activate the display control unit 106.

[0054] While embodiments of the present invention have been described in detail above with reference to the drawings, the specific configuration is not limited to the embodiments described above, and design changes and the like are also included within the scope of the gist of the present invention. [Explanation of symbols]

[0055] 1 Information processing device, 2 External device, 10 First enclosure, 11 CPU, 12 Display, 13 Camera, 14 Image processing circuit, 15 Storage medium, 16 Communication device, 17 Input device, 20 Second enclosure, 30 Hinge mechanism, 100 Display unit, 101 Storage unit, 102 Face detection unit, 103 User detection unit, 104, 202 Communication unit, 105, 201 Application, 106 Display control unit, 107 Control unit, 108 Communication control unit, 109 Event reception unit, 200 Lock state detection unit

Claims

1. A communication device that communicates with an external device, A display that shows information, A detector that detects a user in front of the display, Processor and Equipped with, The aforementioned processor, An instruction to activate the function that displays the aforementioned information is received from the external device via the communication device. When the aforementioned instruction is received and the detector detects the user, the function is activated. If the aforementioned instruction is received and the detector does not detect the user, the activation of the function is canceled. Information processing device.

2. The detector detects the user's face, The aforementioned processor, When the aforementioned instruction is received and the face is the same as a previously registered face, the function is activated. If the aforementioned instruction is received and the face is different from a pre-registered face, the activation of the aforementioned function is canceled. The information processing apparatus according to claim 1.

3. When the external device is not locked, the processor activates the function regardless of the user's detection result. The information processing apparatus according to claim 1 or claim 2.

4. The steps include receiving instructions from an external device via a communication device to activate the function that displays information, The steps include: activating the function when the instruction is received and the detector detects a user standing in front of the display showing the information; If the instruction has been received and the detector has not detected the user, the steps include: canceling the activation of the function; A control method comprising the following features.

Images