Mobile terminal and determination system

Abstract

To enable a user of a mobile terminal to determine whether a vehicle is being driven by the user.SOLUTION: A mobile terminal 10 comprises: a camera 54 that can capture an image of the face of a user 14 who is using the mobile terminal 10; a detection section that detects the gaze direction of the user 14 from the image captured by the camera 54; and a determination section that determines that the user 14 is driving a vehicle when the gaze direction of the user 14 is not toward an operation screen 52 used for operating the mobile terminal 10 for a period equal to or longer than a predetermined ratio of a unit time.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a mobile terminal and a determination system, and particularly to a technique for determining whether a user of the mobile terminal is driving a vehicle or not.

Background Art

[0002] When operating a mobile terminal during driving of a vehicle, the driving operation of the vehicle is likely to become lax. Therefore, a technique for making some functions of the mobile terminal unavailable during driving of the vehicle has been studied.

[0003] Patent Document 1 discloses a driving prevention system for preventing driving while operating a mobile terminal. In this system, when an in-vehicle device detects the running of a vehicle, the in-vehicle device instructs the mobile terminal to stop at least some functions of the mobile terminal using short-range wireless communication. Then, the mobile terminal stops the targeted functions according to the received instruction.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In a vehicle, it is necessary to limit at least some functions of a mobile terminal of an occupant (driver) who is driving the vehicle so as not to limit the functions of mobile terminals of other occupants. Therefore, a technique for determining whether a user of the mobile terminal is driving a vehicle or not is desired.

[0006] An object of the present invention is to enable determination of whether a user of a mobile terminal is driving a vehicle or not.

Means for Solving the Problems

[0007] The mobile terminal according to the present invention includes a camera capable of photographing the face of a user who uses the mobile terminal, a detection unit that detects the line-of-sight direction of the user photographed by the camera, and when the line-of-sight direction of the user is in a direction other than the operation screen used for operating the mobile terminal for a time equal to or more than a predetermined ratio with respect to the unit time, a determination unit that determines that the user is driving a vehicle.

[0008] Also, in the mobile terminal according to the present invention, the determination unit may determine that the user is driving a vehicle when the line-of-sight direction of the user is above the operation screen of the mobile terminal for a time equal to or more than a predetermined ratio with respect to the unit time.

[0009] Also, in the mobile terminal according to the present invention, when it is determined that the user is driving a vehicle, it may further include a restriction unit that restricts the use of a specific application in the mobile terminal as compared to when it is not the case.

[0010] Also, in the mobile terminal according to the present invention, it further includes a face authentication unit that performs face authentication by collating the face image of the user acquired by the camera with the face image of an authorized user of the application registered in advance in the mobile terminal or an external computer. The face authentication unit performs the face authentication at intervals of a predetermined time, and the restriction unit restricts the use of the application when the user is not authenticated by the face authentication.

[0011] The determination system according to the present invention includes a state acquisition unit that acquires the state of the ciliary muscle of the eye based on an electrical signal generated from the eye of a vehicle occupant who uses a mobile terminal, a detection unit that detects whether or not the ciliary muscle is in a relaxed state in which the occupant focuses the eye on an object far away by a predetermined distance or more based on the state of the ciliary muscle of the eye, and a determination unit that determines that the occupant is driving a vehicle when the ciliary muscle of the occupant is in a relaxed state for a time equal to or more than a predetermined ratio with respect to the unit time.

Effects of the Invention

[0012] According to the present invention, it is possible to determine whether or not the user of the mobile terminal is driving a vehicle.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Embodiments for Carrying Out the Invention

[0014] <Summary> Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described herein. When a plurality of embodiments, modification examples, etc. are included below, it is assumed from the beginning that their characteristic parts can be used in appropriate combination. In all the drawings, the same reference numerals are given to equivalent elements, and duplicate explanations are omitted.

[0015] FIG. 1 is a diagram showing a user 14 sitting on a seat 26 in the interior 22 of a vehicle. The vehicle is an automobile. The user 14 is operating a mobile terminal 10. The mobile terminal 10 is a smartphone. Note that the mobile terminal 10 may be a computer such as a tablet terminal or a small PC. An application (also simply referred to as an app) is executed on the mobile terminal 10. The app is software that operates on base software such as an operating system (OS). This app is, for example, a game.

[0016] The use of this application is at least partially restricted for the occupants while the vehicle is in operation, and is not restricted for other occupants. The mobile terminal 10 determines whether the user using the mobile terminal 10 is driving the vehicle, and sets whether to restrict the use of this application. Specifically, the mobile terminal 10 captures the face of the user 14 with the camera 54 to detect the line-of-sight direction of the user 14. Then, when the line-of-sight direction of the user 14 is not in the direction of the operation screen 52 of the mobile terminal 10 for a time equal to or more than a predetermined ratio per unit time, the mobile terminal 10 determines that the user 14 is driving the vehicle. And when the mobile terminal 10 determines that the user 14 is driving the vehicle, it restricts the use of this application.

[0017] Here, in FIG. 1, assume that the seat 26 is the driver's seat. In this case, when the user 14 sitting in the driver's seat operates the mobile terminal 10 while driving the vehicle, the line of sight of the user 14 is likely to move back and forth between the direction where the operation screen 52 of the mobile terminal 10 is located (the direction of reference sign B in FIG. 1) and the front of the vehicle (the direction of reference sign U in FIG. 1). Note that when the line of sight of the user 14 is in the front of the vehicle, that direction is above the operation screen 52 of the mobile terminal 10.

[0018] On the other hand, in FIG. 1, assume that the seat 26 is a passenger seat or a rear seat other than the driver's seat. In this case, when the user 14 sitting in that seat operates the mobile terminal 10, the line of sight of the user 14 focuses on the direction where the operation screen 52 of the mobile terminal 10 is located (the direction of reference sign B in FIG. 1), and does not face the front of the vehicle or the ratio of facing the front of the vehicle is low. The mobile terminal 10 determines whether the user 14 of the mobile terminal 10 is driving the vehicle based on the difference in the line-of-sight directions between this driver and other occupants.

[0019] The mobile terminal 10 includes a touch panel 52 as an operation screen and a camera 54 (in-camera) disposed on the touch panel 52 side. The mobile terminal 10 captures the face of the user 14 at a predetermined frame rate with the camera 54. The mobile terminal 10 analyzes the captured video. Specifically, the mobile terminal 10 detects the line-of-sight direction of the user 14 in each of the plurality of still images constituting the video.

[0020] FIG. 2(A) is an example of a captured image (still image) of a user facing the front of the mobile terminal 10. FIG. 2(B) is an example of a captured image (still image) of a user facing upward with respect to the mobile terminal 10, that is, facing the front of the vehicle.

[0021] As shown in FIG. 2(A), when the user faces the direction of the mobile terminal 10 (the direction of reference sign B in FIG. 1), the user's eyes 42a appear frontally or in a form close thereto in the captured image 40a. On the other hand, as shown in FIG. 2(B), when the user faces upward with respect to the mobile terminal 10 (the direction of reference sign U in FIG. 1), the user's eyes 42b appear to be slightly lifted in the captured image 40b.

[0022] Also, as shown in FIG. 2(A), when the user faces the direction of the mobile terminal 10 (the direction of reference sign B in FIG. 1), the back side of the user's jaw 46a does not appear or appears less likely to appear in the captured image 40a. On the other hand, as shown in FIG. 2(B), when the user faces upward with respect to the mobile terminal 10 (the direction of reference sign U in FIG. 1), the back side of the user's jaw 46 appears or appears more likely to appear in the captured image 40b.

[0023] The mobile terminal 10 detects the user's line-of-sight direction from such differences between the captured images 40a and 40b. For example, when the back side of the user's jaw 46 appears in the captured image (still image) at a rate equal to or higher than a predetermined rate, the mobile terminal 10 may determine that the user is facing upward with respect to the mobile terminal 10 (the direction of reference sign U in FIG. 1), and otherwise may determine that the user is facing the direction of the mobile terminal 10 (the direction of reference sign B in FIG. 1).

[0024] Also, for example, learning data for the front when the user faces the mobile terminal 10 (when the user faces the direction of the mobile terminal 10) and learning data for above when the user faces upward with respect to the mobile terminal 10 may be stored in advance in the auxiliary storage device 60 of the mobile terminal 10. The learning data includes, for example, images. Then, when the captured image (still image) is more similar to the image of the learning data for above than the image of the learning data for the front, the mobile terminal 10 determines that the user is facing upward (in the direction of the symbol U in FIG. 1) with respect to the mobile terminal 10, and if not, it may determine that the user is facing the direction of the mobile terminal 10 (in the direction of the symbol B in FIG. 1).

[0025] The mobile terminal 10 detects the line-of-sight direction of the user 14 for each of a plurality of captured images (still images) by the above-described means (such as the state of the eyes or jaw, or learning data). The mobile terminal 10 counts, for example, the number of captured images (referred to as line-of-sight upward images) in which the line-of-sight direction of the user is upward among the plurality of captured images in a unit time. Then, the mobile terminal 10 calculates the ratio of the number of line-of-sight upward images to the total number of captured images in that unit time to calculate the degree to which the line-of-sight direction of the user is upward in that unit time. Note that the unit time may be, for example, 5 seconds, 10 seconds, 20 seconds, 30 seconds, or 1 minute, etc.

[0026] Incidentally, the above described the calculation of the ratio of the user facing upward with respect to the mobile terminal 10. However, the ratio of the user's line-of-sight direction facing a direction other than the operation screen 52 of the mobile terminal may also be calculated. For example, the mobile terminal 10 counts the number of captured images in a unit time in which the user faces the direction of the mobile terminal 10 (referred to as the line-of-sight front image). Then, the mobile terminal 10 subtracts the number of line-of-sight front images from the total number of captured images in that unit time, and calculates the number of captured images (referred to as the non-line-of-sight front image) in which the user's line-of-sight direction in that unit time faces a direction other than the operation screen 52 of the mobile terminal 10. Then, the mobile terminal 10 may calculate the ratio of the number of non-line-of-sight front images to the total number of captured images in that unit time, thereby calculating the degree to which the user's line-of-sight direction is in a direction other than the operation screen 52 of the mobile terminal 10 in that unit time.

[0027] And when the line-of-sight direction of the user 14 is upward (or facing a direction other than the operation screen 52 of the mobile terminal) for a time equal to or more than a predetermined ratio (predetermined ratio) with respect to the unit time, the mobile terminal 10 determines that the user 14 is driving a vehicle. The predetermined ratio may be, for example, 40%, 50%, 60%, etc.

[0028] And when the mobile terminal 10 determines that the user is driving a vehicle, it restricts the use of the application compared to when it is not the case. The restriction of the use of the application may be, for example, a state where a predetermined screen (predetermined screen) is maintained and cannot proceed, or a state where at least a part of the application screen is not displayed. Also, if the application is a game, as a use restriction, a manual game operation (manual mode) may be impossible, and only a mode in which the game progresses automatically (automatic mode) may be available.

[0029] Thereby, a user driving a vehicle can have the use of the application restricted, preventing the driving of the vehicle from becoming lax. On the other hand, a user who is not driving a vehicle can enjoy an application without use restrictions (for example, a game).

[0030] Each of the above-described configurations can be applied to embodiments, modifications, and the like described below.

[0031] <Mobile terminal> Here, the mobile terminal 10 will be described. The mobile terminal 10 can adopt, for example, a known hardware configuration. FIG. 3 is a diagram illustrating the hardware configuration of the mobile terminal. The mobile terminal 10 includes a processor 50, a memory 58, an auxiliary storage device 60, a touch panel 52, a camera 54, various functional units 56, a GPS sensor 62, a communication unit 64, and the like. The mobile terminal 10 has, for example, a circuit configuration in which each unit is connected via a data transmission path such as a bus 70.

[0032] The processor 50 includes a CPU (Central Processing Unit), and the CPU controls the operation of the mobile terminal 10 by executing various programs. The memory 58 includes a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM stores various control programs, parameters, etc. in advance. The RAM is used as a work area, etc. when the CPU executes various programs. The auxiliary storage device 60 includes an SSD (Solid State Drive), a flash memory, an HDD (Hard Disk Drive), etc., and stores various programs such as applications and various data.

[0033] The touch panel 52 functions as a display unit for displaying various information and also functions as an input unit for inputting various information. Note that the touch panel 52 can be referred to as an operation screen. The camera 54 is an in-camera installed on the operation screen 52 side of the mobile terminal 10 (see FIG. 1). Note that the mobile terminal 10 may further include an out-camera. The GPS sensor 62 is a sensor device for specifying the position of the mobile terminal 10 using GPS (Global Positioning System).

[0034] The various functional units 56 execute various functions provided in the mobile terminal 10. The various functions include, for example, functions that generate sounds and vibrations, sensing functions using an acceleration sensor, a gyro sensor, etc. The communication unit 64 communicates with a communication line such as a mobile phone line network and also performs short-range wireless communication such as Wi-Fi (registered trademark) and Bluetooth (registered trademark).

[0035] In the mobile terminal 10, base software such as an OS is operating. The apps are provided from an external computer (such as a cloud server) via a network such as the Internet. The apps are downloaded to the mobile terminal 10 via the communication unit 64 and installed therein, thereby becoming operable on the base software. The downloaded data of the apps includes, for example, learning data for the front for when the user faces the mobile terminal 10 forward and learning data for above for when the user faces the mobile terminal 10 upward (both are collectively referred to as learning data 90). The learning data 90 is stored in the auxiliary storage device 60.

[0036] The user operates the touch panel 52 to start an app. When the app is executed, the processor 50 of the mobile terminal 10 functions as a detection unit 76, a determination unit 80, a restriction unit 82, and a face authentication unit 84.

[0037] The detection unit 76 detects the line-of-sight direction of the user 14 from the face of the user 14 photographed by the camera 54 by means of the above-described means (the state of the eyes or jaw, or the learning data 90, etc.).

[0038] When the line-of-sight direction of the user 14 is in a direction other than the operation screen 52 of the mobile terminal 10 (for example, above the operation screen 52) for a time equal to or more than a predetermined ratio per unit time, the determination unit 80 determines that the user 14 is driving a vehicle.

[0039] When it is determined that the user is driving the vehicle, the restriction unit 82 restricts the use of the application on the mobile terminal 10 compared to when it is not the case. Note that the face authentication unit 84 has a selective configuration. The face authentication unit 84 will be described later.

[0040] Note that in the embodiment described above, when the application is executed, the processor 50 functions as the detection unit 76, the determination unit 80, the restriction unit 82, and the face authentication unit 84, and they set the presence or absence of application use restriction. However, when the base software such as the OS is executed, the processor 50 may function as the detection unit 76, the determination unit 80, the restriction unit 82, and the face authentication unit 84, and they may set the presence or absence of use restriction of the base software or the application.

[0041] <An example of the embodiment> Next, an example of the embodiment will be described. FIG. 4 is a flowchart showing the processing of the mobile terminal 10. The flow in FIG. 4 is executed when the application is started by the user on the mobile terminal 10. The application is, for example, a game.

[0042] In step S10, the mobile terminal 10 checks whether the mobile terminal 10 (that is, the user, the vehicle) has been continuously moving at a predetermined speed or more for a first time (a predetermined time) or more. This is confirmed, for example, using the GPS sensor 62 of the mobile terminal 10. For example, it is confirmed whether the mobile terminal 10 has been continuously moving at a speed of 20 km / h (an example of the predetermined speed) or more for 5 seconds (an example of the first time) or more.

[0043] If the answer in step S10 is Yes, proceed to step S12. In step S12, the mobile terminal 10 checks whether the user who owns the mobile terminal 10 is on the train. For example, the mobile terminal 10 uses the GPS sensor 62 to check whether the mobile terminal 10 is located on the train line. And if the mobile terminal 10 is located on the line, the mobile terminal 10 determines that the user is on the train (S12: Yes). On the other hand, if the mobile terminal 10 is not located on the line, the mobile terminal 10 determines that the user is not on the train (S12: No). If S12 is No, the mobile terminal 10 determines that the user is in a vehicle such as a car.

[0044] If the answer in step S12 is No, proceed to step S16. In step S16, the mobile terminal 10 functions as the detection unit 76 and the determination unit 80, and checks whether the user's line of sight is above the operation screen 52 of the mobile terminal 10 for a time equal to or more than a predetermined ratio per unit time. Note that the detection of the line of sight direction may start from the timing when the application is launched. If the user's line of sight is above the operation screen 52 of the mobile terminal 10 for a time equal to or more than the above-mentioned predetermined ratio (when S16 is Yes), the mobile terminal 10 determines that the user of the mobile terminal 10 is driving a vehicle or may be driving. On the other hand, if the user's line of sight is not above the operation screen 52 of the mobile terminal 10 for a time equal to or more than the above-mentioned predetermined ratio (when S16 is No), the mobile terminal 10 determines that the user of the mobile terminal 10 is not driving a vehicle.

[0045] If in step S16, it is determined that the user is driving a vehicle or may be driving (S16: Yes), then in step S18, the mobile terminal 10 functions as the restriction unit 82 and restricts the use of the application. For example, as a usage restriction, the mobile terminal 10 makes it impossible for the user to perform manual game operations (manual mode) and allows only the mode in which the game progresses automatically (automatic mode).

[0046] While the mobile terminal 10 is running the app with usage restrictions (S18), if the user instructs to end the app (S20: Yes), the flow of FIG. 4 ends. Also, while the mobile terminal 10 is running the app with usage restrictions (S18), after the determination in step S16, it checks whether or not a third period (predetermined period) has elapsed (S22). And if the third period has elapsed (S22: Yes), the mobile terminal 10 returns to step S10 and performs the above-described confirmation process (S10 - S16) again.

[0047] On the other hand, in step S16, if it is determined that the user is not driving the vehicle (S16: No), in step S24, the mobile terminal 10 continues to run the app without usage restrictions. Note that in the above cases where step S10 is No (when it is estimated that the vehicle is not running) and step S12 is Yes (when it is estimated that the user is on the train), the mobile terminal 10 also continues to run the app without usage restrictions (S24).

[0048] While the mobile terminal 10 is running the app without usage restrictions (S24), if the user instructs to end the app (S26: Yes), the flow of FIG. 4 ends. Also, while the mobile terminal 10 is running the app without usage restrictions (S24), after the determination in step S16, it checks whether or not a second period (predetermined period) has elapsed (S28). And if the second period has elapsed (S28: Yes), the mobile terminal 10 returns to step S10 and performs the above-described confirmation process (S10 - S16) again.

[0049] Note that although it is assumed that the "first period", "second period", and "third period" in the flow of FIG. 4 are different periods, they may be the same period.

[0050] According to the embodiments described above, it is possible to easily determine whether the user of the mobile terminal is driving a vehicle or not. For a user who is driving a vehicle, the use of the application can be restricted to prevent the driving operation of the vehicle from becoming lax. On the other hand, a user who is not driving a vehicle can enjoy the application without usage restrictions.

[0051] Next, a modified example will be described. The processor 50 of the mobile terminal 10 may function as a face authentication unit 84 when an application is executed. In the mobile terminal 10, a face image 92 (see FIG. 3) of an available user of the application is registered in advance, and the face image 92 is stored in the auxiliary storage device 60 in advance. Note that the face image 92 of the available user of the application may be registered in an external computer (for example, a cloud server or the like) in advance, and the mobile terminal 10 may receive the face image 92 at a necessary timing by wireless communication. There may be a plurality of available users of the application.

[0052] The face authentication unit 84 collates the face image of the user acquired by the camera 54 of the mobile terminal 10 with the face image 92 of the available user of the application registered in advance in the mobile terminal 10 or the external computer, and executes face authentication. The face authentication unit 84 executes the face authentication at predetermined time intervals. Then, when the user is not authenticated by the face authentication (when the face image obtained by the camera 54 does not match the face image 92 of the available user of the application registered in advance), the mobile terminal 10 functions as a restriction unit 82 and restricts the use of the application.

[0053] This embodiment of face authentication may be executed in combination with the above-described embodiment of gaze confirmation in FIG. 4. Here, it is assumed that the driver and other passengers are present in the vehicle. When only the above-described embodiment of gaze confirmation in FIG. 4 is executed, for example, the driver hands the mobile terminal 10 to another passenger, and the other passenger makes the determination in step S16 of FIG. 4 be No (a state where the user's line-of-sight direction is not above the operation screen of the mobile terminal for a predetermined ratio or more of the unit time). Then, when this passenger returns the mobile terminal 10 (step S24) with "no restriction on app use" to the driver, the driver has no usage restriction and can use the app.

[0054] However, even in such a case, by executing the above-described embodiment of face authentication in combination, it may be possible to maintain the usage restriction of the app for the driver. For example, it is assumed that the driver has previously registered a face image as an available user of the app, and other passengers have not registered it. In this case, even if the driver hands the mobile terminal 10 to another passenger, the other passenger will not be authenticated as a user by face authentication, so the usage restriction of the app on the mobile terminal 10 remains maintained. Therefore, by combining this embodiment of face authentication, it is possible to restrict the use of the app for the user during driving.

[0055] Next, another modification will be described. When the mobile terminal 10 determines that its user is driving the vehicle or may be driving, a caution message or the user's face captured by the camera 54 may be presented on the screen display (display on the touch panel 52) of the app (for example, a game). Thereby, the mobile terminal 10 (system) can directly or indirectly make the user aware that it recognizes that the user is driving the vehicle (or may be driving), and can suppress the operation of the mobile terminal 10 during driving.

[0056] <Another Example of the Embodiment> Next, another example of the embodiment will be described. FIG. 5 is a diagram schematically showing the determination system 100 of this embodiment.

[0057] In the embodiment described above, based on the face of the user photographed by the camera 54, when the proportion of the user facing the front of the vehicle is high, it is determined that the user is driving the vehicle. However, in this embodiment, when the proportion of the user staring into the distance is high, it is determined that the user is driving the vehicle. This can be realized, for example, by detecting or estimating the state of the ciliary muscle of the user's eyes.

[0058] When a human eye looks at a distant object, the ciliary muscle relaxes and the lens becomes thinner, and when looking at a nearby object, the ciliary muscle contracts and the lens becomes thicker. When the state of the ciliary muscle of the eye changes, the weak current in the eye or its surrounding area changes. Therefore, by detecting the weak current, the state of the ciliary muscle can be detected or estimated. Devices for detecting the state of the ciliary muscle have already been developed, such as glasses-type devices. The glasses-type device is provided with electrodes on the nose pads and the bridge parts of the two lenses to detect the weak current. Figure 5 schematically shows the glasses-type device 102. Note that the form of the device is not limited.

[0059] As shown in Figure 5, the determination system 100 of this embodiment includes a glasses-type device 102 and a mobile terminal 10A. The glasses-type device 102 includes a state acquisition unit 110 and a communication unit 112 as functional elements. The state acquisition unit 110 acquires the state of the ciliary muscle of the eye (such as the level of relaxation or contraction, etc.) based on the weak current (electrical signal) generated from the eyes of the user 14A of the mobile terminal 10A. The communication unit 112 is a part that performs short-range wireless communication with the communication unit 64 of the mobile terminal 10A, and transmits the state of the ciliary muscle acquired by the state acquisition unit 110 to the mobile terminal 10A.

[0060] The mobile terminal 10A includes, as functional elements, a communication unit 64, a detection unit 78, a determination unit 80, and a restriction unit 82. Note that the communication unit 64, the determination unit 80, and the restriction unit 82 may all have functions equivalent to those in the above-described embodiment. The communication unit 64 acquires the state of the ciliary muscle of the eye from the communication unit 112 of the glasses-type device 102. The detection unit 78 detects, based on the state of the ciliary muscle of the eye, whether or not the ciliary muscle is in a relaxed state (a state with a relatively high level of relaxation) in which the user focuses the eyes on an object far away by a predetermined distance or more. The determination unit 80 determines that the user 14 is driving a vehicle when the ciliary muscle of the user 14 is in a relaxed state for a time equal to or more than a predetermined ratio with respect to the unit time. The restriction unit 82 restricts the use of an application in the mobile terminal 10A when it is determined that the user 14A is driving a vehicle, as compared with the case where it is not so determined.

[0061] Also in this embodiment, it is possible to determine whether or not the user 14A of the mobile terminal 10A is driving a vehicle. The user 14A who is driving a vehicle has the use of the application restricted and can concentrate on driving the vehicle.

Explanation of Reference Numerals

[0062] 10, 10A Mobile terminal, 14, 14A User, 22 Indoor (inside the vehicle), 26 Seat, 40a, 40b Captured image, 42a, 42b Eyes, 46a, 46b Jaws, 50 Processor, 52 Touch panel (operation screen), 54 Camera, 56 Various functional units, 58 Memory (main storage device), 60 Auxiliary storage device, 62 GPS sensor, 64 Communication unit, 70 Bus, 76 Detection unit, 78 Detection unit, 80 Determination unit, 82 Restriction unit, 84 Face authentication unit, 90 Learning data, 92 Face image, 100 Determination system, 102 Glasses-type device, 110 State acquisition unit, 112 Communication unit.

Claims

1. A mobile terminal, comprising: a camera capable of photographing the face of a user who uses the mobile terminal; a detection unit that detects the line-of-sight direction of the user photographed by the camera; a determination unit that determines that the user is driving a vehicle when the line-of-sight direction of the user is not in the direction of an operation screen used for operating the mobile terminal for a time equal to or greater than a predetermined ratio per unit time. A mobile terminal.

2. The mobile terminal according to Claim 1, wherein the determination unit determines that the user is driving a vehicle when the line-of-sight direction of the user is above the operation screen of the mobile terminal for a time equal to or greater than a predetermined ratio per unit time. A mobile terminal.

3. The mobile terminal according to Claim 1 or 2, further comprising a restriction unit that restricts the use of a specific application in the mobile terminal when it is determined that the user is driving a vehicle, as compared to when it is not so determined. A mobile terminal.

4. A determination system, comprising: a state acquisition unit that acquires the state of the ciliary muscle of an eye based on an electrical signal generated from the eye of a vehicle occupant who uses a mobile terminal; a detection unit that detects, based on the state of the ciliary muscle of the eye, whether the ciliary muscle is in a relaxed state in which the occupant focuses the eye on an object far away by a predetermined distance or more; a determination unit that determines that the occupant is driving a vehicle when the ciliary muscle of the occupant is in a relaxed state for a time equal to or greater than a predetermined ratio per unit time. A determination system.

Images