Mobile terminal and determination system

Abstract

To enable a user of a mobile terminal to determine whether a vehicle is being driven by the user.SOLUTION: A determination system 12 comprises: a specific pattern 40 provided at a position within an interior of a vehicle where the same can be imaged by a user seated in a seat other than a driver's seat; and a mobile terminal used by the user, which is capable of capturing an image of the pattern 40. The mobile terminal includes a determination section that determines that the user is not driving the vehicle when the pattern 40 is captured by the mobile terminal.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a mobile terminal and a determination system, and particularly to a technique for determining whether a user of the mobile terminal is driving a vehicle or not.

Background Art

[0002] When operating a mobile terminal during driving of a vehicle, the driving operation of the vehicle is likely to become lax. Therefore, a technique for making some functions of the mobile terminal unavailable during driving of the vehicle has been studied.

[0003] Patent Document 1 discloses a driving prevention system for preventing driving while operating a mobile terminal. In this system, when an in-vehicle device detects the running of a vehicle, the in-vehicle device instructs the mobile terminal to stop at least some functions of the mobile terminal using short-range wireless communication. Then, the mobile terminal stops the targeted functions according to the received instruction.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In a form of restricting the functions of a mobile terminal using wireless communication, there is a possibility of also restricting the functions of the mobile terminals of vehicle passengers who are not driving. In a vehicle, it is necessary to restrict at least some functions of the mobile terminal of the passenger (driver) who is driving the vehicle and not to restrict the functions of the mobile terminals of other passengers. Therefore, a technique for determining whether a user of the mobile terminal is driving a vehicle or not is desired.

[0006] An object of the present invention is to enable a user of a mobile terminal to determine whether the user is driving a vehicle or not.

Means for Solving the Problems

[0007] The determination system according to the present invention includes a specific pattern provided at a position where it is possible to take a photograph in the vehicle interior with the user seated in a seat other than the driver's seat, and a mobile terminal used by the user and capable of photographing the pattern. The mobile terminal includes a determination unit that determines that the user is not driving the vehicle when the pattern is photographed by the mobile terminal.

[0008] Further, in the determination system according to the present invention, the pattern may be provided on the back surface of the front seat backrest, the back surface of the front seat headrest, or the door trim of the rear door.

[0009] Further, in the determination system according to the present invention, the pattern may be represented by processing the material of the seat backrest, the headrest, or the door trim into a specific shape.

[0010] Further, in the determination system according to the present invention, the pattern may be represented by embroidering the material of the seat backrest, the headrest, or the door trim.

[0011] Further, in the determination system according to the present invention, the pattern may be represented by a fiber optic fabric provided on the back surface of the seat backrest, the back surface of the headrest, or the door trim.

[0012] Further, in the determination system according to the present invention, the pattern may be a one-dimensional code or a two-dimensional code.

[0013] Further, in the determination system according to the present invention, the mobile terminal may include a restriction unit that restricts the use of a specific application when the pattern is not photographed, as compared with the case where the pattern is photographed.

[0014] Further, in the determination system according to the present invention, the vehicle includes interior parts that can be photographed in a state where the user is seated in a seat other than the driver's seat indoors, and the determination unit of the mobile terminal determines that the user is not driving the vehicle when the pattern is photographed and the outer shape of the interior parts is recognized by photographing the interior parts.

[0015] The mobile terminal according to the present invention is a mobile terminal used by a user, and includes a camera capable of photographing a specific pattern provided at a position where the user can photograph in a state of being seated in a seat other than the driver's seat in the vehicle interior, and a determination unit that determines that the user is not driving the vehicle when the pattern is photographed by the camera.

Advantages of the Invention

[0016] According to the present invention, it is possible to determine whether or not the user of the mobile terminal is driving a vehicle.

Brief Description of the Drawings

[0017]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Embodiments for Carrying Out the Invention

[0018] <Summary> Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described herein. In all the drawings, the same reference numerals are assigned to equivalent elements, and redundant descriptions are omitted.

[0019] FIG. 1 is a diagram schematically showing a plurality of seats 26, 28 in the interior 22 of a vehicle 20. The vehicle 20 is an automobile. The two seats 26 are front seats. There is a steering wheel 24 in front of the vehicle, and the seat 26 (the seat indicated by reference numeral b in FIG. 1) in front of the steering wheel 24 is the driver's seat. The four seats 28 behind the two front seats 26 are rear seats.

[0020] FIG. 2 is a diagram showing a user 14 sitting in the rear seat 28 (the seat indicated by reference numeral d in FIG. 1). The user 14 is operating a mobile terminal 10. The mobile terminal 10 is a smartphone. Note that the mobile terminal 10 may be a computer such as a tablet terminal or a small PC. An application (also simply referred to as an app) is executed on the mobile terminal 10. The app is software that operates on base software such as an operating system (OS). This app is, for example, a game.

[0021] While this app does not restrict the use by the passenger sitting in the rear seat 28, it restricts the use by the passenger sitting in the driver's seat (the seat indicated by reference numeral b in FIG. 1). Specifically, when a specific pattern 40 (see FIGS. 2 and 3(A)) arranged in the interior 22 of the vehicle 20 is photographed by the camera 54 of the mobile terminal 10, the use restriction is released, and when it is not photographed, the use remains restricted. Note that only the outer shape of the pattern 40 in FIGS. 2 and 3(A) is drawn with a dashed line (virtual line), and the interior is omitted. The pattern 40 is provided at a position where the user 14 can photograph it while sitting in the rear seat 28.

[0022] Pattern 40 is provided on the door trim 321 of the rear door 32, for example, as shown in FIG. 2. Further, Pattern 40 is provided on the back surface 261a of the seat back 261 of the front seat 26 and the back surface 262a of the headrest 262 of the front seat 26, for example, as shown in FIG. 3(A). Note that only one Pattern 40 may be provided, and the number of Patterns 40 is not limited.

[0023] The user 14 seated in the rear seat 28 can photograph Pattern 40 with the mobile terminal 10 and enjoy an app without usage restrictions (such as a game). On the other hand, since the user seated in the driver's seat (the seat indicated by reference numeral b in FIG. 1) cannot photograph Pattern 40, the use of the app is restricted, and it is possible to prevent the driver from becoming distracted while driving the vehicle.

[0024] <Pattern> Pattern 40 may be, for example, a unique code, pattern, or the like. FIGS. 3(B) to (D) illustrate Patterns 40 (40a, 40, 40c). FIG. 3(B) shows a QR code (registered trademark) as a two-dimensional code pattern 40a. Note that a part of the QR code is omitted in the figure. Note that a two-dimensional code other than the QR code may be used as Pattern 40a.

[0025] FIG. 3(C) shows a barcode as a one-dimensional code pattern 40b. Note that a part of the barcode is omitted in the figure. Note that a one-dimensional code other than the barcode may be used as Pattern 40b.

[0026] FIG. 3(D) shows a pattern as a pattern 40c, in which dot arrays extending obliquely are arranged at intervals in the left-right direction. Note that other patterns may be adopted as Pattern 40c.

[0027] Pattern 40 can be incorporated into the seat or door during the manufacture of a vehicle, seat, or door. In the case of a vehicle that has already been sold, for example, by attaching a dedicated seat cover with Pattern 40 to the seat, Pattern 40 can be provided on the back surface 261a of the seat back and the back surface 262a of the headrest.

[0028] Pattern 40 may also be represented by processing the material of the back surface 261a of the seat back, the back surface 262a of the headrest, or the door trim 321 into a specific shape. For example, by processing the material, a "bulge" representing the code or pattern as Pattern 40 may be provided on the material. Also, the code or pattern as Pattern 40 may be represented by one or more "colors".

[0029] Pattern 40 may also be represented by embroidering the material of the back surface 261a of the seat back, the back surface 262a of the headrest, or the door trim 321. For example, by embroidery, a "bulge" representing the code or pattern as Pattern 40 may be provided on the material. Also, by embroidery, the code or pattern as Pattern 40 may be represented by one or more "colors".

[0030] Pattern 40 may also be represented by a fiber optic fabric provided on the back surface 261a of the seat back, the back surface 262a of the headrest, or the door trim 321. The fiber optic fabric is a glowing skin (fiber optic skin) incorporating optical fibers, developed by Toyota Boshoku Corporation. The fiber optic fabric is a woven fabric in which optical fibers and ordinary yarns are woven as warp or weft. By irradiating light from a light source to at least one end of the optical fiber to allow the light to enter the optical fiber and causing the light to leak from the circumferential surface of the optical fiber, the woven fabric is made to emit light and Pattern 40 appears.

[0031] In the examples of FIGS. 2 and 3(A), a pattern 40 is provided on the back surface 261a of the seat back of the driver's seat (the seat indicated by reference numeral b in FIG. 1), the back surfaces 262a of the headrests, and the door trim 321 beside the right seat in the second row (the seat indicated by reference numeral d in FIG. 1). However, the pattern 40 may be provided at any position where it is possible for the user to take a photograph while seated in a seat other than the driver's seat. For example, the pattern 40 may be provided on the ceiling near the rear seats, the floor mat, the interior trim, etc.

[0032] Also, in FIG. 1, the pattern 40 may be provided on the back surfaces of the seat backs and the back surfaces of the headrests of the passenger seat (the seat indicated by reference numeral a in FIG. 1) and the two seats 28 in the second row (the seats indicated by reference numerals c and d in FIG. 1). Further, the pattern 40 may be provided on the interior trims beside each of the two seats in the third row (the seats indicated by reference numerals e and f in FIG. 1).

[0033] <Mobile terminal> The determination system 12 includes the pattern 40 and the mobile terminal 10. Here, the mobile terminal 10 will be described. The mobile terminal 10 can adopt, for example, a known hardware configuration. FIG. 4 is a diagram illustrating the hardware configuration of the mobile terminal. The mobile terminal 10 includes a processor 50, a memory 58, an auxiliary storage device 60, a touch panel 52, a camera 54, various functional units 56, a GPS sensor 62, a communication unit 64, etc. The mobile terminal 10 has, for example, a circuit configuration in which each unit is connected via a data transmission path such as a bus 70.

[0034] The processor 50 includes a CPU (Central Processing Unit), and the CPU controls the operation of the mobile terminal 10 by executing various programs. The memory 58 includes a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM stores various control programs, parameters, etc. in advance. The RAM is used as a work area, etc. when the CPU executes various programs. The auxiliary storage device 60 includes an SSD (Solid State Drive), a flash memory, an HDD (Hard Disk Drive), etc., and stores various programs such as applications and various data.

[0035] The touch panel 52 functions as a display unit for displaying various information and also functions as an input unit for inputting various information. Note that the touch panel 52 can be referred to as an operation screen. The camera 54 is, for example, an out-camera installed on the back side of the mobile terminal 10 (the back side of the operation screen 52) (see FIG. 2). Note that the mobile terminal 10 may further include an in-camera. The GPS sensor 62 is a sensor device for specifying the position of the mobile terminal 10 using GPS (Global Positioning System).

[0036] The various functional units 56 execute various functions provided in the mobile terminal 10. The various functions include, for example, a function of generating sound and vibration, a sensing function by an acceleration sensor, a gyro sensor, etc. The communication unit 64 communicates with a communication line such as a mobile phone line network and also performs short-range wireless communication such as Wi-Fi (registered trademark) and Bluetooth (registered trademark).

[0037] On the mobile terminal 10, base software such as an OS is operating. The application is provided from an external computer (such as a cloud server) via a network such as the Internet. The application is downloaded to the mobile terminal 10 via the communication unit 64 and installed thereon, thereby becoming operable on the base software. The downloaded data of the application includes a pattern image 40I representing the pattern 40 installed in the vehicle interior 22. The pattern image 40I is stored in the auxiliary storage device 60.

[0038] The user operates the touch panel 52 to start the application. When the application starts, a pattern shooting request screen as shown in FIG. 6 is displayed on the touch panel 52. The display timing of this request screen may be immediately after the application starts, when a predetermined time has elapsed since the application was started, or when a predetermined condition is satisfied after the application is started.

[0039] Then, the user uses the camera 54 of the mobile terminal 10 to shoot the pattern 40 (see FIGS. 2 and 3(A)) arranged in the vehicle interior 22. The processor 50 of the mobile terminal 10 functions as a determination unit 80 and collates the captured image of the pattern 40 captured by the camera 54 with the pattern image 40I stored in the auxiliary storage device 60. Then, when the pattern 40 of the captured image matches the pattern of the pattern image 40I, the determination unit 80 determines that the user of the mobile terminal 10 is not driving the vehicle.

[0040] When the mobile terminal 10 determines that the user is not driving the vehicle, it releases the usage restriction of the application. On the other hand, when the camera of the mobile terminal 10 is not being used, the processor 50 of the mobile terminal 10 functions as a restriction unit 82 and restricts the use of the application. That is, when the pattern 40 is not photographed, the mobile terminal 10 restricts the use of the application compared to when the pattern 40 is photographed. The restriction of the application use may be, for example, a state where a request screen as shown in FIG. 6 is maintained and cannot proceed, or a state where at least a part of the application screen is not displayed. Also, if the application is a game, as a usage restriction, manual game operations (manual mode) may be impossible, and only a mode in which the game progresses automatically (automatic mode) may be available.

[0041] Since the user 14 sitting in the rear seat 28 (see FIGS. 1 and 2) can photograph the pattern 40 (see FIGS. 2 and 3) with the mobile terminal 10, the user can use the application without restrictions. On the other hand, the user sitting in the driver's seat (the seat indicated by reference numeral b in FIG. 1) cannot photograph the pattern 40, so the use of the application is restricted and the user can concentrate on driving the vehicle.

[0042] In the embodiment described above, when the application is executed, the processor 50 functions as the determination unit 80 and the restriction unit 82, and they set whether to restrict the use of the application. However, when the base software such as the OS is executed, the processor 50 may function as the determination unit 80 and the restriction unit 82, and they may set whether to restrict the use of the base software or the application.

[0043] <An example of the embodiment> Next, an example of the embodiment will be described. FIG. 5 is a flowchart showing the processing of the mobile terminal 10. The flowchart in FIG. 5 is executed when the application is launched by the user on the mobile terminal 10. The application is, for example, a game.

[0044] In step S10, the mobile terminal 10 checks whether the mobile terminal 10 (i.e., the user, the vehicle) has been continuously moving at a speed equal to or higher than a predetermined speed for a first period of time (a predetermined time) or more. This is confirmed, for example, using the GPS sensor 62 of the mobile terminal 10. For example, it is confirmed whether the mobile terminal 10 has been continuously moving at a speed of 20 km / h (an example of a predetermined speed) or more for 5 seconds (an example of the first period of time) or more.

[0045] If step S10 is Yes, the process proceeds to step S12. In step S12, the mobile terminal 10 checks whether the user who holds the mobile terminal 10 is on the train. For example, the mobile terminal 10 checks whether the mobile terminal 10 is located on the train line using the GPS sensor 62. And when the mobile terminal 10 is located on the line, the mobile terminal 10 determines that the user is on the train (S12: Yes). On the other hand, when the mobile terminal 10 is not located on the line, the mobile terminal 10 determines that the user is not on the train (S12: No). If S12 is No, the mobile terminal 10 determines that the user is in a vehicle such as a car.

[0046] If step S12 is No, the process proceeds to step S14. In step S14, the mobile terminal 10 displays a pattern shooting request screen (see FIG. 6) on the touch panel 52. As shown in FIG. 6, the request screen includes a message 90 requesting shooting of the pattern 40, a shooting frame 91, and an "OK" button 92. What is being shot (the scenery) by the camera 54 of the mobile terminal 10 is displayed in the shooting frame 91. The user moves the mobile terminal 10 so that the pattern 40 arranged in the vehicle interior 22 is shot, that is, so that the pattern 40 appears in the shooting frame 91, and touches the "OK" button 92. When the "OK" button 92 is touched, the camera 54 acquires a captured image (a still image).

[0047] Next, in step S16, the mobile terminal 10 checks whether shooting has been performed within the second time (predetermined time) after the request screen is displayed. If shooting has been performed, the mobile terminal 10 checks whether the pattern 40 appearing in the captured image matches the pattern of the pattern image 40I stored in the auxiliary storage device 60 (whether a specific pattern 40 has been captured). The processor 50 of the mobile terminal 10 functions as a determination unit 80. When a specific pattern 40 has been captured (when S16 is Yes), the determination unit 80 of the mobile terminal 10 determines that the user of the mobile terminal 10 is not driving a vehicle. On the other hand, when the specific pattern 40 has not been captured (when S16 is No), the determination unit 80 of the mobile terminal 10 determines that the user of the mobile terminal 10 is driving a vehicle or may be driving.

[0048] When the pattern 40 has been captured (when S16 is Yes), in step S18, the mobile terminal 10 continues to execute the application without any usage restrictions. In addition, in the above cases where step S10 is No (when it is estimated that the vehicle is not running) and step S12 is Yes (when it is estimated that the user is on a train), the mobile terminal 10 also continues to execute the application without any usage restrictions (S18).

[0049] When the user instructs the termination of the application during the execution of the application without any usage restrictions (S18) (when S20 is Yes), the mobile terminal 10 ends the flow of FIG. 5. Also, during the execution of the application without any usage restrictions (S18), after the determination in step S16, the mobile terminal 10 checks whether the third time (predetermined time) has elapsed (S22). Then, when the third time has elapsed (when S22 is Yes), the mobile terminal 10 returns to step S10 and performs the above-described confirmation process (S10 to S16) again.

[0050] On the other hand, in step S16, if pattern 40 is not photographed (S16: No), in step S24, the processor 50 of the mobile terminal 10 functions as the restriction unit 82 and continues to execute the application with usage restrictions. For example, as a usage restriction, the mobile terminal 10 makes it impossible for the user to perform manual game operations (manual mode), and only allows the mode in which the game progresses automatically (automatic mode).

[0051] When the mobile terminal 10 is executing the application with usage restrictions (S24) and the user instructs the termination of the application (S26: Yes), the flow of FIG. 5 ends. Also, when the mobile terminal 10 is executing the application with usage restrictions (S24), after the determination in step S16, it checks whether or not the fourth time (predetermined time) has elapsed (S28). And when the fourth time has elapsed (S28: Yes), the mobile terminal 10 returns to step S10 and performs the above-described confirmation process (S10 to S16) again.

[0052] Note that although it is assumed that the "first time", "second time", "third time", and "fourth time" in the flow of FIG. 5 are different times, they may be the same time.

[0053] According to the embodiment described above, it is possible to easily determine whether or not the user of the mobile terminal is driving a vehicle. Without using means such as wireless communication, it is possible to determine whether or not the user of the mobile terminal is sitting in the back seat.

[0054] <Modification Example> Next, a modification example will be described. The vehicle 20 includes interior parts that can be photographed in the interior 22 while the user is seated in a seat other than the driver's seat. As an example, the interior parts are the seat back of the front seat, the headrest of the front seat, and the like. The processor 50 of the mobile terminal 10 functions as the determination unit 80, and when the above-described pattern 40 is photographed and the outer shape of the interior part is recognized by photographing the above-described interior part, it may be determined that the user is not driving the vehicle.

[0055] For example, include an external shape image representing the external shape of the interior parts in the download data of the application, and store the external shape image in the auxiliary storage device 60. The user uses the camera 54 of the mobile terminal 10 to take a picture of the interior parts arranged in the vehicle interior 22. The mobile terminal 10 collates the external shape of the interior parts photographed by the camera 54 with the external shape of the external shape image stored in the auxiliary storage device 60. Then, when the two external shapes match or are similar, the mobile terminal 10 determines that the above-mentioned interior parts have been photographed. Thereby, when the determination unit 80 of the mobile terminal 10 photographs the pattern 40 and the interior parts, it can be determined that the user is not driving the vehicle.

Explanation of Signs

[0056] 10 Mobile terminal, 12 Judgment system, 14 User, 20 Vehicle, 22 Vehicle interior (indoor), 24 Steering wheel, 26 Front seat (seat), 28 Rear seat (seat), 32 Rear door, 40, 40a, 40b, 40c Patterns, 40I Pattern image, 50 Processor, 52 Touch panel (operation screen), 54 Camera, 56 Various functional parts, 58 Memory (main storage device), 60 Auxiliary storage device, 62 GPS sensor, 64 Communication unit, 70 Bus, 80 Judgment unit, 82 Limiting unit, 90 Message, 91 Photographing frame, 92 Button, 261 Seat back, 261a Back surface (back surface of seat back), 262 Headrest, 262a Back surface (back surface of headrest), 321 Door trim.

Claims

1. A specific pattern provided at a position in the vehicle interior where it is possible to take a picture while the user is seated in a seat other than the driver's seat, and A mobile terminal used by the user and capable of taking a picture of the pattern, comprising: The mobile terminal includes a determination unit that determines that the user is not driving the vehicle when the pattern is photographed by the mobile terminal. A determination system.

2. The determination system according to claim 1, wherein The pattern is provided on the back surface of the front seat backrest, the back surface of the front seat headrest, or the door trim of the rear door. A determination system.

3. The determination system according to claim 2, wherein The pattern is a one-dimensional code or a two-dimensional code. A determination system.

4. The determination system according to any one of claims 1 to 3, wherein The mobile terminal includes a restriction unit that restricts the use of a specific application when the pattern is not photographed as compared to when the pattern is photographed. A determination system.

5. A mobile terminal used by a user, comprising: A camera capable of taking a picture of a specific pattern provided at a position in the vehicle interior where it is possible to take a picture while the user is seated in a seat other than the driver's seat, and A determination unit that determines that the user is not driving the vehicle when the pattern is photographed by the camera. A mobile terminal.

Images