Mobile devices and decision-making systems

Abstract

To enable a user of a mobile terminal to determine whether a vehicle is being driven by the user.SOLUTION: A determination system 12 comprises: a specific pattern 40 provided at a position within an interior of a vehicle where the same can be imaged by a user seated in a seat other than a driver's seat; and a mobile terminal used by the user, which is capable of capturing an image of the pattern 40. The mobile terminal includes a determination section that determines that the user is not driving the vehicle when the pattern 40 is captured by the mobile terminal.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a mobile terminal and a determination system, and particularly to a technique for determining whether a user of the mobile terminal is driving a vehicle.

Background Art

[0002] When operating a mobile terminal during driving of a vehicle, the driving operation of the vehicle is likely to become lax. Therefore, a technique for making some functions of the mobile terminal unavailable during driving of the vehicle has been studied.

[0003] Patent Document 1 discloses a driving prevention system for preventing driving while operating a mobile terminal. In this system, when an in-vehicle device detects the running of a vehicle, the in-vehicle device instructs the mobile terminal to stop at least some functions of the mobile terminal using short-range wireless communication. Then, the mobile terminal stops the targeted function according to the received instruction.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In a form of restricting the functions of a mobile terminal using wireless communication, there is a possibility of also restricting the functions of the mobile terminals of vehicle passengers who are not driving. In a vehicle, it is necessary to restrict at least some functions of the mobile terminal of a passenger (driver) driving the vehicle and not restrict the functions of the mobile terminals of other passengers. Therefore, a technique for determining whether a user of the mobile terminal is driving a vehicle is desired.

[0006] The objective of this invention is to enable a mobile device user to determine whether or not they are driving a vehicle. [Means for solving the problem]

[0007] The determination system according to the present invention comprises a specific pattern located in the interior of a vehicle, in a position where it can be photographed by a user while seated in a seat other than the driver's seat, and a portable terminal used by the user and capable of photographing the pattern, wherein the portable terminal The mobile terminal includes a GPS sensor and a touch panel, and the mobile terminal uses the GPS sensor to confirm the conditions that the mobile terminal is moving at a predetermined speed or higher for a predetermined first time or longer and that the mobile terminal is not located on a train track, and if the conditions are met, a pattern shooting request screen is displayed on the touch panel, and within a predetermined second time after the display of the request screen When the aforementioned pattern is captured by the aforementioned mobile device teeth, The user determined that the vehicle was not currently in operation. If the recording is not made, it is determined that the user is driving the vehicle or may be driving it. It is characterized by the following:

[0008] Furthermore, in the determination system according to the present invention, the pattern may be provided on the back of the seat back of the front seat, on the back of the headrest of the front seat, or on the door trim of the rear door.

[0009] Furthermore, in the determination system according to the present invention, the pattern may be represented by processing the material of the seat back, the headrest back, or the door trim into a specific shape.

[0010] Furthermore, in the determination system according to the present invention, the pattern may be represented by embroidery on the back of the seat back, the back of the headrest, or the door trim material.

[0011] Furthermore, in the determination system according to the present invention, the pattern may be represented by a fiber optic fabric provided on the back of the seat back, the back of the headrest, or the door trim.

[0012] Furthermore, in the determination system according to the present invention, the pattern may be a one-dimensional code or a two-dimensional code.

[0013] Furthermore, in the decision system according to the present invention, the mobile terminal is Within the second time period after displaying the request screen, the mobile device If the aforementioned pattern is not captured, the photograph but Compared to when it is allowed, the use of a specific application is restricted. do, That is also acceptable.

[0014] Furthermore, in the determination system according to the present invention, the vehicle is equipped with interior components that allow the user to take photographs while seated in a seat other than the driver's seat, and the mobile terminal teeth Furthermore, if the pattern is photographed and the interior components are photographed, thereby recognizing the external shape of the interior components, it may be determined that the user is not driving the vehicle.

[0015] The mobile terminal according to the present invention is a mobile terminal used by a user, and includes a camera capable of capturing a specific pattern, which is positioned in the interior of a vehicle so that the user can take a picture while seated in a seat other than the driver's seat. The mobile terminal comprises a GPS sensor and a touch panel, and uses the GPS sensor to confirm the conditions that the mobile terminal is moving at a predetermined speed or higher for a predetermined first time or longer and that the mobile terminal is not located on a train track, and if the conditions are met, a pattern shooting request screen is displayed on the touch panel, and within a predetermined second time after the display of the request screen When the aforementioned pattern is captured by the aforementioned camera teeth , the user is determined not to be driving the vehicle. If the recording is not made, it is determined that the user is driving the vehicle or may be driving it. It is characterized by the following: [Effects of the Invention]

[0016] According to the present invention, it is possible to determine whether or not the user of a mobile device is driving a vehicle. [Brief explanation of the drawing]

[0017] [Figure 1] This is a schematic diagram showing the arrangement of multiple seats inside the vehicle. [Figure 2] This figure shows an example of the position of a user sitting in the rear seat and the pattern 40 provided on the door trim. [Figure 3] (A) is a diagram illustrating the position of pattern 40 provided on the back of the front seat back and the back of the headrest, and (B) to (D) are diagrams showing examples of pattern 40. [Figure 4]It is a diagram illustrating the hardware configuration of a mobile terminal. [Figure 5] It is a flowchart showing the processing of a mobile terminal. [Figure 6] It is a diagram showing an example of the screen of a mobile terminal.

Embodiments for Carrying out the Invention

[0018] <Summary> Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described herein. In all the drawings, the same reference numerals are assigned to equivalent elements, and redundant descriptions are omitted.

[0019] FIG. 1 is a diagram schematically showing a plurality of seats 26, 28 in the interior 22 of a vehicle 20. The vehicle 20 is an automobile. The two seats 26 are front seats. There is a steering wheel 24 in front of the vehicle, and the seat 26 (the seat indicated by reference numeral b in FIG. 1) in front of the steering wheel 24 is the driver's seat. The four seats 28 behind the two front seats 26 are rear seats.

[0020] FIG. 2 is a diagram showing a user 14 sitting in the rear seat 28 (the seat indicated by reference numeral d in FIG. 1). The user 14 is operating a mobile terminal 10. The mobile terminal 10 is a smartphone. Note that the mobile terminal 10 may be a computer such as a tablet terminal or a small PC. An application (also simply referred to as an app) is executed on the mobile terminal 10. The app is software that operates on base software such as an operating system (OS). This app is, for example, a game.

[0021] This app does not restrict use by passengers seated in the rear seat 28, but restricts use by passengers seated in the driver's seat (the seat indicated by the symbol b in Figure 1). Specifically, the usage restriction is lifted when a particular pattern 40 (see Figures 2,3(A)) located in the interior 22 of the vehicle 20 is photographed with the camera 54 of the mobile terminal 10; otherwise, the usage restriction remains in place. Note that in Figures 2,3(A), only the outline of pattern 40 is drawn with a dashed line (dummy line), and the interior is omitted. Pattern 40 is located in a position where it can be photographed by a user 14 while seated in the rear seat 28.

[0022] Pattern 40 is provided on the door trim 321 of the rear door 32, for example, as shown in Figure 2. Pattern 40 is also provided on the back of the seat back 261a of the front seat 26, or on the back of the headrest 262a of the front seat 26, for example, as shown in Figure 3(A). Note that only one pattern 40 may be provided, and the number of patterns 40 is not limited.

[0023] A user 14 seated in the rear seat 28 can take a picture of pattern 40 with their mobile device 10 and enjoy using an unrestricted app (for example, a game). On the other hand, a user seated in the driver's seat (the seat indicated by symbol b in Figure 1) cannot take a picture of pattern 40, thus restricting their app use and preventing them from becoming distracted while driving the vehicle.

[0024] <Pattern> Pattern 40 may be, for example, a unique code or pattern. Figures 3(B) to 3(D) illustrate patterns 40 (40a, 40, 40c). Figure 3(B) shows the QR code (registered trademark) as pattern 40a of a two-dimensional code. Note that part of the QR code is omitted in this figure. Note that a two-dimensional code other than the QR code may be used as pattern 40a.

[0025] Figure 3(C) shows a barcode as pattern 40b of the one-dimensional code. Note that a portion of the barcode is omitted in this figure. Other one-dimensional codes besides barcodes may also be used as pattern 40b.

[0026] Figure 3(D) shows a pattern 40c, which consists of diagonally extending rows of dots spaced apart in the left-right direction. Other patterns can also be used as pattern 40c.

[0027] Pattern 40 can be incorporated into seats or doors during the manufacturing of vehicles, seats, or doors. In the case of vehicles already sold, for example, Pattern 40 can be provided on the back of the seat back 261a or the back of the headrest 262a by attaching a special seat cover with Pattern 40 to the seat.

[0028] Pattern 40 may also be represented by processing the material of the seat back 261a, the headrest back 262a, or the door trim 321 into a specific shape. For example, the material may be processed to create a "raised" area that represents the code or pattern of Pattern 40. The code or pattern of Pattern 40 may also be represented by one or more "colors".

[0029] Furthermore, pattern 40 may be represented by embroidery on the material of the seat back 261a, the headrest back 262a, or the door trim 321. For example, the embroidery may create a raised area on the material that represents the code or pattern of pattern 40. Also, the embroidery may represent the code or pattern of pattern 40 in one or more colors.

[0030] Furthermore, pattern 40 may be represented by a fiber optic fabric provided on the back of the seat back 261a, the back of the headrest 262a, or the door trim 321. The fiber optic fabric is a luminous surface (fiber optic surface) woven with fiber optics, developed by Toyota Boshoku Corporation. The fiber optic fabric is a woven fabric in which fiber optics and ordinary yarn are woven as warp or weft threads. Light is shone from a light source onto at least one end of the fiber optics, causing the light to enter the fiber optics and leak out from the circumferential surface of the fiber optics, thereby causing the fabric to emit light and reveal pattern 40.

[0031] In the example shown in Figures 2 and 3(A), the pattern 40 is provided on the back of the seat back 261a and the back of the headrest 262a of the driver's seat (the seat indicated by the symbol b in Figure 1), and on the door trim 321 next to the right-hand seat of the second row (the seat indicated by the symbol d in Figure 1). However, the pattern 40 may be provided at any position from which it can be photographed while the user is seated in a seat other than the driver's seat. For example, the pattern 40 may be provided on the ceiling near the rear seats, the floor mat, the interior trim, etc.

[0032] Furthermore, in Figure 1, pattern 40 may be provided on the back of the seatbacks and headrests of the passenger seat (the seat indicated by the symbol a in Figure 1), the two seats 28 in the second row (the seats indicated by the symbols c and d in Figure 1), and the back of the headrests. Additionally, pattern 40 may be provided on the interior trim next to each of the two seats in the third row (the seats indicated by the symbols e and f in Figure 1).

[0033] <Mobile devices> The decision system 12 is composed of a pattern 40 and a mobile terminal 10. The mobile terminal 10 will now be described. The mobile terminal 10 can employ, for example, a known hardware configuration. Figure 4 is a diagram illustrating an example of the hardware configuration of a mobile terminal. The mobile terminal 10 includes a processor 50, memory 58, auxiliary storage device 60, touch panel 52, camera 54, various functional units 56, GPS sensor 62, communication unit 64, etc. The mobile terminal 10 has a circuit configuration in which each part is connected via a data transmission path such as a bus 70.

[0034] The processor 50 includes a CPU (Central Processing Unit), which controls the operation of the mobile terminal 10 by executing various programs. The memory 58 includes ROM (Read Only Memory) and RAM (Random Access Memory). The ROM stores various control programs, parameters, etc. in advance. The RAM is used as a work area, etc., when the CPU executes various programs. The auxiliary storage device 60 includes an SSD (Solid State Drive), flash memory, HDD (Hard Disk Drive), etc., and stores various programs such as applications and various data.

[0035] The touch panel 52 functions as a display unit for displaying various information, and also as an input unit for inputting various information. The touch panel 52 can be referred to as an operation screen. The camera 54 is, for example, an out-camera installed on the back of the mobile terminal 10 (behind the operation screen 52) (see Figure 2). The mobile terminal 10 may also be equipped with an in-camera. The GPS sensor 62 is a sensor device that uses GPS (Global Positioning System) to determine the location of the mobile terminal 10.

[0036] The various functional units 56 perform various functions provided in the mobile terminal 10. These functions include, for example, functions that generate sound and vibration, and sensing functions using an accelerometer and a gyroscope. The communication unit 64 communicates with communication lines such as mobile phone networks and also performs short-range wireless communication such as Wi-Fi (registered trademark) and Bluetooth (registered trademark).

[0037] The mobile terminal 10 is running base software such as an operating system. The application is provided from an external computer (such as a cloud server) via a network such as the internet. The application is downloaded to the mobile terminal 10 via the communication unit 64 and installed, making it operable on the base software. The downloaded application data includes a pattern image 40I representing the pattern 40 installed in the vehicle interior 22. The pattern image 40I is stored in the auxiliary storage device 60.

[0038] The user operates the touch panel 52 to launch the application. When the application is launched, a pattern shooting request screen, as shown in Figure 6, is displayed on the touch panel 52. The timing of the display of this request screen may be immediately after the application is launched, after a predetermined amount of time has elapsed since the application was launched, or when predetermined conditions have been met since the application was launched.

[0039] The user then uses the camera 54 of the mobile terminal 10 to photograph the pattern 40 (see Figures 2, 3(A)) placed inside the vehicle 22. The processor 50 of the mobile terminal 10 functions as a determination unit 80 and compares the image of the pattern 40 captured by the camera 54 with the pattern image 40I stored in the auxiliary storage device 60. The determination unit 80 then determines that the user of the mobile terminal 10 is not driving the vehicle if the pattern 40 in the captured image matches the pattern in the pattern image 40I.

[0040] The mobile terminal 10 lifts the restrictions on app usage if it determines that the user is not driving a vehicle. On the other hand, the processor 50 of the mobile terminal 10 functions as a restriction unit 82 and restricts app usage if the image is not captured. In other words, the mobile terminal 10 restricts app usage more when pattern 40 is not captured than when pattern 40 is captured. App usage restrictions may include, for example, a state where the request screen shown in Figure 6 remains and the user cannot proceed, or a state where at least a part of the app screen is not displayed. Also, if the app is a game, the usage restriction may include making manual game operation (manual mode) impossible and only being able to use the mode in which the game progresses automatically (automatic mode).

[0041] A user 14 seated in the rear seat 28 (see Figures 1 and 2) can photograph pattern 40 (see Figures 2 and 3) with their mobile device 10, allowing them to use an unrestricted app. On the other hand, a user seated in the driver's seat (indicated by symbol b in Figure 1) cannot photograph pattern 40, thus limiting their app usage and allowing them to concentrate on driving the vehicle.

[0042] In the embodiments described above, the processor 50 functions as a determination unit 80 and a restriction unit 82 when an application is executed, and these units determine whether or not to restrict the use of the application. However, the processor 50 may also function as a determination unit 80 and a restriction unit 82 when base software such as an OS is executed, and these units may determine whether or not to restrict the use of the base software or the application.

[0043] <An example of an embodiment> Next, an example of an embodiment will be described. Figure 5 is a flowchart showing the processing of the mobile terminal 10. The flow in Figure 5 is executed on the mobile terminal 10 when an application is launched by the user. The application is, for example, a game.

[0044] In step S10, the mobile terminal 10 checks whether the mobile terminal 10 (i.e., the user, the vehicle) is moving at a predetermined speed or higher for a first time (a predetermined time) or longer. This is checked, for example, using the GPS sensor 62 of the mobile terminal 10. For example, it is checked whether the mobile terminal 10 is moving at a speed of 20 km / h or higher (an example of a predetermined speed) for a period of 5 seconds (an example of the first time) or longer.

[0045] If step S10 is Yes, proceed to step S12. In step S12, the mobile terminal 10 checks whether the user possessing the mobile terminal 10 is on a train. For example, the mobile terminal 10 uses the GPS sensor 62 to check whether the mobile terminal 10 is located on the train tracks. The mobile terminal 10 then determines that the user is on a train if the mobile terminal 10 is located on the tracks (S12: Yes). On the other hand, the mobile terminal 10 determines that the user is not on a train if the mobile terminal 10 is not located on the tracks (S12: No). If S12 is No, the mobile terminal 10 determines that the user is in a vehicle such as a car.

[0046] If step S12 is No, proceed to step S14. In step S14, the mobile terminal 10 displays a pattern shooting request screen (see Figure 6) on the touch panel 52. As shown in Figure 6, the request screen includes a message 90 requesting the shooting of pattern 40, a shooting frame 91, and an "OK" button 92. The shooting frame 91 displays what is being captured (scenery) by the camera 54 of the mobile terminal 10. The user moves the mobile terminal 10 so that pattern 40, which is placed inside the vehicle 22, is photographed, that is, so that pattern 40 appears in the shooting frame 91, and then touches the "OK" button 92. When the "OK" button 92 is touched, the camera 54 acquires a captured image (still image).

[0047] Next, in step S16, the mobile terminal 10 checks whether a photograph was taken within a second time period (a predetermined time) after the request screen was displayed, and if a photograph was taken, whether the pattern 40 appearing in the photographed image matches the pattern image 40I stored in the auxiliary storage device 60 (whether a specific pattern 40 was photographed). The processor 50 of the mobile terminal 10 functions as a determination unit 80, and if a specific pattern 40 is photographed (if S16 is Yes), it determines that the user of the mobile terminal 10 is not driving the vehicle. On the other hand, if a specific pattern 40 is not photographed (if S16 is No), the determination unit 80 of the mobile terminal 10 determines that the user of the mobile terminal 10 is driving the vehicle, or is likely to be driving it.

[0048] If pattern 40 is captured (if S16 is Yes), in step S18, the mobile terminal 10 continues to run the app without usage restrictions. Also, if step S10 is No (if it is presumed that the vehicle is not running) and step S12 is Yes (if it is presumed that the user is on the train), the mobile terminal 10 also continues to run the app without usage restrictions (S18).

[0049] If the mobile terminal 10 is running the app without usage restrictions (S18) and the user instructs it to terminate the app (S20: Yes), it terminates the flow shown in Figure 5. Also, if the mobile terminal 10 is running the app without usage restrictions (S18) and the decision in step S16 has been made, it checks whether a third time (a predetermined time) has elapsed (S22). If the third time has elapsed (S22: Yes), the mobile terminal 10 returns to step S10 and performs the above-described confirmation process (S10-S16) again.

[0050] On the other hand, if pattern 40 is not captured in step S16 (S16: No), then in step S24, the processor 50 of the mobile terminal 10 functions as a restriction unit 82 and continues to run the application with usage restrictions. For example, as a usage restriction, the mobile terminal 10 may make it impossible for the user to manually operate the game (manual mode) and only allow the user to use the mode in which the game progresses automatically (automatic mode).

[0051] If the mobile terminal 10 is running the app with usage restrictions (S24) and the user instructs it to terminate the app (S26: Yes), it terminates the flow shown in Figure 5. Also, if the mobile terminal 10 is running the app with usage restrictions (S24) and the decision in step S16 has been made, it checks whether the fourth time (a predetermined time) has elapsed (S28). If the fourth time has elapsed (S28: Yes), the mobile terminal 10 returns to step S10 and performs the above-described confirmation process (S10-S16) again.

[0052] Note that in the flowchart in Figure 5, "First Time," "Second Time," "Third Time," and "Fourth Time" are assumed to be different times, but they may also be the same time.

[0053] According to the embodiments described above, it is possible to easily determine whether or not the user of the mobile device is driving the vehicle. It is also possible to determine whether or not the user of the mobile device is sitting in the back seat without using means such as wireless communication.

[0054] <Variation> Next, a modified example will be described. The vehicle 20 is equipped with interior components in the interior 22 that can be photographed while the user is seated in a seat other than the driver's seat. Examples of interior components include the seat backs and headrests of the front seats. The processor 50 of the mobile terminal 10 functions as a determination unit 80, and if the pattern 40 described above is photographed and the interior components described above are photographed, thereby recognizing the external shape of the interior components, it may determine that the user is not driving the vehicle.

[0055] For example, the app download data includes an external shape image representing the external shape of an interior component, and this external shape image is stored in the auxiliary storage device 60. The user takes a picture of an interior component located in the car interior 22 using the camera 54 of the mobile terminal 10. The mobile terminal 10 compares the external shape of the interior component captured by the camera 54 with the external shape of the external shape image stored in the auxiliary storage device 60. If the two external shapes match or are similar, the mobile terminal 10 determines that the aforementioned interior component has been photographed. As a result, the determination unit 80 of the mobile terminal 10 can determine that the user is not driving the vehicle if pattern 40 has been photographed and an interior component has been photographed. [Explanation of Symbols]

[0056] 10 Mobile terminal, 12 Decision system, 14 User, 20 Vehicle, 22 Interior, 24 Steering wheel, 26 Front seats, 28 Rear seats, 32 Rear door, 40, 40a, 40b, 40c Pattern, 40I Pattern image, 50 Processor, 52 Touch panel (operation screen), 54 Camera, 56 Various function units, 58 Memory (main memory), 60 Auxiliary memory, 62 GPS sensor, 64 Communication unit, 70 Bus, 80 Decision unit, 82 Restriction unit, 90 Message, 91 Shooting frame, 92 Button, 261 Seat back, 261a Back (back of seat back), 262 Headrest, 262a Back (back of headrest), 321 Door trim.

Claims

1. A specific pattern is provided in the vehicle's interior, positioned in a location where the user can take a photograph while seated in a seat other than the driver's seat, A mobile terminal used by the aforementioned user and capable of capturing the aforementioned pattern, The aforementioned mobile terminal includes a GPS sensor and a touch panel. The aforementioned mobile terminal is Using the GPS sensor, the conditions are confirmed that the mobile terminal is moving at a predetermined speed or higher for a predetermined first time or longer, and that the mobile terminal is not located on a train track. If the above preconditions are met, the pattern shooting request screen will be displayed on the touch panel. If the pattern is captured on the mobile device within a predetermined second time after the request screen is displayed, it is determined that the user is not driving the vehicle; if the capture is not made, it is determined that the user is driving the vehicle or may be driving it. Decision-making system.

2. A determination system according to claim 1, The aforementioned pattern is provided on the back of the front seat backrest, the back of the front seat headrest, or the door trim of the rear door. Decision-making system.

3. The determination system according to Claim 2, The aforementioned pattern is represented by a fiber optic fabric. Decision-making system.

4. A determination system according to claim 2, The aforementioned pattern is either a one-dimensional code or a two-dimensional code. Decision-making system.

5. A determination system according to any one of claims 1 to 4, If the mobile terminal does not capture the pattern within the second time period after displaying the request screen, it will restrict the use of a specific application compared to when the pattern is captured. Decision-making system.

6. A mobile device used by a user, A camera capable of capturing a specific pattern is provided in the vehicle's interior, in a position where the user can take a photograph while seated in a seat other than the driver's seat. GPS sensor and, Equipped with a touch panel, The aforementioned mobile terminal is Using the GPS sensor, the conditions are confirmed that the mobile terminal is moving at a predetermined speed or higher for a predetermined first time or longer, and that the mobile terminal is not located on a train track. If the above preconditions are met, the pattern shooting request screen will be displayed on the touch panel. If the pattern is captured by the camera within a predetermined second time period after the request screen is displayed, it is determined that the user is not driving the vehicle; if the pattern is not captured, it is determined that the user is driving the vehicle or may be driving it. Mobile device.

Images