User estimation program

Abstract

To provide a user estimation program that can quickly determine whether the user operating the touch panel is an adult or a child, using a simple configuration. [Solution] The user estimation program is a user estimation program that drives an information processing terminal used by a user, which comprises an input unit that is a touch panel, a display unit, a processing unit, and a storage unit. The processing unit acquires the first user operation on the application when the information processing terminal is first started as first user operation information from the input unit and stores it in the storage unit as past first user operation information. Furthermore, the input unit acquires the current first user operation information and second user operation information, which is a user operation performed a predetermined time after the first start. If the operation predicted from the past first user operation information in the storage unit does not match the first user operation, and the second user operation information indicates an operation in an area other than the operable display area of ​​the display unit, the user is determined to be a child.

Description

Technical Field

[0001] The present invention relates to a user estimation program for estimating a user who is using an information processing terminal.

Background Art

[0002] Information processing terminals that are operated by touch operations on a touch panel display without physical operation buttons, such as IVI (In-Vehicle Infotainment) devices and tablet terminals mounted on vehicles, are becoming widespread. With the spread of such information processing terminals, it is often seen that children such as infants observe and imitate the actions of adults operating the information processing terminals, and measures for preventing incorrect operations during vehicle driving are required. Regarding such problems, for example, in Patent Document 1, although it is not a program mounted on a vehicle but a program related to a game, it collects operation input information on the touch panel after login processing and collates the operation input tendency with determination dictionary data to determine the attributes of the player using the user terminal (for example, adult / child) according to the physical characteristics of the player. A technique is disclosed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, a program as described in Patent Document 1 accumulates the operations of the user after login to perform charging settings, advertisement display, and game settings according to the determined attributes. In a usage form that does not involve a login process for an IVI device or the like in a vehicle, it is difficult to simply and quickly determine whether it is an adult operation or a child operation.

[0005] The present invention aims to provide a user estimation program that can quickly determine whether the user operating the touch panel is an adult or a child, using a simple configuration. [Means for solving the problem]

[0006] (1) A user estimation program according to one aspect of the present invention (for example, the drive mode application 1 described later) is a user estimation program that drives an information processing terminal used by a user (for example, the IVI device 50 described later), which comprises an input unit that is a touch panel (for example, the touch panel 241 described later), a display unit (for example, the display 24 described later), a processing unit (for example, the CPU 21 described later), and a storage unit (for example, the memory 22 described later), The aforementioned processing unit (for example, the CPU 21 described later) The input unit (for example, the touch panel 241 described later) acquires the first user operation on the application when the information processing terminal (for example, the IVI device 50 described later) is first started as first user operation information and stores it in the storage unit (for example, the memory 22 described later) as past first user operation information. Furthermore, the input unit (for example, the touch panel 241 described later) acquires the current first user operation information and second user operation information, which is a user operation performed a predetermined time after the initial startup. If the operation predicted from the past first user operation information in the storage unit (for example, the memory 22 described later) does not match the initial user operation, and the second user operation information indicates an operation in an area other than the operable display area of ​​the display unit (for example, the display 24 described later), the user is determined to be a child.

[0007] According to (1) above, a simple configuration makes it possible to determine whether the user operating the touch panel is an adult or a child.

[0008] (2) In the user estimation program described in (1) above (for example, drive mode application 1 described later), The aforementioned information processing terminal (for example, the IVI device 50 described later) is mounted on the vehicle. The first user operation information refers to operations performed on the application after the vehicle's start switch is turned on and the information processing terminal (for example, the IVI device 50 described later) is started.

[0009] According to (2) above, a simple configuration makes it possible to determine whether the user operating the touch panel installed in the vehicle is an adult or a child.

[0010] (3) In the user estimation program described in (1) or (2) above (for example, the drive mode application 1 described later), When the processing unit (for example, the CPU 21 described later) determines that the user is a child, it runs the multiple applications that are executed on the information processing terminal (for example, the IVI device 50 described later) in a child-friendly mode with restrictions on the functions that can be operated by adults.

[0011] According to (3) above, a simple configuration allows the system to determine whether the user operating the touch panel is an adult or a child, enabling parents to use it with peace of mind. [Effects of the Invention]

[0012] According to the present invention, it is possible to quickly determine whether the user operating the touch panel is an adult or a child with a simple configuration. [Brief explanation of the drawing]

[0013] [Figure 1] This is a system configuration diagram of an IVI device on which the drive mode application of the present invention is installed. [Figure 2] This figure shows the structure of the drive mode application of this embodiment. [Figure 3] This figure shows an example of the display on an IVI device. [Figure 4] This figure shows an example of how to operate when the user is a child. [Figure 5] This figure shows an example of how the home screen looks in child mode. [Figure 6] It is a flowchart showing the control process of the IVI device.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, a preferred embodiment of the present invention will be described with reference to the drawings. Here, a case where the user estimation program of the present invention is applied to an IVI device 50 mounted on a vehicle as an information processing terminal and various functions are realized in the IVI device 50 will be illustrated and described. Note that the present invention is also applicable to a smartphone, a tablet terminal, an in-vehicle car navigation device, a PND (Portable Navigation Device), etc. as an information processing terminal.

[0015] [System Configuration of IVI Device 50] Referring to FIG. 1, the system configuration of the IVI device 50 installed with the user estimation program of the present invention will be described. FIG. 1 is a system configuration diagram of the IVI device 50. The IVI device 50 includes, as hardware 2, at least a CPU 21, a memory 22, a display memory (VRAM: Video RAM) 23, a display 24, and a communication unit 25. Further, the IVI device 50 includes, as software 3, at least a device driver 31, an OS / middleware 32, and an application 33.

[0016] The CPU 21 is a part that comprehensively controls the IVI device 50. By reading and executing various programs, it functions as a processing unit that cooperates with the above-described hardware 2 to realize various functions described later. The memory 22 functions as a storage unit that stores programs to be appropriately read and executed and also stores various information created by the execution of the programs. The display memory 23 is a memory that holds data to be displayed on the display 24.

[0017] The display 24 functions as a display unit that displays a predetermined image. A touch panel 241 is laminated on the surface of the display 24 to receive user operations. The touch panel 241 is composed of a multi-touch panel capable of simultaneously detecting a plurality of contact points and functions as an input unit. Operations received by the touch panel 241 include a selection operation (e.g., tap, etc.) for selecting an arbitrary position on the display 24 and a slide operation (e.g., swipe, flick, etc.) for moving a finger after selecting an arbitrary position on the display 24. Operations received via the touch panel 241 are transmitted to a processing unit (CPU 21) for processing.

[0018] The communication unit 25 connects the IVI device 50 and other devices by wired or wireless connection and controls the communication performed between them. In this embodiment, the communication unit 25 connects the IVI device 50 to a vehicle control device (e.g., ECU: Engine Control Unit) and the user's smartphone, etc. The connection method between the IVI device 50 and the vehicle control device or the user's smartphone, etc. is arbitrary. For example, the user's smartphone, etc. may be attached to a mounting bracket provided on the vehicle to connect to the IVI device 50, or the IVI device 50 may be connected by a predetermined cable such as a signal cable like USB (registered trademark) or a power supply cable for supplying power to the user's smartphone, etc. Also, the IVI device 50 may be connected to the vehicle control device or the user's smartphone, etc. by wireless connection such as Wireless LAN or Bluetooth (registered trademark).

[0019] The device driver 31 controls the above hardware 2. In this embodiment, in accordance with a command from the OS / middleware 32, it writes to the display memory 23 and controls the display of the display 24 based on the written data. The OS / middleware 32 serves as a bridge between the application 33 and the hardware 2 and also manages system resources, etc. Note that the OS / middleware 32 of this embodiment supports a multi-task environment in the IVI device 50.

[0020] Application 33 is software that has the function of performing tasks that the user of the IVI device 50 wants to perform. Application 33 includes at least the drive mode application 1, which is the user estimation program of the present invention, and the native application 331. The native application 331 refers to any application other than the drive mode application 1, and includes applications that are permitted to be used while driving and applications that are not permitted to be used while driving.

[0021] Drive Mode Application 1 is an application that is launched when it detects a connection between the IVI device 50 and the vehicle, or when it detects a connection to the vehicle and accepts user input, or when it detects a connection to the vehicle and that the vehicle is in motion. It implements a user interface that manages input and output between the vehicle and the occupants. Drive Mode Application 1 is written in, for example, HTML Living Standard and consists of a DD manager that prohibits complex operations while driving, and multiple applications that are launched on Drive Mode Application 1. Multiple applications are applications that can be used while driving, and include both pre-configured applications and applications that can be added later. Furthermore, Drive Mode Application 1 can also launch Native Application 331 by referencing it. In this case, functions of Native Application 331 that are undesirable to use while driving will be restricted by the DD Manager.

[0022] [Structure of Drive Mode Application 1] Next, with reference to Figure 2, the structure of the drive mode application 1, which is the program of the present invention, will be described. As shown in Figure 2, the drive mode application 1 is composed of a management unit 11 that performs control considering driver distraction, and a content unit 12 that has an application that is launched on the drive mode application 1.

[0023] The content unit 12 stores multiple applications. In this embodiment, for example, the multiple applications stored in the content unit 12 include a navigation application 121 that implements a car navigation system, a video application 122 that enables video playback, and a radio application 123 that enables radio broadcast reception. The content unit 12 may also store a smartphone connection application 124 that enables connection with the user's smartphone, an assistant application 125 that enables the use of voice-based assistant services, and an SNS application 126 that supports connections between users. The multiple applications stored in the content unit 12 are launched one by one or simultaneously on the drive mode application 1. The applications stored in the content unit 12 are not limited to navigation applications 121 or video applications 122. The content unit 12 can store any application. For example, although not shown in the diagram, it may store music applications, phone applications, navigation assistance applications such as destination search applications and surrounding area guide applications, or information applications such as traffic information applications, disaster information applications, vehicle information applications, and dealer information applications.

[0024] The IVI device 50, by executing the management unit 11, causes the CPU 21 to function as a connection detection unit 111, a memory processing unit 112, a determination processing unit 113, and a function limiting unit 114. Furthermore, the IVI device 50, by executing the management unit 11, causes the CPU 21 to execute an application control method comprising a connection detection step, a storage processing step, a determination processing step, and a function restriction step.

[0025] The following describes the connection detection unit 111, memory processing unit 112, determination processing unit 113, and function restriction unit 114 that the IVI device 50 is equipped with when the management unit 11 is executed. Note that the connection detection step, memory processing step, determination processing step, and function restriction step, which are part of the control method for the application executed by the IVI device 50 when the management unit 11 is executed, can be explained by replacing "unit" with "step," so they will be omitted.

[0026] The connection detection unit 111 detects the connection between the IVI device 50 and the vehicle. Specifically, the connection detection unit 111 detects, for example, a wired or wireless connection between the IVI device 50 and the vehicle via the communication unit 25 after the IVI device 50 is started by the user turning on the vehicle's ignition switch or start switch.

[0027] For example, when the connection detection unit 111 detects a connection between the IVI device 50 and the vehicle, the memory processing unit 112 acquires the first user operation on the application when the IVI device 50 is first started up as first user operation information from the touch panel 241, and stores the acquired first user operation information in the memory 22 as past first user operation information. Specifically, the memory processing unit 112 acquires, for example, user operations such as when the user turns on the vehicle's ignition switch or start switch and the touch panel 241 presses an icon for the navigation app 121 or video app 122 when the IVI device 50 is first started, as first user operation information. The memory processing unit 112 stores the first user operation information indicating the pressing of an icon for the navigation app 121 or video app 122 at the time of first startup in the memory 22 as past first user operation information. The memory processing unit 112 stores all initial user operations on the application during the initial startup of the IVI device 50 as past first user operation information in the memory 22, without identifying the user. However, it is not limited to this. For example, if user identification information is assigned to each vehicle key, the memory processing unit 112 may store the initial user operations on the application during the initial startup of the IVI device 50 as past first user operation information in the memory 22 for each user assigned to the key that unlocked the vehicle.

[0028] The determination processing unit 113, for example, obtains first user operation information from the touch panel 241 and second user operation information, which is a user operation performed a predetermined time (e.g., 1 minute or 5 minutes) after the initial startup. If the operation predicted from the past first user operation information in memory 22 does not match the initial user operation, and the second user operation information indicates an operation in an area other than the operable display area of ​​the display 24, the unit determines that the user is a child. A detailed explanation of the operation of the determination processing unit 113 will be given later.

[0029] In addition to detecting the connection between the IVI device 50 and the vehicle by the connection detection unit 111, the function restriction unit 114 controls the operation of the application based on a second control, which is different from the first control, which is the control state of the IVI device 50 under normal circumstances, when the touch panel 241 accepts user operation and the determination processing unit 113 determines that the user is a child, or when it detects that the vehicle is in motion. Specifically, in the second control, which detects that the vehicle is in motion, some of the user operations that can be accepted in the first control are restricted, as well as some of the applications that can be run in the first control, in order to satisfy the driver distraction requirement. For example, operations such as text input, which is complicated and requires attention to the display 24, are examples of user operations that are restricted in the second control, while video playback applications that require attention to the display 24 are examples of applications that are restricted in the second control. Furthermore, in the second control step when the determination processing unit 113 determines that the user is a child, as described later, multiple applications executed on the IVI device 50 are run in a child-friendly mode with restrictions on functions that can be operated by adults. In this embodiment, when the connection detection unit 111 detects a connection with a vehicle, the system controls the user's operations to partially restrict them in order to satisfy the driver distraction requirement. However, by launching only applications that take driver distraction into consideration in advance, it is possible to omit the configuration of the connection detection unit 111 and other components.

[0030] [Example of display on Display 24] Next, with reference to Figure 3, an example of the display 24 will be described. Note that from Figure 3 onward, the display will be described using a horizontal display as an example, but the present invention may also be realized with a vertical display. Figure 3(A) shows an example of the home screen when the IVI device 50 is first started up. In normal operation, multiple icons are displayed on the home screen of the display 24, and when an icon is selected via the touch panel 241, the corresponding application is launched and displayed on the display 24. In Figure 3(A), for example, an application to be launched on the drive mode application 1 is pre-configured. This configuration may also be done, for example, by selecting any application from the applications stored in the content unit 12. Of course, it is also possible to select any application from the native applications instead of using applications stored in the content unit 12. In this case, multiple applications can be set as applications to be launched on the drive mode application 1. Multiple applications include one basic base application and multiple auxiliary sub-applications. In this embodiment, it is assumed that the base applications are set to navigation application 121, video application 122, radio application 123, smartphone connection application 124, assistant application 125, and SNS application 126. In addition, although not shown in the figures, other applications such as music application, phone application, destination search application, surrounding area guide application and other navigation assistance applications, traffic information application, disaster information application, vehicle information application, and dealer information application may also be set.

[0031] When the drive mode application 1 is launched, the display 24 shows the basic display of the drive mode application 1. The basic display may be, for example, the home screen shown in Figure 3(A) on the display 24. Alternatively, the basic display may be based on the application set as the base application, for example, the display screen of the car navigation system based on the navigation application 121 shown in Figure 3(B) on the display 24. In the car navigation system, an icon indicating the vehicle's position is displayed in the center, and the map scrolls as the vehicle moves. Furthermore, when the car navigation system display screen shown in Figure 3(B) is displayed on the display 24, if, for example, the user presses the home button (not shown), the display 24 may display the home screen shown in Figure 3(A).

[0032] [Determination processing by the determination processing unit 113] The determination processing unit 113 calculates the usage frequency (e.g., number of times launched) for each application on the home screen shown in Figure 3(A) when the IVI device 50 is first started, based on past first user operation information stored in memory 22. This includes launching the navigation application 121 and using the voice assistant service of the assistant application 125. The determination processing unit 113 predicts the application with the highest usage frequency, or the applications with the highest usage frequency, as a user operation predicted from past first user operation information. If the predicted user operation matches the actual first user operation, the determination processing unit 113 determines that the user is an "adult". On the other hand, if the user is a "child," they may imitate adults and, as shown in Figure 4, press areas other than buttons or swipe (traverse) instead of tapping the buttons on the home screen shown in Figure 3(A) when the IVI device 50 is first started. It is thought that such actions may continue intermittently across the entire display 24, including areas other than the operable display area, for a predetermined time (for example, 1 minute or 5 minutes) or longer from the first startup. Therefore, the determination processing unit 113 acquires the current first user operation information from the touch panel 241 and the second user operation information, which is a user operation performed a predetermined time after the initial startup. The determination processing unit 113 determines that the user is a "child" if the operation predicted from the past first user operation information in the memory 22 does not match the initial user operation, and the second user operation information indicates an operation in an area other than the operable display area of ​​the display 24. By doing so, the IVI device 50 can quickly determine whether the user operating the touch panel is an adult or a child, using a simple configuration.

[0033] [Function restriction processing by the function restriction unit 114] In the home screen shown in Figure 3(A), if the user operates via the touch panel 241 and the determination processing unit 113 determines that the user is a "child", the function restriction unit 114 executes a child-friendly mode that restricts functions that adults can operate, and limits the applications displayed on the display 24 that children can run. Figure 5 shows an example of how the home screen looks in child mode. As shown in Figure 5, in child mode, the function restriction unit 114 grays out the buttons for certain applications, such as the navigation app 121, the smartphone connection app 124, the assistant app 125, and the SNS app 126, thereby restricting their use. Specifically, the function restriction unit 114 prevents navigation operation when the display screen 24 is showing the navigation screen, and prevents sending messages when it is showing the SNS screen. The function restriction unit 114 may also prevent making phone calls when the display screen 24 is showing the phone screen.

[0034] Furthermore, the function restriction unit 114 may display a button on the display 24 to deactivate the child mode while the child mode shown in Figure 5 is running, allowing an adult user to run applications such as the navigation application 121. By doing so, an adult user can run the desired application at the desired time by pressing the deactivation button. Alternatively, the function restriction unit 114 may, after executing the child mode, deactivate the child mode and display the normal home screen shown in Figure 3(A) on the display 24 if the touch panel 241 has not accepted input for a predetermined period of time, such as 5 minutes or more. In this way, the child mode is deactivated when the child gets tired of operating the display 24, allowing the adult user to run the desired application without any special operation.

[0035] [Control processing of IVI device 50] Next, the operation of this embodiment will be described with reference to the flowchart shown in Figure 6. Figure 6 is a flowchart showing the control process of the IVI device 50. The flow shown here is executed each time the vehicle's ignition switch or start switch is turned on and the IVI device 50 is started.

[0036] In step S10, the connection detection unit 111 detects the connection between the IVI device 50 and the vehicle.

[0037] In step S11, when the memory processing unit 112 detects that the IVI device 50 is connected to the vehicle in step S10, it acquires the first user operation performed by the touch panel 241 on the application when the IVI device 50 is first started as first user operation information. The memory processing unit 112 stores the acquired first user operation information in the memory 22 as past first user operation information.

[0038] In step S12, the determination processing unit 113 acquires the current first user operation information from the touch panel 241 and the second user operation information, which is a user operation performed a predetermined time after the initial startup.

[0039] In step S13, the determination processing unit 113 determines whether the user is a child or not by determining whether the operation predicted from the past first user operation information stored in memory 22 in step S12 does not match the initial user operation, and whether the second user operation information indicates an operation in an area other than the operable display area of ​​the display 24. If the user is determined to be a child, the process proceeds to step S14. On the other hand, if the user is determined to be an adult, the process ends.

[0040] In step S14, if the function restriction unit 114 determines in step S13 that the user is a child, it executes a child mode that restricts functions that can be operated by adults, and restricts the applications that can be run by children from among the applications displayed on the display 24.

[0041] In step S15, the function restriction unit 114 determines whether to deactivate child mode by determining whether the child mode deactivation button has been pressed or whether the touch panel 241 has not accepted input for a predetermined period of time or longer. If it determines to deactivate child mode, the function restriction unit 114 displays the normal home screen on the display 24. On the other hand, if it determines not to deactivate child mode, the function restriction unit 114 maintains child mode and waits until child mode is deactivated.

[0042] As described above, the IVI device 50 according to one embodiment can quickly determine whether the user operating the touch panel is an adult or a child with a simple configuration. By doing so, the IVI device 50 can prevent accidental operation while the vehicle is in motion, even if a child observes an adult operating an information terminal and tries to imitate them.

[0043] Each of the devices can be implemented using hardware, software, or a combination thereof. Furthermore, the navigation method performed by the cooperation of each device included in the above-described navigation system can also be implemented using hardware, software, or a combination thereof. Here, implementation by software means implementation by a computer loading and executing a program.

[0044] Programs can be stored and supplied to a computer using various types of non-transitory computer-readable medium. Non-transitory computer-readable medium includes various types of tangible storage medium. Examples of non-transitory computer-readable medium include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memory (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)). Programs may also be supplied to a computer using various types of transient computer-readable medium. Examples of transient computer-readable medium include electrical signals, optical signals, and electromagnetic waves. Transitory computer-readable medium can be supplied to a computer via wired communication channels such as electric wires and optical fibers, or via wireless communication channels.

[0045] While the embodiments described above are preferred embodiments of the present invention, the scope of the present invention is not limited to these embodiments, and various modifications can be made to implement the invention without departing from the spirit of the invention. In the embodiments described above, an IVI device 50 is described as an information processing terminal, but the present invention is not limited to this. The present invention is applicable to a variety of devices, such as smartphones, tablet terminals, PNDs, PDAs (Personal Digital Assistants), game consoles, in-car navigation systems, and personal computers.

[0046] Furthermore, it may be primarily implemented in hardware using components such as application-specific integrated circuits ("ASICs") or field-programmable gate arrays ("FPGAs"). It may also be implemented using a combination of both hardware and software. [Explanation of symbols]

[0047] 1. Drive Mode Application 11 Management Department 111 Connection detection unit 112 Memory Processing Unit 113 Determination Processing Unit 114 Function Limitation Section 12 Content Department 121 Navigation Apps 122 Video Apps 123 Radio App 124 Smartphone connection apps 125 Assistant Apps 126 SNS apps 2 Hardware 21 CPU 22 memory 23 Display memory 24 displays 241 Touch Panel 25 Communications Department 3. Software 31 Device Drivers 32 OS / Middleware 33 Applications 331 Native Applications

Claims

1. A user estimation program for driving a user-operated information processing terminal comprising a touch panel input unit, a display unit, a processing unit, and a storage unit, The aforementioned processing unit, The input unit acquires the first user operation on the application when the information processing terminal is first started as first user operation information and stores it in the storage unit as past first user operation information. Furthermore, the user estimation program is characterized in that the input unit acquires the current first user operation information and second user operation information which is a user operation performed a predetermined time after the initial startup, and if the operation predicted from the past first user operation information in the storage unit does not match the initial user operation, and the second user operation information indicates an operation in an area other than the operable display area of ​​the display unit, the user is determined to be a child.

2. The aforementioned information processing terminal is mounted on the vehicle. The user estimation program according to claim 1, characterized in that the first user operation information is an operation performed on the application after the vehicle's start switch is turned on and the information processing terminal is started.

3. The user estimation program according to claim 1 or 2, characterized in that, when the processing unit determines that the user is a child, it causes the multiple applications to be executed on the information processing terminal to be executed in a child-friendly mode with restrictions on functions that can be operated by adults.

Images