Terminal device, information processing method, and program for terminal device

Abstract

To provide a terminal device or the like that can switch its operating mode as a terminal device in relation to an in-vehicle device to which the terminal device is attached.SOLUTION: In a terminal device T that is attached to an attached device M and communicates with the attached device M, on the basis of the attachment state to the attached device M and the communication status with the attached device M, switching means 1 for switching the operation mode of the terminal device T is provided.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present application relates to the technical fields of a terminal device, an information processing method, and a program for the terminal device. More specifically, the present application relates to the technical fields of a terminal device that can be attached to a wearable device, information processing executed in the terminal device, and a program for the terminal device. [Background technology]

[0002] In recent years, by linking a mobile terminal such as a smartphone or a tablet PC (Personal Computer) with an in-vehicle device installed in a vehicle, for example, it has become possible to configure an in-vehicle AV (Audio Visual) system at low cost by utilizing the display function, navigation function, content playback function, etc. of the mobile terminal. An example of a prior art document disclosing such conventional technology is Patent Document 1 listed below.

[0003] Patent Document 1 discloses an in-vehicle system including an in-vehicle device fixed to an interior portion of a vehicle, etc., and a portable terminal detachably attached to the in-vehicle device, which displays an image while transmitting an audio signal to the in-vehicle device via short-range wireless communication with the in-vehicle device.The in-vehicle system disclosed in Patent Document 1 is configured to acquire a delay state in transmitting and receiving the audio signal via short-range wireless communication, and perform processing to suppress the time lag between the displayed image and the output audio. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-58894 Summary of the Invention [Problem to be solved by the invention]

[0005] On the other hand, in addition to being used inside a vehicle, a mobile device may also be used outside the vehicle, for example, while the user is walking. Even when used inside a vehicle, it is assumed that the mobile device may be used not only by the driver but also by passengers other than the driver. Therefore, for a mobile device that is expected to be used in such a variety of ways, it is preferable that its operation and functions can be changed to suit each way of use.

[0006] However, the mobile terminal disclosed in Patent Document 1 does not mention any configuration that meets the above-mentioned demands, and therefore the technology disclosed in Patent Document 1 cannot meet the demands.

[0007] Therefore, the present application has been made in consideration of the above-mentioned demand, and one example of its objective is to provide a terminal device that is capable of switching its operating mode as a terminal device in relation to the vehicle-mounted device to which the terminal device is attached, information processing executed in the terminal device, and a program for the terminal device. [Means for solving the problem]

[0008] In order to solve the above problem, the invention described in claim 1 provides a terminal device that is attached to a device to be attached and communicates with the device to be attached, and is provided with a switching means that switches the operating mode of the terminal device based on the attachment state to the device to be attached and the communication state with the device to be attached.

[0009] In order to solve the above problem, the invention described in claim 7 is an information processing method executed in a terminal device that is attached to a device to be attached and communicates with the device to be attached, and that is equipped with a switching means, and includes a switching step in which the operating mode of the terminal device is switched by the switching means based on the attachment state to the device to be attached and the communication state with the device to be attached.

[0010] In order to solve the above problem, the invention described in claim 8 functions as a switching means for switching the operating mode of the terminal device based on the attachment state to the attached device and the communication state with the attached device, the computer provided in the terminal device being attached to the attached device and communicating with the attached device. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 2 is a block diagram showing a schematic configuration of a terminal device according to the embodiment. [Figure 2] 2 is a block diagram showing the schematic configuration of an in-vehicle device and a terminal device according to the embodiment; FIG. [Figure 3] 10 is a flowchart illustrating information processing in the terminal device of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Next, an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a block diagram showing a schematic configuration of a terminal device according to the embodiment.

[0013] As shown in FIG. 1, the terminal device T of the embodiment is a terminal device T that is attached to a wearable device M and that communicates with the wearable device M.

[0014] The terminal device T includes a switching means 1 that switches the operation mode of the terminal device T based on the state of attachment to the attachment device M and the state of communication with the attachment device M.

[0015] As described above, according to the operation of the terminal device T of the embodiment, the operating mode is switched based on the attachment state to the wearable device M and the communication state between the wearable device M, so that the operating mode as the terminal device T can be automatically switched in relation to the wearable device M. [Example]

[0016] Next, specific examples corresponding to the above-described embodiments will be described with reference to Figures 2 and 3. The examples described below are examples in which the present application is applied to an in-vehicle system including, for example, an in-vehicle device mounted in a vehicle and a terminal device that can be attached to the in-vehicle device and can also be used independently, in which the terminal device and the in-vehicle device cooperate to perform various processes.

[0017] Fig. 2 is a block diagram showing the general configuration of the in-vehicle device and the terminal device of the embodiment, and Fig. 3 is a flowchart showing information processing in the terminal device of the embodiment. In Fig. 2, the same component numbers as those of the terminal device T and the mounted device M are used for the components of the embodiment corresponding to the components of the terminal device T and the mounted device M of the embodiment shown in Fig. 1.

[0018] 2, the in-vehicle system SS of the embodiment includes an in-vehicle device M provided on, for example, the center console or dashboard of the vehicle, and a portable terminal device T that can be attached to the in-vehicle device M and can also be used independently. In this case, the terminal device T may be realized as, for example, a tablet-type terminal device or a so-called smartphone.

[0019] 2, the vehicle-mounted device M of the embodiment is connected to a vehicle speaker 16, a camera 14, and an in-vehicle network 15, which are installed in, for example, a vehicle in which the vehicle-mounted system SS of the embodiment is mounted, and is composed of a mounting unit BS used to mount the terminal device T, a wireless communication unit 10, a control unit 11 including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and an amplifier unit 12 connected to the vehicle speaker 16. In this case, the camera 14 corresponds to an example of the "imaging means" of the present application.

[0020] In this case, camera 14 is a camera that captures images of the front, rear, interior, etc. of the vehicle to be visually recognized by the driver of the vehicle as driving assistance information, and under the control of control unit 11, captures images of the capture range, for example cyclically, as necessary, and outputs image data as the capture results to control unit 11. Control unit 11 also acquires information indicating the vehicle state, such as speed data indicating the speed of the vehicle and reverse gear data indicating that the vehicle is in reverse gear, from in-vehicle network 15. As a result, when reverse gear data is acquired, for example, control unit 11 controls camera 14 so that the image data includes the result of capturing an image of the rear of the vehicle. Meanwhile, mounting unit BS has a connection unit (not shown) for establishing a wired electrical connection with terminal device T, and terminal device T is mounted on mounting unit BS.

[0021] In the above configuration, when the terminal device T is not attached, the wireless communication unit 10, under the control of the control unit 11, controls the reception from the terminal device T of sound signals indicating the sound of content played on the terminal device T and audio signals indicating audio for guidance processing, which will be described later, executed on the terminal device T. Furthermore, under the control of the control unit 11, the amplifier unit 12 outputs the sound signals and audio signals to the vehicle speaker SP to emit the sounds. In these operations, the control unit 11 controls the reception by the wireless communication unit 10 of the sound signals and audio signals from the terminal device T, and also controls the manner in which the sounds are emitted from the vehicle speaker SP.

[0022] In addition, when the terminal device T is mounted, the control unit 11 outputs the image data acquired from the camera 14 to the terminal device T via the connection unit of the mounting unit BS, and when the vehicle state acquired from the in-vehicle network 15 satisfies a preset condition for displaying the image data as an interrupt image on the display 4 of the terminal device T, generates image interrupt request data requesting the terminal device T to interrupt the display, and outputs the image interrupt request data to the terminal device T via the connection unit. Furthermore, when the speed of the vehicle indicated by the speed data acquired from the in-vehicle network 15 exceeds a preset driving restriction threshold, the control unit 11 generates driving restriction instruction data indicating that the speed has exceeded the driving restriction threshold, and outputs the data to the terminal device T via the connection unit. At this time, the threshold speed corresponding to the driving restriction threshold is a preset speed at which it is necessary to restrict the display of, for example, a video or the like that may attract the driver's attention on, for example, a display that the driver sees while driving at a speed above the threshold speed, from the perspective of safe driving. In addition, when the terminal device T is attached, the control unit 11 controls the amplifier unit 12 and the like based on various data exchanged with the terminal device T via the connection unit. Note that even when the terminal device T is connected, the image data, the image interrupt request data, the driving regulation instruction data, and the various data may be exchanged with the terminal device T via the wireless communication unit 10.

[0023] 2, the terminal device T of the embodiment is a terminal device T that can be used by being attached to the vehicle-mounted device M as described above, but can also be used independently, and is composed of an attachment unit 7 used for attachment to the vehicle-mounted device M, a control unit 1 including a CPU, ROM, RAM, etc., a wireless communication unit 2, a recording unit 3 including a recording medium such as an HDD (Hard Disc Drive) or an SSD (Solid State Drive), a display 4 including a liquid crystal display, etc., an operation unit 5 including a touch panel or operation buttons, etc., and a speaker 6. In this case, the control unit 1 corresponds to an example of the switching means 1 of the embodiment, and the display 4 corresponds to an example of the "display means" of the present application.

[0024] In the above configuration, the mounting unit 7 is provided with a detection unit 7A that, for example, physically detects that the terminal device T has been mounted on the mounting unit BS of the in-vehicle device M. When the terminal device T is mounted on the in-vehicle device M, the detection unit 7A outputs a mounting detection signal indicating the mounting to the control unit 1. This allows the control unit 1 to recognize that the terminal device T has been mounted on the in-vehicle device M. Note that the mounting unit 7 is provided with a connection unit (not shown) for establishing a wired electrical connection with the in-vehicle device M, and this connection unit may also serve as the detection unit 7A.

[0025] On the other hand, the recording unit 3 has image data and sound data for playing the content recorded in advance, for example, in a non-volatile manner. The recording unit 3 outputs the image data and the like to the control unit 1 as needed under the control of the control unit 1. On the other hand, when the terminal device T is not attached to the vehicle-mounted device M, the wireless communication unit 2 controls the transmission of the sound signal and the audio signal to the vehicle-mounted device M under the control of the control unit 1. At this time, the control unit 1 uses the wireless communication unit 2 to detect the communication status between the wireless communication unit 10 of the vehicle-mounted device M and the wireless communication unit 2 of the terminal device T (i.e., whether wireless communication is established between the wireless communication unit 10 and the wireless communication unit 2). Furthermore, the operation unit 5 generates operation signals corresponding to various operations performed on the operation unit 5 and outputs the operation signals to the control unit 1.

[0026] In these operations, the control unit 1 executes information processing of the embodiment, including the guidance processing, based on the operation signal corresponding to the operation for the guidance processing of the embodiment performed on the operation unit 5. The guidance processing of the embodiment will be described in detail later. Furthermore, the control unit 1 controls the transmission of the sound signal and the audio signal to the in-vehicle device M via the wireless communication unit 2, and, when the terminal device T is attached to the in-vehicle device M, controls the reception of the image interrupt request data and the driving restriction instruction data from the in-vehicle device M via the respective connection units (i.e., the connection unit provided in the mounting unit BS of the in-vehicle device M and the connection unit provided in the mounting unit 7). Furthermore, the control unit 1 exchanges various data (i.e., the exchange of the image data, the image interrupt request data, the driving restriction instruction data, etc.) with the in-vehicle device M via the wireless communication unit 2 or the connection unit of the mounting unit 7, and, when the terminal device T is not attached to the in-vehicle device M, controls the image display and sound emission unique to the terminal device T.

[0027] Next, the information processing (including the above-mentioned guidance processing) of the embodiment, which is mainly executed by the control unit 1 of the terminal device T, will be described in more detail with reference to FIGS.

[0028] The information processing of the embodiment is executed, for example, as an interrupt process in the terminal device T after the power of the in-vehicle device M and the terminal device T is turned on. That is, as shown in FIG. 3 , when the information processing of the embodiment is started, the control unit 1 first monitors whether wireless communication between the wireless communication unit 2 and the wireless communication unit 10 is established based on the communication status detected by the wireless communication unit 2 (step S1). If the wireless communication is not established in the monitoring of step S1 (step S1: NO), the control unit 1 proceeds to step S6, which will be described later. On the other hand, if the wireless communication is established in the monitoring of step S1 (step S1: YES), the control unit 1 next determines whether the attachment detection signal is output from the detection unit 7A (step S2). If the attachment detection signal is not output in the determination of step S2, i.e., if the terminal device T is not attached to the in-vehicle device M (step S2: NO), the control unit 1 controls the components of the terminal device T and the in-vehicle device M to execute the guidance process in the "in-vehicle mode," which will be described later (step S3). The guidance process in the in-car mode will be described in detail later using Table 1.

[0029] The in-vehicle mode and the driver mode and terminal device mode described later each correspond to an example of an operation mode of the embodiment.

[0030] In step S3, the control unit 1, which is executing the guidance process in the in-vehicle mode, monitors whether the guidance process should be terminated, for example, because the vehicle equipped with the in-vehicle system SS has arrived at the destination of the guidance process (step S4). If the guidance process is to be terminated in the monitoring of step S4 (step S4: YES), the control unit 1 proceeds to other processing as the terminal device T. On the other hand, if the guidance process of the embodiment is to be continued in the monitoring of step S4 (step S4: NO), the control unit 1 returns to step S1 and continues the series of processing described above.

[0031] Next, the guidance process in the in-car mode of the embodiment will be described more specifically with reference to Table 1 below. [Table 1] As described above, the guidance process in the in-vehicle mode in the embodiment is executed when wireless communication is established between the wireless communication unit 2 of the terminal device T and the wireless communication unit 10 of the in-vehicle device M (see step S1 in FIG. 3: YES) and the terminal device T is not attached to the in-vehicle device M (see step S2 in FIG. 3: NO). In this case, it is assumed that the terminal device T is being used by a passenger in the rear seat or the front passenger seat of a vehicle equipped with the in-vehicle system SS, and wireless communication is established between the terminal device T and the in-vehicle device M. In the guidance process in this case, the control unit 1 of the terminal device T searches for a travel route along which the vehicle equipped with the in-vehicle system SS will travel as a vehicle route, as shown in Table 1. In this case, the control unit 1 searches for the vehicle route based on, for example, destination data indicating a destination for travel using the vehicle, separately input using the operation unit 5 of the terminal device T, and current position data indicating the current position of the vehicle, obtained by receiving navigation radio waves from a navigation satellite of a Global Positioning System (GPS), not shown, for example. The control unit 1 then transmits an audio signal corresponding to the guidance voice required for the guidance process along the vehicle route to the in-vehicle device M, for example, via a connection provided in each of the mounting unit 7 and the mounting unit BS, and emits the guidance voice corresponding to the audio signal through the vehicle speaker SP connected to the in-vehicle device M. Furthermore, since it is assumed that the terminal device T performing the guidance process in the in-vehicle mode is being used by the passenger (i.e., the passenger is viewing the image displayed on the display 4), there is no need to present the passenger with images of the front, rear, interior, etc. of the vehicle, which are driving assistance information, and therefore the control unit 1 prohibits image interruption to the display on the display 4 based on the image interruption request data, which is performed by acquiring the image data corresponding to the image capture results by the camera 14 from the in-vehicle device M. Furthermore, the control unit 1 also prohibits driving restrictions based on the driving restriction instruction data from the in-vehicle device M (i.e., restrictions on the display of videos, etc. on the display 1 at speeds above the threshold speed from the perspective of safe driving).

[0032] On the other hand, if the determination in step S2 above indicates that the mounting detection signal has been output, i.e., if the terminal device T is mounted on the vehicle-mounted device M (step S2: YES), the control unit 1 controls the components of the terminal device T and the vehicle-mounted device M to execute the guidance process in the "driver mode" described below (step S5). This guidance process in the driver mode will be described in detail later using Table 1. Thereafter, the control unit 1 proceeds to monitoring in step S4 above.

[0033] Next, the guidance process in the driver mode of the embodiment will be described in more detail with reference to Table 1. As described above, the guidance process in the driver mode of the embodiment is executed when wireless communication is established between the wireless communication unit 2 of the terminal device T and the wireless communication unit 10 of the in-vehicle device M (see step S1 in FIG. 3: YES) and the terminal device T is attached to the in-vehicle device M (see step S2 in FIG. 3: YES). In this case, it is assumed that the driver is using the terminal device T to receive travel guidance. In the guidance process in this case, the control unit 1 of the terminal device T searches for the vehicle route as shown in Table 1. Then, the control unit 1 emits a guidance voice required for the guidance process along the vehicle route via the vehicle speaker SP, similar to the guidance process in the in-vehicle mode, and displays an image, such as a map image, required for the guidance process on the display 4. Furthermore, the control unit 1 executes both the image interruption as needed based on the image interruption request data from the in-vehicle device M and the driving restriction as needed based on the driving restriction instruction data from the in-vehicle device M. A typical example of image interruption is the interruption of an image of the rear of the vehicle onto the display 4 when the vehicle is in reverse gear.

[0034] On the other hand, if the wireless communication is not established in the monitoring of step S1 (step S1: NO), the control unit 1 next determines whether the attachment detection signal is output from the detection unit 7A, as in step S2 (step S6). If the attachment detection signal is not output in the determination of step S6, and therefore it is determined that the terminal device T is not attached to the vehicle-mounted device M (step S6: NO), the control unit 1 displays, for example, a setting screen on the display 4 to prompt the user of the terminal device T to set up wireless communication between the wireless communication unit 10 of the vehicle-mounted device M and the wireless communication unit 2 of the terminal device T (step S8). Thereafter, the control unit 1 returns to step S1 and continues the series of processes described above.

[0035] On the other hand, if it is determined in step S6 that the mounting detection signal has been output and therefore that the terminal device T is mounted on the vehicle-mounted device M (step S6: YES), the control unit 1 controls each component of the terminal device T to execute the guidance process in the "terminal device mode" described below (step S7). The guidance process in this terminal device mode will be described in detail later using Table 1. Thereafter, the control unit 1 proceeds to monitoring in step S4 described above.

[0036] Next, the guidance process in the terminal device mode will be described more specifically with reference to Table 1. As described above, the guidance process in the terminal device mode in this embodiment is executed when wireless communication is not established between the wireless communication unit 2 of the terminal device T and the wireless communication unit 10 of the in-vehicle device M (see step S1: NO in FIG. 3 ) and the terminal device T is not attached to the in-vehicle device M (see step S6: NO in FIG. 3 ). In this case, it is assumed that the terminal device T is being used while being taken out of the vehicle (i.e., carried). In the guidance process in this case, the control unit 1 of the terminal device T searches for a walking route, for example, a travel route that a person carrying the terminal device T would take on foot (without using a vehicle equipped with the in-vehicle system SS), as shown in Table 1. In this case, the control unit 1 searches for the walking route based on, for example, destination data indicating a destination for walking, input using the operation unit 5 of the terminal device T, and current location data indicating the current location of the terminal device T. The control unit 1 then emits the guidance voice necessary for the guidance process along the walking route through the speaker 6 of the terminal device T. Furthermore, since it is assumed that the terminal device T performing the guidance process in the terminal device mode is being used outside the vehicle as described above, the control unit 1 displays the image necessary for the guidance process on the display 4. Furthermore, the control unit 1 does not perform the image interruption or the driving restriction.

[0037] As described above, according to the information processing performed mainly by the terminal device T of the in-vehicle system SS of the embodiment, the operating mode (in-vehicle mode, etc. (see Table 1)) is switched based on the mounting state of the in-vehicle system M and the wireless communication state with the in-vehicle system M, so that the operating mode as the terminal device T can be automatically switched in relation to the in-vehicle system M.

[0038] Furthermore, when the vehicle-mounted unit M is provided in a vehicle, and the terminal device T is not attached to the vehicle-mounted unit M (see step S2: NO in Figure 3) and wireless communication between them is possible (see step S1: YES in Figure 3), the operating mode of the terminal device T is switched to in-vehicle mode (see step S3 in Figure 3), and when the terminal device T is attached to the vehicle-mounted unit M (step S2: YES in Figure 3) and said communication is possible (see step S1: YES in Figure 3), said operating mode is switched to driver mode (see step S5 in Figure 3), so that the operating mode of the terminal device T can be appropriately switched in relation to the vehicle-mounted unit M provided in the vehicle.

[0039] Furthermore, since the in-vehicle mode is a mode that includes a search process for a vehicle route and a sound output control process from the vehicle speaker SP for travel guidance, and the driver mode is a mode that includes the search process, sound output control process, and image output control process on the display 4 for travel guidance, vehicle travel guidance can be performed appropriately depending on the installation state of the terminal device T to the in-vehicle unit M and the mutual communication state.

[0040] Furthermore, the driver mode includes a display control process on the display 4 for images captured by the camera 14 mounted on the vehicle, which can contribute to the safe movement of the vehicle in addition to guiding the vehicle's movement.

[0041] Furthermore, when the terminal device T is not attached to the vehicle-mounted device M (see step S6: NO in Figure 3) and communication between them is not possible (see step S1: NO in Figure 3), the operating mode of the terminal device T is switched to terminal device mode (see step S7 in Figure 3), so that the operating mode of the terminal device T can be automatically adapted to use outside the vehicle.

[0042] Furthermore, since the terminal device mode includes a process for searching for walking routes for a person carrying and using the terminal device T, a process for controlling the output of sound from the speaker 6 for travel guidance, and a process for controlling the output of images on the display 4, travel guidance for a person carrying and using the terminal device T can be appropriately performed depending on the mounting state of the terminal device T on the vehicle-mounted device M and the state of communication between them.

[0043] In addition, a program corresponding to the flowchart shown in Figure 3 can be recorded on a recording medium such as an optical disk or a hard disk, or obtained via a network such as the Internet, and then read out and executed by a microcomputer or the like, thereby causing the microcomputer or the like to function as the control unit 1 of the embodiment. [Explanation of symbols]

[0044] 1 Switching means (control unit 1) 4. Display 6 speakers M Mounted device (on-vehicle device) T terminal device SS In-vehicle system

Claims

[Claim 1] A terminal device that is attached to a device to be attached and that communicates with the device to be attached, A terminal device comprising a switching means for switching an operation mode of the terminal device based on a state of attachment to the attached device and a state of communication with the attached device.

Images