MOBILE BODY, INTERACTION PROVIDING SYSTEM, INTERACTION PROVIDING METHOD, AND INTERACTION PROVIDING PROGRAM

Abstract

To provide a mobile body that can recognize a state of an occupant of the mobile body with a simple configuration, and to provide a system for providing interaction, a method for providing interaction and a program for providing interaction.SOLUTION: A mobile body 1 includes: a steering part 2 displacing in accordance with driver's operation; an operation terminal holding part 50 for holding a left controller 170a or right controller 170b including a posture change detection part for detecting a posture change so as to be capable of being attached to and detached from the steering part 2; and a terminal device holding part 60 for holding a terminal device 110 in a predetermined part of the mobile body 1 so as to be freely detachable.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a mobile object, an interaction providing system, an interaction providing method, and an interaction providing program. [Background technology]

[0002] Conventionally, a system has been proposed that provides interaction to entertain the occupants by detecting information related to the vehicle occupants and information outside the vehicle, and outputting sound and virtual images in sync based on this information (see, for example, Patent Document 1). The above system obtains information about the occupants using in-vehicle cameras, in-vehicle microphones, seating sensors, etc., and La, Na Information about the outside of the vehicle is acquired by a navigation device, etc. Then, the above system provides the occupant with interaction that outputs virtual images and sounds in sync with each other according to the occupant's situation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-75720 A Summary of the Invention [Problem to be solved by the invention]

[0004] In order to provide interaction according to the situation of a passenger in a moving object such as a vehicle, as in the above-mentioned conventional system, it is desirable to recognize the situation of the passenger in the moving object using a simple configuration. The present invention has been made in consideration of the above background, and aims to provide a mobile body, an interaction providing system, an interaction providing method, and an interaction providing program that can recognize the status of a passenger in the mobile body with a simple configuration. [Means for solving the problem]

[0005] As a first aspect for achieving the above object, a steering unit that is displaced in response to an operation by a driver, It is the main body of the game console Terminal device controller and a posture change detection unit for detecting a posture change. An example of a mobile body includes an operation terminal holding section that detachably holds an operation terminal that is detachably attached to the terminal device, and the operation terminal has an operation terminal connector, and when the operation terminal is attached to the terminal device, the operation terminal connector is connected to a terminal device connector that the terminal device has, and the operation terminal holding section has an operation terminal holding section connector, and when the operation terminal is held in the operation terminal holding section, the operation terminal connector is connected to the operation terminal holding section connector.

[0006] In the above mobile object, a display is provided. The above The mobile object may be configured to include a terminal device holder for removably holding the terminal device at a predetermined location on the mobile object.

[0007] In the above-mentioned moving body, the operation terminal holding unit 、1 Alternatively, a plurality of the operation terminals may be configured to be detachably held on the steering section.

[0008] As a second aspect for achieving the above object, a steering unit that is displaced in response to an operation by a driver, It is the main body of the game console Terminal device controller and a posture change detection unit for detecting a posture change. An operation terminal that is detachably attached to the terminal device of,an operation terminal holding unit that is detachably held on the steering unit; and an operation terminal connector that is connected to a terminal device connector of the terminal device when the operation terminal is attached to the terminal device, and the operation terminal holding unit has an operation terminal holding unit connector that is connected to the operation terminal holding unit connector when the operation terminal is held on the operation terminal holding unit, and an operation terminal holding recognition unit that recognizes that the operation terminal is held in the operation terminal holding unit; and an interaction control unit that, when the operation terminal holding recognition unit recognizes that the operation terminal is held in the operation terminal holding unit, executes interaction control to determine information to be output from an output device used in the mobile body based on a detection status of a posture change of the operation terminal by the posture change detection unit.

[0009] In the above interaction providing system, the operation terminal has a display and a speaker. The above The controller may be removably attached to a terminal device, the mobile body having a terminal device holding unit that removably holds the terminal device at a predetermined location on the mobile body, and a terminal device holding recognition unit that recognizes that the terminal device is held in the terminal device holding unit, and the interaction control unit may be configured to execute the interaction control using at least one of the display and the speaker as the output device when the operation terminal holding recognition unit recognizes that the operation terminal is held in the operation terminal holding unit and the terminal device holding recognition unit recognizes that the terminal device is held in the terminal device holding unit.

[0010] In the above interaction providing system, the operating terminal holding recognition unit, the terminal device holding recognition unit, and the interaction control unit may be configured to be provided in the terminal device.

[0011] In the above interaction providing system ,before The configuration may also include a content information output unit that outputs, when the operation terminal holding recognition unit recognizes that the operation terminal is held in the operation terminal holding unit, information about content that becomes available by installing a specified application on the terminal device from the output device.

[0012] In the above interaction providing system, the operation terminal holding unit may detachably hold one or more of the operation terminals, the operation terminal holding recognition unit may recognize the number of the operation terminals held in the operation terminal holding unit, and the interaction control unit may be configured to change the processing content by the interaction control depending on the number of the operation terminals recognized by the operation terminal holding recognition unit.

[0013] The above-mentioned interaction providing system may further include a movement state recognition unit that recognizes the movement state of the moving body, and the interaction control unit may be configured to determine information to be output from the output device based on the posture change of the operation terminal detected by the posture change detection unit and the movement state of the moving body recognized by the movement state recognition unit in the interaction control.

[0014] The first step to achieve the above objectives 3 states A steering unit that is displaced in response to an operation by a driver, It is the main body of the game console Terminal device controller and a posture change detection unit for detecting a posture change. An operation terminal that is detachably attached to the terminal device 、and an operation terminal holding unit that is detachably held on the steering unit, the operation terminal having an operation terminal connector, the operation terminal connector being connected to a terminal device connector of the terminal device when the operation terminal is attached to the terminal device, the operation terminal holding unit having an operation terminal holding unit connector, the operation terminal connector being connected to the operation terminal holding unit connector when the operation terminal is held on the operation terminal holding unit, and an operation terminal holding recognition step of recognizing that the operation terminal is held on the operation terminal holding unit, and an interaction control step of executing interaction control to determine information to be output from an output device used in the moving body based on a detection status of a posture change of the operation terminal by the posture change detection unit when it is recognized by the operation terminal holding recognition step that the operation terminal is held on the operation terminal holding unit.

[0015] The first step to achieve the above objectives 4 states In this embodiment, a controller having a posture change detection unit for detecting posture changes is detachably attached. , the main body of the game consoleAn example of an interaction providing program implemented in a terminal device and executed by a terminal device processor, wherein the controller has an operation terminal connector, and when the controller is attached to the terminal device, the operation terminal connector is connected to a terminal device connector of the terminal device, and the program causes the terminal device processor to function as: an operation terminal holding recognition unit that recognizes that the controller is held in an operation terminal holding unit that is provided in a steering unit of a moving body and holds the controller in a detachable manner, and the operation terminal connector is connected to an operation terminal holding unit connector of the operation terminal holding unit; and an interaction control unit that, when the operation terminal holding recognition unit recognizes that the controller is held in the operation terminal holding unit, executes interaction control that determines information to be output from an output device used in the moving body based on a detection status of a posture change of the controller by the posture change detection unit. Effect of the Invention

[0016] According to the above-mentioned moving body, an operation terminal holding unit is provided in the steering unit of the moving body, and an attitude change detection unit of the operation terminal held in the operation terminal holding unit enables the driver of the moving body to recognize the operation status of the steering unit, thereby making it possible to recognize the status of the driver of the moving body and provide interaction. [Brief description of the drawings]

[0017] [Figure 1] FIG. 1 is an explanatory diagram of a configuration for detachably mounting a game machine to a vehicle. [Diagram 2] FIG. 2 is an explanatory diagram of the state in which the game console and one controller are attached to a vehicle. [Diagram 3] FIG. 3 is an explanatory diagram of the state in which the game console and two controllers are attached to a vehicle. [Figure 4] FIG. 4 is a diagram showing the configuration of the game console. [Diagram 5]FIG. 5 is an explanatory diagram of the configuration of the controller and the manner in which the controller is connected to the game console and the vehicle. [Figure 6] FIG. 6 is a flowchart of a process for determining whether or not to execute interaction control. [Figure 7] FIG. 7 is a flowchart of the interaction control process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] [1. A method for detachably mounting a game machine on a vehicle] With reference to Figs. 1 to 3, a mode in which a game console 100 is detachably attached to a vehicle 1 will be described. The vehicle 1 corresponds to a moving body in the present disclosure, and the game console main body 100 corresponds to a terminal device in the present disclosure. With reference to Fig. 1, the game console 100 includes a game console main body 110, and a left controller 170a and a right controller 170b for operating the game console main body 110. The left controller 170a and the right controller 170b correspond to an operation terminal in the present disclosure. The game console main body 110 includes a display 141 and a speaker 142.

[0019] The left controller 170a is detachably held on the left side of the game console 110 by a holder (not shown) provided on the left side of the game console 110. The right controller 170b is detachably held on the right side of the game console 110 by a holder (not shown) provided on the right side of the game console 110.

[0020] When the left controller 170a is attached to the game console 110, the connector 185a is connected to the left connector 152a of the game console 110, thereby enabling wired communication between the left controller 170a and the game console 110. Similarly, when the right controller 170b is attached to the game console 110, the connector 185b is connected to the right connector 152b of the game console 110, thereby enabling wired communication between the right controller 170b and the game console 110. For example, USB (registered trademark) is used as the specification for wired communication.

[0021] A1 in Fig. 1 shows a state in which a left controller 170a and a right controller 170b are attached to the game console main body 110. In this state, a user of the game console 100 can play a game by operating the buttons 174a and stick 175a of the left controller 170a with the left hand and the buttons 174b and stick 175b of the right controller 170b with the right hand.

[0022] A2 in Fig. 1 shows a state in which the left controller 170a and the right controller 170b are detached from the game console 110. In this state, the left controller 170a and the right controller 170b perform wireless communication with the game console 110. For example, Bluetooth (registered trademark) is adopted as the specification for wireless communication. A user can play a game by operating the left controller 170a or the right controller 170b from a location away from the game console 110.

[0023] The vehicle 1 includes a steering wheel 2 operated by a driver, and a dashboard 3 of the vehicle 1 is provided with a display 4 and speakers 5a, 5b. The steering wheel 2 corresponds to the steering section of the present disclosure, and is displaced by rotating left and right in response to an operation by the driver. The steering wheel 2 is provided with an operation terminal holding section 50 for detachably mounting the right controller 170b. In addition, the dashboard 3 is provided with a game console body holding section 60 for detachably mounting the game console body 110 at a predetermined position visible to the driver and other passengers. The game console body holding section 60 corresponds to the terminal device holding section of the present disclosure.

[0024] The operation terminal holding part 50 has a recessed shape that matches the outer shape of the right controller 170b. In Fig. 1, the arrow R1 indicates a state in which the right controller 170b is attached to the operation terminal holding part 50. When a passenger such as a driver fits the right controller 170b into the recessed part of the operation terminal holding part 50, the right controller 170b is held by the operation terminal holding part 50 and fixed to the steering wheel 2.

[0025] At this time, the connector 185b of the right controller 170b is connected to the connector 51 of the operation terminal holding part 50. Since the connector 51 of the operation terminal holding part 50 is connected to the vehicle ECU (Electronic Control Unit) 10, by attaching the right controller 170b to the operation terminal holding part 50, wired communication between the vehicle ECU 10 and the right controller 170b becomes possible.

[0026] The operation terminal holding unit 50 may be configured to hold the left controller 170a instead of the right controller 170b. Alternatively, the operation terminal holding unit 50 may be configured to be capable of holding either the left controller 170a or the right controller 170b. When the left controller 170a is attached to the operation terminal holding unit 50, the connector 185a of the left controller 170a is connected to the connector 51 of the operation terminal holding unit 50, enabling wired communication between the vehicle ECU 10 and the left controller 170a.

[0027] The game console body holding part 60 has a recessed shape that matches the outer shape of the game console body 110. In FIG. 1, the state in which the game console body 110 is attached to the game console body holding part 60 is indicated by an arrow R2, and the game console body 110 is held and fixed by the game console body holding part 60 when a passenger such as a driver fits the game console body 110 into the recessed part of the game console body holding part 60. At this time, the lower connector 151 of the game console body 110 is connected to the connector 61 of the game console body holding part 60. Since the connector 61 of the game console body holding part 60 is connected to the vehicle ECU 10, attaching the game console body 110 to the game console body holding part 60 enables wired communication between the vehicle ECU 10 and the game console body 110.

[0028] 2 shows a state in which the right controller 170b is attached to the operation terminal holding unit 50. In this state, the attitude of the right controller 170b changes in response to the operation of the steering wheel 2 by the driver. In this state, the driver of the vehicle 1 can operate the right controller 170b to give instructions to the game device main body 110 and the vehicle ECU 10, and passengers other than the driver can operate the left controller 170a to give instructions to the game device main body 110 and the vehicle ECU 10. In addition, passengers can operate the display of the game device main body 110. 141 The user can view and hear the images displayed on the display and the sounds output from the speaker 142.

[0029] The left controller 170a and the right controller 170b can perform wireless communication with the game console body 110 even when attached to the operation terminal holding part 50. Also, the left controller 170a, the right controller 170b, and the game console body 110 may be configured to perform wireless communication with the vehicle ECU 10.

[0030] 3 shows another configuration in which an operation terminal holding part 50a for mounting a left controller 170a and an operation terminal holding part 50b for mounting a right controller 170b are provided on the steering wheel 2. The configurations of the operation terminal holding part 50a and the operation terminal holding part 50b are the same as the operation terminal holding part 50 shown in FIGS.

[0031] When the left controller 170a is attached to the operation terminal holding part 50a, the connector 185a (see FIG. 1) of the left controller 170a is connected to the connector 51a of the operation terminal holding part 50a, enabling wired communication between the left controller 170a and the game console body 110 and the vehicle ECU 10. Similarly, when the right controller 170b is attached to the operation terminal holding part 50b, the connector 185b (see FIG. 1) of the right controller 170b is connected to the connector 51b of the operation terminal holding part 50b, enabling wired communication between the right controller 170b and the game console body 110 and the vehicle ECU 10.

[0032] 3, the attitudes of the left controller 170a and the right controller 170b change in response to the driver's operation of the steering wheel 2. The game machine main body 110 and the vehicle ECU 10 can recognize the attitude change of the left controller 170a by communicating with the left controller 170a, and can recognize the attitude change of the right controller 170b by communicating with the right controller 170b.

[0033] [2. Configuration of the game console] The configuration of the game console 110 will be described with reference to Fig. 4. The game console 110 includes a terminal device processor 120, and a memory 130, a communication unit 140, a display 141, a speaker 142, a microphone 143, an acceleration sensor 144, and an angular velocity sensor 145, all of which are connected to the terminal device processor 120. Furthermore, the game console 110 includes a card slot 150, a lower connector 151, a left connector 152a, and a right connector 152b, all of which are connected to the terminal device processor 120.

[0034] The communication unit 140 performs wireless communication with the left controller 170a, right controller 170b, etc., and also performs wireless communication with a support server 510 (see FIG. 5) via a communication network 500 (see FIG. 5). The display 141 is a touch panel in which a touch sensor is arranged on the surface of a flat-type display device such as an LCD, and performs screen display according to an image control signal output from the terminal device processor 120, and inputs an operation signal to the terminal device processor 120 according to a touch operation by the user.

[0035] The speaker 142 outputs sounds (voice, warning sounds, music, etc.) corresponding to the acoustic signals output from the terminal device processor 120. The microphone 143 detects sounds such as the user's voice and inputs a sound detection signal to the terminal device processor 120. The acceleration sensor 144 detects the acceleration of the game machine main body 110 and inputs an acceleration detection signal to the terminal device processor 120. The angular velocity sensor 145 detects the angular velocity of the game machine main body 110 and inputs an angular velocity detection signal to the terminal device processor 120.

[0036] The memory 130 stores a control program 131 for controlling the overall operation of the game device main unit 110, an interaction providing program 132 for executing interaction control described below, and a game application program 133 for executing a game. The card slot 150 reads and writes data from and to an inserted memory card 155.

[0037] As described above, the lower connector 151 is connected to the connector 61 of the game device main body holding unit 60. As described above, the left connector 152a is connected to the left controller 170a, or the connector 51 of the operation terminal holding unit 50, or the connector 51a of the operation terminal holding unit 50a. As described above, the right connector 152b is connected to the right controller 170b, or the connector 51 of the operation terminal holding unit 50, or the connector 51b of the operation terminal holding unit 50b.

[0038] The interaction providing program 132 may be read from the memory card 155 by the terminal processor 120 and stored in the memory 130 , or may be downloaded from the support server 510 by the communication unit 140 and stored in the memory 130 .

[0039] The terminal device processor 120 controls the overall operation of the game console 110 by reading and executing a control program 131, and executes game processing by reading and executing a game application program 133. The terminal device processor 120 also reads and executes an interaction providing program 132, thereby functioning as an operation terminal holding recognition unit 121, a terminal device holding recognition unit 122, an interaction control unit 123, and a content information output unit 124.

[0040] When the operation terminal holding recognition unit 121 recognizes through communication with the vehicle ECU 10 that wired communication has been established between the left controller 170a and the vehicle ECU 10, the operation terminal holding recognition unit 121 recognizes that the left controller 170a is held in the operation terminal holding unit 50 (configuration in Figs. 1 and 2) or the operation terminal holding unit 50a (in the case of Fig. 3). Similarly, when the operation terminal holding recognition unit 121 recognizes through communication with the vehicle ECU 10 that wired communication has been established between the right controller 170b and the vehicle ECU 10, the operation terminal holding recognition unit 121 recognizes that the right controller 170b is held in the operation terminal holding unit 50 (configuration in Figs. 1 and 2) or the operation terminal holding unit 50b (configuration in Fig. 3).

[0041] When the terminal device holding recognition unit 122 recognizes that wired communication has been established between the game console body 110 and the vehicle ECU 10, it recognizes that the game console body 110 is held in the game console body holding unit 60. The interaction control unit 123 executes interaction control when the operation terminal holding recognition unit 121 recognizes that at least one of the left controller 170a and the right controller 170b is connected to the operation terminal holding units 50, 50a, 50b, and the terminal device holding recognition unit 122 recognizes that the game console body 110 is held in the game console body holding unit 60. Details of the interaction control will be described later.

[0042] The content information output unit 124 outputs information on predetermined content from the display 141, speaker 142, etc. of the game machine main body 110 when the operation terminal holding recognition unit 121 recognizes that at least one of the left controller 170a and the right controller 170b is connected to the operation terminal holding units 50, 50a, 50b and the terminal device holding recognition unit 122 recognizes that the game machine main body 110 is held in the game machine main body holding unit 60. The predetermined content is content that becomes available by installing a predetermined application in the game machine main body 110, and is, for example, an additional item that can be used in a game executed by the game application program 133, another game related to the game executed by the game application program 133, etc.

[0043] [3. Controller configuration and connection mode] With reference to FIG. 5, the configuration of the left controller 170a and the right controller 170b, and the manner in which the left controller 170a and the right controller 170b are connected to the vehicle 1 and the game console 110 will be described.

[0044] The left controller 170a includes a controller processor 171a, and a communication unit 172a, a memory 173a, a button 174a, a stick 175a, an acceleration sensor 176a, an angular velocity sensor 177a, an LED 178a, a vibrator 179a, and a connector 185a, all of which are connected to the controller processor 171a. The acceleration sensor 176a and the angular velocity sensor 177a correspond to the posture change detection unit of the present disclosure.

[0045] The controller processor 171a controls the overall operation of the left controller 170a by executing a control program stored in the memory 173a. The controller processor 171a performs wireless communication with the game console 110 via the communication unit 172a. The controller processor 171a also transmits to the game console 110 operation signals of the buttons 174a, operation signals of the stick 175a, acceleration detection signals of the acceleration sensor 176a, and angular velocity detection signals of the angular velocity sensor 177a.

[0046] Furthermore, the controller processor 171a controls the operation of the LED 178a (on, off, blinking) and the operation of the vibrator 179a (vibration on, vibration off, vibration strength) in response to a control signal transmitted from the game console 110 to the left controller 170a.

[0047] The right controller 170b, like the left controller 170a, is equipped with a controller processor 171b, and a communication unit 172b, a memory 173b, a button 174b, a stick 175b, an acceleration sensor 176b, an angular velocity sensor 177b, an LED 178b, a vibrator 179b, and a connector 185b, all of which are connected to the controller processor 171b, and operates in the same manner as the left controller 170a. In addition, the right controller 170b is equipped with a camera 180, and transmits images captured by the camera 180 to the game console 110.

[0048] The vehicle 1 is equipped with a display 4, speakers 5a and 5b, sensors 25, a communication unit 26, and a car navigation system 20, which are connected to the vehicle ECU 10 via a CAN (Controller Area Network) 205. The sensors 25 include a speed sensor that detects the traveling speed of the vehicle 1, an accelerator pedal sensor that detects the operation amount of an accelerator pedal (not shown) provided in the vehicle 1, a brake pedal sensor that detects the operation amount of a brake pedal (not shown) provided in the vehicle 1, an illuminance sensor that detects the illuminance outside the vehicle, and the like. The communication unit 26 performs wireless communication with a communication terminal such as a smartphone 300, and also performs wireless communication with a support server 510 via a communication network 500. The car navigation system 20 is equipped with a GNSS (Global Navigation Satellite System) sensor 21 that detects the current position of the vehicle 1, and map data 22.

[0049] The vehicle ECU 10 is connected to the game console 110 via a communication line 200, to the left controller 170a via a communication line 201a, and to the right controller 170b via a communication line 201b. Thus, the vehicle ECU 10 performs wired communication between the game console 110, the left controller 170a, and the right controller 170b.

[0050] The game console body 110 acquires detection information from the sensors 25, current vehicle position information from the GNSS sensor 21, map data 22, etc., through communication with the vehicle ECU 10, and recognizes the traveling conditions of the vehicle 1. In addition, the game console body 110 can control the display of the display 4 of the vehicle 1 and the sound output from the speakers 5a and 5b through communication with the vehicle ECU 10.

[0051] As another configuration, recognition that the game console main body 110 is held in the game console main body holding unit 60, and recognition that the left controller 170a or the right controller 170b is held in the operation terminal holding units 50, 50a, 50b may be performed on the game console main body 110 side, and the left controller 170a and right controller 170b side using limit switches, proximity sensors, magnetic sensors, etc., rather than by establishing wired communication with the vehicle ECU 10.

[0052] In this configuration, there is no need to connect the game console main body 110 and the left controller 170a and right controller 170b to the vehicle ECU 10, and the game console main body 110 and the left controller 170a and right controller 170b are directly connected by communication lines 202a, 202b, and the interaction providing system of the present disclosure can be configured only by the game console main body 110. Furthermore, communication between the game console main body 110 and the left controller 170a and right controller 170b may be performed by wireless communication, in which case the connection by the communication lines 202a, 202b is also unnecessary.

[0053] [4. Decision process for whether to execute interaction control] The process of determining whether or not to execute interaction control, which is executed by the operation terminal holding recognition unit 121, the terminal device holding recognition unit 122, and the interaction control unit 123, will be described below with reference to the flowchart shown in Fig. 6. In the following, the process will be described for a configuration in which the operation terminal holding unit 50 that detachably holds the right controller 170b is provided on the steering wheel 2, as described above with reference to Figs.

[0054] 6, the terminal device holding recognition unit 122 recognizes whether or not the game device main body 110 is held in the game device main body holding unit 60, depending on the state of wired communication with the vehicle ECU 10. The terminal device holding recognition unit 122 determines that the game device main body 110 is held in the game device main body holding unit 60 when wired communication is established between the game device main body 110 and the vehicle ECU 10.

[0055] In the following step S2, when the terminal device holding recognition unit 122 recognizes that the game device main body 110 is held in the game device main body holding unit 60, the interaction control unit 123 advances the process to step S3. On the other hand, when the terminal device holding recognition unit 122 does not recognize that the game device main body 110 is held in the game device main body holding unit 60, the interaction control unit 123 advances the process to step S1.

[0056] In step S3, the operation terminal holding recognition unit 121 recognizes the state of wired communication between the right controller 170b and the vehicle ECU through communication with the vehicle ECU 10, and determines whether the right controller 170b is held in the operation terminal holding unit 50. right Controller 170 b When wired communication is established between the operation terminal holding unit 50 and the right Controller 170 b is recognized as being maintained.

[0057] In the following step S4, when the operation terminal holding recognition unit 121 recognizes that the right controller 170b is held in the operation terminal holding unit 50, the interaction control unit 123 advances the process to step S5 and executes the interaction control. On the other hand, when the operation terminal holding recognition unit 121 does not recognize that the right controller 170b is held in the operation terminal holding unit 50, the interaction control unit 123 advances the process to step S1. In this case, the interaction control is not executed.

[0058] [5. Interaction Control] The procedure for executing interaction control by the interaction control unit 123 will be described below with reference to the flowchart shown in FIG. ,figure As described above with reference to 1 and 2, the processing targeted at the configuration in which the steering wheel 2 is provided with the operation terminal holding unit 50 that detachably holds the right controller 170b will be described.

[0059] 7, the interaction control unit 123 receives detection signals from the acceleration sensor 176b and the angular velocity sensor 177b transmitted from the right controller 170b held in the operation terminal holding unit 50. In the following step S11, the interaction control unit 123 recognizes the state of change in posture of the right controller 170b based on the detection signals from the acceleration sensor 176b and the angular velocity sensor 177b. The state of change in posture includes the amount of change in posture, the direction of change, the speed of change, etc.

[0060] In the following step S12, the interaction control unit 123 receives driving information of the vehicle 1 from the vehicle ECU 10. The driving information includes the driving speed, driving location, driving route, destination, etc. of the vehicle 1. In the next step S13, the interaction control unit 123 recognizes the driving state of the vehicle 1 from the driving information.

[0061] In the next step S13, the interaction control unit 123 determines information to be output from the output device used in the vehicle 1, based on the state of posture displacement of the right controller 170b and the traveling state of the vehicle 1. The interaction control unit 123 uses, as output devices, the display 141 and speaker 142 of the game console 110, the display 4 and speakers 5a, 5b of the vehicle 1, etc.

[0062] The interaction control unit 123 determines the information to be output from the output device, for example, as follows. The type, tempo, and volume of the music output from the speaker are changed according to the amount and speed of change in the posture of the right controller 170b. In this case, the music output from the speaker may be music used in the game executed by the game application program 133. The music output from the speaker and the image displayed on the display are changed according to the traveling speed, traveling point, and destination of the vehicle 1. In this case, too, the music output from the speaker may be music used in the game executed by the game application program 133, and the image displayed on the display may be an image of a scene from the game.

[0063] 6. Other embodiments In the above embodiment, vehicle 1 is used as an example of a moving body of the present disclosure, but the configuration of the present disclosure can be applied to various moving bodies such as vehicles that run on the ground, aircraft that move through the air, ships that sail on water, etc.

[0064] In the above embodiment, the left controller 170a and the right controller 170b of the game console 100 are shown as the operation terminals of the present disclosure, but the operation terminals of the present disclosure may also be smartphones, mobile phones, portable game consoles, etc. that have an orientation detection unit.

[0065] As shown in Fig. 3, when multiple controllers can be attached to the steering wheel 2, the processing contents of the interaction control by the interaction control unit 123 may be changed according to the number of attached controllers. For example, when the left controller 170a and the right controller 170b are attached, the operation status of the steering wheel 2 may be recognized more accurately by using a combination of the detection signals of the acceleration sensor 176a and the angular velocity sensor 177a of the left controller 170a and the acceleration sensor 176b and the angular velocity sensor 177b of the right controller 170b, and information to be output from the output device may be determined based on the operation status of the steering wheel 2. Alternatively, the driver's operation may be recognized from an image by using an image captured by the camera 180 provided in the right controller 170b.

[0066] In the above embodiment, an example was shown in which the game console 110 was provided with the content information output unit 124, but the content information output unit 124 may be omitted.

[0067] In the above embodiment, the configuration is such that when the terminal device holding recognition unit 122 recognizes that the game console body is held in the game console body holding unit 60 and the operation terminal holding recognition unit 121 recognizes that the right controller 170b is held in the operation terminal holding unit 50 by the processing according to the flowchart shown in Fig. 6, the interaction control unit 123 executes the interaction control. As another configuration, the game console body holding unit 60 and the terminal device holding recognition unit 122 may be omitted, and when the operation terminal holding recognition unit 121 recognizes that the right controller 170b is held in the operation terminal holding unit 50, the interaction control unit 123 may execute the interaction control.

[0068] In the above embodiment, the interaction providing system of the present disclosure is configured by the game console main unit 110, but the interaction providing system may be configured by the vehicle ECU 10. In this case, an interaction providing program 132 is stored in a memory provided in the vehicle ECU 10, and a vehicle processor provided in the vehicle ECU 10 executes the interaction providing program 132 to function as an operation terminal holding recognition unit 121, a terminal device holding recognition unit 122, an interaction control unit 123, and a content information output unit 124.

[0069] Alternatively, an interaction providing system may be configured by the support server 510. A computer configuring the support server 510 executes the interaction providing program 132 to function as an operation terminal holding recognition unit 121, a terminal device holding recognition unit 122, an interaction control unit 123, and a content information output unit 124. In this case, the operation terminal holding recognition unit 121 and the terminal device holding recognition unit 122 determine whether the left controller 170a or the right controller 170b is held in the operation terminal holding unit 50 and whether the game machine main body 110 is held in the game machine main body holding unit 60, based on information on establishment of wired communication between the vehicle ECU 10 and the game machine main body 110, the left controller 170a, and the right controller 170b, which is transmitted from the vehicle ECU 10 via the communication network 500.

[0070] Furthermore, information on the acceleration detection signal and angular velocity signal transmitted from the left controller 170a or the right controller 170b is transmitted to the support server 510 via the vehicle ECU 10, and the interaction control unit 123 recognizes the state of the change in posture of the left controller 170a or the right controller 170b based on this information and determines the information to be output from the output device. Then, the interaction control unit 123 transmits the determined information to the vehicle ECU 10 and outputs the determined information from the output device used in the vehicle 1.

[0071] In the above embodiment, the game console 110 is shown as the terminal device of the present disclosure, but the terminal device of the present disclosure may be any terminal device having a display and a controller that is detachably attached, and may be an information terminal other than the game console.

[0072] 4 and 5 are schematic diagrams showing the vehicle 1, the game console 110 including the function of the interaction providing system, the left controller 170a, and the right controller 170b, divided according to the main processing contents, in order to facilitate understanding of the present invention, and the vehicle 1, the game console 110, the left controller 170a, and the right controller 170b may be divided according to other classifications. Furthermore, the processing of each component may be executed by one hardware unit or by multiple hardware units. Furthermore, the processing of each component shown in FIG. 6 and FIG. 7 may be executed by one program or by multiple programs.

[0073] [7. Configuration supported by the above embodiment] The above embodiment is a specific example of the following configuration.

[0074] (Item 1) A mobile body comprising: a steering unit that displaces in response to operation by a driver; and an operation terminal holding unit that detachably holds an operation terminal having a posture change detection unit that detects posture changes to the steering unit. According to the mobile body of paragraph 1, an operation terminal holding section is provided in the steering section of the mobile body, and the attitude change detection section of the operation terminal held in the operation terminal holding section enables recognition of the operation status of the steering section. This simple configuration makes it possible to recognize the driver's situation and provide interaction.

[0075] (Item 2) The moving body according to item 1, further comprising a terminal device holding section for detachably holding a terminal device having a display and to which the operation terminal is detachably attached as a controller, at a predetermined location on the moving body. According to the mobile object of the second aspect, the terminal device can be attached to the terminal device holder and used as an output device that displays interactions.

[0076] (3) The moving body described in paragraph 1 or 2, wherein the operation terminal holding unit detachably holds one or more of the operation terminals that are detachably attached to a terminal device as a controller in the steering unit. According to the vehicle of the third aspect, the controller of the terminal device can be used as a means for recognizing the operation status of the steering section. Also, by attaching multiple controllers to the operation terminal holding section, it becomes possible to recognize the operation status of the steering section in more detail.

[0077] (4) An interaction providing system that provides interaction in a mobile body that includes a steering unit that displaces in response to operation by a driver, and an operation terminal holding unit that detachably holds an operation terminal having an attitude change detection unit that detects attitude changes in the steering unit, the interaction providing system comprising: an operation terminal holding recognition unit that recognizes that the operation terminal is held in the operation terminal holding unit; and an interaction control unit that, when the operation terminal holding recognition unit recognizes that the operation terminal is held in the operation terminal holding unit, executes interaction control that determines information to be output from an output device used in the mobile body based on the detection status of the attitude change of the operation terminal by the attitude change detection unit. According to the interaction providing system of paragraph 4, when it is recognized that an operation terminal is held in an operation terminal holding section provided in a steering section of a moving body, an interaction according to the driver's situation can be provided based on a change in posture of the operation terminal recognized by the posture change detection section.

[0078] (Clause 5) The operation terminal is a controller that is detachably attached to a terminal device having a display and a speaker, the mobile body has a terminal device holding unit that detachably holds the terminal device at a predetermined location on the mobile body and is equipped with a terminal device holding recognition unit that recognizes that the terminal device is held in the terminal device holding unit, and the interaction control unit executes the interaction control using at least one of the display and the speaker as the output device when the operation terminal holding recognition unit recognizes that the operation terminal is held in the operation terminal holding unit and the terminal device holding recognition unit recognizes that the terminal device is held in the terminal device holding unit. According to the interaction providing system of the fifth aspect, the terminal device held in the terminal device holding unit can be diverted as an output device that outputs information by interaction control.

[0079] (Clause 6) An interaction providing system according to Clause 5, wherein the operating terminal holding recognition unit, the terminal device holding recognition unit, and the interaction control unit are provided in the terminal device. According to the system for providing interaction in paragraph 6, interaction control can be performed by processing by the game device itself, without relying on processing by a mobile object.

[0080] (Clause 7) The operation terminal is a controller for a terminal device, and the interaction providing system described in Clause 4 is equipped with a content information output unit that outputs, from the output device, information on content that becomes available by installing a specified application on the terminal device when the operation terminal is recognized by the operation terminal holding recognition unit as being held in the operation terminal holding unit. According to the interaction providing system of paragraph 7, information on available content can be provided to the driver or other passengers who are enjoying the information output by interaction control.

[0081] (Clause 8) An interaction providing system described in any one of clauses 4 to 7, wherein the operation terminal holding unit removably holds one or more of the operation terminals, the operation terminal holding recognition unit recognizes the number of the operation terminals held in the operation terminal holding unit, and the interaction control unit changes the processing content by the interaction control depending on the number of the operation terminals recognized by the operation terminal holding recognition unit. According to the interaction providing system of paragraph 8, it is possible to change the variation of information output by interaction control in accordance with the number of operation terminals held in the operation terminal holding unit.

[0082] (Clause 9) An interaction providing system as described in any one of clauses 4 to 8, further comprising a movement state recognition unit that recognizes the movement state of the moving body, and wherein the interaction control unit, in the interaction control, determines information to be output from the output device based on the posture change of the operation terminal detected by the posture change detection unit and the movement state of the moving body recognized by the movement state recognition unit. According to the interaction providing system of paragraph 9, by adding the movement state of the moving object to the determining factors of the information to be output by the interaction control, the information to be output by the interaction control can be changed according to the movement state of the moving object.

[0083] (Clause 10) A method of providing interaction executed by a computer to provide interaction in a mobile body equipped with a steering unit that displaces in response to operation by a driver, and an operation terminal holding unit that detachably holds an operation terminal having an attitude change detection unit that detects attitude changes in the steering unit, the method including: an operation terminal holding recognition step of recognizing that the operation terminal is held in the operation terminal holding unit; and an interaction control step of executing interaction control to determine information to be output from an output device used in the mobile body based on the detection status of the attitude change of the operation terminal by the attitude change detection unit when it is recognized by the operation terminal holding recognition step that the operation terminal is held in the operation terminal holding unit. By executing the interaction providing method of paragraph 10 by a computer, the configuration of the interaction providing system of paragraph 4 above can be realized.

[0084] (Clause 11) An interaction providing program executed by a terminal device processor implemented in a terminal device to which a controller having a posture change detection unit that detects posture changes is removably attached, the interaction providing program causing the terminal device processor to function as: an operation terminal holding recognition unit that recognizes that the controller is held in an operation terminal holding unit that is provided on a steering unit of a moving body and removably holds the controller; and an interaction control unit that, when the operation terminal holding recognition unit recognizes that the controller is held in the operation terminal holding unit, executes interaction control that determines information to be output from an output device used in the moving body based on the detection status of posture changes of the controller by the posture change detection unit. By executing the interaction providing program of paragraph 11 by a terminal processor implemented in the terminal device, the interaction control processing can be executed by the terminal device and the controller without relying on processing by the mobile object. [Explanation of symbols]

[0085] 1...vehicle (mobile body), 2...steering wheel (steering unit), 3...dashboard, 4...display, 5a, 5b...speaker, 10...vehicle ECU, 50, 50a, 50b...operation terminal holding unit, 60...game machine main body holding unit (terminal device holding unit), 100...game machine, 110...game machine main body (interaction providing system), 120...terminal device processor, 121...operation terminal holding recognition unit, 122...terminal device holding recognition unit, 123...interaction control unit, 124...computer Content information output unit, 130...memory, 131...control program, 132...interaction providing program, 133...game application program, 140...communication unit, 141...display, 142...speaker, 143...microphone, 144...acceleration sensor, 145...angular velocity sensor, 170a...left controller, 170b...right controller, 171a, 171b...controller processor, 176a, 176b...acceleration sensor, 177a, 177b...angular velocity sensor.

Claims

1. A steering unit that is displaced in response to an operation by a driver; an operation terminal holding section that holds an operation terminal, which is a controller of a terminal device that is a main body of a game machine, detachably attached to the terminal device and has a posture change detection section that detects posture change, in a manner that the operation terminal is detachably attached to the terminal device and is detachably held on the steering section; A moving body comprising: the operation terminal has an operation terminal connector, and when the operation terminal is attached to the terminal device, the operation terminal connector is connected to a terminal device connector of the terminal device; The operation terminal holding section has an operation terminal holding section connector, and when the operation terminal is held in the operation terminal holding section, the operation terminal connector is connected to the operation terminal holding section connector. Mobile body.

2. The terminal device holding unit is configured to hold the terminal device having a display unit in a detachable manner at a predetermined position of the mobile body. The moving body according to claim 1 .

3. The operation terminal holding unit holds one or more of the operation terminals in a detachable manner to the steering unit. The moving body according to claim 1 or 2.

4. An interaction providing system for providing interaction in a moving object including a steering unit which is displaced in response to an operation by a driver, and an operation terminal holding unit which detachably holds an operation terminal, which is a controller of a terminal device that is a game machine main body, and which has a posture change detection unit which detects posture change and is detachably attached to the terminal device, in the steering unit, the operation terminal has an operation terminal connector, and when the operation terminal is attached to the terminal device, the operation terminal connector is connected to a terminal device connector of the terminal device; the operation terminal holding unit has an operation terminal holding unit connector, and when the operation terminal is held in the operation terminal holding unit, the operation terminal connector is connected to the operation terminal holding unit connector; an operation terminal holding recognition unit that recognizes that the operation terminal is held in the operation terminal holding unit; an interaction control unit that executes interaction control to determine information to be output from an output device used in the moving object, based on a detection state of a posture change of the operation terminal by the posture change detection unit, when the operation terminal holding recognition unit recognizes that the operation terminal is held in the operation terminal holding unit; An interaction providing system comprising:

5. the operation terminal is a controller that is detachably attached to the terminal device having a display and a speaker, the moving body has a terminal device holding section that detachably holds the terminal device at a predetermined position of the moving body, a terminal device holding recognition unit that recognizes that the terminal device is held in the terminal device holding unit, When the operation terminal holding recognition unit recognizes that the operation terminal is held in the operation terminal holding unit and the terminal device holding recognition unit recognizes that the terminal device is held in the terminal device holding unit, the interaction control unit executes the interaction control by using at least one of the display unit and the speaker as the output device. The system for providing interaction according to claim 4 .

6. The operation terminal holding recognition unit, the terminal device holding recognition unit, and the interaction control unit are provided in the terminal device. The system for providing interaction according to claim 5 .

7. and a content information output unit that outputs, when the operation terminal holding recognition unit recognizes that the operation terminal is held in the operation terminal holding unit, information on content that becomes available by installing a predetermined application in the terminal device from the output device. The system for providing interaction according to claim 4 .

8. the operation terminal holding unit detachably holds one or a plurality of the operation terminals, the operation terminal holding recognition unit recognizes the number of the operation terminals held in the operation terminal holding unit, The interaction control unit changes the content of the process by the interaction control in accordance with the number of the operation terminals recognized by the operation terminal holding recognition unit. The system for providing interaction according to any one of claims 4 to 7.

9. a moving state recognition unit that recognizes a moving state of the moving object, The interaction control unit determines information to be output from the output device based on a change in posture of the operation terminal detected by the posture change detection unit and a moving state of the moving object recognized by the moving state recognition unit in the interaction control. The system for providing interaction according to any one of claims 4 to 8.

10. 1. A method for providing interaction executed by a computer in a moving object including a steering unit that is displaced in response to an operation by a driver, and an operation terminal holding unit that detachably holds an operation terminal, which is a controller of a terminal device that is a game machine main body, having a posture change detection unit that detects posture change and is detachably attached to the terminal device, on the steering unit, the method comprising: the operation terminal has an operation terminal connector, and when the operation terminal is attached to the terminal device, the operation terminal connector is connected to a terminal device connector of the terminal device; the operation terminal holding unit has an operation terminal holding unit connector, and when the operation terminal is held in the operation terminal holding unit, the operation terminal connector is connected to the operation terminal holding unit connector; an operation terminal holding recognition step of recognizing that the operation terminal is held in the operation terminal holding unit; an interaction control step of executing, when it is recognized in the operation terminal holding unit that the operation terminal is held by the operation terminal holding recognition step, an interaction control step of determining information to be output from an output device used in the moving object, based on a detection state of a posture change of the operation terminal by the posture change detection unit; A method of providing interaction including:

11. An interaction providing program executed by a terminal device processor, the terminal device being a game console main body to which a controller having a posture change detection unit that detects posture changes is detachably attached, the program comprising: the controller has an operation terminal connector, and when the controller is attached to the terminal device, the operation terminal connector is connected to a terminal device connector of the terminal device; The program causes the terminal device processor to: an operation terminal holding recognition unit that recognizes that the controller is held by an operation terminal holding unit that is provided on a steering unit of a moving body and that detachably holds the controller, and that the operation terminal connector is connected to an operation terminal holding unit connector of the operation terminal holding unit; an interaction control unit that executes interaction control to determine information to be output from an output device used in the moving object, based on a detection state of a posture change of the controller by the posture change detection unit, when the operation terminal holding recognition unit recognizes that the controller is held in the operation terminal holding unit; An interaction delivery program that functions as a service.

Images