Control device, control method, and program

Abstract

Providing technology that allows multiple occupants to share enjoyable experiences while the vehicle is in motion. [Solution] A control device for controlling an information providing means that provides information to the occupants of a vehicle, comprising: a control means for controlling the information providing means so that a plurality of suggestive pieces of information that suggest the correct answer to a quiz are provided to the occupants of the vehicle in sequence; and an acquisition means for acquiring driving information that changes according to the driving of the vehicle, wherein the control means controls the timing of providing each piece of suggestive information after the provision of the first piece of suggestive information based on the driving information acquired by the acquisition means.

Description

Technical Field

[0001] The present invention relates to a control device, a control method, and a program.

Background Art

[0002] Techniques for providing a game to a user using data of actual running of a vehicle are known. For example, Patent Document 1 proposes a system that provides a game of traveling in a virtual space according to the actual traveling distance of a vehicle.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When a vehicle moves a long distance or the like, passengers may feel bored. If a plurality of passengers including a driver can share enjoyment during the running of the vehicle, such boredom can be reduced.

[0005] An object of the present invention is to provide a technique in which a plurality of passengers can share enjoyment during the running of a vehicle.

Means for Solving the Problems

[0006] According to the present invention, a control device that controls an information providing means for providing information to passengers of a vehicle, control means for controlling the information providing means so that a plurality of pieces of hint information for suggesting correct answers to quizzes are sequentially provided to the passengers of the vehicle; acquisition means for acquiring Surrounding image of the aforementioned vehicle which varies according to the running of the vehicle, and is provided with, the control means is Based on the surrounding images, it is determined whether or not the vehicle passed by another vehicle of the same type as the vehicle in question. After providing one of the aforementioned multiple pieces of suggestive information, the information providing means is controlled so that the next piece of suggestive information is provided when it is determined that the vehicle has passed another vehicle of the same type as the vehicle after the first piece of suggestive information has been provided. A control device characterized by the above is provided. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a technology that allows multiple occupants to share enjoyment while a vehicle is in motion. [Brief explanation of the drawing]

[0008] [Figure 1] A block diagram of a system to which the present invention is applied. [Figure 2] A schematic diagram showing the configuration of the vehicle. [Figure 3] A diagram showing the structure of song information. [Figure 4] (A) is a diagram showing an example of the timing of providing suggestive information, and (B) is a diagram showing an example of the relationship between distance traveled and the timing of information provision. [Figure 5] (A) is a flowchart showing an example of the system's processing in Figure 1, and (B) is a diagram showing an example of the display on the display device. [Figure 6] (A) is a flowchart showing an example of the system's processing in Figure 1, and (B) is a diagram showing the interior of the vehicle. [Figure 7] A flowchart illustrating an example of the control server's processing. [Figure 8] (A) is a flowchart showing an example of the system's processing in Figure 1, and (B) and (C) are diagrams showing the interior of the vehicle. [Figure 9] (A) and (B) are diagrams illustrating examples of the timing of providing suggestive information according to the difficulty level. [Figure 10] (A) is a flowchart showing an example of the system's processing in Figure 1, and (B) and (C) are diagrams showing the interior of the vehicle. [Figure 11] (A) to (C) are diagrams showing examples of displays on the display device. [Figure 12] (A) to (C) are diagrams showing other examples of driving information and the timing of its provision. [Figure 13] (A) to (C) are flowcharts showing examples of processing by the control server. [Figure 14](A) and (B) are diagrams showing other examples of travel information and provision timing. [Figure 15] (A) and (B) are flowcharts showing processing examples of the control server. [Figure 16] A flowchart showing another processing example of the system of FIG. 1. [Figure 17] A flowchart showing another processing example of the system of FIG. 1. [Figure 18] A flowchart showing another processing example of the system of FIG. 1. [[ID=1z]] [Figure 19] (A) is a block diagram of the mobile terminal, and (B) is a flowchart showing another processing example of the system of FIG. 1. [Figure 20] A flowchart showing another processing example of the system of FIG. 1. [Figure 21] A flowchart showing another processing example of the system of FIG. 1.

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims, and not all combinations of the features described in the embodiments are essential for the invention. Two or more of the features described in the embodiments may be arbitrarily combined. Also, the same or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0010] <First Embodiment> <Overview of the System> FIG. 1 is a schematic diagram of an information processing system 1. The information processing system 1 is a system in which a control server 2 provides services to a vehicle V and a mobile terminal 4 of a passenger 100 in the vehicle V via a communication network such as the Internet. As the service, in the present embodiment, the control server 2 provides a quiz game to the passengers in the vehicle V via the controller 3 of the vehicle V. By providing the quiz game, a plurality of passengers in the vehicle V can share the fun, and particularly according to the present embodiment, a plurality of passengers including the driver can share the fun.

[0011] The control server 2 includes a processing unit 21, a storage unit 22, and a communication interface unit 23. The processing unit 21 is a processor, such as a CPU, and executes programs stored in the storage unit 22. The storage unit 22 is a storage device such as RAM, ROM, or hard disk. The communication interface unit 23 includes a communication interface that can communicate with the vehicle V's controller 3 and the mobile terminal 4 via a communication network. In addition to the programs executed by the processing unit 21, various types of data are stored in the storage unit 22. The data stored in the storage unit 22 includes a database 22a that stores information related to the quiz.

[0012] The configuration of vehicle V will be explained with reference to Figure 2. Vehicle V is equipped with a controller 3 as an in-vehicle device (in-vehicle computer). Controller 3 includes a processor, such as a CPU, storage devices such as semiconductor memory, and interfaces with external devices. The storage devices store programs executed by the processor and data used by the processor for processing. Controller 3 may be equipped with multiple processors, storage devices, and interfaces.

[0013] Controller 3 can control the drive source 5, brake system 6, and electric power steering 7 as driver assistance control. The drive source 5 includes, for example, an internal combustion engine and an automatic transmission, and Controller 3 can control the acceleration and deceleration of the vehicle V by controlling the drive source 5. The brake system 6 is, for example, a disc brake system, and Controller 3 can control the deceleration of the vehicle V by controlling the brake system 6. The accelerator pedal 8 is provided with a sensor 8a that detects the amount of accelerator operation, and the brake pedal 9 is provided with a sensor 9a that detects the amount of brake operation, and Controller 3 can also control the drive source 5 and brake system 6 based on each operation amount.

[0014] The electric power steering system 7 is a mechanism that steers the front wheels in response to the driver's steering input (steering operation) to the steering wheel. The electric power steering system 7 includes a motor that provides driving force (sometimes called steering assist torque) to assist the steering operation, a steering angle sensor, a torque sensor that detects the steering torque borne by the driver, and the like.

[0015] The controller 3 can recognize the driving environment (external environment) of vehicle V based on the detection results of the detection unit 8, which detects the surrounding conditions of vehicle V. In this embodiment, the detection unit 8 is a camera that takes pictures of the area around vehicle V. By analyzing the images taken by the detection unit 8, oncoming vehicles and shops along the roadside can be recognized. In addition to a camera, millimeter-wave radar, ultrasonic sensors, etc. can also be used as the detection unit 8, and their arrangement and detection range can be designed as appropriate.

[0016] Vehicle V is equipped with a GNSS (Global Navigation Satellite System) sensor 9 and a communication unit 12. The controller 3 can recognize the current position of vehicle V from the detection results of the GNSS sensor 9. The communication unit 12 includes a communication interface that can communicate with the control server 2 via a communication network, and a communication interface that can communicate with a mobile terminal 4 inside the vehicle. The controller 3 can communicate with the control server 2 and the mobile terminal 4 via the communication unit 12.

[0017] The controller 3 can also acquire detection results from the inertial sensor 10 and the vehicle speed sensor 11. The inertial sensor 10 includes, for example, an acceleration sensor and a yaw rate sensor. The vehicle speed sensor 11 detects the amount of wheel rotation, which allows for the calculation of the vehicle speed and distance traveled by the vehicle V.

[0018] Controller 3 also controls an information provision unit 13 that provides information to the occupants. The information provision unit 13 includes an audio output device 13a, such as a speaker, that provides information to the occupants by voice, and a display device 13b that provides information to the occupants by image. The display device 13b may be a device that displays images on the meter panel or a HUD (head-up display).

[0019] Controller 3 also controls input devices 15 and 16 that receive instructions from the crew. Input device 15 is, for example, an audio input device such as a microphone, and input device 16 is, for example, a touch panel that serves both to display images and to receive input operations from the crew.

[0020] The controller 3 also controls the detection unit 14, which detects the behavior of the occupants. In this embodiment, the detection unit 14 is a camera that takes pictures of the interior of the vehicle V. The behavior of the occupants can be recognized by analyzing the images taken by the detection unit 14.

[0021] <Example of a service> An example of a quiz game provided by the control server 2 to the occupants of vehicle V is described. In this embodiment, the control server 2 controls the information provision unit 13 of vehicle V via the controller 3 to provide a quiz in which the occupants guess the titles of songs. Multiple types of song information are stored in the database 22a. Figure 3 illustrates the data structure of the song information stored in the database 22a.

[0022] The song information M in Figure 3 represents the audio data for one song. The song information M consists of audio data P1-P5 for each instrument and vocal part, with playback time and sound data associated with each. Audio data P1 is data for the bass part only, and audio data P2 is data for the drum part only. Similarly, audio data P3-P5 are data for the keyboard part only, the guitar part only, and the vocal part only, respectively. Playing these simultaneously produces a complete song.

[0023] Audio data P1 to P5 each contain multiple pieces of hinting information that suggest the correct title of the song. In the quiz of this embodiment, audio data P1 to P5 are provided to the occupants in order, and they are asked to guess the song title using these as hints.

[0024] The quiz has a set order for providing hint information. Figure 4(A) shows an example of the timing of providing each hint piece of information and an example of the configuration of the playback sound H provided to the crew. In the illustrated example, when the quiz game starts, playback of audio data P1 begins as the first hint piece of information. The crew is provided with only the bass part of the playback sound. If the crew does not answer correctly, at the provision timing T1, playback of audio data P2 begins as the next hint piece of information. Audio data P2 will start playing from the middle. The crew is provided with the playback sound of the drum part in addition to the bass part.

[0025] If the occupant does not give the correct answer, at the provision timing T2, playback of audio data P3 begins as the next suggestive information. Audio data P3 will start playing from the middle. The occupant is provided with the sound of the bass part, drum part, and keyboard part. As more parts are played, the likelihood of the occupant thinking of the song title increases. If the occupant does not give the correct answer, at the provision timing T3, playback of audio data P4 begins as the next suggestive information, and at the provision timing T4, playback of audio data P5 begins as the final suggestive information. From the provision timing T4 onward, all parts are played. In this way, in this embodiment, multiple pieces of suggestive information that hint at the correct answer to the quiz are provided in sequence, increasing the likelihood of the occupant giving the correct answer.

[0026] Since the occupants' anticipation for the provision of suggestive information increases depending on the provision timing T1-T4, how the provision timing T1-T4 is set affects the enjoyment of the quiz game. In this embodiment, the provision timing T1-T4 is controlled based on driving information that changes according to the movement of the vehicle V. Since the movement of the vehicle V and the provision timing of the suggestive information are linked, the occupants' attention is directed not only to the quiz game but also to the movement of the vehicle V. Therefore, it is possible to enjoy the quiz game without reducing attention to driving the vehicle V. In addition, since the provision timing T1-T4 changes according to the movement of the vehicle V, it is also possible to give the occupants the enjoyment of guessing the provision timing.

[0027] In this embodiment, the vehicle V driving information is set to provide timings T1 to T4 based on the distance traveled by vehicle V since the start of the quiz game.

[0028] Figure 4(B) shows the relationship between the provision timings T1-T4 and the distance traveled. In the illustrated example, a provision timing occurs each time vehicle V travels a distance L. Due to the acceleration, deceleration, and stopping of vehicle V, the relationship between distance traveled and time is not usually proportional. Since the provision timings T1-T4 vary, the excitement of the quiz game can be enhanced. In the example of Figure 4(B), the provision timing occurs every time the same distance L is traveled, but the distance can be varied depending on the provision timing. For example, let the distance traveled between provision timing T1 and provision timing T2 be distance X, and the distance traveled between provision timing T2 and provision timing T3 be distance Y( <X)としてもよい。

[0029] <Example of system processing> This section describes an example of processing by the information processing system 1 related to the provision of a quiz game. Figure 5(A) is a flowchart showing an example of processing between the control server 2 and the vehicle V's controller 3 regarding the start of a quiz game.

[0030] The occupants of vehicle V instruct controller 3 to start the quiz game. The start instruction is given, for example, via input device 15 or input device 16. Upon receiving the start instruction, controller 3 sends a request to start the quiz game to control server 2 (S1). Control server 2 receives the start request and sends a setup request to controller 3, which sent the start request (S11). The setup request includes the occupants' selections regarding the specifications of the quiz game. In this embodiment, the setup request includes items for selecting the songs to be used in the quiz.

[0031] Controller 3 accepts input from the crew members regarding their selections in response to setting requests from the control server 2 (S2). Figure 5(B) shows an example of the display on the input device 16. The song selection options include era, genre, and difficulty level. Crew members can specify the era (e.g., 1990s, 2000s, etc.), genre (e.g., rock, pop, etc.), and difficulty level (e.g., easy, normal, hard, etc.) of the songs to be featured in the quiz.

[0032] Controller 3 transmits input information indicating the occupant's selection result to control server 2 (S3). Control server 2 receives the input information transmitted from controller 3, acquires the input information, and selects a song to present from the song information stored in database 22a based on the acquired input information (S12). After selecting a song, control server 2 sends a game start notification to controller 3 (S13). The start notification includes a request to acquire driving information. Controller 3 notifies the occupant of the start of the game using information provision unit 13 (S4). Controller 3 also transmits driving information to control server 2 (S5). In this embodiment, the driving information transmitted is the current mileage of vehicle V (for example, total mileage), and control server 2 stores the received mileage in storage unit 22 as reference information (S14).

[0033] Figure 6(A) is a flowchart showing an example of processing between the control server 2 and the vehicle V's controller 3 regarding the provision of suggestive information. Figure 8(A) is a flowchart showing an example of processing between the control server 2 and the vehicle V's controller 3 regarding the determination of the correctness of the occupant's response. These processes are executed in parallel. First, we will explain the processing example in Figure 6(A).

[0034] The control server 2 sends the first part of the song information M selected in S12 to the controller 3 as suggestive information (S31). In the example in Figure 4(A), audio data P1 is sent to the controller 3. Upon receiving the first part, the controller 3 starts playing the audio data of the received part (S21). Figure 6(B) shows the inside of the vehicle V. The audio of the first part is output from the audio output device 13a. In the example in Figure 4(A), the bass part is output inside the vehicle. The occupant 100 will then guess the title of the song from the bass part.

[0035] The control server 2 requests driving information of vehicle V from the controller 3 (S32). The controller 3 responds to the request and transmits the driving information (S22). The control server 2 receives the driving information from the controller 3 (S34) and determines whether the timing for providing the next suggestion information has arrived (S34). Figure 7 is a flowchart showing an example of the determination process in S34.

[0036] In S41, the reference information stored in the memory unit 22 in S14 is compared with the mileage, which is the travel information acquired in S33, and the mileage since the acquisition of the reference information is calculated. In S42, if the mileage calculated in S41 is greater than or equal to the threshold, the process proceeds to S43; otherwise, the process proceeds to S45. In S43, the reference information in the memory unit 22 is updated with the travel information acquired in S33, and in the subsequent S44, the determination result is to provide. In S45, the determination result is to wait (not provide).

[0037] For example, in the example shown in Figure 4(B), at the stage of determining when the provision timing T1 has arrived, the reference information (distance traveled at the start of the game) stored in the memory unit 22 is compared with the current distance traveled. If the difference between them is greater than or equal to the threshold distance L, the process proceeds to S43; otherwise, the process proceeds to S45. Similarly, at the stage of determining when the provision timing T2 has arrived, the reference information (distance traveled at provision timing T1) stored in the memory unit 22 is compared with the current distance traveled. If the difference between them is greater than or equal to the threshold distance L, the process proceeds to S43; otherwise, the process proceeds to S45. The same applies to provision timing T3 and beyond.

[0038] Returning to Figure 6(A), the control server 2 determines in S35 whether or not it is time to provide suggestion information. If the determination in S34 is to provide the information, the process proceeds to S36; if it is to wait, the process returns to S32 and the same process is repeated. In S36, the control server 2 sends the audio data for the next part as additional suggestion information to the controller 3. The controller 3 starts playing the audio data for the received part in addition to the audio data that is already being played (S23).

[0039] In the example shown in Figure 4(A), when the delivery timing T1 arrives, audio data P2 is transmitted from the control server 2 to the controller 3. The controller 3 starts playing the drum part of audio data P2 over the bass part of audio data P1, which is already playing. The bass and drum parts are output to the crew 100 from the audio output device 13a. The crew 100 will then try to guess the title of the song from the bass and drum parts.

[0040] In S37, the control server 2 determines whether it has sent all the audio data for all parts to the controller 3. In the example in Figure 4(A), it determines whether all of the audio data P1 to P5 have been sent to the controller 3. If the audio data for all parts has not been sent to the controller 3, the process returns to S32 and the same process is repeated. If the audio data for all parts has been sent to the controller 3, the control server 2 waits for a playback completion notification from the controller 3.

[0041] When controller 3 has finished playing all the audio data for all parts, it sends a playback completion notification to control server 2 (S24). Upon receiving the playback completion notification, control server 2 sends a correct answer notification to controller 3 indicating the title of the song that was presented (S38). Upon receiving the correct answer notification, controller 3 announces the title of the song via information provision unit 13 (S25). If no correct answer is given by crew member 100, all the processes in Figure 6(A) will be executed.

[0042] In this embodiment, the timing of providing each suggestion information (voice data P1 to P5) is controlled by the control server 2 based on driving information.

[0043] Next, with reference to Figure 8(A), an example of processing between the control server 2 and the vehicle V's controller 3 regarding the determination of the correctness of the crew's answers will be described. During the game, the controller 3 receives answers from the crew 100 (S51). The crew 100 can input their quiz answers into input devices 15 and 16. For example, if the crew 100 inputs an answer by voice, the detection unit 14 detects the crew 100 raising their hand, then the input device 15 captures the crew 100's answer, and the captured voice is processed using speech recognition to identify the content of the answer. Upon receiving the answer in S51, the controller 3 pauses playback of the voice data (S52) and sends the received answer to the control server 2 (S53).

[0044] The control server 2 receives the answer from the controller 3 (S60) and determines whether the received answer is correct or incorrect (S61). If the answer is correct, the process proceeds to S63; if the answer is incorrect, the process proceeds to S62. In S62, the control server 2 sends an incorrect answer notification to the controller 3 indicating that the answer is incorrect. Upon receiving the incorrect answer notification, the controller 3 notifies the information provider unit 13 that the answer is incorrect (S54) and resumes playback of the audio data (S55). Figure 8(B) shows an example of an incorrect answer notification. In the illustrated example, when crew member 100 raises his hand and speaks his answer, an audio message indicating that it is incorrect is output from the audio output device 13a.

[0045] In S63, the control server 2 sends a correct answer notification to the controller 3 indicating that the answer is correct. Upon receiving the correct answer notification, the controller 3 notifies the information provision unit 13 that the answer is correct (S56). Figure 8(C) shows an example of the notification of a correct answer. In the illustrated example, when crew member 100 raises their hand and speaks their answer, the audio output device 13a outputs an audio message indicating that the answer is correct. After the notification of a correct answer in S56, one round of the quiz game ends. Alternatively, after the notification of a correct answer in S56, playback of the audio data may be resumed and the song played to the end. In that case, the control server 2 may send audio data for all parts to the controller 3, and the controller 3 may play all parts of the audio data to the end.

[0046] <Second Embodiment> In the first embodiment, the display example of the input device 16 shown in Figure 5(B) illustrates the difficulty level as an example of the song to be presented. Rather than using the difficulty level of the song as an indicator for song selection, it may also be used as an indicator for the order in which multiple pieces of suggestive information are provided. Of the parts that make up a song, the part that plays the melody is easier to guess the song from than the part that plays the rhythm. Therefore, if the part that plays the melody is provided at an early stage, the crew member 100 is more likely to get the correct answer.

[0047] Figures 9(A) and 9(B) show examples of the timing of providing each piece of suggestive information for the same musical piece as the example in Figure 4(A) already described, and illustrate examples of the configuration of the playback sound H provided to the crew.

[0048] Comparing the example in Figure 9(A) with the example in Figure 4(A), in the example in Figure 9(A), the timing of the audio data P3 for the keyboard part is earlier than the audio data P2 for the drum part. Generally, the keyboard part has more elements that play melodies than the drum part. Therefore, it can be said that the example in Figure 9(A) is less difficult than the example in Figure 4(A).

[0049] Comparing the example in Figure 9(B) with the example in Figure 9(A), in the example in Figure 9(B), the audio data P4 for the guitar part is provided first, followed by the audio data P3 for the keyboard part. The audio data P1 and P2 for the bass and drum parts, which have many rhythmic elements, are provided later. Therefore, it can be said that the example in Figure 9(B) is less difficult than the example in Figure 9(A).

[0050] Based on the above, the difficulty levels of the examples in Figures 4(A), 9(A), and 9(B), from easiest to most difficult, are: the example in Figure 9(B), the example in Figure 9(A), and the example in Figure 4(A).

[0051] This section describes an example of the processing of the control server 5 when the order of providing suggestive information is changed according to the difficulty level. In the music selection in S12 of Figure 5(A), the crew member 100 selects a song from the options other than difficulty level (in the example of Figure 5(B), this is the era and genre). Then, the order in which the suggestive information is provided in the processing of Figure 6(A) is changed according to the difficulty level selected by the crew member 100. This makes it possible to provide the crew member 100 with a quiz game in which the correct answer difficulty level differs even though the song is the same.

[0052] In another embodiment, the crew member 100 may be able to select the order in which each piece of suggestive information is provided. For example, at the input reception in S2 of Figure 5(A), the types of parts that make up the song are announced, and the crew member 100 selects the order in which they are provided. The announcement of the types of parts may be done by displaying a message or outputting an audio message such as, "This song consists of a bass part, a drum part, a keyboard part, a guitar part, and a vocal part. Please select the order." Then, the order in which the suggestive information is provided in the process of Figure 6(A) is changed according to the order selected by the crew member 100. In this embodiment as well, the crew member 100 can substantially select the difficulty level of the quiz, or a new way of enjoying the quiz can be provided to the crew member 100.

[0053] Note that the difficulty level is not determined by the crew's selection of 100; it can be changed by the system. For example, if the correct answer rate is high in multiple quiz games, the difficulty level may be automatically increased, and conversely, if the correct answer rate is low, the difficulty level may be automatically decreased. Also, for example, if vehicle V encounters traffic congestion, the difficulty level may be automatically increased. This can reduce the feeling of boredom caused by traffic jams.

[0054] <Third Embodiment> In the first embodiment, a process was performed to determine whether the answer given by the occupant 100 was correct or incorrect (Figure 8(A)). However, this determination is not necessarily required, and the quiz game may end after the occupant 100 has given an answer, regardless of whether the answer was correct or incorrect. Even such a game would contribute to reducing boredom and motion sickness for the occupant 100.

[0055] Figure 10(A) is a flowchart showing an example of processing between the control server 2 and the vehicle V's controller 3 regarding the crew's response, replacing the processing in Figure 8(A). During the game, the controller 3 monitors the behavior of the crew 100 to determine whether or not they have responded (S71). For example, if the input device 15 picks up the voice of the crew 100, it is determined that the crew 100 has responded. Alternatively, if the detection unit 14 detects the crew 100 raising their hand, it is determined that the crew 100 has responded. The content of the response is irrelevant. Figure 10(B) shows an example of behavior that indicates the crew 100 has responded. In the example in Figure 10(B), the crew 100's raising of their hand is detected while audio data is being played back from the audio output device 13a. This detection of the raising of the hand leads to the determination that the crew 100 has responded.

[0056] In S71, when it is detected that a crew member 100 has answered, the controller 3 stops playing the audio data (S72) and sends a correct answer request to the control server 2 (S73). The control server 2 sends a correct answer notification indicating the correct answer (S81). Based on the received correct answer notification, the controller 3 notifies the correct answer via the information provision unit 13 (S74). Figure 10(C) shows an example of the notification of the correct answer. In the illustrated example, the correct song title is output audibly from the audio output device 13a. The crew members 100 confirm with each other whether their answers were correct or not. After the notification of the correct answer in S74, one round of the quiz game ends.

[0057] Thus, in this embodiment, the information provision system 1 does not determine whether the crew member 100's answer is correct or incorrect, but rather leaves the determination to the crew member 100. Even with this game configuration, the crew member 100 can still share in the enjoyment of the quiz game.

[0058] <Fourth Embodiment> The information provision unit 13 may provide information indicating the suggestive information being provided between the start and end of the game. Figures 11(A) and 11(B) show an example of the display 130 of the display device 13b.

[0059] Display 130 in Figure 11(A) indicates that the currently provided suggestive information is the base part. Applying this to the example in Figure 4(A), Display 130 in Figure 11(A) is displayed from the start of the game until the presentation timing T1. Alternatively, Display 130 in Figure 11(A) may be displayed only at the start of the game.

[0060] The display 130 in Figure 11(B) indicates that the currently provided suggestive information consists of the bass part and the drum part. Applying this to the example in Figure 4(A), the display 130 in Figure 11(B) is shown from the provision timing T1 to the provision timing T2. Alternatively, the display 130 in Figure 11(B) may be shown only at the provision timing T1 stage when the suggestive information is added.

[0061] Display 130 in Figure 11(C) indicates that the currently provided suggestive information is the base part. Applying this to the example in Figure 4(A), Display 130 in Figure 11(C) is displayed from the start of the game until the presentation timing T1. Alternatively, Display 130 in Figure 11(C) may be displayed only at the start of the game.

[0062] Both Figure 11(A) and Figure 11(C) show examples indicating that the currently provided suggestive information is the base part, but Figure 11(A) uses text information, while Figure 11(C) uses icons. When vehicle V is stationary, notification may be made using icons, as in the example in Figure 11(C). When vehicle V is in motion, notification may be made using text information, as in the examples in Figures 11(A) and 11(B), or it may be a voice notification that reads out the text information. When reading out text information, playback of the voice data may be temporarily stopped.

[0063] <Fifth Embodiment> In the first embodiment, the mileage of vehicle V was used as an example of driving information, but it is not limited to this. Another example of driving information will be described.

[0064] (Example of travel time) Figure 12(A) shows an example where the driving information is the driving time of vehicle V, illustrating the relationship between the provision timing and the driving time. In this embodiment, the driving time does not include stopping time. However, the driving time may include stopping time. In the illustrated example, a provision timing (T1 to T4) occurs each time time t has elapsed. In the example of Figure 12(A), the provision timing occurs at the same time interval t, but the time may be different depending on the provision timing. For example, the driving time between provision timing T1 and provision timing T2 may be defined as time t0, and the driving time between provision timing T2 and provision timing T3 may be defined as time t1.

[0065] Figure 13(A) shows an example of the timing determination process in S34 of Figure 6(A) when the driving information is the driving time of vehicle V. As a premise of this embodiment, for example, in S5 of Figure 5(A), an initial value (=0) is transmitted from the controller 3 as driving information, and in S14, the initial value is stored in the storage unit 22 as reference information. In S22 of Figure 6(A), the driving time from the start of the game is transmitted from the controller 3 to the control server 2 as driving information.

[0066] In S91 of Figure 13(A), the reference information stored in the memory unit 22 is compared with the travel time, which is the travel information acquired in S33 of Figure 6(A), and the difference between them is calculated as the travel time since the reference information was acquired. In S92, if the travel time calculated in S91 is greater than or equal to the threshold, the process proceeds to S93; if the travel time is less than the threshold, the process proceeds to S95. In the example in Figure 12(A), the threshold is time t. In S93, the reference information in the memory unit 22 is updated with the travel time acquired in S33, and in the subsequent S94, the determination result is determined to provide. In S95, the determination result is determined to wait (not provide).

[0067] (Example of passing a target) Figure 12(B) shows an example where the driving information is the position of vehicle V, illustrating the relationship between the timing of information provision and the position of vehicle V. The position of vehicle V is detected by the GNSS sensor 9. In the example in Figure 12(B), the timing of information provision (T1-T4) occurs each time vehicle V passes a specific facility 200 on the side of the road. Facility 200 is, for example, a dealership (car dealer) that handles vehicle V. The dealership serves as a guide for additional suggestive information, drawing the attention of the occupant 100 to the location of the dealership.

[0068] Figure 13(B) shows an example of the timing determination process in S34 of Figure 6(A) when the driving information is the position of vehicle V. As a premise of this embodiment, for example, in S5 of Figure 5(A), the position of vehicle V is transmitted from the controller 3 as driving information, and in S14, the position of vehicle V is stored in the storage unit 22 as reference information. In S22 of Figure 6(A), the position of vehicle V is transmitted from the controller 3 to the control server 2 as driving information.

[0069] In S101 of Figure 13(A), the reference information stored in the memory unit 22 is compared with the current position of vehicle V, which is the driving information acquired in S33 of Figure 6(A), and the position information of each facility 200 stored in the memory unit 22. In this comparison, for example, the road and section traveled by vehicle V are identified from the reference information and the current position of vehicle V, and it is determined whether or not there are facilities 200 adjacent to the identified road and section. If there are, it is determined that vehicle V has passed through facility 200.

[0070] In S102 of Figure 13(B), if the comparison in S101 determines that vehicle V has passed facility 200, the process proceeds to S103; otherwise, the process proceeds to S105. In S103, the reference information in the storage unit 22 is updated to the position acquired in S33, and in the subsequent S104, the determination result is determined to be "provide". In S105, the determination result is determined to be "wait" (do not provide).

[0071] (Example of acceleration) Figure 12(C) shows an example where the driving information is the acceleration of vehicle V, illustrating the relationship between the timing of information provision and the acceleration of vehicle V. The acceleration of vehicle V is detected by the inertial sensor 10. In the example in Figure 12(C), the information provision timing (T1~T4) occurs each time the acceleration (deceleration) of vehicle V during deceleration reaches a predetermined threshold. The threshold is set to a value corresponding to the acceleration when the driver applies the brakes suddenly, for example. Additional suggestive information is provided each time the brakes are applied suddenly, so the driver can be alerted by the provision of this suggestive information.

[0072] Figure 13(C) shows an example of the timing determination process in S34 of Figure 6(A) when the driving information is the acceleration of the vehicle V. In this embodiment, for example, it is not necessary to transmit the acceleration of the vehicle V as driving information from the controller 3 in S5 of Figure 5(A), nor is it necessary to store the acceleration of the vehicle V as reference information in the storage unit 22 in S14. On the other hand, in S22 of Figure 6(A), the acceleration of the vehicle V is transmitted from the controller 3 to the control server 2 as driving information.

[0073] In S111 of Figure 13(C), it is determined whether the acceleration of vehicle V, which is the driving information acquired in S33 of Figure 6(A), is below a threshold. If the acceleration value during deceleration is a negative value, then the threshold is a negative value. If the acceleration is below the threshold, the process proceeds to S112; if the acceleration is greater than the threshold, the process proceeds to S113. In S112, the result is determined to provide. In S113, the result is determined to wait (do not provide).

[0074] (Example of vehicle speed) Figure 14(A) shows an example where the driving information is the vehicle speed of vehicle V, and illustrates the relationship between the timing of information provision and the number of times vehicle V has stopped. The vehicle speed of vehicle V is detected by the vehicle speed sensor 11. When the vehicle speed is 0, it is assumed that vehicle V has stopped, for example, due to waiting at a traffic light. In the example in Figure 14(A), the information provision timing (T1, T2...) occurs every two stops of vehicle V. In this example, two stops are used as a requirement for the information provision timing, but the number of stops can be one or three or more. Additional suggestive information is provided according to the number of times vehicle V has stopped, so that the driver can be alerted or encouraged to drive safely by providing this suggestive information.

[0075] Figure 15(A) shows an example of the timing determination process in S34 of Figure 6(A) when the driving information is the vehicle speed of vehicle V. In this embodiment, for example, it is not necessary for the controller 3 to transmit the vehicle speed of vehicle V as driving information in S5 of Figure 5(A), nor is it necessary to store the vehicle speed of vehicle V as reference information in the storage unit 22 in S14. On the other hand, in S22 of Figure 6(A), the vehicle speed of vehicle V is transmitted from the controller 3 to the control server 2 as driving information.

[0076] In S121 of Figure 15(A), it is determined whether vehicle V has stopped based on the vehicle speed of vehicle V, which is the driving information acquired in S33 of Figure 6(A). If the vehicle speed of vehicle V is 0, it is determined that vehicle V has stopped. In order to prevent misinterpreting one stop as multiple stops, for example, if the vehicle speed acquired in S33 of the previous processing cycle was not 0, and the vehicle speed acquired in S33 of the current processing cycle is 0, it may be determined that vehicle V has stopped. If it is determined that vehicle V has stopped, the process proceeds to S122; if it is determined that vehicle V has not stopped, the process proceeds to S126.

[0077] In S122, the control server 2 counts the number of stops. For example, it stores the number of stops in a predetermined storage area of ​​the storage unit 22 and increments the number of stops by one in S122. In S123, the control server 2 determines whether the number of stops counted in S122 is equal to or greater than a threshold. In the example in Figure 14(A), the threshold is 2. If the number of stops is equal to or greater than the threshold, the process proceeds to S124; if the number of stops is less than the threshold, the process proceeds to S126.

[0078] In S124, the control server 2 resets the number of stops stored in the memory unit 22. For example, it sets the number of stops to 0. In S124, the determination result is determined to provide. In S126, the determination result is determined to wait (not provide).

[0079] (Example of surrounding image) Figure 14(B) shows an example where the driving information is an image of the area around vehicle V, illustrating the relationship between the timing of information provision and the passing of oncoming vehicles of the same make and model as vehicle V. The image of the area around vehicle V is captured by the detection unit 8. The make and model of oncoming vehicles is recognized from the images of oncoming vehicles included in the surrounding image based on their external characteristics. Each time vehicle V passes an oncoming vehicle of the same make and model, a information provision timing (T1, T2...) occurs. In the example shown in the figure, oncoming vehicles V1 and V3 are of the same make and model as vehicle V, while oncoming vehicle V2 is of a different make and model. When vehicle V passes oncoming vehicle V1, the information provision timing T1 occurs, and when it passes oncoming vehicle V3, the next information provision timing T2 occurs.

[0080] When vehicle V passes another vehicle of the same type, additional suggestive information is provided, which can encourage the driver to pay attention to the surroundings of vehicle V or to drive safely.

[0081] In the example in Figure 14(B), an oncoming vehicle is used as an example of a vehicle of the same type passing vehicle V. However, the timing for providing the service may also be set so that it occurs each time a vehicle of the same type traveling in the same lane or a stationary vehicle of the same type passes by.

[0082] Furthermore, "the same vehicle model" can refer to vehicles with the same model name, or vehicles with the same model name and trim level. It can also refer to vehicles in the same vehicle segment.

[0083] Figure 15(B) shows an example of the timing determination process in S34 of Figure 6(A) when the driving information is an image of the area around the vehicle V. In this embodiment, for example, in S5 of Figure 5(A), the controller 3 transmits vehicle type information of the vehicle V instead of driving information, and in S14, the vehicle type information of the vehicle V is stored in the storage unit 22 as reference information. In S22 of Figure 6(A), the controller 3 transmits an image of the area around the vehicle V to the control server 2 as driving information.

[0084] In S131 of Figure 15(B), the type of vehicle of the oncoming vehicle is recognized based on the surrounding image of vehicle V, which is driving information acquired in S33 of Figure 6(A). In S132, the control server 2 determines whether the type of vehicle of the oncoming vehicle recognized in S131 is the same as the type of vehicle V stored as reference information in the storage unit 22. If it is determined to be the same, the process proceeds to S133; if it is determined to be different, the process proceeds to S134. In S133, the result is determined to provide. In S134, the result is determined to wait (do not provide).

[0085] (Example of a combination of multiple types of driving information) The timing of providing suggestive information may be controlled based on multiple types of driving information. For example, the driving information could be the distance traveled and position of vehicle V, and suggestive information could be provided each time vehicle V travels a distance L, as in the first embodiment, and also each time vehicle V passes a specific facility 200, as in the examples in Figures 12(B) and 13(B). Alternatively, for example, the driving information could be the distance traveled, position, and speed of vehicle V, and suggestive information could be provided each time vehicle V travels a distance L, as in the first embodiment, and also each time vehicle V passes a specific facility 200, as in the examples in Figures 12(B) and 13(B), and further, each time vehicle V stops a predetermined number of times, as in the examples in Figures 14(A) and 15(A).

[0086] By controlling the timing of providing suggestive information based on multiple types of driving data in this way, the enjoyment of the quiz game can be enhanced, and drivers can be encouraged to drive safely.

[0087] <Sixth Embodiment> In the first embodiment, an example was shown in which the song information M is divided into audio data for each instrument and vocal part (Figure 3). However, the song information M may be stored in the database 22a as an audio source without being divided into parts, and then separated into audio data for each part using audio source separation technology when providing the quiz game. Existing technologies such as FFT (Fast Fourier Transform) or AI (Artificial Intelligence) can be used for audio source separation.

[0088] Figure 16 is a flowchart illustrating an example of the processing between the control server 2 and the vehicle V's controller 3 regarding the start of a quiz game in this embodiment, replacing Figure 5(A). The processing in Figure 16 that is the same as that in Figure 5(A) will not be explained, and only the different processing will be described.

[0089] After selecting a song in S12, the control server 2 performs separation processing in S15 before proceeding to the processing in S13. In the separation processing in S15, the sound source of the song selected in S12 is obtained from the database 22a, and sound source separation processing is performed on the obtained sound source to generate audio data for each instrument and vocal part. Each generated audio data is stored in the storage unit 22 and provided to the crew 100 as suggestive information when the timing for provision arrives. This simplifies the management of song sound sources while providing each audio data as suggestive information to the crew 100.

[0090] <Seventh Embodiment> The controller 3 may perform at least a portion of the processing performed by the control server 2 as illustrated in the first embodiment. Figure 17 is a flowchart illustrating an example of processing in this embodiment, replacing Figure 5(A), and shows an example of processing between the control server 2 and the vehicle V's controller 3 regarding the start of a quiz game. In this embodiment, the vehicle V's mileage is assumed as the driving information. However, as illustrated in the fifth embodiment, other driving information besides mileage can also be applied.

[0091] The occupants of vehicle V instruct controller 3 to start the quiz game. The start instruction is given, for example, via input device 15 or input device 16. Upon receiving the start instruction, controller 3 sends a request to start the quiz game to control server 2 (S161). Control server 2 receives the start request and sends a setting request to controller 3, which sent the start request (S171). The setting request includes the occupants' selections regarding the specifications of the quiz game. In this embodiment, the setting request includes items for selecting the songs to be used in the quiz.

[0092] The controller 3 accepts input of the crew's selections in response to the setting request from the control server 2 (S162). For example, as illustrated in Figure 5(B), the input device 16 accepts input of the selections.

[0093] Controller 3 transmits input information indicating the occupant's selection result to control server 2 (S163). Control server 2 receives the input information transmitted from controller 3, acquires the input information, and based on the acquired input information, selects a song to be presented from the song information stored in database 22a (S172). After selecting a song, control server 2 transmits the selected song information M (Figure 3) and its title to controller 3 (S173). Controller 3 stores the received song information M in its memory device and notifies the occupant of the start of the game via information provision unit 13 (S164). Controller 3 also acquires the current mileage from internal information as driving information and stores it in controller 3's memory device (S165).

[0094] Figure 18(A) is a flowchart showing an example of the processing performed by Controller 3 regarding the provision of suggestive information, which replaces the processing shown in Figure 6(A). Figure 18(B) is a flowchart showing an example of the processing performed by Controller 3 regarding the determination of the correctness of the crew's answers, which replaces the processing shown in Figure 8(A). These processes are executed in parallel. In this embodiment, the control server 2 essentially only provides the music information M, while the processing related to the provision of suggestive information and the determination of the correctness of the answers are all performed by Controller 3.

[0095] First, let's explain the processing example in Figure 18(A). The controller 3 starts playing the audio data of the first part as suggestive information from the music information M received from the control server 2 (S181). In the example in Figure 4(A), the audio of audio data P1 is output from the audio output device 13a.

[0096] Controller 3 obtains the mileage as driving information from its internal data (S182) and determines whether or not it is time to provide the next suggestion information (S183). The determination process in S183 is the same as the determination process in Figure 7, and Controller 3 performs this instead of Control Server 2.

[0097] In S184, the controller 3 determines whether or not it is time to provide suggestive information. In the determination in S183, if it is determined to provide the information, the process proceeds to S185; if it is determined to wait, the process returns to S182 and the same process is repeated. In S185, the controller 3 starts playing the next part of the audio data in addition to the audio data that is already being played (S185). In the example in Figure 4(A), if the provision timing T1 arrives, the controller 3 starts playing the drum part of the audio data P2 overlaid on the bass part of the audio data P1 that is already being played. The crew member 100 receives the audio of the bass part and drum part from the audio output device 13a.

[0098] In S186, controller 3 determines whether playback of all parts' audio data has started. If it has started, the process proceeds to S187. If playback of all parts' audio data has not started, the process returns to S182 and the same process is repeated. In S187, controller 3 determines whether playback of all parts' audio data has finished. If it has finished, the process proceeds to S188. If playback of all parts' audio data has not finished, playback continues until it is completed.

[0099] In S188, the controller 3 notifies the song title via the information provision unit 13. The song title is the one received from the control server 2 along with the song information M in S173. If no correct answer is given by the crew 100, all of the processing shown in Figure 6(A) will be executed.

[0100] In this embodiment, the timing of providing each suggestion information (voice data P1 to P5) is controlled by the controller 3 based on driving information.

[0101] Next, with reference to Figure 18(B), an example of the processing performed by the controller 3 regarding the determination of the correctness of the crew member's response will be explained.

[0102] During the game, controller 3 receives and retrieves responses from crew member 100 (S191). Crew member 100 can input quiz answers into input devices 15 and 16. For example, if crew member 100 inputs an answer by voice, detection unit 14 detects crew member 100 raising their hand, then input device 15 records crew member 100's answer, and speech recognition processing is performed on the recorded voice to identify the answer. Upon receiving the answer in S191, controller 3 pauses playback of the voice data (S192) and determines whether the received answer is correct or not (S193). The correct answer is the song title received from control server 2 along with song information M in S173.

[0103] If the answer is correct, the process proceeds to S194; if the answer is incorrect, the process proceeds to S195. In S195, the controller 3 is notified by the information provision unit 13 that the answer is incorrect and resumes playback of the audio data (S196). On the other hand, in S194, the controller 3 is notified by the information provision unit 13 that the answer is correct. After the notification of the correct answer in S194, one round of the quiz game ends. Alternatively, after the notification of the correct answer in S194, playback of the audio data may be resumed and the song may be played to the end. In that case, the controller 3 may play all parts of the audio data to the end.

[0104] In this way, the controller 3 can control the provision of suggestive information and determine whether the crew member's response is correct or incorrect. When this embodiment is combined with the sixth embodiment, in S173 the control server 2 may send the music information M to the controller 3 as a sound source that is not separated into parts, and the controller 3 may perform sound source separation processing to generate audio data for each part.

[0105] <Eighth Embodiment> The mobile terminal 4 may perform at least a portion of the processing performed by the control server 2 as illustrated in the first embodiment. Figure 19(A) is a block diagram of the mobile terminal 4.

[0106] The mobile terminal 4 is a communication terminal that includes a processing unit 41, a storage unit 42, a display unit 43, an input unit 44, a communication unit 45, an acceleration sensor 46, and a GNSS sensor 47, and is, for example, a smartphone. The processing unit 41 is a processor, such as a CPU, and executes programs stored in the storage unit 42. The storage unit 42 is a storage device such as RAM or ROM.

[0107] The display unit 43 is a device that serves both to display images and to accept input operations from the occupant, such as a touch panel. The input unit 44 is a device that accepts touch operations or voice input from the occupant. The acceleration sensor 46 is a sensor that detects the acceleration acting on the mobile terminal 4. The GNSS sensor 47 is a sensor that detects the current location of the mobile terminal 4.

[0108] In this embodiment, the mobile terminal 4 controls the information provision unit 13 of the vehicle V via the controller 3 to provide a quiz in which the player guesses the title of a song.

[0109] Figure 19(B) is a flowchart illustrating an example of processing in this embodiment, replacing Figure 5(A), and shows an example of processing between the mobile terminal 4 and the control server 2 regarding the start of a quiz game. In this embodiment, the mileage of the vehicle V is assumed as the driving information. However, as illustrated in the fifth embodiment, other driving information besides mileage can also be applied.

[0110] The occupant 100 of vehicle V instructs the mobile terminal 4 to start the quiz game. The start instruction is given, for example, via the display unit 43 or the input unit 44. Upon receiving the start instruction, the mobile terminal 4 sends a request to the control server 2 to start the quiz game (S201). The control server 2 receives the start request and sends a setting request to the mobile terminal 4 that sent the start request (S211). The setting request includes the occupant's selections regarding the specifications of the quiz game. In this embodiment, the setting request includes items for selecting the songs to be used in the quiz.

[0111] The mobile terminal 4 accepts input of the crew's selections in response to setting requests from the control server 2 (S202). For example, the display unit 43 displays the same information as in Figure 5(B) to accept the input of the selections.

[0112] The mobile terminal 4 transmits input information indicating the crew member's selection result to the control server 2 (S203). The control server 2 receives the input information transmitted from the mobile terminal 4, acquires the input information, and based on the acquired input information, selects a song to be presented from the song information stored in the database 22a (S212). After selecting the song, the control server 2 transmits the selected song information M (Figure 3) and its title to the mobile terminal 4 (S213). The mobile terminal 4 stores the received song information M in the storage unit 42.

[0113] Figure 21(A) is a flowchart illustrating an example of processing between the mobile terminal 4 and the controller 3 regarding the provision of suggestive information, which is an alternative to the process shown in Figure 6(A). Also, Figure 21 is a flowchart illustrating an example of processing between the mobile terminal 4 and the controller 3 regarding the determination of the correctness of the crew member's response, which is an alternative to the process shown in Figure 8(A). These processes are executed in parallel. In this embodiment, the control server 2 essentially only provides the music information M, while the mobile terminal 4 performs all processing related to the provision of suggestive information and the determination of the correctness of the response.

[0114] First, let's explain the processing example shown in Figure 20. The mobile terminal 4 sends a game start notification to the controller 3 (S221). The start notification includes a request to acquire driving information. The controller 3 notifies the occupants of the start of the game via the information provision unit 13 (S231). The controller 3 also sends the vehicle V's mileage as driving information to the mobile terminal 4 (S232). The mobile terminal 4 stores the received mileage in the storage unit 42 as reference information (S222).

[0115] The mobile terminal 4 transmits the first part of the music information M received from the control server 2 to the controller 3 as suggestive information (S223). In the example in Figure 4(A), audio data P1 is transmitted to the controller 3. Upon receiving the first part, the controller 3 starts playing the audio data of the received part (S233). The audio of the first part is output from the audio output device 13a.

[0116] The mobile terminal 4 requests driving information of vehicle V from the controller 3 (S224). The controller 3 responds to the request and transmits the driving information (S234). The mobile terminal 4 receives the driving information from the controller 3 (S225) and determines whether or not it is time to provide the next suggestion information (S226). The determination process in S226 is the same as the determination process in Figure 7, and the mobile terminal 4 performs this instead of the control server 2.

[0117] In S227, the mobile terminal 4 determines whether it is time to provide suggestive information. In the determination in S226, if it is determined to provide the information, the process proceeds to S228; if it is determined to wait, the process returns to S224 and the same process is repeated. In S228, the mobile terminal 4 transmits the audio data for the next part to the controller 3 as additional suggestive information. The controller 3 starts playing the audio data for the received part in addition to the audio data that is already being played (S235). In the example in Figure 4(A), if the provision timing T1 arrives, the audio data P2 is transmitted from the mobile terminal 4 to the controller 3. The controller 3 starts playing the drum part of the audio data P2 over the bass part of the audio data P1 that is already being played. The bass part and drum part are output to the crew member 100 from the audio output device 13a.

[0118] In S229, the mobile terminal 4 determines whether it has sent all the audio data for all parts to the controller 3. In the example in Figure 4(A), it determines whether all of the audio data P1 to P5 has been sent to the controller 3. If the audio data for all parts has not been sent to the controller 3, the process returns to S224 and the same process is repeated. If the audio data for all parts has been sent to the controller 3, the mobile terminal 4 waits for a playback completion notification from the controller 3.

[0119] When the playback of all audio data parts is complete, the controller 3 sends a playback completion notification to the mobile terminal 4 (S236). Upon receiving the playback completion notification, the mobile terminal 4 sends a correct answer notification to the controller 3 indicating the title of the song that was presented (S230). The correct answer is the song title received from the control server 2 along with the song information M in S213. Upon receiving the correct answer notification, the controller 3 announces the song title via the information provision unit 13 (S237). If no correct answer is given by the crew 100, all the processes in Figure 20 will be executed.

[0120] In this way, in this embodiment, the timing of providing each suggestive piece of information (voice data P1 to P5) is controlled by the mobile terminal 4 based on driving information.

[0121] Next, with reference to Figure 21, an example of the processing between the mobile terminal 4 and the vehicle V's controller 3 regarding the determination of the correctness of the crew member's answer will be described. During the game, the controller 3 receives answers from the crew member 100 (S251). The crew member 100 can input quiz answers into input devices 15 and 16. Upon receiving an answer in S251, the controller 3 pauses the playback of the audio data (S252) and sends the received answer to the mobile terminal 4 (S253).

[0122] The mobile terminal 4 receives the answer from the controller 3 (S240) and determines whether the received answer is correct or not (S241). If the answer is correct, the process proceeds to S243; if the answer is incorrect, the process proceeds to S242. The correct answer is the song title received from the control server 2 along with the song information M in S213.

[0123] In S242, the mobile terminal 4 sends an incorrect answer notification to the controller 3 indicating that the answer is incorrect. Upon receiving the incorrect answer notification, the controller 3 notifies the information provider unit 13 that the answer is incorrect (S254) and resumes playback of the audio data (S255).

[0124] In S243, the mobile terminal 4 sends a correct answer notification to the controller 3 indicating that the answer is correct. Upon receiving the correct answer notification, the controller 3 notifies the information provider unit 13 that the answer is correct (S256). After the notification of the correct answer in S256, one round of the quiz game ends. Alternatively, after the notification of the correct answer in S256, playback of the audio data may be resumed and the song may be played to the end. In that case, the mobile terminal 4 may send all parts of the audio data to the controller 3, and the controller 3 may play all parts of the audio data to the end.

[0125] In this way, the mobile terminal 4 can control the provision of suggestive information and determine whether the crew member's response is correct or incorrect. When this embodiment is combined with the sixth embodiment, in S213 the control server 2 may send the music information M to the mobile terminal 4 as an audio source that is not separated into parts, and the mobile terminal 4 may perform an audio source separation process to generate audio data for each part.

[0126] <Other Embodiments> In the above embodiment, a quiz asking the crew member 100 to guess the title of a song was given as an example, but the content of the quiz is not limited to this. The content of the quiz may be questions that test knowledge of academic subjects such as history, science, geography, and literature, and the suggestive information only needs to be hints that suggest the correct answer to the question.

[0127] In the above embodiment, the programs executed by the control server 2, controller 3, and mobile terminal 4 may be installed via a storage medium such as a CD-ROM, or they may be downloaded from a server that provides the programs.

[0128] <Summary of Embodiments> The above embodiments disclose inventions relating to at least the following items.

[0129] Item 1. A control device (2,3,4) that controls an information providing means (13) that provides information to the occupants of a vehicle, Control means (S34-S36, S183-S185, S226-S228) for controlling the information providing means (13) so that multiple pieces of suggestive information indicating the correct answer to the quiz are provided sequentially to the occupants of the vehicle, The system includes acquisition means (S33, S182, S225) for acquiring driving information that changes according to the movement of the vehicle, The control means is The timing of providing each subsequent piece of suggestive information after the initial suggestive information is controlled based on the driving information acquired by the acquisition means (S34-S36, S183-S185, S226-S228). A control device characterized by the following features. According to this embodiment, it is possible to provide a technology that allows multiple occupants to share enjoyment while the vehicle is in motion.

[0130] Item 2. The control device described in item 1, The aforementioned driving information is, The vehicle includes at least one of the following: distance traveled, time traveled, position, acceleration, vehicle speed, and surrounding images. A control device characterized by the following features. According to this embodiment, suggestive information can be provided as the vehicle is in motion.

[0131] Item 3. The control device described in item 1, The aforementioned driving information is the mileage of the vehicle. The control means is The information providing means is controlled such that the next suggestion information after the provision of one of the plurality of suggestion information is provided when the distance traveled since the provision of the first suggestion information reaches a threshold. A control device characterized by the following features. According to this embodiment, it is possible to prevent occupants from feeling bored or experiencing motion sickness. By varying the timing of providing suggestive information, it is possible to keep occupants entertained with a quiz game while preventing a decrease in their attention to driving.

[0132] Item 4. The control device described in item 1, The aforementioned driving information is the driving time of the vehicle. The control means is The information providing means is controlled such that the next suggestion information after the provision of one of the plurality of suggestion information is provided when the driving time since the provision of the first suggestion information reaches a threshold. A control device characterized by the following features. According to this embodiment, it is possible to prevent passengers from feeling bored or experiencing motion sickness.

[0133] Item 5. The control device described in item 1, The aforementioned driving information is the position of the vehicle, The control means is Based on the aforementioned location, it is determined whether or not the vehicle has passed a dealership that handles the vehicle. The information providing means is controlled so that the next suggestive information after the provision of one of the plurality of suggestive information is provided when the first suggestive information has been provided and the dealer has passed through the dealer. A control device characterized by the following features. This embodiment prevents occupants from feeling bored or experiencing motion sickness. It allows occupants to enjoy a quiz game while varying the timing of suggestive information provided, without diminishing their attention to driving. It can also increase occupants' interest in the dealership.

[0134] Item 6. The control device described in item 1, The aforementioned driving information is the acceleration of the vehicle, The control means is The information providing means is controlled such that the next suggestion information after the provision of one of the plurality of suggestion information is provided when the acceleration during deceleration after the provision of the first suggestion information reaches a threshold. A control device characterized by the following features. According to this embodiment, it is possible to prevent occupants from feeling bored or experiencing motion sickness. By varying the timing of providing suggestive information, it is possible to keep occupants entertained with a quiz game while preventing a decrease in their attention to driving.

[0135] Item 7. The control device described in item 1, The aforementioned driving information is the vehicle speed of the vehicle. The control means is Based on the aforementioned vehicle speed, the number of times the vehicle stops is counted. The information providing means is controlled such that the next suggestion information after the provision of one of the plurality of suggestion information is provided when the number of stops since the provision of the first suggestion information reaches a threshold. A control device characterized by the following features. According to this embodiment, it is possible to prevent occupants from feeling bored or experiencing motion sickness. By varying the timing of providing suggestive information, it is possible to keep occupants entertained with a quiz game while preventing a decrease in their attention to driving.

[0136] Item 8. The control device described in item 1, The aforementioned driving information is an image of the area surrounding the vehicle. The control means is Based on the surrounding images, it is determined whether or not the vehicle passed by another vehicle of the same type as the vehicle in question. The information providing means is controlled so that the next suggestion information after the provision of one of the aforementioned multiple pieces of suggestion information is provided when it is determined that the vehicle has passed another vehicle of the same type as the vehicle after the provision of the first suggestion information. A control device characterized by the following features. According to this embodiment, it is possible to prevent occupants from feeling bored or experiencing motion sickness. By varying the timing of providing suggestive information, it is possible to keep occupants entertained with a quiz game while preventing a decrease in their attention to driving.

[0137] Item 9. A control device as described in any one of items 1 to 8, The above quiz is about song titles, The aforementioned multiple pieces of suggestive information are the sounds of each instrument and vocals in the aforementioned song. A control device characterized by the following features. According to this embodiment, multiple passengers can enjoy a quiz game, and the driver can also actively participate in the game.

[0138] Item 10. The control device described in item 9, The system includes separation means (S15) for separating the sound source of the aforementioned song into the sounds of each instrument and the vocals. A control device characterized by the following features. According to this embodiment, it is possible to make it easier to manage the sound sources of musical pieces.

[0139] Item 11. A control device as described in any one of items 1 to 10, The vehicle is equipped with an answer acquisition means (S60, S191, S240) that acquires the occupant's response via input means (15, 16) provided in the vehicle, The control means is If the answer obtained by the answer acquisition means is correct, the information provision means will notify that it is correct (S63, S194, S243). A control device characterized by the following features. According to this embodiment, the crew can know the correct answer, which can make the game more exciting.

[0140] Item 12. A control device as described in any one of items 1 to 10, The vehicle is equipped with difficulty level acquisition means (S12, S162, S202) that acquires the difficulty level selected by the occupant via input means (15, 16) provided in the vehicle, The control means is The order in which the multiple pieces of suggestive information are provided is changed according to the difficulty level acquired by the difficulty level acquisition means. A control device characterized by the following features. According to this embodiment, the difficulty level of the quiz can be changed while using the same song.

[0141] Item 13. A control method for controlling an information provision means that provides information to the occupants of a vehicle, A control step of controlling the information providing means so that multiple pieces of suggestive information that indicate the correct answer to the quiz are provided sequentially to the occupants of the vehicle, The system includes an acquisition step for acquiring driving information that changes according to the movement of the vehicle, In the control process described above, The timing of providing each subsequent piece of suggestive information after the initial suggestive information is controlled based on the driving information acquired in the acquisition step. A control method characterized by the following: According to this embodiment, it is possible to provide a technology that allows multiple occupants to share enjoyment while the vehicle is in motion.

[0142] Item 14. A program that causes a computer to execute a control method for controlling an information provision means that provides information to the occupants of a vehicle, wherein the control method is: A control step of controlling the information providing means so that multiple pieces of suggestive information that indicate the correct answer to the quiz are provided sequentially to the occupants of the vehicle, The system includes an acquisition step for acquiring driving information that changes according to the movement of the vehicle, In the control process described above, The timing of providing each subsequent piece of suggestive information after the initial suggestive information is controlled based on the driving information acquired in the acquisition step. A program characterized by the following features. According to this embodiment, it is possible to provide a technology that allows multiple occupants to share enjoyment while the vehicle is in motion.

[0143] Although embodiments of the invention have been described above, the invention is not limited to the above embodiments, and various modifications and changes are possible within the scope of the gist of the invention. [Explanation of symbols]

[0144] 1. Information processing system, 2. Control server, 3. Controller, 4. Mobile terminal

Claims

1. A control device for controlling an information provision means that provides information to the occupants of a vehicle, A control means for controlling the information providing means so that a plurality of suggestive pieces of information that suggest the correct answer to the quiz are provided sequentially to the occupants of the vehicle, The system includes an acquisition means for acquiring images of the area surrounding the vehicle that change according to the movement of the vehicle, The control means is Based on the surrounding images, it is determined whether or not the vehicle passed by another vehicle of the same type as the vehicle in question. After providing one of the aforementioned multiple pieces of suggestive information, the information providing means is controlled so that the next piece of suggestive information is provided when it is determined that the vehicle has passed another vehicle of the same type as the vehicle after the first piece of suggestive information has been provided. A control device characterized by the following features.

2. A control device according to claim 1, The above quiz is about song titles, The aforementioned multiple pieces of suggestive information are the sounds of each instrument and vocals in the aforementioned song. A control device characterized by the following features.

3. A control device according to claim 2, The system includes a separation means for separating the sound source of the aforementioned song into the sounds of each instrument and the vocals. A control device characterized by the following features.

4. A control device according to claim 1, The vehicle is equipped with an answer acquisition means that acquires the occupant's response via an input means provided in the vehicle, The control means is If the answer obtained by the answer acquisition means is correct, the information provision means will notify that it is correct. A control device characterized by the following features.

5. A control device according to claim 1, The vehicle is equipped with a difficulty level acquisition means that acquires the difficulty level selected by the occupant via an input means provided in the vehicle, The control means is The order in which the multiple pieces of suggestive information are provided is changed according to the difficulty level acquired by the difficulty level acquisition means. A control device characterized by the following features.

6. A control method for controlling an information provision means that provides information to the occupants of a vehicle, A control step of controlling the information providing means so that multiple pieces of suggestive information that indicate the correct answer to the quiz are provided sequentially to the occupants of the vehicle, The process includes an acquisition step of acquiring an image of the area surrounding the vehicle that changes according to the movement of the vehicle, In the control process described above, Based on the surrounding images, it is determined whether or not the vehicle passed by another vehicle of the same type as the vehicle in question. After providing one of the aforementioned multiple pieces of suggestive information, the information providing means is controlled so that the next piece of suggestive information is provided when it is determined that the vehicle has passed another vehicle of the same type as the vehicle after the first piece of suggestive information has been provided. A control method characterized by the following:

7. A program that causes a computer to execute a control method for controlling an information provision means that provides information to the occupants of a vehicle, wherein the control method is: A control step of controlling the information providing means so that multiple pieces of suggestive information that indicate the correct answer to the quiz are provided sequentially to the occupants of the vehicle, The process includes an acquisition step of acquiring an image of the area surrounding the vehicle that changes according to the movement of the vehicle, In the control process described above, After providing one of the aforementioned multiple pieces of suggestive information, the information providing means is controlled so that the next piece of suggestive information is provided when it is determined that the vehicle has passed another vehicle of the same type as the vehicle after the first piece of suggestive information has been provided. A program characterized by the following features.

Images