Information processing device, information processing method, and program

Abstract

This information processing device (1) comprises an output control unit (10), an input unit (20), a determination unit (30), and a mode setting unit (40). The output control unit (10) outputs question information relating to whether a co-occupant is present in a moving body. The input unit (20) receives input of response information relating to a response by an occupant to the question information. The determination unit (30) determines, using the response information, whether a co-occupant is present in the moving body. The mode setting unit (40) determines, using the result of the determination by the determination unit (30), whether to apply a first mode for operating as a voice recognition device upon detecting a first keyword, or a second mode for operating as a voice recognition device even when no first keyword is detected.

Description

Information processing device, information processing method, and program

[0001] The present invention relates to an information processing device, an information processing method, and a program.

[0002] Patent Document 1 (JP 2020-148805 A) discloses a technology that detects the number of people in the vicinity and, if the detected number of people in the vicinity is one, makes it possible to omit a trigger word for enabling voice recognition.

[0003] Patent Document 2 (WO 2017 / 042906) discloses a technology that determines whether there is a single or multiple speaker in a vehicle and changes the speech recognition method depending on the number of speakers in the vehicle.

[0004] JP 2020-148805 A International Publication No. 2017 / 042906 A

[0005] A known technique is to use a wake-up word (trigger word) to request a speech recognition device to execute a predetermined command (such as directions) when performing speech recognition. In particular, when there are multiple speakers, the speech recognition device may erroneously recognize an unintended speech (command) and request an unintended command from the speech recognition device. Therefore, using a wake-up word for speech recognition reduces erroneous recognition by the speech recognition device.

[0006] On the other hand, when there is only one speaker, the possibility of the voice recognition device making an erroneous voice recognition is small, so it becomes very cumbersome to also use a wake-up word every time a command is requested to be executed by the voice recognition device.

[0007] Patent Literature 1 describes a method for acquiring audio, detecting the number of people around the vehicle based on the audio, and executing subsequent audio processing if the detected number of people is one without recognizing a trigger word. However, it is difficult to analyze audio information inside the vehicle, including audio sounds, engine sounds, and voices of multiple speakers, and accurately detect the number of people inside the vehicle based on the audio information.

[0008] Furthermore, Patent Document 2 describes a method for determining the number of passengers in a vehicle using a camera or pressure sensor installed in the vehicle. However, it is difficult to accurately detect whether there is one or more passengers in the vehicle because the passengers may not be clearly visible on the camera or may have luggage inside the vehicle. If the number of passengers is incorrectly detected, the voice recognition device may be activated unintentionally, which may disrupt a comfortable drive.

[0009] The problem to be solved by the present invention is to provide an information processing device that can suppress erroneous voice recognition and realize a comfortable drive.

[0010] The invention described in claim 1 is an information processing device comprising: an output control unit that outputs question information regarding the presence or absence of passengers in a vehicle; an input unit that inputs answer information regarding the passenger's answer to the question information; a judgment unit that uses the answer information to determine whether or not there are passengers in the vehicle; and a mode setting unit that uses the judgment result of the judgment unit to determine whether to apply a first mode that operates as a voice recognition device when a first keyword is detected, or a second mode that operates as a voice recognition device even if the first keyword is not detected.

[0011] The invention described in claim 11 is an information processing method in which a computer realizing an information processing device outputs question information regarding the presence or absence of passengers in a vehicle, receives answer information regarding the passenger's response to the question information, uses the answer information to determine whether or not there are passengers in the vehicle, and determines whether or not there are passengers in the vehicle using the result of the determination of whether or not there are passengers in the vehicle to apply either a first mode in which the device operates as a voice recognition device when a specified keyword is detected, or a second mode in which the device operates as a voice recognition device even if the keyword is not detected.

[0012] The invention described in claim 12 is a program for causing a computer realizing an information processing device to execute the following steps: outputting question information regarding the presence or absence of passengers in the vehicle; inputting answer information regarding the passenger's response to the question information; using the answer information to determine whether or not there are passengers in the vehicle; and using the result of the determination of whether or not there are passengers in the vehicle to apply either a first mode in which the device operates as a voice recognition device when a specified keyword is detected, or a second mode in which the device operates as a voice recognition device even if the keyword is not detected.

[0013] FIG. 1 is a block diagram showing an outline of an information processing device according to a first embodiment; FIG. 2 is a diagram showing an example of the hardware configuration of the information processing device; FIG. 3 is a flow diagram of a process in which the information processing device according to the first embodiment applies the first mode or the second mode; FIG. 4 is a block diagram showing an outline of an information processing device according to a second embodiment; FIG. 5 is a flow diagram of a process in which the storage processing unit according to the second embodiment stores mode determination information in the storage unit; and FIG. 6 is a block diagram for explaining the functions of an input unit and a storage processing unit according to a fourth embodiment.

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, like components are designated by like reference numerals, and the description thereof will be omitted as appropriate.

[0015] In the following description, each component of each device represents a functional block, not a hardware configuration. Each component of each device is realized by any combination of hardware and software, centered around the CPU of any computer, memory, a program loaded into the memory, a storage medium such as a hard disk that stores the program, and a network connection interface. There are many variations in the realization method and device.

[0016] [First embodiment] (Information processing device 1) Fig. 1 is a block diagram showing an outline of an information processing device 1 according to a first embodiment. The information processing device 1 will be described using Fig. 1. In the first embodiment, the information processing device 1 is provided outside the vehicle. The information processing device 1 may be a so-called cloud server.

[0017] In the first embodiment, the information processing device 1 includes a voice recognition function. The information processing device 1 receives a predetermined command (e.g., route guidance, search, etc.) as voice information and executes a process corresponding to the command. Examples of the predetermined command include "display the route to the nearest station" and "find the nearest parking lot." The information processing device 1 receives the command as voice information and executes a process corresponding to the command (display the route to the nearest station, find the nearest parking lot).

[0018] The information processing device 1 operates as a voice recognition device when it detects a first keyword. In other words, when the information processing device 1 detects a first keyword, it accepts voice information uttered after the first keyword as a predetermined command. The first keyword is a so-called wake-up word (= trigger word). The wake-up word is a keyword necessary for causing the information processing device 1 to execute a predetermined command (to execute voice recognition processing). For example, if "A" is registered as the first keyword, and the driver utters "A, find a nearby parking lot," the information processing device 1 accepts "find a nearby parking lot" (voice information uttered after the first keyword) as a predetermined command.

[0019] (Intra-vehicle device 2) The intra-vehicle device 2 is mounted on the moving body. The intra-vehicle device 2 may be brought in from outside the moving body or may be attached to the moving body in advance. In the first embodiment, the moving body is a vehicle. The intra-vehicle device 2 includes a camera unit 2a, an audio output unit 2b, an audio input unit 2c, and a position sensor unit 2d. Although not shown, the intra-vehicle device 2 may also include a display.

[0020] The camera unit 2a has an in-camera and an out-camera (not shown). The in-camera faces the interior of the vehicle and at least the driver's seat is included in the imaging range. The in-camera images the interior of the vehicle so that the driver is visible. Alternatively, the in-camera may image the entire interior of the vehicle so that passengers (driver and passengers) are visible. The out-camera faces outside the vehicle and images the situation outside the vehicle.

[0021] In the first embodiment, the audio output unit 2b includes a speaker (not shown) and outputs a mechanical voice from the speaker.

[0022] The voice input unit 2c includes at least one microphone (not shown). Voices uttered by passengers are input to the voice input unit 2c. The passengers include the driver and fellow passengers.

[0023] The position sensor unit 2d acquires the position information of the mobile object, for example, by using the Global Navigation Satellite System (GNSS).

[0024] The in-vehicle device 2 is configured to be able to communicate with the information processing device 1 via a communication network 101. The communication network 101 includes, for example, communication over a 4G or 5G line. The in-vehicle device 2 is configured to include an external communication unit (not shown) for configuring the communication network 101.

[0025] (Output control unit 10) The information processing device 1 includes an output control unit 10, an input unit 20, a determination unit 30, and a mode setting unit 40. The output control unit 10 outputs question information. In the first embodiment, the output control unit 10 outputs the question information to the audio output unit 2b of the in-vehicle device 2. The question information is information regarding the presence or absence of a passenger in the vehicle. The question information is information for confirming with the driver whether or not there is a passenger in the vehicle, such as, for example, "Are you going out alone today?" or "Is there anyone with you?" In the first embodiment, the output control unit 10 outputs the question information by voice, but may also output it to a display provided in the in-vehicle device 2.

[0026] (Input unit 20) Answer information is input to the input unit 20. In the first embodiment, voice information input to the voice input unit 2c of the in-vehicle device 2 is input to the input unit 20 as answer information. Answer information is information about the passenger's answer to question information. For example, if the question information is "Are you going out alone today?", answers such as "No, I'm going out with my family of four" or "Yes, I'm alone" to the question information are answer information.

[0027] (Determination unit 30) The determination unit 30 uses the response information to determine whether or not there is a passenger in the vehicle. When the response information includes information suggesting that there is a passenger in the vehicle, the determination unit 30 determines that there is a passenger in the vehicle. Specifically, when question information such as "Are you going out alone today?" is output from the voice output unit 2b and voice information such as "No, I'm going out with my family of four" is input to the input unit 20 as response information, the determination unit 30 determines that there is a passenger in the vehicle.

[0028] (Mode setting unit 40, first mode, second mode) The mode setting unit 40 determines whether to apply the first mode or the second mode using the determination result of the determination unit 30. The first mode is a mode in which, when the first keyword is detected, the information processing device 1 operates as a voice recognition device. In other words, the first mode is a mode in which, when the information processing device 1 detects the first keyword, the information processing device 1 accepts, as a predetermined command, voice information uttered after the first keyword.

[0029] A specific example will be described in which "A" is registered as the first keyword and "search for a parking lot near the mobile object" is registered as the predetermined command. In this case, when the driver utters "A, search for a parking lot nearby," the information processing device 1 accepts the command "search for a parking lot near the mobile object" and executes a process of searching for a parking lot near the mobile object. Then, the information processing device 1 outputs the search results to the voice output unit 2b.

[0030] The second mode is a mode in which the information processing device 1 operates as a voice recognition device even if the first keyword is not detected. In other words, the second mode is a mode in which the information processing device 1 operates as a voice recognition device even if a wake-up word is not present. In the above example, when the driver utters "Find a nearby parking lot," the information processing device 1 accepts a command "Find a parking lot near the mobile object," and executes a process of searching for a parking lot near the mobile object. In this way, in the second mode, the information processing device 1 can accept a command even if the driver does not utter "A" as the first keyword.

[0031] The mode setting unit 40 applies the first mode when the determination unit 30 determines that there is a passenger in the vehicle. When there is one or more passengers in the vehicle, the first mode requiring the first keyword (wake-up word) is applied, which reduces the possibility of erroneously recognizing the voices of multiple speakers, thereby preventing the information processing device 1 from erroneously recognizing voices.

[0032] The mode setting unit 40 applies the second mode when the determination unit 30 determines that there are no passengers in the vehicle. When there are no passengers in the vehicle (when there is only the driver), the second mode, which does not require the first keyword (wake-up word), is applied, thereby eliminating the need to input the wake-up word every time. This improves the comfort of the drive.

[0033] When the second mode is applied, the passenger's voice information input into the voice input unit 2c will continue to be uploaded to the information processing device 1, but the personal information contained in the voice information may be configured not to be uploaded to the information processing device 1, or may be configured to delete all of the personal information after being uploaded to the information processing device 1.

[0034] As a specific configuration, the in-vehicle device 2 may have a function of filtering voice information. More specifically, for example, only voice information containing specific keywords (such as "search," "directions," and "weather") may be uploaded to the information processing device 1. Alternatively, voice information not containing specific keywords may be automatically deleted by the information processing device 1.

[0035] 2 is a diagram showing an example of the hardware configuration of the information processing device 1. The information processing device 1 has a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

[0036] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0037] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0038] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0039] The storage device 1040 is an auxiliary storage device realized by removable media such as a hard disk drive (HDD), a solid state drive (SSD), or a memory card, or a read-only memory (ROM), and has a recording medium. The recording medium of the storage device 1040 stores program modules that realize each function of the information processing device 1 (e.g., the output control unit 10, the input unit 20, the determination unit 30, and the mode setting unit 40). The processor 1020 loads and executes each of these program modules into the memory 1030, thereby realizing each function corresponding to the program module. The storage device 1040 may also function as the memory unit 3 described below.

[0040] The input / output interface 1050 is an interface for connecting the information processing device 1 to various input / output devices.

[0041] The network interface 1060 is an interface for connecting the information processing device 1 to a network. This network is, for example, a local area network (LAN) or a wide area network (WAN). The network interface 1060 may connect to the network wirelessly or by wire. The information processing device 1 may communicate with the in-vehicle device 2 via the network interface 1060.

[0042] 3 is a flow diagram of a process in which the information processing device 1 of the first embodiment applies the first mode or the second mode. In step S10, the output control unit 10 causes the voice output unit 2b to output question information. Specifically, for example, the output control unit 10 causes the voice output unit 2b to output a mechanical voice saying, "Are you going out alone today?" as question information.

[0043] The timing of outputting the question information is arbitrary, and the question information may be output when the driver gets into the vehicle or when the driver starts the vehicle engine. Alternatively, the question information may be output after the driver has been driving the vehicle for a while or after the vehicle has traveled a predetermined distance. Alternatively, the question information may be output when the driver waits at a traffic light for the first time after driving (when the vehicle first detects a stopped state after moving).

[0044] In step S20, answer information is input to the input unit 20 (voice input unit 2c). Specifically, for example, if the driver replies "No" to the question information ("Are you going out alone today?"), the voice information of "No" is input to the input unit 20 via the voice input unit 2c as answer information.

[0045] In step S30, the determination unit 30 uses the response information to determine whether or not there is a passenger in the vehicle. In the above case, the determination unit 30 determines that there is a passenger in the vehicle using the response information of "No" returned by the driver. If the determination unit 30 determines that there is a passenger in the vehicle (YES in step S30), the process proceeds to step S40. In step S40, the mode setting unit 40 applies the first mode.

[0046] If the determination unit 30 determines that there is no passenger in the vehicle (NO in step S30), the process proceeds to step S50, in which the mode setting unit 40 applies the second mode.

[0047] As described above, according to the first embodiment, the determination unit 30 determines whether or not there is a passenger in the vehicle using the response information. This makes it possible to accurately determine whether or not there is a passenger in the vehicle with a simple configuration.

[0048] Furthermore, the mode setting unit 40 according to the first embodiment determines whether to apply the first mode or the second mode, using the determination result of the determination unit 30. Specifically, the mode setting unit 40 applies the first mode when the determination unit 30 determines that there is a passenger in the vehicle, and applies the second mode when the determination unit 30 determines that there is no passenger in the vehicle.

[0049] This makes it possible to determine whether or not to omit the wake-up word depending on whether or not there are passengers in the vehicle. By omitting the wake-up word when there are no passengers in the vehicle, it is possible to eliminate the need to speak the wake-up word, which would normally be required every time a specific command (such as searching for the nearest station or setting a route to the nearest parking lot) is requested. This allows for quick command requests to the voice recognition device. Furthermore, the elimination of the hassle of speaking the wake-up word makes driving more comfortable.

[0050] When there are passengers in the vehicle, the wake-up word is not omitted, thereby reducing the possibility that the information processing device 1 will mistakenly recognize any one of the voices of multiple passengers.

[0051] As described above, the information processing device 1 according to the first embodiment can suppress erroneous voice recognition and realize a comfortable drive.

[0052] 4 is a block diagram showing an outline of an information processing device 1 according to a second embodiment. Unlike the first embodiment, the information processing device 1 according to the second embodiment further includes a device information acquisition unit 50 and a storage processing unit 60. Furthermore, in the second embodiment, the mobile body device 2 is configured to include an intra-mobile body communication unit (not shown) for configuring the mobile body communication means 102.

[0053] The mobile body device 2 is configured to be able to communicate with a communication device 4 within the mobile body via a mobile body communication means 102. The mobile body communication means 102 is, for example, a wireless communication means, including Wi-Fi (registered trademark) and Bluetooth (registered trademark). The communication device 4 is a device of a passenger of the mobile body, and is a device owned, managed, carried, or used by the passenger. The communication device 4 is brought into the mobile body by the passenger.

[0054] (Device Information Acquisition Unit 50) The device information acquisition unit 50 acquires a plurality of pieces of device information from a plurality of communication devices 4 inside the mobile body. In the second embodiment, the device information acquisition unit 50 acquires the device information via the device 2 inside the mobile body.

[0055] The communication device 4 includes, for example, a smartphone, a tablet, a PC (personal computer), and a wearable device. The device information is information for identifying each communication device 4. The device information is information related to the communication device 4. The information related to the communication device 4 is information linked to the communication device 4, and includes, for example, the name registered in the communication device 4, the device model, the device ID, and the name of the device registered in the communication device 4. By using the device information, it is possible to identify each of the multiple communication devices 4.

[0056] The device information acquisition unit 50 may use radio wave intensity information relating to the strength of radio waves to determine whether the communication device 4 is located inside a mobile object. Note that the radio wave intensity information may be acquired using a known configuration.

[0057] The device information acquisition unit 50 may determine whether the communication device 4 is inside the mobile object by comparing the device information acquired in the first state with the device information acquired in the second state. The first state is a state before the mobile object moves. Specifically, the first state is a state before the driver starts driving. The second state is a state after a predetermined time has elapsed since the mobile object moved or after the mobile object has moved a predetermined distance. Specifically, the second state is a state after a while has passed since the driver started driving.

[0058] The device information acquisition unit 50 may repeatedly acquire device information and determine whether the communication device 4 is located within a mobile object using device history information related to the acquisition history of the device information. More specifically, for example, the device information acquisition unit 50 determines that the communication device 4 is located within a mobile object when the device information acquired continuously for a predetermined time (e.g., 30 seconds) after the driver starts driving is the same. The timing at which the device information acquisition unit 50 starts to continuously acquire device information may be when the driver starts the vehicle engine or immediately after starting driving. Alternatively, the device information acquisition unit 50 may continuously acquire device information from the time it starts acquiring device information until the vehicle has traveled a predetermined distance. Alternatively, the device information acquisition unit 50 may repeatedly acquire device information up to immediately after starting driving.

[0059] Furthermore, when the device information continuously acquired for a predetermined time after the driver starts driving includes device information different from the device information acquired immediately after the start of device information acquisition, the device information acquisition unit 50 may determine that the communication device 4 related to the device information acquired immediately after the start of device information acquisition is not inside the mobile body. Also, when the device information acquired immediately after the start of device information acquisition has disappeared after the predetermined time has elapsed, the device information acquisition unit 50 may determine that the communication device 4 related to the device information is not inside the mobile body.

[0060] (Storage Processing Unit 60) The storage processing unit 60 associates multiple pieces of device information with answer information and stores them as mode determination information in the storage unit 3. The storage processing unit 60 stores in the storage unit 3 the answer information input to the input unit 20 and a combination of multiple pieces of device information detected within the moving object when the answer information was input.

[0061] (Operation Example 1 of Second Embodiment) Fig. 5 is a flowchart of a process in which the storage processing unit 60 of the second embodiment stores mode determination information in the storage unit 3. The process in which the storage processing unit 60 stores mode determination information in the storage unit 3 will be described with reference to Fig. 5 .

[0062] In step S5, the device information acquisition unit 50 acquires multiple pieces of device information from multiple communication devices 4 in the vehicle. Steps S11 and S21 are similar to steps S10 and S20, respectively, in the first embodiment. Specifically, in step S11, the output control unit 10 causes the voice output unit 2b to output question information, and in step S21, answer information is input to the input unit 20 (voice input unit 2c).

[0063] The timing at which the device information acquisition unit 50 acquires the device information is arbitrary. The device information acquisition unit 50 may acquire the device information after a predetermined time has elapsed since the driver started driving the vehicle. Alternatively, the device information acquisition unit 50 may acquire the device information after the driver has driven the vehicle a predetermined distance. In this case, the predetermined distance may be calculated using the position information of the moving object generated by the position sensor unit 2d. Note that the process of step S5 may be executed after the process of step S11.

[0064] In step S25, the storage processing unit 60 associates the plurality of pieces of device information acquired by the device information acquisition unit 50 with the answer information and stores them as mode determination information in the storage unit 3. Specifically, for example, if question information such as "Are you driving alone today?" is output in step S11 and answer information such as "No, I'm driving with a friend" is input to the input unit 20 in step S21, the storage processing unit 60 stores a combination of the answer information, the device information of the driver, and the device information of the passenger (=friend) in the storage unit 3. After step S25, the process proceeds to step S31.

[0065] The processes of steps S31, S41, and S51 are the same as the processes of steps S30, S40, and S50 in the first embodiment, respectively.

[0066] (Operation Example 2 of Second Embodiment) Fig. 6 is a flow diagram of a process in which the information processing device 1 applies the first mode or the second mode using the mode determination information. The process of applying the first mode or the second mode using the mode determination information will be described with reference to Fig. 6. In step S6, the device information acquisition unit 50 acquires multiple pieces of device information from multiple communication devices 4 in the mobile object.

[0067] As in the first operation example of the second embodiment, the timing at which the device information acquisition unit 50 acquires the device information is arbitrary. The device information acquisition unit 50 may acquire the device information immediately after starting driving, or may acquire the device information after a predetermined time has elapsed since the driver started driving. Alternatively, the device information acquisition unit 50 may acquire the device information after a predetermined time has elapsed since the driver started the vehicle engine. Alternatively, the device information acquisition unit 50 may acquire the device information after the driver has driven the vehicle a predetermined distance.

[0068] Next, in step S7, the mode setting unit 40 determines whether to omit the question information using the plurality of device information and mode determination information previously stored in the storage unit 3. Specifically, the mode setting unit 40 searches the storage unit 3 for device information with the same combination as the plurality of device information acquired in step S6. If there is a plurality of device information with the same combination as the plurality of device information, the mode setting unit 40 acquires the plurality of device information with the same combination and the associated answer information as mode determination information. The mode setting unit 40 then determines whether to omit the question information using the mode determination information. When the mode determination information includes information suggesting the presence of a passenger in the vehicle, the mode setting unit 40 determines to omit the question information. For example, when the answer information included in the mode determination information is "No, I'm going out with two friends," the mode setting unit 40 determines to omit the question information. When the mode setting unit 40 determines to omit the question information (YES in step S7), the process proceeds to step S42.

[0069] Then, in step S42, the mode setting unit 40 applies the first mode without using the determination result of the determination unit 30 (the determination result as to whether or not there is a passenger in the vehicle).

[0070] If the mode setting unit 40 determines not to omit the question information (NO in step S7), the process proceeds to step S12. The processes in steps S12, S22, S26, S32, S42, and S52 are the same as the processes in steps S11, S21, S25, S31, S41, and S51 in the second embodiment ( FIG. 5 ), respectively.

[0071] As described above, according to the second embodiment, the information processing device 1 further includes a device information acquisition unit 50 and a storage processing unit 60. The mode setting unit 40 according to the second embodiment determines whether to omit question information using multiple pieces of device information and pre-stored mode determination information. This allows the process of outputting question information to be omitted when a driver gets into a vehicle carrying the same multiple devices as previously stored devices (when the same driver and passengers get into the vehicle). This eliminates the driver's need to go to the trouble of answering questions and reduces the amount of information processing work required.

[0072] Furthermore, the device information acquisition unit 50 according to the second embodiment may use radio wave intensity information regarding the strength of radio waves to determine whether the communication device 4 is located inside a mobile body. This makes it possible to easily determine whether the communication device 4 is located inside a mobile body. This makes it possible to prevent erroneous acquisition of device information regarding a communication device located outside the mobile body.

[0073] Furthermore, the device information acquisition unit 50 according to the second embodiment may determine whether the communication device 4 is located within a mobile object by comparing the device information acquired in the first state with the device information acquired in the second state. By comparing the device information acquired some time after the driver started driving with the device information acquired before the driver started driving and determining whether the device information is the same, it is possible to easily determine whether the communication device 4 is located within a mobile object. This reduces the possibility of erroneously acquiring device information about a location near where the vehicle is parked.

[0074] Furthermore, the device information acquisition unit 50 according to the second embodiment may repeatedly acquire device information and determine whether the communication device 4 is located within a mobile body using device history information relating to the history of device information acquisition. For example, if device information is repeatedly acquired over a predetermined period of time and the repeatedly acquired device information is all from the same communication device, it is highly likely that the communication device is located within a mobile body. By using the device history information, it is possible to easily determine whether the communication device 4 is located within a mobile body.

[0075] By having the device information acquisition unit 50 acquire device information after a predetermined time has elapsed since the driver began driving (or after the vehicle engine was started) or after the vehicle had traveled a predetermined distance, it is possible to prevent the device information acquisition unit 50 from mistakenly acquiring device information of a communication device outside the vehicle near where the vehicle is parked.

[0076] 4 (the configuration of the information processing device 1 according to the second embodiment), but some of the functions of the mode setting unit 40 are different from those of the information processing device 1 according to the second embodiment. After the mode setting unit 40 according to the third embodiment applies the second mode, when the device information acquisition unit 50 detects that the number of communication devices 4 inside the mobile object has increased, the mode setting unit 40 according to the third embodiment switches from the second mode to the first mode.

[0077] This allows automatic switching to the first mode even if a passenger joins the drive. By immediately switching to the first mode, which requires a wake-up word, when there are multiple speakers, the possibility of the information processing device 1 erroneously recognizing speech is reduced. Furthermore, even if the number of passengers increases during the drive, there is no need to take the trouble of executing the process shown in Figure 6, and the information processing man-hours can be reduced because the mode automatically switches from the second mode to the first mode.

[0078] In another aspect of the third embodiment, when the device information acquisition unit 50 detects that the number of communication devices 4 inside the mobile object has decreased after the mode setting unit 40 applies the first mode, the output control unit 10 causes the output control unit 10 to output the question information again. Specifically, when the device information acquisition unit 50 detects that the number of communication devices 4 inside the mobile object has decreased, the output control unit 10 executes the processing from step S12 onwards in FIG. 6 .

[0079] This allows for a smooth transition to the second mode even if the driver is left alone after the passengers have left at least one passenger at the beginning of the drive, thereby improving the comfort of the drive.

[0080] [Fourth embodiment] The information processing device 1 according to the fourth embodiment has almost the same configuration as that shown in FIG. 4 (the configuration of the information processing device 1 according to the second embodiment), but some of the functions of the input unit 20 and the storage processing unit 60 are different from those of the information processing device 1 according to the second embodiment.

[0081] By inputting a second keyword into the input unit 20 according to the fourth embodiment, the storage processing unit 60 erases the specific mode determination information. The second keyword is an arbitrary word and may be set in advance or may be newly set by the driver. The specific mode determination information is any mode determination information stored in the storage unit 3.

[0082] Fig. 7 is a block diagram for explaining the functions of the input unit 20 and the storage processing unit 60 according to the fourth embodiment. The block diagram of Fig. 7 is almost the same as the block diagram of Fig. 4, but the number of devices relative to the number of passengers is different (in Fig. 4, there are two communication devices 4 for two passengers, while in Fig. 7, there are two communication devices 4 for one passenger). The functions of the input unit 20 and the storage processing unit 60 according to the fourth embodiment will be explained in detail using Fig. 4 and Fig. 7.

[0083] For example, when a driver who owns two communication devices 4 gets into a vehicle with a child (corresponding to the situation in FIG. 4 ), the answer information "No" to the question information "Are you alone today?" is input into the input unit 20, and the storage processing unit 60 stores the combination of the answer information and the device information of the two communication devices 4 in the memory unit 3.

[0084] Then, the next time the driver does not bring a child with him / her (corresponding to the situation in Figure 7) and brings the same two communication devices 4 as the communication devices 4 stored last time into the vehicle, the mode setting unit 40 will adopt the mode determination information stored previously (a combination of the answer information and the device information of the two communication devices 4), and even though there are no passengers (children) and only the driver this time, the question information will be omitted and the vehicle will automatically switch to the first mode.

[0085] However, since the storage processing unit 60 has a function for erasing specific mode determination information, it is possible to erase mode determination information that has been stored in the past, and therefore it is possible to store correct mode determination information again.

[0086] In another aspect of the fourth embodiment, the output control unit 10 may re-output question information by inputting a third keyword into the input unit 20. Specifically, inputting the third keyword into the input unit 20 may cause the processing from step S12 in Fig. 6 (or step S11 in Fig. 5) onwards to be executed. The third keyword is an arbitrary word and may be set in advance or may be newly set by the driver.

[0087] As a result, even if the driver inputs answer information by mistake, it is possible to execute the process again as shown in Fig. 6 (or Fig. 5). This makes it possible to switch to the correct mode (the mode intended by the driver). Furthermore, it is possible to store the correct mode determination information again.

[0088] (Other Modifications) Combinations of multiple communication devices and answer information may be manually stored in advance in the storage unit 3. The mode setting unit 40 may then determine whether to omit question information using the multiple pieces of device information acquired by the device information acquisition unit 50 and the information on the combinations manually stored in advance.

[0089] Although the embodiments have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations can also be adopted.

[0090] The information processing device 1 may be mounted inside a moving object. In an embodiment, the information processing device 1 may also include an in-vehicle device 2. In this case, the in-vehicle device 2 (=information processing device 1) includes an output control unit 10, an input unit 20, a determination unit 30, and a mode setting unit 40 in addition to a camera unit 2a, an audio output unit 2b, an audio input unit 2c, and a position sensor unit 2d.

[0091] If the driver turns off the engine after applying the second mode shown in Fig. 3, the process in Fig. 3 may be executed again. At this time, the wording of the question information may or may not be changed.

[0092] Examples of reference forms are given below. 1. An information processing device comprising: an output control unit that outputs question information regarding the presence or absence of a passenger in a vehicle; an input unit that receives input of answer information regarding the passenger's answer to the question information; a determination unit that uses the answer information to determine whether or not a passenger is in the vehicle; and a mode setting unit that uses a determination result from the determination unit to determine whether to apply a first mode that operates as a voice recognition device when a first keyword is detected, or a second mode that operates as a voice recognition device even if the first keyword is not detected. 2. In the information processing device described in 1., the mode setting unit applies the first mode when the determination unit determines that there is a passenger in the vehicle, and applies the second mode when the determination unit determines that there is no passenger in the vehicle. 3. An information processing device according to 1. or 2. 4. The information processing device described in any one of 1. to 3., further comprising a device information acquisition unit that acquires a plurality of pieces of device information related to a plurality of communication devices in the mobile body, and a storage processing unit that associates the plurality of pieces of device information with the answer information and stores them as mode determination information, wherein the mode setting unit determines whether to omit the question information using the plurality of pieces of device information and the mode determination information stored in advance, and when the mode setting unit determines to omit the question information, the mode setting unit applies the first mode without using the determination result of the determination unit. 4. The information processing device described in any one of 1. to 3., further comprising a device information acquisition unit that acquires a plurality of pieces of device information related to a plurality of communication devices in the mobile body, and when the device information acquisition unit detects that the number of communication devices in the mobile body has increased after the mode setting unit applies the second mode, the mode setting unit switches from the second mode to the first mode. 5. 4. In the information processing device described in the above, after the mode setting unit applies the first mode, when the device information acquisition unit detects that the number of communication devices within the mobile object has decreased, the output control unit outputs the question information again.6. The information processing device described in any one of 3. to 5., wherein the device information acquisition unit determines whether the communication device is inside the mobile body using radio wave strength information related to the strength of radio waves. 7. The information processing device described in any one of 3. to 6., wherein a state before the mobile body moves is defined as a first state, and a state after a predetermined time has elapsed or after the mobile body has moved a predetermined distance is defined as a second state, and the device information acquisition unit determines whether the communication device is inside the mobile body by comparing the device information acquired in the first state with the device information acquired in the second state. 8. The information processing device described in any one of 3. to 7., wherein the device information acquisition unit repeatedly acquires the device information and determines whether the communication device is inside the mobile body using device history information related to the acquisition history of the device information. 9. The information processing device described in any one of 3. to 8., wherein the storage processing unit erases the specific mode determination information by inputting a second keyword to the input unit. 10. An information processing device according to any one of 1. to 9., wherein inputting a third keyword into the input unit causes the output control unit to output the question information again. 11. An information processing method in which a computer realizing an information processing device outputs question information regarding the presence or absence of a passenger in the vehicle, receives answer information regarding the passenger's answer to the question information as input, determines whether or not there is a passenger in the vehicle using the answer information, and determines whether or not there is a passenger in the vehicle using the determination result of whether or not there is a passenger in the vehicle to apply a first mode in which the computer operates as a voice recognition device when a predetermined keyword is detected, or a second mode in which the computer operates as a voice recognition device even if the keyword is not detected.12. A program for causing a computer realizing an information processing device to execute the following steps: outputting question information regarding the presence or absence of a passenger in a vehicle; inputting answer information regarding the passenger's answer to the question information; determining whether or not there is a passenger in the vehicle using the answer information; and determining, using the determination result of whether or not there is a passenger in the vehicle, whether to apply a first mode in which the device operates as a voice recognition device when a predetermined keyword is detected, or a second mode in which the device operates as a voice recognition device even if the keyword is not detected.

[0093] This application claims priority based on Japanese Patent Application No. 2022-158479, filed September 30, 2022, the disclosure of which is incorporated herein by reference in its entirety.

[0094] REFERENCE SIGNS LIST 1 Information processing device 2 In-vehicle device 2a Camera unit 2b Audio output unit 2c Audio input unit 2d Position sensor unit 3 Storage unit 4 Communication device 10 Output control unit 20 Input unit 30 Determination unit 40 Mode setting unit 50 Device information acquisition unit 60 Storage processing unit

Claims

1. A device information acquisition unit that acquires device information regarding a communication device in a moving body, Based on the device information acquired by the device information acquisition unit, a first mode that operates as a voice recognition device when a first keyword is detected, and a second mode that operates as a voice recognition device even if the first keyword is not detected And a mode setting unit for setting any one of the above, an information processing apparatus.

2. In the information processing apparatus according to claim 1, A storage processing unit that associates the device information with information regarding the presence or absence of a passenger in the moving body and stores it as mode determination information, and further includes: The mode setting unit sets any one of the first mode and the second mode based on the device information and the mode determination information stored in advance.

3. In the information processing apparatus according to claim 2, An output control unit that outputs question information regarding the presence or absence of a passenger in the moving body, An input unit to which answer information regarding an answer of a passenger to the question information is input, Comprising, The storage processing unit stores the answer information as information regarding the presence or absence of a passenger in the moving body and the device information in association with each other as the mode determination information.

4. In the information processing apparatus according to claim 3, The mode setting unit determines whether or not to omit the question information based on the device information acquired by the device information acquisition unit and the mode determination information stored in advance. The output control unit does not output the question information when it is determined by the mode setting unit that the question information is to be omitted.

5. In the information processing apparatus according to claim 3 or 4, By inputting a second keyword to the input unit, the storage processing unit deletes the specific mode determination information.

6. In the information processing apparatus according to claim 3 or 4, By inputting a third keyword to the input unit, the output control unit outputs the question information again.

7. In the information processing apparatus according to claim 1, After the mode setting unit sets the second mode, when the device information acquisition unit detects that the number of communication devices in the moving body has increased, the mode setting unit switches from the second mode to the first mode.

8. In the information processing apparatus according to any one of claims 1 to 4, the device information acquisition unit is an information processing apparatus that determines whether the communication device is inside the moving body by using radio intensity information regarding the intensity of radio waves.

9. In the information processing apparatus according to any one of claims 1 to 4, the state before the moving body moves is defined as the first state, and the state after a predetermined time has elapsed or after the moving body has moved a predetermined distance is defined as the second state. The device information acquisition unit is an information processing apparatus that determines whether the communication device is inside the moving body by comparing the device information acquired in the first state with the device information acquired in the second state.

10. In the information processing apparatus according to any one of claims 1 to 4, the device information acquisition unit repeatedly acquires the device information and determines whether the communication device is inside the moving body by using device history information regarding the acquisition history of the device information.

11. A computer that realizes an information processing apparatus causes a device information regarding a communication device inside a moving body to be acquired, and based on the acquired device information, sets either a first mode that operates as a voice recognition device when a first keyword is detected or a second mode that operates as a voice recognition device even when the first keyword is not detected.

12. In a computer that realizes an information processing apparatus, a procedure for causing a device information regarding a communication device inside a moving body to be acquired, a procedure for setting either a first mode that operates as a voice recognition device when a first keyword is detected or a second mode that operates as a voice recognition device even when the first keyword is not detected based on the acquired device information, and a program for causing the procedures to be executed.