Control device

Abstract

To provide a technology that can inhibit unnecessary broadcast station searches from being conducted at a site to which electric waves do not reach easily.SOLUTION: A control device controls a broadcast station search for searching broadcast stations from which electric waves can be received. The control device includes: an acquisition unit which acquires imaging data from a camera which captures images around a vehicle; and a determination part which performs determination regarding the broadcast station search based on reception environment information indicating a reception environment of electric waves for broadcasting, which can be obtained by inputting the imaging data into a learned model by machine learning.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a control device for controlling a broadcast station search.

Background Art

[0002] In a receiving device mounted on a vehicle, the broadcast station currently being received may become unreceivable due to the movement of the vehicle. As a technology for dealing with this, conventionally, when the broadcast station currently being received becomes unreceivable, a technology (broadcast station search) that automatically searches for and receives its affiliated stations or relay stations is known.

[0003] Patent Document 1 discloses a technology for determining a decrease in reception quality caused by a shielding object such as a tunnel or a building and performing an appropriate search. Patent Document 1 discloses that in the case of a decrease in reception quality caused by a shielding object such as a tunnel or a building, a search process is not performed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] For example, if a configuration is adopted to perform a broadcast station search even in a tunnel where radio waves are shielded, it is feared that a broadcast station that can receive radio waves cannot be found in the tunnel and the broadcast station search will continue, resulting in an increased processing load. A technology that can detect a place where radio waves are shielded at an early stage and prevent unnecessary broadcast station searches is desired. Preferably, a technology that can detect a place where radio waves are shielded before the vehicle enters a place where radio waves are shielded, such as a tunnel, is desired.

[0006] In view of the above points, an object of the present invention is to provide a technique capable of suppressing unnecessary broadcast station searches in places where radio waves are difficult to reach.

Means for Solving the Problems

[0007] An exemplary control device of the present invention is a control device that controls a broadcast station search for receivable broadcast stations, and includes an acquisition unit that acquires shooting data from a camera that shoots the periphery of a vehicle, and a learned model by machine learning. A determination unit that makes a determination related to the broadcast station search based on reception environment information indicating a reception environment of radio waves for broadcasting obtained by inputting the shooting data.

Effects of the Invention

[0008] According to an exemplary aspect of the present invention, it is possible to suppress unnecessary broadcast station searches in places where radio waves are difficult to reach.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Modes for Carrying Out the Invention

[0010] Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. In the following description, in the straight-ahead traveling direction of the vehicle, the direction from the driver's seat toward the steering wheel is defined as the "front direction". Also, in the straight-ahead traveling direction of the vehicle, the direction from the steering wheel toward the driver's seat is defined as the "rear direction". Further, in a direction perpendicular to the straight-ahead traveling direction of the vehicle and the vertical line, the direction from the right side to the left side of the driver facing the front direction is defined as the "left direction". Also, in a direction perpendicular to the straight-ahead traveling direction of the vehicle and the vertical line, the direction from the left side to the right side of the driver facing the front direction is defined as the "right direction".

[0011] <1. Vehicle-mounted device> FIG. 1 is a block diagram showing the configuration of a vehicle-mounted device 100 to which a control device 1 according to an embodiment of the present invention is applied. Note that the control device of the present invention is not limited to a vehicle-mounted device, and may be applied to a portable vehicle device that can be brought into or taken out of a vehicle.

[0012] In the present embodiment, the vehicle-mounted device 100 is an AV (Audio / Visual) device. However, the control device of the present invention can be widely applied to a device including a receiving device that receives and reproduces broadcast waves, and may be applied to devices other than AV devices. The broadcast waves received by the receiving device may include at least one of broadcast waves for television broadcasts and broadcast waves for radio broadcasts. The control device of the present invention may be applied to, for example, an audio-integrated navigation device, a display audio, or the like.

[0013] As shown in FIG. 1, the vehicle-mounted device 100 includes a control device 1 and an operation input device 2. The control device 1 comprehensively controls the entire vehicle-mounted device 100. When a user (a passenger in the vehicle) inputs an operation using the operation input device 2, the control device 1 performs an operation corresponding to the operation. For example, the control device 1 selects a media source, selects a broadcast channel, adjusts the volume, adjusts the sound quality, adjusts the video, etc., according to an operation using the operation input device 2. Note that the operation input device 2 may be configured to include at least one of, for example, a touch panel, a voice input device, a keyboard, a button, a lever, and a rotary knob.

[0014] In this embodiment, the in-vehicle device 100 further includes a TV tuner 3, a radio tuner 4, and a media player 5. Correspondingly, the control device 1 is provided to enable selection of media sources such as radio, TV, optical disk, memory card, etc. by an operation using the user operation input device 2. The control device 1 activates the circuit of the selected media source and switches the circuit of the selector 6 provided in the in-vehicle device 100 based on the input of an operation using the user operation input device 2.

[0015] The TV tuner 3 is, for example, a tuner for terrestrial digital TV broadcasting or satellite digital TV broadcasting. Note that the in-vehicle device 100 may include both a tuner for terrestrial digital TV broadcasting and a tuner for satellite digital TV broadcasting. Note that the TV tuner 3 may be a tuner for analog TV broadcasting.

[0016] For example, the TV tuner 3 converts a TV signal of a TV broadcast received by a predetermined antenna (not shown) into an intermediate frequency signal including a target channel by a tuner circuit. Then, the TV tuner 3 demodulates this intermediate frequency signal to extract digital data, and decodes a data stream of video and audio of the target channel from this digital data. The decoded demodulated video signal and demodulated audio signal are output to the selector 6. Note that the TV tuner 3 can detect the reception level of a broadcast wave for TV broadcasting by a known configuration.

[0017] The radio tuner 4 is, for example, a tuner for terrestrial digital radio broadcasting or satellite digital radio broadcasting. Note that the in-vehicle device 100 may include both a tuner for terrestrial digital radio broadcasting and a tuner for satellite digital radio broadcasting. Note that the radio tuner 4 may be a tuner for analog radio broadcasting.

[0018] For example, the radio tuner 4 amplifies the radio signal of the radio broadcast received by a predetermined antenna (not shown) with an amplifier, and then converts it into an intermediate frequency signal with a mixer and a band-pass filter. Then, the radio tuner 4 detects and demodulates this intermediate frequency signal, converts it into a TDM (Time Division Multiplexing) bit stream, and extracts the data of a predetermined channel. The audio data of the extracted channel is converted into a demodulated audio signal by an audio decoder and output to the selector 6. The radio tuner 4 can detect the reception level of the broadcast wave for radio broadcast with a known configuration.

[0019] The media player 5 reads out digital signals, for example, from an optical disk such as a CD or a DVD set in a predetermined insertion slot (not shown), a memory card, or a portable memory or a portable terminal connected via a connection terminal (not shown) such as a USB terminal. The media player 5 decodes the video signal and the audio signal included in the read digital signal and outputs them to the selector 6.

[0020] The in-vehicle device 100 further includes an audio output device 7 and a display device 8.

[0021] The audio output device 7 includes, for example, a DA (Digital to Analog) converter that converts the audio signal input via the selector 6 into an analog signal, an amplifier that amplifies the analog signal output from the DA converter, and a speaker (all not shown) that converts the amplified analog signal into sound. The audio output device 7 outputs, for example, the broadcast audio of the selected TV broadcast or the broadcast audio of the selected radio broadcast. Also, the audio output device 7 outputs, for example, the audio recorded on an optical disk or a memory card.

[0022] The display device 8 includes, for example, a display control circuit that displays an image according to a video signal input via the selector 6, and a display device (both not shown). The display device may be, for example, a liquid crystal panel, an organic EL panel, or the like. The display device 8 outputs, for example, the broadcast video of the selected TV broadcast.

[0023] <2. Control Device> Next, the configuration of the control device 1 described above will be further described. In addition to the operations described above, the control device 1 controls a broadcast station search for searching for receivable broadcast stations. Hereinafter, the description will focus on the function of the control device 1.

[0024] FIG. 2 is a block diagram showing the configuration of the control device 1 according to an embodiment of the present invention. In FIG. 2, only the components necessary for explaining the features of the embodiment are shown, and the description of general components is omitted. As shown in FIG. 2, the control device 1 includes a control unit 11 and a storage unit 12.

[0025] The control unit 11 is configured by, for example, a processor. The control unit 11 includes, for example, an integrated circuit for arithmetic operations, a RAM (Random Access Memory), and a ROM (Read Only Memory). The integrated circuit for arithmetic operations may be, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an APU (Accelerated Processing Unit).

[0026] The storage unit 12 non-temporarily stores or stores programs and data that can be read by a computer. The storage unit 12 is, for example, at least one type of non-transitory physical storage medium among semiconductor memories, magnetic media, and optical media. The storage unit 12 stores various programs and various data.

[0027] In this embodiment, the storage unit 12 stores the learned model 121. The learned model 121 is pre-generated using a learning device (not shown) that performs machine learning and is pre-stored in the storage unit 12. The learned model 121 is provided by an algorithm such as a neural network or a support vector machine, for example. Details of the learned model 121 will be described later.

[0028] The control unit 11 includes a search unit 111, an acquisition unit 112, a determination unit 113, and an instruction unit 114. The search unit 111, the acquisition unit 112, the determination unit 113, and the instruction unit 114 are functions of the control unit 11 realized by the integrated circuit for operation of the control unit 11 executing arithmetic processing according to a computer program. In other words, the control device 1 includes the acquisition unit 112 and the determination unit 113. The control device 1 further includes the instruction unit 114. The control device 1 further includes the search unit 111.

[0029] Note that at least any one of the search unit 111, the acquisition unit 112, the determination unit 113, and the instruction unit 114 included in the control unit 11 may be configured by hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). Also, the search unit 111, the acquisition unit 112, the determination unit 113, and the instruction unit 114 are conceptual components. The functions executed by one component may be distributed among multiple components, or the functions of multiple components may be integrated into one component.

[0030] The search unit 111 performs a broadcast station search to search for the carrier frequencies of receivable broadcast stations. Note that the broadcast station search may be referred to as a broadcast wave search. In the present embodiment, in principle, when the currently received broadcast station becomes unreceivable, the search unit 111 performs a search until a relay station or an affiliated station of the received broadcast station becomes receivable. A known method may be used as the search method. Note that in the present embodiment, in a specific case, even when the reception of the received broadcast station becomes impossible, the search unit 111 does not perform a broadcast station search. This will be described below.

[0031] Note that in the present embodiment, specifically, there are a broadcast station search for television broadcasts and a broadcast station search for radio broadcasts. When the term "broadcast station search" is used without particular distinction, it means that it applies to both of these broadcast station searches.

[0032] The acquisition unit 112 acquires imaging data from a camera 9 that images the periphery of the vehicle. The camera 9 is mounted on the same vehicle on which the in-vehicle device 100 including the control device 1 is mounted. The acquisition unit 112 and the camera 9 are provided to be communicable by wire or wirelessly. The acquisition unit 112 continuously acquires imaging images at a predetermined period (for example, a period of 1 / 30 second) from the camera 9 in time series. The imaging images that are continuous in time constitute a moving image (video). That is, the acquisition unit 112 can acquire still images and moving images captured by the camera 9. In addition, the acquisition unit 112 appropriately performs processes necessary as preprocessing for various processes performed using the imaging data.

[0033] In this embodiment, the camera 9 that captures the periphery of the vehicle is preferably a front camera that captures the front of the vehicle. However, the camera 9 is not limited to the front camera, and may be, for example, a side camera that captures the side of the vehicle. Also, the number of cameras 9 is not limited to one, and may be plural. The camera 9 provided to be communicable with the control device 1 may be configured to include a left side camera and a right side camera that capture the left and right sides of the vehicle instead of or in addition to the front camera. Also, the camera 9 is not limited to an in-vehicle camera, and may be a portable camera that can be brought into or removed from the vehicle.

[0034] The determination unit 113 makes a determination related to the broadcast station search based on the reception environment information indicating the reception environment of the radio wave for broadcasting, which is obtained by inputting the captured data of the camera 9 into the learned model 121 by machine learning. The reception environment information is, in other words, information that enables the estimation of the reception environment of the radio wave for broadcasting in the vehicle. According to this configuration, it is possible to control the broadcast station search by making a determination related to the broadcast station search according to the surrounding environment of the vehicle obtained by the camera 9. According to this configuration, it is possible to suppress an unnecessary broadcast station search according to the surrounding environment of the vehicle.

[0035] In this embodiment, the reception environment information is detection information of a specific location that shields the radio wave for broadcasting. The specific location is, in other words, a location that reduces the reception sensitivity of the broadcast wave (radio wave for broadcasting) in the receiver (in-vehicle device 100 in this embodiment) that receives the broadcast wave, and for example, a tunnel or the shade of a building corresponds to this. That is, in this embodiment, expressed by giving a specific example, the reception environment information is detection information such as a tunnel or the shade of a building.

[0036] When the determination unit 113 detects a specific location, it determines to stop the function of searching for broadcast stations. That is, when the determination unit 113 detects, for example, a tunnel or the shadow of a building, it stops the function of searching for broadcast stations. According to this configuration, when a specific location such as a tunnel is detected, the function of searching for broadcast stations can be stopped, and unnecessary search for broadcast stations can be suppressed in a place where radio waves are difficult to reach.

[0037] In the present embodiment, the learned model 121 is a learned model obtained by performing machine learning using a plurality of captured data of specific locations that shield radio waves for broadcasting as teacher data. The captured data used as teacher data is preferably captured data captured by a camera (such as a front camera) mounted on a traveling vehicle.

[0038] Specifically, the learned model 121 may be a learned model obtained by performing machine learning using, as teacher data, a plurality of captured data with locations where radio waves for broadcasting cannot be received (for example, in a tunnel or the shadow of a building) as specific locations. When the captured data of the camera 9 that captures the periphery of the vehicle is input to the learned model 121, when a specific location that shields radio waves for broadcasting is captured in the captured image, the specific location is detected. For example, when the learned model 121 finds a location in the captured image whose similarity to a learned specific location is equal to or greater than a predetermined threshold, the learned model 121 detects the location as a specific location. Here, it is assumed that the higher the similarity, the more similar it is to a specific location. Also, the predetermined threshold can be set arbitrarily. Based on the detection of the specific location, the determination unit 113 determines to stop the function of searching for broadcast stations.

[0039] Note that in the present embodiment, the captured data input to the learned model 121 is still image data captured by the camera 9. The teacher data used to generate the learned model 121 is also still image data. However, the captured data and teacher data input to the learned model 121 may be video data in some cases.

[0040] In addition, in this embodiment, the control unit 11 mounted on the vehicle uses the learned model 121 stored in the storage unit 12 to make a determination related to the broadcast station search. That is, the control device 1 is configured to make a determination related to the broadcast station search using edge AI (Artificial Intelligence). However, methods other than edge AI may be used for the determination related to the broadcast station search. For example, a server device communicably provided via a network such as the Internet with a device mounted on the vehicle may be configured to make a determination related to the broadcast station search using a learned model. In this case, the control device that controls the broadcast station search is composed of a device mounted on the vehicle (for example, in-vehicle equipment) and a server device.

[0041] When it is determined that the function of the broadcast station search is stopped, the instruction unit 114 instructs the reproduction of sound by means different from the reproduction of sound by receiving a broadcast wave. When the function of the broadcast station search is stopped, as can be understood from the above description, it is presumed that the vehicle enters a specific place such as a tunnel and the reception of the broadcast wave becomes impossible at the time when the function is stopped or immediately after the function is stopped. By instructing the reproduction of sound by means different from the reception of the broadcast wave, it is possible to automatically avoid the output sound disappearing and becoming silent, or only noise being output. That is, it is possible to reduce the trouble of the user operating the in-vehicle device 100 to switch the media source. Note that the instruction unit 114 may be configured to instruct the reproduction of sound by means different from the reproduction of sound by receiving a broadcast wave when the function of the broadcast station search is stopped and the received broadcast wave cannot be received. Also, the instruction unit 114 may not be provided in some cases.

[0042] In this embodiment, for sound reproduction by means different from receiving broadcast waves, there is sound reproduction using the media player 5. That is, the instruction unit 114 instructs the media player 5 to reproduce alternative sound. The alternative sound may be, for example, sound held as audio data (for example, music data) in an optical disk, a memory card, a connected device using a USB terminal (USB memory, smartphone, etc.). Further, when the in-vehicle device 100 has a recording function, the alternative sound may be sound included in the recorded data of a TV commercial. Also, when the in-vehicle device 100 has a recording function, the alternative sound may be sound in the recorded data of a radio broadcast.

[0043] For example, when receiving a radio broadcast and the reception of broadcast waves becomes impossible, noise is output. Considering such points, etc., the instruction unit 114 may be configured to instruct the stop of sound output by receiving broadcast waves when it is determined that the function of searching for a broadcast station has stopped. Thereby, it is possible to avoid a situation where the state becomes one where broadcast waves cannot be received and only noise is output. Note that the instruction unit 114 may be configured to instruct the stop of sound output by receiving broadcast waves when the function of searching for a broadcast station has stopped and the broadcast waves being received become impossible to receive.

[0044] <3. Details Regarding Broadcast Station Search> (3-1. Control of Broadcast Station Search Function) FIG. 3 is a flowchart showing an example of a control process of a broadcast station search function performed by the control device 1 according to an embodiment of the present invention. The control process of the broadcast station search function is specifically performed using the learned model 121. The control process of the broadcast station search function by the control device 1 starts, for example, when a selection of using the TV tuner 3 or the radio tuner 4 is made according to an operation instruction from the user.

[0045] Note that the broadcast station search function is enabled by default, and at the start of the process shown in FIG. 3, the broadcast station search function is enabled. The broadcast station search function being enabled means that when the broadcast wave of the receiving broadcast station cannot be received, the relay stations or affiliated stations of the received broadcast station are automatically searched.

[0046] In step S1, the determination unit 113 performs image recognition processing using the captured image (still image) acquired from the acquisition unit 112. The image recognition processing is performed by inputting the captured image data into the learned model 121. The image recognition processing here is the processing of recognizing a specific location (a location that shields broadcast radio waves) in the captured image. When the image recognition processing is completed, the process proceeds to the next step S2.

[0047] In step S2, the determination unit 113 determines whether a specific location has been detected by the image recognition processing. The case where a specific location is recognized in the captured image by the image recognition processing corresponds to the case where a specific location has been detected. For example, when the captured image includes an entrance to a tunnel or an image recognized as being inside a tunnel, a specific location is detected. In the configuration of this embodiment, it is possible to detect a specific location before the vehicle enters the specific location. If a specific location is detected (Yes in step S2), the process proceeds to the next step S3. If a specific location is not detected (No in step S2), the process proceeds to step S7.

[0048] In step S3, the determination unit 113 determines to stop the broadcast station search function. This is because when a specific location is detected, it is estimated that even if the broadcast station search is performed, the target broadcast station cannot be found and the search will continue uselessly. By stopping the broadcast station search function, such a continuous search state can be avoided and the processing load on the control device 1 can be reduced. When the stop determination is made, the process proceeds to the next step S4.

[0049] In step S4, the same image recognition process as in step S1 is performed. That is, a process of recognizing a specific location in the captured image is performed. Note that the captured image used for the image recognition process is a captured image different from that in step S1, and is a captured image taken after the function of the broadcast station search is stopped. When the image recognition process is completed, the process proceeds to the next step S5.

[0050] In step S5, the determination unit 113 determines whether or not a specific location is detected by the image recognition process. The case where a specific location is not recognized in the captured image by the image recognition process corresponds to the case where no specific location is detected. For example, when the vehicle is in a tunnel, usually, since the captured image includes an image that can be recognized as being inside the tunnel, it is determined that there is a detection of a specific location. For example, after the vehicle enters the tunnel and then exits the tunnel and there is no new detection of a specific location, it is determined that there is no detection of a specific location. When it is determined that there is no detection of a specific location (Yes in step S5), the process proceeds to step S6. When it is determined that there is a detection of a specific location (No in step S5), the process returns to step S4. In this case, the stop of the broadcast station search function continues.

[0051] In step S6, since the vehicle is not in a specific location that shields the radio wave for broadcasting and furthermore is estimated not to reach a specific location immediately, the broadcast station search function is restarted. Thereby, until a specific location is detected by the next image recognition process, the broadcast station search is performed as necessary. When the broadcast station search function is restarted, the process proceeds to the next step S7.

[0052] In step S7, it is confirmed whether or not an operation end event has occurred. The operation end event is, for example, when the user instructs to switch to another media source from the state of using the TV tuner 3 or the radio tuner 4. When the operation end event has occurred (Yes in step S7), the process in FIG. 3 ends. When the operation end event has not occurred (No in step S7), the process returns to step S1.

[0053] (Operation Example Related to Broadcast Station Search) FIG. 4 is a flowchart showing an operation example related to broadcast station search of the control device 1 according to an embodiment of the present invention. The flowchart shown in FIG. 4 starts, for example, when a selection of using the TV tuner 3 or the radio tuner 4 is made according to an operation instruction from a user.

[0054] In step S11, the control unit 11 monitors whether or not it is in a state where the broadcast station selected by the user cannot be received. Whether or not it is in a state where it cannot be received can be determined based on the reception level of the broadcast wave obtained from the TV tuner 3 or the radio tuner 4. When it is determined that it is in a state where the selected broadcast station cannot be received (Yes in step S11), the process proceeds to the next step S12.

[0055] In step S12, the control unit 11 determines whether or not the broadcast station search function is stopped. The stop determination of the broadcast station search function is separately performed based on the shooting data obtained from the camera 9 as described above. When the broadcast station search function is not stopped (No in step S12), the process proceeds to the next step S13. When the broadcast station search function is stopped (Yes in step S12), the process proceeds to step S15.

[0056] In step S13, the control unit 11 performs a broadcast station search by the search unit 111. That is, a search for a relay station or an affiliated station of the received broadcast station is automatically performed. When the broadcast station search is completed, the process proceeds to the next step S14.

[0057] In step S14, it is checked whether an operation end event has occurred. The operation end event is, for example, when the user instructs to switch to another media source from a state where the TV tuner 3 or the radio tuner 4 is being used. When an operation end event has occurred (Yes in step S14), the process in FIG. 4 ends. When an operation end event has not occurred (No in step S14), the process returns to step S11.

[0058] In step S15, the control unit 11 instructs the instruction unit 114 to play the above-described alternative sound (such as playing music data) using the media player 5. As a result, the media player 5 operates and music or the like is output. When the instruction to play the alternative sound is given, the process proceeds to the next step S16.

[0059] In step S16, the control unit 11 monitors the release of the stop of the broadcast station search function. The release of the stop of the broadcast station search function is performed, for example, when the vehicle exits a tunnel as described above. When the stop of the broadcast station search function is released (Yes in step S16), the process proceeds to the next step S17.

[0060] In step S17, the control unit 11 instructs the media player 5 or the like to stop playing the alternative sound. As a result, the playback of the alternative sound is stopped. In addition, the control unit 11 performs a process of resuming the reception of the broadcast station that was received before becoming unable to receive. By configuring in this way, for example, after the vehicle exits the tunnel, it is possible to play the broadcast station that was received before entering the tunnel. When the process of step S17 is completed, the process proceeds to step S14 described above.

[0061] <4. Modification Example> (4-1. First Modification Example) FIG. 5 is a flowchart showing a modification example of the operation related to the broadcast station search of the control device 1 shown in FIG. 4. In FIG. 5, the same reference numerals are given to the same processes as in FIG. 4. For the processes that are the same as in FIG. 4, the description will be omitted when there is no need to repeat the description particularly.

[0062] In the above-described embodiment, regardless of the reception level of the broadcast wave being received, a configuration is adopted in which a stop determination of the broadcast station search function is made according to the result of the image recognition process for the periodically taken images (by the camera 9). Then, in the operation example shown in FIG. 4, a configuration is adopted in which the process related to the broadcast station search is performed using the on / off result of the broadcast station search function determined according to the result of the image recognition process.

[0063] On the other hand, in this example, a configuration is adopted in which a stop determination of the broadcast station search function is made according to the reception level of the broadcast wave being received. That is, on the condition that it is determined (Yes in step S11) that the broadcast station selected by the user cannot be received, a determination process is performed (step S12A) as to whether to stop the broadcast station search function.

[0064] Note that the determination as to whether to stop the broadcast station search function may be made, for example, using the captured image taken at the time when it is determined in step S11 that reception is impossible. For example, when a specific location (inside a tunnel or in the shade of a building) is detected from the captured image, it is determined to stop the broadcast station search function, and when no specific location is detected, it is determined to maintain the state where the broadcast station search function is effective.

[0065] When it is determined to maintain the state where the broadcast station search function is effective (No in step S12A), the process proceeds to step S13 and the broadcast station search is performed. When it is determined to stop the broadcast station search function (Yes in step S12A), the process proceeds to step S15 and an instruction to reproduce an alternative sound is given.

[0066] When the instruction to play the substitute sound is completed, the process proceeds to step S16A. In step S16A, it is determined whether to resume the broadcast station search function. Note that the determination of whether to resume the broadcast station search function is executed by performing image recognition processing on the captured image (by the camera 9) obtained after the broadcast station search function is stopped. Step S16A is repeated until a state where a specific location is not detected is reached. When a state where a specific location is not detected is reached, it is determined to resume the broadcast station search (Yes in step S16A), and the process proceeds to the next step S17. Thereby, an instruction to stop playing the substitute sound and a process to resume receiving the broadcast station that was received before becoming unable to receive are performed.

[0067] (4-2. Second Modified Example) FIG. 6 is a block diagram showing the control device 1A of the modified example. The control device 1A of the modified example makes a determination related to the broadcast station search using a plurality of learned models 121A1, ···, 121An (n is a natural number of 2 or more). In this regard, it is different from the above-described embodiment in which a determination (stop determination) related to the broadcast station search is made using only one learned model 121.

[0068] In this modified example, the determination unit 113A makes a determination related to the broadcast station search using a plurality of learned models 121A1, ···, 121An prepared separately for each different broadcast station. Here, the different broadcast stations mentioned here may be rephrased as different broadcast waves, or may be interpreted to include the meanings of both.

[0069] The plurality of learned models 121A1, ···, 121An are each learned models obtained by performing machine learning using, as teacher data, a plurality of captured data captured at locations with poor reception conditions for each broadcasting station. The locations with poor reception conditions may be, for example, locations where each broadcasting station could not be received. The locations with poor reception conditions may include not only locations where each broadcasting station could not be received, but also locations where reception was not completely impossible but the reception sensitivity was lower than a predetermined threshold and was in a state close to a state where reception was impossible. Note that the captured data used as teacher data is preferably captured data captured by a camera (such as a front camera) mounted on a traveling vehicle.

[0070] Each of the plurality of learned models 121A1, ···, 121An outputs, together with a similarity, a location similar to a location where the reception condition of the corresponding broadcasting station deteriorates when the captured image of the camera 9 is input. When there is no location similar to a location where the reception condition deteriorates in the input captured image, for example, the location may not be output and the similarity may be set to zero.

[0071] When it is necessary to perform a broadcasting station search, the determination unit 113A determines, as a selection target, a broadcasting station selected according to the reception environment information for each broadcasting station obtained from each of the learned models 121A, ···, An to which the captured data is input. The case where it is necessary to perform a broadcasting station search may be, for example, the time point when reception of the received broadcasting station becomes impossible. Also, the case where it is necessary to perform a broadcasting station search may be the case where a specific location is detected using the learned model 121 of the above-described embodiment. The captured data may be, for example, a captured image captured at the time point when reception becomes impossible, or before or after the time point when reception becomes impossible.

[0072] In this modification, the reception environment information is the similarity to a location with a poor reception condition. A location with a high similarity to a location with a poor reception condition has a high possibility of not being able to receive a broadcast wave, and it can be estimated that the reception environment is poor. A location with a low similarity to a location with a poor reception condition does not necessarily have a high possibility of not being able to receive a broadcast wave, and it can be estimated that the reception environment is not poor.

[0073] The determination unit 113A compares the similarities obtained from the input of the captured data to each of the learned models 121A1, ···, An. Then, the determination unit 113A determines that the broadcast station corresponding to the learned model that outputs the result with the lowest similarity among the plurality of learned models 121A1, ···, An is the target for station selection. After that, a search for the broadcast station determined as the target for station selection is performed by the determination unit 113A.

[0074] In a specific area, there may be a situation where a certain broadcast station is easy to receive while another certain broadcast station is difficult to receive. When such a situation occurs, the configuration of this modification example is effective. According to this modification example, even when the currently received broadcast station becomes unreceivable, it is possible to suppress the occurrence of a wasteful broadcast station search and avoid the occurrence of silence or noise resulting from the broadcast station becoming unreceivable.

[0075] Note that there may be a case where it is still impossible to receive even after switching to the broadcast station determined as the selection target by the determination unit 113A. In such a case, the configuration may be such that the function of the broadcast station search is temporarily stopped.

[0076] <5. Precautions, etc.> The various technical features disclosed in this specification can be variously modified within the scope not departing from the gist of the technical creation, in addition to the above-described embodiments. That is, the above-described embodiments should be considered as illustrative in all respects and not restrictive, and the technical scope of the present invention is indicated by the claims rather than the description of the above-described embodiments, and it should be understood that all modifications belonging to the meaning and scope equivalent to the claims are included. Also, the plurality of embodiments and modification examples shown in this specification may be appropriately combined and implemented within the possible range.

Explanation of Reference Numerals

[0077] 1, 1A ··· Control device 9 ··· Camera 112 ··· Acquisition unit 113, 113A ··· Determination unit 114 ··· Indication unit 121, 121A1, 121An ··· Trained model

Claims

1. A control device for controlling a broadcast station search for searching for receivable broadcast stations, comprising: a control unit, wherein the control unit: acquires shooting data from a camera that shoots the periphery of the vehicle, and when detecting the specific location based on the detection information of the specific location that shields the radio wave for broadcasting, which is obtained by inputting the shooting data into a learned model by machine learning, determines to stop the function of the broadcast station search, and when determining to stop the function of the broadcast station search, instructs the reproduction of sound by means different from the reception of broadcast waves. A control device.

2. A control device for controlling a broadcast station search for searching for receivable broadcast stations, comprising: a control unit, wherein the control unit: acquires shooting data from a camera that shoots the periphery of the vehicle, and when detecting the specific location based on the detection information of the specific location that shields the radio wave for broadcasting, which is obtained by inputting the shooting data into a learned model by machine learning, determines to stop the function of the broadcast station search, and when determining to stop the function of the broadcast station search, instructs the stop of the output of sound by the reception of broadcast waves. A control device.

3. A control device for controlling a broadcast station search for searching for receivable broadcast stations, comprising: a control unit, wherein the control unit: acquires shooting data from a camera that shoots the periphery of the vehicle, makes a determination related to the broadcast station search based on reception environment information indicating the reception environment of the radio wave for broadcasting, which is obtained by inputting the shooting data into a learned model by machine learning, the determination related to the broadcast station search is made using a plurality of the learned models prepared separately for different broadcast stations, and the control unit: when it is necessary to perform the broadcast station search, determines a broadcast station selected according to the reception environment information for each broadcast station obtained from each of the learned models into which the shooting data is input as a selection target for station selection. A control device.

Images