Remote control device, communication environment transmission device, and communication environment confirmation program

Abstract

To provide a remote operation device, a communication environment originating device and a communication environment confirmation program, enabling a user to confirm the communication environment of ultrasonic communication.SOLUTION: A remote operation device 10 includes: a speaker 11 which can send a supersonic signal Ω which controls operation of on-vehicle apparatuses (51-54); an information acquisition unit 18 which detects information of noise sound inside a vehicle 100; a control unit 19 which calculates a degree of transfer easiness of the supersonic signal Ω from the information of the noise sound; and a display unit 13 which displays the calculated transfer easiness degree as a communication quality level of the supersonic signal Ω.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a technology for checking the quality of ultrasonic communication performed between an in-vehicle device and a control terminal. [Background technology]

[0002] In recent years, technologies have been developed that allow drivers to remotely control in-vehicle devices such as air conditioners and navigation systems using mobile terminals or remote controllers (collectively referred to as "control terminals" below) while the vehicle is moving. Radio wave communication or infrared communication is often used as a means of communication between the in-vehicle devices and the control terminal. In addition, ultrasonic communication using ultrasonic waves is also known. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-63284 A Summary of the Invention [Problem to be solved by the invention]

[0004] Ultrasound is in the inaudible frequency range (approximately 18 kHz or higher) used for ultrasonic communication and is easily disturbed by environmental noise and other disturbances, so the contents of ultrasonic communication may not be received correctly by the receiving terminal. For example, the sound of a plastic bag rubbing against another contains inaudible components and can be a factor in impeding ultrasonic communication. However, since the user cannot sense ultrasonic waves, he or she cannot recognize the occurrence of such a disturbance, and therefore cannot know whether the system is in a usable state or not.

[0005] The present invention has been made in consideration of the above circumstances, and aims to provide a remote control device, a communication environment transmission device, and a communication environment confirmation program that allow a user to check the communication environment for ultrasonic communication. [Means for solving the problem]

[0006] The remote control device of the present invention comprises a speaker capable of emitting an ultrasonic signal that controls the operation of an in-vehicle equipment, an information acquisition unit that detects information related to noise sounds inside the vehicle, a control unit that calculates the transmission ease of the ultrasonic signal from the information, and a display unit that displays the calculated transmission ease as a communication quality level of the ultrasonic signal.

[0007] The communication environment transmitting device according to the present invention transmits a signal for controlling the operation of an in-vehicle device. By ultrasonic communication Remote control device capable of transmitting receiving the signal from the A communication environment transmitting device capable of receiving a signal is provided in a vehicle. The ultrasonic communication may be disrupted. a detection unit that acquires information about a noise sound inside the vehicle, and a communication environment transmission device that transmits the information about the noise sound inside the vehicle to the remote control device and the communication environment transmission device. The ultrasound between and a transmitting unit that converts the information into an environmental notification signal for calculating the degree of communication transmission ease and transmits the environmental notification signal to the remote control device disposed in the vehicle.

[0008] The communication environment confirmation program of the present invention causes a computer that controls the operation of in-vehicle equipment with ultrasonic signals to execute the steps of receiving information regarding noise sounds inside the vehicle, calculating the ease of transmission of the ultrasonic signal from the information, and displaying the calculated ease of transmission as a communication quality level of the ultrasonic signal. Effect of the Invention

[0009] The present invention provides a remote control device, a communication environment transmitting device, and a communication environment checking program that allow a user to check the communication environment of ultrasonic communication. [Brief description of the drawings]

[0010] [Figure 1] 1 is a conceptual configuration diagram of a vehicle equipped with a remote control device and target in-vehicle equipment according to a first embodiment. [Diagram 2]1A and 1B are schematic diagrams of a smartphone as an example of a remote control device according to a first embodiment. [Diagram 3] 1 is a schematic diagram of the interior of a vehicle equipped with a communication environment transmission device and a target in-vehicle device according to a first embodiment, viewed from the roof side. [Figure 4] 1 is a schematic diagram of the periphery of an inner panel in which a communication environment transmission device according to a first embodiment is provided. [Diagram 5] 5 is a flowchart showing an operation procedure of the remote control device and the communication environment transmitting device according to the first embodiment. [Figure 6] FIG. 11 is a diagram showing the relationship between the air volume and the correction amount in the second embodiment. [Figure 7] 13 is a map showing a relationship between speed and acceleration and a correction amount in the second embodiment. [Figure 8] 10 is a flowchart showing the operation of the remote control device according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0012] (First embodiment)

[0013] First, using Figures 1 to 4, we will explain the remote control device 10 (hereinafter simply referred to as the "control device 10") and the in-vehicle devices (51 to 54) (hereinafter referred to as the "target in-vehicle devices (51 to 54)") that are operated by the control device 10 using an ultrasonic signal Ω. FIG. 1 is a conceptual configuration diagram of a vehicle 100 equipped with an operating device 10 and target in-vehicle devices (51 to 54) according to the first embodiment. 2(A) and (B) are schematic diagrams of a smartphone 10a, which is an example of the operating device 10 according to the first embodiment. FIG. 3 is a schematic diagram of the interior of a vehicle 100 equipped with a transmitting device 70 and target in-vehicle devices (51 to 54) according to the first embodiment, viewed from the roof side. FIG. 4 is a schematic diagram of the periphery of an inner panel 80 on which a transmitting device 70 according to the first embodiment is provided.

[0014] <Operation device 10> The operation device 10 is a mobile terminal 10a owned by a user 200, such as a smartphone as shown in Figures 2(A) and (B). The operation device 10 may also be a PC (Personal Computer), a wearable device, a public terminal, a specially designed and manufactured remote controller, or an in-vehicle operation terminal 10b installed near a rear seat 53c (Figure 3). In the following embodiment, an example will be described in which a smartphone 10a (mobile terminal 10a) is used as the operation device 10 by separately installing an application program developed for remote operation, as appropriate.

[0015] 1, the operation device 10 includes a speaker 11, a microphone 12, a display unit 13, a storage unit 14, and a processing circuit 15. The storage unit 14 is configured, for example, with a ROM (Read Only Memory), a RAM (Random Access Memory), or a HDD (Hard Disk Drive). In addition, the processing circuit 15 performs the functions of a transmission / reception unit 17, an information acquisition unit 18, a control unit 19, and an input / output unit 20 by executing the programs stored in the storage unit 14.

[0016] The transmitter / receiver 17 transmits an ultrasonic signal Ω that controls the operation of the target in-vehicle devices (51 to 54) via the speaker 11. The speaker 11 may be an existing speaker provided for audio, or a dedicated speaker provided separately for ultrasonic communication. The target in-vehicle devices (51 to 54) that are remotely controlled by this ultrasonic signal Ω are, for example, an air conditioner 51 (hereinafter referred to as "air conditioner 51"), lighting 52, a seat 53, or an IVI (In-Vehicle Infotainment) 54. Note that the target in-vehicle devices are not limited to the above examples, and may be electronically controllable in-vehicle accessories such as a lock mechanism for a door opening / closing lever, an in-vehicle camera, a conventional navigation system, an audio device, or the like.

[0017] IVI54 is a system that provides a combination of functions such as navigation, location information service, multimedia playback such as music and video, voice communication, data communication, and Internet connection. The IVI 54 will be described in detail below in the description of the vehicle 100.

[0018] The target in-vehicle devices (51-54) are connected to an in-vehicle communication network 90 such as a Controller Area Network (CAN) or a Local Interconnect Network (LIN). For example, an ultrasonic receiver 79 is provided in the IVI 54, and the ultrasonic receiver 79 receives an ultrasonic signal Ω emitted by the operation device 10. Then, the IVI 54 serves as a repeater to transmit an operation instruction to the target in-vehicle devices (51-54) via the communication network 90. Each of the target in-vehicle devices (51 to 54) may have an ultrasonic receiver 79 and may be remotely controlled by the operation device 10A to directly perform its functions. In response to the remote control, for example, in the multimedia playback function of the IVI 54, functions such as start, stop, volume increase / decrease, media playback, fast forward, or fast rewind are executed.

[0019] In the following, an example will be described in which the target in-vehicle device (51 to 54) is an IVI 54, and a microphone 72 of the IVI 54 capable of detecting an ultrasonic signal Ω is provided in a display unit 71 provided between the driver's seat 53a and the passenger seat 53b on the inner panel 80, as shown in Figures 3 and 4. The ultrasonic communication commands may be acquired from a server 400 connected via the Internet 300. Alternatively, basic commands may be stored in the memory units 14, 73 of the devices (10, 70), and additional commands may be acquired from the server 400.

[0020] Returning to the explanation of the configuration of the operation device 10, the following will be described. The information acquisition unit 18 detects information relating to noise sounds inside the vehicle 100 (hereinafter referred to as "noise-related information"). Here, noise-related information refers to information related to disturbances that impede ultrasonic communication or causes of disturbances, such as the traveling speed of the vehicle 100, the traveling acceleration of the vehicle 100, the opening degree of the window 84, or the air volume of the air conditioner 51.

[0021] For example, the conditioned air σ sent from the air outlet 51a of the air conditioner 51 in FIG. 3 forms a temperature boundary surface between the mobile terminal 10a operated by the user 200 and the microphone 72 of the IVI 54 due to the temperature difference with the surrounding air. Air-conditioned airflow σ blown from air outlet 51a of the front seat air conditioner and air outlet 51b of the rear seat air conditioner flows between mobile terminal 10a held by user 200 seated in rear seat 53c and IVI 54. If ultrasonic signal Ω enters the temperature boundary surface formed at the boundary between air-conditioned air σ and the surrounding air, it may be disturbed by being reflected by the temperature boundary surface, which may significantly affect ultrasonic communication. Therefore, the information acquisition unit 18 acquires the air blowing sound inside the vehicle 100 via the microphone 12 of the mobile terminal 10a.

[0022] Furthermore, when the air conditioner 51 is operated, operation sounds of the air conditioner 51 are generated, such as the sound of the conditioned air σ coming out of the air outlets 51a, 51b coming into contact with the fins of the air outlets 51a, 51b, and the sound of the motor. These operation sounds may contain ultrasonic waves that may cause disturbances in the band used for the ultrasonic signal Ω, and therefore such operation sounds are also included in the noise-related information. The information acquisition unit 18 may directly acquire ultrasonic waves contained in such operation sounds of devices in the vehicle 100 as noise-related information.

[0023] Even if the microphone 12 of the operation device 10 cannot detect ultrasonic waves, the information acquisition unit 18 can learn to estimate ultrasonic waves from operation sounds by machine learning or the like, thereby making it possible to estimate ultrasonic components with high accuracy from operation sounds of in-vehicle devices collected by the existing microphone 12. In particular, by having the information acquisition unit 18 learn in advance the interference frequency range specific to the vehicle 100, even noise sounds inside the vehicle that may seem unrelated at first glance can be included in the noise-related information.

[0024] Furthermore, the information acquisition unit 18 may use a GPS function installed in the mobile terminal 10a to determine the moving speed of the mobile terminal 10a and determine the running mode of the vehicle 100. For example, it is possible to estimate ultrasonic waves generated when the vehicle 100 is coasting, accelerating rapidly, or running electrically.

[0025] The control unit 19 calculates the transmission ease of the ultrasonic signal Ω from the acquired noise-related information. For example, if the blowing noise is loud, it can be assumed that the air circulation inside the vehicle is strong and the transmission ease of the ultrasonic signal Ω is low. Also, if the ultrasonic waves contained in the blowing noise have a frequency far away from the frequency of the ultrasonic signal Ω, the influence on the transmission ease is small. In addition, the control unit 19 calculates the intensity of disturbance generated by the operation sound of the air conditioner 51 in the ultrasonic communication band, and calculates the transmissibility from this intensity.

[0026] Ultrasonic waves may also be generated by air entering and exiting when the window 84 is open, the opening and closing sound of the window 84, switching noise generated from the drive source or battery of the vehicle 100, etc. These noises may also interfere with ultrasonic communication, and therefore such noises are also included in the noise-related information.

[0027] The display unit 13 is, for example, a touch panel that combines an input device for inputting data in response to an operation by the user 200 and a display device such as a liquid crystal display device for displaying data. On the display unit 13, as shown in, for example, FIGS. 2(A) and (B), operation pages 21 for "IVI," "air conditioner," "lighting," and "seats" are displayed switchably using tabs 22. For example, Fig. 2(A) displays an operation page 21 for operating an air conditioner 51, and Fig. 2(B) displays an operation page 21 for operating an IVI 54. On the operation page 21 for the air conditioner 51 in Fig. 2(A), the air conditioner 51 is remotely adjusted using eight buttons (23a to 23h) including a circulation switch button 23a, an AUTO button 23b, an air volume button 23c, and a compressor drive button 23d.

[0028] Moreover, when the "IVI" tab 22 is touched, the operation page 21 of the IVI 54 in FIG. 2(B) is displayed, and the IVI 54 is remotely operated using various buttons (24a to 24g) such as the channel buttons 24a and 24b. Although not shown in the drawings, the brightness adjustment and ON / OFF of the lighting 52 are remotely controlled. Also, the reclining angle adjustment and the fore-aft position adjustment of the seat 53 are remotely controlled.

[0029] Moreover, various icons 31 indicating the remaining battery level of the mobile terminal 10a and the radio wave intensity for wireless communication are displayed in a status bar 27 at the top of the display unit 13 (display screen 26). In the mobile terminal 10a according to the first embodiment, the display unit 13 displays the calculated degree of ease of communication as the communication quality level of the ultrasonic signal Ω in the status bar 27, for example. The communication quality level is expressed in four stages by the number of arcs 28, for example, 0 to 3, as shown in FIGS. 2(A) and 2(B).

[0030] When the communication environment for the ultrasonic signal Ω is good and the degree of communication ease is high, three arcs 28 are displayed by the icon 31 as shown in FIG. 2(A), and when the degree of communication ease drops by one level, two arcs 28 are displayed as shown in FIG. 2(B). The display format of the communication quality level is not limited to the sector icon 31 in which the arcs 28 are arranged concentrically as shown in FIGS. 2(A) and 2(B), and may be represented by, for example, the number of antenna bars or a number. Furthermore, the location where the communication quality level is displayed is not particularly limited to the status bar 27, and may be anywhere on the display screen 26 as long as the user 200 can see it.

[0031] Also, depending on the degree of ease of communication, a message such as "Point the mobile terminal at the vehicle receiving unit" or "Put the mobile terminal closer to the vehicle receiving unit" may be displayed to the user 200, and the user may be notified of a specific action to improve the degree of ease of communication. Furthermore, instead of displaying the message on the display screen 26, the message may be notified by voice, and the manner of notification is not particularly limited. By notifying the user of a specific action in this manner, the user is not only able to recognize that the communication quality level is low, but also able to take a specific action to improve the communication quality level.

[0032] By providing the mobile terminal 10a with such a communication environment checking function, the user 200 can check the communication quality level on the operation device 10 before starting remote operation or during operation, and know whether ultrasonic communication is available or not. In addition, by repeatedly using the communication environment confirmation function, it becomes possible to predict the circumstances in which it will be difficult to use ultrasonic communication.

[0033] <Vehicle 100> Next, a communication environment transmitting device 70 (hereinafter simply referred to as "transmitting device 70") that cooperates with the operating device 10 and a vehicle 100 equipped with this transmitting device 70 will be described with reference to Figs. 3 and 4 in addition to Fig. 1. The vehicle 100 is equipped with a vehicle control unit 91 (ECU: Electronic Control Unit), various sensors (92 to 96), an IVI 54, and target in-vehicle devices (51 to 54). These devices (91 to 96) are connected to each other via the above-mentioned communication network 90 to transmit and receive information.

[0034] The ECU 91 is an on-board computer provided in multiple locations within the vehicle 100, and has, for example, an engine control function, a steering control function, a brake control function, and a data security function. For example, the brake control ECU 91 receives information on the operation of the accelerator pedal and the brake pedal and the traveling speed via a pedal stroke sensor 93 and a vehicle speed sensor 92, and converts this information into control signals to apply driving force or braking force to the front wheels or the rear wheels.

[0035] The IVI 54 has a touch panel display unit 71 that combines an input device for inputting data in response to operations by the user 200, and a display device such as a liquid crystal display device for displaying data. The IVI 54 also includes an in-vehicle microphone 72, an in-vehicle memory unit 73, an in-vehicle speaker 74, and an in-vehicle processing circuit 75. In describing the IVI 54, the name of each part of the IVI 54 will be prefixed with "in-vehicle" as appropriate to distinguish it from the speaker 11, the microphone 12, the display unit 13, the memory unit 14, and the processing circuit 15 in the mobile terminal 10a.

[0036] The in-vehicle storage unit 73 is configured with, for example, a ROM, a RAM, or a HDD. The in-vehicle processing circuit 75 executes instructions according to the programs stored in the in-vehicle storage unit 73, whereby the IVI 54 performs various functions such as the navigation function and the location information service function described above.

[0037] As described above, a plurality of air outlets 51a, 51b of the air conditioner 51 are provided in the vehicle 100 in accordance with targets to which the conditioned airflow σ is to be sent. The air outlet 51a provided for the front seats 53a, 53b is located near the display unit 71 of the IVI 54, but is distant from the rear seat 53c. Therefore, even if the conditioned air σ is blown from the air outlet 51a, the air is not sufficiently sensed by the mobile terminal 10a of the user 200 seated in the rear seat 53c. However, even if the air is not sensed by the mobile terminal 10a, the conditioned air σ forms a temperature boundary layer near the IVI 54, which becomes a factor that inhibits ultrasonic communication.

[0038] Therefore, in order to make the communication environment confirmation function of the mobile terminal 10a more accurate, it is preferable to equip the IVI 54 with a transmission function and to use it as a transmission device 70 that notifies the operation device 10 of a disturbance occurrence state that inhibits ultrasonic communication near the IVI 54. Specifically, the IVI 54 ( 70 ) further includes the functions of a detection unit 76 , a location information acquisition unit 77 , and a transmission unit 78 .

[0039] The detection unit 76 receives noise-related information from the ECU 91 and various sensors ( 92 to 96 ) at various locations connected to the IVI 54 via a communication network 90 . Furthermore, the detection unit 76 acquires noise-related information within the vehicle from these connected devices (91 to 96). The information detected by the detection unit 76 is, for example, the running speed of the vehicle 100, the running acceleration of the vehicle 100, the driving state of the electric motor, the driving state of the engine, the opening degree of the window 84, or the air conditioning air volume. In addition, the vehicle parameter may be another physical quantity related to the vehicle 100 derived by combining the running speed and the like. For example, the speed or acceleration detected by the detection unit 76 is detected via a vehicle speed sensor 92 . The speed or acceleration may be acquired by the position information acquisition unit 77 via a GPS (Global Positioning System) sensor 96, which is a satellite positioning system.

[0040] Furthermore, the detection unit 76 detects the opening degree of the window 84 via a window sensor 94. This is because when the window 84 is fully open, a large amount of air flows into the vehicle interior, and therefore disturbances that affect the ultrasonic signal Ω are likely to be large. Furthermore, the transmitting device 70 may detect actually occurring noise directly via the vehicle-mounted microphone 72, similar to the mobile terminal 10a.

[0041] The transmitting unit 78 is provided in the vehicle, converts noise-related information in the vehicle into an ultrasonic signal Ω (environment notification signal) for environmental notification, and transmits it to the operating device 10 in the vehicle. In this way, the IVI 54 collects noise-related information inside the vehicle, particularly around the IVI 54, that reduces the quality of the ultrasonic signal Ω, and transmits the collected information to the mobile terminal 10a via a signal.

[0042] The control unit 19 of the mobile terminal 10a reflects the notified noise-related information in the display of the communication quality level. The communication form for notifying the noise-related information around the IVI 70 sent to the mobile terminal 10a may be ultrasonic communication, wireless communication, or infrared communication. The transmitting device 70 does not have to be built into the IVI 54 . The transmitting device 70 may be installed, for example, as shown in FIG. 4, on the surface 71a of the IVI 54, in the area 97b surrounding the rearview mirror 85, or on the steering wheel 71c.

[0043] In addition, the functional units (17-20, 76-79) of the processing circuits 15, 75 of the operation device 10 and the target in-vehicle devices (51-54) can also be realized by hardware such as an ASIC (Application Specific Integration Circuit) or an FPGA (Field-Programmable Gate Array) instead of software processing. Furthermore, these functional units can also be realized by a combination of software processing and hardware processing.

[0044] Next, the operation procedure of the operating device 10 and the transmitting device 70 according to the first embodiment will be described with reference to the flowchart of FIG. 5 (see FIGS. 1 to 4 as appropriate).

[0045] First, in order to start or adjust the target in-vehicle device (51 to 54), the user 200 starts a remote control application on the mobile terminal 10a (S11). When the remote control application is started, the operation page 21 for each target in-vehicle device (51-54) as shown in Figures 2(A) and (B) is displayed on the display screen 26 of the mobile terminal 10a. When the in-vehicle transmitting device 70 is used, the mobile terminal 10a notifies the transmitting device 70 by an ultrasonic signal Ω that the remote control application has been started.

[0046] Next, the information acquisition unit 18 of the mobile terminal 10a acquires noise-related information (S12 to S15). Note that steps S12 to S15 may be performed in any order. For example, first, the information acquisition unit 18 acquires noise sound inside the vehicle 100 via the microphone 12 of the mobile terminal 10a (S12). Furthermore, the information acquisition unit 18 detects the traveling state of the vehicle 100 using the GPS function of the mobile terminal 10a or via each of the sensors (92 to 96) (S13). In this case, instead of obtaining the instantaneous speed of the vehicle 100, an average speed may be used.

[0047] In addition, the opening degree of each window 84 and the operating state of the air conditioner 51 are detected from the microphone 12 (S14, S15). In the mobile terminal 10a, the opening degree of each window 84 and the operating state of the air conditioner 51 are both detected as noise sounds. Since the outside air flowing into the vehicle interior and the conditioned airflow σ from the air conditioner 51 both have characteristics in terms of intensity and frequency, it is possible to distinguish and identify the opening degree of the window 84 or the operating state of the air conditioner 51 by learning the characteristics using machine learning. In addition, the traveling direction of the vehicle 100 and the direction in which the noise sounds are generated, which are acquired using the GPS function, may be used as elements for identifying the opening degree information of the window 84 and the operating state of the air conditioner 51.

[0048] The detection in steps S12 to S15 may be performed by the transmitting device . In this case, the transmitting device 70 collects noise-related information upon receiving a notification of the start of a remote control application of the operating device 10. In this case, the microphone for acquiring the noise sound in step S12 is the in-vehicle microphone 72 provided in the transmitting device 70 as described above.

[0049] Furthermore, the driving state of the vehicle 100, the state of the windows 84, and the operating status of the air conditioner 51 in steps S13 to S15 are acquired through the communication network 90. ​​Note that the driving state may be acquired using a GPS sensor 96 instead of the vehicle speed sensor 92 or the pedal stroke sensor 93. Then, the transmitting device 70 transmits the noise-related information to the mobile terminal 10a, for example, by ultrasonic communication. By transmitting the noise-related information to the mobile terminal 10a in this manner, the mobile terminal 10a can more accurately calculate the communicability.

[0050] By requesting noise-related information from the transmitting device 70 each time the operation page 21 of the remote control application becomes active, it is possible to check the communication quality level at the timing when remote control is to be used on the mobile terminal 10a. However, the timing of requesting noise-related information from the transmitting device 70 is not limited to this, and the request may be made automatically at regular intervals, for example.

[0051] Next, the control unit 19 calculates the transmissibility based on the noise-related information (S16). There may be cases where the communication environment is poor and the transmitting device 70 is unable to detect the launch of the remote control application itself, or where the transmitting device 70 is unable to detect the ultrasonic signal Ω transmitted to the mobile terminal 10a. In either case, even after the remote control application is started, the ultrasonic signal Ω from the transmitting device 70 does not reach the mobile terminal 10a. If the mobile terminal 10a does not receive the ultrasonic signal Ω from the transmitting device 70 within a predetermined time, the mobile terminal 10a determines that the communication environment is poor and calculates the communication ease. Then, the control unit 19 displays the communication quality level using the icon 29 in the status bar 27 of the display unit 13 (S17; END).

[0052] As described above, the controller 10 according to the first embodiment allows the user 200 to check the communication environment for ultrasonic communication. In addition, by repeatedly checking the communication environment, it becomes possible to predict the situations in which it will be difficult to use ultrasonic communication.

[0053] Second embodiment FIG. 6 is a diagram showing the relationship between the air volume and the correction amount in the second embodiment. In the operation device 10 according to the second embodiment, the control unit 19 corrects the ultrasonic signal Ω transmitted from the operation device 10. The amount of correction to the ultrasonic signal Ω is changed according to the acquired noise-related information.

[0054] As described in the first embodiment, a plurality of air outlets (51a, 51b) of the air conditioner 51 are provided inside the vehicle 100. The direction of airflow also differs depending on the mode, such as a normal mode in which air is blown toward the upper body of a passenger, a foot mode, or a defroster mode (DEF mode). Therefore, the effect of the air conditioning airflow σ on ultrasonic communication depends on which mode is being executed during ultrasonic communication. For example, in FOOT mode, the air conditioning airflow σ flows near the floor surface inside the vehicle to warm the feet of passengers. Therefore, when the air conditioner 51 is operating in FOOT mode, the effect of the airflow on ultrasonic communication is small.

[0055] Therefore, for example, as shown in FIG. 6, the amount of correction to the ultrasonic signal Ω is changed in accordance with the mode being executed. For example, it is assumed that the transmitting device 70 installed in the surrounding area 97b of the rearview mirror 85 in FIG. At this time, when the fan mode is the above-mentioned FOOT mode, it is considered that the operation does not have a large effect on ultrasonic communication. Therefore, even if information is received from the transmitting device 70 that the fan strength of the air conditioner 51 is "high", the correction amount of the ultrasonic signal Ω in the control unit 19 is set to be small. In other words, as shown in Fig. 6, the increase gradient of the correction amount of the ultrasonic signal Ω with an increase in the air volume is set to be different for each fan mode.

[0056] 6 shows the relationship between the airflow rate and the correction amount when the vehicle-mounted microphone 72 is installed at the upper part of the vehicle interior. The function of the airflow rate and the correction amount for each mode varies depending on the installation position of the transmitting device 70. The correction amount is appropriately determined depending on the distance between the microphone 72 of the transmitting device 70 and the air outlets (51a to 51c) from which the air is being blown, and the likelihood of being hit by the air-conditioned air σ.

[0057] It is also preferable to change the correction amount according to the opening degree of the window 84 obtained from the window sensor 94. This is because the flow rate of outside air flowing in through the window 84 depends greatly on the opening degree of the window 84, and the outside air generates convection inside the vehicle, which greatly affects ultrasonic communication. In this way, by taking into account the operating status of the in-vehicle devices acquired via the communication network 90 when correcting the ultrasonic signal Ω, it is possible to improve communication quality through effective correction.

[0058] FIG. 7 is a map showing the relationship between the speed and acceleration and the correction amount. In the second embodiment, a map that defines the speed, acceleration, and correction amount shown in Fig. 7 is stored in the storage unit 14. This map is created by measuring ultrasonic characteristics of the vehicle 100 for each speed and acceleration, and specifying and defining an optimal correction amount for each speed and acceleration.

[0059] The control unit 19 determines a correction coefficient based on the mapped correction amount, and corrects the ultrasonic signal Ω transmitted from the mobile terminal 10a. For example, when the vehicle 100 is accelerating, the engine operates at high power, so the combustion noise and the ultrasonic intensity contained in the combustion noise are considered to be strong. Therefore, the correction amount is set to increase from "small" to "medium" and then to "large" as the acceleration increases.

[0060] Incidentally, when coasting, there is no combustion sound because fuel is cut off, so there is no effect of ultrasonic waves contained in the combustion sound. However, if the vehicle 100 is a hybrid vehicle, regenerative sound is generated by the electric motor when coasting. The same applies to electric vehicles. Therefore, taking into consideration the regenerative noise generated during coasting and braking, the correction amount in the negative acceleration area of ​​the map is set to "medium" or "large" according to the output of the electric motor.

[0061] In addition, since the noise-related information sent from the transmitting device 70 is usually carried on the ultrasonic signal Ω, it may be drowned out by disturbances in the ultrasonic band and may not sufficiently reach the operating device 10. In this case, the correction amount may be determined based on noise-related information received within the past few minutes.

[0062] In addition, except for correcting the ultrasonic signal Ω and changing the amount of correction based on noise-related information, the second embodiment is similar in configuration and operation to the first embodiment, so duplicated explanations will be omitted.

[0063] Thus, according to the operating device 10 of the second embodiment, in addition to the effect of the first embodiment, correction according to the noise environment can be performed, so that the communication quality of the ultrasonic signal Ω can be maintained at high quality even if a disturbance occurs inside the vehicle.

[0064] Third embodiment FIG. 8 is a flowchart showing the operation of the operating device 10 according to the third embodiment.

[0065] In the operation device 10 according to the third embodiment, when the communication quality level is equal to or lower than a predetermined level and the operation device 10 is not oriented toward the target in-vehicle device (51-54), the control unit 19 notifies the user 200 to orient the operation device 10 toward the target in-vehicle device (51-54). In other words, when the IVI 54 is a repeater for the other target in-vehicle devices (51-53), the control unit 19 notifies the user 200 to orient the mobile terminal 10a toward the IVI 54.

[0066] A specific procedure will be described with reference to the flowchart in FIG. First, the information acquisition unit 18 checks whether the remote control application is running (YES in S21), and checks the orientation of the mobile terminal 10a (S22). The orientation of the mobile terminal 10a is confirmed using an electronic compass installed in the mobile terminal 10a. When the user 200 is seated and holds the mobile terminal 10a in a correct orientation, the speaker 11 of the mobile terminal 10a is considered to face the front of the vehicle 100.

[0067] Next, the control unit 19 checks whether the direction of the speaker 11 of the mobile terminal 10a coincides with the traveling direction of the vehicle 100 (S23). Since the orientation of the vehicle 100 matches the traveling direction of the vehicle 100, if the traveling direction and the orientation of the mobile terminal 10a match (YES in S23), it can be estimated that the mobile terminal 10a is facing forward within the vehicle 100. Generally, the target vehicle-mounted devices (51 to 54) are often arranged in the front of the vehicle cabin. Even when they are installed in the rear seat 53c, they are arranged in front of the user 200 in the vehicle travel direction. Therefore, when the traveling direction of the vehicle 100 and the direction of the mobile terminal 10a match, the direction of the mobile terminal 10a can be said to be appropriate.

[0068] If the traveling direction and the orientation of the mobile terminal 10a do not match (NO in S23), it is determined that the mobile terminal 10a is not facing the target in-vehicle device (51 to 54). Therefore, the control unit 19 notifies the user 200 that the orientation of the mobile terminal 10a should be changed, for example, by displaying on the display unit 13 or by voice (S24). The user 200 changes the orientation of the mobile terminal 10a to a direction that allows for establishment of a suitable communication state. The member on the mobile terminal 10a that is to be aligned with the traveling direction is not limited to the speaker 11, but may be an appropriate member such as the microphone 12 depending on the characteristics of the model.

[0069] If the direction of the microphone 12 of the mobile terminal 10a and the traveling direction of the vehicle 10 match (YES in S23), the control unit 19 notifies the user 200 of the match by, for example, displaying the operation page 21 on the display screen 26 (S25). In addition, many of the recent smartphones 10a are equipped as standard with a function for changing the display form, such as the display direction and aspect ratio, as needed depending on the way the user 200 holds the device. The display form in step S25 may be a display form that utilizes such technology to prompt the user 200 to hold the mobile terminal 10a in an appropriate orientation by fixing the display figure on the display screen 26 in a specific direction in the car, for example, so that the speaker 11 facing downward faces upward. By using such a display form, the user 200 can check the appropriate orientation of the mobile terminal 10a and adjust the orientation with minimal attention. Then, the communication quality level is displayed on the display screen 26 in the same manner as in the first embodiment (S26; END).

[0070] In addition, except for the prompting to align the direction of the mobile terminal 10a with the traveling direction of the vehicle 100, the third embodiment is similar to the first embodiment in terms of configuration and operation, so a duplicated description will be omitted.

[0071] Thus, according to the operation device 10 of the third embodiment, in addition to the effects of the first embodiment, the user 200 is encouraged to adjust the orientation before remotely operating the target in-vehicle devices (51 to 54), and a suitable communication environment can be created. Therefore, the communication quality level can be improved.

[0072] According to at least one of the embodiments of the operation device, the transmitting device, or the communication environment confirmation program described above, the degree of transmission ease is visualized, thereby enabling the user to check the communication environment for ultrasonic communication.

[0073] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0074] 100...vehicle, 200...user, 300...Internet, 400...server, 10...remote control device (operation device), 10a (10)...mobile terminal (smartphone), 10b (10)...in-vehicle operation terminal, 11...speaker, 12...microphone, 13...display unit, 14...storage unit, 15...processing circuit, 17...transmission / reception unit, 18...information acquisition unit, 19...control unit, 20...input / output unit, 21...operation page, 22...tab, 23a to 23h, 24a to 24g...operation button, 26...display screen, 27...status bar, 28...arc, 29...icon displaying communication quality level, 31...icon, 51...air conditioner (air conditioner), 51a...front seat air conditioner outlet, 51b...rear seat air conditioner outlet 52... Lighting, 53 (53a, 53b, 53c)...seats (driver's seat, passenger seat, rear seat), 54...IVI, 70...communication environment transmitter (transmitter, IVI), 71...display unit, 72...vehicle microphone (microphone), 73...vehicle memory unit (memory unit), 74...vehicle speaker, 75...vehicle processing circuit (processing circuit), 76...detection unit, 77...location information acquisition unit, 78...transmitter, 79...ultrasonic receiver, 80...inner panel, 84...window, 85...rear-view mirror, 86...steering wheel, 90...communication network, 91...vehicle control unit (ECU), 92...vehicle speed sensor, 93...pedal stroke sensor, 94...window sensor, 95...steering angle sensor, 96...GPS sensor, 97a to 97c...position of communication environment transmitter, Ω...ultrasonic signal.

Claims

1. a speaker capable of emitting an ultrasonic signal for controlling the operation of an in-vehicle device; an information acquisition unit that detects information regarding noise sound inside a vehicle; A control unit that calculates a degree of transmission ease of the ultrasonic signal from the information; a display unit that displays the calculated ease of transmission as a communication quality level of the ultrasonic signal.

2. 2. The remote control device according to claim 1, wherein the information regarding the noise is at least one of a vehicle speed, a vehicle acceleration, a window opening degree, and an airflow rate of an air conditioner.

3. The information acquisition unit detects an output of an electric motor mounted on a vehicle, 3. The remote control device according to claim 1, wherein the control unit changes a correction amount of the ultrasonic signal in accordance with the output of the electric motor.

4. The remote control device according to any one of claims 1 to 3, wherein the control unit notifies a user to turn the remote control device toward the in-vehicle equipment when the communication quality level is below a predetermined level and the remote control device is not facing the in-vehicle equipment.

5. A communication environment transmitting device capable of transmitting a signal for controlling an operation of an in-vehicle device from a remote control device via ultrasonic communication, the communication environment transmitting device being capable of receiving the signal via ultrasonic communication, a detection unit provided in a vehicle and configured to acquire information regarding noise sound within the vehicle that may impede the ultrasonic communication; A communication environment transmitting device characterized by comprising: a transmitting unit provided within the vehicle, which converts the information regarding the noise sound within the vehicle into an environmental notification signal for calculating the transmission ease of the ultrasonic communication between the remote control device and the communication environment transmitting device, and transmits the information to the remote control device provided within the vehicle.

6. 6. The communication environment transmitting device according to claim 5, wherein the information regarding the noise is at least one of a vehicle speed, a vehicle acceleration, a window opening degree, and an airflow rate of an air conditioner.

7. A computer that controls the operation of in-vehicle equipment using ultrasonic signals. receiving information regarding a noise sound within the vehicle; calculating a transmission ease of the ultrasonic signal from the information; and displaying the calculated degree of ease of transmission as a communication quality level of the ultrasonic signal.

Images