Communication environment transmission device and communication environment transmission program

Abstract

To provide a remote control device, a communication environment transmission device, and a communication environment confirmation program capable of maintaining communication quality display that accurately reflects a change in the communication environment of ultrasonic communication.SOLUTION: A communication environment transmission device 70 includes a detection unit 76 that is installed in a vehicle and acquire information on noise in the vehicle, an in-vehicle control unit 78 that is installed in the vehicle and converts information on noise in the vehicle into an environmental notification signal ε, and a transmission unit 79 that transmits the environment notification signal ε to a remote control device 10 located in the vehicle, and the in-vehicle control unit 78 causes the transmission unit 79 to transmit the environment notification signal ε when a vehicle parameter of the vehicle changes by default.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a technology for checking the quality of ultrasonic communication performed between a target in-vehicle device and a control terminal. [Background technology]

[0002] In recent years, technologies have been developed that allow drivers to remotely control in-vehicle devices such as air conditioners and navigation systems using mobile devices or remote controllers (hereinafter collectively referred to as "control terminals") while in motion. Radio wave or infrared communication is often used as a means of communication between the in-vehicle devices and the control terminal. Ultrasonic communication using ultrasonic waves is also known. Note that ultrasonic signals are easily disrupted by any disturbances, such as environmental noise, in the inaudible frequency range (approximately 18 kHz or higher) used in ultrasonic communication. For example, the sound of a plastic bag rubbing against another bag contains inaudible components, and such sounds can degrade the communication quality of ultrasonic communication. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-63284 Summary of the Invention [Problem to be solved by the invention]

[0004] To enable users to confirm that the content of ultrasonic communications is being received correctly by the receiving terminal, there is a need for technology that can visualize the communication quality of ultrasonic signals using icons or other methods. In particular, due to the nature of ultrasonic waves, the communication quality of ultrasonic communication changes from moment to moment depending on the environment around the vehicle, such as traffic conditions, outside temperature, weather, driving mode, etc. Therefore, the display of communication quality must also immediately and accurately reflect changes in the communication environment.

[0005] The present invention has been made in consideration of the above circumstances, and aims to provide a remote control device, a communication environment transmission device, and a communication environment confirmation program that can maintain a communication quality display that accurately reflects changes in the communication environment of ultrasonic communication. [Means for solving the problem]

[0006] The communication environment transmission device according to this embodiment is provided in a vehicle. Interfering with ultrasonic communication a detection unit for acquiring information about a noise sound; Before Regarding the noise The aforementioned an in-vehicle control unit that converts information into an environmental notification signal; and a transmitting unit that transmits the environmental notification signal to a remote control device disposed in the vehicle; an ultrasonic receiving unit that receives an ultrasonic signal for controlling an operation of an in-vehicle device from the remote control device; The in-vehicle control unit comprises: The noise may be generated vehicle parameters of the vehicle This may disrupt the ultrasonic communication. When a change occurs, the transmitting unit transmits the environmental notification signal.

[0009] The communication environment transmission program according to the present embodiment is provided in a vehicle and includes a remote control device disposed in the vehicle. a communication environment transmitting program for causing a computer to operate as a communication environment transmitting device for receiving an ultrasonic signal for controlling the operation of an in-vehicle device from the The computer Interfering with ultrasonic communication obtaining information about the noise sound; The noise Regarding The aforementioned converting the information into an environmental notification signal; The noise may be generated vehicle parameters of the vehicle This may disrupt the ultrasonic communication. and transmitting the environmental notification signal to a remote control device disposed in the vehicle when a change occurs. [Effects of the Invention]

[0010] The present invention provides a remote control device, a communication environment transmission device, a communication environment confirmation program, and a communication environment transmission program that allow a user to check the communication environment of ultrasonic communication. [Brief explanation of the drawings]

[0011] [Figure 1]1 is a conceptual configuration diagram of a vehicle equipped with a remote control device and target in-vehicle equipment according to a first embodiment. [Figure 2] 1A and 1B are schematic diagrams of a smartphone as an example of a remote control device according to the first embodiment. [Figure 3] 1 is a schematic diagram of the interior of a vehicle equipped with a communication environment transmission device and target in-vehicle devices according to a first embodiment, viewed from the roof side. [Figure 4] 1 is a schematic diagram of the periphery of an inner panel on which a communication environment transmitter according to a first embodiment is provided. [Figure 5] 4 is a flowchart showing the operation procedure of the remote control device and the communication environment transmitting device according to the first embodiment. [Figure 6] 10 is a flowchart showing the operation procedure of the operating device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0013] (First embodiment) First, using Figures 1 to 4, we will explain the remote control device 10 (hereinafter simply referred to as the "control device 10") and the target in-vehicle devices (51 to 54) (hereinafter referred to as the "target in-vehicle devices (51 to 54)") that are operated by this control device 10 with an operation signal Ω. FIG. 1 is a conceptual configuration diagram of a vehicle 100 equipped with an operating device 10 and target in-vehicle devices (51 to 54) according to the first embodiment. 2(A) and 2(B) are schematic diagrams of a smartphone 10a, which is an example of the operating device 10 according to the first embodiment. FIG. 3 is a schematic view of the interior of a vehicle 100 equipped with a transmitting device 70 and target in-vehicle devices (51 to 54) according to the first embodiment, viewed from the roof side. FIG. 4 is a schematic diagram of the periphery of an inner panel 81 on which a transmitting device 70 according to the first embodiment is provided.

[0014] <Operation device 10> The operation device 10 is a mobile terminal 10a owned by a user 200, such as a smartphone as shown in FIGS. 2(A) and 2(B). The operation device 10 may also be a PC (Personal Computer), a wearable device, a public terminal, a specially designed and manufactured remote controller, or an in-vehicle operation terminal 10b installed near the rear seat 53c.

[0015] In the following embodiment, an example will be described in which an application program developed for remote control (hereinafter referred to as a "remote control app") is separately installed on a smartphone 10a (mobile terminal 10a) as appropriate and used as the operating device 10. As shown in FIG. 1, the operating device 10 includes a speaker 11, a microphone 12, a display unit 13, a storage unit 14, and a processing circuit 15. The storage unit 14 is configured by, for example, a read-only memory (ROM), a random access memory (RAM), or a hard disk drive (HDD). Furthermore, the processing circuit 15 executes the programs stored in the storage unit 14 to perform the functions of a transmission / reception unit 17, an information acquisition unit 18, a control unit 19, and an input / output unit 20.

[0016] The transmitter / receiver 17 transmits an ultrasonic signal Ω (hereinafter referred to as "operation signal Ω") that controls the operation of the target in-vehicle devices (51 to 54) via the speaker 11. The speaker 11 may be an existing speaker provided for audio, or a dedicated speaker provided separately for ultrasonic communication. The target in-vehicle devices (51 to 54) that are remotely controlled by this operation signal Ω are, for example, an air conditioner 51 (hereinafter referred to as "air conditioner 51"), lighting 52, seats 53, or IVI (In-Vehicle Infotainment) 54. Note that the target in-vehicle devices are not limited to the above examples, and may be any electronically controllable in-vehicle accessory, such as a door opening / closing lever lock mechanism, an in-vehicle camera, a conventional navigation system, or an audio device.

[0017] IVI54 is a system that provides a combination of functions such as navigation, location information service, multimedia playback for music and video, voice communication, data communication, and Internet connection. The IVI 54 will be described in detail later in the description of the vehicle 100.

[0018] The target in-vehicle devices (51 to 54) are connected to an in-vehicle communication network 90 such as a CAN (Controller Area Network) or a LIN (Local Interconnect Network). For example, an ultrasonic receiver 79 is provided in the IVI 54, and the ultrasonic receiver 79 receives the ultrasonic signal Ω emitted by the operation device 10. Then, the IVI 54 acts as a repeater and transmits an operation instruction to the target in-vehicle devices (51 to 54) via the communication network 90. Each of the target in-vehicle devices (51 to 54) may have its own ultrasonic receiver 79 and may be remotely controlled by the operation device 10A to directly perform its functions. In response to the remote control, for example, in the case of the multimedia playback function of the IVI 54, functions such as start, stop, volume increase / decrease, media playback, fast forward, or fast rewind are executed.

[0019] In the following, the IVI 54 will be used as a representative example of the target in-vehicle device, and an example will be described in which a microphone 72 capable of detecting ultrasonic waves is provided on a display unit 71 of the IVI 54. The display unit 71 of the IVI 54 is usually provided on an inner panel 81 between the driver's seat 53a and the passenger seat 53b, that is, between the speedometer 56 and the dashboard 57, as shown in Figures 3 and 4. 1, ultrasonic communication commands may be acquired from a server 400 connected via the Internet 300. Alternatively, basic commands may be stored in the memory units 14, 73 of the devices (10, 70), and additional commands may be acquired from the server 400.

[0020] Returning to the explanation of the transmitter / receiver 17. The transmitter / receiver 17 also transmits a notification request signal Σ to the originating device 70 when the mobile terminal 10a is changed to an operable state. The notification request signal Σ is a signal that requests the mobile terminal 10a to transmit an environment notification signal ε that is a signal containing information related to noise (hereinafter referred to as "noise-related information").

[0021] The operable state is defined in advance and stored in the storage unit 14 as a state in which the target in-vehicle device (51 to 54) can be remotely operated from the mobile terminal 10a. For example, the operable state is defined as a state in which the operation restriction of the mobile terminal 10a is lifted, the display unit 13 is ON, a remote control application is running, or the mobile terminal 10a is facing a predetermined direction.

[0022] For example, even when a remote control app is running in the background, the mobile terminal 10a may be placed in a pocket or a bag. If the mobile terminal 10a receives the environmental notification signal ε at a time when the user 200 does not need the mobile terminal 10a, the battery power of the mobile terminal 10a will be wasted. Therefore, by transmitting the environmental notification signal ε when the mobile terminal 10a transitions to an operable state and checking the communication quality, the battery consumption of the mobile terminal 10a can be reduced. For example, the timing of transmitting the environmental notification signal ε may be specified even during the operable state, such as by requesting the transmitting device 70 to transmit the environmental notification signal ε every time the operation page 21 of the remote control app transitions from an inactive state to an active state.

[0023] In addition, noise-related information is information regarding disturbances that impede ultrasonic communication, such as the running speed of the vehicle 100, the running acceleration of the vehicle 100, the operating state of the electric motor, the operating state of the engine, the opening degree of the window 84, or the air volume of the air conditioner 51.

[0024] For example, as shown in FIG. 3, inside the vehicle 100, an air outlet 51a for the front seat air conditioner is provided around the inner panel 81, and an air outlet 51b for the rear seat air conditioner is provided in the center of the roof. The conditioned air σ blown from these air conditioners (51a, 51b) flows between the IVI 54 and the mobile terminal 10a held by the user 200 seated in the rear seat 53c. A temperature boundary surface is formed at the boundary between the air conditioning wind σ and the surrounding air due to the temperature difference. When the control signal Ω enters this temperature boundary surface, it is reflected and refracted at the temperature boundary surface and is caught in the convection created by the air conditioning wind σ, causing it to become disturbed. Therefore, the air conditioning wind σ is thought to have a significant impact on ultrasonic communication.

[0025] Furthermore, when the air conditioner 51 is operated, there are generated operating sounds of the air conditioner 51, such as the sound of the conditioned air σ coming into contact with the fins of the air outlets 51a and 51b as it exits the air outlet 51a, and the sound of the motor. These operating sounds may contain ultrasonic waves that cause disturbances in the band used by the operation signal Ω, and therefore, such operating sounds of in-vehicle devices are also included in the noise-related information.

[0026] Ultrasonic waves can also be generated by the flow of air in and out when the window 84 is open, the sound of the window 84 opening and closing, switching noise generated from the drive source or battery of the vehicle 100, etc. These noises can also interfere with ultrasonic communication, and therefore such noises are also included in the noise-related information. The transmitter / receiver 17 transmits a notification request signal Σ to the transmitting device 70 to transmit the environment notification signal ε carrying such noise-related information.

[0027] The information acquisition unit 18 receives the environment notification signal ε from the transmitting device 70 and acquires noise-related information detected by the transmitting device 70 . Furthermore, it is desirable that the information acquisition unit 18 itself acquires noise sounds around the mobile terminal 10a via the microphone 12 as noise-related information. Even if the microphone 12 cannot detect ultrasonic waves, the information acquisition unit 18 can learn to estimate ultrasonic waves from operating sounds using machine learning or other methods, making it possible to estimate ultrasonic components with high accuracy using the existing microphone 12.

[0028] The control unit 19 calculates the degree of ease of transmission of the operation signal Ω from the acquired noise-related information. For example, if the blowing noise is loud, it can be estimated that the air circulation inside the vehicle is strong and the ease of transmission of the operation signal Ω is low. Also, if the ultrasonic waves contained in this blowing noise have a frequency far removed from the frequency of the operation signal Ω, the influence on the ease of transmission is small.

[0029] The display unit 13 is, for example, a touch panel that combines an input device for inputting data in response to operations by the user 200 and a display device such as a liquid crystal display device for displaying data. On the display unit 13, as shown in FIGS. 2A and 2B, for example, operation pages 21 for "IVI," "air conditioner," "lighting," and "seats" are displayed switchably using tabs 22.

[0030] For example, Fig. 2(A) displays an operation page 21 for operating the air conditioner 51, and Fig. 2(B) displays an operation page 21 for operating the IVI 54. On the operation page 21 for the air conditioner 51 in Fig. 2(A), the air conditioner 51 is remotely adjusted using eight buttons (23a to 23h), including a circulation switch button 23a, an AUTO button 23b, an air volume button 23c, and a compressor drive button 23d.

[0031] Furthermore, when the "IVI" tab 22 is touched, the page switches to the operation page 21 of the IVI 54 shown in FIG. 2(B), and the IVI 54 is remotely controlled using various buttons (24a to 24g) such as channel buttons 24a and 24b. Although not shown, the brightness and ON / OFF of the lighting 52 are remotely controlled. The reclining angle and forward / backward position of the seat 53 are remotely controlled.

[0032] Additionally, a status bar 27 at the top of the display screen 26 displays various icons 31 indicating the battery level of the mobile terminal 10a and the strength of the radio wave for wireless communication. In the mobile terminal 10a according to the first embodiment, the display unit 13 displays the calculated degree of ease of communication as the communication quality level of the operation signal Ω, for example, in the status bar 27. The communication quality level is expressed in four stages by the number of arcs 28, for example, 0 to 3, as shown in FIGS. 2(A) and 2(B).

[0033] When the communication environment for the operation signal Ω is good and the ease of transmission is high, three arcs 28 are displayed as icon 31 as shown in Figure 2(A), and when the ease of transmission drops by one level, two arcs 28 are displayed as shown in Figure 2(B).

[0034] The display format of the communication quality level is not limited to the fan-shaped icon 31 formed by arranging the arcs 28 concentrically as shown in FIGS. 2(A) and 2(B), but may be represented by the number of antenna bars or a number, for example. Furthermore, the location where the communication quality level is displayed is not particularly limited to the status bar 27, and may be anywhere on the display unit 13 (display screen 26) as long as the user 200 can see it. Furthermore, depending on the degree of communication ease, a message such as "Point the mobile terminal at the in-vehicle receiving unit" or "Bring the mobile terminal closer to the in-vehicle receiving unit" may be displayed to the user 200, and the user may be notified of a specific action to be taken to improve the degree of communication ease. Furthermore, the notification may be made by voice instead of displaying the message on the display screen 26, and the manner of notification is not particularly limited. By notifying the user of a specific action in this manner, the user not only knows that the communication quality level is low, but also takes specific action to improve the communication quality level.

[0035] By having such a communication environment checking function in the mobile terminal 10a, the user 200 can check the communication quality level on the operation device 10 before starting remote operation or during operation, and know whether ultrasonic communication is available or not.

[0036] <Vehicle 100> Next, a transmitting device 70 that cooperates with the operation device 10 and a vehicle 100 that has the transmitting device 70 mounted thereon will be described with reference to FIGS. The vehicle 100 is equipped with a vehicle control unit 91 (ECU: Electronic Control Unit), various sensors (92 to 96), an IVI 54, and target in-vehicle devices (51 to 54). These devices (91 to 96) are interconnected via a communication network 90 to send and receive information.

[0037] The ECU 91 is an on-board computer provided in multiple locations within the vehicle 100, and has, for example, an engine control function, a steering control function, a brake control function, and a data security function. For example, the brake control ECU 91 receives information on the operation of the accelerator pedal and the brake pedal and the traveling speed via a pedal stroke sensor 93 and a vehicle speed sensor 92, and converts this information into control signals to apply driving force or braking force to the front wheels or the rear wheels.

[0038] The IVI 54 includes an in-vehicle microphone 72 , an in-vehicle storage unit 73 , an in-vehicle speaker 74 , and an in-vehicle processing circuit 75 . In describing the IVI 54, the name of each part of the IVI 54 will be prefixed with "vehicle-mounted" to distinguish it from the speaker 11, microphone 12, display unit 13, memory unit 14, and processing circuit 15 in the mobile terminal 10a. In addition, the display unit 71 of the aforementioned IVI 54 is a touch panel that combines, for example, an input device for inputting data in response to operations by the user 200, and a display device such as a liquid crystal display device for displaying data.

[0039] The in-vehicle storage unit 73 is configured with, for example, a ROM, a RAM, or a HDD. The in-vehicle processing circuit 75 executes instructions in accordance with the programs stored in the in-vehicle storage unit 73, and the IVI 54 performs various functions such as the navigation function and the location information service function described above.

[0040] As described above, a plurality of air outlets 51a, 51b of air conditioner 51 are provided in vehicle 100 in accordance with the targets to which the conditioned airflow σ is to be sent. The air outlet 51a provided for the front seats 53a and 53b is located near the display unit 71 of the IVI 54, but is distant from the rear seat 53c. Therefore, even if the conditioned air σ is blown out from the air outlet 51a, the air is not sufficiently sensed by the mobile terminal 10a of the user 200 seated in the rear seat 53c. However, even if the air is not sensed by the mobile terminal 10a, the conditioned air σ forms a thermal boundary layer near the IVI 54, which becomes a factor that inhibits ultrasonic communication. Furthermore, since the mobile terminal 10a is not connected to the communication network 90, the mobile terminal 10a cannot directly acquire the vehicle parameters obtained from the communication network 90.

[0041] Therefore, the IVI 54 is equipped with a transmission function, and noise-related information in the vehicle, particularly around the IVI 54, that reduces the communication quality of the operation signal Ω is collected and notified to the mobile terminal 10a as an environment notification signal ε. Specifically, the IVI 54 ( 70 ) further includes the functions of a detection unit 76 , a location information acquisition unit 77 , an in-vehicle control unit 78 , and a transmission unit 79 .

[0042] The detection unit 76 detects noise-related information from the ECU 91 and various sensors (92 to 96) at various locations connected to the IVI 54 via the communication network 90. ​​The noise-related information received by the detection unit 76 includes vehicle parameters.

[0043] The vehicle parameters are, for example, the running speed of the vehicle 100, the running acceleration of the vehicle 100, the driving state of the electric motor, the driving state of the engine, the opening degree of the window 84, or the airflow rate of the air conditioner. The vehicle parameters may also be other physical quantities related to the vehicle 100 that are derived by combining the running speed and the like. The speed or acceleration detected by the detection unit 76 is detected via a vehicle speed sensor 92. Note that the speed or acceleration may be acquired by the position information acquisition unit 77 via a GPS (Global Positioning System) sensor 96, which is a satellite positioning system.

[0044] The detection unit 76 also detects the opening degree of the window 84 via the window sensor 94. This is because when the window 84 is fully open, a large amount of air flows into the vehicle, and therefore it is considered that the disturbance that affects the operation signal Ω will also be large. Furthermore, like the mobile terminal 10a, the transmitting device 70 may directly detect the actually occurring noise via the in-vehicle microphone 72 and include it in the vehicle parameters. Even if the on-board microphone 72 cannot detect ultrasonic waves, the detection unit 76 or the on-board control unit 78 described below can learn to estimate ultrasonic waves from operating sounds using machine learning or the like, so that the existing microphone 72 can estimate ultrasonic components with high accuracy.

[0045] The in-vehicle control unit 78 is provided in the vehicle 100 and converts noise-related information within the vehicle 100 into an environment notification signal ε. At this time, the in-vehicle control unit 78 causes the transmitting unit 79 to transmit the environment notification signal ε when the vehicle parameters undergo a predetermined change.

[0046] For example, the in-vehicle storage unit 73 stores a plurality of speed zones divided by a plurality of thresholds for the traveling speed of the vehicle 100, such as a first speed zone of 0 to 30 km / h, a second speed zone of 30 to 60 km / h, a third speed zone of 60 to 100 km / h, and a fourth speed zone for speeds greater than 100 km / h. The in-vehicle control unit 78 transmits an environment notification signal ε to the remote operation device 10 every time the traveling speed zone changes.

[0047] As the traveling speed of the vehicle 100 increases, noise generated from the drive source and tires increases, and noise in the frequency band of ultrasonic communication also increases. Furthermore, for example, when the vehicle 100 is coasting, accelerating rapidly, or running on electric power, the frequency and intensity of the ultrasonic waves generated vary. Therefore, in order to recalculate the transmission ease at the timing when the ultrasonic noise fluctuates, the on-board control unit 78 transmits the latest environment notification signal ε.

[0048] The rules for generating a trigger for sending the environmental notification signal ε may also be set for other vehicle parameters as appropriate. In addition to changes in the intervals defined on the number line, changes in the operation of vehicle parameters such as "the air outlet has been changed," "the driving mode has been changed," and "the audio has been started" can also trigger the transmission of the environmental notification signal ε.

[0049] The communication format of the noise-related information around the IVI 70 sent to the mobile terminal 10a may be ultrasonic communication, wireless communication, or infrared communication. Furthermore, the transmitting device 70 does not have to be built into the IVI 54 . The transmitter 70 may be installed externally on a surface 97a of the IVI 54, or in an area 97b surrounding the rearview mirror 85, or on a steering wheel 97c, as shown in FIG.

[0050] In addition, the functional units (17-20, 76-79) of the processing circuits 15, 75 of the operation device 10 and the target in-vehicle devices (51-54) can also be realized by hardware such as an ASIC (Application Specific Integration Circuit) or an FPGA (Field-Programmable Gate Array) instead of software processing. Furthermore, these functional units can also be realized by combining software processing and hardware processing.

[0051] Next, the operation procedure of the operating device 10 and the transmitting device 70 according to the first embodiment will be described with reference to the flowchart of FIG. 5 (see FIGS. 1 to 4 as appropriate).

[0052] First, in order to remotely control the target in-vehicle devices (51 to 54), the user 200 starts up a remote control application on the mobile terminal 10a (S11). When the remote control application is started, an operation page 21 for each target in-vehicle device (51 to 54) as shown in FIGS. 2(A) and 2(B) is displayed on the display screen 26 of the mobile terminal 10a. The transmitter / receiver 17 of the mobile terminal 10a notifies the transmitting device 70 that the remote control application has been started by using a notification request signal Σ.

[0053] Note that the flowchart in Figure 5 shows an example in which an environment notification request is made only when the remote control app is launched, but the environment notification request is also executed when the state changes to another operable state as described above.

[0054] Next, upon receiving the notification request signal Σ, the detector 76 of the transmitting device 70 detects noise-related information (S12). Vehicle parameters are acquired via the communication network 90, and noise sounds inside the vehicle are also acquired by the detector 76 as noise-related information. The in-vehicle control unit 78 converts the noise-related information inside the vehicle 100 into an environment notification signal ε. The in-vehicle transmitting unit 79 transmits the environment notification signal ε from the speaker 74 to the mobile terminal 10a. Even after the environmental notification signal ε is transmitted, the vehicle parameters continue to be detected and monitored.

[0055] The information acquisition unit 18 of the mobile terminal 10a receives the environment notification signal ε transmitted by the transmitting device 70 and acquires the noise-related information held by the transmitting device 70. It is preferable that the information acquisition unit 18 itself also acquires noise sounds around the mobile terminal 10a as noise-related information.

[0056] Next, the control unit 19 calculates the degree of transmissibility based on the noise-related information (S13). There may be cases where the communication environment is poor and the transmitting device 70 is unable to detect the launch of the remote control app itself, or is unable to detect the operation signal Ω transmitted from the transmitting device 70 to the mobile terminal 10a. In either case, the operation signal Ω from the transmitting device 70 does not reach the mobile terminal 10a even after the remote control app is launched. If the mobile terminal 10a does not receive the operation signal Ω from the transmitting device 70 within a predetermined time, the mobile terminal 10a determines that the communication environment is poor and calculates the ease of communication.

[0057] Then, the control unit 19 displays the communication quality level using an icon 29 on the status bar 27 of the display unit 13 (S14). The on-board controller 78 continues to monitor the vehicle parameters included in the noise-related information until a predetermined change defined in advance occurs in the vehicle parameters (NO in S15).

[0058] Then, when a predetermined change occurs in the vehicle parameters (YES in S15), this triggers the on-board control unit 78 to convert the noise-related information into an environment notification signal ε and transmit it to the mobile terminal 10a. This is because if there is a change in the vehicle parameters, there is a high possibility that the degree of transmission ease will also change. Then, on-board control unit 78 continues to monitor the vehicle parameters (YES in S15).

[0059] The environment notification signal ε transmitted from the transmitting device 70 is received by the information acquiring unit 18 of the mobile terminal 10a. The information acquisition unit 18 itself also acquires the noise again via the microphone 12 around the mobile terminal 10a. Then, the control unit 19 of the mobile terminal 10a recalculates the degree of transmissibility using the noise-related information acquired by the information acquisition unit 18 (S16). Then, based on the recalculated communication ease, the control unit 19 updates the communication quality level displayed on the status bar 27 of the display unit 13 (S17; END).

[0060] When the degree of transmission ease is low, it is desirable that the transmitter / receiver 17 take measures to transmit the operation signal Ω multiple times. As another measure, the operation signal Ω can be transmitted accurately to the IVI 54 by transmitting the operation signal Ω for a longer period of time or by increasing the output amount of the operation signal Ω. Similarly, when the degree of communication ease is low, the user 200 may be requested to "point the mobile terminal toward the vehicle receiving unit" or "move the mobile terminal closer to the vehicle receiving unit," as described above.

[0061] As described above, according to the operation device 10 of the first embodiment, when a change occurs in the in-vehicle environment that affects the communication quality of the operation signal Ω, the transmission ease is recalculated, so that the user 200 can check the communication quality level that corresponds to the change in the in-vehicle environment at any time. Furthermore, by transmitting the environment notification signal ε at the timing when the mobile terminal 10a transitions to an operable state, it is possible to reduce battery consumption of the mobile terminal 10a. Furthermore, by limiting the timing of transmitting the environment notification signal ε in this way, the ultrasonic band can be effectively utilized.

[0062] (Second embodiment) FIG. 6 is a flowchart showing the operation procedure of the operating device 10 according to the second embodiment.

[0063] The operation device 10 according to the second embodiment estimates vehicle parameters based on noise-related information collected from the microphone 12, and monitors changes in the estimated vehicle parameters, that is, the in-vehicle environment. Then, the operation device 10 updates the display of the communication quality level using the estimated vehicle parameters at the timing when the communication environment changes, similar to the first embodiment.

[0064] In the first embodiment, the transmitting device 70 directly acquires the vehicle parameters from the communication network 90 and monitors the changes in the vehicle parameters. On the other hand, in the second embodiment, the operation device 10 measures the timing based on the noise-related information collected by itself and updates the display of the communication quality level. As with the in-vehicle storage unit 73 of the first embodiment, the storage unit 14 of the operation device 10 stores data that specifies the timing for recalculating the transmission ease for the estimated vehicle parameters.

[0065] A specific operation procedure of the operating device 10 will be described with reference to the flowchart of FIG. 6 (see also FIGS. 1 to 4 as appropriate).

[0066] First, in order to remotely control the target in-vehicle devices (51 to 54), the user 200 starts up a remote control application on the mobile terminal 10a (S21). When the remote control application is started, an operation page 21 as shown in FIGS. 2(A) and 2(B) is displayed on the display screen 26 of the mobile terminal 10a, similar to the first embodiment.

[0067] Next, the information acquisition unit 18 detects noise-related information when the mobile terminal 10a changes to an operable state (S22). At this time, the information acquisition unit 18 detects noise-related information such as the airflow noise inside the vehicle 100 and the operating noise of the devices inside the vehicle via the microphone 12 itself, without going through the transmitting device 70 . Furthermore, the information acquisition unit 18 may determine the traveling speed of the mobile terminal 10a using a GPS function installed in the mobile terminal 10a, and determine the traveling mode of the vehicle 100.

[0068] Then, from this noise-related information, the vehicle interior environment is estimated through estimation of vehicle parameters (S23). In the second embodiment, vehicle parameters such as the opening degree of the window 84 are estimated from the characteristic mechanical sounds and directions of the in-vehicle equipment. Note that the opening degree information of the window 84 and the operating state of the air conditioner 51 may be estimated by combining the traveling direction of the vehicle 100 and the direction of the noise sound, which are acquired using the GPS function.

[0069] Since both the outside air flowing into the vehicle interior and the air conditioning airflow σ from the air conditioner 51 have characteristic intensities and frequencies, the characteristics can be learned using machine learning to distinguish and identify the opening degree of the window 84 or the operating state of the air conditioner 51. In particular, by having the information acquisition unit 18 learn in advance the interference frequency range specific to the vehicle 100, even seemingly unrelated noise sounds inside the vehicle can be used to estimate vehicle parameters.

[0070] Then, similarly to the first embodiment, the control unit 19 calculates the degree of communication ease and displays the communication quality level on the display unit 13 from the degree of communication ease (S24, S25). The control unit 19 continues to monitor the vehicle parameters included in the noise-related information until a predefined change occurs in the vehicle parameters (NO in S26).

[0071] Then, if there is a predetermined change in the vehicle parameters (YES in S26), this triggers the recalculation of the transmission ease based on the latest noise-related information and the communication quality level is updated, as in the first embodiment (S28, S29; END).

[0072] The second embodiment is structurally and operationally similar to the first embodiment, except that the display of the communication quality level is updated based on changes in the vehicle parameters acquired and estimated by the mobile terminal 10a, so redundant explanations will be omitted.

[0073] In this way, according to the operating device 10 and the transmitting device 70 according to the second embodiment, it is possible to obtain the same effects as in the first embodiment, even if the transmitting device 70 does not cooperate with each other.

[0074] According to at least one of the above-described embodiments of the remote control device, communication environment transmission device, and communication environment confirmation program, an environmental notification signal is transmitted when a predetermined change occurs in a vehicle parameter, thereby making it possible to maintain a communication quality display that accurately reflects changes in the communication environment of ultrasonic communication.

[0075] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, modifications, and combinations can be made without departing from the spirit of the invention. These embodiments and their variations are intended to be included in the scope of the invention and its equivalents as described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0076] 10... remote control device (operation device), 10a (10)... mobile terminal (smartphone), 10b (10)... in-vehicle operation terminal, 11... speaker, 12... microphone, 13... display unit, 14... memory unit, 15... processing circuit, 17... transmission / reception unit, 18... information acquisition unit, 19... control unit, 20... input / output unit, 21... operation page, 22... tab, 23a... circulation switch button, 23b... AUTO button, 23c... air volume button, 24a... channel channel button, 24b...channel button, 26...display screen, 27...status bar, 28...arc, 29...icon, 31...icon, 51(51a, 51b)...air conditioner (air conditioner), 51a...air outlet for front seats, 51b...air outlet for rear seats, 52...lighting, 53...seat, 53a...driver's seat (front seat), 53b...passenger seat (front seat), 53c...rear seat, 56...speed Meter, 57... dashboard, 70... transmitter, 71... display unit, 71a to 71b... installation position of in-vehicle microphone, 72... in-vehicle microphone (microphone), 73... in-vehicle memory unit (memory unit), 74... in-vehicle speaker (speaker), 75... in-vehicle processing circuit (processing circuit), 76... detection unit, 77... position information acquisition unit, 78... in-vehicle control unit, 79... in-vehicle transmitter (transmitter), 80... ultrasonic receiver, 81... inner panel, 84... window, 8 5...Rearview mirror, 90...Communication network, 91...Vehicle control unit (ECU), 92...Vehicle speed sensor, 93...Pedal stroke sensor, 94...Window sensor, 95...Steering angle sensor, 96...GPS sensor, 97b...Surrounding area, 100...Vehicle, 200...User, 300...Internet, 400...Server, Σ...Notification request signal, Ω...Operation signal (ultrasonic signal), ε...Environmental notification signal, π...Test signal, σ...Air conditioning wind.

Claims

1. a detection unit provided in a vehicle to acquire information about noise that interferes with ultrasonic communication within the vehicle; an in-vehicle control unit provided in the vehicle and configured to convert the information regarding the noise into an environmental notification signal; a transmitter that transmits the environment notification signal to a remote control device disposed in the vehicle; an ultrasonic receiving unit that receives an ultrasonic signal for controlling an operation of an in-vehicle device from the remote control device, The communication environment transmitting device is characterized in that the on-board control unit causes the transmitting unit to transmit the environmental notification signal when a vehicle parameter of the vehicle that may generate the noise undergoes a change that may interfere with the ultrasonic communication.

2. The traveling speed of the vehicle is divided into a plurality of speed zones; The communication environment transmitting device according to claim 1 , wherein the in-vehicle control unit transmits the environment notification signal to the remote control device every time the traveling speed crosses the speed zone.

3. The communication environment transmission device according to claim 1 or claim 2, wherein the vehicle control unit transmits the environmental notification signal to the remote control device when the operating state of the air conditioning equipment installed in the vehicle changes in a way that may interfere with the ultrasonic communication.

4. The remote control device is a second speaker capable of emitting the ultrasonic signal for controlling the operation of the in-vehicle device; an information acquisition unit that receives the environmental notification signal and acquires the information related to the noise; a control unit that calculates the transmission ease of the ultrasonic signal from the information related to the noise acquired by the information acquisition unit; a second display unit that displays the calculated degree of transmission ease as a communication quality level of the ultrasonic signal; a second storage unit that stores a rule regarding an operable state; The communication environment transmission device according to claim 1 , wherein the control unit calculates the degree of communicability when the state changes to the operable state.

5. The remote control device is a second speaker capable of emitting the ultrasonic signal for controlling the operation of the in-vehicle device; The second microphone, an information acquisition unit that acquires the information regarding the noise that disturbs the ultrasonic communication inside the vehicle via the second microphone; a control unit that estimates the vehicle parameters of the vehicle that may cause the noise based on the information about the noise acquired by the information acquisition unit, and calculates the ease of transmission of the ultrasonic signal from the information about the noise acquired by the information acquisition unit when the vehicle parameters change in a way that may impede the ultrasonic signal; a second display unit that displays the calculated degree of transmission ease as a communication quality level of the ultrasonic signal; a second storage unit that stores a rule regarding an operable state; The communication environment transmission device according to claim 1 , wherein the control unit calculates the degree of communicability when the state changes to the operable state.

6. The communication environment transmission device according to claim 4 or 5, wherein the operable state is one of a state in which the operation restriction of the remote control device is lifted, a state in which the second display unit is ON, a state in which an application capable of operating the in-vehicle equipment is launched, and a state in which the remote control device is facing in a predetermined direction.

7. A communication environment transmitting program that causes a computer to operate as a communication environment transmitting device that is provided in a vehicle and receives ultrasonic signals that control operation of in-vehicle equipment from a remote control device arranged in the vehicle, the program comprising: a step of acquiring information about noise that interferes with ultrasonic communication in the vehicle by the computer; converting the information about the noise sound into an environmental notification signal; a step of transmitting the environmental notification signal to a remote control device located in the vehicle when a vehicle parameter of the vehicle that may generate the noise undergoes a change that may interfere with the ultrasonic communication.

Images