In-vehicle device and in-vehicle light emission control method

Abstract

To perform state notification of functional operation very well in an on-vehicle device.SOLUTION: An on-vehicle device comprises an audio knob (41) which is served to adjustment of output sound volume of an audio device which is installed on a vehicle, a light emission part (60) which is provided by being corresponded to the audio knob and a main control part which controls execution of audio functional operation which plays output acoustic signal of a tuner part of the audio device and other functional operation different from the audio functional operation. The main control part makes the light emission part emit light according to first control when the audio functional operation is executed and makes the light emission part emit light according to second control different from the first control when other functional operation is executed.SELECTED DRAWING: Figure 12

Description

[Technical field]

[0001] The present invention relates to an in-vehicle device and an in-vehicle light emission control method. [Background technology]

[0002] 2. Description of the Related Art One type of in-car device with an audio function is provided with an audio knob for adjusting the output volume.

[0003] On the other hand, there are also in-vehicle devices that can execute functional operations for hands-free calling or for voice recognition. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-7873 A Summary of the Invention [Problem to be solved by the invention]

[0005] The current state of a hands-free call (incoming call, answering call, holding, outgoing call state, etc.) is often notified to the user by displaying an image or the like. However, when the hands-free call state is displayed as an image, the display of other necessary images (for example, display of a navigation image) is prevented. In consideration of this, a control is being considered in which, by inputting a predetermined operation when the hands-free call state is displayed as an image, the state transitions (returns) to a state in which other necessary images (for example, a navigation image) are displayed (see FIG. 16).

[0006] However, if this control causes a transition (return) to a state in which other necessary images (for example, a navigation image) are displayed, the current state of the hands-free call becomes difficult or unclear for the user. If a dedicated indicator showing the current state of the hands-free call were provided, the current state of the hands-free call would be clearly communicated to the user, but the installation of a dedicated indicator would increase costs, etc., making it difficult to adopt. Although particular attention has been given to hands-free calls, the same situation also applies to voice recognition, etc.

[0007] An object of the present invention is to provide an in-vehicle device and an in-vehicle light emission control method that can provide good notification of the state of functional operations. [Means for solving the problem]

[0008] The in-vehicle device of the present invention comprises an audio knob used to adjust the output volume of an audio device installed in a vehicle, a light-emitting unit that illuminates the audio knob by emitting light, and a main control unit that controls the execution of an audio function operation that reproduces an output acoustic signal from a tuner unit of the audio device, and another functional operation different from the audio functional operation, wherein the main control unit causes the light-emitting unit to emit light in accordance with a first control when the audio functional operation is executed, and causes the light-emitting unit to emit light in accordance with a second control different from the first control when the other functional operation is executed. Effect of the Invention

[0009] According to the present invention, it is possible to provide an in-vehicle device and an in-vehicle light emission control method that can provide good notification of the state of functional operation. [Brief description of the drawings]

[0010] [Figure 1] 1 is an overall configuration diagram of an in-vehicle system according to an embodiment of the present invention; [Diagram 2] 1 is a schematic top view of a vehicle according to an embodiment of the present invention. [Diagram 3] 1 is a diagram showing a state of a vehicle interior of a vehicle according to an embodiment of the present invention; [Figure 4] 1 is a front view of a multimedia device according to an embodiment of the present invention; [Diagram 5] 11A and 11B are diagrams illustrating modified examples of the relationship between an audio knob and a light-emitting portion in a multimedia device according to an embodiment of the present invention. [Figure 6] 2A and 2B are diagrams illustrating navigation images that may be displayed on the display screen of FIG. 1. [Figure 7] 4 is an operational flowchart of a multimedia device according to a first embodiment of the present invention. [Figure 8] FIG. 10 is an explanatory diagram of light emission control related to audio operation in the first example pertaining to an embodiment of the present invention. [Figure 9] 1A to 1C are diagrams showing examples (three examples) of a display image and a light emitting state of a light emitting unit during execution of a hands-free function operation according to a first example belonging to an embodiment of the present invention. [Figure 10] FIG. 2 is an explanatory diagram of state transition during execution of a voice recognition function operation in a first example belonging to an embodiment of the present invention. [Figure 11] 1A to 1C are diagrams showing examples (three examples) of a display image and a light emitting state of a light emitting unit during execution of a voice recognition function operation according to a first example belonging to an embodiment of the present invention. [Figure 12] FIG. 11 is a diagram showing how a display image is changed during execution of a hands-free function operation in a second embodiment of the present invention. [Figure 13] FIG. 11 is a diagram showing how a display image is changed during execution of a voice recognition function operation in a third example belonging to an embodiment of the present invention. [Figure 14] FIG. 13 is a diagram showing how a display image is changed during execution of a hands-free function operation in a fourth embodiment of the present invention. [Figure 15] FIG. 13 is a diagram showing how a display image is changed during execution of a voice recognition function operation in a fifth example belonging to an embodiment of the present invention. [Figure 16] 11A to 11C are diagrams showing changes in the display content on the display screen of an in-vehicle device according to the reference technology; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, examples of the embodiments of the present invention will be described in detail with reference to the drawings. In each of the drawings, the same parts are given the same reference numerals, and duplicated explanations of the same parts are omitted as a rule. In this specification, for the sake of simplicity, a symbol or a code referring to information, a signal, a physical quantity, a member, etc. may be written, and the name of the information, signal, physical quantity, member, etc. corresponding to the symbol or code may be omitted or abbreviated. For example, the multimedia device referred to by "1" (see FIG. 1) described later may be written as multimedia device 1 or abbreviated as device 1, but they all refer to the same thing.

[0012] Fig. 1 shows the overall configuration of an in-vehicle system SYS according to an embodiment of the present invention. The in-vehicle system SYS comprises a multimedia device 1, a camera unit 2, a GPS processing unit 3, an in-vehicle sensor unit 4 and an in-vehicle network 5. Fig. 1 also shows a terminal device TM and a communication network NET. Fig. 2 is a schematic top view of a vehicle CR equipped with the in-vehicle system SYS. Fig. 3 shows a part of the interior of the vehicle CR. In the interior of the vehicle CR, a steering wheel CC1, a shift lever CC2 and an ignition switch CC3 are provided near the driver's seat as parts operated by the driver, and the multimedia device 1 is also installed.

[0013] The steering wheel CC1 is a ring-shaped part that is rotated by the driver to adjust the traveling direction of the vehicle CR in response to the rotation. The shift lever CC2, based on the driver's operation, sets whether the vehicle CR can proceed and the traveling direction of the vehicle CR, and changes the gear of the vehicle CR. The ignition switch CC3, based on the driver's operation, specifies whether to supply power to each electrical device of the vehicle CR or not, and specifies whether to start or stop the power source (engine, etc.) of the vehicle CR.

[0014] The multimedia device 1, the camera unit 2, the GPS processing unit 3, and the in-vehicle sensor unit 4 are connected to an in-vehicle network 5 formed inside the vehicle CR, and can communicate any information and signals bidirectionally with each other via the in-vehicle network 5, or can communicate any information and signals unidirectionally. A CAN (Controller Area Network) or the like can be used as the in-vehicle network 5. Note that while FIG. 1 shows only the multimedia device 1, the camera unit 2, the GPS processing unit 3, and the in-vehicle sensor unit 4 as components connected to the in-vehicle network 5, various other devices (e.g., a power steering system, a brake system, a radar device, a drive recorder) that are not shown in the figure may also be connected to the in-vehicle network 5.

[0015] The vehicle CR is a vehicle (such as an automobile) that can travel on a road surface. However, the vehicle CR may be any type of vehicle. In the vehicle CR, the direction from the driver's seat toward the steering wheel CC1 is defined as "forward," and the direction from the steering wheel CC1 toward the driver's seat is defined as "rearward." The direction perpendicular to the front-to-rear direction and parallel to the road surface is defined as the left-to-right direction. The left and right in the left-to-right direction are defined as the left and right as seen by the driver of the vehicle CR, who is sitting in the driver's seat of the vehicle CR and facing forward.

[0016] The camera unit 2 is composed of one or more cameras installed in the vehicle CR, and each camera installed in the camera unit 2 is called a unit camera. Each unit camera has an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge-Coupled Device) image sensor and an optical system, and captures an image within its own field of view (in other words, a shooting area) and generates image information indicating an image obtained by shooting (i.e., an image within the field of view). The image information generated by the unit camera is hereinafter referred to as camera image information, and a two-dimensional image represented by the camera image information is referred to as a camera image. Each unit camera periodically and repeatedly captures an image within its own field of view at a predetermined shooting frame rate. The camera image information generated by the unit camera is sent to the multimedia device 1 in sequence.

[0017] The camera unit 2 is provided with a camera 2R as one of the unit cameras (see FIG. 2). The camera 2R is a rear camera having a field of view outside the vehicle CR and in a rear area of ​​the vehicle CR, and is installed in an appropriate position on the body of the vehicle CR. Although not clear from FIG. 2, the depression angle of the camera 2R is appropriately set so that the road surface in a predetermined area outside the vehicle CR and on the rear side of the vehicle CR is included in the field of view of the camera 2R.

[0018] In addition to the camera 2R as a rear camera, the camera unit 2 may be provided with a front camera that is outside the vehicle CR and has a field of view in the front area of ​​the vehicle CR, a right camera that is outside the vehicle CR and has a field of view in the right area of ​​the vehicle CR, and a left camera that is outside the vehicle CR and has a field of view in the left area of ​​the vehicle CR. Each of the front camera, right camera, and left camera is also a type of unit camera.

[0019] The GPS processing unit 3 detects the position (current location) of the vehicle CR by receiving signals from multiple GPS satellites that form the GPS (Global Positioning System), and generates vehicle position information indicating the detected position. The position of the vehicle CR means the location where the vehicle CR is present. In the vehicle position information, the position (current location) of the vehicle CR is expressed by longitude and latitude on the earth. The vehicle position information is generated sequentially at a predetermined cycle, and the generated vehicle position information is sent sequentially to the multimedia device 1.

[0020] The in-vehicle sensor unit 4 is composed of a plurality of in-vehicle sensors installed in the vehicle CR, and generates in-vehicle sensor information using each of the in-vehicle sensors. The in-vehicle sensor information is generated sequentially at a predetermined cycle, and the generated in-vehicle sensor information is sequentially sent to the multimedia device 1. In Fig. 1, a shift lever sensor 4A and a vehicle speed sensor 4B are shown as two sensors included in the plurality of sensors.

[0021] The shift lever sensor 4A is a sensor that detects the position of the shift lever CC2 of the vehicle CR, and is configured using a displacement sensor, etc. The position of the shift lever CC2 is set to one of a number of positions including drive position, reverse position, and parking position based on the driver's operation. When the shift lever CC2 is in the drive position, the vehicle CR moves forward (travels forward) in response to depression of the accelerator pedal of the vehicle CR, and when the shift lever CC2 is in the reverse position, the vehicle CR moves backward (travels backward) in response to depression of the accelerator pedal of the vehicle CR. When the shift lever CC2 is in the parking position, the vehicle CR does not move forward or backward regardless of depression of the accelerator pedal of the vehicle CR. Information indicating the position of the shift lever CC2 detected by the shift lever sensor 4A is referred to as shift information. The shift information is included in the in-vehicle sensor information.

[0022] The vehicle speed sensor 4B detects the traveling speed (movement speed) of the vehicle CR. Information indicating the traveling speed of the vehicle CR detected by the vehicle speed sensor 4B is referred to as vehicle speed information. The vehicle speed information is included in the in-vehicle sensor information. In addition, the in-vehicle sensor information includes accelerator information indicating the depression amount of an accelerator pedal provided on the vehicle CR, brake information indicating the depression amount of a brake pedal provided on the vehicle CR, and steering angle information indicating the steering angle of the steering wheel CC1.

[0023] The following describes the configuration of the multimedia device 1. The multimedia device 1 includes a main control unit 10, a storage unit 20, a display screen 30, an operation unit 40, a microphone 50, a light emitting unit 60, a communication module 70, and an audio device 80. However, the audio device 80 may be a device provided outside the multimedia device 1.

[0024] The main control unit 10 includes a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and the like, and performs overall control of the overall operation within the multimedia device 1.

[0025] The storage unit 20 is composed of a magnetic disk, a semiconductor memory, or a combination thereof, and stores and keeps track of various programs and data. The programs in the storage unit 20 are executed by the CPU of the main control unit 10 to realize various functions.

[0026] The display screen 30 is made up of a liquid crystal display panel or an organic electroluminescence panel or the like, and displays any image under the control of the main control unit 10 .

[0027] The operation unit 40 accepts various operations from the user of the multimedia device 1. The contents of the operations input to the operation unit 40 are transmitted to the main control unit 10. The user of the multimedia device 1 (hereinafter simply referred to as the user) is a passenger of the vehicle CR. A passenger other than the driver of the vehicle CR can also be a user, but in the following, it is assumed that the driver of the vehicle CR is the user. The operation unit 40 is provided with an audio knob 41. A touch panel may be configured on the display screen 30, in which case the touch panel is included as a component of the operation unit 40.

[0028] The microphone 50 picks up sounds around the microphone 50, converts the picked up sounds into audio signals, which are electrical signals, and outputs the converted sounds. The target of the sounds picked up by the microphone 50 is mainly voices uttered by the user. The microphone 50 is installed in a position (for example, a predetermined position on the steering wheel CC1 or a predetermined position near the driver's seat) where it is easy to pick up voices uttered by the user (here, the driver).

[0029] The light-emitting unit 60 emits light under the control of the main control unit 10. More specifically, the light-emitting unit 60 is composed of a light-emitting element that emits light by converting an electric signal supplied from the main control unit 10 into an optical signal. The light-emitting element is, for example, a light-emitting diode. However, the light-emitting element may be any element that emits light. The light-emitting unit 60 may emit light by organic electroluminescence. The light-emitting unit 60 may be formed by combining a liquid crystal and a backlight. The light-emitting unit 60 may function as a light source that illuminates the audio knob 41 by emitting light. In this case, the light-emitting unit 60 may illuminate the audio knob 41 from the outside, or may illuminate the audio knob 41 from the inside so that the audio knob 41 itself appears to be emitting light. The light-emitting unit 60 may be configured to emit light in only one color, but in the following, the light-emitting unit 60 is assumed to be configured to emit light in multiple colors.

[0030] The communication module 70 realizes wireless two-way communication with an external device for the multimedia device 1. The external device includes a terminal device TM. The terminal device TM is a terminal device owned by a user (here, the driver) of the multimedia device 1. The terminal device TM is, for example, a mobile phone (including a smartphone) or a tablet terminal. However, it is assumed that the terminal device TM has a telephone function. The communication module 70 and the terminal device TM are wirelessly connected to each other by a short-range wireless communication line such as Bluetooth (registered trademark). The communication network NET includes a mobile communication network having a mobile communication base station and the Internet. The communication module 70 is wirelessly connected to the communication network NET, and any other device (such as a server device) connected to the Internet is also included in the above-mentioned external device.

[0031] The audio device 80 includes a tuner unit 81, an audio amplifier 82, and a speaker 83. The speaker 83 may be a speaker externally connected to the multimedia device 1 (i.e., a speaker provided outside the multimedia device 1 and connected to the multimedia device 1). The tuner unit 81 outputs an audio signal acquired from a predetermined sound source to the audio amplifier 82. Specifically, for example, the tuner unit 81 acquires an audio signal such as a piece of music from a music recording medium stored in or connected to the audio device 80, or acquires an audio signal such as a radio program from a broadcast wave received from a broadcast station, and outputs the acquired audio signal to the audio amplifier 82. The audio amplifier 82 can execute an audio function operation of amplifying the audio signal output from the tuner unit 81 and supplying the acquired audio signal (an amplified signal of the output audio signal of the tuner unit 81) to the speaker 83. When the audio function operation is executed, the audio signal output from the tuner unit 81 is reproduced using the speaker 83 (output as sound from the speaker 83).

[0032] FIG. 4 shows an example of the appearance of the multimedia device 1 when viewed from the front. In the front view of the multimedia device 1, the device 1 has a roughly rectangular main housing, in which the display screen 30 is fitted at a predetermined position, and the audio knob 41 and the light-emitting unit 60 are installed at a position shifted from the fitting position of the external screen 30. The audio knob 41 (which may be abbreviated as the knob 41 hereinafter) is a knob-shaped operating part used for adjusting and setting the output volume of the audio device 80, and protrudes from the surface of the main housing of the multimedia device 1. A user can adjust and set the output volume of the audio device 80 by pinching and rotating the knob 41 with his / her fingers. The output volume of the audio device 80 (which may be simply referred to as the output volume hereinafter) is an amount proportional to the volume of the sound output from the speaker 83, and the volume of the sound is larger as the output volume is larger. The multimedia device 1 is installed near the driver's seat of the vehicle CR so that the user of the multimedia device 1 can easily view the display screen 30 and can easily operate the touch panel and knob 41 on the display screen 30.

[0033] The light-emitting unit 60 is provided in correspondence with the knob 41. The knob 41 is a cylindrical knob that protrudes from the surface of the main housing of the multimedia device 1 in a direction perpendicular to the surface, and here, the light-emitting unit 60 is formed by one or more light-emitting elements arranged in a position surrounding the cylindrical housing of the knob 41. In FIG. 4, the hatched area corresponds to the light-emitting unit 60. However, the shape of the light-emitting unit 60 is not limited to the example of FIG. 4. For example, the light-emitting unit 60 may be a linear light-emitting unit 60_1 arranged adjacent to the knob 41 as shown in FIG. 5(a), or may be a circular light-emitting unit 60_2 installed on the upper surface of the cylindrical housing of the knob 41 as shown in FIG. 5(b). In addition, the knob 41 and the light-emitting unit 60 may be installed in a housing (not shown) other than the main housing.

[0034] 1 again, the main control unit 10 includes a navigation unit 11, a hands-free support unit 12, a voice recognition support unit 13, and a light emission control unit 14 as functional blocks realized by the CPU of the main control unit 10 executing a program in the storage unit 20.

[0035] The navigation unit 11 executes a predetermined navigation operation based on the vehicle position information. The navigation operation includes a process of displaying a navigation image on the display screen 30. An image 600 in FIG. 6 is an example of a navigation image. The navigation image 600 includes a map image showing the current position of the vehicle CR and a map of the surroundings of the current position of the vehicle CR. In the navigation image 600, an icon indicating the current position of the vehicle CR and a route to a destination specified and set by the user are superimposed on the map image. The navigation operation includes a process of guiding the vehicle CR along the route.

[0036] The hands-free compatible unit 12 (hereinafter referred to as the HF compatible unit 12) executes a hands-free function operation (hereinafter referred to as the HF function operation) that enables a hands-free call. In this embodiment, the hands-free call is a hands-free call made by a user of the multimedia device 1, and the HF compatible unit 12 cooperates with the terminal device TM, the communication module 70, the microphone 50, and the speaker 83 to enable the hands-free call.

[0037] A description will now be given of hands-free calling. For the sake of specificity and clarity of explanation, the user of the multimedia device 1 is referred to as the first person, and a person located outside the vehicle CR and different from the user of the multimedia device 1 is referred to as the second person. A terminal device (such as a mobile phone including a smartphone) used by the second person and different from the terminal device TM is referred to as the second terminal device. Hereinafter, the terminal device TM may be referred to as the first terminal device. In hands-free calling, the first person can talk with the second person by phone using the microphone 50 and a speaker installed in the vehicle CR. The speaker installed in the vehicle CR used for hands-free calling is assumed to be the speaker 83 here. However, the hands-free calling may be realized using another speaker (not shown) installed in the vehicle CR.

[0038] The second terminal device corresponds to the opposite end device for the first terminal device (TM). When a second person uses the second terminal device to call the first terminal device (TM) over a telephone line, an incoming call signal is received by the first terminal device (TM) through the communication network NET. When the first terminal device (TM) receives the incoming call signal, it transmits an incoming call notification signal to the multimedia device 1. The incoming call signal and the incoming call notification signal include identification information associated with the second terminal device (e.g., the telephone number of the second terminal device, etc.).

[0039] When the multimedia device 1 receives an incoming call notification signal from the first terminal device (TM), the HF support unit 12 starts executing the HF function operation. Here, there are a plurality of states including an incoming call state as the state of the HF function operation (states other than the incoming call state will be described later). The incoming call state may be read as a response state. In the incoming call state, a voice signal indicating the contents of the speech of the second person is input from the first terminal device (TM) to the HF support unit 12 through the communication module 70, and the HF support unit 12 outputs the voice signal indicating the contents of the speech of the second person from the speaker 83. In the incoming call state, a voice signal indicating the contents of the speech of the first person (i.e., the contents of the speech of the user of the multimedia device 1) is input from the microphone 50 to the HF support unit 12, and the HF support unit 12 transmits the voice signal indicating the contents of the speech of the first person to the first terminal device (TM) through the communication module 70. The first terminal device (TM) transmits the audio signal (audio signal indicating the contents of the first person's speech) received from the multimedia device 1 to the communication network NET including the base station and the mobile communication network. As a result, the audio signal indicating the contents of the first person's speech is transmitted to the second terminal device, and the audio signal is reproduced in the second terminal device. Although the hands-free call when the second terminal device calls the first terminal device (TM) has been described, it is also possible to make a hands-free call after calling the second terminal device from the first terminal device (TM).

[0040] The voice recognition support unit 13 (hereinafter referred to as the VR support unit 13) executes a voice recognition function operation (hereinafter referred to as the VR function operation). The VR function operation includes a voice recognition process for recognizing the contents of a user's speech, and a response process for responding to the contents of the user's speech using the recognition result of the voice recognition process. A voice signal representing the contents of a user's speech collected by the microphone 50 is particularly referred to as a user speech voice signal. During the user's speech period, the user speech voice signal is output from the microphone 50. In the voice recognition process, the contents of the user's speech are converted into text data based on the user speech voice signal, and the contents of the user's speech are recognized and understood. In the response process, an appropriate response corresponding to the contents of the user's speech is made based on the result of the voice recognition process. The VR function operation can be realized by software-based artificial intelligence.

[0041] The light emission control unit 14 controls the light emission of the light emission unit 60. The control of light emission includes control of whether the light emission unit 60 emits light or not, as well as control of the light emission mode of the light emission unit 60. The content of the light emission control of the light emission unit 60 depends on whether the HF function operation or the VR function operation is currently being executed (details will be described later).

[0042] Below, several specific operation examples, application techniques, modified techniques, etc., related to the in-vehicle system SYS will be described in multiple embodiments. The matters described above in this embodiment are applied to each of the following embodiments unless otherwise specified and unless there is a contradiction. If there are any matters in each embodiment that contradict the matters described above, the description in each embodiment may take precedence. Furthermore, unless there is a contradiction, the matters described in any of the multiple embodiments shown below can also be applied to any other embodiment (i.e., any two or more of the multiple embodiments can also be combined).

[0043] <<First Example>> A first embodiment will be described below with reference to Fig. 7. The flow of operations of the multimedia device 1 will be described with focus on the light emission control of the light emitting unit 60, the HF function operation, and the VR function operation.

[0044] Consider starting from step S11. In step S11, the multimedia device 10 is in an initial state. In the initial state, neither the HF function operation nor the VR function operation is executed. Also, it is assumed that the terminal device TM and the multimedia device 1 are set so that the HF function operation is executed when the terminal device TM receives an incoming call signal (however, this does not include the case where incoming call rejection is set).

[0045] In step S12 following step S11, the navigation operation is started. After the navigation operation is started in step S12, it may be understood that the navigation image 600 as shown in FIG. 6 continues to be displayed on the display screen 30 unless otherwise specified.

[0046] After step S12, the process proceeds to step S13. In step S13, the main control unit 10 (specifically, the HF support unit 12) judges whether or not an incoming call notification signal has been received from the terminal device TM. If an incoming call notification signal has been received (Y in step S13), the process proceeds to step S31. If an incoming call notification signal has not been received (N in step S13), the process proceeds to step S14. In step S14, the main control unit 10 (specifically, the VR support unit 13) judges whether or not a predetermined voice recognition activation condition has been established. If the voice recognition activation condition has been established (Y in step S14), the process proceeds to step S51. If the voice recognition activation condition has not been established (N in step S14), the process proceeds to step S15. The voice recognition activation condition is established, for example, when the user utters a predetermined wake-up keyword, and a user-uttered voice signal indicating the wake-up keyword is input from the microphone 50 to the VR support unit 13. Alternatively, for example, the voice recognition activation condition may be established when a predetermined wake-up operation is input to the operation unit 40.

[0047] When the process proceeds to step S15, both the HF function operation and the VR function operation are in a non-executing state. Also, it is assumed that a predetermined operation for instructing the execution of the above-mentioned audio function operation has been input to the operation unit 40 in step S11 or step S15. Then, in step S15, the main control unit 10 controls the audio device 80 so that the audio function operation is executed, and as a result, the audio signal output from the tuner unit 81 is output as sound from the speaker 83.

[0048] The light emission control unit 14 executes the light emission control CNT1 in step S15. The light emission control CNT1 controls the light emission mode of the light emission unit 60. For example, the light emission control CNT1 controls the volume setting value VOL AD The light emitting section 60 emits light in a light emitting manner according to the volume setting value VOL AD represents the set value of the output volume of the audio device 80 in the audio function operation. Therefore, in the audio function operation, the output volume of the audio device 80 is set to the volume set value VOL ADWhen an audio function operation is being performed, the user operates the knob 41 to set the volume according to the volume setting value VOL AD The volume setting value VOL AD is adjusted in several stages.

[0049] An example of the light emission control CNT1 is shown in Fig. 8. In the example of Fig. 8, only the hatched area of ​​the entire area of ​​the light emitting unit 60 indicates the part that emits light. In the example of Fig. 8, the light emitting unit 60 is configured to be able to change its own light emitting area in multiple stages, and the light emission control unit 14 controls the volume setting value VOL AD The light emission control CNT1 increases the light emitting area of ​​the light emitting unit 60 as the volume setting value VOL AD It is also acceptable to control the light-emitting unit 60 to emit light constantly regardless of the lighting condition. If the audio function operation is stopped when the process reaches step S15, the light-emitting control unit 14 may completely turn off the light-emitting unit 60. After step S15, the process returns to step S13.

[0050] In step S31, the HF support unit 12 judges whether or not the incoming call rejection is set. The user can set or not set the incoming call rejection by operating the operation unit 40. In step S31, if the incoming call rejection is set (Y in step S31), the process returns to step S13, whereas if the incoming call rejection is not set (N in step S31), the process proceeds to step S32.

[0051] In step S32, the HF support unit 12 activates the HF function operation (i.e., starts the execution of the HF function operation). Also, when the step S32 is reached, the light emission control unit 14 controls the light emission of the light emission unit 60 as the light emission control CNT 2A After that, the light emission control CNT is set to "0" until the HF function operation ends. 2A The light emission control CNT controls the light emission state of the light emitting unit 60. 2A The light emission mode of the light emitting unit 60 is controlled in the light emission control CNT. 2A The above-mentioned light emission control CNT1 and the below-mentioned light emission control CNT 2Bare different from each other (see steps S15 and S51). 2A In the example, the light-emitting unit 60 emits light in one of a plurality of different light-emitting modes depending on the state of the HF function operation. The plurality of light-emitting modes depending on the state of the HF function operation are referred to as the light-emitting modes LM 1 , which will be described later. 2A_1 , L.M. 2A_2 and L.M. 2A_3 (See Figures 9(a) to (c)).

[0052] After the HF function operation is started, the state of the HF function operation (hereinafter referred to as the HF state) becomes one of a plurality of states including an incoming call state, an on-call state, and a hold state. When an incoming call notification signal is received, the HF state is an incoming call state before the user inputs a predetermined on-call instruction operation to the operation unit 40, and then when the user inputs a predetermined on-call instruction operation to the operation unit 40, the HF state switches from the incoming call state to the on-call state. When the HF state is the on-call state, the connection state of the telephone line between the first terminal device (TM) and the second terminal device is maintained, and a telephone call (hands-free call for the first person) between the first person (user of the multimedia device 1) and the second person is possible as described above.

[0053] After the HF state transitions to the receive state, when the user inputs a predetermined hold instruction operation to the operation unit 40, the HF state transitions to the receive state. In the hold state, the exchange of audio signals of the speech contents of the first and second persons between the first terminal device (TM) and the second terminal device is stopped while maintaining the connection of the telephone line between the first terminal device (TM) and the second terminal device. Therefore, in the hold state, the output of the audio signal indicating the contents of the sound picked up by the microphone of the second terminal device (including the contents of the sound picked up by the second person) from the speaker 83 is stopped, and the transmission of the audio signal indicating the contents of the sound picked up by the microphone 50 (including the contents of the sound picked up by the first person) to the second terminal device is stopped. When the HF state is in the hold state, when the user inputs a predetermined hold release operation to the operation unit 40, the HF state returns to the receive state.

[0054] However, when the HF state is in the receiving state or the holding state, if the user inputs a predetermined call end instruction operation to the operation unit 40, or if a predetermined call end instruction operation is input to the operation unit (not shown) of the second terminal device, the telephone line between the first terminal device (TM) and the second terminal device is disconnected. The disconnection of the telephone line is called "call end."

[0055] In step S33 following step S32, the main control unit 10 executes an incoming call notification process for notifying the user that the HF state is in an incoming call state (that is, that there is an incoming call at the terminal device TM). In the incoming call notification process, a predetermined incoming call image 611 is displayed on the display screen 30 as shown in FIG. 9(a). Therefore, when the process proceeds from step S11 to step S33 via steps S13, S31, and S32, the display image on the display screen 30 is switched from the navigation image 600 to the incoming call image 611. The incoming call image 611 is an image indicating that there is an incoming call at the terminal device TM. Furthermore, in the incoming call notification process, as shown in FIG. 9(a), the light-emitting unit 60 is illuminated in a predetermined light-emitting manner LM 2A_1 After step S33, the process proceeds to step S34.

[0056] In step S34, the HF support unit 12 checks the HF state. If the HF state is an incoming call state, the process returns to step S33, but if the HF state has switched from an incoming call state to a listening state, the process proceeds to step S35.

[0057] In step S35, the main control unit 10 executes a call receiving notification process to notify the user that the HF state is a call receiving state (a call is being received using the terminal device TM). In the call receiving notification process, a predetermined call receiving image 612 is displayed on the display screen 30 as shown in FIG. 9(b). Therefore, when the HF state transitions from an incoming call state to a call receiving state, the display image on the display screen 30 switches from an incoming call image 611 to a call receiving image 612. The call receiving image 612 is an image indicating that the HF state is a call receiving state. Furthermore, in the call receiving notification process, as shown in FIG. 9(b), the light emitting unit 60 is illuminated in a predetermined light emitting pattern LM 2A_2After step S35, the process proceeds to step S36. In the call receiving state, the speech content of the second person is output from the speaker 83, and when the user operates the knob 41 in the call receiving state, the output volume of the speaker 83 in the call receiving state is adjusted. When the knob 41 is operated to adjust the output volume of the speaker 83 in the call receiving state, the light emission control unit 14 temporarily changes the light emission state of the light emitting unit 60 to the light emission state LM 2A_2 (For example, the light emitting state of the light emitting unit 60 may be temporarily changed to a light emitting state corresponding to the output volume of the speaker 83).

[0058] In step S36, the HF support unit 12 checks the HF state. If the HF state is the receiving state, the process returns to step S35, but if the HF state has switched from the receiving state to the holding state, the process proceeds to step S37. Also, if the call has been ended in step S36, the process proceeds to step S39.

[0059] In step S37, the main control unit 10 executes an on-hold notification process to notify the user that the HF state is on hold. In the on-hold notification process, a predetermined on-hold image 613 is displayed on the display screen 30 as shown in FIG. 9(c). Therefore, when the HF state transitions from the call receiving state to the call on-hold state, the image displayed on the display screen 30 switches from the call receiving image 612 to the call on-hold image 613. The call on-hold image 613 is an image indicating that the HF state is on-hold. Furthermore, in the on-hold notification process, the light-emitting unit 60 is illuminated in a predetermined light-emitting pattern LM 2A_3 After step S37, the process proceeds to step S38.

[0060] In step S38, the HF support unit 12 checks the HF state. If the HF state is a hold state (i.e., if the hold state continues), the process returns to step S37. If the hold state is released and the HF state transitions from the hold state to the call receiving state, the process returns to step S35. If the call is ended in step S38, the process proceeds to step S39.

[0061] In step S39, the HF support unit 12 ends the HF function operation (i.e., ends the execution of the HF function operation). Also in step S39, the light emission control unit 14 issues a light emission control CNT 2A After step S39, the process returns to step S13. Therefore, after going through step S15, the light emission control CNT 2A When this is completed, the process returns to step S15 via step S13, causing the light-emitting unit 60 to return to a state in which it is illuminated by the light-emitting control CNT1 (assuming that a new incoming call notification signal has not been received and the voice recognition activation condition has not been satisfied).

[0062] Although it is not necessarily clear from Figs. 9(a) to (c), the light emission mode LM 2A_1 , L.M. 2A_2 and L.M. 2A_3 are different light emission modes. 2A_1 , L.M. 2A_2 and L.M. 2A_3 As long as the light emission modes are different from each other, the light emission modes are arbitrary. The light emission modes can be made different by changing the light emission color, the presence or absence of blinking, the frequency of blinking, and the movement of the light emission point. For example, the light emission mode LM 2A_1 In the light emitting state LM 2A_2 In the light emitting state LM, the entire area of ​​the light emitting unit 60 flashes slowly in green. 2A_3 In this case, the light-emitting unit 60 rotates and lights up in blue. Fast blinking refers to repeating a unit blinking operation at a predetermined first frequency, in which the light-emitting element of the light-emitting unit 60 is turned on and then turned off, while slow blinking refers to repeating a unit blinking operation at a predetermined second frequency that is lower than the first frequency. Rotating lighting refers to a light-emitting mode in which the light-emitting point of the light-emitting unit 60 appears to rotate around a predetermined axis (a light-emitting mode in which the light-emitting point is changed sequentially so that the light-emitting point changes around a predetermined axis). Images 611 to 613 in Figures 9(a) to (c) are also different from one another. Light-emitting mode LM 2A_1 , L.M. 2A_2 , L.M. 2A_3The illumination of the light emitting unit 60 by the illumination mode LM has a function of notifying the user that the current HF state is an incoming call state, an answering state, or a hold state, respectively. 2A_1 , L.M. 2A_2 and L.M. 2A_3 may be different from the light emission state of the light-emitting unit 60 when the light-emission control CNT1 is executed in step S15 of FIG. 7 (see FIG. 8).

[0063] The flow of operations when moving from step S14 to step S51 will be described. In step S51, the VR support unit 13 activates the VR function operation (i.e., starts the execution of the VR function operation). Also, when it reaches step S51, the light emission control unit 14 controls the light emission of the light emission unit 60 as the light emission control CNT 2B After that, the light emission control CNT is set to 0 until the VR function operation ends. 2B The light emission control CNT controls the light emission state of the light emitting unit 60. 2B The light emission mode of the light emitting unit 60 is controlled in the light emission control CNT. 2B In the example, the light-emitting unit 60 emits light in one of a plurality of different light-emitting modes according to the state of the VR function operation. The plurality of light-emitting modes according to the state of the VR function operation are referred to as light-emitting modes LM 2B_1 , L.M. 2B_2 and L.M. 2B_3 (See Figures 11(a) to (c)).

[0064] After the VR function operation is started, the state of the VR function operation (hereinafter referred to as the VR state) becomes one of a plurality of states including an utterance waiting state, an utterance input in progress state, and a response state. The transition between these states is shown in FIG. 10. When the VR function operation is started, the VR state first becomes an utterance waiting state in which the VR state waits for the user to start speaking. The period during which the user speaks after the VR function operation is started is referred to as the user utterance period. During the user utterance period, the VR state is an utterance input in progress state. The utterance input in progress state corresponds to a state in which the contents of the user's utterance are being input to the microphone 50. The VR support unit 13 may determine the start timing and end timing of the user utterance period based on the strength and spectrum of the output audio signal of the microphone 50, etc. When the user's speech is interrupted for a certain period of time after the start of the user's speech period (for example, when the strength of the signal component of the human voice in the output audio signal of the microphone 50 remains below a predetermined value for a certain period of time), the VR support unit 13 can determine that the user's speech period has ended. When the user's speech period ends, the VR state transitions from the speech input state to the response state. In the response state, a voice recognition process that recognizes the contents of the user's speech during the user's speech period and a response process that responds to the contents of the user's speech using the recognition result of the voice recognition process are executed. The voice recognition process can be started midway through the user's speech period.

[0065] Depending on the contents of the user's speech during the user speech period, there are cases where the VR function operation ends after the response process is completed, and cases where the VR state returns to the speech standby state after the response process is completed. The former case corresponds to the case of moving from step S57 to step S58 in Fig. 7, and the latter case corresponds to the case of returning from step S57 to step S52 in Fig. 7.

[0066] Returning to the description of the process flow after step S51, with reference to FIG. 7, in step S52 following step S51, the main control unit 10 executes speech standby notification process for notifying the user that the VR state is an utterance standby state. In the speech standby notification process, a predetermined standby image 621 is displayed on the display screen 30 as shown in FIG. 11(a). Therefore, when the process proceeds from step S11 to step S52 via steps S12 to S14 and S51, the display image on the display screen 30 is switched from the navigation image 600 to the standby image 621. The standby image 621 is an image indicating that the user's utterance is being waited for. Furthermore, in the speech standby notification process, as shown in FIG. 11(a), the light emitting unit 60 is illuminated in a predetermined light emitting mode LM 2B_1 After step S52, the process proceeds to step S53.

[0067] In step S53, the VR support unit 13 checks the VR state. If the VR state is a speech waiting state, the process returns to step S52, but if the VR state has switched from the speech waiting state to a speech input state, the process proceeds to step S54. After moving from step S51 to step S52, if the user starts speaking, the process proceeds to step S54.

[0068] In step S54, the main control unit 10 executes a speech input notification process to notify the user that the VR state is in a speech input state. In the speech input notification process, a predetermined input image 622 is displayed on the display screen 30 as shown in FIG. 11(b). Therefore, when the VR state transitions from the speech standby state to the speech input state, the display image on the display screen 30 switches from the standby image 621 to the input image 622. The input image 622 is an image indicating that the VR state is in a speech input state. Furthermore, in the speech input notification process, as shown in FIG. 11(b), the light-emitting unit 60 emits light in a predetermined light-emitting pattern LM 2B_2 After step S54, the process proceeds to step S55.

[0069] In step S55, the VR support unit 13 checks the VR state. If the VR state is the speech input state, the process returns to step S54, but if the VR state has switched from the speech input state to the response state, the process proceeds to step S56.

[0070] In step S56, the main control unit 10 executes an in-progress notification process to notify the user that the VR state is in a response state. In the in-progress notification process, a predetermined in-progress image 623 is displayed on the display screen 30 as shown in FIG. 11(c). Therefore, when the VR state transitions from the speech input state to the in-progress state, the display image on the display screen 30 switches from the input image 622 to the in-progress image 623. The in-progress image 623 is an image indicating that the VR state is in a response state. Furthermore, in the in-progress notification process, as shown in FIG. 11(c), the light-emitting unit 60 emits light in a predetermined light-emitting pattern LM 2B_3 It is illuminated with.

[0071] In step S56, while the in-service notification process is being executed, the VR support unit 13 executes a voice recognition process for recognizing the contents of the user's speech during the user's speech period, and a response process for responding to the contents of the user's speech using the recognition result of the voice recognition process. When the response process is completed, the in-service notification process is stopped and the process proceeds to step S57. The in-service notification process may also be stopped at the stage where the response process is started.

[0072] In step S57, the VR support unit 13 judges whether or not the VR function operation should be continued. If it is judged that the VR function operation should be continued (Y in step S57), the process returns to step S52, whereas if not (N in step S57), the process proceeds to step S58.

[0073] The determination process in step S57 depends on the contents of the user's speech during the user's speech period. For example, consider the following first case. In the first case, the user increases the audio volume setting value VOL AD In the first case, the VR support unit 13 makes an utterance instructing to increase the volume setting value VOL ADIn the first case, the volume setting VOL AD Since the user's needs are satisfied by the increase in the number of users, the VR support unit 13 determines that the VR function operation may be terminated (N in step S57), and the process proceeds to step S58.

[0074] Also, for example, consider a second case in which the user's utterance during the user utterance period is an utterance instructing to set a nearby restaurant as the destination of the vehicle CR. The VR support unit 13 related to the second case searches for restaurants in the vicinity of the vehicle CR through the communication module 70 and the communication network NET while referring to the vehicle position information in the response process of step S56. Here, it is assumed that the first to third restaurants are found as restaurants in the vicinity of the vehicle CR. Then, in the response process of step S56, the VR support unit 13 related to the second case notifies the user to inquire which of the first to third restaurants to set as the destination of the vehicle CR while showing the information of the first to third restaurants to the user (the notification is performed using the speaker 83, or using the display screen 30 and the speaker 83). In such a second case, since a response from the user is required after the notification of the above inquiry, it is determined that the VR function operation should be continued (Y in step S57), and the process returns to step S52.

[0075] In step S58, the VR support unit 13 ends the VR function operation (i.e., ends the execution of the VR function operation). Also, in step S58, the light emission control unit 14 issues a light emission control CNT 2B After step S58, the process returns to step S13. Therefore, after going through step S15, the light emission control CNT 2B When this is completed, the process returns to step S15 via step S13, causing the light-emitting unit 60 to return to a state in which it is illuminated by the light-emitting control CNT1 (assuming that the incoming call notification signal has not been received and the new voice recognition activation condition has not been satisfied).

[0076] Although it is not necessarily clear from Figs. 11(a) to (c), the light emission mode LM 2B_1 , L.M. 2B_2 and L.M.2B_3 are different light emission modes. 2B_1 , L.M. 2B_2 and L.M. 2B_3 As long as the light emission modes are different from each other, the light emission modes are arbitrary. The light emission modes can be made different by changing the light emission color, the presence or absence of blinking, the frequency of blinking, and the movement of the light emission point. For example, the light emission mode LM 2B_1 In the light emitting state LM 2B_2 In the light emitting state LM 2B_3 In the light emission mode LM, the light emitting unit 60 rotates and lights up in blue. The meanings of slow blinking, fast blinking, and rotating lighting are as described above. The images 621 to 623 in Figs. 11(a) to (c) are also different from each other. 2B_1 , L.M. 2B_2 , L.M. 2B_3 The light emission of the light-emitting unit 60 by the light-emitting state LM has a function of notifying the user that the current VR state is a speech waiting state, a speech input state, or a response state, respectively. 2B_1 , L.M. 2B_2 and L.M. 2B_3 may be different from the light emission state of the light-emitting unit 60 when the light-emission control CNT1 is executed in step S15 of FIG. 7 (see FIG. 8).

[0077] As described above, the light emission control unit 14 causes the light emitting unit 60 to emit light in accordance with the light emission control CNT1 when the audio function operation is performed, and causes the light emitting unit 60 to emit light in accordance with the other light emission control (CNT 2A , CNTs 2B ) to light the light-emitting unit 60. This makes it possible to notify the user of information related to the execution of another functional operation (whether or not another functional operation is being executed, etc.) by using the light-emitting unit 60 for the knob 41 that was originally provided for the audio functional operation (thus, without adding any new member). Even if the display image on the display screen 30 is switched from an image for another functional operation during the execution of the other functional operation, the other light-emitting control (CNT 2A , CNTs 2BSince the light emitting section 60 emits light in accordance with the command, the user can recognize information related to the execution of other functional operations (whether or not other functional operations are being executed, etc.).

[0078] <<Second Example>> A second embodiment will now be described. The second embodiment is based on the first embodiment, and the matters described in the first embodiment are also applied to the second embodiment.

[0079] As described in the first embodiment, when the main control unit 10 executes the HF function operation, it displays a predetermined image corresponding to the HF function operation on the display image 30. Examples of the predetermined images corresponding to the HF function operation include the incoming call image 611, the call receiving image 612, and the on-hold image 613 (see Figs. 9(a)-(c)). Here, referring to Fig. 12, the period from time t11 to time t13 is the execution period of the HF function operation. Time t12 is a time after time t11 and before time t13, and the display change condition is satisfied at time t12 (in detail, the display change condition is not satisfied until time t12, and is satisfied at time t12). The execution period of the HF function operation corresponds to the period from the transition to step S32 in Fig. 7 until step S39. During the execution period of the HF function operation, when a predetermined display change condition is satisfied (time t12) while a predetermined image (611, 612 or 613) corresponding to the HF function operation is displayed on the display screen 30, the main control unit 10 changes the display image on the display screen 30 from the predetermined image corresponding to the HF function operation to a predetermined destination image. In the second embodiment, the display change condition is a first display change condition, and the destination image is the navigation image 600. After the first display change condition is satisfied, the display of the incoming call image 611, the answering call image 612, and the on-hold image 613 by the processes of steps S33, S35, and S37 in FIG. 7 is stopped (see FIGS. 9(a) to (c)), and the display image on the display screen 30 becomes the navigation image 600.

[0080] On the other hand, the light emission control unit 14 that controls the light emission of the light emitting unit 60 performs light emission control on the light emitting unit 60 during the execution period of the HF function operation. 2ATherefore, during the execution period of the HF function operation, the light emission control unit 14 maintains the light emission control CNT even after the display image on the display screen 30 is changed from a predetermined image corresponding to the HF function operation to a change destination image in response to the establishment of the display change condition. 2A The light emitting unit 60 continues to emit light in accordance with the instruction (see step S32 in FIG. 7).

[0081] As a result, even if the predetermined image corresponding to the HF function operation is no longer displayed, the light emission mode of the light-emitting unit 60 can inform the user of the current HF state (state of the HF function operation).

[0082] When a navigation operation accompanied by the display of the navigation image 600 is being continuously executed, an incoming call to the terminal device TM may cause a transition to an execution period of an HF function operation. During the execution period of the HF function operation, a predetermined image (611, 612 or 613) corresponding to the HF function operation is displayed, which allows the user to know the current HF state, but at this time, the visibility of the navigation image 600 is obstructed.

[0083] The user can input a predetermined navigation return instruction to the multimedia device 1 at any timing during the execution period of the HF function operation. For example, the navigation return instruction is input to the multimedia device 1 by inputting a predetermined navigation return operation to the operation unit 40. When the navigation return instruction is input to the multimedia device 1 during the execution period of the HF function operation, a first display change condition, which is a display change condition according to the second embodiment, is satisfied. When the first display change condition is satisfied, the main control unit 10 changes the display image on the display screen 30 from a predetermined image corresponding to the HF function operation to the navigation image 600. The navigation return instruction corresponds to an instruction to make this change.

[0084] By adopting such a configuration, during the execution of the HF function operation, the state of the display screen 30 can be returned to a state in which the navigation image 600 is displayed, according to the user's wishes (it is possible to shorten the period during which the navigation image 600 is not displayed).

[0085] In the example of FIG. 12, the display image on the display screen 30 changes from the call receiving image 612 back to the navigation image 600, and thereafter, the driver as the user can view the navigation image 600. However, during the execution period of the HF function operation, the light emission control CNT 2A continues (see step S32 in FIG. 7). For this reason, if the HF state (state of the HF function operation) is the same during the period during which the call receiving image 612 is displayed on the display screen 30 (first period) and during the period during which the navigation image 600 is displayed on the display screen 30 (second period) within the execution period of the HF function operation, the light emission control unit 14 causes the light emitting unit 60 to emit light in the same light emission mode during the former period and the latter period. In the example of FIG. 12, the image displayed on the display screen 30 is changed from the call receiving image 612 to the navigation image 600 at time t12, but since the HF state does not change from the call receiving state at time t12, the same light emission mode LM is maintained throughout the former period and the latter period. 2A_2 The light emitting section 60 emits light.

[0086] The same applies when the display image on the display screen 30 is changed from the incoming call image 611 or the hold image 613 to the navigation image 600 at the time t12. 2A_1 ~LM 2A_3 are different from each other, so the light emission mode LM 2A_1 ~LM 2A_3 The light emitted by the light emitting unit 60 has the function of notifying the user of the current HF state.

[0087] Therefore, even if a predetermined image corresponding to the HF function operation (in the example of FIG. 12, the call receiving image 612) is no longer displayed in response to the establishment of the display change condition, it is possible to inform the user of the current HF state (state of the HF function operation) by the light emitting mode of the light emitting unit 60. In other words, while being provided with the navigation image 600, the user can check the current HF state (whether the HF state immediately before time t12 is continuing, etc.) by looking at the light emitting unit 60 as necessary.

[0088] Although the input of the navigation return operation by the user to the multimedia device 1 has been described as the first display change condition according to the second embodiment, the first display change condition, which is the display change condition according to the second embodiment, may be any condition. For example, during the execution period of the HF function operation, the first display change condition may be established when a predetermined time (e.g., 5 seconds) has elapsed since the start of displaying a predetermined image (611, 612, or 613) corresponding to the HF function operation on the display screen 30.

[0089] <<Third Example>> A third embodiment will now be described. The third embodiment is based on the first embodiment, and the matters described in the first embodiment are also applied to the third embodiment.

[0090] As described in the first embodiment, when the main control unit 10 executes the VR function operation, it displays a predetermined image corresponding to the VR function operation on the display image 30. As examples of the predetermined image corresponding to the VR function operation, the standby image 621, the input image 622, and the corresponding image 623 are given (see Figs. 11(a) to (c)). Here, referring to Fig. 13, the period from time t21 to time t23 is the execution period of the VR function operation. Time t22 is a time after time t21 and before time t23, and the display change condition is satisfied at time t22 (in detail, the display change condition is not satisfied until time t22, and is satisfied at time t22). The execution period of the VR function operation corresponds to the period from the transition to step S51 in Fig. 7 until step S58. During the execution period of the VR function operation, when a predetermined display change condition is satisfied (time t22) while a predetermined image (621, 622 or 623) corresponding to the VR function operation is displayed on the display screen 30, the main control unit 10 changes the display image on the display screen 30 from the predetermined image corresponding to the VR function operation to a predetermined destination image. In the third embodiment, the display change condition is a first display change condition, and the destination image is the navigation image 600. After the first display change condition is satisfied, the display of the standby image 621, the inputting image 622, and the corresponding image 623 by the processes of steps S52, S54, and S56 in FIG. 7 is stopped (see FIGS. 11(a) to (c)), and the display image on the display screen 30 becomes the navigation image 600.

[0091] On the other hand, the light emission control unit 14 that controls the light emission of the light emitting unit 60 performs light emission control on the light emitting unit 60 during the execution period of the VR function operation. 2B Therefore, during the execution period of the VR function operation, the light emission control unit 14 maintains the light emission control CNT even after the display image on the display screen 30 is changed from the predetermined image corresponding to the VR function operation to the change destination image in response to the establishment of the display change condition. 2B The light emitting unit 60 continues to emit light in accordance with the instruction (see step S51 in FIG. 7).

[0092] As a result, even if the predetermined image corresponding to the VR function operation is no longer displayed, the light emission mode of the light-emitting unit 60 can inform the user of the current VR state (the state of the VR function operation).

[0093] When a navigation operation accompanied by the display of the navigation image 600 is continuously executed, a transition may occur to a period during which a VR function operation is executed. During the period during which the VR function operation is executed, a predetermined image (621, 622 or 623) corresponding to the VR function operation is displayed, which allows the user to know the current VR state, but at this time, the visibility of the navigation image 600 is obstructed.

[0094] The user can input a predetermined navigation return instruction to the multimedia device 1 at any timing during the execution period of the VR function operation. The navigation return instruction is as described in the second embodiment. When a navigation return instruction is input to the multimedia device 1 during the execution period of the VR function operation, a first display change condition, which is a display change condition according to the third embodiment, is established. When the first display change condition is established, the main control unit 10 changes the display image on the display screen 30 from a predetermined image corresponding to the VR function operation to the navigation image 600. The navigation return instruction corresponds to an instruction to make this change.

[0095] By adopting such a configuration, during the execution of the VR function operation, the state of the display screen 30 can be returned to a state in which the navigation image 600 is displayed, according to the user's wishes, and the period during which the navigation image 600 is not displayed can be shortened.

[0096] In the example of FIG. 13, the display image on the display screen 30 returns from the standby image 621 to the navigation image 600, and thereafter, the driver as the user can view the navigation image 600. However, during the execution period of the VR function operation, the light emission control CNT 2B continues (see step S51 in FIG. 7). Therefore, if the VR state (state of the VR function operation) is the same during a period (first period) in which the standby image 621 is displayed on the display screen 30 and during a period (second period) in which the navigation image 600 is displayed on the display screen 30 within the execution period of the VR function operation, the light emission control unit 14 causes the light emitting unit 60 to emit light in the same light emission mode during the former period and the latter period. In the example of FIG. 13, the image displayed on the display screen 30 is changed from the standby image 621 to the navigation image 600 at time t22, but since the VR state does not change from the speech standby state at time t22, the same light emission mode LM is maintained throughout the former period and the latter period. 2B_1 The light emitting section 60 emits light.

[0097] The same applies when the display image on the display screen 30 is changed from the input image 622 or the corresponding image 623 to the navigation image 600 at time t22. 2B_1 ~LM 2B_3 are different from each other, so the light emission mode LM 2B_1 ~LM 2B_3 The light emitted by the light-emitting unit 60 has the function of notifying the user of the current VR state.

[0098] Therefore, even if a predetermined image (standby image 621 in the example of FIG. 13) corresponding to the VR function operation is no longer displayed in response to the establishment of the display change condition, it is possible to inform the user of the current VR state (state of the VR function operation) by the light emission mode of the light-emitting unit 60. In other words, while being provided with the navigation image 600, the user can check the current VR state (whether the VR state immediately before time t22 is continuing, etc.) by looking at the light-emitting unit 60 as necessary.

[0099] Although the input of the navigation return operation to the multimedia device 1 by the user has been described as the first display change condition according to the third embodiment, the first display change condition, which is the display change condition of the third embodiment, may be any condition. For example, during the execution period of the VR function operation, the first display change condition may be established when a predetermined time (e.g., 5 seconds) has elapsed since the start of displaying a predetermined image (621, 622, or 623) corresponding to the VR function operation on the display screen 30.

[0100] <<Fourth Example>> A fourth embodiment will be described. In the fourth embodiment, a modified technique of the second embodiment will be described. The description of the second embodiment also applies to the fourth embodiment unless otherwise specified.

[0101] Please refer to Figures 12 and 14. In the second embodiment corresponding to Figure 12, the display change condition is the first display change condition and the changed image is a navigation image 600, whereas in the fourth embodiment corresponding to Figure 14, the display change condition is the second display change condition and the changed image is a rear camera image 630. The rear camera image 630 is a camera image obtained by photographing with the camera 2R (rear camera; see Figure 2).

[0102] The second display change condition is satisfied when the traveling direction of the vehicle CR is set to the reverse direction. That is, when the position of the shift lever CC2 coincides with the reverse position, the second display change condition is satisfied. The main control unit 10 can determine whether the second display change condition is satisfied or not based on the shift information. When the second display change condition is satisfied during the execution period of the HF function operation, the main control unit 10 changes the display image of the display screen 30 from a predetermined image corresponding to the HF function operation to a rear camera image 630. The predetermined image corresponding to the HF function operation may be any of the incoming call image 611, the incoming call image 612, and the on-hold image 613, and in FIG. 14, the on-hold image 612 is shown as an example of the predetermined image. After the second display change condition is satisfied, the display of the incoming call image 611, the incoming call image 612, and the on-hold image 613 by the processes of steps S33, S35, and S37 in FIG. 7 is stopped (see FIG. 9(a) to (c)), and the display image of the display screen 30 is changed to the rear camera image 630.

[0103] According to the fourth embodiment, when it becomes necessary to display the rear camera image 630 during the execution period of the HF function operation, it is possible to quickly transition to a state in which the rear camera image 630 is displayed.

[0104] In this case, as in the second embodiment, if the HF state (state of the HF function operation) is the same during the period (first period) during which the call receiving image 612 is displayed on the display screen 30 and during the period (second period) during which the rear camera image 630 is displayed on the display screen 30 during the execution period of the HF function operation, the light emission control unit 14 causes the light emitting unit 60 to emit light in the same light emission mode during the former period and the latter period. In the example of FIG. 14, the image displayed on the display screen 30 is changed from the call receiving image 612 to the rear camera image 630 at the boundary of time t12, but since the HF state does not change from the call receiving state at the boundary of time t12, the same light emission mode LM is maintained throughout the former period and the latter period. 2A_2 The light-emitting unit 60 emits light. Therefore, while being provided with the rear camera image 630, the user can check the current HF state (whether the HF state immediately before time t12 is continuing, etc.) by looking at the light-emitting unit 60 as necessary.

[0105] <<Fifth Example>> A fifth embodiment will be described. In the fifth embodiment, a modified technique for the third embodiment will be described. The description of the third embodiment also applies to the fifth embodiment unless otherwise specified. Similar to the modification of the second embodiment (FIG. 12) to the fourth embodiment (FIG. 14), the fifth embodiment is a modification of the third embodiment (FIG. 13).

[0106] Please refer to Figures 13 and 15. In the third embodiment corresponding to Figure 13, the display change condition is the first display change condition and the changed image is a navigation image 600, whereas in the fifth embodiment corresponding to Figure 15, the display change condition is the second display change condition and the changed image is a rear camera image 630.

[0107] The rear camera image 630 and the second display change condition are as described in the fourth embodiment. When the second display change condition is satisfied during the execution period of the VR function operation, the main control unit 10 changes the display image of the display screen 30 from a predetermined image corresponding to the VR function operation to the rear camera image 630. The predetermined image corresponding to the VR function operation may be any of the standby image 621, the input image 622, and the corresponding image 623, and the standby image 621 is shown as an example of the predetermined image in FIG. 15. After the second display change condition is satisfied, the display of the standby image 621, the input image 622, and the corresponding image 623 by the processes of steps S52, S54, and S56 in FIG. 7 is stopped (see FIG. 11(a) to (c)), and the display image of the display screen 30 is changed to the rear camera image 630.

[0108] According to the fifth embodiment, when it becomes necessary to display the rear camera image 630 during the execution period of the VR function operation, it is possible to quickly transition to a state in which the rear camera image 630 is displayed.

[0109] In this case, as in the third embodiment, if the VR state (state of the VR function operation) is the same during the execution period of the VR function operation in a period (first period) in which the standby image 621 is displayed on the display screen 30 and a period (second period) in which the rear camera image 630 is displayed on the display screen 30, the light emission control unit 14 causes the light emission unit 60 to emit light in the same light emission mode during the former period and the latter period. In the example of FIG. 15, the image displayed on the display screen 30 is changed from the standby image 621 to the rear camera image 630 at time t22, but the VR state does not change from the speech standby state at time t22, so the same light emission mode LM is maintained throughout the former period and the latter period. 2B_1 The light emitting unit 60 emits light. Therefore, while receiving the rear camera image 630, the user can check the current VR state (whether the VR state immediately before time t22 is continuing, etc.) by looking at the light emitting unit 60 as necessary.

[0110] <<Sixth Example>> A sixth embodiment will now be described. In the sixth embodiment, some supplementary matters, applied techniques, modified techniques, and the like to the matters described above will be described.

[0111] In the flowchart of FIG. 7, attention is focused on a hands-free call when the second terminal device calls the first terminal device (TM), but the above-mentioned operations and controls are also possible when a hands-free call is made after the first terminal device (TM) calls the second terminal device. For example, when the first terminal device (TM) calls the second terminal device in the HF function operation, the user inputs a predetermined calling operation to the operation unit 40. In response to the input of the calling operation, the HF support unit 12 causes the first terminal device (TM) to transmit a calling signal toward the communication network NET. When an incoming signal based on the calling signal is received by the second terminal device and an answering operation is input by the second terminal device, a hands-free call is made possible.

[0112] After a call originating operation is input to the operation unit 40, the HF state remains in the call originating state until a call receiving operation is input to the second terminal device. A call state occurs when a call receiving operation is input to the second terminal device and hands-free calling is possible. The call state may be considered to be the same as the call receiving state described above. In the call originating state, the main control unit 10 executes a call originating notification process for notifying the user that the HF state is in the call originating state. In the call originating notification process, a predetermined call originating image (not shown) is displayed on the display screen 30, and the light emitting unit 60 is turned on in a predetermined light emitting pattern LM 2A_4 (not shown) to emit light. Light emission mode LM 2A_4 The LM has a function to notify the user that the HF state is a transmission state. 2A_4 is the light emission mode LM 2A_1 ~LM 2A_3 It may be different from any of the above.

[0113] Light emitting mode LM 2A_4 is one of the light emission modes of the light-emitting unit 60 during the execution of the HF function operation, and the light-emission control CNT 2A (see step S32 in FIG. 7). Therefore, during the execution of the HF function operation, the light emission mode LM 2A_4 Even if the display change condition is satisfied when the light emitting unit 60 is emitting light, and the display image on the display screen 30 is changed from the transmission image to the destination image (navigation image 600 or rear camera image 630), as long as the HF state is maintained in the transmission state, the light emitting state LM 2A_4 The light emitting unit 60 continues to emit light.

[0114] The multimedia device 1 in FIG. 1 is an example of an in-vehicle device according to the present invention. The multimedia device 1 itself can be considered to correspond to the in-vehicle device according to the present invention. Alternatively, it is possible to form an in-vehicle device having only some of the components of the multimedia device 1. In this case, it is preferable that the in-vehicle device includes at least a knob 41, a light-emitting unit 60, and a main control unit 10. The method in which the main control unit 10 controls the light emission of the light-emitting unit 60 can be called an in-vehicle light-emission control method.

[0115] The in-vehicle device may be configured by hardware such as an integrated circuit, or a combination of hardware and software. Any specific function, which is all or part of the functions realized by the in-vehicle device, may be written as a program and the program may be stored in a memory that can be mounted on the in-vehicle device. The specific function may then be realized by executing the program on a program execution device (for example, a microcomputer that can be mounted on the in-vehicle device, such as the CPU of the main control unit 10). The program may be stored in any recording medium. The recording medium that stores the program may be mounted on or connected to a device different from the in-vehicle device.

[0116] The embodiments of the present invention can be modified in various ways as appropriate within the scope of the technical ideas set forth in the claims. The above embodiments are merely examples of the present invention, and the meanings of the terms of the present invention and each component are not limited to those described in the above embodiments. The specific numerical values ​​shown in the above description are merely examples, and can be changed to various numerical values ​​as a matter of course. [Explanation of symbols]

[0117] SYS In-vehicle system 1 Multimedia devices 1 2 Camera section 2R Rear Camera 3 GPS processing section 4. Vehicle sensor section 4A Shift Lever Sensor 4B Vehicle speed sensor 10 Main control unit 11 Navigation section 12 Hands-free compatible section (HF compatible section) 13 Voice recognition support section (VR support section) 14 Light emission control unit 20 Memory section 30 display screen 40 Control section 41 Audio Knob 50 Microphone 60 Light emitting part 70 Communication Module 80 Audio Equipment 81 Tuner section 82 Audio Amplifier 83 Speaker TM terminal equipment NET Communication network CC1 Steering Wheel CC2 Shift Lever CC3 Ignition Switch

Claims

1. an audio knob for adjusting an output volume of an audio device installed in a vehicle; a light emitting unit that illuminates the audio knob by emitting light; a main control unit that controls execution of an audio function operation for reproducing an output sound signal of a tuner unit of the audio device and another function operation different from the audio function operation; The main control unit causes the light emitting unit to emit light in accordance with a first control when the audio function operation is performed, and causes the light emitting unit to emit light in accordance with a second control different from the first control when the other function operation is performed. , in-vehicle equipment.

2. Further comprising a display screen for displaying an image; The main control unit, when the other functional operation is executed, displays a predetermined image corresponding to the other functional operation on the display screen, and when the display image on the display screen is changed from the predetermined image during the execution period of the other functional operation, continues emitting light from the light emitting unit in accordance with the second control. The in-vehicle device according to claim 1 .

3. When an execution period of the other functional operation includes a first period during which the predetermined image is displayed on the display screen and a second period after the display image on the display screen is changed from the predetermined image, and when a state of the other functional operation is the same between the first period and the second period, the main control unit causes the light emitting unit to emit light in the same light emitting mode in the first period and the second period. The in-vehicle device according to claim 2 .

4. The other functional operation state is a plurality of states, The main control unit controls a light emission state of the light emitting unit in accordance with a current state of the other functional operation during an execution period of the other functional operation. The in-vehicle device according to claim 3 .

5. The main control unit changes the display image on the display screen from the predetermined image when a display change condition is satisfied during the execution period of the other functional operation.

5. The vehicle-mounted device according to claim 2.

6. When the main control unit receives an instruction from a user of the in-vehicle device to change the display image on the display screen from the predetermined image to a navigation image including a map image while the predetermined image is being displayed on the display screen during the execution period of the other functional operation, the display change condition is established and the display image on the display screen is changed from the predetermined image to the navigation image. The in-vehicle device according to claim 5 .

7. When the traveling direction of the vehicle is set to a reverse direction while the predetermined image is being displayed on the display screen during the execution period of the other functional operation, the main control unit establishes the display change condition, and changes the display image on the display screen from the predetermined image to a camera image capturing the outside of the vehicle. The in-vehicle device according to claim 5 .

8. The other functions include a hands-free function that enables a user of the in-vehicle device to make a hands-free call.

8. An in-vehicle device according to claim 1.

9. The other functional operations include a voice recognition functional operation of recognizing the contents of an utterance by a user of the in-vehicle device and responding to the contents of the utterance.

9. An in-vehicle device according to claim 1.

10. 1. An in-vehicle light emission control method for use in an in-vehicle device including an audio knob for adjusting an output volume of an audio device installed in a vehicle and a light emitting unit provided in correspondence with the audio knob, comprising: a main control step for controlling execution of an audio function operation for reproducing an output sound signal of a tuner unit of the audio device and another function operation different from the audio function operation; In the main control step, when the audio function operation is executed, the light emitting unit is caused to emit light in accordance with a first control, and when the other function operation is executed, the light emitting unit is caused to emit light in accordance with a second control different from the first control. , A method for controlling light emission in a vehicle.

Images