Display control device, display control method, and display control program

Abstract

To provide a display control device and the like which promptly enable a hazard lamp to light up or the like in response to occurrence of a dangerous situation where a traffic accident or the like is caused.SOLUTION: A display control device comprises an extracting part 1 that extracts dangerous sound from sound of a person getting on a vehicle and a control part 2 that when the dangerous sound is extracted, makes a display DP display an operation screen for activating a function corresponding to the extracted dangerous sound.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present application relates to the technical fields of a display control device, a display control method, and a display control program. More specifically, the present application relates to the technical fields of a display control device and a display control method that control display in a moving body such as a vehicle, and a program for the display control device. [Background technology]

[0002] In recent years, a considerable number of traffic accidents have occurred due to an increase in traffic volume. Meanwhile, one of the devices installed in vehicles to prevent traffic accidents is a hazard lamp. From the viewpoint of suppressing the above traffic accidents, it is required to prevent erroneous operation of turning on the hazard lamp and to improve the operability of the hazard lamp. For example, the following Patent Document 1 is a prior art document that discloses an example of a conventional technique made from this viewpoint.

[0003] Patent Document 1 discloses a configuration in which, in order to maintain good operability while preventing erroneous operation, multiple switch images including an image of a hazard lamp switch are displayed on a display or the like, and the images are operated using touch pads provided on the front and back of the steering wheel. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-144582 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, from the viewpoint of preventing traffic accidents, turning on the hazard lamps is extremely urgent, and it is desirable to configure the hazard lamps so that they can be turned on immediately when a dangerous situation that may lead to a traffic accident occurs. However, the above-mentioned Patent Document 1 does not take into consideration such a demand for urgency. Therefore, the technology disclosed in the above-mentioned Patent Document 1 cannot meet the above demand.

[0006] Therefore, the present application has been made in consideration of the above-mentioned demands and problems, and one example of the object of the application is to provide a display control device and a display control method, as well as a program for the display control device, that are capable of quickly turning on hazard lights, etc. in response to the occurrence of a dangerous situation that may lead to a traffic accident. [Means for solving the problem]

[0007] In order to solve the above problem, the present invention provides an extracting means for extracting a danger voice indicating danger from the voice of a passenger of a vehicle, and when the danger voice is extracted, At least one of i) a first operation image for activating a function of turning on a hazard lamp provided on the moving body, and ii) a second operation image for activating at least a function of recording image data of an image captured around the moving body. and a control means for causing the display means to display the above.

[0008] In order to solve the above problems, the present invention provides a display control method executed in a display control device including an extraction means and a control means, the display control method including: an extraction step of extracting a danger voice indicating danger from a voice of a passenger of a moving body by the extraction means; and when the danger voice is extracted, At least one of i) an operation image for activating a function of turning on a hazard lamp provided on the moving body, and ii) an operation image for activating at least a function of recording image data of an image captured around the moving body. and a control step of causing the control means to display the above on the display means.

[0009] In order to solve the above problem, the invention described in claim 8 provides a computer including an extraction unit that extracts a danger voice indicating danger from the voice of a passenger of a vehicle, and a processing unit that, when the danger voice is extracted, At least one of i) an operation image for activating a function of turning on a hazard lamp provided on the moving body, and ii) an operation image for activating at least a function of recording image data of an image captured around the moving body. on the display means. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a schematic configuration of a display control device according to an embodiment; [Diagram 2] 1 is a block diagram showing a schematic configuration of a navigation device according to an embodiment of the present invention; [Diagram 3] 4 is a flowchart showing a display control process according to the embodiment. [Figure 4] 1A and 1B are diagrams showing display examples in the display control process of the embodiment, where FIG. 1A is a diagram showing a first example, and FIG. 1B is a diagram showing a second example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Next, an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a block diagram showing a schematic configuration of a display control device according to the embodiment.

[0012] As shown in FIG. 1, a display control device S of the embodiment is configured to include an extraction means 1 and a control means 2.

[0013] In this configuration, the extraction means 1 extracts danger voices indicating danger from the voices of passengers of the vehicle. When the danger voice is extracted by the extraction means 1, the control means 2 causes the display means DP to display an operation image for activating a function corresponding to the extracted danger voice.

[0014] As described above, according to the operation of the display control device S of the embodiment, when a danger voice is extracted from the voice of an occupant of a moving body, an operation image for activating a function corresponding to the danger voice is displayed on the display means.

[0015] Therefore, necessary functions can be quickly activated in response to the occurrence of a danger. EXAMPLES

[0016] Next, specific examples corresponding to the above-described embodiment will be described with reference to Figures 2 to 4. Note that the examples described below are examples in which the present application is applied to the control of display content on a display provided in a vehicle.

[0017] Fig. 2 is a block diagram showing a schematic configuration of a navigation device of the embodiment, Fig. 3 is a flowchart showing a display control process of the embodiment, and Fig. 4 is a diagram showing a display example in the display control process of the embodiment. In Fig. 2, the same component numbers as those of the display control device S of the embodiment shown in Fig. 1 are used for the components of the embodiment corresponding to the components of the display control device S of the embodiment.

[0018] As shown in FIG. 2, the navigation device SS of the embodiment, which is an example of the display control device S of the embodiment, is mounted on, for example, a vehicle, and more specifically, is configured with a processing unit 10 consisting of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., a non-volatile recording unit 11 consisting of an HDD (Hard Disc Drive) or an SSD (Solid State Drive) or the like, an operation unit 12 consisting of operation buttons, etc., a microphone 13, a camera 14 consisting of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor) imaging element, etc., a sensor unit 15 constituting a GNSS (Global Navigation Satellite System) or an autonomous navigation system, etc., a display DP consisting of a liquid crystal display, etc., a touch panel TP provided on the surface of the display DP, a speaker 16, and an interface 17.

[0019] On the other hand, the processing unit 10 is composed of an extraction unit 1 and a control unit 2. In this case, the extraction unit 1 and the control unit 2 may be realized by a hardware logic circuit constituting the processing unit 10, or may be realized in software by the processing unit 10 reading and executing a program corresponding to the flowchart showing the display control process of the embodiment, for example, from the recording unit 11. The extraction unit 1 corresponds to an example of the extraction means 1 of the embodiment, the control unit 2 corresponds to an example of the control means 2 of the embodiment, and the processing unit 10 corresponds to an example of the "determination means" of the present application. In this case, as shown by the dashed line in FIG. 2, the extraction unit 1 and the control unit 2 constitute an example of a display control device S of the embodiment.

[0020] In the above configuration, the recording unit 11 non-volatilely records a program corresponding to the display control process of the embodiment, map data used for the vehicle guidance process by the navigation device SS, and the like, and is read out by the processing unit 10 as necessary. At this time, the display control process of the embodiment is executed as a part of the guidance process.

[0021] Meanwhile, under the control of the processing unit 10, the microphone 13 collects the speech of the vehicle occupants (including the driver or passengers of the vehicle; the same applies below) and outputs sound data corresponding to the collected speech to the processing unit 10. Furthermore, under the control of the processing unit 10, the camera 14 outputs to the processing unit 10 image data corresponding to the imaging results of, for example, the surroundings including the front and rear of the vehicle or the interior of the vehicle, which are necessary for the guidance processing. Furthermore, under the control of the processing unit 10, the sensor unit 15 detects the current position, moving speed, traveling direction, etc. of the vehicle equipped with the navigation device using the GNSS, etc., as part of the guidance processing, and generates detection data indicating the detection results and outputs it to the processing unit 10.

[0022] On the other hand, the display DP, which has a touch panel TP on its surface, displays images (including a hazard switch image, which is the subject of the display control process described later in this embodiment) and maps required for the guidance process under the control of the processing unit 10. The speaker 16 also emits sounds or voices required for the guidance process under the control of the processing unit 10. Furthermore, the interface 17 controls the transmission and reception of information or data required for the guidance process via a network, such as the Internet (not shown), under the control of the processing unit 10. Furthermore, when an instruction operation is performed on the navigation device SS by any of the passengers, the operation unit 12 generates an operation signal corresponding to the instruction operation and outputs it to the processing unit 10. As a result, the processing unit 10 mainly executes the guidance process including the display control process of the embodiment while controlling each member constituting the navigation device SS based on the operation signal.

[0023] At this time, the extraction unit 1 of the processing unit 10, as a part of the display control process of the embodiment, extracts a danger sound of the embodiment uttered by any one of the passengers from among the speech corresponding to the sound data based on the sound data input from the microphone 13, and outputs the extraction result to the control unit 2. As a result, when the danger sound is extracted as a part of the display control process of the embodiment, the control unit 2 causes the display DP to display a hazard switch image of the embodiment for turning on a hazard lamp (not shown) of the vehicle in which the navigation device SS is mounted, which can be operated by the passenger's finger or the like touching the touch panel TP, immediately after the danger sound is extracted. Then, when the touch panel TP detects the passenger's operation on the hazard switch image, the processing unit 10 turns on the hazard lamp.

[0024] Next, the display control process of the embodiment, which is mainly executed by the processing unit 10, will be specifically described with reference to Fig. 2 to Fig. 4. The display control process of the embodiment is started as an interrupt process at regular intervals as part of the guidance process.

[0025] As shown in the corresponding flowchart in FIG. 3, when the display control process of the embodiment is started, the processing unit 10 recognizes the content of any of the utterances of the passengers based on the sound data from the microphone 13 (speech recognition) (step S1). The extraction unit 2 then determines whether or not a danger voice of the embodiment is extracted from the recognized utterance (step S2). At this time, the danger voice is a voice indicating danger, such as "Danger!", "Wow!", "Are you serious!", "That's dangerous!", or "Oh no!". If the danger voice is not extracted in the determination of step S2 (step S2: NO), the processing unit 10 proceeds to step S8 described later.

[0026] On the other hand, if the judgment in step 2 finds that a danger voice of the embodiment is extracted from the recognized speech (step S2: YES), the control unit 2 immediately displays the hazard switch image of the embodiment on the display DP (step S3) and starts timing in a timer not shown (step S4).

[0027] Here, the hazard switch image displayed in step S3 is, for example, the hazard switch image MK illustrated in Fig. 4(a). At this time, as illustrated in Fig. 4(a), when a display DP is provided together with a touch panel TP in a portion surrounded by the center console CC, dashboard DB, and front window W of the vehicle, the hazard switch image MK is displayed as large as possible in the displayable area of ​​the display DP. When any of the passengers touches a part of the displayed hazard switch image MK, the hazard lamps of the vehicle are turned on.

[0028] Therefore, while the hazard switch image MK is being displayed, the processing unit 10 monitors whether or not a preset time (e.g., 5 seconds) corresponding to the lighting of the hazard lamps has elapsed in the timing started in step S4 (step S5). If the preset time has not elapsed in the monitoring in step S5 (step S5: NO), the processing unit 10 then judges whether or not the touch operation on the hazard switch image MK via the touch panel TP has been performed (step S6). If the judgment in step S6 indicates that the touch operation has not been performed (step S6: NO), the processing unit 10 continues the timing. On the other hand, if the judgment in step S6 indicates that the touch operation has been performed (step S6: YES), the processing unit 10 starts lighting the hazard lamps in response to the touch operation and proceeds to step S7 described later.

[0029] On the other hand, if the preset time has elapsed in the monitoring of step S5 (step S5: YES), or if the touch operation has been performed in the judgment of step S6 (step S6: YES), the processing unit 10 ends the display of the hazard switch image MK on the display DP (step S7). After that, the processing unit 10 judges whether or not to end the display control process of the embodiment due to, for example, the vehicle reaching its destination (step S8). If the display control process of the embodiment is to be continued in the judgment of step S8 (step S8: NO), the processing unit 10 returns to step S1 and continues the series of processes described above. On the other hand, if the display control process of the embodiment is to be ended in the judgment of step S8 (step S8: YES), the processing unit 10 ends the display control process as it is.

[0030] As described above, according to the display control process of the embodiment, when a danger sound is extracted from the voice of a vehicle occupant, an operation image such as a hazard switch image MK for activating a function corresponding to the danger sound (e.g., turning on the hazard lights) is displayed on the display DP, so that a required function can be quickly activated in response to the occurrence of a danger.

[0031] Furthermore, if the function corresponding to the danger sound is a function for turning on the hazard lights and the operation image is a hazard switch image MK, the hazard lights can be turned on quickly in response to the occurrence of danger.

[0032] Furthermore, if no operation is performed on the operation image within a predetermined time from the start of displaying the operation image (see step S5: NO and step S6: NO in FIG. 4), the display of the operation image is terminated (see step S7 in FIG. 4), so that the display of the operation image that did not require any operation can be terminated and restored to the original display.

[0033] In addition, in the extraction of dangerous sounds in the display control process of the embodiment, it may be configured so that it is determined that a dangerous sound has been extracted from the utterance (see step S2: YES in FIG. 4) only if the strength of the feeling of the dangerous sound (particularly the ending) is higher (stronger) than a threshold value set in advance according to the content of the dangerous sound. In this case, whether or not to display an operation image is determined based on the strength of the feeling of the extracted dangerous sound (particularly the ending), so that a required function can be quickly and accurately activated in response to the occurrence of a danger. Modified Example

[0034] Next, a modification of the above-described embodiment will be described. (I) First Modification First, as the first modified example, in the above-mentioned embodiment, when a danger sound is extracted (see step S2: YES in FIG. 4), a hazard switch image MK for turning on a hazard lamp is displayed on the display DP. However, in addition to this, in the case where there is a function for non-volatilely recording the image data from the camera 14 in the embodiment in the recording unit 11 (i.e., when the navigation device SS has a so-called drive recorder function), when a danger sound is extracted, a record button image MK2 as exemplified in FIG. 4(b) for starting the recording function is displayed on the display DP and a touch operation from the passenger is waited for. In this case, since the record button image MK2 is immediately displayed on the display DP when a danger sound is extracted, the recording function can be quickly started in response to the occurrence of a danger. Note that the first modified example can also be applied when the part functioning as the drive recorder including the camera 14 in the first modified example is a so-called retrofit drive recorder separate from the navigation device SS.

[0035] In addition, the hazard switch image MK of the embodiment and the recording button image MK2 of the first variant example may be displayed on the display DP, for example, in parallel, vertically or horizontally, and simultaneous touch operations on these may be configured to simultaneously activate the hazard lamp lighting function and the image data recording function.

[0036] (II) Second Variation Next, as a second modified example, in the above-mentioned embodiment, the embodiment is applied to the case where the display DP is provided in the vehicle itself (see FIG. 4). However, in addition to this, for example, when a smartphone (not shown) carried by a vehicle occupant is connected to the processing unit 10 by short-distance wireless communication, and the hazard lamp lighting function or the image data recording function can be activated by a touch operation on a touch panel provided on the display of the smartphone, the embodiment can also be applied to the case where the hazard switch image MK and / or the recording button image MK2 of the embodiment are displayed on the display of the smartphone. In this case, by displaying the hazard switch image MK etc. on a display that is closer to the occupant, the necessary functions can be activated more quickly in response to the occurrence of a danger.

[0037] In addition, the above program corresponding to the display control processing of the embodiment can be recorded on a recording medium such as an optical disk or a hard disk, or obtained via a network such as the Internet, and then read out and executed by a general-purpose microcomputer or the like, thereby causing the microcomputer or the like to function as the processing unit 10 of the embodiment. [Explanation of symbols]

[0038] 1 Extraction means (extraction part) 2 Control means (control unit) DP display means S Display control device SS Navigation Device TP Touch Panel MK Hazard Switch Image MK2 Record button image

Claims

1. An extraction means for extracting danger voice indicating danger from the voice of a passenger of the vehicle; a control means for displaying, when the danger sound is extracted, at least one of i) a first operation image for activating a function of turning on a hazard lamp provided in the moving body, and ii) a second operation image for activating a function of recording at least image data of an image captured around the moving body, on a display means; A display control device comprising:

2. 2. The display control device according to claim 1, 13. A display control device according to claim 12, wherein the first operation image is an image of a hazard switch.

3. 2. The display control device according to claim 1, The display control device according to claim 1, wherein the second operation image is an image of a record button.

4. The display control device according to any one of claims 1 to 3, The moving object is a vehicle, A display control device, wherein the display means is provided in a portable device carried by a passenger of the vehicle.

5. The display control device according to any one of claims 1 to 4, the control means includes a determination means for determining whether or not to cause the display means to display the operation image based on a strength of a ending of the extracted danger sound, The display control device is characterized in that the control means causes the display means to display the operation image when it is determined that the operation image is to be displayed.

6. The display control device according to any one of claims 1 to 5, The display control device is characterized in that the control means terminates the display of the operation image when no operation is performed on the operation image within a predetermined time corresponding to the function from the start of display of the operation image.

7. A display control method executed in a display control device including an extraction means and a control means, an extraction step of extracting a danger voice indicating danger from a voice of a passenger of the vehicle by the extraction means; a control step of causing the control means to display, when the danger sound is extracted, at least one of i) an operation image for activating a function of turning on a hazard lamp provided in the moving body, and ii) an operation image for activating a function of recording at least image data of an image captured around the moving body, on the display means; A display control method comprising:

8. Computer, An extraction means for extracting danger voice indicating danger from the voice of a passenger of the vehicle; and a control means for displaying, when the danger sound is extracted, at least one of i) an operation image for activating a function of turning on a hazard lamp provided in the moving body, and ii) an operation image for activating at least a function of recording image data of an image captured around the moving body, on a display means; A display control program that causes the display control program to function as a display control program.

Images