Display control system, method, computer readable storage medium, and computer program product

Abstract

The invention provides a display control system and method, a computer readable storage medium and a computer program product, which are beneficial to improving the traffic safety. This display control system is a display control system for a moving body provided with: a sound source device that guides sound to the moving body; a display device capable of displaying information indicating an external environment around the moving body; and the control device is used for processing sound information guided by sound to be output by the sound source device so as to obtain a signal waveform of the sound information, and controlling the display device so that a display mode to be output by the display device is tuned with the obtained signal waveform.

Description

Technical Field

[0001] The present invention relates to a display control system, a method, a computer-readable storage medium and a computer program product. Background Art

[0002] In recent years, efforts have been actively made to provide a sustainable transportation system that takes further safety into consideration, and in order to achieve this goal, research and development of preventive safety technology is being conducted.

[0003] For example, some vehicles are equipped with a display device that can display position information of objects (pedestrians, other vehicles, etc.) around the vehicle (Patent Documents 1-2). With such a structure, it is easy for the driver to recognize the existence of objects around the vehicle, and the vehicle can be driven in an appropriate manner.

[0004] Prior art literature Patent Literature Patent Document 1: International Publication No. 2022 / 190630 Patent Document 2: Japanese Patent Application Publication No. 2016-197407 Summary of the invention Problems to be solved by the invention Generally, there is a need for a technology that can further improve traffic safety by making the driving style more appropriate. The same can be said for a moving body without wheels.

[0005] The invention has as an exemplary object to increase traffic safety and thus to contribute to the development of sustainable transport systems.

[0006] Means used to solve problems One aspect of the present invention relates to a display control system, which is a display control system for a mobile body, wherein the mobile body comprises: a sound source device, which performs sound guidance for the mobile body; a display device, which can display information representing the external environment around the mobile body; and a control device, characterized in that the control device processes sound information of the sound guidance to be output by the sound source device to obtain a signal waveform of the sound information, and controls the display device so that the display mode to be output by the display device is tuned with the acquired signal waveform.

[0007] The second aspect of the present invention relates to a method, which is a method for performing display control of a display device in a mobile body, wherein the mobile body comprises: a sound source device, which performs sound guidance for the mobile body; and a display device, which can display information representing the external environment around the mobile body, characterized in that the method includes: a step of processing sound information of the sound guidance to be output by the sound source device to obtain a signal waveform of the sound information; and a step of controlling the display device so that the display mode to be output by the display device is tuned with the acquired signal waveform.

[0008] The third aspect of the present invention relates to a computer-readable storage medium, which stores a computer program, and is characterized in that when the computer program is executed by a processor, the steps of the method described in technical solution 17 are implemented.

[0009] The fourth aspect of the present invention relates to a computer program product, which includes a computer program and is characterized in that when the computer program is executed by a processor, the steps of the method described in technical solution 17 are implemented.

[0010] Effects of the Invention According to the present invention, traffic safety can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 It is a diagram showing the structure of a vehicle according to the embodiment.

[0012] Figure 2 It is a schematic diagram showing the relative positions of various elements of the vehicle.

[0013] Figure 3 This is a flowchart showing an example of control content by the control device.

[0014] Figure 4A This is a schematic diagram showing an example of a driving method of a display device and a sound source device.

[0015] Figure 4B This is a schematic diagram showing an example of a driving method of a display device and a sound source device.

[0016] Figure 4C This is a schematic diagram showing an example of a driving method of a display device and a sound source device.

[0017] Figure 5 FIG. 1 is a diagram showing examples of icons used in a display device.

[0018] Figure 6 FIG. 1 is a diagram showing an example of a tuning display of icons used in a display device.

[0019] Figure 7 This is a flowchart showing an example of control content by a control device for realizing tuning display.

[0020] Figure 8 An example of a signal waveform that can be generated by filtering processing is shown.

[0021] Fig.9A This is a diagram showing an example of a driving method for tuning display.

[0022] Fig. 9B This is a diagram showing an example of a driving method for tuning display.

[0023] Fig. 9C This is a diagram showing an example of a driving method for tuning display.

[0024] Fig.9D This is a diagram showing an example of a driving method for tuning display.

[0025] Fig.9E This is a diagram showing an example of a driving method for tuning display.

[0026] Fig.10 This is a schematic diagram showing an example of a driving method of a display device and a sound source device.

[0027] Fig.11 This is a flowchart showing an example of control content by a control device for realizing tuning display.

[0028] Description of Reference Numerals 1: vehicle (moving body); 14: window member; 17: display device; 18: sound source device; 19: control device; OB: object. DETAILED DESCRIPTION

[0029] Hereinafter, the embodiments are described in detail with reference to the accompanying drawings. It should be noted that the following embodiments do not limit the invention involved in the technical solution. In addition, not all of the feature combinations described in the embodiments are necessary for the invention. Two or more of the multiple features described in the embodiments can be combined arbitrarily. In addition, the same or identical configurations are marked with the same reference numerals, and repeated descriptions are omitted.

[0030] (First embodiment) Figure 1 The structure of the vehicle 1 according to the embodiment is shown. Figure 2 It is a schematic diagram for explaining the relative positions of the elements of the vehicle 1. The vehicle 1 includes wheels 11, a driver's seat 12, a driving operation device 13, a window member 14, a first detection device 15, a second detection device 16, a display device 17, a sound source device 18, and a control device 19.

[0031] In this embodiment, the vehicle 1 is a four-wheeled vehicle having a pair of left and right front wheels and a pair of left and right rear wheels as wheels 11, but the number of wheels 11 is not limited to this example. In addition, the vehicle 1 is a riding type vehicle in which a driver can sit in a driver's seat 12, but it can also be a straddle type vehicle having a seat for the driver to sit astride instead of the driver's seat 12.

[0032] In the figure, in order to facilitate the understanding of the structure, mutually orthogonal X-axis, Y-axis and Z-axis are shown (the same applies to other figures described later). The X direction corresponds to the front-to-back direction, the Y direction corresponds to the left-to-right direction, and the Z direction corresponds to the up-down direction. In this specification, expressions such as front / back, left / right (lateral), and up / down represent relative positional relationships based on the vehicle body. For example, expressions such as "front" and "front" correspond to the +X direction, and expressions such as "back" and "rear" correspond to the -X direction. Similarly, expressions such as the inside (inner side) of the vehicle body / the outside (outer side) of the vehicle body also represent relative positional relationships based on the vehicle body.

[0033] The driving operation device 13 includes an acceleration operating member 13a, a brake operating member 13b and a steering operating member 13c, which are respectively arranged near the driver's seat 12 so that the driver can approach it. The acceleration operating member 13a is configured to be able to receive an operation input from the driver for accelerating the vehicle 1 or maintaining driving. As a typical example, an accelerator pedal can be used. The brake operating member 13b is configured to be able to receive an operation input from the driver for decelerating or stopping the vehicle. As a typical example, a deceleration pedal can be used. The steering operating member 13c is configured to be able to receive an operation input from the driver for rotating the vehicle or changing the direction of travel. As a typical example, a steering wheel can be used. It should be noted that other well-known structures such as push-button switches and rotary levers can also be used in the operating members 13a~13c.

[0034] The window member 14 is a light-transmitting plate defining the inside and outside of the vehicle, and is disposed in the front portion of the vehicle 1, and in the present embodiment, is disposed in front of the driver's seat 12 and the driving operation device 13, so that the driver can visually recognize the appearance outside the vehicle from inside the vehicle through the window member 14. The window member 14 can be described as a windshield, etc., but can also be described as a front window, etc.

[0035] The first detection device 15 detects the external environment around the vehicle 1 (in order to distinguish it from the detection device 16 described later, it is expressed as the external environment detection device 15.). The external environment mentioned here refers to the external environment that the driver needs to recognize when driving the vehicle 1, which can be broadly interpreted as including the external environment directly / indirectly related to the driver's driving operation. As examples thereof, the surrounding environment of the vehicle indicating the existence of objects around the vehicle 1, the road environment indicating the existence of intersections and road facilities (signals, road signs, etc.), etc. can be listed. In addition, as examples of objects, pedestrians, other vehicles, etc., and other obstacles that should avoid contact with the vehicle can be listed.

[0036] In the following description, an object is exemplified as a typical element of the external environment to be detected, but it may also be an intersection or a road installation. In this specification, they may be expressed as "objects, etc." when no particular distinction is required.

[0037] The external environment detection device 15 may typically use a camera composed of a CCD / CMOS image sensor, or may use a plurality of cameras to detect the state of the periphery of the vehicle 1, or may use an omnidirectional camera. The external environment detection device 15 monitors the state of the periphery of the vehicle 1, and thus may be described as a periphery monitoring device, or may simply be described as a monitoring device, or the like.

[0038] The second detection device 16 detects the driver sitting in the driver's seat 12 and his posture (in order to distinguish it from the aforementioned detection device 15, it is expressed as a driver detection device 16). A camera can be typically used as the driver detection device 16. The driver detection device 16 monitors the appearance of the driver, so it can be expressed as a driver monitoring device, etc., or it can also be simply expressed as a monitoring device, etc.

[0039] The display device 17 is extended in the left-right direction in a manner corresponding to the width of the window member 14. In the present embodiment, the display device 17 can be extended in a strip shape below the window member 14 along the lower edge of the window member 14. Typically, such a strip-shaped display device 17 is arranged on a dashboard including an instrument panel close to the window member 14 side in a manner that the driver can visually recognize it.

[0040] The display device 17 has light source elements such as organic EL and LED arranged along a display range extending in the left-right direction together with its frame, thereby being able to display position information of objects and the like around the vehicle 1. The display method based on the display device 17 can be changed based on the detection result of the external environment detection device 15, as will be described in detail later.

[0041] In the present embodiment, a plurality of sound source devices 18 are provided inside the vehicle 1, but a plurality of sound source devices 18 may be provided around the driver's seat 12. Figure 2 In the example of FIG. 1 , a total of six sound source devices 18 are arranged, namely, a pair of left and right sound source devices 181L and 181R, sound source devices 182L and 182R, and sound source devices 183L and 183R. For example, on the left side, the sound source device 181L, the sound source device 182L, and the sound source device 183L may be arranged in order from the front to the back, and on the right side, the sound source device 181R, the sound source device 182R, and the sound source device 183R may be arranged in order from the front to the back.

[0042] The details will be described later. The sound source device 18 is configured to notify the position information of objects and the like around the vehicle 1 by emitting one or more sounds, and the generation method thereof can be changed based on the detection result of the external environment detection device 15 .

[0043] It should be noted that the display device 17 and the sound source device 18 have a function of notifying the driver of position information of an object, etc., and therefore may be collectively described as a notification device, or may be separately described as a first notification device and a second notification device.

[0044] The control device 19 is configured to be able to control various elements included in the vehicle 1 , and in the present embodiment, mainly controls the display device 17 and the sound source device 18 based on the detection results of the external environment detection device 15 and the driver detection device 16 .

[0045] The control function of the control device 19 is realized by a CPU (central processing unit) developing and executing a predetermined program on a memory, but may also be realized by a semiconductor device such as an ASIC (application specific integrated circuit). That is, the control function of the control device 19 may be realized by either hardware or software.

[0046] Figure 3 1 is a flowchart showing an example of control content by the control device 19 (for the sake of ease of explanation, the description is given here for the case where an object is detected by the external environment detection device 15, but the same applies to the case where an object other than the object is detected.). The summary is that when an object is detected by the external environment detection device 15, the display device 17 and the sound source device 18 notify the position information of the object in a manner corresponding to the detected position of the object. This flowchart can be started when the vehicle 1 is started, but can also be executed based on the switching of the notification function on / off, and can also be executed when other predetermined conditions are met.

[0047] In step S3000 (hereinafter referred to as "S3000". The same applies to other steps described later), it is determined whether there is an object around the vehicle 1 based on the detection result of the external environment detection device 15. In the present embodiment, it is stipulated that when an object is detected within a reference range from the vehicle 1, it is determined that there is an object around the vehicle 1. The reference range is a range that requires the driver's attention, and can also be referred to as the detection object range of the object based on the external environment detection device 15 (hereinafter referred to as the "detection object range").

[0048] For example, a camera can be generally used in the external environment detection device 15, and when an object is not only included in the image data obtained by the camera but also the distance to the object is less than the reference, it is determined that the object exists around the vehicle 1. Therefore, the external environment detection device 15 has a distance measurement function, and typically a multi-eye camera can be used, but other distance measurement devices such as millimeter wave radar and LiDAR (Light Detection And Ranging) can also be used instead of / in addition.

[0049] Although the details will be described later, the detection target range of the object by the external environment detection device 15 may be different depending on the X direction or the Y direction with respect to the vehicle 1 .

[0050] If it is determined that there is an object around vehicle 1 (the object is within the detection target range), the process proceeds to S3010 . If it is determined that there is no object around vehicle 1 , the process returns to S3000 .

[0051] In S3010, the relative position of the object detected by the external environment detection device 15 relative to the vehicle 1 is determined. In this embodiment, the distance from the vehicle 1 to the object in the X direction and / or the Y direction is determined, and information representing the relative position is generated as a relative position signal SIG1.

[0052] In S3020, the posture of the driver is determined based on the detection result of the driver detection device 16. In this embodiment, the position of the driver's head (mainly eyes) in the vehicle 1 is determined, and information representing the posture of the driver is generated as a driver posture signal SIG2.

[0053] In S3030, based on the relative position of the object and the driver's posture, it is determined whether the object is located at a position that the driver can visually recognize through the window member 14. This determination can be performed by arithmetic processing based on the relative position signal SIG1 and the driver's posture signal SIG2. If the object can be visually recognized, the process proceeds to S3040, and if the object cannot be visually recognized, the process proceeds to S3050.

[0054] In S3040 (when it is determined that the object can be visually recognized), the control signal CNT1 is output and the drive control of the display device 17 is performed.

[0055] Although the details will be described later, the control signal CNT1 is generated based on the relative position signal SIG1 and the driver posture signal SIG2 .

[0056] In S3050 (when it is determined that the object cannot be visually recognized), the control signal CNT21 is output to control the drive of the display device 17 , and the control signal CNT22 is output to control the drive of the sound source device 18 .

[0057] Although the details will be described later, the control signal CNT21 and the control signal CNT22 are generated based on the relative position signal SIG1 and the driver posture signal SIG2 .

[0058] Here, in the following description, whether or not the driver can visually recognize the object through the window member 14 may be simply expressed as “can visually recognize” or “cannot visually recognize”.

[0059] Figure 4A to Figure 4C Some examples of driving methods of display device 17 and sound source device 18 when object OB is detected by external environment detection device 15 (when determination is “YES” in S3000 ) are shown.

[0060] Figure 4A This indicates that the object OB that can be visually recognized by the driver DR is detected by the external environment detection device 15 (a case where it is determined as YES in S3030 ).

[0061] Figure 4B This indicates that the object OB that cannot be visually recognized by the driver DR is detected by the external environment detection device 15 (a NO determination in S3030 ) and the object OB is located on the left side of the vehicle 1 .

[0062] Figure 4C This indicates that the object OB that cannot be visually recognized by the driver DR is detected by the external environment detection device 15 (a “NO” determination in S3030 ) and the object OB is located behind the right side of the vehicle 1 .

[0063] It should be noted that the dotted line in the figure represents the detection target range R based on the external environment detection device 15. As an example, the detection target range R is set wider in front of the vehicle 1 than in the rear of the vehicle 1, and is set narrower on both sides of the vehicle 1. In addition, some elements are not shown in the figure for easy viewing of the drawings.

[0064] exist Figure 4AIn the example of FIG. 1 , the driver DR can visually recognize the object OB detected by the external environment detection device 15 through the window member 14. Therefore, the display device 17 displays the position information of the object OB by the icon CON1 based on the control signal CNT1.

[0065] Here, the icon CON1 is displayed at a position corresponding to the object OB, and in the strip-shaped display device 17 involved in the present embodiment, the display position of the icon CON1 is preferably consistent with the object OB in the vertical direction of the driver DR's line of sight. In the case of this example, when viewed from above, the icon CON1 is displayed at a position on the dotted arrow indicating the line of sight direction.

[0066] The display position of the icon CON1 can be calculated based on the relative position signal SIG1 and the driver posture signal SIG2. The control signal CNT1 can be generated based on the relative position signal SIG1 and the driver posture signal SIG2.

[0067] exist Figure 4B In the example shown in FIG. 2 , the object OB detected by the external environment detection device 15 is located to the left of the window member 14 (outside the window member 14) in the sight line of the driver DR, so the driver DR cannot visually recognize the object OB through the window member 14. Therefore, the display device 17 displays the position information of the object OB through the icon CON2L based on the control signal CNT21.

[0068] Such an icon CON2L is displayed at one of the two ends of the strip-shaped display device 17 corresponding to the object OB (here, the left end) as indicating that the object OB is located outside the window member 14. The control signal CNT21 can be generated based on the relative position signal SIG1 and the driver posture signal SIG2.

[0069] Incidentally, the plurality of sound source devices 18 are selectively driven based on the control signal CNT22, and specifically, a portion (one or more) of the sound source devices 18 corresponding to the relative position of the object OB is driven. Here, the sound source device 18 to be driven only needs to allow the driver DR to recognize the relative position of the object OB (especially the direction in which the object OB exists, i.e., the relative direction) through the sound emitted by the sound source device / devices, that is, the sound source device 18 that can achieve this is selected from the plurality of sound source devices 18 and driven. In the present embodiment, the sound source device 181L and the sound source device 182L are driven.

[0070] The driving force (volume, sound range, etc.) of the sound source device 18 to be driven is individually adjusted based on the relative position of the object OB. The control signal CNT22 can be generated based on the relative position signal SIG1 and the driver posture signal SIG2.

[0071] For example, in the present embodiment, in the sound source device 181L and the sound source device 182L that are driven, it is possible to express in detail where the object OB is located on the left side of the vehicle 1 by increasing the driving force of one and decreasing the driving force of the other, or making the driving forces of both equal, etc. In addition, it is possible to express that the object OB is approaching the vehicle 1 by increasing the driving force of the sound source device 18, and it is possible to express that the object OB is moving away from the vehicle 1 by decreasing the driving force.

[0072] It should be noted that, in the present embodiment, a case where a plurality of sound source devices 18 are used is described, but a single sound source device 18 may be used as long as a directional structure capable of recognizing the relative position of the object OB is adopted.

[0073] exist Figure 4C In the example shown in FIG. 2 , the object OB detected by the external environment detection device 15 is located to the right of the window member 14 (outside the window member 14) in the sight line of the driver DR, so the driver DR cannot visually recognize the object OB through the window member 14. Therefore, the display device 17 displays the position information of the object OB through the icon CON2R based on the control signal CNT21.

[0074] The icon CON2R is displayed on one of the two ends of the strip-shaped display device 17 that corresponds to the object OB (here, the right end).

[0075] Incidentally, a part (one or more) of the plurality of sound source devices 18 corresponding to the relative position of the object OB is driven based on the control signal CNT22. In the present embodiment, it is assumed that the sound source device 182R and the sound source device 183R are driven.

[0076] The icon CON1, the icon CON2L, and the icon CON2R preferably have visually different shapes from each other. Their shapes are not limited to Figure 4A to Figure 4C The example shown in FIG. 1 may be any shape that can be easily visually recognized by the user including the driver DR. Figure 5 Other icons may be selected from the multiple patterns shown and used. Alternatively, multiple patterns shown here may be used in combination, or other known icons may be used instead of or in addition to them.

[0077] The icons CON2L and CON2R may be displayed in mutually symmetrical shapes, but their size, color depth, and other parameters indicating the degree of emphasis may be changed according to the relative position of the object OB. Figure 4B In the case of , the icon CON2L may be displayed in a shape that becomes increasingly elongated as the position of the object OB on the left side of the vehicle 1 moves rearward.

[0078] The drive control of the display device 17 and the sound source device 18 by the control device 19 is continuously executed. Therefore, when the relative position of the object OB changes due to the movement of the object OB, the drive mode of the display device 17 and the sound source device 18 can be adjusted and changed to follow the change. Similarly, when the posture (position of the head) of the driver DR on the driver's seat 12 changes, the drive mode of the display device 17 and the sound source device 18 can be adjusted and changed to follow the change.

[0079] The above-mentioned drive control based on the control device 19 can also be executed based on the switching of the notification function on / off. Alternatively, when the vehicle 1 has a driving assistance function (a function in which the on-board ECU (electronic control unit) performs part / all of the acceleration operation, braking operation and steering operation instead of the driver DR), the above-mentioned drive control can be executed in the manual driving mode and suppressed in the driving assistance mode.

[0080] According to the above-described structure, when the object OB can be visually recognized through the window member 14, the position information of the object OB is displayed in a first manner (here, by the icon CON1) at the position corresponding to the object OB in the display device 17. On the other hand, when the object OB cannot be visually recognized, the position information of the object OB is displayed in a second manner (here, by the icon CON2L or the icon CON2R) at one of the two ends of the display device 17 corresponding to the position of the object OB (the left end or the right end).

[0081] According to the above configuration, the driver DR can appropriately recognize the existence of the object OB around the vehicle 1 , and can make the driving style of the vehicle 1 more appropriate.

[0082] When the object OB cannot be visually recognized, the existence of the object OB is further notified through the sound source device 18 in a manner indicating the relative position of the object OB, thereby allowing the driver DR to further appropriately recognize the existence of the object OB around the vehicle 1 .

[0083] In order to appropriately achieve the above-mentioned effects, a system may be adopted that selects or combines some of the elements provided by the vehicle 1. For example, as the vehicle-mounted system, a display control system provided with a display device 17 and a control device 19 may be adopted. The vehicle-mounted system may further include a sound source device 18, and may further include a driving operation device 13, a window member 14, an external environment detection device 15, and / or a driver detection device 16 instead of or in addition to the driving operation device 13.

[0084] In addition, the sound source device 18 is capable of providing voice guidance for the vehicle 1. In the present embodiment, voice guidance is provided for driving guidance of the vehicle 1. Voice guidance only needs to inform the driver of the external environment that the driver needs to recognize when actually performing driving operations, or the external environment that is recommended to be paid attention to by the driver. Examples of voice information based on voice guidance include "Turn right at that intersection.", "Turn left at the next signal.", "There is an oncoming vehicle. Please pay attention.", etc., which can be composed of sounds in a predetermined language. The sound information can be formed by sound data generated by sound synthesis, or by sound data generated by analog-to-digital conversion after recording. Such sound information is processed in the sound source device 18 so that the driver can perform digital-to-analog conversion by auditory recognition and output it as sound.

[0085] In the above example, the intersection, traffic lights, and oncoming vehicles are shown as objects that the driver needs to recognize. Figure 4A As described above, the position information is displayed on the display device 17 by the icon CON1 or the like.

[0086] On the other hand, in order to enable the driver to properly recognize the notification content of the voice guidance, or to prevent the driver from missing the voice guidance or being confused by sounds different from the voice guidance (for example, typically the driving sound of the vehicle 1, conversations between passengers, the sound of a media player, the radio, etc., but it can also be other sounds), it is possible to consider tuning the above-mentioned display based on the display device 17 to the voice guidance so that it is visually prominent.

[0087] The tuning mentioned here includes the case where the above-mentioned display mode based on the display device 17 (in the following description, it can be expressed as "the display mode of the display device 17", or simply expressed as "the display mode") is dynamically added to the sound information of the sound guidance. As an example, the brightness, color, shape and / or size of the icon CON1, etc. can be changed. Alternatively / in addition, the icon CON1, etc. can be swung, for example, the display position of the icon CON1, etc. can be moved back and forth up and down. Further alternatively / in addition, other displays can be added to the icon CON1, etc., for example, a radial pattern can be additionally displayed on the periphery of the icon CON1, etc.

[0088] The display mode accompanied by tuning with voice guidance as described above can be expressed as "tuning display".

[0089] Figure 6 Indicates that Figure 5 2 shows multiple examples of tuning display of the icon CON1 (■ mark) of pattern #01 illustrated in FIG.

[0090] The pattern #01a shows how the brightness (for example, the display intensity indicating shade, lightness, or darkness) of the icon CON1 changes.

[0091] The pattern #01b shows how the color of the icon CON1 (for example, the ratio of the combination of red light, green light, and blue light) changes.

[0092] The pattern #01c shows how the shape of the icon CON1 changes (for example, from a quadrilateral shape to another shape).

[0093] The pattern #01d shows how the size of the icon CON1 (for example, the length in the up-down direction and the left-right direction) changes.

[0094] The pattern #01e shows that the icon CON1 is swinging (eg, moving up and down).

[0095] The pattern #01f shows a state where a radial pattern is additionally displayed as another display on the icon CON1 (for example, on the outer periphery of the icon CON1).

[0096] It should be noted that the tuning display mode may be any mode that is visually easy for users including the driver to recognize intuitively, and may be set by the user by selecting in advance from a plurality of patterns including this example. The setting screen is preferably displayed by animation.

[0097] The above example is about icon CON1, and the same can be said about other icons CON2L, etc. In addition, for the sake of ease of explanation, the following describes the case of setting pattern #01a, that is, the case of changing the brightness of icon CON1 in accordance with the sound information of the sound guide by the control signal CNT1.

[0098] Figure 7 The flowchart is a flowchart showing an example of the control contents of the control device 19 for realizing the above-mentioned tuning display. In summary, the sound source device 18 processes the sound information of the corresponding sound guidance output, and changes the display mode of the icon CON1 based on the display device 17 based on the signal waveform obtained thereby. Figure 3 The process Figure 1 The same is executed, and is mainly executed for the generation of the control signal CNT1 (the control signal CNT21 in the case of the icon CON2L, etc.).

[0099] In S7000, it is determined whether the output of the voice guidance by the sound source device 18 is necessary. If the output of the voice guidance is necessary, the process proceeds to S7010, and if the output of the voice guidance is not necessary, the process returns to S7000. The determination of whether the output of the voice guidance by the sound source device 18 is necessary is also shown as another example in the second embodiment described later, and can be performed based on the fact that the importance of the notification to the driver for the external environment corresponding to the icon CON1 is increased.

[0100] In S7010, the sound information (the sound data thereof) of the sound guidance to be output by the sound source device 18 is acquired. The sound information may be acquired by reading from a memory built into the control device 19, or may be acquired by reading from another memory other than the control device 19.

[0101] In S7020, filtering processing is performed on the sound information acquired in S7010, for example, signal processing using a low-pass filter is performed to generate a signal waveform of an envelope sound signal.

[0102] Figure 8 The figure shows an example of a signal waveform that can be generated by filtering using a low-pass filter. The sound data WD1 before filtering contains high-frequency components caused by timbre and sound quality, and the boxes WV1a~WV1m in the figure correspond to multiple sounds composed of vowels and / or consonants in the sound data WD1 (for example, the sounds that constitute the sound information "Turn right at that intersection."). According to the filtering process of this example, by removing the above-mentioned high-frequency components, a signal waveform that substantially envelops the original sound data WD1 can be obtained as sound data WD2. Therefore, the sound data WD2 after filtering substantially represents the sounds WV1a~WV1m composed of vowels and / or consonants. It should be noted that in the above-mentioned low-pass filter, for example, a low-pass filter that can pass low-frequency components of 10±5Hz can be used.

[0103] Refer again Figure 7 In S7030, the signal waveform of the sound data WD2 acquired in S7020 is analyzed, and the driving method and driving timing for tuning the display method of the display device 17 to the signal waveform are determined.

[0104] Figure 9A to Figure 9D 1 and 2 show a plurality of examples of driving methods for tuning display that can be determined based on the sound data WD2. In each figure, the signal waveform of the sound data WD2 and the brightness of the icon CON1 ( Figure 6 The driving signal SIG corresponding to the pattern #01a) DRV For example, if the drive signal SIG DRVIf the value of the driving signal SIG is high, the icon CON1 is displayed with high brightness (output in a manner that makes the display prominent). DRV A low value causes the icon CON1 to be displayed with low brightness (the display is suppressed or not displayed).

[0105] exist Fig.9A In the example, the display mode is tuned to the signal value in the signal waveform in the sound data WD2, that is, the drive signal SIG DRV The signal waveform of the sound data WD2 is substantially consistent with the signal waveform of the sound data WD2. The signal value in the signal waveform of the sound data WD2 can typically correspond to the volume (volume). Therefore, by tuning the display mode to the temporal change of the volume, in this example, the brightness of the icon CON1 changes with the volume of each sound, for example, there is a flickering of the icon CON1.

[0106] exist Fig. 9B In the example, the display mode is tuned to the time when the signal value in the signal waveform of the sound data WD2 becomes less than the reference, that is, the display of the icon CON1 is suppressed when the volume becomes less than the reference. Thus, for example, when the period when the volume does not meet the reference continues for a predetermined time (for example, 20 milliseconds) or more, the icon CON1 flashes, and the display can be tuned in accordance with the syllable, beat, etc.

[0107] exist Fig. 9C In the example, the drive signal SIG is set to 0 before the start of tuning and after the completion of tuning for a predetermined period Ta and a predetermined period Tb respectively. DRV The icon CON1 is set to a low value and is set to be non-displayed or the brightness is set to be below the reference. In the period Ta and the period Tb, a period that does not cause discomfort to the driver can be set, for example, a value in the range of 100 to 500 milliseconds is set, preferably 300 milliseconds. Thus, the start of the voice guidance is appropriately synchronized with the start of the tuning display, and the completion of the voice guidance is appropriately synchronized with the completion of the tuning display, so that the driver can feel that the overall tuning display according to the voice guidance is being performed.

[0108] In the synchronization described above, as long as the sound guide and drive signal SIG in the output DRV The switching of the signal value can be distinguished, so if there is a sufficient time interval in the distinction, the above period Ta and / or period Tb can be omitted. That is, in the case of this example, Fig.9D As illustrated, only the period Ta of the period Ta and the period Tb may be provided.

[0109] exist Fig.9EIn the example, the start timing of tuning is delayed by a predetermined time Tc from the start timing of voice guidance. In the period Tc, a period that does not cause discomfort to the driver is set, for example, a value in the range of 100 to 500 milliseconds, preferably 200 milliseconds. This can prevent the flashing of the icon CON1 from unexpectedly (suddenly to the driver) starting and placing an unnecessary burden on the driver.

[0110] The driving method for the tuning display as described above may be set by the user by selecting in advance from a plurality of patterns including the above examples.

[0111] Refer again Figure 7 In S7040, the drive mode determined in S7030 (refer to Figure 9A to Figure 9D ) generates a control signal CNT1 in a manner that changes the display mode of the display device 17 and outputs it to the display device 17. Thereby, it is possible to realize the tuning display of the icon CON1 accompanied by the tuning with the voice guidance.

[0112] The above situation is also the same when the icon CON2 and the like are tuned and displayed by the control signal CNT21.

[0113] In this way, the control device 19 processes the sound information of the sound guidance to be output by the sound source device 18 to obtain a signal waveform, and controls the display device 17 so that the display mode to be output by the display device 17 is tuned with the signal waveform, thereby realizing a tuned display. According to the above-mentioned drive control, the external environment that the driver should recognize is notified to the driver together with the sound guidance based on the sound source device 18 through the dynamic display mode based on the display device 17, and the driver can further appropriately recognize the external environment. Therefore, according to this embodiment, it can be said that it is conducive to further improving traffic safety.

[0114] (Second embodiment) In the first embodiment, for ease of understanding, the case where one icon CON1, etc. is displayed on the display device 17 is illustrated, but it is also possible to consider the case where there are two or more elements of the external environment to be notified to the driver and two or more icons CON1, etc. are displayed. In this case, if all of the two or more icons CON1, etc. are tuned and displayed, it is difficult to know which situation the notification content of the voice guidance represents, which may cause confusion to the driver. Therefore, in the second embodiment, priorities are set for the two or more elements that are the notification objects, and the elements whose priorities meet the criteria are tuned and displayed together with the voice guidance.

[0115] Fig.10 and Figure 4ASimilarly, a schematic diagram of the vehicle 1 in which another vehicle OBa and an intersection OBb, two elements of the external environment to be notified to the driver, are detected by the environment detection device 15 is shown. In the figure, it is stipulated that the other vehicle OBa is an oncoming vehicle and intends to enter the parking area P1 in front of the vehicle 1, and the vehicle 1 intends to go straight toward the intersection OBb further ahead. It is stipulated that in the display device 17, a total of two icons CON1, namely, an icon CON1a corresponding to the other vehicle OBa and an icon CON1b corresponding to the intersection OBb, are displayed.

[0116] In such a state, it is conceivable that the sound information based on the voice guidance is not the content of notifying the existence of the intersection OBb but the content of notifying the existence of another vehicle OBa (as an example, the sound source device 18 outputs the sound information consisting of the sound "There is an oncoming vehicle. Please pay attention."). In such a case, the icon CON1a becomes the object of the tuning display out of the icon CON1a and the icon CON1b. Fig.10 In the display of the icon CON1a, there is flickering, and the display of the icon CON1b shows that the lighting state is maintained.

[0117] In the present embodiment, the driver may be informed of the sound information related to the icon CON1a. Therefore, in the vehicle body structure of the present embodiment, only the sound source device 181R and / or the sound source device 182R near the driver's seat 12 may be driven among the plurality of sound source devices 181L, 181R, 182L, 182R, 183L, and 183R, or other sound source devices may be driven incidentally.

[0118] Fig.11 This is a flowchart showing an example of control contents by the control device 19 for realizing the tuning display involved in this embodiment. The outline thereof is that when there are two or more elements to be displayed by the display device 17 in the external environment (i.e., when there are two or more icons CON1, etc. displayed), priorities are set for them, and tuning display is performed for the corresponding elements together with the voice guidance based on the set priorities. Figure 7 Similarly, this flowchart can be used with Figure 3 The process Figure 1 Executed together.

[0119] In S11010, it is determined in the display device 17 whether the number of elements to be displayed is more than two by means of the icon CON1 or the like. Here, in the strip-shaped display device 17 in the present embodiment, more than two icons CON1 can be displayed. On the other hand, the icon CON2L or the icon CON2R is displayed at the end of the display device 17. Therefore, for example, when there are more than two objects that cannot be visually recognized through the window member 14 on the left side (or right side) of the vehicle body, they are collectively displayed as one icon CON2L (or icon CON2R). Therefore, in this step, it is not the number of icons that is determined, but whether the number of display objects (or the elements corresponding thereto) is more than two. If the number of display objects is more than two, the process proceeds to S11020, and if the number of display objects is not more than two, the process returns to S11010.

[0120] In S11020, priorities are set (updated in the case of the second or later display) for two or more display objects. In this priority, an initial value and an added value of the priority are pre-set for each scene, for example, In order to make the driver recognize only the existence of the intersection, "1" is set as the initial value. If you plan to turn left or right at the intersection, and the distance to the left or right turn is less than the reference, add "+3". In order to make the driver recognize only the presence of the oncoming vehicle, "2" is set as the initial value. For the oncoming vehicle, when the inter-vehicle time interval with vehicle 1 is equal to or less than the reference time interval, "+3" or more is added (it should be noted that the added value can be determined based on the inter-vehicle time interval).

[0121] In the above example, the priority set for the display corresponding to the intersection is "1" or "4", and the priority set for the display corresponding to the oncoming vehicle is "2" or "5" or above. The priority can be set similarly for other objects.

[0122] In S11030, it is determined whether the priority of each display object satisfies a criterion. The criterion is set to "3", for example. If any priority satisfies the criterion, the process proceeds to S11040, and if any priority does not satisfy the criterion, the process returns to S11010.

[0123] In S11040, it is determined whether there are two or more display objects satisfying the priority criteria. If there are two or more display objects satisfying the priority criteria, the process proceeds to S11050, and if there are not two or more display objects satisfying the priority criteria (if there is only one display object), the process proceeds to S11060.

[0124] In S11050, a display object with a higher priority is selected from two or more display objects whose priorities satisfy a reference.

[0125] In S11060 , for the element corresponding to the display object satisfying the priority standard (the display object selected in S11050 when entering this step from S11050 ), sound information corresponding to the output requiring sound guidance by the sound source device 18 is acquired.

[0126] It should be noted that the sound information may include, for example, a sound such as "Turn right at that intersection" in the case of an intersection, and may include a sound such as "There is an oncoming vehicle. Please be careful." in the case of an oncoming vehicle.

[0127] In S11070, the filtering process for the sound information, the analysis of the signal waveform obtained thereby, and the determination of the driving method for realizing the tuning display are respectively performed in the same order as S7020 to S7040, and the tuning display is performed. After the output of the sound information and the tuning display are completed, the process returns to S11010. Thus, when there are two or more display objects, the display object with a high priority is selectively tuned and displayed together with the sound guidance.

[0128] According to the present embodiment, a priority is set for each element to be displayed by the display device 17 in the external environment. When the priority satisfies the reference, the display mode is changed together with the voice guidance for the corresponding display object, thereby performing a tuning display. In addition, in the case where there are two or more elements whose priorities meet the reference, such as the case where both the oncoming vehicle and the intersection are close to the vehicle 1, a tuning display is performed for the one with the higher priority, and during this period, the tuning display for the other is suppressed. Furthermore, before and / or after the tuning display for the element with the higher priority, the tuning display for the other element is preferably suppressed for a predetermined period (e.g., 200 to 300 milliseconds) for one of the purposes of preventing the driver from being confused.

[0129] Furthermore, when the priority meets the criteria, the notification is often of high importance to the driver, so in this case, the voice guidance based on the sound source device 18 may be output at a variable speed (for example, 1.5 times). In addition, when there are two or more display objects that meet the priority criteria, it is necessary to output the voice guidance continuously, so in this case, the voice guidance may be output at a variable speed. As another embodiment, for example, other voice information of shorter sentences such as "turn right!" and "oncoming vehicle!" (other voice information that takes a shorter time to output based on the sound source device 18) may be used.

[0130] The contents of the above-described embodiments may be modified and altered without departing from the gist thereof, and may be applied in various forms as shown below.

[0131] (First Modification) The notification method of the object etc. by the display device 17 and the sound source device 18 can also be further changed based on the attributes of the object etc. For example, the display method (e.g., shape, color, etc.) of the icon CON1 etc. can be changed depending on whether the object etc. is a pedestrian or another vehicle, and the type of sound emitted by the sound source device 18 can be changed instead of or in addition.

[0132] The identification of the attribute of the object or the like can be achieved by performing a known image analysis on the object or the like detected by the external environment detection device 15 in S3000 .

[0133] (Second Modification) In the embodiment, a method of changing the drive control of the display device 17 and the sound source device 18 based on whether the driver can visually recognize the object through the window member 14 is exemplified. However, the content of the embodiment can also be applied to a vehicle that does not have the window member 14. As an example, a straddle-type two-wheeled vehicle or the like, a vehicle in which the driver can actually directly (for example, in the form of an additional element that can be determined by the driver, such as sunglasses) visually recognize the object can be cited.

[0134] In this case, the state in which the object, etc. can be visually recognized described in the embodiment corresponds to the state in which the relative position of the object, etc. is within the display range of the display device 17. Similarly, the state in which the object, etc. cannot be visually recognized corresponds to the state in which the relative position of the object, etc. is outside the display range of the display device 17.

[0135] In the case of a straddle-type two-wheeled vehicle, the display device 17 may be provided in a strip-shaped manner extending in the left-right direction, for example, along the handlebars, in front of the driver's seat 12 and the driving operation device 13. In the case of a straddle-type two-wheeled vehicle, the handlebar posture (direction relative to the vehicle body) can usually be arbitrarily changed by the driver, so the display position of the icon CON1 can be further adjusted based on the handlebar posture.

[0136] It should be noted that, here, a straddle-type two-wheeled vehicle is exemplified as a vehicle not including the window member 14 , but the contents of the embodiment can also be applied to other well-known vehicles such as a riding-type working machine and a small special vehicle.

[0137] (Other variations) In the structure illustrated in the embodiment, deformation and change can be applied within the scope of the main purpose, for example, part / all of the function of a certain element can be replaced by other elements that can directly / indirectly cooperate with the element. In addition, the expression representing the function can also be replaced by other equivalent expressions.

[0138] For example, part of the functions of the control device 19 may also be performed by the detection device 15 and the detection device 16. Specifically, in the embodiment, it is stipulated that a series of operations from "determining" the detection object by the detection device 15 and the detection device 16 to "generating" its position information are performed by the control device 19 ( Figure 3 However, part or all of the series of operations may also be implemented by the detection device 15 and the detection device 16. In this case, it can be said that the detection device 15 and the detection device 16 "acquire" the position information of the detection object, and thus can be referred to as an acquisition device.

[0139] The above-mentioned functions may be replaced by an external factor other than the vehicle 1 , and a typical example thereof is that the vehicle 1 obtains the result of the replacement by the external factor through predetermined wireless communication.

[0140] As an example of the above-mentioned situation of "obtaining" the position information of the detection object, the position information of the detection object is generated by a monitoring camera or other image processing device installed on the road, and the vehicle 1 can obtain the position information from the image processing device through road-to-vehicle communication. The monitoring camera is installed on road settings such as traffic lights and road signs, and the image processing device generates the position information based on the image data obtained by the monitoring camera and sends it to the vehicle 1.

[0141] As another example, the location information of the detection object may be generated in other vehicles traveling around the vehicle 1, and the vehicle 1 may also obtain the location information from other vehicles through inter-vehicle communication. Other vehicles may generate the location information based on cameras mounted thereon and transmit it to the vehicle 1. In addition, other vehicles may also be the object itself that is one of the detection objects.

[0142] As another example, the location information of the detected object may be generated in a server device at a remote location, and the vehicle 1 may obtain the location information from the server device through network communication. The server device obtains information about the surroundings of the vehicle 1 from other vehicles around the vehicle 1 and / or obtains information about the surroundings of the vehicle 1 detected by a surveillance camera installed on the road, thereby generating the location information and sending it to the vehicle 1.

[0143] In the above case, the detection device 15 and the detection device 16 of the vehicle 1 may be in other words an acquisition device, or the vehicle 1 may further include a communication device that is independent of the detection device 15 and the detection device 16 and is used to acquire position information through wireless communication.

[0144] (other) In the above description, in order to facilitate understanding, each element is shown with a name related to the function, but each element is not limited to the element having the content described in the embodiment as the main function, and may also be an element having its function auxiliary. Therefore, each element is not strictly limited to its description, and its description can be replaced by the same description.

[0145] With the same purpose, the expression “apparatus” may be replaced by “unit,” “component, piece,” “member,” “structure,” “assembly,” etc., or may be omitted or added.

[0146] In addition, in this specification, the vehicle 1 is illustrated as a typical example, but the content of the embodiment can also be applied to an object (such as a ship) that does not have wheels, that is, it can be said that it can be applied to various types of moving objects.

[0147] In addition, each expression used in this specification should be interpreted broadly within the range not departing from the gist of the invention.

[0148] (Summary of implementation methods) Several features exemplified in the embodiments are as follows.

[0149] [1] A display control system for a mobile body, the mobile body comprising: a sound source device that performs sound guidance for the mobile body; a display device that can display information representing an external environment around the mobile body; and a control device. It is characterized in that The control device processes the sound information of the sound guide to be output by the sound source device to obtain a signal waveform of the sound information, and controls the display device so that the display mode to be output by the display device is tuned with the obtained signal waveform.

[0150] According to the above features, the external environment that the driver should recognize is notified to the driver through a dynamic display method based on the display device together with the sound guidance based on the sound source device, and the driver can appropriately recognize the external environment. Therefore, it is helpful to improve traffic safety.

[0151] [2] The display control system according to [1], characterized in that: The tuning of the display mode that the display device should output includes at least one of a situation where the display brightness changes, a situation where the display color changes, a situation where the display shape changes, a situation where the display size changes, a situation where the display swings, and a situation where other displays are attached to the display.

[0152] According to the above feature, the adjustment of the display mode can be appropriately recognized visually, and the driver can further appropriately recognize the above external environment.

[0153] [3] The display control system according to [1] or [2], characterized in that: The control device processes the sound information through filtering.

[0154] According to the above feature, the display mode is adjusted at an appropriate frequency, and the driver can further appropriately recognize the external environment.

[0155] [4] The display control system described in any one of [1] to [3] above, characterized in that: The control device controls the display device so that the display mode to be output by the display device is tuned with the signal value in the acquired signal waveform.

[0156] According to the above-mentioned features, the display mode can be adjusted appropriately, and the driver can further appropriately recognize the above-mentioned external environment.

[0157] [5] The display control system described in any one of [1] to [4] above, characterized in that: The control device tunes the display mode to be output by the display device with the time change of the volume of the sound information based on the acquired signal waveform.

[0158] According to the above-mentioned features, the display mode can be adjusted appropriately, and the driver can further appropriately recognize the above-mentioned external environment.

[0159] [6] The display control system described in any one of [1] to [5] above, characterized in that: The control device adjusts the display mode to be output by the display device and the timing when the volume of the sound information becomes equal to or lower than a reference value based on the acquired signal waveform.

[0160] The tuning is based on syllables and beats, for example, when the volume of the sound information does not meet the reference for a period of time exceeding a predetermined time, the display mode is changed in the form of flashing. According to the above feature, the display mode can be properly tuned, and the driver can further properly recognize the above external environment.

[0161] [7] The display control system described in any one of [1] to [6] above, characterized in that: The control device delays the timing of starting the tuning by a predetermined time from the timing of starting the voice guidance to be output by the sound source device.

[0162] According to the above-mentioned features, it is possible to prevent the display mode from being adjusted at an unexpected timing for the driver, and to reduce the unnecessary attention burden on the driver.

[0163] [8] The display control system described in any one of [1] to [7] above, characterized in that: The display device is extended in a manner that the display range extends in the left-right direction. The display control system takes the element to be displayed by the display device in the external environment as the first element, In a case where position information indicating the relative position of the first element with respect to the moving body can be displayed within the display range extending along the left-right direction, the control device controls the display device so that the position information of the first element is displayed in a first manner at a position corresponding to the first element within the display range.

[0164] According to the above feature, when the position of the external environment that the driver should recognize is within the display range, the driver is notified of the external environment together with its position, that is, the driver can further appropriately recognize the external environment.

[0165] [9] The display control system described in [8] above is characterized in that: When the position information representing the relative position of the first element cannot be displayed within the display range extending along the left-right direction, the control device controls the display device so that the position information of the first element is displayed in a second manner different from the first manner at one of the two ends of the display range that corresponds to the position of the first element.

[0166] According to the above-described feature, even if the position of the external environment that the driver should recognize is outside the display range, the driver can appropriately recognize the external environment.

[0167]

[10] The display control system described in any one of [1] to [9] above, characterized in that: The control device sets priorities for elements to be displayed by the display device in the external environment, and changes a display mode corresponding to the elements when the priorities satisfy a reference.

[0168] According to the above-mentioned features, it is possible to allow the driver to appropriately recognize the external environment with a high priority.

[0169]

[11] The display control system described in

[10] above is characterized in that: The display device in the external environment should display two or more elements, and the two or more elements include a first element and a second element. When the priority of the first element and the priority of the second element both satisfy the benchmark and the priority of the first element is higher than the priority of the second element, the control device changes the display mode corresponding to the first element, and before and / or after it, suppresses the change of the display mode corresponding to the second element.

[0170] According to the above-mentioned features, the effect of

[10] mentioned above can be further appropriately obtained.

[0171]

[12] The display control system described in

[10] or

[11] above, characterized in that: When the priority of the element to be displayed by the display device in the external environment satisfies the reference, the control device subsequently controls the sound source device so that a voice guidance for the element is output, thereby changing the display mode corresponding to the element.

[0172] According to the above-mentioned features, the effect of

[10] mentioned above can be further appropriately obtained.

[0173]

[13] The display control system described in any one of

[10] to

[12] above, characterized in that: The control device changes the display brightness corresponding to the element whose priority satisfies a criterion.

[0174] According to the above-mentioned features, the effect of

[10] mentioned above can be further appropriately obtained.

[0175]

[14] The display control system described in any one of

[10] to

[13] above, characterized in that: The control device changes a display color corresponding to the element whose priority satisfies a criterion.

[0176] According to the above-mentioned features, the effect of

[10] mentioned above can be further appropriately obtained.

[0177]

[15] The display control system described in any one of

[10] to

[14] above, characterized in that: The control device controls the sound source device so that the sound guidance for the element satisfying the priority standard is output at a variable speed.

[0178] According to the above-mentioned features, the effect of

[10] mentioned above can be further appropriately obtained.

[0179]

[16] The display control system described in any one of [1] to

[15] above, characterized in that: The sound source device performs voice guidance for driving guidance of the moving body.

[0180] According to the above-mentioned feature, the driver can appropriately recognize the external environment related to driving guidance through the dynamic display method by the display device and the voice guidance by the sound source device.

[0181]

[17] A method for controlling a display of a display device in a mobile body, the mobile body comprising: a sound source device for providing voice guidance to the mobile body; and the display device capable of displaying information indicating an external environment around the mobile body, It is characterized in that The method comprises: A step of processing the sound information of the sound guide to be output by the sound source device to obtain a signal waveform of the sound information; and The step of controlling the display device so that the display mode to be output by the display device is tuned with the acquired signal waveform.

[0182] According to the above features, the same effect as that of the above-mentioned [1] can be obtained.

[0183]

[18] A program for causing a computer to execute display control of a display device in a mobile body, the mobile body comprising: a sound source device that performs voice guidance for the mobile body; and a display device that can display information representing an external environment around the mobile body, It is characterized in that The program causes the computer to execute: Processing the sound information of the sound guide to be output by the sound source device to obtain a signal waveform of the sound information; and The display device is controlled so that the display mode to be output by the display device is tuned with the acquired signal waveform.

[0184] According to the above features, the same effects as those in the above [1] can be obtained. The above program is executed by one or more processors with a memory, and the above program is stored in a computer-readable storage medium that can be executed by a CPU.

[0185] The present invention is not limited to the above-described embodiments, and various modifications and changes can be made within the scope of the gist of the invention.

Claims

1. A display control system, which is a display control system for a mobile body, the mobile body comprising: a sound source device that performs sound guidance for the mobile body; a display device that can display information representing an external environment around the mobile body; and a control device, It is characterized in that The control device processes the sound information of the sound guide to be output by the sound source device to obtain a signal waveform of the sound information, and controls the display device so that the display mode to be output by the display device is tuned with the obtained signal waveform.

2. The display control system according to claim 1, characterized in that: The tuning of the display mode that the display device should output includes at least one of a situation where the display brightness changes, a situation where the display color changes, a situation where the display shape changes, a situation where the display size changes, a situation where the display swings, and a situation where other displays are attached to the display.

3. The display control system according to claim 1, characterized in that: The control device processes the sound information through filtering.

4. The display control system according to claim 1, characterized in that: The control device controls the display device so that the display mode to be output by the display device is tuned with the signal value in the acquired signal waveform.

5. The display control system according to claim 1, characterized in that: The control device tunes the display mode to be output by the display device with the time change of the volume of the sound information based on the acquired signal waveform.

6. The display control system according to claim 1, characterized in that: The control device adjusts the display mode to be output by the display device and the timing when the volume of the sound information becomes equal to or lower than a reference value based on the acquired signal waveform.

7. The display control system according to claim 1, characterized in that: The control device delays the timing of starting the tuning by a predetermined time from the timing of starting the voice guidance to be output by the sound source device.

8. The display control system according to claim 1, characterized in that: The display device is extended in a manner that a display range extends in the left-right direction. The display control system takes the element to be displayed by the display device in the external environment as the first element, In a case where position information indicating the relative position of the first element with respect to the moving body can be displayed within the display range extending along the left-right direction, the control device controls the display device so that the position information of the first element is displayed in a first manner at a position corresponding to the first element within the display range.

9. The display control system according to claim 8, characterized in that: When the position information representing the relative position of the first element cannot be displayed within the display range extending along the left-right direction, the control device controls the display device so that the position information of the first element is displayed in a second manner different from the first manner at one of the two ends of the display range that corresponds to the position of the first element.

10. The display control system according to claim 1, characterized in that: The control device sets priorities for elements to be displayed by the display device in the external environment, and changes a display mode corresponding to the elements when the priorities satisfy a reference.

11. The display control system according to claim 10, characterized in that: The display device in the external environment should display two or more elements, and the two or more elements include a first element and a second element. When the priority of the first element and the priority of the second element both satisfy the benchmark and the priority of the first element is higher than the priority of the second element, the control device changes the display mode corresponding to the first element, and before and / or after it, suppresses the change of the display mode corresponding to the second element.

12. The display control system according to claim 10, characterized in that: When the priority of the element to be displayed by the display device in the external environment satisfies the reference, the control device subsequently controls the sound source device so that a voice guidance for the element is output and a display method corresponding to the element is changed.

13. The display control system according to claim 10, characterized in that: The control device changes the display brightness corresponding to the element whose priority satisfies a criterion.

14. The display control system according to claim 10, characterized in that: The control device changes a display color corresponding to the element whose priority satisfies a criterion.

15. The display control system according to claim 10, characterized in that: The control device controls the sound source device so that the sound guidance for the element satisfying the priority standard is output at a variable speed.

16. The display control system according to claim 1, characterized in that: The sound source device performs voice guidance for driving guidance of the moving body.

17. A method for controlling a display of a display device in a mobile body, the mobile body comprising: a sound source device for providing voice guidance to the mobile body; and the display device capable of displaying information indicating an external environment around the mobile body, It is characterized in that The method comprises: A step of processing the sound information of the sound guide to be output by the sound source device to obtain a signal waveform of the sound information; and The step of controlling the display device so that the display mode to be output by the display device is tuned with the acquired signal waveform.

18. A computer-readable storage medium storing a computer program, It is characterized in that When the computer program is executed by a processor, the steps of the method according to claim 17 are implemented.

19. A computer program product, comprising a computer program, It is characterized in that When the computer program is executed by a processor, the steps of the method according to claim 17 are implemented.

Images