Content generation device, content generation method, program, and storage medium

Abstract

To provide a content output device that can output a content with the viewpoint of a passenger taken into consideration as a content for guiding the passenger.SOLUTION: A content generator includes an information acquisition unit and a content generation unit. The information acquisition unit acquires an image obtained by imaging regions around a vehicle and driving situation information as information related to the driving situation of the vehicle, from the vehicle. The content generation unit generates a guidance content as a content used to provide a guidance according to the driving situation information on the basis of the image when the image includes an object with a feature.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a technique that can be used in outputting guidance content. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a technique for outputting content such as landmarks around a current location and a route from the current location to a destination as guidance content for providing guidance to a user.

[0003] Specifically, for example, Patent Document 1 discloses a technology in which a navigation device that guides a vehicle driver along a route to a destination highlights guidance about an intersection that is the same as or similar to an intersection where the driver has deviated from the guided route due to an error. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 4424961 Summary of the Invention [Problem to be solved by the invention]

[0005] Here, when content relating to landmarks around the current location is output as the above-mentioned guidance content while driving a vehicle, a problem may arise in that the content is output without taking into consideration how the landmarks will appear to the passengers of the vehicle.

[0006] However, Patent Document 1 does not particularly disclose a method capable of solving the problems related to the output of the above-mentioned guide content. Therefore, the configuration disclosed in Patent Document 1 still has problems corresponding to the above-mentioned problems.

[0007] The present invention has been made to solve the above-mentioned problems, and its main object is to provide a content generation device that is capable of outputting content that takes into account the viewpoint of vehicle occupants as content for providing guidance to the occupants. [Means for solving the problem]

[0008] The claimed invention is a content generation device, comprising: an image of a surrounding area of a vehicle captured from the vehicle; Shooting direction information, which is information relating to the shooting direction when the image was shot, is included. an information acquisition unit that acquires driving situation information, and when the image contains a characteristic subject, a first script indicating that the subject is visible in the photographing direction and indicating objects other than the subject that exist in the image as guidance content; A content generation unit.

[0009] The claimed invention is a content generation method, comprising: an image of a surrounding area of a vehicle taken from the vehicle; Shooting direction information, which is information relating to the shooting direction when the image was shot, is included. When the driving situation information is acquired and the image contains a characteristic subject, As guidance content, a first script is generated that indicates that the subject is visible in the shooting direction and also indicates objects other than the subject that exist in the image.

[0010] The claimed invention is also a program executed by a content generation device including a computer, the program including: an image of a surrounding area of a vehicle taken from the vehicle; Shooting direction information, which is information relating to the shooting direction when the image was shot, is included. an information acquisition unit that acquires driving situation information, and a first script indicating that the subject is visible in the photographing direction and indicating objects other than the subject that exist in the image as guidance content; The computer is caused to function as a content generation unit. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an audio output system according to an embodiment. [Figure 2] FIG. 1 is a block diagram showing a schematic configuration of an audio output device. [Figure 3] FIG. 2 is a diagram showing an example of a schematic configuration of a server device. [Figure 4] 10 is a flowchart illustrating processing performed in the server device. [Figure 5]FIG. 10 is a diagram for explaining a modified example of processing performed in the server device. DETAILED DESCRIPTION OF THE INVENTION

[0012] In one preferred embodiment of the present invention, a content generation device includes an information acquisition unit that acquires an image of the surroundings of a vehicle taken from the vehicle and driving situation information that is information related to the driving situation of the vehicle, and a content generation unit that generates guidance content that is content used to provide guidance in accordance with the driving situation information based on the image when a characteristic subject is included in the image.

[0013] The content generation device includes an information acquisition unit and a content generation unit. The information acquisition unit acquires an image of the surroundings of a vehicle captured from the vehicle and driving situation information, which is information related to the driving situation of the vehicle. When the image contains a distinctive subject, the content generation unit generates guidance content, which is content used to provide guidance according to the driving situation information, based on the image. This makes it possible to output content that takes into account the viewpoint of a vehicle occupant as content for providing guidance to the vehicle occupant.

[0014] In one aspect of the above content generation device, the driving situation information includes at least one of location information, which is information relating to the position of the vehicle when the image was captured, time information, which is information relating to the time when the image was captured, and shooting direction information, which is information relating to the shooting direction when the image was captured.

[0015] In one aspect of the content generation device, the shooting direction information includes at least one of information indicating a direction corresponding to the orientation of an exterior camera installed on the vehicle, information indicating the orientation of the vehicle, and information indicating a direction within the angle of view of the exterior camera.

[0016] In one aspect of the above content generation device, when the content generation unit detects, based on the location information and the shooting direction information contained in the driving situation information, that the image was taken under shooting conditions similar to those of other images, instead of performing processing to generate the guidance content, it performs processing to obtain content that has already been generated as the guidance content.

[0017] In one aspect of the above content generation device, the content generation unit stores generated content information in a memory unit, which is information that associates the generated content generated as the guidance content, the driving situation information used when generating the generated content, and the image.

[0018] In another embodiment of the present invention, a content output method includes acquiring an image of the surroundings of a vehicle taken from the vehicle and driving situation information that is information related to the driving situation of the vehicle, and, if the image includes a characteristic subject, generating guidance content that is content used to provide guidance according to the driving situation information based on the image. This makes it possible to output content that takes into account the viewpoint of the vehicle occupant as content for providing guidance to the vehicle occupant.

[0019] In yet another embodiment of the present invention, a program executed by a content generation device including a computer causes the computer to function as an information acquisition unit that acquires images of the vehicle's surroundings taken from the vehicle and driving situation information that is information related to the vehicle's driving situation, and a content generation unit that generates, based on the images if a distinctive subject is included in the images, guidance content that is content used to provide guidance in accordance with the driving situation information. By executing this program on a computer, the above-mentioned content generation device can be realized. This program can be stored in a storage medium and used. [Example]

[0020] Preferred embodiments of the present invention will now be described with reference to the drawings.

[0021] [System Configuration] (Overall composition) 1 is a diagram illustrating an example of the configuration of an audio output system according to an embodiment. The audio output system 1 according to the embodiment includes an audio output device 100 and a server device 200. The audio output device 100 is mounted on a vehicle Ve. The server device 200 communicates with a plurality of audio output devices 100 mounted on a plurality of vehicles Ve.

[0022] The audio output device 100 basically performs route search processing, route guidance processing, and the like for a user who is a passenger in a vehicle Ve. For example, when a destination or the like is input by the user, the audio output device 100 transmits an upload signal S1 including location information of the vehicle Ve and information about the specified destination to the server device 200. The server device 200 calculates a route to the destination by referring to map data, and transmits a control signal S2 indicating the route to the destination to the audio output device 100. The audio output device 100 provides route guidance to the user by audio output based on the received control signal S2.

[0023] Furthermore, the audio output device 100 provides various types of information to the user through dialogue with the user. For example, when the user makes an information request, the audio output device 100 supplies the server device 200 with an upload signal S1 including information indicating the content or type of the information request and information regarding the running state of the vehicle Ve. The server device 200 acquires and generates the information requested by the user and transmits it to the audio output device 100 as a control signal S2. The audio output device 100 provides the received information to the user by audio output.

[0024] (Audio output device) The audio output device 100 travels with the vehicle Ve and provides route guidance primarily through audio so that the vehicle Ve travels along the guidance route. Note that "route guidance primarily through audio" refers to route guidance that allows the user to understand information necessary for driving the vehicle Ve along the guidance route at least through audio alone, and does not exclude the audio output device 100 supplementarily displaying a map or the like around the current location. In this embodiment, the audio output device 100 outputs various driving-related information by audio, such as at least points on the route where guidance is required (also referred to as "guidance points"). Herein, guidance points include, for example, intersections where the vehicle Ve must turn right or left, and other important passing points for the vehicle Ve to travel along the guidance route. The audio output device 100 provides audio guidance regarding guidance points, such as the distance from the vehicle Ve to the next guidance point and the direction of travel at that guidance point. Hereinafter, audio guidance regarding the guidance route will also be referred to as "route audio guidance."

[0025] The audio output device 100 is attached, for example, to the top of the windshield or on the dashboard of the vehicle Ve. The audio output device 100 may also be incorporated into the vehicle Ve.

[0026] 2 is a block diagram showing a schematic configuration of the audio output device 100. The audio output device 100 mainly includes a communication unit 111, a storage unit 112, an input unit 113, a control unit 114, a sensor group 115, a display unit 116, a microphone 117, a speaker 118, an exterior camera 119, and an interior camera 120. The elements within the audio output device 100 are connected to each other via a bus line 110.

[0027] The communication unit 111 performs data communication with the server device 200 under the control of the control unit 114. The communication unit 111 may receive, for example, map data for updating a map DB (DataBase) 4 (described later) from the server device 200.

[0028] The storage unit 112 is configured with various types of memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), and a non-volatile memory (including a hard disk drive, a flash memory, etc.). The storage unit 112 stores programs for the audio output device 100 to execute predetermined processes. The above-mentioned programs may include an application program for providing route guidance by voice, an application program for playing music, an application program for outputting content other than music (such as television), etc. The storage unit 112 is also used as a working memory for the control unit 114. The programs executed by the audio output device 100 may be stored in a storage medium other than the storage unit 112.

[0029] The storage unit 112 also stores a map database (hereinafter, database will be referred to as "DB") 4. The map DB 4 stores various data necessary for route guidance. The map DB 4 stores, for example, road data that represents a road network using a combination of nodes and links, and facility data that indicates facilities that are candidates for destinations, stop-off points, or landmarks. The map DB 4 may be updated based on map information that the communication unit 111 receives from a map management server under the control of the control unit 114.

[0030] The input unit 113 is a button, a touch panel, a remote controller, or the like that is operated by the user. The display unit 116 is a display or the like that displays information under the control of the control unit 114. The microphone 117 collects sounds inside the vehicle Ve, particularly sounds uttered by the driver. The speaker 118 outputs audio for route guidance to the driver or the like.

[0031] The sensor group 115 includes an external sensor 121 and an internal sensor 122. The external sensor 121 is one or more sensors for recognizing the surrounding environment of the vehicle Ve, such as a lidar, radar, ultrasonic sensor, infrared sensor, or sonar. The internal sensor 122 is a sensor for measuring the position of the vehicle Ve, such as a Global Navigation Satellite System (GNSS) receiver, a gyro sensor, an Inertial Measurement Unit (IMU), a vehicle speed sensor, or a combination thereof. Note that the sensor group 115 may include any sensor that allows the control unit 114 to directly or indirectly (i.e., by performing estimation processing) derive the position of the vehicle Ve from the output of the sensor group 115.

[0032] Exterior camera 119 is a camera that captures the outside of vehicle Ve. Exterior camera 119 may be only a front camera that captures the view in front of the vehicle, or may include a rear camera that captures the view behind the vehicle in addition to the front camera, or may be an omnidirectional camera that can capture the entire periphery of vehicle Ve. On the other hand, interior camera 120 is a camera that captures the interior of vehicle Ve, and is installed in a position that can capture at least the area around the driver's seat.

[0033] The control unit 114 includes a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and controls the entire audio output device 100. For example, the control unit 114 estimates the position (including the direction of travel) of the vehicle Ve based on the output of one or more sensors in the sensor group 115. When a destination is specified by the input unit 113 or the microphone 117, the control unit 114 generates route information indicating a guidance route that is a route to the destination, and provides route guidance based on the route information, the estimated position information of the vehicle Ve, and the map DB 4. In this case, the control unit 114 outputs route voice guidance from the speaker 118. The control unit 114 also controls the display unit 116 to display information on the music being played, video content, a map of the area around the current location, etc.

[0034] The processing performed by the control unit 114 is not limited to being realized by software programs, but may be realized by any combination of hardware, firmware, and software. The processing performed by the control unit 114 may also be realized by a user-programmable integrated circuit, such as an FPGA (field-programmable gate array) or a microcomputer. In this case, the program executed by the control unit 114 in this embodiment may be realized by using this integrated circuit. In this way, the control unit 114 may be realized by hardware other than a processor.

[0035] The configuration of the audio output device 100 shown in FIG. 2 is an example, and various modifications may be made to the configuration shown in FIG. 2. For example, instead of storing the map DB4 in the memory unit 12, the control unit 114 may receive information necessary for route guidance from the server device 200 via the communication unit 111. In another example, instead of including the speaker 118, the audio output device 100 may be connected electrically or via a known communication means to an audio output unit configured separately from the audio output device 100, thereby outputting audio from the audio output unit. In this case, the audio output unit may be a speaker provided in the vehicle Ve. In yet another example, the audio output device 100 may not include the display unit 116. In this case, the audio output device 100 may not perform any control related to the display, and may be electrically connected to a display unit provided in the vehicle Ve, etc., via a wired or wireless connection, thereby causing the display unit to perform a predetermined display. Similarly, instead of including the sensor group 115, the audio output device 100 may acquire information output by sensors provided in the vehicle Ve from the vehicle Ve based on a communication protocol such as CAN (Controller Area Network).

[0036] (Server device) The server device 200 generates route information indicating a guide route along which the vehicle Ve should travel, based on an upload signal S1 including a destination and the like received from the audio output device 100. The server device 200 then generates a control signal S2 related to information output in response to the user's information request, based on the user's information request and the traveling state of the vehicle Ve indicated in the upload signal S1 transmitted thereafter by the audio output device 100. The server device 200 then transmits the generated control signal S2 to the audio output device 100.

[0037] Furthermore, the server device 200 generates content for providing information to the user of the vehicle Ve and for dialogue with the user, and transmits the content to the audio output device 100. The provision of information to the user is primarily push-type information provision initiated from the server device 200 side when triggered by the vehicle Ve entering a predetermined driving situation or when a distinctive subject is included in an image of the periphery of the vehicle Ve taken from the vehicle Ve (an image of the periphery of the vehicle Ve). Furthermore, dialogue with the user is basically pull-type dialogue initiated by a question or inquiry from the user. However, dialogue with the user may also be initiated by push-type content provision.

[0038] 3 is a diagram showing an example of a schematic configuration of the server device 200. The server device 200 mainly includes a communication unit 211, a storage unit 212, and a control unit 214. The elements within the server device 200 are connected to each other via a bus line 210.

[0039] The communication unit 211 performs data communication with external devices such as the audio output device 100 under the control of the control unit 214. The storage unit 212 is configured with various types of memory such as RAM, ROM, and non-volatile memory (including a hard disk drive, flash memory, etc.). The storage unit 212 stores programs for the server device 200 to execute predetermined processes. The storage unit 212 also includes a map DB4.

[0040] The control unit 214 includes a CPU, a GPU, etc., and controls the entire server device 200. The control unit 214 also operates together with the audio output device 100 by executing a program stored in the storage unit 212, and performs route guidance processing and information provision processing for the user. For example, the control unit 214 generates route information indicating a guidance route or a control signal S2 related to information output in response to an information request from the user, based on an upload signal S1 received from the audio output device 100 via the communication unit 211. Then, the control unit 214 transmits the generated control signal S2 to the audio output device 100 via the communication unit 211.

[0041] [Push-type content provision] Next, push-type content provision will be described. Push-type content provision refers to the audio output device 100 audibly outputting content corresponding to the driving situation of the vehicle Ve to the user based on an image of the surroundings of the vehicle Ve and the driving situation of the vehicle Ve. Specifically, the audio output device 100 acquires an image of the surroundings of the vehicle Ve captured by the exterior camera 119 and driving situation information indicating the driving situation of the vehicle Ve, and transmits the image to the server device 200. If the image received from the audio output device 100 installed in the vehicle Ve contains a distinctive subject, the server device 200 generates a script based on the image for providing guidance corresponding to the driving situation information received from the audio output device 100 and transmits the script to the audio output device 100. The audio output device 100 audibly outputs the output content received from the server device 200. In this way, content corresponding to the image of the surroundings of the vehicle Ve and the driving situation of the vehicle Ve is audibly output to the user.

[0042] The image of the surroundings of the vehicle Ve may be a still image or a moving image, and may be an image taken in response to a command from a passenger of the vehicle Ve, or may be an image taken automatically (without a command from the passenger) while the vehicle Ve is being driven.

[0043] The driving situation information includes at least one of location information, which is information related to the location of the vehicle Ve when an image of the periphery of the vehicle Ve was captured, time information, which is information related to the time when the image was captured, and image capture direction information, which is information related to the image capture direction when the image was captured. Note that the driving situation information may further include at least one piece of information that can be acquired based on the functions of each unit of the audio output device 100, such as traffic information (including speed limits and congestion information, etc.) around the location of the vehicle Ve and a destination. The driving situation information may also include any of audio (excluding user speech) acquired by the microphone 117 and images captured by the in-vehicle camera 120. The driving situation information may also include information received from the server device 200 via the communication unit 111.

[0044] The shooting direction information may include information indicating a direction corresponding to the orientation of the exterior camera 119, such as the traveling direction of the vehicle Ve, the lateral direction of the vehicle Ve, and the rearward direction of the vehicle Ve. The shooting direction information may also include information indicating the orientation of the vehicle Ve. The shooting direction information may also include information indicating a direction within the angle of view of the exterior camera 119, such as the front of the vehicle Ve, the right front of the vehicle Ve, the left front of the vehicle Ve, etc.

[0045] [Example of how to generate guidance content] In this embodiment, landmarks such as Tokyo Tower, Mt. Fuji, and rows of cherry blossom trees can be set as characteristic objects included in an image of the periphery of the vehicle Ve. The control unit 214 of the server device 200 analyzes the image transmitted from the audio output device 100 and detects characteristic objects included in the image. For example, the control unit 214 can perform object recognition using AI (Artificial Intelligence) and extract characteristic objects included in the image as characteristic objects.

[0046] Note that the control unit 214 may identify a characteristic subject using driving situation information in addition to the image analysis results. For example, if the control unit 214 detects that a tower is captured in an image by analyzing the image and determines that the vehicle Ve is near Tokyo Tower based on location information included in the driving situation information, the control unit 214 can identify the tower as Tokyo Tower. Also, if the control unit 214 detects that a mountain is captured in an image by analyzing the image and determines that the image was captured in the direction of Mount Fuji based on shooting direction information in the driving situation information, the control unit 214 can identify the mountain as Mount Fuji.

[0047] For example, if an image of the vicinity of the vehicle Ve includes Tokyo Tower and a group of buildings, and the shooting direction information included in the driving situation information received from the vehicle Ve indicates the front of the vehicle Ve, the server device 200 generates, based on the image, a script SC11 for providing guidance according to the shooting direction information, such as "Tokyo Tower can be seen directly ahead between the buildings." The server device 200 then transmits the script SC11 to the audio output device 100 as guidance content. In this way, the script SC11 is output as audio to the user.

[0048] According to this embodiment, for example, if an image of the vicinity of the vehicle Ve does not include Tokyo Tower, but does include a group of buildings, and the location information included in the driving status information received from the vehicle Ve indicates a location near Tokyo Tower, the server device 200 can generate a script saying, "Tokyo Tower cannot be seen from this position."

[0049] For example, if an image of the vicinity of the vehicle Ve includes Mt. Fuji, the location information included in the driving situation information received from the vehicle Ve indicates a location within an area where Mt. Fuji is visually visible, and the shooting direction information included in the driving situation information indicates the front of the vehicle Ve, the server device 200 generates, based on the image, a script SC12 for providing guidance according to the location information and the shooting direction information, such as "You can see Mt. Fuji in full view directly ahead." The server device 200 then transmits the script SC12 to the audio output device 100 as guidance content. In this way, the script SC12 is output as audio to the user.

[0050] For example, if an image of the vicinity of the vehicle Ve includes a row of cherry blossom trees before they bloom, and the time information included in the driving situation information received from the vehicle Ve indicates a month other than April, the server device 200 generates, based on the image, a script SC13 for providing guidance according to the time information, such as "The cherry blossoms on this road will be in full bloom in April." The server device 200 then transmits the script SC13 to the audio output device 100 as guidance content. In this way, the script SC13 is output as voice to the user.

[0051] (Processing flow) FIG. 4 is a flowchart illustrating the processing performed in the server device.

[0052] First, the control unit 114 acquires an image of the surroundings of the vehicle Ve captured by the exterior camera 119 and transmits the image to the server device 200. The server device 200 acquires the image transmitted from the audio output device 100 (step S11).

[0053] Next, the control unit 114 acquires driving situation information, which is information related to the driving situation of the vehicle Ve when the image was acquired in step S11, and transmits it to the server device 200. The server device 200 acquires the driving situation information transmitted from the audio output device 100 (step S12).

[0054] The control unit 214 analyzes the image acquired in step S11 to determine whether or not the image contains a characteristic subject (step S13).

[0055] If the control unit 214 determines that the image acquired in step S11 does not include a distinctive subject (step S13: NO), it ends the process without performing the processes from step S14 onwards.

[0056] If the control unit 214 determines that the image acquired in step S11 contains a characteristic subject (step S13: YES), it generates a script based on the image to provide guidance in accordance with the driving situation information acquired in step S12 (step S14).

[0057] Next, the control unit 214 performs processing to store generated content information, which is information related to the script generated in step S14, in the storage unit 212 (step S15).

[0058] The generated content information includes the script generated in step S14, the driving situation information used when generating the script, and the image acquired together with the driving situation information. That is, according to the process of step S15, information associating the generated guidance content corresponding to the script generated in step S14, the driving situation information used when generating the generated guidance content, and the image acquired together with the driving situation information is stored in storage unit 212 as generated content information.

[0059] Next, the control unit 214 acquires the script generated in step S14 as guidance content and transmits the acquired guidance content to the audio output device 100 (step S16). This completes the generation of content by the server device 200. The audio output device 100 outputs the content received from the server device 200 to the passengers of the vehicle Ve by audio.

[0060] According to this embodiment, the server device 200 functions as a content generating device, and the control unit 214 functions as an information acquisition unit and a content generating unit.

[0061] In this embodiment, at least a part of the processes in FIG.

[0062] That is, according to this embodiment, the audio output device 100 may have the function of a content generating device, and further, the control unit 114 may have the function of an information acquisition unit and a content generating unit.

[0063] As described above, according to this embodiment, when an image contains a distinctive subject, it is possible to generate guidance content based on the image to provide guidance in accordance with driving situation information, which is information related to the driving situation of the vehicle when the image was acquired. Therefore, according to this embodiment, it is possible to output content that takes into account the viewpoint of the vehicle occupant as content for providing guidance to the vehicle occupant.

[0064] (Variation) A modification of the above embodiment will be described below: Fig. 5 is a diagram for explaining a modification of the process performed in the server device.

[0065] According to a modified example, instead of the process related to the generation of the script shown in step S14, for example, a process may be performed to acquire a script corresponding to the driving situation information of the vehicle Ve from among the generated scripts included in the generated content information stored in the storage unit 212. A specific example of such a process will be described below.

[0066] The control unit 214 determines whether or not there is a generated script corresponding to the driving situation information obtained in step S12 by referring to the generated content information stored in the storage unit 212 (step S21).

[0067] If the control unit 214 determines that there is no generated script corresponding to the driving situation information obtained in step S12 (step S21: NO), it performs the process of step S13. If the control unit 214 determines that there is a generated script corresponding to the driving situation information obtained in step S12 (step S21: YES), it acquires the generated script (step S22) and then performs the process of step S16.

[0068] Specifically, the control unit 214 detects whether the image obtained in step S11 was taken under similar shooting conditions (for example, the same shooting position and the same shooting direction) as those of other images included in the generated content information, based on the position information and shooting direction information included in the driving situation information obtained in step S12. If the control unit 214 detects that the image obtained in step S11 was not taken under similar shooting conditions as those of other images included in the generated content information, the control unit 214 determines that there is no generated script corresponding to the driving situation information obtained in step S12, and performs processing of step S13. If the control unit 214 detects that the image obtained in step S11 was taken under similar shooting conditions as those of other images included in the generated content information, the control unit 214 determines that there is a generated script corresponding to the driving situation information obtained in step S12, acquires the generated script, and then performs processing of step S16.

[0069] According to the process of the modified example described above, when it is detected that an image of the periphery of the vehicle Ve was captured under the same circumstances as other images, instead of the process for generating guidance content, a process for acquiring content that has already been generated as the guidance content is performed. Therefore, according to the process of the modified example described above, it is possible to reduce the load on the server device 200 that occurs due to the process for generating a script, for example.

[0070] In each of the above-described embodiments, the program can be stored using various types of non-transitory computer-readable media and supplied to a control unit or the like that is a computer. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic storage media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical storage media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (Random Access Memory)).

[0071] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications within the scope of the present invention that would be understood by those skilled in the art can be made to the configuration and details of the present invention. In other words, the present invention naturally includes various modifications and alterations that would be possible for those skilled in the art based on the entire disclosure, including the claims, and the technical ideas. Furthermore, the disclosures of the above-cited patent documents and other documents are incorporated herein by reference. [Explanation of symbols]

[0072] 100 Audio output device 200 Server device 111, 211 Communications Department 112, 212 Storage section 113 Input section 114, 214 Control unit 115 Sensor Group 116 Display section 117 Mike 118 Speaker 119 Exterior Camera 120 In-car camera

Claims

1. an information acquisition unit that acquires an image of the surroundings of the vehicle taken from the vehicle and driving situation information including imaging direction information that is information related to the imaging direction when the image was taken; a content generation unit that generates, as guidance content when the image includes a characteristic subject, a first script that indicates that the subject is visible in the shooting direction and that indicates objects other than the subject that exist in the image; A content generation device comprising:

2. The information acquisition unit further acquires, as the driving situation information, location information which is information relating to the location of the vehicle when the image was taken, The content generation device according to claim 1, wherein the content generation unit generates, as guidance content when the image does not include the subject and the location information indicates a position near the subject, a second script indicating that the subject is not visible from the current position of the vehicle.

3. 3. The content generation device according to claim 1, wherein the shooting direction information includes at least one of information indicating a direction corresponding to the orientation of an exterior camera installed on the vehicle, information indicating the orientation of the vehicle, and information indicating a direction within the angle of view of the exterior camera.

4. The information acquisition unit further acquires, as the driving situation information, location information which is information relating to the location of the vehicle when the image was taken, The content generation device of claim 1, wherein when the content generation unit detects, based on the location information and the shooting direction information included in the driving situation information, that the image was taken under shooting conditions similar to those of other images, instead of performing processing to generate the guidance content, it performs processing to obtain content that has already been generated as the guidance content.

5. 5. The content generating device according to claim 1, wherein the content generating unit stores generated content information in a memory unit, the generated content information being information that associates the generated content generated as the guidance content with the driving situation information and the image used when generating the generated content.

6. Acquire an image of the surroundings of the vehicle taken from the vehicle and driving situation information including imaging direction information that is information relating to the imaging direction when the image was taken, A content generation method for generating a first script as guidance content when the image contains a distinctive subject, which indicates that the subject is visible in the shooting direction and indicates objects other than the subject that are present in the image.

7. A program executed by a content generation device having a computer, an information acquisition unit that acquires an image of the surroundings of the vehicle taken from the vehicle and driving situation information including imaging direction information that is information related to the imaging direction when the image was taken; and A program that causes the computer to function as a content generation unit that generates a first script as guidance content when the image contains a distinctive subject, which indicates that the subject is visible in the shooting direction and indicates objects other than the subject that are present in the image.

8. A storage medium storing the program according to claim 7.

Images