In-vehicle device, content playback method, and program

The in-vehicle device addresses the issue of impaired sense of presence by using an external audio output unit to provide external voices and sounds, enhancing the immersive experience for passengers by clearly separating the audio source from the visual display.

JP7695617B2Active Publication Date: 2025-06-19SONY GROUP CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022501622
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-02-21
Filing Date
2020-10-23
Publication Date
2025-06-19
Estimated Expiration
2040-10-23

AI Technical Summary

Technical Problem

When providing an external voice to a passenger along with an image representing the outside state of a vehicle, outputting the external voice from an internal speaker impairs the sense of presence for the passenger.

Method used

An in-vehicle device comprising an in-vehicle display unit, an external audio output unit, and a playback unit that plays back content with in-vehicle images displayed on the in-vehicle display unit and audio output from the external audio output unit, enhancing the sense of presence by separating the audio source from the visual display.

Benefits of technology

The solution effectively enhances the sense of presence for passengers by ensuring that external audio is perceived as coming from outside the vehicle, thereby improving the immersion in the in-vehicle experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007695617000001
    Figure 0007695617000001
  • Figure 0007695617000002
    Figure 0007695617000002
  • Figure 0007695617000003
    Figure 0007695617000003
Patent Text Reader

Abstract

The present technology relates to an in-vehicle device, a content reproduction method, and a program that are capable of giving a passenger realistic sensations. An in-vehicle device according to the present technology comprises: an in-vehicle display unit mounted inside a vehicle; an audio output unit mounted outside the vehicle; and a reproduction unit for reproducing content including an image for in-vehicle use to be displayed on the in-vehicle display unit and audio to be outputted from the audio output unit. The present technology is, for example, applicable to a cart that runs while giving a performance using the image in the content.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present technology relates to an in-vehicle device, a content playback method, and a program, and particularly to an in-vehicle device, a content playback method, and a program that can give a sense of presence to passengers.

Background Art

[0002] Generally, vehicles such as automobiles are provided with speakers. For example, Patent Document 1 describes providing a speaker for transmitting an alarm to the outside on the outside of a vehicle.

[0003] On the other hand, speakers for outputting voices for vehicle passengers are also provided inside the vehicle. Voices of contents and the like are output from the speakers inside the vehicle.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When providing an external voice to a passenger together with an image representing the state of the outside of the vehicle, if the external voice is output from a speaker provided inside the vehicle, the external voice will be heard from the internal speaker, so the sense of presence will be impaired.

[0006] The present technology has been made in view of such a situation, and aims to give a sense of presence to passengers.

Means for Solving the Problems

[0007] An in-vehicle device according to one aspect of the present technology includes an in-vehicle display unit mounted inside the vehicle, an audio output unit mounted outside the vehicle, and a playback unit that plays back content including an in-vehicle image displayed on the in-vehicle display unit and audio output from the audio output unit.

[0008] In one aspect of the present technology, content including an image and audio is played back, the image is displayed on a display unit mounted inside the vehicle, and the audio is output from an audio output unit mounted outside the vehicle.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments for carrying out the present technology will be described. The description will be made in the following order. 1. Appearance and Interior of the Cart 2. Configuration of the Cart 3. Operation of the Cart 4. Regarding the Interlocking of the External Display Unit and the External Speaker of the Vehicle 5. Others

[0011] <1. Appearance and Interior of the Cart> FIG. 1 is a diagram showing a configuration example of the appearance of a cart 1 equipped with an in-vehicle device according to an embodiment of the present technology. FIG. 1 shows the appearance of the cart 1 when viewed from the front left diagonal.

[0012] The cart 1 is a vehicle that can move by autonomous driving or remote operation. A person can ride on the cart 1. The cart 1 may be driven by an occupant.

[0013] Examples of the cart 1 include an electric vehicle that moves with a motor, such as an electric cart. Note that the cart 1 according to the present embodiment is not limited to an electric vehicle.

[0014] The body of the cart 1 has a substantially rectangular parallelepiped shape. On the front, left side, right side, and back of the cart 1, an external display unit 11F, an external display unit 11L, an external display unit 11R (not shown), and an external display unit 11B (not shown) are provided, respectively. The external display units 11F to 11B are configured by a thin display device such as an LCD (Liquid Crystal Display) or an organic EL panel.

[0015] As shown in FIG. 1, an entrance / exit for people to get on and off is provided at a position near the rear of the left side surface of the body. There is no door at the entrance / exit. A similar entrance / exit is also provided on the right side surface of the body.

[0016] In addition, a camera 12F, a camera 12L, a camera 12R (not shown), and a camera 12B (not shown) are provided on the front surface, the left side surface, the right side surface, and the rear surface of the cart 1, respectively. Images of the front, the left side, the right side, and the rear of the cart 1 are captured by the cameras 12F to 12B, respectively.

[0017] Furthermore, an external speaker 13F, an external speaker 13L, an external speaker 13R (not shown), and an external speaker 13B (not shown) are provided on the front surface, the left side surface, the right side surface, and the rear surface of the cart 1, respectively. In FIG. 1, the external speaker 13F and the external speaker 13L are shown as circles with hatches, but the shape and position of the speakers are not limited to the shape and position shown in FIG. 1.

[0018] The cart 1 having such an external configuration is used to carry people and travel at a relatively low speed on a circuit course set in a park, a theme park, etc. The passengers can enjoy the effects provided by the cart 1 while looking at the surrounding scenery.

[0019] FIG. 2 is a diagram showing a configuration example of the interior of the cart 1. FIG. 2 shows the interior when viewed from the front inside the cart 1.

[0020] As shown in the blowout, an in-vehicle display unit 21 is provided in the front of the interior of the cart 1. Similar to the external display unit, the in-vehicle display unit 21 is composed of a thin display device such as an LCD or an organic EL panel.

[0021] For example, an image captured by the camera 12F provided on the front surface of the cart 1 is displayed on the in-vehicle display unit 21. By displaying such an image, the passengers in the cart 1 can observe the forward scenery that changes according to the running of the cart 1 through the in-vehicle display unit 21. In the example of FIG. 2, a view of a road in a forest with trees lined up on both sides is displayed on the in-vehicle display unit 21.

[0022] Note that display units may be provided on the left side surface, the right side surface, and the rear surface inside the cart 1, respectively. In this case, for example, images captured by the camera 12L, the camera 12R, and the camera 12B are displayed on the display units provided on the left side surface, the right side surface, and the rear surface of the cart 1, respectively.

[0023] The in-vehicle display unit 21 can display not only an image of the external scenery captured by the camera 12F but also various types of information such as an image of content. For example, an image of content selected according to the running environment of the cart 1 is displayed on the in-vehicle display unit 21. The passengers will enjoy the performance by viewing not only the surrounding scenery but also the image of the content. The image of the content may be displayed superimposed on the image captured by the camera 12F, or only the image of the content may be displayed.

[0024] Below the in-vehicle display unit 21, in-vehicle speakers 22L and 22R are provided. Sound directed to the passengers is output from the in-vehicle speakers 22L and 22R. The sound includes various types of sounds such as human voices, artificial sounds, sounds generated in the natural environment, and music.

[0025] Hereinafter, among the content reproduced during running as appropriate, the content reproduced as the main content will be referred to as the main content.

[0026] In addition, the content that is temporarily played in order to perform an effect-based presentation is referred to as effect content. The effect content is played at a predetermined timing such as the timing when an event occurs. The effect content may be played together with the main content, or may be played alone.

[0027] The main content includes at least an in-vehicle image to be displayed on an in-vehicle display unit (in-vehicle display unit 21), audio to be output from in-vehicle speakers (in-vehicle speakers 22L, 22R), and an out-of-vehicle image to be displayed on an out-of-vehicle display unit (out-of-vehicle display units 11F to 11B). Audio output from out-of-vehicle speakers (out-of-vehicle speakers 13F to 13B) may be included in the main content.

[0028] On the other hand, the effect content includes at least an in-vehicle image, an out-of-vehicle image, and audio output from out-of-vehicle speakers. Audio output from in-vehicle speakers may be included in the effect content.

[0029] One or more pieces of effect content are associated with the main content. The main content and the associated effect content constitute the content to be played during driving. The effect content may be included in the main content.

[0030] FIG. 3 is a diagram showing a first example of an image displayed on the in-vehicle display unit 21.

[0031] In the example of FIG. 3, an effect image E1, which is a moving image representing a state where the trees on both sides of the traveling road of the cart 1 are burning, is displayed. The effect image E1 is an image included in the effect content.

[0032] In this way, when the effect content is played, the cart 1 performs in-vehicle staging by superimposing and displaying the effect image E1 obtained by playing the effect content on the image captured by the camera 12F. By viewing the display on the in-vehicle display unit 21, the passenger can virtually experience a situation where a fire has occurred around the cart 1.

[0033] On the other hand, outside the cart 1, in conjunction with the in-vehicle staging, the display of other effect images and the output of sound effects in the form of voices are performed.

[0034] FIG. 4 is a diagram showing the state outside the cart 1 when the effect content of a fire is being played.

[0035] As shown in FIG. 4, the effect image E2, which is an image representing the flickering of fire, is displayed on the outside vehicle display unit 11F and the outside vehicle display unit 11L. Similar images are also displayed on the outside vehicle display unit 11R and the outside vehicle display unit 11B.

[0036] Also, as shown in FIG. 4, from the outside vehicle speaker 13F and the outside vehicle speaker 13L, a sound like "pat pat", which is the sound of wood burning, is output as an effect sound. Similar effect sounds are also output from the outside vehicle speaker 13R and the outside vehicle speaker 13B.

[0037] In this way, in conjunction with displaying the fire effect image E1 inside the cart 1, the cart 1 causes the effect image E2 representing the flickering of fire to be displayed on the outside display unit and causes the effect sound corresponding to the effect image E1 to be output from the outside speakers.

[0038] As described above, the effect image E1 displayed on the in-vehicle display unit 21 is an image that is displayed superimposed on the image of the scenery outside the cart 1, and is a virtual representation of the state outside the vehicle. If an effect sound corresponding to an image representing such a state outside the vehicle is output from the in-vehicle speakers 22L and 22R provided inside the vehicle, since the sound source is inside the vehicle and voices are not heard from outside the vehicle, it is difficult for the passengers inside the vehicle to obtain a sense of immersion.

[0039] In the cart 1 of the present technology, by outputting an effect sound corresponding to an image representing the state outside the vehicle from the speakers outside the vehicle, the sound source is outside the vehicle, and the effect sound will be heard from outside the vehicle. As described above, since there are no doors at the entrance and exit of the cart 1, the effect sound output from the outside speakers 13F to 13B directly reaches the ears of the passengers.

[0040] As a result, the passengers can obtain a greater sense of immersion in the in-vehicle performance carried out using the display on the in-vehicle display unit 21.

[0041] Figure 5 is a diagram showing the situation when the surroundings are dark.

[0042] Driving in a park or the like may be carried out during a time when it is dark around. As shown in Figure 5, when the surroundings are dark, by displaying the effect image E2 representing the flickering of a fire on the outside display units 11F to 11B, the light of the effect image E2 illuminates the external environment such as the road surface. The passengers can obtain a similar feeling to that when the road surface is illuminated by an actual fire by seeing from the entrance and exit that the road surface is illuminated.

[0043] In addition, in conjunction with the display of the effect image E1 inside the vehicle, an image in which a figure crosses may be displayed on the outside display units 11F to 11B.

[0044] Figure 6 is a diagram showing a second example of the image displayed on the in-vehicle display unit 21.

[0045] In the example of FIG. 6, an effect image representing whales or fish flying over the park is displayed. The effect images of whales and fish are images included in the content for effects.

[0046] By looking at the display on the in-vehicle display unit 21, the passenger can virtually experience the situation where the cart 1 is traveling in the sea.

[0047] On the other hand, outside the cart 1, in conjunction with the in-vehicle effects, other effect images are displayed and sound effects are output.

[0048] FIG. 7 is a diagram showing the state outside the cart 1 when playing the content for sea effects.

[0049] As shown in FIG. 7, on the outside display unit 11F and the outside display unit 11L of the vehicle, effect images representing the fluctuation of light reflected on the sea surface are displayed. Similar images are also displayed on the outside display unit 11R and the outside display unit 11B.

[0050] Also, as shown in FIG. 7, from the outside speaker 13F and the outside speaker 13L of the vehicle, the sounds of whales and fish swimming are output as sound effects. Similar sound effects are also output from the outside speaker 13R and the outside speaker 13B.

[0051] FIG. 8 is a diagram showing the situation when the surroundings are dark.

[0052] As shown in FIG. 8, when the surroundings are dark, by displaying effect images representing the fluctuation of light on the outside display units 11F to 11B of the vehicle, the light of the effect images illuminates the external environment such as the road surface. The passenger can obtain a similar feeling to that of the road surface being illuminated by the light reflected on the sea surface by seeing from the boarding and alighting opening that the road surface is illuminated.

[0053] As described above, in the cart 1, other effect images corresponding to the effect image representing the state outside the vehicle are displayed on the outside-vehicle display unit, and the sound effects corresponding to the effect image representing the state outside the vehicle are output from the outside-vehicle speakers.

[0054] Thereby, the cart 1 can give the passengers a sense of presence for the in-vehicle production performed using the display of the in-vehicle display unit 21.

[0055] <2. Configuration of Cart> FIG. 9 is a block diagram showing a configuration example of the cart 1. In FIG. 9, the configurations corresponding to the above-described configurations are denoted by the same reference numerals. Redundant descriptions are omitted as appropriate.

[0056] As shown in FIG. 9, in addition to the above-described outside-vehicle display unit 11, outside-vehicle imaging unit 12, outside-vehicle speaker 13, in-vehicle display unit 21, and in-vehicle speaker 22, an input unit 51 and a control unit 52 are provided in the cart 1. The configuration shown in FIG. 9 is an in-vehicle device mounted on the cart 1.

[0057] Note that the outside-vehicle display unit 11 corresponds to the outside-vehicle display units 11F to 11B, the outside-vehicle imaging unit 12 corresponds to the cameras 12F to 12B. The outside-vehicle speaker 13 corresponds to the outside-vehicle speakers 13F to 13B, and the in-vehicle speaker 22 corresponds to the in-vehicle speakers 22L and 22R.

[0058] The input unit 51 is used for various inputs including the operation of the cart 1 and the operations on the cart 1. For example, the input unit 51 includes a touch panel, buttons, a steering wheel, a shift lever, an accelerator pedal, a brake pedal, and the like. For example, the input unit 51 receives the selection of the main content to be played back and outputs information representing the selected main content to the content playback unit 61 of the control unit 52.

[0059] The control unit 52 is configured by a computer. In the control unit 52, a content playback unit 61, a content storage unit 62, and a position information acquisition unit 63 are realized by executing a predetermined program by a CPU (Central Processing Unit) of the computer.

[0060] Based on the information supplied from the input unit 51, the content playback unit 61 reads out and plays back the selected main content from the content storage unit 62. The image obtained by playing back the main content is appropriately output to the outside vehicle display unit 11 and the inside vehicle display unit 21, and the audio obtained by playing back the main content is appropriately output to the outside vehicle speaker 13 and the inside vehicle speaker 22.

[0061] Also, the content playback unit 61 reads out and plays back the effect content from the content storage unit 62 according to the position information of the cart 1 supplied from the position information acquisition unit 63. For example, the content playback unit 61 plays back the effect content associated with the main content when the cart 1 reaches a predetermined position.

[0062] The effect image obtained by playing back the effect content is appropriately output to the outside vehicle display unit 11 and the inside vehicle display unit 21, and the effect sound obtained by playing back the effect content is appropriately output to the outside vehicle speaker 13.

[0063] The content storage unit 62 is configured by an HDD, a flash memory, etc. The content storage unit 62 stores, in addition to the main content, the effect content as described above.

[0064] The position information acquisition unit 63 acquires the position information of the cart 1 based on the output of the sensor. A magnetic sensor for detecting magnetism from a magnetic marker embedded in the road surface is provided at a predetermined position such as the bottom surface of the cart 1. The position information of the cart 1 acquired by the position information acquisition unit 63 is output to the content playback unit 61.

[0065] In addition to the configuration shown in FIG. 9, the cart 1 is provided with a communication device that communicates with other devices via a network by a predetermined communication method. Further, the cart 1 is provided with a drive unit related to the movement of the cart 1, such as a power source such as a motor, wheels, a transmission for transmitting the power generated by the power source to the wheels, and a braking mechanism.

[0066] The cart 1 is provided with a sensor group composed of various sensors. The sensors constituting the sensor group include sensors for detecting the state of the cart 1, such as a gyro sensor, an acceleration sensor, and an inertial measurement unit (IMU).

[0067] Further, the sensors constituting the sensor group include sensors for detecting external information, such as a ToF (Time Of Flight) camera, a stereo camera, a monocular camera, an infrared camera, and a surrounding information detection sensor. The surrounding information detection sensor includes, for example, an ultrasonic sensor, a radar, a LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging), and a sonar. The sensors constituting the sensor group include a positioning sensor for detecting the current position of the cart 1.

[0068] Further, the cart 1 is provided with a battery as an internal power source. Instead of using the internal power source, the cart 1 may be driven by electric power supplied from the outside.

[0069] <3. Operation of the Cart> Here, the operation of the cart 1 having the above configuration will be described.

[0070] Referring to the flowchart of FIG. 10, the process performed by the cart 1 will be described. This process starts, for example, when the power of the in-vehicle device mounted on the cart 1 is turned on.

[0071] In step S1, the input unit 51 receives the selection of the main content. The selection of the main content may be made by the passenger or by the administrator of the cart 1.

[0072] In step S2, the control unit 52 drives a driving unit such as a motor to start traveling.

[0073] In step S3, the content playback unit 61 reads the main content selected in step S1 from the content storage unit 62 and starts playing the main content. For example, an image obtained by playing the main content is superimposed on an image captured by the outside vehicle imaging unit 12 and displayed on the in-vehicle display unit 21.

[0074] In step S4, the content playback unit 61 determines whether the cart 1 has reached a specific position based on the position information of the cart 1 supplied from the position information acquisition unit 63, and waits until the cart 1 reaches the specific position. While the main content is being played until the cart 1 reaches the specific position, the display of the image of the main content and the like continues. If it is determined that the cart 1 has reached the specific position, the process proceeds to step S5.

[0075] In step S5, the content playback unit 61 reads the effect content from the content storage unit 62 and starts playing the effect content. By displaying the effect image obtained by playing the effect content on the in-vehicle display unit 21, the in-vehicle effect is started.

[0076] In step S6, the content playback unit 61 outputs the effect image obtained by playing the effect content to the outside vehicle display unit 11 to display an effect image linked to the in-vehicle effect.

[0077] In step S7, the content playback unit 61 outputs the sound effects obtained by playing the content for effects to the external speaker 13, and outputs the sound effects linked to the in-vehicle presentation.

[0078] The playback of such content for effects is continued, for example, while the vehicle is traveling in a predetermined section. When the playback of the content for effects ends, the playback of the main content is resumed, and the process ends when the goal point is reached.

[0079] Through the above processing, the passengers in the cart 1 can obtain a stronger sense of immersion in the in-vehicle presentation.

[0080] <4. Regarding the linkage between the external display unit and the external speaker> · Regarding the output of sound linked to the image for external use Not only the sound linked to the in-vehicle image displayed on the in-vehicle display unit 21, but also the sound linked to the external image displayed on the external display unit 11 may be output from the external speaker 22.

[0081] FIG. 11 is a diagram showing the external state of the cart 1 when playing animal content.

[0082] As shown in FIG. 11, images representing animals such as penguins moving are displayed on the external display unit 11F and the external display unit 11L. Similar images are also displayed on the external display unit 11R and the external display unit 11B.

[0083] When traveling in such a state, from the external speaker 22, a sound linked to the external image is output according to the situation around the cart 1. During travel, in the cart 1, the situation around the cart 1 is recognized based on the image captured by the external imaging unit 12 such as the camera 12F.

[0084] FIG. 12 is a diagram showing an example of outputting a sound linked to an external image.

[0085] For example, as shown in the upper part of FIG. 12, when it is recognized that there is a pedestrian H1 around the cart 1 on a driving road or the like, as shown in the lower part of FIG. 12, the sound of the penguin's cry is output from the external speaker 13 in conjunction with the movement of the penguin, thereby alerting the pedestrian H1.

[0086] In the example of FIG. 12, the sound of the cry is output from the external speaker 13F and the external speaker 13L, but the same sound of the cry is also output from the external speaker 13R and the external speaker 13B. Note that the sound of the cry may be output by the external speaker 13 provided in the direction where the pedestrian H1 is located.

[0087] In this way, when there are pedestrians around, in conjunction with the animal displayed on the external display unit 11, the sound of the cry of that animal is output from the external speaker 13. For example, when an image of a lion is displayed on the external display unit 11, the sound of the lion's cry is output from the external speaker 13.

[0088] Thereby, the cart 1 can make the pedestrian H1 aware of the presence of the cart 1 and prompt attention. On the other hand, the pedestrian H1 can notice the cart 1 on which the image of the animal making the cry is displayed.

[0089] Compared with the case where a horn sound or the like is output, when the sound of the cry of an animal is output, it is considered that people around the cart 1 are less likely to feel uncomfortable. The cart 1 can prompt attention without giving discomfort to people around.

[0090] ·Configuration of the cart FIG. 13 is a diagram showing a configuration example of the cart 1 that outputs sound in conjunction with an image for external use.

[0091] In FIG. 13, the same components as those of the cart 1 in FIG. 9 are denoted by the same reference numerals. Redundant descriptions will be omitted as appropriate.

[0092] The configuration of the cart 1 shown in FIG. 13 is different from the configuration described with reference to FIG. 9 in that the in-vehicle display unit 21 and the out-vehicle speaker 22 are not provided, and the pedestrian recognition unit 101 is provided in the control unit 51. Thus, when the sound linked to the display of the out-vehicle display unit 11 is output from the out-vehicle speaker 13, it is also possible not to provide the in-vehicle display unit 21 and the out-vehicle speaker 22.

[0093] The pedestrian recognition unit 101 acquires the image captured by the out-vehicle imaging unit 12, and recognizes the people around the cart 1 based on the acquired image. For example, a pedestrian walking on the road is recognized. The information representing the recognition result by the pedestrian recognition unit 101 is supplied to the content reproduction unit 61.

[0094] The content reproduction unit 61 reads out the selected content from the content storage unit 62 and reproduces it based on the information supplied from the input unit 51. The image obtained by reproducing the content is appropriately output to the out-vehicle display unit 11.

[0095] Also, the content reproduction unit 61 outputs the sound obtained by reproducing the content to the out-vehicle speaker 13 according to the recognition result by the pedestrian recognition unit 101 or the information supplied from the input unit 51.

[0096] ·Operation of the Cart With reference to the flowchart of FIG. 14, the process performed by the cart 1 will be described. This process is started, for example, after the content is selected by the administrator of the cart 1.

[0097] In step S101, the control unit 52 drives the drive unit such as a motor to start traveling.

[0098] In step S102, the content playback unit 61 reads out the content selected by the administrator from the content storage unit 62 and starts playing the content. For example, an image of a penguin obtained by playing the content is displayed on the outside vehicle display unit 11. Also, the capture of an image of the surrounding situation is started by the outside vehicle imaging unit 12.

[0099] After the playback of the content is started in step S102, in step S103, the input unit 51 receives a warning operation by the passenger of cart 1. The warning operation is an operation performed by the passenger to cause cart 1 to output a voice prompting attention when the passenger notices that there is a pedestrian on the driving path of cart 1. In this example, a voice prompting attention is output when there is a pedestrian on the driving path.

[0100] Also, after the playback of the content is started in step S102, in step S104, the pedestrian recognition unit 101 recognizes the pedestrians on the driving path of cart 1.

[0101] After the warning operation is received in step S103, or after the pedestrians on the driving path are recognized in step S104, in step S105, the content playback unit 61 outputs the voice obtained by playing the content to the outside vehicle speaker 13 and causes the voice of the penguin's cry linked to the display on the outside vehicle display unit 11 to be output as a warning sound.

[0102] Such playback of the content continues, for example, while traveling in a predetermined section. The process ends in response to reaching the goal point.

[0103] Through the above processing, cart 1 can prompt attention to people around cart 1 without giving discomfort by outputting voices such as cries linked to the display on the outside vehicle display unit 11.

[0104] <5. Others> The above-described series of processes can be executed either by hardware or by software. When the series of processes is executed by software, the program constituting the software is installed from a program recording medium into a computer incorporated with dedicated hardware or a general-purpose personal computer or the like.

[0105] FIG. 15 is a block diagram showing a configuration example of the hardware of a computer that executes the above-described series of processes by a program. The control unit 52 in FIGS. 9 and 13 is constituted by a computer having a configuration as shown in FIG. 15.

[0106] The CPU 301, ROM (Read Only Memory) 302, and RAM (Random Access Memory) 303 are interconnected by a bus 304.

[0107] An input / output interface 305 is further connected to the bus 304. An input unit 306 composed of a keyboard, a mouse, etc. and an output unit 307 composed of a display, a speaker, etc. are connected to the input / output interface 305. Further, a storage unit 308 composed of a hard disk, a non-volatile memory, etc., a communication unit 309 composed of a network interface, etc., and a drive 310 for driving a removable medium 311 are connected to the input / output interface 305.

[0108] In the computer configured as described above, the CPU 301 loads and executes, for example, a program stored in the storage unit 308 via the input / output interface 305 and the bus 304 into the RAM 303, whereby the above-described series of processes are performed.

[0109] The program executed by the CPU 301 is recorded, for example, on the removable medium 311 or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting, and installed in the storage unit 308.

[0110] Note that the program executed by the computer may be a program that is processed in time series according to the order described in this specification, or a program that is processed in parallel or at a necessary timing such as when a call is made.

[0111] The effects described in this specification are merely examples and are not limiting, and there may be other effects.

[0112] The embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.

[0113] For example, the present technology can adopt a cloud computing configuration in which one function is shared and jointly processed by a plurality of devices via a network.

[0114] In addition, each step described in the above flowchart can be executed by one device or can be shared and executed by a plurality of devices.

[0115] Furthermore, when a plurality of processes are included in one step, the plurality of processes included in that one step can be executed by one device or can be shared and executed by a plurality of devices.

[0116] <Example of configuration combination> The present technology can also adopt the following configuration.

[0117] (1) An in-vehicle display unit mounted inside the vehicle, An audio output unit mounted outside the vehicle, A playback unit that plays back content including an in-vehicle image displayed on the in-vehicle display unit and audio output from the audio output unit An in-vehicle device comprising. (2) Further comprising a position information acquisition unit that acquires the position information of the vehicle, The playback unit plays the content in response to the vehicle reaching a predetermined position. The in-vehicle device according to (1) above. (3) The voice output unit outputs, as the voice, sound effects associated with the in-vehicle image. The in-vehicle device according to (1) or (2) above. (4) The voice output unit is mounted on each of a plurality of surfaces of the vehicle body. The in-vehicle device according to any one of (1) to (3) above. (5) The vehicle further includes an out-vehicle display unit mounted outside the vehicle, The playback unit plays the content further including an out-vehicle image displayed on the out-vehicle display unit. The in-vehicle device according to any one of (1) to (4) above. (6) The out-vehicle display unit is mounted on each of a plurality of surfaces of the vehicle body. The in-vehicle device according to (5) above. (7) The out-vehicle display unit displays the out-vehicle image associated with the in-vehicle image. The in-vehicle device according to (5) or (6) above. (8) The vehicle further includes an imaging unit mounted outside the vehicle, The in-vehicle display unit displays the in-vehicle image superimposed on the image captured by the imaging unit. The in-vehicle device according to any one of (1) to (7) above. (9) The voice output unit outputs voice associated with the out-vehicle image. The in-vehicle device according to (5) above. (10) The vehicle further includes a recognition unit that recognizes people around the vehicle, The voice output unit outputs the voice according to the recognition result by the recognition unit. The in-vehicle device according to (9) above. (11) An in-vehicle display unit mounted inside the vehicle, and an audio output unit mounted outside the vehicle, wherein a control device mounted on the vehicle equipped with these components plays content including an in-vehicle image displayed on the in-vehicle display unit and audio output from the audio output unit. Content playback method. (12) An in-vehicle display unit mounted inside the vehicle, and an audio output unit mounted outside the vehicle, wherein a computer that controls a control device mounted on the vehicle equipped with these components executes a process of playing content including an in-vehicle image displayed on the in-vehicle display unit and audio output from the audio output unit. Program for causing the execution.

Description of Reference Numerals

[0118] 1 Cart, 11F to 11B Out-vehicle display unit, 12F to 12B Camera, 13F to 13B Out-vehicle speaker, 21 In-vehicle display unit, 22L, 22R In-vehicle speaker 51 Input unit, 52 Control unit, 61 Content playback unit, 62 Content storage unit, 63 Position information acquisition unit, 101 Pedestrian recognition unit

Claims

1. An in-vehicle display unit mounted inside the vehicle, An audio output unit mounted outside the vehicle, A position information acquisition unit that acquires the position information of the vehicle, A playback unit that plays back content including an in-vehicle image displayed on the in-vehicle display unit and audio output from the audio output unit in response to the vehicle reaching a predetermined position An in-vehicle device comprising:

2. The audio output unit outputs an effect sound linked to the in-vehicle image as the audio The in-vehicle device according to claim 1.

3. The audio output unit is mounted on each of a plurality of surfaces of the vehicle body The in-vehicle device according to claim 1 or 2.

4. Further comprising an out-vehicle display unit mounted outside the vehicle, The playback unit plays back the content further including an out-vehicle image displayed on the out-vehicle display unit The in-vehicle device according to any one of claims 1 to 3.

5. The out-vehicle display unit is mounted on each of a plurality of surfaces of the vehicle body The in-vehicle device according to claim 4.

6. The out-vehicle display unit displays the out-vehicle image linked to the in-vehicle image The in-vehicle device according to claim 4 or 5.

7. Further comprising an imaging unit mounted outside the vehicle, The in-vehicle display unit displays the in-vehicle image by superimposing it on the image captured by the imaging unit The in-vehicle device according to any one of claims 1 to 6.

8. The audio output unit outputs audio linked to the out-vehicle image The in-vehicle device according to claim 4.

9. further comprising a recognition unit that recognizes a person around the vehicle, the voice output unit outputs the voice according to the recognition result by the recognition unit The in-vehicle device according to claim 8.

10. an in-vehicle display unit mounted inside the vehicle, a voice output unit mounted outside the vehicle, and a control device mounted on the vehicle equipped with the above, obtains the position information of the vehicle, reproduces content including an in-vehicle image displayed on the in-vehicle display unit and voice output from the voice output unit in response to the vehicle reaching a predetermined position, and A content playback method including the above.

11. an in-vehicle display unit mounted inside the vehicle, a voice output unit mounted outside the vehicle, and a computer constituting a control device mounted on the vehicle equipped with the above, obtains the position information of the vehicle, reproduces content including an in-vehicle image displayed on the in-vehicle display unit and voice output from the voice output unit in response to the vehicle reaching a predetermined position, and A program for causing the computer to execute a process including the above.

Citation Information

Patent Citations

  • Car game apparatus

    JP1997234289A

  • Game device using game vehicle

    JP2001129262A

  • Vehicle control system, vehicle control method, and vehicle control program

    JP2017199317A

  • Automobile

    JP2019117215A

  • Vehicle acoustic device and attachment structure of vehicle acoustic device

    JP2019166980A