Content processing system, content generation device, and content reproduction device

Abstract

To reduce costs related to content generation.SOLUTION: A content generation device (10) generates content according to a landscape that changes according to movement of a vehicle (30) on the basis of information related to an internal space of the vehicle and information related to traveling of the vehicle.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a content processing system, a content generation device, and a content playback device. [Background technology]

[0002] Conventionally, there are known inventions that generate content that allows a user to experience virtual reality (VR) or augmented reality (AR) in accordance with the movement of a moving object, and generate physical events within the content that are linked to the scenery outside the moving object (e.g., Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-103782 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the invention described in Patent Document 1, images transmitted in real time from a camera are used when generating content. In other words, in the invention described in Patent Document 1, an actual moving object needs to be driven when generating content. For this reason, the invention described in Patent Document 1 increases the cost of generating content.

[0005] One aspect of the present disclosure aims to reduce costs associated with content generation. [Means for solving the problem]

[0006] In order to solve the above problems, a content processing system according to one embodiment of the present disclosure is a content processing system including a content generation device, a storage device, and a content playback device mounted on a moving body, wherein the content generation device acquires information regarding the interior space of the moving body, acquires information regarding the movement of the moving body, and generates content corresponding to the scenery that changes as the moving body moves based on the information regarding the interior space and the information regarding the movement, stores the generated content in the storage device, and the content playback device acquires information regarding the interior space of the moving body, acquires information regarding the movement of the moving body, acquires content corresponding to the information regarding the interior space and the information regarding the movement from the storage device, and plays the acquired content.

[0007] In order to solve the above problems, a content generation device according to one aspect of the present disclosure is a content generation device including a processor, which acquires information regarding the interior space of an external moving body, acquires information regarding the movement of the external moving body, and generates content corresponding to the landscape that changes as the external moving body moves based on the information regarding the interior space and the information regarding the movement, and stores the generated content in an external storage device.

[0008] In order to solve the above problems, a content playback device according to one embodiment of the present disclosure is a content playback device mounted on a moving body and includes a processor, which acquires information regarding the internal space of the moving body, acquires information regarding the movement of the moving body, acquires content corresponding to the information regarding the internal space and the information regarding the movement from an external storage device, and plays the acquired content.

[0009] The content generation device and content playback device according to each aspect of the present disclosure may be realized by a computer. In this case, a control program for realizing the content generation device and the content playback device on a computer by causing the computer to operate as each unit (software element) of the content generation device and the content playback device, and a computer-readable recording medium on which the control program is recorded, also fall within the scope of the present disclosure. Effect of the Invention

[0010] According to one aspect of the present disclosure, it is possible to reduce costs associated with content generation. [Brief description of the drawings]

[0011] [Figure 1] 1 is a schematic configuration diagram illustrating an example of a content processing system according to a first embodiment of the present disclosure. [Diagram 2] 1 is a block diagram showing an example of a hardware configuration of a content generating device according to a first embodiment of the present disclosure. [Diagram 3] FIG. 2 is a block diagram showing an example of a hardware configuration of a server according to the first embodiment of the present disclosure. [Figure 4] 1 is a block diagram showing an example of a hardware configuration mounted on a vehicle according to a first embodiment of the present disclosure. [Diagram 5] 2 is a functional block diagram of a processor of the content generation device according to the first embodiment of the present disclosure. FIG. [Figure 6] 2 is a simulation screen simulating a part of an interior space of a vehicle according to the first embodiment of the present disclosure. [Figure 7] 13 is another example of a simulation screen. [Figure 8] FIG. 2 is a functional block diagram of a processor of a vehicle according to the first embodiment of the present disclosure. [Figure 9] FIG. 2 is a diagram for explaining the relationship of content for each location. [Figure 10]4 is a sequence chart showing an example of content processing performed among the content generation device according to the first embodiment of the present disclosure, a server, and a vehicle. [Figure 11] FIG. 11 is a block diagram showing an example of a hardware configuration mounted on a vehicle according to a second embodiment of the present disclosure. [Figure 12] FIG. 11 is a functional block diagram of a processor of a vehicle according to a second embodiment of the present disclosure. [Figure 13] FIG. 11 is a block diagram showing an example of a hardware configuration mounted on a vehicle according to a third embodiment of the present disclosure. [Figure 14] FIG. 11 is a functional block diagram of a processor of a vehicle according to a third embodiment of the present disclosure. [Figure 15] FIG. 11 is a block diagram showing an example of a hardware configuration mounted on a vehicle according to a fourth embodiment of the present disclosure. [Figure 16] FIG. 11 is a functional block diagram of a processor of a vehicle according to a fourth embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] [Embodiment 1] Hereinafter, the content processing system 100 according to the first embodiment of the present disclosure will be described in detail with reference to the drawings. In the description of the drawings, the same parts are given the same reference numerals and the description will be omitted.

[0013] As shown in FIG. 1, the content processing system 100 includes a content generation device 10, a server 20, and a vehicle 30. Although one content generation device, one server, and one vehicle are shown in FIG. 1, the number of content generation devices, servers, and vehicles is not limited to one. The content processing system 100 may include a plurality of content generation devices, a plurality of servers, and a plurality of vehicles. As an example of the operation of such a content processing system 100, content to be reproduced in the interior space of the vehicle 30 is generated, the generated content is stored in the server 20, and content corresponding to predetermined information is reproduced in the interior space of the vehicle 30.

[0014] The content generation device 10 and the server 20 are connected via a communication network 50 so as to enable communication between them. Also, the vehicle 30 and the server 20 are connected via the communication network 50 so as to enable communication between them. Note that the content generation device 10 and the vehicle 30 may or may not be connected via the communication network 50. Note that in this embodiment, the content generation device 10 and the vehicle 30 are described as not being connected via the communication network 50. The communication network 50 is, for example, the Internet, but is not limited thereto and other wireless communication methods may be adopted.

[0015] The content generation device 10 is a device for generating content according to the landscape that changes as the vehicle 30 moves. In this embodiment, the content generation device 10 is described as a general-purpose computer, but is not limited to this and may be a simulator configured with dedicated hardware. The content generated by the content generation device 10 is transmitted to the server 20 via the communication network 50 and stored therein.

[0016] As an example of the content generated by the content generation device 10, the content corresponding to the scenery that changes as the vehicle 30 moves has been described, but more specifically, it is a virtual image linked to the scenery that changes as the vehicle 30 moves. In other words, the content generated by the content generation device 10 is content for providing "mixed reality" (MR). However, the content generated by the content generation device 10 is not limited to this. The content generated by the content generation device 10 may be content for providing "virtual reality" or content for providing "augmented reality".

[0017] The vehicle 30 is equipped with various devices for playing back the content generated by the content generation device 10. The vehicle 30 also stores an application for controlling the playback of the content generated by the content generation device 10. This application corresponds to a "content playback application 441" described later. This application requests the server 20 for content corresponding to predetermined information, and plays back the content obtained from the server 20 using various devices.

[0018] In this embodiment, the vehicle 30 is described as a bus equipped with an automatic driving function, but is not limited thereto. The vehicle 30 does not have to be equipped with an automatic driving function. In addition, the vehicle 30 is not limited to a bus, and may be a private car, a taxi, or any other vehicle.

[0019] Although the description will be given taking a vehicle 30 as an example of a moving body to which the content processing system 100 is applied, the moving body is not limited to the vehicle 30. The moving body may be a ship, an aircraft, a spacecraft, or the like.

[0020] (Example of Hardware Configuration of Content Generation Device 10) Next, an example of a hardware configuration of the content generation device 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of a hardware configuration of the content generation device 10.

[0021] 2, the content generator 10 includes a processor 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a storage unit 14, an input / output I / F 15, and a communication I / F 16. Each component is connected to each other via a bus 17 so as to be able to communicate with each other.

[0022] The processor 11 is an arithmetic unit that executes various programs, such as a CPU (Central Processing Unit). The processor 11 reads programs from the ROM 12 or the storage unit 14, and executes the various programs using the RAM 13 as a working area. Although one processor 11 is shown in FIG. 2, the present invention is not limited to this, and multiple processors 11 may be provided.

[0023] The ROM 12 stores various programs and various data. The RAM 13 temporarily stores programs or data as a working area. Note that computer-readable recording media are not limited to the ROM 12 and RAM 13, and may include EPROM (Erasable Programmable ROM), EEPROM (registered trademark) (Electrically Erasable Programmable ROM), etc.

[0024] The storage unit 14 is configured with a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc., and stores various programs and various data. In this embodiment, a content generation program 141 is stored in the storage unit 14.

[0025] The content generation program 141 is a program used to generate content for providing mixed reality. Although details will be described later, the content generation program 141 is a program that references scenery information stored in advance in the storage unit 14 and generates content according to scenery that changes as the vehicle 30 moves.

[0026] An example of the scenery information pre-stored in the storage unit 14 is image data of the surrounding scenery captured by a camera while the vehicle 30 is moving. This image data is linked to the position information at the time of capturing the image and stored in the storage unit 14 as scenery information. However, the scenery information is not limited to this. For example, the scenery information may be data obtained by referring to high-precision three-dimensional map data, so-called HD map (High Definition).

[0027] The input / output I / F 15 is an interface used for connecting input devices such as a mouse, keyboard, and touch panel, and output devices such as a display, microphone, and speaker.

[0028] The communication I / F 16 is an interface used for communication with the server 20, and is implemented as hardware such as a network adapter, communication software, or a combination of these.

[0029] (Example of hardware configuration of server 20) Next, an example of a hardware configuration of the server 20 will be described with reference to Fig. 3. Fig. 3 is a block diagram showing an example of a hardware configuration of the server 20.

[0030] 3, the server 20 includes a processor 21, a ROM 22, a RAM 23, a storage unit 24, and a communication I / F 26. Each component is connected via a bus 27 so as to be able to communicate with each other.

[0031] The configurations of the processor 21, ROM 22, RAM 23, memory unit 24, and communication I / F 26 are similar to the configurations of the processor 11, ROM 12, RAM 13, memory unit 14, and communication I / F 16 of the content generation device 10 described above, so the explanation will be omitted.

[0032] The storage unit 24 stores the content 241 transmitted from the content generator 10.

[0033] (Example of hardware configuration installed in vehicle 30) Next, an example of a hardware configuration mounted on the vehicle 30 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of a hardware configuration mounted on the vehicle 30.

[0034] As shown in FIG. 4, the vehicle 30 includes a positioning device 31, a camera 32, a vehicle ECU 40 (Electronic Control Unit), a display 33, and a speaker .

[0035] The positioning device 31 measures the position of the vehicle 30. The positioning device 31 is not particularly limited and may be, for example, a GNSS (Global Navigation Satellite System) receiver. The positioning device 31 outputs position information indicating the measured position to the vehicle ECU 40. Note that the method of measuring the position of the vehicle 30 is not limited to a method using the positioning device 31 and may be, for example, a method using odometry information based on the acceleration of the vehicle 30. Therefore, it is not essential that the positioning device 31 is installed in the vehicle 30.

[0036] The camera 32 has an imaging element such as a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The camera 32 may be installed at any position where it is possible to capture an image of the face of a passenger sitting in a seat (not shown in FIG. 4) of the vehicle 30. The number of cameras 32 installed is not particularly limited, and may be one, or two or more. The camera 32 may be a visible light camera, or an infrared camera having an infrared function.

[0037] The camera 32 photographs the passenger's face at a predetermined period and outputs the photographed image data to the vehicle ECU 40. When the camera 32 photographs the passenger's face, the photographing method may be a still image or a video. The image data is used to estimate the passenger's line of sight. Details will be described later.

[0038] The vehicle ECU 40 is a device that executes various controls. As such an ECU, an engine ECU for controlling the engine, a brake ECU for controlling the brakes, or the like may be provided separately for each mechanism of the vehicle 30. The vehicle ECU 40 in this embodiment may be an ECU dedicated to providing content to passengers, or the engine ECU, the brake ECU, or the like may function as the vehicle ECU 40.

[0039] A description will now be given of an example of a hardware configuration of the vehicle ECU 40. The vehicle ECU 40 includes a processor 41, a ROM 42, a RAM 43, a storage unit 44, and a communication I / F 46. Each component is connected via a bus 47 so as to be able to communicate with each other.

[0040] The configurations of the processor 41, ROM 42, RAM 43, and storage unit 44 are similar to the configurations of the processor 11, ROM 12, RAM 13, and storage unit 14 of the content generation device 10 described above, and therefore will not be described.

[0041] The storage unit 44 stores a content playback application 441 and a device database 442.

[0042] As described above, the content playback application 441 is an application for controlling the playback of the content generated by the content generator 10. The content playback application 441 requests the server 20 for content corresponding to predetermined information, and plays back the content acquired from the server 20 using various devices mounted on the vehicle 30.

[0043] The device database 442 stores information on the location of various devices mounted on the vehicle 30 and information on the types of devices. "Device location information" is information that indicates where in the vehicle 30 the device is located.

[0044] The communication I / F 46 is not particularly limited, but may be, for example, an interface for an in-vehicle network conforming to the CAN (Controller Area Network) standard. The communication I / F 46 also includes an interface used for communication with the server 20.

[0045] The display 33 is one of various devices mounted on the vehicle 30, and functions as a display device that displays content. The number of displays 33 mounted on the vehicle 30 is not particularly limited, and may be one or two or more. In the present embodiment, the display 33 is described as being mounted in a plurality of displays. As an example, the display 33 is described as a display that can be switched between transparent and opaque, which is called a "smart window." In the "smart window," for example, it becomes opaque when not energized, and becomes transparent when energized. That is, the display 33 according to the present embodiment functions as a "transparent window" by controlling the current, while also functioning as a "display device that displays content." In the present embodiment, the "windows" of the vehicle 30 are all described as being composed of the display 33, but are not limited thereto. A part of the "windows" of the vehicle 30 may be composed of the display 33.

[0046] The speaker 34 is one of various devices mounted on the vehicle 30, and functions as an audio output device that outputs audio of the content. The number of speakers 34 mounted on the vehicle 30 is not particularly limited, and may be one, or may be two or more. Note that in this embodiment, a description will be given assuming that a plurality of speakers 34 are mounted.

[0047] (Functions of the processor 11 of the content generation device 10) Next, an example of the functions of the processor 11 of the content generation device 10 will be described with reference to Fig. 5. Fig. 5 is a functional block diagram of the processor 11 of the content generation device 10. As shown in Fig. 5, in the content generation device 10 of the present embodiment, the processor 11 executes a content generation program 141 to function as an information acquisition unit 111, a content generation unit 112, and an output unit 113.

[0048] The information acquisition unit 111 acquires information necessary for generating the content. In this embodiment, examples of the information necessary for generating the content include three pieces of information: (A1) layout information of various devices mounted on the vehicle 30, (A2) gaze information of passengers, and (A3) driving information of the vehicle 30. An example of the "layout information of various devices mounted on the vehicle 30" here is layout information of the display 33 and layout information of the speaker 34. An example of the "driving information of the vehicle 30" is position information when the vehicle 30 is driving and scenery information linked to this position information. Note that it is not essential to use the three pieces of information (A1) to (A3) when generating the content, and the content may be generated using, for example, two pieces of information (A1) and (A3).

[0049] As an example of a method for acquiring the three pieces of information (A1) to (A3), there is a method using an input module prepared in the content generation program 141. The "input module" here is a module for a person who generates content (hereinafter simply referred to as a "content generator") to input initial conditions and parameters required for generating content. For example, if the input module is configured to provide items for inputting "display 33 layout information," "speaker 34 layout information," "passenger line of sight information," and "vehicle 30 position information," the content generator may input these pieces of information into the input module. The content generation program 141 can acquire the "scenery information linked to the vehicle 30 position information" by referring to the storage unit 14 based on the "vehicle 30 position information" input into the input module.

[0050] Here, an example of the operation of the content generation program 141 in a case where three pieces of information are input by the content generator will be described with reference to Fig. 6. Fig. 6 shows a simulation screen simulating a part of the interior space of the vehicle 30 in a case where three pieces of information are input by the content generator. As shown in Fig. 6, virtual displays 61A, 61B, virtual seats 62A, 62B, virtual passengers 63A, 63B seated in the virtual seats 62A, 62B, and virtual speakers 64A, 64B are displayed on the simulation screen 60.

[0051] The content generation program 141 receives input from a content generator, and generates a simulation screen 60 based on this input.

[0052] The virtual displays 61A and 61B are virtual representations of a plurality of displays 33 mounted on the actual vehicle 30. The virtual seats 62A and 62B are virtual representations of a plurality of seats mounted on the actual vehicle 30. The virtual passengers 63A and 63B are virtual representations of passengers who get on the actual vehicle 30. The virtual speakers 64A and 64B are virtual representations of a plurality of speakers 34 mounted on the actual vehicle 30. The arrow in FIG. 6 indicates the line of sight of the virtual passenger 63A. Here, the line of sight of the virtual passenger 63A is indicated by a three-dimensional coordinate system, but is not limited thereto. It is assumed that the content generator has also inputted the layout information of the actual seats. The layout information of the seats may be included in the "layout information of various devices mounted on the vehicle 30" described in (A1) above.

[0053] The content generator generates the simulation screen 60 using the content generation program 141, and then generates content according to the scenery that changes as the vehicle 30 moves. The content generation method is not particularly limited, but for example, a method using a generation module prepared in the content generation program 141 can be mentioned. The "generation module" here is a module having a plurality of models for generating content according to the scenery that changes as the vehicle 30 moves. The content generator can select a model that the content generator wants to provide to passengers from among the plurality of models. Examples of the plurality of models include a model in which a mammoth appears in accordance with the scenery that changes as the vehicle 30 moves, and a model in which fireworks are launched in accordance with the scenery that changes as the vehicle 30 moves. Here, it is assumed that the content generator selects a model in which a mammoth appears. In this case, the content generation program 141 generates content in which a mammoth appears, as shown in FIG. 6, according to the selection of the content generator.

[0054] The mammoth is a three-dimensional object arranged in a virtual space corresponding to the landscape that changes as the vehicle 30 moves. The term "virtual space" used here means a three-dimensional space model consisting of a three-dimensional map of a predetermined range and various three-dimensional objects arranged in the three-dimensional map. The virtual space may be a space model that faithfully copies the real space in which the vehicle 30 actually travels, or may be a space model that imitates a space in which the vehicle 30 cannot actually travel, such as the bottom of the sea or the air. In addition, the virtual space may contain a mixture of maps and objects that exist in the real space or imitate events that exist in the real space, and maps and objects that do not exist in the real space or imitate events that do not exist in the real space.

[0055] The operation of the content generation program 141 using the generation module corresponds to the "content generation unit 112."

[0056] By using the line-of-sight information of the virtual passenger 63A, the content creator can generate the content while checking the view seen by a passenger who actually gets on the vehicle 30. For example, the view seen by the virtual passenger 63A in FIG. 6 is the view shown in FIG. 7. As shown in the simulation screen 70 in FIG. 7, the virtual passenger 63A can see the virtual displays 61A and 61C from his line of sight, but cannot see the virtual display 61B. In this way, by generating the content while checking the line of sight of the virtual passenger 63A as if he were on the vehicle 30, it is possible to provide the content that does not feel strange even if a passenger actually gets on the vehicle. Note that the virtual display 61C arranged to the left of the virtual display 61A is omitted in FIG. 6.

[0057] By generating content while performing such a simulation, it is possible to generate content according to the scenery that changes as the vehicle 30 moves, without actually running the vehicle 30. Also, it is possible to check on the simulator how the content will look to passengers when the vehicle 30 is running, without actually running the vehicle 30. Thus, according to this embodiment, content can be generated and checked without actually running the vehicle 30, and therefore the cost associated with content generation can be reduced.

[0058] The output unit 113 transmits the content generated by the content generation unit 112 to the server 20. The server 20 stores the content transmitted from the content generation device 10.

[0059] (Functions of processor 11 of vehicle 30) Next, an example of functions of the processor 41 of the vehicle 30 will be described with reference to Fig. 8. Fig. 8 is a functional block diagram of the processor 41 of the vehicle 30. As shown in Fig. 8, in the vehicle ECU 40 of this embodiment, the processor 41 executes a content playback application 441 to function as an information acquisition unit 411, a content request unit 412, a content acquisition unit 413, a display control unit 414, and a sound control unit 415.

[0060] The information acquisition unit 411 acquires information for requesting the server 20 for the content to be reproduced. In this embodiment, examples of information required for requesting the content to be reproduced include three pieces of information: (B1) layout information of various devices mounted on the vehicle 30, (B2) gaze information of passengers, and (B3) driving information of the vehicle 30. An example of the "layout information of various devices mounted on the vehicle 30" here is layout information of the display 33 and layout information of the speaker 34. Also, an example of the "driving information of the vehicle 30" is position information when the vehicle 30 is driving. That is, in this embodiment, the above-mentioned three pieces of information (A1) to (A3) correspond to the three pieces of information (B1) to (B3). Note that it is not essential to use the three pieces of information (B1) to (B3) when requesting the content to be reproduced, and the content may be requested using, for example, two pieces of information (B1) and (B3).

[0061] An example of a method for acquiring the three pieces of information (B1) to (B3) will be described. First, the content playback application 441 can acquire the "layout information of the display 33" and the "layout information of the speaker 34" by referring to the device database 442 stored in the storage unit 44.

[0062] Next, the content playback application 441 can acquire the "passenger line of sight information" by analyzing the image data of the camera 32 using a known method.

[0063] Next, the content playback application 441 can obtain the “location information of the vehicle 30 ” from the positioning device 31 .

[0064] The content playback application 441 requests the content corresponding to these three pieces of information from the server 20. This function corresponds to the content request unit 412.

[0065] Next, the content playback application 441 acquires the content transmitted from the server 20. This function corresponds to the content acquisition unit 413. Then, the content playback application 441 uses the display 33 and the speaker 34 to play back the content acquired from the server 20. This function corresponds to the display control unit 414 and the audio control unit 415.

[0066] An example of the operation of the content playback application 441 will now be described with reference to Fig. 9. Fig. 9 is a diagram illustrating the relationship between points that the vehicle 30 passes through when traveling from a departure point 80 to a destination 81 and the content for each point.

[0067] At point A, the content playback application 441 acquires the above-mentioned information (B1) to (B3), i.e., the layout information of the display 33 at point A, the layout information of the speakers at point A, the gaze information of the passengers at point A, and the position information of the vehicle 30 at point A. The content playback application 441 requests the server 20 for content corresponding to the acquired information.

[0068] The server 20 identifies the content corresponding to the information acquired from the content playback application 441, and transmits the identified content to the content playback application 441. Here, the content corresponding to the point A is referred to as “content A.” That is, the server 20 transmits the content A to the content playback application 441.

[0069] The content playback application 441 plays back the content A acquired from the server 20 using the display 33 and the speaker .

[0070] In addition, FIG. 9 shows an example in which the content is divided for each location. This is because it is assumed that there is a limit to the range of movement that can be simulated in the simulation when generating the content. If there is no limit to the range of movement, the capacity of the content increases as the distance traveled increases, which may increase the burden of managing the content on the server 20 and increase the time and load when downloading the content from the server 20. Therefore, in this embodiment, as shown in FIG. 9, the content is generated within the range of movement that can be simulated for each location. In this way, if the content is divided for each location, the burden of managing the content on the server 20 and the time and load when downloading the content from the server 20 are reduced. However, it is not necessary that the content is divided for each location. In addition, the range of movement that can be simulated is not particularly limited, but one example is 500 m.

[0071] When the vehicle 30 passes point A and arrives at point B, the content playback application 441 acquires the above-mentioned information (B1) to (B3) at point B, i.e., the layout information of the display 33 at point B, the layout information of the speakers at point B, the gaze information of the passengers at point B, and the position information of the vehicle 30 at point B.

[0072] Here, when various devices (display 33 and speaker 34 in FIG. 9) mounted on vehicle 30 are fixed so as to be immovable, content playback application 441 may not acquire device arrangement information at a subsequent location once it has acquired device arrangement information, and may reuse previously acquired device arrangement information. In other words, when display 33 and speaker 34 are fixed so as to be immovable, content playback application 441 may reuse, at location B, arrangement information of display 33 and speaker 34 acquired at location A. Of course, when display 33 and speaker 34 are movable, content playback application 441 may acquire arrangement information of display 33 and speaker 34 each time.

[0073] Similar to the operation at point A, the content playback application 441 requests the server 20 for content corresponding to the information acquired at point B.

[0074] The server 20 identifies the content corresponding to the information acquired from the content playback application 441, and transmits the identified content to the content playback application 441. Here, the content corresponding to the point B is referred to as “content B.” That is, the server 20 transmits content B to the content playback application 441.

[0075] The content playback application 441 plays back the content B acquired from the server 20 using the display 33 and the speaker .

[0076] The operation of the content playback application 441 at points C and D is the same as that at points A and B, and therefore a description thereof will be omitted.

[0077] The content may include an event. An "event" here is an event that passengers can perceive with the five senses. Examples of such events include scent, wind, vibration, sound, and light. The above-mentioned fireworks are also a type of event. If the images show fireworks, passengers can enjoy them visually, and if the sounds of fireworks going off and popping are output from speaker 34 in sync with the images of the fireworks, passengers can also enjoy them aurally. Such events can be set for each location, that is, for each content.

[0078] The data included in the content is not particularly limited, but may include, for example, mp4 video data for each location, wav audio data, json video control information, and the like.

[0079] The content playback application 441 may transmit a vehicle ID for identifying the vehicle 30 when requesting content from the server 20. By using the vehicle ID, the server 20 can manage which content has been transmitted to which vehicle.

[0080] 9, for convenience of explanation, the section from the departure point 80 to point A, the section from point A to point B, the section from point B to point C, the section from point C to point D, and the section from point D to destination 81 are illustrated as sections without content, but this is not limiting. Content may exist in all sections from the departure point 80 to the destination 81 without any gaps.

[0081] (An example of content processing) Next, an example of content processing carried out among the content generator 10, the server 20, and the vehicle 30 will be described with reference to a sequence chart of FIG.

[0082] In step S101, the processor 11 of the content generator 10 acquires three pieces of information: (A1) arrangement information of various devices mounted on the vehicle 30; (A2) passenger line-of-sight information; and (A3) vehicle 30 running information.

[0083] The process proceeds to step S102, where processor 11 of content generation device 10 generates simulation screen 60 (see FIG. 6) based on the three pieces of information (A1) to (A3) acquired in the process of step S101. Processor 11 of content generation device 10 generates content according to the scenery that changes as vehicle 30 moves, in response to the operation of the content generator on simulation screen 60.

[0084] The process proceeds to step S103, where the processor 11 of the content generation device 10 transmits the content generated in the process of step S102 to the server 20. As described in FIG. 9, when content is generated for each location, each of the contents generated for each location is transmitted to the server 20.

[0085] In step S104, the server 20 stores the content transmitted from the content generator 10.

[0086] In step S105, the vehicle 30 travels toward the set destination 81 (see FIG. 9).

[0087] The process proceeds to step S106, where the processor 41 of the vehicle 30 acquires three pieces of information, (B1) placement information of various devices mounted on the vehicle 30, (B2) gaze information of passengers, and (B3) driving information of the vehicle 30, at point A on the way to the destination 81. The three pieces of information (A1) to (A3) in step S101 correspond to the three pieces of information (B1) to (B3) in step S106, respectively.

[0088] The process proceeds to step S107, where the processor 41 of the vehicle 30 requests the server 20 for the content corresponding to the information acquired in the process of step S106.

[0089] In step S108, the server 20 identifies content corresponding to the information acquired from the vehicle 30, and transmits the identified content to the vehicle 30. For example, when the vehicle 30 is traveling at point A, the server 20 transmits content A to the vehicle 30.

[0090] In step S109, the processor 41 of the vehicle 30 acquires the content (eg, content A) from the server 20.

[0091] The process proceeds to step S110, where the processor 41 of the vehicle 30 reproduces, using the display 33 and the speaker , the content (eg, content A) acquired in the process of step S109.

[0092] Note that the process flow in the sequence chart shown in FIG. 10 is just an example, and steps may be deleted, new steps may be added, or the process order may be changed without departing from the spirit of the invention.

[0093] For example, in step S106, the processor 41 of the vehicle 30 starts acquiring the three pieces of information (B1) to (B3), but may start acquiring them on condition that a predetermined trigger is received. The predetermined trigger is, for example, a signal transmitted from a passenger's smartphone. When a passenger wants to experience content, the passenger can experience the content by operating a dedicated application installed on the passenger's smartphone. The processor 41 of the vehicle 30 may start acquiring the three pieces of information on condition that a signal generated when the dedicated application is operated is received.

[0094] (Modification of the first embodiment) Next, a modification of the first embodiment will be described.

[0095] In the above, it has been described that the three pieces of information (A1) to (A3) are used when generating the content, but this is not limiting. When generating the content, in addition to these three pieces of information, other information may be added to generate the content. For example, the content generation program 141 may generate the content by adding information on the type of device in addition to the three pieces of information.

[0096] The term "device type" as used here refers to a type that is distinguished by the device's performance, shape, features, and the like. For example, displays 33 can be classified into two types: "displays that can be switched between transparent and opaque" and "general-purpose displays that cannot be switched between transparent and opaque." Depending on which of these two types of displays is installed in vehicle 30, the content to be generated may be changed. Note that these two types of classifications are merely examples, and it goes without saying that there are many types of displays, such as displays with curved surfaces and foldable displays.

[0097] As another example, the speaker 34 can be classified into three types: a "monaural speaker," a "stereo speaker," and a "multi-channel speaker." The content to be generated may be changed depending on which of these three types of speakers is installed in the vehicle 30. Note that these three types of classifications are merely an example, and it goes without saying that there are many types of speakers, such as speakers that excel in low tones, speakers that excel in high tones, and speakers that support high-resolution sound sources.

[0098] In this way, by generating content by adding information on the type of device in addition to the three pieces of information (A1) to (A3), it becomes possible to generate content that makes the most of the device's capabilities. The type of device can be input by the content creator into the content generation program 141.

[0099] Similarly, when the content playback application 441 requests content from the server 20, the content playback application 441 may also add information about the type of device. By storing the information about the type of device in advance in the storage unit 44, the content playback application 441 can obtain the information about the type of device at any timing.

[0100] (Action and effect) As described above, the content processing system 100 according to the first embodiment provides the following advantageous effects.

[0101] The content processing system 100 includes a content generator 10, a storage device, and a content playback device mounted on a mobile object. An example of the “storage device” here is the server 20, and an example of the “content playback device” is the vehicle ECU 40.

[0102] The content generator 10 acquires information relating to the internal space of the moving body, and acquires information relating to the traveling of the moving body. An example of the "information relating to the internal space of the moving body" here is the information in (A1) above. An example of the "information relating to the traveling of the moving body" is the information in (A3) above.

[0103] The content generation device 10 generates content according to the scenery that changes as the mobile body moves, based on information about the interior space of the mobile body and information about the traveling of the mobile body, and stores the generated content in a storage device.

[0104] The content playback device acquires information about the internal space of the moving body, and acquires information about the traveling of the moving body. An example of the "information about the internal space of the moving body" here is the information in (B1) above. An example of the "information about the traveling of the moving body" is the information in (B3) above.

[0105] The content reproduction device obtains, from the storage device, content corresponding to information regarding the interior space of the mobile body and information regarding the traveling of the mobile body, and reproduces the obtained content.

[0106] According to the above configuration, it is possible to generate content corresponding to the scenery that changes as the moving object moves, without actually running the moving object. Also, it is possible to check on a simulator how the content would look from the passengers' line of sight when the moving object is running, without actually running the moving object. In the conventional method described above, it was necessary to check how the content would look from the passengers' line of sight while actually running the moving object. This was a factor in increasing the cost of content generation. In contrast, in the present embodiment, it is possible to generate and check the content without actually running the moving object, thereby reducing the cost of content generation.

[0107] The content is virtual images such as mammoths and fireworks, so passengers can visually enjoy the virtual images linked to the scenery that changes as the moving object moves. Also, if the sounds of fireworks going off and popping are output from speaker 34 in sync with the images of fireworks, passengers can enjoy the content audibly as well. In this way, according to this embodiment, content that stimulates the five senses of passengers can be provided, allowing passengers to have a new experience.

[0108] From the viewpoint of the content generator 10, the storage device is an external storage device, and the mobile entity is an external mobile entity. Also, from the viewpoint of the mobile entity, the storage device is an external storage device.

[0109] The content generator 10 may further acquire information about a passenger seated in the interior space of the moving body. An example of the "information about a passenger seated in the interior space of the moving body" is the information (A2) described above. The "passenger" includes a driver who drives the moving body and passengers who ride in the moving body.

[0110] The content generation device 10 may generate content corresponding to the scenery that changes as the moving body moves, based on information about the interior space of the moving body, information about the occupants, and information about the traveling of the moving body, and store the generated content in a storage device.

[0111] The content playback device may further acquire information about an occupant seated in the interior space of the moving body. An example of the "information about an occupant seated in the interior space of the moving body" here is the information (B2) described above.

[0112] The content playback device may acquire content corresponding to information regarding the interior space of the vehicle, information regarding the occupants, and information regarding the traveling of the vehicle from the storage device, and play back the acquired content.

[0113] According to the above configuration, the same effects as those described above can be obtained.

[0114] The information regarding the interior space of the moving body may be arrangement information of at least one device arranged in the interior space of the moving body. The content generation device 10 may further acquire information regarding the type of the device. The content generation device 10 may generate content based on the arrangement information of the device, information regarding the occupant, information regarding the traveling of the moving body, and information regarding the type of the device.

[0115] The content playback device may also acquire information on the type of device. The content playback device may acquire content corresponding to the device arrangement information, the information on the occupant, the information on the running of the moving object, and the information on the type of device from the storage device.

[0116] According to the above configuration, by generating content by further adding information about the type of device, it is possible to generate content that makes the most of the device's capabilities.

[0117] Furthermore, the content generator 10 may generate content for each predetermined range, and store the content for each predetermined range in a storage device.

[0118] According to the above configuration, the burden of managing content in the storage device and the time and load required to download content from the storage device are reduced.

[0119] [Embodiment 2] Next, a second embodiment of the present disclosure will be described with reference to Figures 11 and 12. For ease of explanation, the same reference numerals will be used to designate members having the same functions as those described in the first embodiment, and the explanations thereof will not be repeated.

[0120] 11 is a block diagram showing an example of a hardware configuration mounted on a vehicle 30 according to embodiment 2. As shown in FIG.

[0121] If the seat 35 is provided with a vibration device 351, it is possible to provide passengers with a new experience by vibrating the seat 35 in accordance with the event. For example, if the event is fireworks, the seat 35 can be vibrated in time with the bursting of the fireworks, allowing passengers to virtually experience the vibration of the air when the fireworks burst, thereby providing a new experience. In this way, the content may include vibration in addition to video and audio.

[0122] When the seat 35 is provided with the vibration device 351, the processor 41 of the vehicle 30 can function as a vibration control unit 416 as shown in Fig. 12. In other words, the content playback application 441 functions as an application capable of controlling the vibration of the seat 35.

[0123] Furthermore, the content generation program 141 may generate content by adding information about the type of the vibration device 351. An example of the type of the vibration device 351 is the magnitude and period of the amplitude of vibration. By generating content while taking into consideration the magnitude and period of the amplitude, it becomes possible to generate content that makes the most of the performance of the vibration device 351.

[0124] [Embodiment 3] Next, a third embodiment of the present disclosure will be described with reference to Figures 13 and 14. For ease of explanation, the same reference numerals are given to members having the same functions as those described in the second embodiment, and the explanation thereof will not be repeated.

[0125] 13 is a block diagram showing an example of a hardware configuration mounted on a vehicle 30 according to embodiment 3. As shown in FIG.

[0126] If the vehicle 30 is provided with a lighting device 36, it is possible to provide passengers with a new experience by controlling the lighting device 36 in accordance with the event. For example, if the event is fireworks, the effect of the fireworks can be enhanced by lighting up the interior of the vehicle when the fireworks burst and darkening the interior of the vehicle at times other than when the fireworks burst, making it possible to provide passengers with a realistic space. In this way, the content may include lighting in addition to video, audio, and vibration.

[0127] When the lighting device 36 is provided in the vehicle 30, the processor 41 of the vehicle 30 can function as a lighting control unit 417 as shown in Fig. 14. In other words, the content playback application 441 functions as an application capable of controlling the lighting device 36.

[0128] Furthermore, the content generation program 141 may generate content by adding information about the type of lighting device 36. The type of lighting device 36 can be classified by, for example, dimming function. Specifically, there are lighting devices whose brightness can be adjusted in several steps and lighting devices whose color can be adjusted. By generating content while taking the type of lighting device 36 into consideration, it becomes possible to generate content that makes the most of the performance of the lighting device 36.

[0129] When switching between transparent and opaque states of the display 33, a smooth switching can be achieved by controlling the brightness of the display 33 using the lighting device 36.

[0130] [Embodiment 4] Next, a fourth embodiment of the present disclosure will be described with reference to Figures 15 and 16. For ease of explanation, the same reference numerals will be given to members having the same functions as those described in the third embodiment, and the explanation thereof will not be repeated.

[0131] 15 is a block diagram showing an example of a hardware configuration mounted on a vehicle 30 according to embodiment 4. As shown in FIG.

[0132] If the vehicle 30 is provided with the fragrance device 37, it is possible to provide passengers with a new experience by controlling the fragrance device 37 in accordance with the event. For example, if the event is fireworks, a lavender scent may be released into the vehicle in time with the bursting of the fireworks. This allows passengers to relax with the lavender scent while enjoying the fireworks, and thus provides a new experience. In this way, the content may include scents in addition to video, audio, vibration, and lighting.

[0133] When the fragrance device 37 is provided in the vehicle 30, the processor 41 of the vehicle 30 can function as a fragrance control unit 418, as shown in Fig. 16. In other words, the content playback application 441 functions as an application capable of controlling the fragrance device 37.

[0134] Furthermore, the content generation program 141 may generate content by adding information on the type of fragrance device 37, i.e., information on the type of fragrance. In addition to the above-mentioned lavender, examples of the types of fragrance include vanilla, rose, citrus, and jasmine. By generating content while taking the type of fragrance into consideration, it is possible to generate content that makes the most of the performance of the fragrance device 37.

[0135] Other embodiments The content may include any combination of video, audio, vibration, lighting, and scent.

[0136] [Software implementation example] The functions of the content generation device 10 and the content playback device can be realized by a program for causing a computer to function as the content generation device 10 and the content playback device, and a program for causing a computer to function as each control block of the content generation device 10 and the content playback device.

[0137] In this case, the content generator 10 and the content playback device are provided with a computer having at least one device (e.g., a processor) and at least one storage unit (e.g., a memory) as hardware for executing a program. The computer executes the program to realize each function described in each embodiment.

[0138] The program may be recorded on one or more computer-readable recording media, not on a temporary basis. The recording media may or may not be included in the content generation device 10 and the content playback device. In the latter case, the program may be supplied to the content generation device 10 and the content playback device via any wired or wireless transmission medium.

[0139] In addition, some or all of the functions of each control block can be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each control block is formed is also included in the scope of the present disclosure. In addition, the functions of each control block can be realized by, for example, a quantum computer.

[0140] Furthermore, each process described in each embodiment may be executed by AI (Artificial Intelligence). In this case, the AI ​​may operate on the content generation device 10 and the content playback device, or may operate on another device (such as an edge computer or a cloud server).

[0141] The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present disclosure. [Explanation of symbols]

[0142] 100 Content Processing System 10 Content generation device 20 Servers 30 Vehicles 40 Vehicle ECU 11, 21, 41 processors 14, 24, 44 storage section 441 Content playback app

Claims

1. A content processing system including a content generating device, a storage device, and a content reproducing device mounted on a mobile object, The content generating device, Acquire information regarding an interior space of the moving body; Acquire information regarding the traveling of the moving object; generating content according to a landscape that changes as the moving object moves, based on the information about the interior space and the information about the movement of the moving object; storing the generated content in the storage device; The content playback device includes: Acquire information regarding an interior space of the moving body; Acquire information regarding the traveling of the moving object; acquiring content corresponding to the information regarding the internal space and the information regarding the traveling from the storage device; Playing acquired content, Content processing system.

2. The content generating device, Acquire information regarding an occupant seated in an interior space of the vehicle; generating content according to a landscape that changes as the moving body moves, based on information about the interior space, information about the occupants, and information about the traveling; The content playback device includes: Acquire information regarding an occupant seated in an interior space of the vehicle; acquiring from the storage device content corresponding to information regarding the interior space, information regarding the occupants, and information regarding the traveling; Playing acquired content, The content processing system of claim 1 .

3. the information about the internal space of the moving body is location information of at least one device located in the internal space of the moving body; The content generating device, Obtaining information regarding the type of device; generating the content based on location information of the device, information about the occupant, information about the trip, and information about the type of the device; The content playback device includes: Obtaining information regarding the type of device; acquiring from the storage device content corresponding to the device arrangement information, information about the occupant, information about the traveling, and information about the type of the device; Playing the acquired content using the device; The content processing system according to claim 2 .

4. The content generating device, Generate content for each specified range, storing the content for each predetermined range in the storage device; The content processing system according to any one of claims 1 to 3.

5. A content generation device comprising a processor, The processor, Obtaining information about the interior space of an external moving body; Acquire information regarding the travel of the external moving object; generating content according to a landscape that changes as the external moving object moves, based on the information about the internal space and the information about the traveling; Storing the generated content in an external storage device; Content generation device.

6. A content playback device mounted on a moving object, comprising: A processor is provided. The processor, Acquire information regarding an interior space of the moving body; Acquire information regarding the traveling of the moving object; acquiring content corresponding to the information regarding the internal space and the information regarding the traveling from an external storage device; Playing acquired content, Content playback device.

Images