Content processing system, content generation device, and content reproduction device

Abstract

The invention relates to a content processing system, a content generation device, and a content reproduction device. The content generation device (10) generates content corresponding to a landscape that changes according to the movement of the vehicle, on the basis of information relating to the interior space of the vehicle (30) and information relating to the travel of the vehicle.

Description

Technical Field

[0001] The present disclosure relates to a content processing system, a content generating device, and a content reproducing device. Background Art

[0002] In the past, the following invention is known: content for allowing users to experience virtual reality (VR) and augmented reality (AR) is generated in coordination with the movement of a moving body, and physical events linked to the external scenery of the moving body occur on the content (for example, Patent Document 1).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2020-103782 Summary of the invention

[0006] Problem that the invention aims to solve

[0007] In the invention described in Patent Document 1, images transmitted from a camera in real time are used when generating content. That is, in the invention described in Patent Document 1, it is necessary to make an actual moving object run when generating content. Therefore, in the invention described in Patent Document 1, the cost associated with content generation increases.

[0008] One aspect of the present disclosure is to reduce costs associated with content generation.

[0009] Solutions for solving problems

[0010] In order to solve the above-mentioned problems, a content processing system involved in one embodiment of the present invention comprises a content generating device, a storage device, and a content reproducing device mounted on a mobile body, wherein the content generating device performs the following processing: obtaining information related to an interior space of the mobile body; obtaining information related to the travel of the mobile body; generating content corresponding to a landscape that changes according to the movement of the mobile body based on the information related to the interior space and the information related to the travel; and storing the generated content in the storage device, and the content reproducing device performs the following processing: obtaining information related to the interior space of the mobile body; obtaining information related to the travel of the mobile body; obtaining content corresponding to the information related to the interior space and the information related to the travel from the storage device; and reproducing the acquired content.

[0011] In order to solve the above-mentioned problem, a content generating device involved in one embodiment of the present invention is a content generating device having a processor, and the processor performs the following processing: obtaining information related to the internal space of an external mobile body; obtaining information related to the travel of the external mobile body; based on the information related to the internal space and the information related to the travel, generating content corresponding to the landscape that changes according to the movement of the external mobile body; and storing the generated content in an external storage device.

[0012] In order to solve the above-mentioned problems, a content reproducing device involved in one embodiment of the present invention is a content reproducing device mounted on a mobile body, and the content reproducing device has a processor, and the processor performs the following processing: obtaining information related to the internal space of the mobile body; obtaining information related to the driving of the mobile body; obtaining content corresponding to the information related to the internal space and the information related to the driving from an external storage device; and reproducing the acquired content.

[0013] The content generating device and content reproducing device involved in each method of the present disclosure may also be implemented by a computer. In this case, a control program that enables the content generating device and the content reproducing device to be implemented by a computer by causing the computer to act as the various parts (software elements) possessed by the content generating device and the content reproducing device, and a computer-readable recording medium recording the control program also fall within the scope of the present disclosure.

[0014] Effects of the Invention

[0015] According to one aspect of the present disclosure, the cost associated with content generation can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a schematic configuration diagram showing an example of a content processing system according to Embodiment 1 of the present disclosure.

[0017] Figure 2 This is a block diagram showing an example of the hardware configuration of the content generating device according to Embodiment 1 of the present disclosure.

[0018] Figure 3 This is a block diagram showing an example of the hardware configuration of the server according to Embodiment 1 of the present disclosure.

[0019] Figure 4 This is a block diagram showing an example of a hardware configuration mounted on a vehicle according to the first embodiment of the present disclosure.

[0020] Figure 5 This is a functional block diagram of a processor of the content generating device according to Embodiment 1 of the present disclosure.

[0021] Figure 6 This is a simulation screen that simulates a part of the interior space of the vehicle according to the first embodiment of the present disclosure.

[0022] Figure 7 This is another example of a simulation screen.

[0023] Figure 8 This is a functional block diagram of a processor of a vehicle according to Embodiment 1 of the present disclosure.

[0024] Fig. 9 It is a diagram illustrating the relationship between the contents of each location.

[0025] Fig.10 This is a sequence diagram showing an example of content processing performed among the content generating device, the server, and the vehicle according to the first embodiment of the present disclosure.

[0026] Fig.11 This is a block diagram showing an example of a hardware configuration mounted on a vehicle according to Embodiment 2 of the present disclosure.

[0027] Fig.12 This is a functional block diagram of a processor of a vehicle according to Embodiment 2 of the present disclosure.

[0028] Fig.13 This is a block diagram showing an example of a hardware configuration mounted on a vehicle according to Embodiment 3 of the present disclosure.

[0029] Fig.14 This is a functional block diagram of a processor of a vehicle according to Embodiment 3 of the present disclosure.

[0030] Fig.15 This is a block diagram showing an example of a hardware configuration mounted on a vehicle according to Embodiment 4 of the present disclosure.

[0031] Fig.16 This is a functional block diagram of a processor of a vehicle according to Embodiment 4 of the present disclosure. DETAILED DESCRIPTION

[0032] [Implementation method 1]

[0033] Hereinafter, the content processing system 100 according to the first embodiment of the present disclosure will be described in detail with reference to the drawings. In the description of the drawings, the same reference numerals are attached to the same parts, and the description thereof will be omitted.

[0034] like Figure 1 As shown, the content processing system 100 includes a content generation device 10, a server 20, and a vehicle 30. Figure 1, one content generation device, one server, and one vehicle are shown, but the number of content generation devices, servers, and vehicles is not limited to one. The content processing system 100 may also include a plurality of content generation devices, a plurality of servers, and a plurality of vehicles. As an example of the operation of such a content processing system 100, content to be reproduced in the interior space of the vehicle 30 is generated, the generated content is stored in the server 20, and content corresponding to the prescribed information is reproduced in the interior space of the vehicle 30.

[0035] The content generation device 10 and the server 20 are connected via the communication network 50 in a manner that allows communication. In addition, the vehicle 30 and the server 20 are connected via the communication network 50 in a manner that allows communication. In addition, the content generation device 10 and the vehicle 30 may be connected via the communication network 50 or may not be connected. In addition, in the present embodiment, it is assumed that the content generation device 10 and the vehicle 30 are not connected via the communication network 50 for explanation. The communication network 50 is, for example, the Internet, but is not limited thereto, and other wireless communication methods may also be used.

[0036] The content generation device 10 is a device for generating content corresponding to the scenery that changes according to the movement of the vehicle 30. In addition, in the present embodiment, the content generation device 10 is described as a general-purpose computer, but it is not limited to this, and it may also be a simulator composed of dedicated hardware. The content generated by the content generation device 10 is transmitted to the server 20 via the communication network 50 and stored.

[0037] As an example of the content generated by the content generating device 10, the content corresponding to the landscape that changes according to the movement of the vehicle 30 is described, but in more detail, it is a virtual image linked to the landscape that changes according to the movement of the vehicle 30. That is, the content generated by the content generating device 10 is a content for providing "mixed reality" (MR). However, the content generated by the content generating device 10 is not limited to this. The content generated by the content generating device 10 may also be a content for providing "virtual reality" or a content for providing "augmented reality".

[0038] The vehicle 30 is equipped with various devices for reproducing the content generated by the content generating device 10. In addition, an application for controlling the reproduction of the content generated by the content generating device 10 is stored in the vehicle 30. This application corresponds to the "content reproduction application 441" described later. The application requests the server 20 for content corresponding to the prescribed information, and reproduces the content acquired from the server 20 using various devices.

[0039] In this embodiment, the vehicle 30 is described as a bus with an automatic driving function, but the present invention is not limited thereto. The vehicle 30 may not have an automatic driving function. In addition, the vehicle 30 is not limited to a bus, but may be a private car, a taxi, or any other vehicle.

[0040] Although the vehicle 30 is described as an example of a mobile object applied to the content processing system 100, the mobile object is not limited to the vehicle 30. The mobile object may be a ship, an aircraft, a spacecraft, or the like.

[0041] (Hardware Configuration Example of Content Generating Device 10)

[0042] Next, refer to Figure 2 An example of the hardware configuration of the content generating device 10 will be described. Figure 2 This is a block diagram showing an example of the hardware configuration of the content generating device 10 .

[0043] like Figure 2 As shown, the content generating device 10 includes a processor 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a storage unit 14, an input / output I / F 15, and a communication I / F 16. Each component is connected via a bus 17 so as to be able to communicate with each other.

[0044] The processor 11 is a computing unit that executes various programs, such as a CPU (Central Processing Unit). The processor 11 reads programs from the ROM 12 or the storage unit 14, and uses the RAM 13 as a work area to execute various programs. Figure 2 One processor 11 is shown in the figure, but the invention is not limited thereto, and a plurality of processors 11 may be provided.

[0045] The ROM 12 stores various programs and various data. The RAM 13 temporarily stores programs or data as a work area. In addition, the computer-readable recording medium is not limited to the ROM 12 and the RAM 13, and may also include EPROM (Erasable Programmable ROM: Erasable Programmable ROM), EEPROM (registered trademark) (Electrically Erasable Programmable ROM: Electrically Erasable Programmable ROM), etc.

[0046] The storage unit 14 is composed of a HDD (Hard Disk Drive), an SSD (Solid State Drive), or a flash memory, and stores various programs and various data. In the present embodiment, a content creation program 141 is stored in the storage unit 14 .

[0047] The content generation program 141 is a program used to generate content for providing mixed reality. The content generation program 141 is a program that generates content corresponding to a landscape that changes as the vehicle 30 moves, with reference to landscape information pre-stored in the storage unit 14 , as will be described in detail later.

[0048] An example of the landscape information pre-stored in the storage unit 14 is image data obtained by capturing the surrounding landscape of the vehicle 30 when the vehicle 30 is moving by a camera. The image data is associated with the position information when the image data is captured and stored in the storage unit 14 as landscape information. However, the landscape information is not limited to this. For example, the landscape information may also be data obtained by referring to high-precision three-dimensional map data called a so-called HD map (High Definition).

[0049] The input / output I / F 15 is an interface used for connection with input devices such as a mouse, a keyboard, and a touch panel, and output devices such as a display, a microphone, and a speaker.

[0050] The communication I / F 16 is implemented as hardware such as a network adapter, communication software, or a combination thereof, and is an interface used for communication with the server 20 .

[0051] (Hardware Configuration Example of Server 20)

[0052] Next, refer to Figure 3 An example of the hardware configuration of the server 20 will be described. Figure 3 It is a block diagram showing an example of the hardware configuration of the server 20 .

[0053] like Figure 3 As shown, the server 20 includes a processor 21, a ROM 22, a RAM 23, a storage unit 24, and a communication I / F 26. Each component is connected via a bus 27 so as to be able to communicate with each other.

[0054] The configurations of the processor 21, ROM 22, RAM 23, storage unit 24, and communication I / F 26 are the same as those of the processor 11, ROM 12, RAM 13, storage unit 14, and communication I / F 16 of the above-described content generating device 10, and thus description thereof is omitted.

[0055] The storage unit 24 stores the content 241 transmitted from the content generating device 10 .

[0056] (Example of Hardware Configuration Mounted in Vehicle 30)

[0057] Next, refer to Figure 4 An example of a hardware configuration mounted on the vehicle 30 will be described. Figure 4 This is a block diagram showing an example of a hardware configuration mounted on the vehicle 30 .

[0058] like Figure 4 As shown, the vehicle 30 includes a positioning device 31 , a camera 32 , a vehicle ECU 40 (Electronic Control Unit), a display 33 , and a speaker 34 .

[0059] The positioning device 31 locates the position of the vehicle 30. The positioning device 31 is not particularly limited, and may be, for example, a GNSS receiver (Global Navigation Satellite System). The positioning device 31 outputs position information indicating the located position to the vehicle ECU 40. In addition, the method of locating the position of the vehicle 30 is not limited to the method using the positioning device 31, and may be, for example, a method using odometer (odometry) information based on the acceleration of the vehicle 30. Therefore, it is not necessary to mount the positioning device 31 on the vehicle 30.

[0060] The camera 32 has an imaging element such as a CCD (charge-coupled device) or a CMOS (complementary metal oxide semiconductor). The camera 32 can be installed at any location where it can capture images of the seats in the vehicle 30 (in the Figure 4 The number of cameras 32 is not particularly limited, and it can be one or more than two. In addition, the camera 32 can be a visible light camera or an infrared camera with an infrared function.

[0061] The camera 32 captures the passenger's face at a predetermined period and outputs the captured image data to the vehicle ECU 40. When the camera 32 captures the passenger's face, the capture method may be a still image or a moving image. The image data is used to estimate the passenger's line of sight. Details will be described later.

[0062] The vehicle ECU 40 is a device that performs various controls. As such ECUs, an engine ECU for controlling an engine, a brake ECU for controlling a brake, and the like are sometimes separately provided in accordance with each mechanism of the vehicle 30. The vehicle ECU 40 in this embodiment may be a dedicated ECU for providing content to passengers, or the engine ECU, the brake ECU, and the like may function as the vehicle ECU 40.

[0063] An example of the hardware configuration of the vehicle ECU 40 will be described. The vehicle ECU 40 includes a processor 41, a ROM 42, a RAM 43, a storage unit 44, and a communication I / F 46. Each of the components is connected via a bus 47 so as to be able to communicate with each other.

[0064] The configurations of the processor 41 , ROM 42 , RAM 43 , and storage unit 44 are the same as the configurations of the processor 11 , ROM 12 , RAM 13 , and storage unit 14 of the above-described content generating device 10 , and thus description thereof is omitted.

[0065] The storage unit 44 stores a content reproduction application 441 and a device database 442 .

[0066] As described above, the content reproduction application 441 is an application program for controlling the reproduction of content generated by the content generation device 10. The content reproduction application 441 requests the server 20 for content corresponding to predetermined information, and reproduces the content acquired from the server 20 using various devices mounted on the vehicle 30.

[0067] The device database 442 stores information on the placement of various devices mounted on the vehicle 30 and information on the types of devices. The “placement information of the device” is information indicating where in the vehicle 30 the device is placed.

[0068] The communication I / F 46 is not particularly limited, and for example, an interface for an in-vehicle network compliant with the CAN (Controller Area Network) standard is used. The communication I / F 46 also includes an interface used for communication with the server 20 .

[0069] The display 33 is one of the various devices mounted on the vehicle 30, and functions as a display device for displaying content. In addition, there is no particular limitation on the number of displays 33 mounted on the vehicle 30, and it can be one or more than two. In addition, in the present embodiment, it is assumed that a plurality of displays 33 are mounted for explanation. In addition, as an example, the display 33 is set to be a display called a so-called "smart window" that can switch between transparent and opaque for explanation. Regarding the "smart window", for example, it becomes opaque when not powered on, and becomes transparent when powered on. That is, the display 33 involved in the present embodiment functions as a "transparent window" by controlling the current, and on the other hand, it also functions as a "display device for displaying content". In the present embodiment, it is assumed that the "windows" of the vehicle 30 are all composed of the display 33 for explanation, but it is not limited to this. It is also possible that a part of the "windows" of the vehicle 30 is composed of the display 33.

[0070] The speaker 34 is one of the various devices mounted on the vehicle 30, and functions as a sound output device for outputting the sound of the content. The number of speakers 34 mounted on the vehicle 30 is not particularly limited, and may be one or more than two. In addition, in the present embodiment, it is assumed that a plurality of speakers 34 are mounted for description.

[0071] (Function of Processor 11 of Content Generating Device 10)

[0072] Next, refer to Figure 5 An example of the function of the processor 11 of the content generating device 10 will be described. Figure 5 is a functional block diagram of the processor 11 of the content generating device 10. Figure 5 As shown, in the content generating device 10 of the present embodiment, the processor 11 functions as the information acquiring unit 111 , the content generating unit 112 , and the output unit 113 by executing the content generating program 141 .

[0073] The information acquisition unit 111 acquires information required for generating content. In the present embodiment, as an example of the information required for generating content, three information can be cited: (A1) configuration information of various devices mounted on the vehicle 30, (A2) passenger sight information, and (A3) driving information of the vehicle 30. An example of "configuration information of various devices mounted on the vehicle 30" mentioned here is configuration information of the display 33 and configuration information of the speaker 34. In addition, an example of "driving information of the vehicle 30" is position information of the vehicle 30 when it is driving, and landscape information associated with the position information. In addition, when generating content, it is not necessary to use the three information (A1) to (A3). For example, two information (A1) and (A3) can also be used to generate content.

[0074] As an example of a method for acquiring the three information (A1) to (A3), a method using an input module prepared in the content generation program 141 can be cited. The "input module" referred to herein refers to a module for a person who generates content (hereinafter simply referred to as a "content generator") to input initial conditions and parameters required when generating content. In the case where the input module is structured such as to include items for inputting "display 33 configuration information", "speaker 34 configuration information", "passenger sight line information", and "vehicle 30 position information", the content generator only needs to input these information into the input module. With respect to "landscape information associated with vehicle 30 position information", the content generation program 141 can obtain it by referring to the storage unit 14 based on the "vehicle 30 position information" input into the input module.

[0075] Here, refer to Figure 6 An example of the operation of the content generation program 141 when the content generator inputs three pieces of information will be described. Figure 6 FIG. 2 shows a simulation screen obtained by simulating a part of the interior space of the vehicle 30 when three pieces of information are input by the content creator. Figure 6 As shown, virtual displays 61A and 61B, virtual seats 62A and 62B, virtual passengers 63A and 63B sitting in the virtual seats 62A and 62B, and virtual speakers 64A and 64B are displayed on the simulation screen 60 .

[0076] The content generation program 141 receives input from a content generator and generates a simulation screen 60 based on the input.

[0077] The virtual displays 61A and 61B are virtual displays that virtually represent the multiple displays 33 installed in the actual vehicle 30. In addition, the virtual seats 62A and 62B are virtual seats that virtually represent the multiple seats installed in the actual vehicle 30. In addition, the virtual passengers 63A and 63B are virtual passengers that virtually represent passengers riding in the actual vehicle 30. In addition, the virtual speakers 64A and 64B are virtual speakers that virtually represent the multiple speakers 34 installed in the actual vehicle 30. Figure 6 The arrow mark indicates the line of sight direction of the virtual passenger 63A. Here, the line of sight direction of the virtual passenger 63A is represented by a three-dimensional coordinate system, but is not limited to this. In addition, it is assumed that the content generator also inputs the actual seat configuration information. The seat configuration information may also be included in the "configuration information of various devices mounted on the vehicle 30" described in (A1) above.

[0078] After the content generator generates the simulation screen 60 using the content generation program 141, the content generator generates content corresponding to the scenery that changes according to the movement of the vehicle 30. There is no particular limitation on the method of generating the content, and for example, a method using a generation module prepared in the content generation program 141 can be cited. The "generation module" referred to herein refers to a module having a plurality of models for generating content corresponding to the scenery that changes according to the movement of the vehicle 30. The content generator can select a model that he wants to provide to passengers from a plurality of models. As an example of the plurality of models, there can be a model in which a mammoth appears in accordance with the scenery that changes according to the movement of the vehicle 30, a model in which fireworks are set off in accordance with the scenery that changes according to the movement of the vehicle 30, and the like. Here, it is assumed that the content generator selects the model in which a mammoth appears. In this case, the content generation program 141 generates the content according to the selection of the content generator, such as Figure 6 As shown, the content for the appearance of the mammoth is generated.

[0079] The mammoth is a three-dimensional object arranged in a virtual space corresponding to a landscape that changes according to the movement of the vehicle 30. The "virtual space" mentioned here refers to a three-dimensional space model composed of a three-dimensional map of a specified range and various three-dimensional objects arranged in the three-dimensional map. In addition, the virtual space can be a space model obtained by faithfully replicating the real space where the vehicle 30 actually travels, or it can be a space model obtained by simulating a space such as the seabed or the air where the vehicle 30 cannot travel in reality. In addition, in the virtual space, there can also be a mixture of maps and objects obtained by simulating things that exist in the real space or phenomena that exist in the real space, and maps and objects obtained by simulating things that do not exist in the real space or phenomena that do not exist in the real space.

[0080] The operation of the content generation program 141 using the generation module corresponds to the “content generation unit 112 ”.

[0081] By using the line of sight information of the virtual passenger 63A, the content creator can create content while confirming the scene seen from the perspective of a passenger actually riding in the vehicle 30. Figure 6 The view from the perspective of virtual passenger 63A is Figure 7 As shown in the scene. Figure 7 As shown in the simulation screen 70, the virtual displays 61A and 61C are visible in the line of sight of the virtual passenger 63A, but the virtual display 61B is invisible. By generating content while confirming the line of sight of the virtual passenger 63A who seems to be riding in the vehicle 30, it is possible to provide content that does not feel out of place even when the passenger actually rides. Figure 6 In FIG. 6 , the virtual display 61C disposed on the left side of the virtual display 61A is omitted.

[0082] By generating content while performing such a simulation, it is possible to generate content corresponding to the scenery that changes according to the movement of the vehicle 30 without actually driving the vehicle 30. In addition, it is possible to confirm on the simulator how the content is viewed from the perspective of the passenger when the vehicle 30 is driven without actually driving the vehicle 30. As described above, according to the present embodiment, it is possible to generate and confirm content without actually driving the vehicle 30, thereby reducing the cost associated with content generation.

[0083] The output unit 113 transmits the content generated by the content generating unit 112 to the server 20. The server 20 stores the content transmitted from the content generating device 10.

[0084] (Function of the processor 11 of the vehicle 30)

[0085] Next, refer to Figure 8 An example of the function of the processor 41 of the vehicle 30 will be described. Figure 8 FIG. 4 is a functional block diagram of the processor 41 of the vehicle 30. Figure 8 As shown, in the vehicle ECU 40 of the present embodiment, the processor 41 executes the content playback application 441 to function as an information acquisition unit 411 , a content request unit 412 , a content acquisition unit 413 , a display control unit 414 , and a sound control unit 415 .

[0086] The information acquisition unit 411 acquires information for requesting the server 20 for the content to be played back. In the present embodiment, as an example of the information required for requesting the content to be played back, three information can be cited, namely (B1) configuration information of various devices mounted on the vehicle 30, (B2) passenger sight information, and (B3) driving information of the vehicle 30. An example of the "configuration information of various devices mounted on the vehicle 30" mentioned here is the configuration information of the display 33 and the configuration information of the speaker 34. In addition, an example of the "driving information of the vehicle 30" is the position information of the vehicle 30 when it is driving. That is, in the present embodiment, the three information (A1) to (A3) mentioned above correspond to the three information (B1) to (B3), respectively. In addition, when requesting the content to be played back, it is not necessary to use the three information (B1) to (B3), and for example, two information (B1) and (B3) can be used to request the content.

[0087] An example of a method of acquiring the three pieces of information (B1) to (B3) will be described. First, the content playback application 441 can acquire the “display 33 arrangement information” and the “speaker 34 arrangement information” by referring to the device database 442 stored in the storage unit 44 .

[0088] Next, the content playback application 441 can acquire “passenger’s sight line information” by analyzing the image data of the camera 32 using a known method.

[0089] Next, the content playback application 441 can acquire “position information of the vehicle 30 ” from the positioning device 31 .

[0090] The content reproduction application 441 requests the server 20 for the content corresponding to the three types of information. This function corresponds to the content request unit 412.

[0091] Next, the content reproduction application 441 obtains the content transmitted from the server 20. This function corresponds to the content acquisition unit 413. Then, the content reproduction application 441 reproduces the content obtained from the server 20 using the display 33 and the speaker 34. This function corresponds to the display control unit 414 and the sound control unit 415.

[0092] Here, refer to Fig. 9 An example of the operation of the content reproduction application 441 will be described. Fig. 9 The diagram is a diagram for explaining the relationship between the points that the vehicle 30 passes when traveling from the departure point 80 toward the destination 81 and the content of each point.

[0093] The content reproduction application 441 obtains the above-mentioned information (B1) to (B3) at the location A, that is, the configuration information of the display 33 at the location A, the configuration information of the speaker at the location A, the sight line information of the passenger at the location A, and the position information of the vehicle 30 at the location A. The content reproduction application 441 requests the server 20 for content corresponding to the obtained information.

[0094] The server 20 specifies the content corresponding to the information acquired from the content reproduction application 441 and transmits the specified content to the content reproduction application 441. Here, the content corresponding to the location A is referred to as "content A".

[0095] The content reproduction application 441 reproduces the content A acquired from the server 20 using the display 33 and the speaker 34 .

[0096] In addition, Fig. 9 2 shows an example of dividing the content for each location. This is because it is assumed that there is a limit to the range of movement that can be simulated in the simulation when generating the content. If the limit on the range of movement is removed, the longer the distance moved, the larger the content capacity, which may increase the management burden of the content in the server 20 or increase the time and load when downloading the content from the server 20. Therefore, in this embodiment, Fig. 9As shown, for each location, content is generated within the range of movement that can be simulated. If the content is divided for each location in this way, the management burden of the content in the server 20 and the time and load when downloading the content from the server 20 are reduced. However, it is not necessary to divide the content for each location. In addition, the range of movement that can be simulated is not particularly limited, and in one example, it is 500m.

[0097] When the vehicle 30 passes through location A and arrives at location B, the content playback application 441 obtains the above-mentioned information (B1) to (B3) at location B, namely, the configuration information of the display 33 at location B, the configuration information of the speaker at location B, the line of sight information of the passengers at location B, and the position information of the vehicle 30 at location B.

[0098] Here, various devices (in Fig. 9 In the case where the display 33 and the speaker 34 are fixed in an immovable manner, if the content playback application 441 has obtained the configuration information of the device once, it is also possible not to obtain the configuration information of the device at the subsequent location, but to use the configuration information of the device obtained in the past. That is to say, in the case where the display 33 and the speaker 34 are fixed in an immovable manner, the content playback application 441 can also use the configuration information of the display 33 and the speaker 34 obtained at location A for location B. Of course, in the case where the display 33 and the speaker 34 are movable, the content playback application 441 only needs to obtain the configuration information of the display 33 and the speaker 34 each time.

[0099] Similar to the operation at the location A, the content reproduction application 441 requests the server 20 for the content corresponding to the information acquired at the location B.

[0100] The server 20 specifies the content corresponding to the information acquired from the content reproduction application 441 and transmits the specified content to the content reproduction application 441. Here, the content corresponding to the location B is referred to as "content B".

[0101] The content reproduction application 441 reproduces the content B acquired from the server 20 using the display 33 and the speaker 34 .

[0102] The operation of the content reproduction application 441 at the location C and the location D is the same as that at the location A and the location B, and therefore the description thereof will be omitted.

[0103] The content may also include events. The "event" mentioned here refers to an event that the passenger can feel through the five senses. Examples of such events include fragrance, wind, vibration, sound, light, etc. The fireworks mentioned above are also a type of event. If it is an image of fireworks, the passenger can enjoy it visually, and if the sound of emission and explosion is output from the speaker 34 in accordance with the image of fireworks, the passenger can also enjoy it through hearing. Such events can be set for each location, that is, for each content.

[0104] The data included in the content is not particularly limited, and for example, it may include mp4 as video data for each location, wav as audio data, json as video control information, and the like.

[0105] The content reproduction application 441 may transmit the vehicle ID for identifying the vehicle 30 when requesting the content from the server 20. The server 20 can manage which content is transmitted to which vehicle by using the vehicle ID.

[0106] In addition, Fig. 9 In the figure, for the sake of convenience, the section from the departure point 80 to the point A, the section from the point A to the point B, the section from the point B to the point C, the section from the point C to the point D, and the section from the point D to the destination 81 are shown as sections without content, but the present invention is not limited to this. Content may exist without gaps in all sections from the departure point 80 to the destination 81.

[0107] (An example of content processing)

[0108] Next, refer to Fig.10 An example of content processing performed between the content generating device 10, the server 20, and the vehicle 30 will be described with reference to a sequence diagram of FIG.

[0109] In step S101 , the processor 11 of the content generating device 10 acquires three pieces of information: (A1) arrangement information of various devices mounted on the vehicle 30 , (A2) passenger sight line information, and (A3) driving information of the vehicle 30 .

[0110] The process proceeds to step S102, and the processor 11 of the content generation device 10 generates a simulation screen 60 (see Figure 6 ). The processor 11 of the content generating device 10 generates content corresponding to the scenery that changes according to the movement of the vehicle 30 based on the operation of the content generator on the simulation screen 60.

[0111] The process proceeds to step S103, and the processor 11 of the content generating device 10 sends the content generated in the process of step S102 to the server 20. Fig. 9 When content is generated for each location as described in , each content generated for each location is transmitted to the server 20 .

[0112] In step S104 , the server 20 stores the content transmitted from the content generating device 10 .

[0113] In step S105, the vehicle 30 is directed toward the set destination 81 (see Fig. 9 ) driving.

[0114] The process proceeds to step S106, where the processor 41 of the vehicle 30 obtains three pieces of information at a location A on the way to the destination 81: (B1) configuration information of various devices mounted on the vehicle 30, (B2) passenger sight information, and (B3) driving information of the vehicle 30. The three pieces of information (A1) to (A3) in step S101 correspond to the three pieces of information (B1) to (B3) in step S106, respectively.

[0115] The process proceeds to step S107 , and the processor 41 of the vehicle 30 requests the server 20 for content corresponding to the information acquired in the process of step S106 .

[0116] In step S108, the server 20 determines the content corresponding to the information acquired from the vehicle 30, and transmits the determined content to the vehicle 30. For example, when the vehicle 30 is traveling at the point A, the server 20 transmits the content A to the vehicle 30.

[0117] In step S109 , the processor 41 of the vehicle 30 acquires content (eg, content A) from the server 20 .

[0118] The process proceeds to step S110 , and the processor 41 of the vehicle 30 uses the display 33 and the speaker 34 to reproduce the content (eg, content A) acquired in the process of step S109 .

[0119] also, Fig.10 The process flow in the sequence diagram shown is an example, and steps may be deleted, new steps may be added, or the process order may be changed without departing from the scope of the invention.

[0120] For example, in step S106, the processor 41 of the vehicle 30 starts acquiring the three pieces of information (B1) to (B3), but may also start acquiring based on a predetermined trigger. The predetermined trigger is, for example, a signal sent from a passenger's smartphone. When a passenger wants to experience the content, he or she can experience the content by operating a dedicated application installed on the smartphone he or she owns. The processor 41 of the vehicle 30 may also start acquiring the three pieces of information based on receiving a signal when a dedicated application is operated.

[0121] (Variation of Implementation Example 1)

[0122] Next, a modification of the first embodiment will be described.

[0123] In the above description, the three pieces of information (A1) to (A3) are used when generating content, but the present invention is not limited thereto. When generating content, other information may be added in addition to the three pieces of information to generate content. For example, the content generation program 141 may also add information related to the type of device in addition to the three pieces of information to generate content.

[0124] The "type of device" mentioned here refers to the classification based on the performance, shape, characteristics, etc. of the device. For example, in the case of the display 33, it can be classified into two types: "a display that can be switched between transparent and opaque" and "a general-purpose display that cannot be switched between transparent and opaque". The generated content can be changed depending on which of the two types of displays is installed in the vehicle 30. In addition, the classification of these two types is only an example, and it goes without saying that there are many types of displays, such as displays with curved surfaces and displays that can be bent.

[0125] As another example, the speaker 34 can be classified into three categories: "mono speaker", "stereo speaker", and "multi-channel speaker". The generated content can be changed depending on which of the three types of speakers is installed in the vehicle 30. In addition, the classification of these three categories is only an example, and it goes without saying that there are many types of speakers, such as speakers with excellent bass, speakers with excellent treble, and speakers that support high-resolution audio sources.

[0126] By adding information about the type of device in addition to the three pieces of information (A1) to (A3) to generate content, it is possible to generate content that makes the most of the performance of the device. The type of device can be input into the content generation program 141 by the content creator.

[0127] Similarly, the information on the device type may be added when the content reproduction application 441 requests content from the server 20. The information on the device type is stored in advance in the storage unit 44, so that the content reproduction application 441 can obtain the information on the device type at any time.

[0128] (Effect)

[0129] As described above, according to the content processing system 100 according to the first embodiment, the following effects can be obtained.

[0130] The content processing system 100 includes a content generating device 10 , a storage device, and a content reproducing device mounted on a mobile object. An example of the “storage device” mentioned here is the server 20 , and an example of the “content reproducing device” is the vehicle ECU 40 .

[0131] The content generation device 10 obtains information related to the interior space of the mobile body and obtains information related to the travel of the mobile body. An example of the "information related to the interior space of the mobile body" mentioned here is the information (A1) mentioned above. An example of the "information related to the travel of the mobile body" is the information (A3) mentioned above.

[0132] The content generating device 10 generates content corresponding to the scenery that changes according to the movement of the mobile body based on the information about the internal space of the mobile body and the information about the travel of the mobile body, and stores the generated content in the storage device.

[0133] The content playback device acquires information related to the interior space of the mobile body and acquires information related to the travel of the mobile body. An example of the "information related to the interior space of the mobile body" mentioned here is the information (B1) mentioned above. An example of the "information related to the travel of the mobile body" is the information (B3) mentioned above.

[0134] The content playback device acquires content corresponding to the information on the internal space of the mobile body and the information on the travel of the mobile body from the storage device, and plays back the acquired content.

[0135] According to the above structure, it is possible to generate content corresponding to the scenery that changes according to the movement of the moving body without actually driving the moving body. In addition, it is possible to confirm on the simulator how the content is seen from the perspective of the passengers when the moving body is driven without actually driving the moving body. In the above-mentioned conventional method, it is necessary to confirm how the content is seen from the perspective of the passengers while actually driving the moving body. This is the main reason for the increase in the cost associated with content generation. In contrast, in the present embodiment, it is possible to generate and confirm the content without actually driving the moving body, so the cost associated with content generation can be reduced.

[0136] The content is a virtual image such as a mammoth or fireworks, so the passenger can visually enjoy the virtual image linked to the landscape that changes according to the movement of the moving body. In addition, if the sound of emission and explosion is output from the speaker 34 in accordance with the image of the fireworks, the passenger can also enjoy the content through hearing. In this way, according to this embodiment, it is possible to provide content that stimulates the five senses of the passenger, and the passenger can have a new experience.

[0137] Furthermore, from the perspective of the content generating device 10, the storage device is an external storage device, and the moving object is an external moving object. Furthermore, from the perspective of the moving object, the storage device is an external storage device.

[0138] In addition, the content generation device 10 may also obtain information related to passengers seated in the interior space of the moving body. An example of the "information related to passengers seated in the interior space of the moving body" mentioned here is the information (A2) mentioned above. "Passengers" include the driver driving the moving body, passengers riding in the moving body, etc.

[0139] The content generating device 10 may generate content corresponding to the scenery changing according to the movement of the moving body based on the information about the interior space of the moving body, the information about the occupants, and the information about the travel of the moving body, and store the generated content in the storage device.

[0140] In addition, the content playback device may also acquire information related to passengers seated in the interior space of the moving object. An example of the "information related to passengers seated in the interior space of the moving object" mentioned here is the information (B2) described above.

[0141] The content playback device may acquire content corresponding to the information on the interior space of the moving body, the information on the occupant, and the information on the travel of the moving body from the storage device, and may play back the acquired content.

[0142] According to the above configuration, the same effects as those described above can be obtained.

[0143] In addition, the information related to the interior space of the mobile body may be the configuration information of at least one device configured in the interior space of the mobile body. The content generation device 10 may also obtain information related to the type of the device. The content generation device 10 may also generate content based on the configuration information of the device, the information related to the occupant, the information related to the travel of the mobile body, and the information related to the type of the device.

[0144] The content playback device may also acquire information related to the type of device. The content playback device may also acquire content corresponding to the device configuration information, information related to the occupant, information related to the travel of the mobile body, and information related to the type of device from the storage device.

[0145] According to the above configuration, by adding information on the type of device when generating content, it is possible to generate content that makes the most of the performance of the device.

[0146] Furthermore, the content generating device 10 may generate content for each predetermined range and store the content for each predetermined range in the storage device.

[0147] According to the above configuration, the burden of managing content in the storage device and the time and load when downloading content from the storage device are reduced.

[0148] [Implementation method 2]

[0149] Next, refer to Figure 11-12 Embodiment 2 of the present disclosure will be described. In addition, for the sake of convenience of description, the same reference numerals are given to components having the same functions as those described in Embodiment 1, and their description will not be repeated.

[0150] Fig.11 1 is a block diagram showing an example of a hardware configuration mounted on a vehicle 30 according to Embodiment 2. Fig.11 As shown, the seat 35 mounted on the vehicle 30 may also include a vibration device 351 .

[0151] If the seat 35 is provided with a vibration device 351, the seat 35 can be vibrated in accordance with an event to provide a new experience to the passenger. For example, when the event is fireworks, by vibrating the seat 35 in accordance with the time when the fireworks explode, the passenger can experience the vibration of the air when the fireworks explode, and can have a new experience. In this way, the content may include vibration in addition to moving images and sounds.

[0152] In the case where the seat 35 is provided with a vibration device 351, as Fig.12 As shown, the processor 41 of the vehicle 30 can function as the vibration control unit 416. In other words, the content playback application 441 functions as an application program that can control the vibration of the seat 35.

[0153] In addition, the content generation program 141 may generate content by adding information related to the type of the vibration device 351. An example of the type of the vibration device 351 is the size of the amplitude and the period related to the vibration. By generating content by also considering the size of the amplitude and the period, it is possible to generate content that makes the most of the performance of the vibration device 351.

[0154] [Implementation method 3]

[0155] Next, refer to Figure 13-14 Embodiment 3 of the present disclosure will be described. In addition, for the sake of convenience of description, the same reference numerals are attached to components having the same functions as those described in Embodiment 2, and the description thereof will not be repeated.

[0156] Fig.13 1 is a block diagram showing an example of a hardware configuration mounted on a vehicle 30 according to Embodiment 3. Fig.13 As shown, the vehicle 30 may also be equipped with a lighting device 36 .

[0157] If the vehicle 30 is provided with a lighting device 36, a new experience can be provided to passengers by controlling the lighting device 36 in accordance with an event. For example, when the event is fireworks, by brightening the interior of the vehicle at the time when the fireworks explode and darkening the interior of the vehicle at other times, the effect of the fireworks performance can be enhanced, and a space with a sense of presence can be provided to passengers. In this way, the content may include lighting in addition to moving images, sounds, and vibrations.

[0158] In the case where the vehicle 30 is provided with the lighting device 36, as Fig.14 As shown, the processor 41 of the vehicle 30 can function as the lighting control unit 417. In other words, the content playback application 441 functions as an application program capable of controlling the lighting device 36.

[0159] In addition, the content generation program 141 may generate content by adding information related to the type of the lighting device 36. The type of the lighting device 36 can be classified, for example, according to the dimming function. Specifically, there are lighting devices that can adjust the brightness in stages, lighting devices that can adjust the color, and the like. By generating content in consideration of the type of the lighting device 36, it is possible to generate content that makes the most of the performance of the lighting device 36.

[0160] Furthermore, by performing dimming control using the lighting device 36 when switching between transparency and opacity of the display 33, smooth switching can be performed.

[0161] [Implementation method 4]

[0162] Next, refer to Figure 15-16Embodiment 4 of the present disclosure will be described. In addition, for the sake of convenience of description, the same reference numerals are attached to components having the same functions as those described in Embodiment 3, and the description thereof will not be repeated.

[0163] Fig.15 1 is a block diagram showing an example of a hardware configuration mounted on a vehicle 30 according to the fourth embodiment. Fig.15 As shown, the vehicle 30 may also be equipped with a fragrance device 37 .

[0164] If the vehicle 30 is provided with an aroma device 37, a new experience can be provided to the passengers by controlling the aroma device 37 in accordance with the event. For example, when the event is fireworks, the aroma of lavender can be released into the vehicle in accordance with the time when the fireworks explode. Thus, the passengers can relax by the aroma of lavender while enjoying the fireworks, and can have a new experience. In this way, the content may include aroma in addition to moving images, sounds, vibrations, and lighting.

[0165] In the case where the vehicle 30 is provided with the fragrance device 37, Fig.16 As shown, the processor 41 of the vehicle 30 can function as the fragrance control unit 418. In other words, the content playback application 441 functions as an application program capable of controlling the fragrance device 37.

[0166] In addition, the content generation program 141 may generate content by adding information about the type of the aroma device 37, that is, information about the type of fragrance. As the type of fragrance, in addition to the above-mentioned lavender, vanilla, rose, citrus, jasmine, etc. can be cited. By generating content by also considering the type of fragrance, it is possible to generate content that maximizes the performance of the aroma device 37.

[0167] [Other implementation methods]

[0168] The combination of moving images, sounds, vibrations, lighting, and fragrances included in the content may be arbitrary.

[0169] [Example of implementation by software]

[0170] The functions of the content generating device 10 and the content reproducing device can be realized by a program for causing a computer to function as the content generating device 10 and the content reproducing device and for causing the computer to function as each control block of the content generating device 10 and the content reproducing device.

[0171] In this case, the content generation device 10 and the content reproduction device include a computer as hardware for executing a program, and the computer has at least one device (e.g., a processor) and at least one storage unit (e.g., a memory). The functions described in each embodiment are realized by executing the program on the computer.

[0172] The program may be recorded in a non-transitory manner on one or more computer-readable recording media. The content generation device 10 and the content reproduction device may or may not have the recording medium. In the latter case, the program may be supplied to the content generation device 10 and the content reproduction device via any transmission medium, whether wired or wireless.

[0173] In addition, part or all of the functions of each control block can also be implemented by a logic circuit. For example, an integrated circuit having a logic circuit that functions as each control block is also included in the scope of the present disclosure. In addition, for example, the functions of each control block can also be implemented by a quantum computer.

[0174] In addition, each process described in each embodiment may be executed by AI (Artificial Intelligence). In this case, AI may be operated by the content generation device 10 and the content playback device, or by other devices (such as edge computers or cloud servers).

[0175] The present disclosure is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims. Embodiments obtained by appropriately combining technical means disclosed in different embodiments are also included in the technical scope of the present disclosure.

[0176] Description of Reference Numerals

[0177] 100: content processing system; 10: content generating device; 20: server; 30: vehicle; 40: vehicle ECU; 11, 21, 41: processors; 14, 24, 44: storage units; 441: content reproducing application.

Claims

1. A content processing system comprising a content generating device, a storage device, and a content reproducing device mounted on a mobile body, in, The content generation device performs the following processing: acquiring information related to the internal space of the moving object; Acquiring information related to the travel of the mobile body; generating content corresponding to a landscape that changes according to movement of the moving body based on the information related to the interior space and the information related to the travel; and storing the generated content in the storage device, The content reproducing device performs the following processing: acquiring information related to the internal space of the moving object; Acquiring information related to the travel of the mobile body; acquiring, from the storage device, content corresponding to the information related to the interior space and the information related to the driving; as well as Regenerate the acquired content.

2. The content processing system according to claim 1, wherein: The content generation device performs the following processing: acquiring information related to an occupant seated in an interior space of the moving body; and generating content corresponding to a landscape that changes according to movement of the moving body based on the information about the interior space, the information about the occupant, and the information about the travel, The content reproducing device performs the following processing: acquiring information related to an occupant seated in the interior space of the mobile body; acquiring, from the storage device, content corresponding to the information related to the interior space, the information related to the occupant, and the information related to the travel; as well as Regenerate the acquired content.

3. The content processing system according to claim 2, wherein: The information related to the internal space of the mobile body is configuration information of at least one device configured in the internal space of the mobile body. The content generation device performs the following processing: obtaining information related to the type of the device; as well as generating the content based on the configuration information of the device, the information related to the occupant, the information related to the travel, and the information related to the type of the device, The content reproducing device performs the following processing: obtaining information related to the type of the device; acquiring, from the storage device, content corresponding to the configuration information of the device, the information related to the occupant, the information related to the travel, and the information related to the type of the device; as well as The acquired content is reproduced using the device.

4. The content processing system according to any one of claims 1 to 3, wherein: The content generation device performs the following processing: Generate content for each specified scope; and The content of each of the prescribed ranges is stored in the storage device.

5. A content generation device comprising a processor, in, The processor performs the following processing: Acquiring information related to the interior space of an external moving object; acquiring information related to the travel of the external mobile object; generating content corresponding to a landscape that changes according to movement of the external moving object based on the information related to the internal space and the information related to the travel; as well as The generated content is stored in an external storage device.

6. A content reproduction device, mounted on a mobile object, The content playback device includes a processor. The processor performs the following processing: acquiring information related to the internal space of the moving object; Acquiring information related to the travel of the mobile body; acquiring content corresponding to the information related to the interior space and the information related to the driving from an external storage device; and Regenerate the acquired content.

Images