Information processing system, information processing method, and program

Abstract

The present disclosure relates to an information processing system, an information processing method, and a program that make it possible to provide a more valuable user experience. In the present disclosure, a drive simulation system performs a drive simulation using a vehicle selected by a user, and acquires driving data corresponding to the user's operations on the vehicle, and in-simulator images showing the vehicle traveling in a virtual space. A camera system captures images of the vehicle and the user using a camera to obtain captured images. A video creation system creates a video configured using at least the in-simulator images and the captured images. The present technology can be applied, for example, to a content production system that performs a drive simulation using an actual vehicle to produce content.

Description

Information processing system, information processing method, and program

[0001] The present disclosure relates to an information processing system, an information processing method, and a program, and more particularly to an information processing system, an information processing method, and a program that are capable of providing a more valuable user experience.

[0002] In recent years, it has been proposed to provide various user experiences, such as realistic driving simulations and content viewing, by utilizing display devices and audio equipment installed inside and outside of parked electric vehicles, in combination with user profiles, external vibration devices, charging devices, etc. Furthermore, with the rise of virtual production, 3DCG (3 Dimensional Computer Graphics) is increasingly being used in the production of promotional videos.

[0003] Patent Document 1 discloses a racing game device in which a racing game is played using an operation unit provided with a steering wheel, an accelerator, and a brake.

[0004] Japanese Patent Application Laid-Open No. 2000-229177

[0005] As mentioned above, it has been proposed to provide various user experiences using parked electric vehicles, but there is a need to provide a more valuable user experience that, for example, motivates users to travel to a charging station located a little further away and spend time there.

[0006] The present disclosure has been made in light of these circumstances, and aims to provide a more valuable user experience by making secondary use of 3DCG created in virtual productions, games, etc.

[0007] An information processing system according to one aspect of the present disclosure includes a driving simulation system that executes a driving simulation using a vehicle selected by a user and acquires driving data corresponding to the user's operation of the vehicle and an in-simulator image showing the vehicle traveling in a virtual space, a camera system that photographs the vehicle and the user with a camera to acquire the captured image, and a video creation system that creates a video composed of at least the in-simulator image and the captured image.

[0008] An information processing method or program according to one aspect of the present disclosure includes executing a driving simulation using a vehicle selected by a user, acquiring driving data corresponding to the user's operation of the vehicle and an in-simulator image showing the vehicle traveling in a virtual space, photographing the vehicle and the user with a camera to acquire the captured image, and creating a moving image using at least the in-simulator image and the captured image.

[0009] In one aspect of the present disclosure, a driving simulation is performed using a vehicle selected by a user, driving data corresponding to the user's operation of the vehicle and in-simulator footage showing the vehicle traveling in a virtual space are obtained, the vehicle and the user are photographed with a camera to obtain captured footage, and a moving image is created using at least the in-simulator footage and the captured footage.

[0010] 1 is a block diagram illustrating an example configuration of an embodiment of a content production system to which the present technology is applied. FIG. 2 is a diagram illustrating an example of a cut capturing a user getting into a vehicle. FIG. 3 is a diagram illustrating an example of a cut capturing a user driving a vehicle from above the vehicle. FIG. 4 is a diagram illustrating an example of capturing the interior of a vehicle. FIG. 5 is a block diagram illustrating an example configuration of a video creation processing unit. FIG. 6 is a block diagram illustrating an example configuration of a simulation processing unit. FIG. 7 is a diagram illustrating an example of a cut capturing an arrangement of 3DCG model data and a vehicle traveling in a virtual space. FIG. 8 is a block diagram illustrating an example configuration of a shooting control processing unit. FIG. 9 is a sequence diagram illustrating content production processing. FIG. 10 is a flowchart illustrating template cut creation processing. FIG. 11 is a flowchart illustrating initial shooting processing. FIG. 12 is a flowchart illustrating simulator startup processing. FIG. 13 is a flowchart illustrating in-simulator video shooting processing. FIG. 14 is a flowchart illustrating automatic shooting processing. FIG. 15 is a block diagram illustrating a configuration of a video creation processing.

[0011] Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the drawings.

[0012] <Configuration Example of Content Production System> A configuration example of an embodiment of a content production system to which the present technology is applied will be described with reference to FIGS. 1 to 8 .

[0013] FIG. 1 is a block diagram showing an example of the configuration of a content production system 11.

[0014] 1 is assumed to be installed and used in, for example, a vehicle dealership equipped with a charging station for electric vehicles. The content production system 11 allows a user who visits the vehicle dealership to charge their electric vehicle to perform a driving simulation while test-driving a vehicle 43 on display at the vehicle dealership, thereby enabling the production of content similar to an existing promotional video (e.g., a commercial video) for advertising the vehicle 43.

[0015] For example, in the content production system 11, the vehicle 43 that the user wishes to test drive is moved to a predetermined position in front of the display device 42, and after the user selects the location where the user wants to drive in the content, the music to be used in the content, etc., filming is started by the camera 52. Then, a shot of the user getting into the vehicle 43 is filmed by the camera 52, and while a driving simulation is being performed in response to the user's driving of the vehicle 43, various shots of the vehicle 43 are filmed by the camera 52 against the background of the display device 42 displaying a simulation video of the location selected by the user. Furthermore, during the driving simulation in response to the user's driving of the vehicle 43, the virtual camera films the vehicle 43 driving in a virtual space corresponding to the location selected by the user, and various shots of an image within the simulator are generated.

[0016] Thereafter, in the content production system 11, when the driving simulation ends and the camera 52 captures a shot of the user getting out of the vehicle 43, the camera 52 stops filming. The content production system 11 then presents the user with the footage of each shot captured by the camera 52 and the in-simulator footage of each shot generated during the driving simulation, allowing the user to select a favorite shot. This allows the content production system 11 to create a moving image combining the footage of the shots selected by the user and to create and provide content in which music selected by the user is played along with the moving image. Furthermore, the content production system 11 can assign a non-fungible token (NFT) to a link for sharing the content on a social networking service (SNS) and provide the link.

[0017] As shown in FIG. 1, the content production system 11 is configured to include a moving image production system 21, a driving simulation system 22, and a camera system 23, and a cloud server 24 is connected to the moving image production system 21 via a network 25.

[0018] The moving image creation system 21 includes a moving image creation processing unit 31 and a UI (User Interface) terminal 32 .

[0019] The UI terminal 32 is equipped with a touch panel, and when the user operates the touch panel to select, for example, the vehicle 43 that the user wishes to test drive, the location where the user wishes to drive within the content, the music to be used in the content, etc., user selection information indicating the content of the user's selection is supplied to the moving image creation processing unit 31.

[0020] The moving image creation processing unit 31 references each cut constituting an existing promotional video for the vehicle 43 indicated by the user selection information and creates a template cut that indicates the camera work and shooting timing for filming the driving simulation being performed at the location selected by the user. For example, the template cut includes instructions on the timing to start and end filming of each cut, instructions on the placement and angle of view of the camera 52 required to film the footage of each cut, instructions on the placement and angle of view of the virtual camera required to generate the in-simulator footage of each cut, and, if the driver is shown in each cut, an instruction that the user is included in the filming. The moving image creation processing unit 31 then supplies the template cut and the user selection information to the driving simulation system 22 and the camera system 23, respectively.

[0021] The moving image creation processing unit 31 then receives driving data and in-simulator footage from the driving simulation system 22, as well as captured footage from the camera system 23. The moving image creation processing unit 31 stores a plurality of virtual production videos prepared in advance as advertising materials for the vehicle 43 (including, for example, materials not used in the promotional video), and can select virtual production videos that resemble the driving conditions of the driving simulation based on the driving data. The moving image creation processing unit 31 then displays the in-simulator footage, captured footage, and virtual production videos on the UI terminal 32 as options for the user to select videos to be used in the content. When the user selects a video to be used in the content from these options, the moving image creation processing unit 31 adjusts and edits the user-selected video to match the length of the music selected by the user, creates a moving image, and displays the moving image on the UI terminal 32.

[0022] The drive simulation system 22 includes a simulation processing unit 41 , a display device 42 , and a vehicle 43 .

[0023] The simulation processing unit 41 executes a driving simulation in which the vehicle 43 virtually travels through a virtual space corresponding to a location indicated by the user selection information supplied from the moving image creation processing unit 31 in accordance with the actual user's driving of the vehicle 43. For example, the vehicle 43 supplies the simulation processing unit 41 with driving data indicating the details of driving (such as the angle of the tires and the degree of acceleration and deceleration) in accordance with the user's operation of the steering wheel, pedals, etc. The simulation processing unit 41 controls an internal active suspension, a seat vibration device, an external vibration device, etc., which generate vibrations (such as left-right tilting vibrations in response to cornering and forward-backward tilting vibrations in response to acceleration and deceleration) in the vehicle 43 in accordance with the driving data. At this time, the simulation processing unit 41 generates a simulation video linked to the scenery in the simulator corresponding to the virtual space in which the vehicle 43 is traveling, and displays the simulation video on the display device 42.

[0024] The simulation processing unit 41 then generates an in-simulator video showing the vehicle 43 traveling in the virtual space by taking pictures with a virtual camera in accordance with the template cuts supplied from the moving image creation processing unit 31. After that, when the virtual traveling of the vehicle 43 is completed for all cuts that need to be photographed in accordance with the template cuts, the simulation processing unit 41 ends the drive simulation and supplies the traveling data and the in-simulator video to the moving image creation processing unit 31.

[0025] The camera system 23 includes a photography control processing unit 51 and a camera 52 .

[0026] The shooting control processing unit 51 controls the camera in accordance with the template cut supplied from the moving image creation processing unit 31 to acquire video footage of the vehicle 43 and the user captured by the camera 52. For example, the shooting control processing unit 51 detects the model of the vehicle 43, executes initial shooting processing to detect the stopping position of the vehicle 43, and adjusts the position of the camera 52 in accordance with the stopping position of the vehicle 43 in automatic shooting processing to control the camera in accordance with the template cut so that shooting by the camera 52 is automatically performed. At this time, the shooting control processing unit 51 can adjust the camera position based on the position and posture of the subject (such as the vehicle 43 or the user who is the driver) in the template cut. Note that the camera position may be adjusted using camera position learning data that learns the relationship between the position and posture of the subject and the camera position.

[0027] When the driving simulation in the driving simulation system 22 is completed, the shooting control processing unit 51 supplies the video obtained by shooting the vehicle 43 and the user with the camera 52 to the moving image creation processing unit 31 .

[0028] The cloud server 24 provides a service for distributing existing promotional videos that the moving image creation processing unit 31 references when creating template cuts, virtual production footage that the moving image creation processing unit 31 uses to create moving images, and various assets that the simulation processing unit 41 uses when generating in-simulator footage. The cloud server 24 also provides a service for issuing NFTs for content created in the content production system 11.

[0029] 1 has a connection configuration in which a cloud server 24 is connected to a video production system 21 via a network 25, but may have a connection configuration in which, for example, the video production system 21, the drive simulation system 22, the camera system 23, and the cloud server 24 are connected via the network 25. Furthermore, the simulation processing unit 41 may be an IVI ECU (In-Vehicle Infotainment Electric Control Unit) mounted in the vehicle 43, or an MPU (Multimedia Plug-in Unit) connected to the IVI ECU. Furthermore, the camera 52 may be a system that utilizes multiple cameras.

[0030] The content production system 11 configured in this manner can provide a user with an experience in which the user drives in a virtual space corresponding to an existing promotional video of the vehicle 43 and feels what it feels like to be a character in the promotional video. The content production system 11 can then provide content created using moving images captured while the user is experiencing driving in the virtual space through a driving simulation, at the time the driving simulation ends.

[0031] For example, the content production system 11 can provide a service that combines value for the user with promotion for the vehicle dealership, such that the user can have a deep connection with the new vehicle 43 at the vehicle dealership and have it become their first memory with the vehicle 43. The content production system 11 can also provide a more valuable user experience, such as completing content production while the user is enjoying a driving simulation and sharing a link to the content with the NFT attached via social media or the like.

[0032] The content production system 11 can adjust the relative positions of the camera 52, the lights, the display device 42, and the user in terms of software and hardware so as to be suitable for shooting according to the position of the user as the driving simulation progresses. In addition to providing content consisting of moving images, the content production system 11 may also provide multiple image shots selected from the moving images.

[0033] FIG. 2 is a diagram illustrating a shot of a user getting into a vehicle 43. In FIG.

[0034] For example, in a cut capturing a user getting into vehicle 43, as shown in A of Fig. 2 , video is captured from video Cut1, which captures the user opening the door of vehicle 43, to video Cut2, which captures the user sitting in a seat in vehicle 43. To perform such video capture, the template cut indicates the position of camera 52 relative to vehicle 43 when capturing video Cut1 (see B of Fig. 2 ) and the position of camera 52 relative to vehicle 43 when capturing video Cut2 (see C of Fig. 2 ). As a result, shooting control processing unit 51 starts shooting with camera 52 in accordance with the template cut, and performs camera control to move camera 52 from the position shown in B of Fig. 2 to the position shown in C of Fig. 2 , thereby capturing a video of the user getting into vehicle 43.

[0035] FIG. 3 is a diagram illustrating a shot in which a user driving a vehicle 43 is photographed from above the vehicle 43. In FIG.

[0036] For example, in a cut capturing a user driving vehicle 43 from above vehicle 43, as shown in A of Fig. 3 , video is captured from video Cut 3, which captures the entire vehicle 43 from above, to video Cut 4, which captures the user driving through the front window of vehicle 43. To perform such video capture, the template cut indicates the position of camera 52 relative to vehicle 43 when capturing video Cut 3 (see B of Fig. 3 ) and the position of camera 52 relative to vehicle 43 when capturing video Cut 4 (see C of Fig. 3 ). As a result, the video capture control processing unit 51 starts capturing video with camera 52 in accordance with the template cut, and performs camera control to move camera 52 from the position shown in B of Fig. 3 to the position shown in C of Fig. 3 , thereby capturing a video of the user driving vehicle 43 from above vehicle 43.

[0037] Referring to FIG. 4, the photographing of the interior of the vehicle 43 will be described.

[0038] As shown in Fig. 4, when photographing the interior of vehicle 43, camera 52 is attached to the tip of rig 53, and photographing is performed by inserting camera 52 into the vehicle through a window of vehicle 43. Fig. 4A shows the arrangement of camera 52 when photographing from the center of the back seat toward the front of vehicle 43, and Fig. 4B shows the arrangement of camera 52 when photographing a user who is driving from diagonally forward on the passenger seat side.

[0039] FIG. 5 is a block diagram showing an example of the configuration of the moving image creation processing unit 31.

[0040] As shown in FIG. 5, the moving image creation processing unit 31 includes a UI control unit 71 , a storage 72 , a template cut creation unit 73 , a communication unit 74 , a processing control unit 75 , a cut selection unit 76 , and a moving image creation unit 77 .

[0041] The UI control unit 71 controls the exchange of data with the UI terminal 32. For example, the UI control unit 71 acquires user selection information supplied from the UI terminal 32 and supplies it to the template cut creation unit 73, the communication unit 74, the cut selection unit 76, and the moving image creation unit 77. The UI control unit 71 also supplies the UI terminal 32 with content made up of video options (in-simulator video, shot video, and virtual production video) supplied from the cut selection unit 76 and moving images supplied from the moving image creation unit 77.

[0042] Storage 72 stores various data such as existing promotional videos that are referenced when creating template cuts, virtual production footage that is presented to the user as a selection of footage to be used in the content, and music used in the content.

[0043] The template cut creation unit 73 retrieves from the storage 72 an existing promotional video of the vehicle 43 indicated by the user selection information supplied from the UI control unit 71, creates a template cut by referencing each cut constituting the promotional video, and supplies the template cut to the communication unit 74. Furthermore, if the location indicated by the user selection information supplied from the UI control unit 71 does not match the location where the existing promotional video of the vehicle 43 indicated by the user selection information was shot, the template cut creation unit 73 can create a template cut by referencing each cut constituting an existing promotional video of another vehicle that was shot at the location indicated by the user selection information. For example, the template cut creation unit 73 can extract key cuts at predetermined time intervals in each scene of the promotional video and create a template cut from the extracted cuts. Furthermore, the template cut creation unit 73 may use learned identification criteria when identifying key cuts and creating a template cut. Note that the identification criteria for key cuts are learned in advance and stored in the template cut creation unit 73.

[0044] The communication unit 74 communicates with the simulation processing unit 41 and the shooting control processing unit 51. For example, the communication unit 74 transmits user selection information supplied from the UI control unit 71 and template cuts supplied from the template cut creation unit 73 to the simulation processing unit 41 and the shooting control processing unit 51, respectively. The communication unit 74 also receives driving data and in-simulator video transmitted from the simulation processing unit 41 and supplies them to the cut selection unit 76, and receives shot video transmitted from the shooting control processing unit 51 and supplies them to the cut selection unit 76.

[0045] The processing control unit 75 controls the processing performed in the simulation processing unit 41 and the shooting control processing unit 51. For example, when the processing control unit 75 is notified via the communication unit 74 from the simulation processing unit 41 that a simulator has been started, the processing control unit 75 instructs the simulation processing unit 41 to start a driving simulation. Furthermore, when the processing control unit 75 is notified via the communication unit 74 from the simulation processing unit 41 that a driving simulation has been started, the processing control unit 75 instructs the shooting control processing unit 51 to start automatic shooting processing, and instructs the simulation processing unit 41 to start in-simulator video shooting processing.

[0046] The cut selection unit 76 supplies to the UI control unit 71 the in-simulator video transmitted from the simulation processing unit 41, the captured video transmitted from the shooting control processing unit 51, and the virtual production video read from the storage 72 based on the driving data transmitted from the simulation processing unit 41. For example, the cut selection unit 76 selects virtual production video that resembles the driving conditions based on the driving data from among multiple virtual production videos prepared in advance as material for vehicle advertising.

[0047] The in-simulator video, the shot video, and the virtual production video are then presented to the user by the UI control unit 71 as video options for use in the content, and user selection information indicating the video selected by the user from these videos is supplied to the cut selection unit 76 via the UI control unit 71. In response to this, the cut selection unit 76 supplies the video selected by the user from the in-simulator video, the shot video, and the virtual production video to the moving image creation unit 77.

[0048] The moving image creation unit 77 creates a moving image by adjusting and editing the images selected by the user and supplied from the cut selection unit 76 to match the length of the music indicated by the user selection information supplied from the UI control unit 71. The moving image creation unit 77 then supplies the UI control unit 71 with content that allows the music to be played along with the created moving image, and the UI control unit 71 supplies the content to the UI terminal 32.

[0049] FIG. 6 is a block diagram showing an example of the configuration of the simulation processing unit 41.

[0050] As shown in FIG. 6, the simulation processing unit 41 includes a communication unit 81, a simulator startup processing unit 82, a simulation execution unit 83, and an in-simulator video capture processing unit 84.

[0051] The communication unit 81 communicates with the moving image creation processing unit 31 and the shooting control processing unit 51. For example, the communication unit 81 receives user selection information and template cuts transmitted from the moving image creation processing unit 31, and supplies them to the simulator startup processing unit 82, the simulation execution unit 83, and the in-simulator video shooting processing unit 84. The communication unit 81 also transmits the in-simulator video supplied from the in-simulator video shooting processing unit 84 to the moving image creation processing unit 31.

[0052] The simulator startup processing unit 82 executes a simulator startup process to start a simulator when it receives user selection information and a template cut from the communication unit 81. In the simulator startup process, the simulator startup processing unit 82 places 3DCG model data included in the assets called according to the location indicated by the user selection information in a virtual space in which the vehicle 43 virtually travels in a driving simulation. Note that this 3DCG is existing data created in a virtual production or game. For example, if the location indicated by the user selection information is an urban area and a mountainous region, the simulator startup processing unit 82 places 3DCG model data constituting the urban area, such as buildings and viaducts, and 3DCG model data constituting the mountainous region, such as mountains and forests, in the virtual space, as shown in A of FIG. 7 . The simulator startup processing unit 82 then notifies the moving image creation processing unit 31 via the communication unit 81 that the simulator has been started.

[0053] The simulation execution unit 83 starts the driving simulation when instructed to start the driving simulation by the moving image creation processing unit 31, which has been notified via the communication unit 81 that the virtual space simulator has been started, and notifies the moving image creation processing unit 31 that the driving simulation has started. Then, the simulation execution unit 83 executes a driving simulation in which the vehicle 43 virtually runs in accordance with the driving data supplied from the vehicle 43 so that each cut according to the template cut can be shot in the virtual space in which the 3DCG model data has been placed by the simulator start processing unit 82.

[0054] Thereafter, the simulation execution unit 83 ends the driving simulation when the vehicle 43 has completed driving in the virtual space for all shots that require shooting according to the template shots. The simulation execution unit 83 then creates driving data indicating the driving conditions of the vehicle 43 in the driving simulation (such as the driving position and driving speed in the virtual space) based on the driving data supplied from the vehicle 43 during the driving simulation, and supplies the data to the moving image creation processing unit 31 via the communication unit 81. The simulation execution unit 83 also notifies the shooting control processing unit 51 via the communication unit 81 that the driving simulation has ended. Furthermore, the simulation execution unit 83 generates a simulation video adjusted to appear as if the vehicle 43 were actually being driven from the position of the vehicle 43 driving in the virtual space through the display device 42 during the driving simulation, and displays the simulation video on the display device 42.

[0055] The in-simulator video shooting processing unit 84 places a virtual camera in the virtual space at an angle of view that allows it to shoot in-simulator video in accordance with the template cut supplied from the communication unit 81. Then, when the in-simulator video shooting processing unit 84 is instructed to start in-simulator video shooting processing by the moving image creation processing unit 31 in response to notification via the communication unit 81 from the simulation execution unit 83 that a driving simulation has started, the in-simulator video shooting processing unit 84 executes in-simulator video shooting processing in which cuts to be shot are shot in order according to the template cut with the virtual camera. For example, when a vehicle 43 travels in the virtual space from an urban area toward a mountainous area as shown in A of Fig. 7, the in-simulator video shooting processing unit 84 executes in-simulator video shooting processing in which a video Cut 5 of the vehicle 43 virtually traveling through the urban area is shot, through a video Cut 6 of the vehicle 43 virtually traveling through the mountainous area, is shot with the virtual camera, as shown in B of Fig. 7.

[0056] In addition, if the cut to be shot includes the user according to the template cut, the in-simulator video shooting processing unit 84 can notify the camera system 23 via the communication unit 81 of a signal (cue) instructing the camera 52 to start shooting.

[0057] Then, when the driving simulation by the simulation execution unit 83 ends, the in-simulator video shooting processing unit 84 ends the in-simulator video shooting processing and supplies the in-simulator video to the moving image creation processing unit 31 via the communication unit 81.

[0058] FIG. 8 is a block diagram showing an example of the configuration of the shooting control processing unit 51.

[0059] As shown in FIG. 8, the photography control processing section 51 includes a communication section 91 , an initial photography processing section 92 , and an automatic photography processing section 93 .

[0060] The communication unit 91 communicates with the moving image creation processing unit 31 and the simulation processing unit 41. For example, the communication unit 91 receives user selection information and template cuts transmitted from the moving image creation processing unit 31, and supplies them to the initial shooting processing unit 92 and the automatic shooting processing unit 93. The communication unit 91 also transmits the shot video supplied from the automatic shooting processing unit 93 to the moving image creation processing unit 31.

[0061] The initial photography processing unit 92 detects the type of vehicle 43 and executes initial photography processing to detect the stopping position of the vehicle 43 relative to the display device 42. For example, in the initial photography processing, the initial photography processing unit 92 moves the camera 52 to a position where photography can be performed at an angle of view corresponding to the cut at the start of photography, in accordance with a template cut supplied from the communication unit 91, and calibrates the position of the camera 52 based on the stopping position of the vehicle 43 relative to the display device 42, the reflection of the camera 52, etc.

[0062] The automatic shooting processing unit 93 derives, for each cut, camera work for controlling the operation of the camera 52 and the timing for shooting by the camera 52 based on the template cut supplied from the communication unit 91, and controls the camera so that video can be shot by the camera 52 in accordance with the template cut. The automatic shooting processing unit 93 starts the automatic shooting processing when instructed to start the automatic shooting processing by the moving image creation processing unit 31 via the communication unit 91. For example, in the automatic shooting processing, when the automatic shooting processing unit 93 receives a cue from the in-simulator video shooting processing unit 84 via the communication unit 91 instructing the start of shooting, the automatic shooting processing unit 93 starts shooting the cut to be shot by the camera 52 at that timing.

[0063] The automatic shooting processing unit 93 then ends the automatic shooting process when the simulation execution unit 83 notifies the automatic shooting processing unit 93 of the end of the driving simulation via the communication unit 81. Thereafter, the automatic shooting processing unit 93 transmits the shot video acquired in the automatic shooting process to the moving image creation processing unit 31 via the communication unit 81.

[0064] As described above, the content production system 11 is configured to include the moving image creation processing unit 31, the simulation processing unit 41, and the shooting control processing unit 51, and can provide content produced using moving images captured while a user is performing a driving simulation in which the user drives in a virtual space corresponding to an existing promotional video for the vehicle 43. Furthermore, the content production system 11 can provide a more valuable user experience by secondary utilization of 3DCG created in virtual production, games, etc.

[0065] <Processing Example of Content Creation Processing> The content creation processing executed in the content creation system 11 will be described with reference to FIGS.

[0066] FIG. 9 is a sequence diagram illustrating an example of a content creation process.

[0067] For example, when the content production system 11 is started, processing begins, and in step S11, the template cut creation unit 73 executes a template cut creation process (see the flowchart in FIG. 10 described later) in the video production system 21. As described later, in the template cut creation process, the template cut creation unit 73 transmits the template cut created in the template cut creation process and user selection information to the driving simulation system 22 and the camera system 23, respectively, via the communication unit 74.

[0068] In step S12, in the camera system 23, the initial shooting processing unit 92 receives the template cut and user selection information sent from the video creation system 21 in step S11 via the communication unit 91, and executes the initial shooting processing (see the flowchart in Figure 11 described later).

[0069] In step S13, in the driving simulation system 22, the simulator activation processing unit 82 receives the template cut and user selection information transmitted in step S11 from the moving image creation system 21 via the communication unit 81. Then, the simulator activation processing unit 82 executes simulator activation processing (see the flowchart in FIG. 12 described later) and notifies the moving image creation system 21 via the communication unit 81 that the simulator has been activated.

[0070] In step S14, in the moving image creation system 21, the processing control unit 75 instructs the driving simulation system 22 to start a driving simulation via the communication unit 74 in response to the notification of the simulator startup in step S13.

[0071] In step S15, in the driving simulation system 22, the simulation execution unit 83 starts the driving simulation in accordance with the instruction in step S14, and notifies the moving image creation system 21 via the communication unit 81 that the driving simulation has started. Then, the simulation execution unit 83 executes a driving simulation in which the vehicle 43 virtually runs in accordance with the driving data supplied from the vehicle 43, so that each cut that needs to be shot in accordance with the template cut can be shot in the virtual space.

[0072] In step S16, in the video creation system 21, in response to the notification of the start of the driving simulation in step S15, the processing control unit 75 instructs the camera system 23 to start automatic shooting processing and instructs the driving simulation system 22 to start in-simulator video shooting processing.

[0073] In step S17, in the driving simulation system 22, the in-simulator video shooting processing unit 84 executes in-simulator video shooting processing (see the flowchart in FIG. 13 described later) in accordance with the instruction in step S16. As will be described later, in the in-simulator video shooting processing, the in-simulator video shooting processing unit 84 notifies the camera system 23 of a cue to start shooting by the camera 52, the end of the driving simulation, etc.

[0074] In step S18, the automatic photography processing unit 93 in the camera system 23 executes automatic photography processing (see the flowchart in FIG. 14, which will be described later) in accordance with the instruction in step S16.

[0075] When the automatic shooting process in step S18 is completed, the process proceeds to step S19. In step S19, the automatic shooting processing unit 93 of the camera system 23 transmits the shot video acquired in the automatic shooting process executed in step S18 to the video creation system 21 via the communication unit 91.

[0076] When the in-simulator video shooting process in step S17 is completed, the process proceeds to step S20. In step S20, in the driving simulation system 22, the simulation execution unit 83 transmits the driving data acquired in the driving simulation executed in step S15 to the moving image creation system 21 via the communication unit 81. Furthermore, in step S20, in the driving simulation system 22, the in-simulator video shooting processing unit 84 transmits the in-simulator video acquired in the in-simulator video shooting process executed in step S17 to the moving image creation system 21 via the communication unit 81.

[0077] In step S21, a moving image creation process (see the flowchart in FIG. 15 described later) is executed in the moving image creation system 21. Then, after the content is provided to the user in the moving image creation process executed in step S21, the content production process is terminated.

[0078] FIG. 10 is a flowchart illustrating the template cut creation process executed in step S11 of FIG.

[0079] In step S21, when the user operates the UI terminal 32 to select the vehicle 43 to test drive, the location in the content where they want to drive, and the music to be used in the content, the template cut creation unit 73 obtains the user selection information via the UI control unit 71.

[0080] In step S22, the template cut creation unit 73 acquires an existing promotional video of the vehicle 43 selected by the user from the storage 72 in accordance with the user selection information acquired in step S21, and recognizes the location where the promotional video was shot. Then, based on the user selection information acquired in step S21, the template cut creation unit 73 determines whether the location selected by the user matches the location where the existing promotional video of the vehicle 43 selected by the user was shot.

[0081] In step S22, if the template cut creation unit 73 determines that the location selected by the user does not match the location where an existing promotional video for the vehicle 43 selected by the user was filmed (i.e., the locations are different), processing proceeds to step S23.

[0082] In step S23, the template cut creation unit 73 acquires an existing promotional video of another vehicle that was filmed at a location selected by the user from the storage 72. Then, the template cut creation unit 73 creates a template cut by referring to each cut that constitutes the existing promotional video of another vehicle that was filmed at a location selected by the user.

[0083] After step S23, the process proceeds to step S24. Alternatively, if the template cut creation unit 73 determines in step S22 that the location selected by the user matches the location where an existing promotional video for the vehicle 43 selected by the user was shot, the process proceeds to step S24.

[0084] In step S24, the template cut creation unit 73 creates a template cut by referring to each cut that constitutes an existing promotional video of the vehicle 43 selected by the user.

[0085] In step S25, the template cut creation unit 73 transmits the user selection information acquired in step S21 and the template cuts created in steps S23 and S24 (or only the template cut created in step S24 if the processing of step S23 has not been performed) to the simulation processing unit 41 and the shooting control processing unit 51, respectively, via the communication unit 74. After the processing of step S25, the template cut creation process ends.

[0086] FIG. 11 is a flowchart illustrating the initial photographing process executed in step S12 of FIG.

[0087] In step S31, the initial shooting processing unit 92 performs analysis processing on the captured image obtained by the camera 52 shooting the vehicle 43, thereby recognizing the model of the vehicle 43 and detecting the stopping position of the vehicle 43 relative to the display device 42.

[0088] In step S32, the initial shooting processing unit 92 receives, via the communication unit 91, the user selection information and template cut transmitted from the moving image creation processing unit 31 in step S25 of FIG.

[0089] In step S33, the initial shooting processing unit 92 moves the camera 52 to a position where it can shoot with an angle of view corresponding to the shot at the start of shooting (for example, a shot that captures the user getting into the vehicle 43 as shown in Figure 2 above) based on the template shot received in step S32.

[0090] In step S34, the initial shooting processing unit 92 calibrates the position of the camera 52 moved in step S33 based on the parked position of the vehicle 43 relative to the display device 42 detected in step S31. For example, the initial shooting processing unit 92 calibrates the position of the camera 52 so that it corresponds to the cut at the start of shooting and so that the background when the vehicle 43 and the user are shot is within the display range of the display device 42 (so that an area outside the display range of the display device 42 is not shot). Note that if the reflection of the camera 52 or the like can be removed by post-processing of the 3DCG (for example, if the reflection is only on the body of the vehicle 43), that part may be ignored and left for post-processing.

[0091] In step S35, the initial photography processing unit 92 determines whether or not the image captured by the camera 52 placed in step S34 contains any reflections of the camera 52 (e.g., reflections including the body or glass of the vehicle 43).

[0092] If the initial shooting processing unit 92 determines in step S35 that the camera 52 is being reflected, the process proceeds to step S36. In step S36, the initial shooting processing unit 92 recalibrates the position of the camera 52 so that it corresponds to the cut at the start of shooting, the background when the vehicle 43 and the user are photographed is within the display range of the display device 42, and further so that the camera 52 is not being reflected.

[0093] After the process of step S36, or if it is determined in step S35 that the camera 52 is not reflected, the initial photographing process is ended.

[0094] FIG. 12 is a flowchart illustrating the simulator startup process executed in step S13 of FIG.

[0095] In step S41, the simulator startup processing unit 82 receives the user selection information sent from the template cut creation unit 73 in step S25 of Figure 10 via the communication unit 81, and calls up the asset corresponding to the location selected by the user in accordance with the user selection information.

[0096] In step S42, the simulator startup processing unit 82 places the 3DCG model data contained in the assets read in step S41 in a virtual space (see A in Figure 7 above) so that the in-simulator image corresponding to the template cut can be captured with a virtual camera.

[0097] In step S43, the simulator startup processing section 82 positions the virtual camera in a location that allows shooting in the virtual space at an angle of view that corresponds to the shot at which shooting will start, and then the simulator startup processing ends.

[0098] FIG. 13 is a flowchart illustrating the in-simulator video shooting process executed in step S17 of FIG.

[0099] In step S51, the in-simulator video capture processing unit 84 determines whether or not the vehicle 43 has started traveling in the virtual space of the driving simulation executed in step S15 of Fig. 9, and waits until it determines that the vehicle 43 has started traveling in the virtual space. Then, in step S51, if the in-simulator video capture processing unit 84 determines that the vehicle 43 has started traveling in the virtual space, the process proceeds to step S52.

[0100] In step S52, the in-simulator video shooting processing unit 84 selects a cut to be shot in order according to the template cut, and determines whether or not the vehicle 43 is traveling in the virtual space within the shooting range of the cut to be shot.

[0101] In step S52, if the in-simulator video shooting processing unit 84 determines that the vehicle 43 is traveling in the virtual space within the shooting range of the shot to be shot, the process proceeds to step S53.

[0102] In step S53, the in-simulator video shooting processing unit 84 determines, based on the template shot, whether or not the shot to be shot includes the user.

[0103] In step S53, if the in-simulator video shooting processing unit 84 determines that the shot to be shot includes the user, the process proceeds to step S54.

[0104] In step S54, the in-simulator video shooting processing unit 84 sends a signal to the camera system 23 via the communication unit 81 to instruct the camera 52 to start shooting.

[0105] After the process of step S54, or if it is determined in step S53 that the user is not included in the image (i.e., only the vehicle 43 is imaged so that the user is not captured), the process proceeds to step S55.

[0106] In step S55, the in-simulator video shooting processing unit 84 shoots the shot to be shot using the virtual camera in accordance with the template shot, and acquires an in-simulator video showing the vehicle 43 traveling in the virtual space.

[0107] After processing in step S55, or if it is determined in step S52 that vehicle 43 is not traveling in the virtual space that is within the shooting range of the cut to be shot (i.e., vehicle 43 is traveling in the virtual space that is outside the shooting range of the cut to be shot), processing proceeds to step S56.

[0108] In step S56, the in-simulator video capture processing unit 84 determines whether or not the driving of the vehicle 43 in the virtual space of the driving simulation executed in step S15 of FIG. 9 has been completed.

[0109] In step S56, if the in-simulator video shooting processing unit 84 determines that the vehicle 43 has not yet completed traveling in the virtual space (i.e., there is a cut in which the vehicle 43 has not yet traveled in the virtual space), the processing returns to step S52, and the same processing is repeated thereafter.

[0110] On the other hand, if the in-simulator video capture processing unit 84 determines in step S56 that the vehicle 43 has completed traveling in the virtual space, the process proceeds to step S57. That is, in this case, the driving simulation by the simulation execution unit 83 has ended.

[0111] In step S57, the in-simulator video shooting processing unit 84 notifies the camera system 23 of the end of the driving simulation, and then the in-simulator video shooting processing is ended.

[0112] FIG. 14 is a flowchart illustrating the automatic photography process executed in step S18 of FIG.

[0113] In step S61, the automatic shooting processing unit 93 receives the template cut sent from the moving image creation processing unit 31 in step S25 of Figure 10 via the communication unit 91, and based on the template cut, derives camera work for controlling the operation of the camera 52 for each individual cut.

[0114] In step S62, the automatic photography processing unit 93 derives the timing for photographing by the camera 52 for each individual shot based on the template shot received in step S61.

[0115] In step S63, the automatic photography processing unit 93 determines whether or not a signal instructing the camera 52 to start photography has been received from the in-simulator video photography processing unit 84, and waits until it determines that the signal instructing the camera 52 to start photography has been received. For example, in step S54 of Fig. 13 described above, when the in-simulator video photography processing unit 84 sends a signal instructing the camera system 23 to start photography with the camera 52 and the automatic photography processing unit 93 receives the signal via the communication unit 91, it determines that the signal instructing the camera 52 to start photography has been received, and the processing proceeds to step S64.

[0116] In step S64, the automatic photography processing unit 93 selects cuts to be photographed in order according to the template cuts, and moves the camera 52 to a position where the camera 52 can be positioned to photograph the cuts at an angle of view corresponding to the cuts to be photographed. The automatic photography processing unit 93 then calibrates the position of the camera 52 based on the parked position of the vehicle 43 relative to the display device 42 detected by the initial photography processing unit 92 in step S31 of Fig. 11. For example, the automatic photography processing unit 93 calibrates the position of the camera 52 so that the position corresponds to the cut to be photographed and so that the background when the vehicle 43 and the user are photographed is within the display range of the display device 42 (so that an image outside the display range of the display device 42 is not photographed).

[0117] In step S65, the automatic photography processing unit 93 determines whether or not the image captured by the camera 52 placed in step S64 contains any reflections of the camera 52 (e.g., reflections including the body or glass of the vehicle 43).

[0118] If the automatic photography processing unit 93 determines in step S65 that the camera 52 is reflected, the process proceeds to step S66. In step S66, the automatic photography processing unit 93 recalibrates the placement of the camera 52 so that it corresponds to the shot of the subject to be photographed, the background when the vehicle 43 and the user are photographed is within the display range of the display device 42, and further so that the camera 52 is not reflected.

[0119] After the process of step S66, or if it is determined in step S65 that no reflection of the camera 52 occurs, the process proceeds to step S67.

[0120] In step S67, the automatic photography processing unit 93 determines whether or not the end of the driving simulation has been notified by the in-simulator video photography processing unit 84. For example, in step S57 in Fig. 13 described above, when the in-simulator video photography processing unit 84 notifies the camera system 23 of the end of the driving simulation and the automatic photography processing unit 93 receives this notification via the communication unit 91, it determines that the end of the driving simulation has been notified.

[0121] If the automatic photography processing unit 93 determines in step S67 that the end of the driving simulation has not been notified, the process returns to step S63, and the same processes are repeated thereafter.

[0122] On the other hand, if the automatic photography processing unit 93 determines in step S67 that the end of the drive simulation has been notified, the automatic photography processing is ended.

[0123] FIG. 15 is a flowchart illustrating the moving image creation process executed in step S21 of FIG.

[0124] In step S71, the cut selection unit 76 receives, via the communication unit 74, the captured video transmitted from the camera system 23 in step S19 of FIG. 9, and also receives the driving data and in-simulator video transmitted from the driving simulation system 22 in step S20 of FIG. 9.

[0125] In step S72, the cut selection unit 76 selects virtual production footage that is similar to the driving situation of the vehicle 43 in the driving simulation indicated by the driving data received in step S71.

[0126] In step S73, the cut selection unit 76 displays the in-simulator footage and shot footage received in step S71, as well as the virtual production footage picked up in step S72, on the UI terminal 32 via the UI control unit 71 as options for the user to select the footage to be used in the content.

[0127] When the user selects a video to be used in the content from the in-simulator video, the shot video, and the virtual production video displayed as options, user selection information indicating the video selected by the user is supplied to the cut selection unit 76 via the UI control unit 71. In response, the cut selection unit 76 supplies the video selected by the user from the in-simulator video, the shot video, and the virtual production video to the video creation unit 77, and the process proceeds to step S74.

[0128] In step S74, the moving image creating unit 77 adjusts and edits the video supplied from the cut selecting unit 76 in step S73 to match the length of the music indicated by the user selection information, thereby creating a moving image.

[0129] In step S75, the moving image creating unit 77 provides the user with content in which music is played along with the moving image created in step S74 via the UI control unit 71 using the UI terminal 32.

[0130] In step S76, the video creation unit 77 provides the user with a link for sharing the content on SNS with an NFT attached, and then the video creation process ends.

[0131] By executing the content production process as described above, the content production system 11 can provide content produced using video images captured while the user is performing a driving simulation in which the user drives in a virtual space corresponding to an existing promotional video for the vehicle 43. This allows the content production system 11 to provide a more valuable user experience.

[0132] In addition, the content production system 11 of this embodiment can be installed in vehicle dealerships as described above, as well as in restaurants with charging stations, shopping malls, entertainment facilities, etc., and used to attract customers.

[0133] <Example of Computer Configuration> Next, the above-described series of processes (information processing method) can be performed by hardware or software. When the series of processes is performed by software, a program constituting the software is installed in a general-purpose computer or the like.

[0134] FIG. 16 is a block diagram showing an example of the configuration of an embodiment of a computer in which a program for executing the above-described series of processes is installed.

[0135] The program can be recorded in advance on the hard disk 105 or ROM 103 as a recording medium built into the computer.

[0136] Alternatively, the program can be stored (recorded) on a removable recording medium 111 driven by the drive 109. Such a removable recording medium 111 can be provided as a so-called package software. Here, examples of the removable recording medium 111 include a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, and a semiconductor memory.

[0137] The program can be installed into the computer from the removable recording medium 111 as described above, or can be downloaded to the computer via a communication network or a broadcasting network and installed on the built-in hard disk 105. That is, the program can be transferred to the computer wirelessly from a download site via an artificial satellite for digital satellite broadcasting, or transferred to the computer by wire via a network such as a LAN (Local Area Network) or the Internet.

[0138] The computer includes a CPU (Central Processing Unit) 102 , to which an input / output interface 110 is connected via a bus 101 .

[0139] When a user inputs a command via the input / output interface 110 by operating the input unit 107, the CPU 102 executes a program stored in a read-only memory (ROM) 103 in accordance with the command. Alternatively, the CPU 102 loads a program stored on a hard disk 105 into a random access memory (RAM) 104 and executes the program.

[0140] As a result, the CPU 102 performs processing according to the flowchart described above or processing performed by the configuration of the block diagram described above. Then, the CPU 102 outputs the processing results from the output unit 106 via the input / output interface 110, transmits them from the communication unit 108, or records them on the hard disk 105, as necessary.

[0141] The input unit 107 is made up of a keyboard, a mouse, a microphone, etc. The output unit 106 is made up of an LCD (Liquid Crystal Display), a speaker, etc.

[0142] In this specification, the processing performed by a computer according to a program does not necessarily have to be performed in chronological order according to the order described in the flowchart. In other words, the processing performed by a computer according to a program also includes processing that is executed in parallel or individually (for example, parallel processing or object-based processing).

[0143] The program may be processed by a single computer (processor), or may be distributed among multiple computers. Furthermore, the program may be transferred to and executed on a remote computer.

[0144] Furthermore, in this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all of the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.

[0145] Also, for example, a configuration described as one device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit). Of course, configurations other than those described above may be added to the configuration of each device (or each processing unit). Furthermore, as long as the configuration and operation of the entire system are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).

[0146] Furthermore, for example, the present technology can be configured as a cloud computing system in which a single function is shared and processed collaboratively by a plurality of devices via a network.

[0147] Furthermore, for example, the above-described program can be executed in any device, as long as the device has the necessary functions (functional blocks, etc.) and can obtain the necessary information.

[0148] Also, for example, each step described in the above flowchart can be executed by one device or can be shared and executed by multiple devices. Furthermore, if one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices. In other words, multiple processes included in one step can be executed as multiple step processes. Conversely, processes described as multiple steps can be executed collectively as a single step.

[0149] In addition, the processing of the steps of a program executed by a computer may be executed in chronological order according to the order described in this specification, or may be executed in parallel or individually at the required timing, such as when a call is made. In other words, as long as no contradiction occurs, the processing of each step may be executed in an order different from the order described above. Furthermore, the processing of the steps of this program may be executed in parallel with the processing of another program, or may be executed in combination with the processing of another program.

[0150] It should be noted that the present technologies described in this specification can be implemented independently and singly, unless a contradiction arises. Of course, any two or more of the present technologies can also be implemented in combination. For example, part or all of the present technologies described in any embodiment can be implemented in combination with part or all of the present technologies described in other embodiments. Furthermore, part or all of any of the present technologies described above can also be implemented in combination with other technologies not described above.

[0151] <Examples of Combinations of Configurations> The present technology can also be configured as follows: (1) An information processing system comprising: a driving simulation system that executes a driving simulation using a vehicle selected by a user, and acquires driving data corresponding to the user's operation of the vehicle and in-simulator video showing the vehicle traveling in a virtual space; a camera system that captures the vehicle and the user with a camera to acquire captured video; and a video creation system that creates a video constructed using at least the in-simulator video and the captured video. (2) The video creation system has a template cut creation unit that creates template cuts that instruct the shooting of the in-simulator video and the captured video by referencing each cut that constitutes an existing promotional video of the vehicle selected by the user, the driving simulation system has an in-simulator video shooting processing unit that shoots the in-simulator video in accordance with the template cut, and the camera system has an automatic shooting processing unit that performs camera control on the camera that shoots the captured video in accordance with the template cut. The information processing system described in (1) above. (3) The information processing system according to (2) above, wherein the template cut creation unit, if the location selected by the user does not match the location where an existing promotional video for the vehicle was shot, creates the template cut by referring to each cut constituting an existing promotional video for another vehicle that was shot at the location selected by the user. (4) The information processing system according to (2) or (3) above, wherein the video creation system further comprises a cut selection unit that, from a plurality of virtual production videos prepared in advance as material for advertising the vehicle, picks out virtual production videos that are similar to driving conditions based on the driving data, and allows the user to select cuts to be used in creating the video from the in-simulator video, the shot video, and a plurality of cuts from the virtual production videos.(5) The information processing system according to (4), wherein the video creation system further includes a video creation unit that creates the video by adjusting and editing the video of the multiple cuts selected by the user to match the length of the music selected by the user. (6) The information processing system according to (5), wherein the video creation system provides the user with content in which the music is played along with the video created by the video creation unit, and provides the user with a link for sharing the content on a social networking service (SNS) by attaching a non-fungible token (NFT). (7) The information processing system according to any of (2) to (6), wherein the driving simulation system further includes a display device that displays a simulation video of a location selected by the user during execution of the driving simulation. (8) The information processing system according to (7), wherein the driving simulation system further includes a simulator startup processing unit that places 3DCG (3 Dimensional Computer Graphics) model data included in assets called up according to the location selected by the user in the virtual space in which the vehicle virtually travels in the driving simulation. (9) The information processing system according to (8), wherein the driving simulation system further includes a simulation execution unit that executes a driving simulation in which the vehicle virtually drives in accordance with the driving data so that each cut according to the template cut can be shot in the virtual space. (10) The information processing system according to (9), wherein the simulation execution unit generates the simulation video adjusted to make it appear as if the vehicle is actually being driven through the display device from a position of the vehicle running in the virtual space, and displays the simulation video on the display device. (11) The information processing system according to any of (7) to (10), wherein the camera system further includes an initial shooting processing unit that detects the model of the vehicle and detects a stopping position of the vehicle relative to the display device.(12) The information processing system described in (11) above, wherein the initial shooting processing unit moves the camera to a position where shooting can be performed with an angle of view corresponding to the cut at the start of shooting, based on the template cut, and calibrates the position of the camera based on the stopping position of the vehicle so that the background of the shot taken by the camera is within the display range of the display device. (13) The information processing system described in (12) above, wherein the initial shooting processing unit recalibrates the position of the camera to avoid reflections of the camera, if any. (14) The information processing system described in any of (11) to (13) above, wherein the automatic shooting processing unit moves the camera to a position where shooting can be performed with an angle of view corresponding to the cut of the subject, based on the template cut, and calibrates the position of the camera based on the stopping position of the vehicle so that the background of the shot taken by the camera is within the display range of the display device. (15) The information processing system described in (14) above, wherein the automatic shooting processing unit recalibrates the position of the camera to avoid reflections of the camera, if any. (16) An information processing method, comprising: an information processing system executing a driving simulation using a vehicle selected by a user, and acquiring driving data corresponding to the user's operation of the vehicle and an in-simulator video showing the vehicle traveling in a virtual space, capturing the vehicle and the user with a camera to acquire the captured video, and creating a video using at least the in-simulator video and the captured video. (17) A program for causing a computer of an information processing system to execute information processing, comprising: executing a driving simulation using a vehicle selected by a user, and acquiring driving data corresponding to the user's operation of the vehicle and an in-simulator video showing the vehicle traveling in a virtual space, capturing the vehicle and the user with a camera to acquire the captured video, and creating a video using at least the in-simulator video and the captured video.

[0152] It should be noted that the present embodiment is not limited to the above-described embodiment, and various modifications are possible within the scope of the gist of the present disclosure. Furthermore, the effects described in this specification are merely examples and are not intended to be limiting, and other effects may also be obtained.

[0153] REFERENCE SIGNS LIST 11 Content production system, 21 Video image creation system, 22 Driving simulation system, 23 Camera system, 24 Cloud server, 25 Network, 31 Video image creation processing unit, 32 UI terminal, 41 Simulation processing unit, 42 Display device, 43 Vehicle, 51 Shooting control processing unit, 52 Camera, 53 Rig, 71 UI control unit, 72 Storage, 73 Template cut creation unit, 74 Communication unit, 75 Processing control unit, 76 Cut selection unit, 77 Video image creation unit, 81 Communication unit, 82 Simulator startup processing unit, 83 Simulation execution unit, 84 In-simulator video shooting processing unit, 91 Communication unit, 92 Initial shooting processing unit, 93 Automatic shooting processing unit

Claims

1. A drive simulation system that executes a drive simulation using a vehicle selected by a user, and acquires driving data corresponding to the user's operation on the vehicle and in-simulator video showing the vehicle traveling in a virtual space, a camera system that photographs the vehicle and the user with a camera to acquire photographed video, and a moving image creation system that creates a moving image configured using at least the in-simulator video and the photographed video. An information processing system comprising:

2. The information processing system according to claim 1, wherein the moving image creation system has a template cut creation unit that creates a template cut for instructing photographing of the in-simulator video and the photographed video by referring to each cut constituting an existing promotion video of the vehicle selected by the user, the drive simulation system has an in-simulator video photographing processing unit that photographs the in-simulator video according to the template cut, and the camera system has an automatic photographing processing unit that performs camera control on the camera that photographs the photographed video according to the template cut.

3. The information processing system according to claim 2, wherein when the location selected by the user does not match the location where an existing promotion video of the vehicle was photographed, the template cut creation unit creates the template cut by referring to each cut constituting an existing promotion video of another vehicle photographed at the location selected by the user.

4. The information processing system according to claim 2, wherein the moving image creation system further has a cut selection unit that picks up a virtual production video similar to the driving situation based on the driving data from among a plurality of virtual production videos prepared in advance as materials for advertising the vehicle, and causes the user to select a cut to be used in creating the moving image from among a plurality of cuts of the in-simulator video, the photographed video, and the virtual production video.

5. The moving image creation system according to claim 4, further comprising a moving image creation unit that adjusts and edits the videos of the plurality of cuts selected by the user according to the length of the music selected by the user to create the moving image.

6. The information processing system according to claim 5, wherein the moving image creation system provides the user with content in which the music is played together with the moving image created by the moving image creation unit, and provides the user with a link for sharing the content on an SNS (Social Networking Service) with an NFT (Non-Fungible Token) attached thereto.

7. The information processing system according to claim 2, wherein the drive simulation system further includes a display device that displays a simulation video of a location selected by the user during the execution of the drive simulation.

8. The information processing system according to claim 7, wherein the drive simulation system further includes a simulator startup processing unit that arranges the model data of 3DCG (3 Dimensional Computer Graphics) included in an asset called according to a location selected by the user in the virtual space in which the vehicle is virtually driven in the drive simulation.

9. The information processing system according to claim 8, wherein the drive simulation system further includes a simulation execution unit that executes a drive simulation to virtually drive the vehicle according to the driving data so that each cut according to the template cut can be photographed in the virtual space.

10. The information processing system according to claim 9, wherein the simulation execution unit generates a simulation video adjusted to actually drive as if through the display device from the arrangement position of the vehicle traveling in the virtual space, and displays the simulation video on the display device.

11. The information processing system according to claim 7, wherein the camera system further includes an initial shooting processing unit that detects the vehicle type of the vehicle and detects the stop position of the vehicle with respect to the display device.

12. The initial shooting processing unit moves the camera to an arrangement where shooting is possible at an angle of view corresponding to the cut at the start of shooting based on the template cut, and calibrates the arrangement of the camera based on the parking position of the vehicle so that the background of the shooting by the camera is within the display range of the display device. The information processing system according to claim 11.

13. When reflection of the camera occurs, the initial shooting processing unit re-calibrates the arrangement of the camera so as to avoid the reflection. The information processing system according to claim 12.

14. The automatic shooting processing unit moves the camera to an arrangement where shooting is possible at an angle of view corresponding to the cut of the shooting target based on the template cut, and calibrates the arrangement of the camera based on the parking position of the vehicle so that the background of the shooting by the camera is within the display range of the display device. The information processing system according to claim 11.

15. When reflection of the camera occurs, the automatic shooting processing unit re-calibrates the arrangement of the camera so as to avoid the reflection. The information processing system according to claim 14.

16. An information processing method including: executing a drive simulation using a vehicle selected by a user, and acquiring driving data corresponding to the user's operation on the vehicle and an in-simulator image in which the vehicle traveling in a virtual space is reflected; acquiring a captured image by photographing the vehicle and the user with a camera; and creating a moving image configured using at least the in-simulator image and the captured image.

17. A program for causing a computer of an information processing system to execute information processing including: executing a drive simulation using a vehicle selected by a user, and acquiring driving data corresponding to the user's operation on the vehicle and an in-simulator image in which the vehicle traveling in a virtual space is reflected; acquiring a captured image by photographing the vehicle and the user with a camera; and creating a moving image configured using at least the in-simulator image and the captured image.

Images