CONTENT CONTROL DEVICE, CONTENT CONTROL METHOD, PROGRAM, AND CONTENT PROVIDING SYSTEM

Abstract

To provide a content control device, a content control method, a program, and a content providing system that improve the presence of content that allows a user to experience sensations including movement in a virtual space.SOLUTION: In a content providing system 1A including a video projection device 10, an omnidirectional vehicle 20, and a content control device 30, the content control device includes a content reproduction unit that reproduces a content that allows a user to experience a sensation including movement in a virtual space, and that outputs a video signal obtained by reproducing the content to a video projection device, and a movement control unit that controls the omnidirectional wheels of the omnidirectional vehicle in synchronization with the video displayed on the video projection device.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to a content control device, a content control method, a program, and a content providing system. [Background technology]

[0002] Conventionally, technology has been developed that provides content that allows users to experience a virtual space using a head-mounted display. In such applications, it is often desirable for the head-mounted display to be used in an open space with no surrounding obstacles, taking into consideration the user's movements. However, since the situation around the user is not necessarily constant, the user needs to use the head-mounted display while taking into consideration the surrounding environment when using the content. In order to solve such inconveniences, technology has been devised that provides content using a head-mounted display while restricting the user's range of movement to some extent (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-136572 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the technology of Patent Document 1, the user does not actually move from a given position, so the content that allows the user to experience movement in a virtual space may lack a sense of realism.

[0005] The present invention has been made in consideration of the above circumstances, and one of its objectives is to provide a content control device, a content control method, a program, and a content provision system that can improve the sense of realism of content that provides an experience that includes movement in a virtual space. [Means for solving the problem]

[0006] A content control device, a content control method, a program, and a content providing system according to the present invention employ the following configuration.

[0007] (1): A content control device according to one embodiment of the present invention is a control device for a content provision system including a vehicle equipped with omnidirectional wheels and a video projection device, and includes a content playback unit that plays content that allows a user to have an experience including movement in a virtual space and outputs a video signal obtained by playing the content to the video projection device, and a movement control unit that controls the omnidirectional wheels of the vehicle in synchronization with the video displayed on the video projection device.

[0008] (2): In the above aspect (1), the movement control unit controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the user's straight-line movement in the virtual space while the content is being played.

[0009] (3) In the above aspect (2), the movement control unit controls the omnidirectional wheels so that the vehicle travels along the circular route at a speed equal to or less than a specified speed.

[0010] (4): In any of the above aspects (1) to (3), in the image of the virtual space obtained by playing the content, the virtual space is displayed so that areas that are perceived as closer by the user change more in accordance with the user's movement in the virtual space, and areas that are perceived as farther away by the user change less in accordance with the user's movement in the virtual space.

[0011] (5): In any of the above aspects (1) to (4), the movement control unit controls the omnidirectional wheels based on the position of an object displayed in the virtual space corresponding to the movement limit of the vehicle so that the user does not come into contact with the movement limit.

[0012] (6): In any of the above aspects (1) to (5), the vehicle may be supported on a platform, and the platform may further include a drive platform device that counteracts the movement of the vehicle caused by the omnidirectional wheels.

[0013] (7): In the above aspect (6), a production control unit is further provided which instructs a generating device, which generates an event perceived by at least one of the five human senses as a special effect for producing the content, to generate the event in accordance with the driving state of the drive table device.

[0014] (8): A content control method according to one embodiment of the present invention involves a computer functioning as a control device for a content provision system including a vehicle with omnidirectional wheels and a video projection device, playing content that allows a user to have an experience including movement in a virtual space, outputting a video signal obtained by playing the content to the video projection device, and controlling the omnidirectional wheels of the vehicle in synchronization with the video displayed on the video projection device.

[0015] (9): A program according to one embodiment of the present invention causes a computer functioning as a control device for a content provision system including a vehicle with omnidirectional wheels and a video projection device to play content that allows a user to have an experience that includes movement in a virtual space, output a video signal obtained by playing the content to the video projection device, and control the omnidirectional wheels of the vehicle in synchronization with the video displayed on the video projection device.

[0016] (10): A content provision system according to one embodiment of the present invention includes a vehicle equipped with omnidirectional wheels, a video projection device, a content playback unit that plays content that allows a user to have an experience including movement in a virtual space and outputs a video signal obtained by playing the content to the video projection device, and a movement control unit that controls the omnidirectional wheels of the vehicle in synchronization with the video displayed on the video projection device. Effect of the Invention

[0017] According to (1) to (10), by playing content that allows a user to have an experience including movement in a virtual space, outputting a video signal obtained by playing the content to a video projection device, and controlling an omnidirectional vehicle in synchronization with the video displayed on the video projection device, it is possible to improve the realism of the content that provides an experience including movement in a virtual space. [Brief description of the drawings]

[0018] [Figure 1] 1 is a diagram illustrating an example of the configuration of a content providing system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a configuration example of an omnidirectional wheel according to the first embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an example of a functional configuration of a content providing system according to a first embodiment. [Figure 4] 3 is a diagram illustrating an example of the relationship between the moving direction of an omnidirectional vehicle and the moving direction of a user perceived from a content video in the first embodiment. FIG. [Diagram 5] 5 is a flowchart showing an example of a process flow in which the content control device of the first embodiment controls the movement of an omnidirectional vehicle in accordance with the playback of content. [Figure 6] 5 is a flowchart showing an example of the flow of a synchronization control process in the first embodiment. [Figure 7] 5A to 5C are diagrams illustrating an example of a situation in which the moving direction of the omnidirectional vehicle is changed at a second control timing in the first embodiment. [Figure 8] FIG. 11 is a diagram illustrating an example of the configuration of a content providing system according to a second embodiment. [Figure 9] FIG. 11 is a diagram illustrating an example of a functional configuration of a content providing system according to a second embodiment. [Figure 10] 10 is a flowchart showing an example of the flow of a synchronization control process in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, embodiments of a content control device, a content control method, a program, and a content providing system of the present invention will be described with reference to the drawings. First Embodiment 1 is a diagram showing an example of the configuration of a content providing system 1A in the first embodiment. The content providing system 1A is a system that provides content that allows a user to experience a visually recognized virtual movement in synchronization with an actual movement. The content providing system 1A includes, for example, a video projection device 10, an omnidirectional vehicle 20, and a content control device 30. The content control device 30 is capable of communicating with both the video projection device 10 and the omnidirectional vehicle 20.

[0020] The image projection device 10 is a display device that can give the user the sensation of being in a virtual space by inputting an image signal (hereinafter referred to as a "VR signal") corresponding to VR (Virtual Reality) and displaying an image according to parallax in front of the user's eyes. The image projection device 10 inputs a VR signal of a target content from the content control device 30 and displays an image based on the input VR signal, thereby allowing the user to have an experience including movement in a virtual space.

[0021] For example, the image projection device 10 may be a head-mounted display device known as VR goggles. The image projection device 10 is not limited to being mounted on the head of a user as long as it is installed in a position that allows a moving user to view VR images. For example, the image projection device 10 may be one in which a display support is fixed to a part other than the user's head (such as the shoulder), or may be one that is fixed to the omnidirectional vehicle 20. The VR images projected by the image projection device 10 may include AR (Augmented Reality) and MR (Mixed Reality).

[0022] Note that the method of realizing the image projection device 10 is not limited to a specific method as long as it allows the user to perceive a similar sensation. For example, the projection method of the image projection device 10 may be a retinal projection method, a virtual image projection method, or other methods. Also, for example, the type of the display unit of the image projection device 10 may be an open type or a shielded type.

[0023] In the content providing system 1A, the omnidirectional vehicle 20 has a role of moving the user in order to add a sense of movement obtained by actual movement to the virtual movement visually perceived by the content video. The omnidirectional vehicle 20 receives a control signal synchronized with the content video from the content control device 30, and controls the movement of the vehicle itself based on the received control signal. Specifically, the omnidirectional vehicle 20 includes, for example, a seat unit 21 and omnidirectional wheels 22. The seat unit 21 constitutes the seat of the user. The user sits in the seat unit 21 and operates the omnidirectional vehicle 20.

[0024] The omnidirectional wheels 22 are wheels that enable the vehicle to immediately move forward in any direction (all directions of 360 degrees) from the current position without performing preparatory movements such as turning. FIG. 2 is a diagram showing an example of the configuration of the omnidirectional wheels 22. The omnidirectional wheels 22 include, for example, large diameter wheels 22A as front wheels and turning wheels 22C as rear wheels, and include a plurality of small diameter wheels 22B on the ground contact portion (radial edge portion) of the large diameter wheels 22A of the front wheels. The large diameter wheels 22A are wheels that mainly realize linear movement in the front-rear direction. The small diameter wheels 22B are wheels that mainly realize lateral movement on the spot by rotating around an axis in the rotation direction (circumferential direction) of the large diameter wheels 22A. On the other hand, the turning wheels 22C of the rear wheels are wheels that have a smaller diameter than the large diameter wheels 22A and mainly realize turning movement by rotating around an axis perpendicular to the axis of rotation of the large diameter wheels 22A. Omnidirectional wheels 22 are equipped with motors (not shown) that can independently control the rotation of large diameter wheels 22A, small diameter wheels 22B, and turning wheels 22C. With this configuration, omnidirectional wheels 22 can not only move forward and backward, but also move in various directions such as sideways and diagonally by utilizing the difference in lateral movement speed between the front and rear wheels, and can also realize agile movements such as turning and rotating on the spot.

[0025] 1 (the direction from the rear of the page to the front of the page, hereinafter referred to as the +y-axis direction), and the rearward direction is the negative y-axis direction (the direction from the front of the page to the rear of the page, hereinafter referred to as the -y-axis direction). For example, as shown in operation example M1 (forward / reverse) in FIG. 2, the omnidirectional wheel 22 moves forward by rotating the large diameter wheel 22A in the direction of arrow A1, and moves backward by rotating it in the direction of arrow A2.

[0026] Also, for example, as shown in the operation example M2 (left-right movement) of FIG. 2, the omnidirectional wheel 22 can move leftward on the spot without changing its direction by rotating the small diameter wheel 22B in the direction of the arrow A3. In this case, the turning wheel 22C may be configured to rotate naturally in the direction of the arrow A4 in response to the left-right movement, or may be controlled to rotate in the direction of the arrow A4 in response to the amount of rotation of the small diameter wheel 22B. Also, the omnidirectional wheel 22 can move rightward on the spot without changing its direction by rotating the small diameter wheel 22B in the opposite direction to the arrow A3. The leftward direction here is the leftward direction in FIG. 1, which corresponds to the negative direction of the x-axis (-x-axis direction), and the rightward direction is the rightward direction in FIG. 1, which corresponds to the positive direction of the x-axis (+x-axis direction). The multiple small diameter wheels 22B may be configured so that all the wheels rotate simultaneously, or only the wheels on the ground may rotate.

[0027] Further, for example, as shown in operation example M3 (turning on the spot) in FIG. 2, the omnidirectional wheel 22 can turn on the spot in the direction of arrow A6 around the ground contact point P1 of the large diameter wheel 22A by rotating the turning wheel 22C in the direction of arrow A5, and can turn on the spot in the direction opposite to arrow A6 by rotating it in the opposite direction to arrow A5.

[0028] 2, the omnidirectional wheel 22 can move forward while turning in the direction of the arrow A9 by rotating the large diameter wheel 22A in the direction of the arrow A7 and rotating the turning wheel 22C in the direction of the arrow A8 (turning). The omnidirectional wheel 22 can move backward while turning in the direction opposite to the arrow A9 by rotating the large diameter wheel 22A in the direction opposite to the arrow A7 and rotating the turning wheel 22C in the direction of the arrow A8. In this example, the omnidirectional wheel 22 can move forward or backward with the turning center on the right side by rotating the turning wheel 22C in the direction opposite to the arrow A8.

[0029] The method of realizing the omnidirectional wheels 22 is not limited to the method shown in FIG. 2. The omnidirectional wheels 22 may be realized by any existing technology. The omnidirectional vehicle 20 may be equipped with one omnidirectional wheel 22 or multiple omnidirectional wheels 22. Furthermore, the omnidirectional vehicle 20 may be equipped with normal wheels as auxiliary wheels in addition to the omnidirectional wheels 22. The operation of the omnidirectional wheels 22 is controlled by a control unit (not shown) (for example, installed inside the seat unit 21) mounted on the omnidirectional vehicle 20, and the control unit changes the operation (movement direction and speed) of the omnidirectional wheels 22 based on a control signal input from the content control device 30.

[0030] The content control device 30 has a function of playing back content and outputting a VR signal of the content being played back to the video projection device 10. The content control device 30 also has a function of outputting a control signal according to the playback status of the content to the omnidirectional vehicle 20. As the content control device 30 has these functions, the content providing system 1A can move the user in synchronization with the virtual movement visually perceived by the content video.

[0031] 3 is a diagram showing an example of a functional configuration of the content providing system 1A in the first embodiment. The video projection device 10, the omnidirectional vehicle 20, and the content control device 30 are connected to, for example, a wireless LAN (Local Area Network) and can communicate with each other via the wireless LAN. For convenience in using content, this embodiment assumes that communication between the devices is realized by wireless communication, but this is not essential and communication between the devices may be realized by wired communication. In addition, the video projection device 10, the omnidirectional vehicle 20, and the content control device 30 may be configured to communicate by short-range wireless communication instead of wireless LAN.

[0032] Furthermore, if there is no problem with responsiveness, the image projection device 10, the omnidirectional vehicle 20, and the content control device 30 may be configured to communicate via a WAN (Wide Area Network) such as a cellular network, a dedicated line, or the Internet. Furthermore, if there is no problem with responsiveness, the image projection device 10, the omnidirectional vehicle 20, and the content control device 30 may be configured to communicate via a WAN (Wide Area Network) such as a cellular network, a dedicated line, or the Internet.

[0033] First, the configuration of the video projection device 10 will be described. The video projection device 10 includes, for example, a communication unit 11, a display unit 12, and a display control unit 13. These components are realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by cooperation between software and hardware. The program may be stored in advance in a storage device (a storage device having a non-transient storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or may be stored in a removable storage medium (non-transient storage medium) such as a DVD or a CD-ROM, and installed by mounting the storage medium in a drive device.

[0034] The communication unit 11 is, for example, a wireless LAN interface that connects to a LAN. The communication unit 11 receives a VR signal from the content control device 30 via the LAN, and outputs the received VR signal to the display control unit 13. The communication unit 11 may be replaced with another communication interface depending on the communication method adopted between the video projection device 10, the omnidirectional vehicle 20, and the content control device 30.

[0035] The display unit 12 is configured by combining a light source (a small projector), a lens, a half mirror, etc., and is configured so that an image output from the light source is formed on the retina of a user wearing the image projection device 10 via the lens, half mirror, etc. The display unit 12 outputs an image based on a VR signal supplied from the content control device 30 from the light source.

[0036] The display control unit 13 controls the display operation of the video projection device 10. Specifically, the display control unit 13 receives a VR signal of the content being played from the content control device 30 via the communication unit 11, and outputs the received VR signal to the display unit 12. In the display unit 12, an image based on the VR signal output from the display control unit 13 is output from a light source. As a result, the image of the content being played is formed on the user's retina.

[0037] Next, the configuration of the omnidirectional vehicle 20 will be described. The omnidirectional vehicle 20 includes, for example, omnidirectional wheels 22, a communication unit 23, and a wheel control unit 24. These components are realized by, for example, a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by a combination of software and hardware. The program may be stored in advance in a storage device such as an HDD or flash memory (a storage device having a non-transient storage medium), or may be stored in a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium), and may be installed by mounting the storage medium in a drive device.

[0038] As described above, the omnidirectional wheel 22 is a wheel that can instantly change its moving direction to any direction, and has a drive mechanism that changes the moving direction of the wheel, and a drive mechanism that changes the rotation speed and rotation direction of the wheel. Each of these drive mechanisms can be controlled by an electric signal, and is controlled based on a control signal input from the wheel control unit 24.

[0039] The communication unit 23 is, for example, a wireless LAN interface. The communication unit 23 receives a control signal from the content control device 30 and outputs the received control signal to the wheel control unit 24. The communication unit 23 may be replaced with another communication interface depending on the communication method adopted between the image projection device 10, the omnidirectional vehicle 20, and the content control device 30.

[0040] The wheel control unit 24 controls the movement of the omnidirectional vehicle 20. Specifically, the wheel control unit 24 controls the operation of the omnidirectional wheels 22 based on a control signal corresponding to the playback status of the content, which is supplied from the content control device 30. For example, in a situation where a scene in which a user moves forward in a virtual space is being played back in a content video, the wheel control unit 24 receives a control signal from the content control device 30 for moving the omnidirectional vehicle 20 forward in accordance with the forward movement of the user, and outputs the received control signal to the omnidirectional wheels 22, thereby moving the omnidirectional vehicle 20 forward.

[0041] Next, the configuration of the content control device 30 will be described. The content control device 30 includes, for example, a communication unit 31, a storage unit 32, and a content control unit 33A. These components are realized by, for example, a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by cooperation between software and hardware. The program may be stored in advance in a storage device such as an HDD or flash memory (a storage device having a non-transient storage medium), or may be stored in a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium), and installed by mounting the storage medium in a drive device.

[0042] The communication unit 31 is, for example, a wireless LAN interface that connects to a LAN. The communication unit 31 transmits a VR signal to the image projection device 10 via the LAN, and transmits a control signal to the omnidirectional vehicle 20. The communication unit 31 may be replaced with another communication interface depending on the communication method adopted between the image projection device 10, the omnidirectional vehicle 20, and the content control device 30.

[0043] The storage unit 32 is realized by, for example, a HDD, a flash memory, an EEPROM, a ROM, or a RAM. For example, content data D1 and content control data D2 are stored in the storage unit 32. In addition, the storage unit 32 may store any information necessary for the operation of the content control device 30, such as programs and setting information that are read and executed by the processor, intermediate data, and various input / output data.

[0044] Here, the content data D1 is data for generating content to be provided to the user. In this embodiment, the content data D1 includes video data that allows the user to visually perceive virtual movement in a virtual space, and is configured to display the content video by performing a playback process. Moreover, the content control data D2 is data that defines a control signal according to the playback status for the content to be provided to the user.

[0045] The content control unit 33A has a function of playing back the specified content and displaying it on the video projection device 10, and also has a function of controlling the movement of the omnidirectional vehicle 20 according to the content playback status. For example, the content control unit 33A includes a content playback unit 331 and a movement control unit 332.

[0046] The content playback unit 331 acquires the content data D1 of the specified content from the storage unit 32 and executes a playback process to acquire a video signal of the content, and also converts the acquired video signal into a VR signal and transmits it to the video projection device 10. Note that if the content data D1 supports VR display, that is, if the video data included in the content data D1 is configured to directly output a VR signal through a playback process, the content playback unit 331 may omit the process of converting the video signal into a VR signal.

[0047] The movement control unit 332 acquires content control data D2 corresponding to the content being played from the storage unit 32, generates a control signal according to the playback status of the content based on the acquired content control data D2, and transmits the generated control signal to the omnidirectional vehicle 20. For example, the content control data D2 defines at least a control timing corresponding to the display timing of a scene in which the user moves in the content video, and the movement control unit 332 generates a control signal for moving the omnidirectional vehicle 20 in accordance with the control timing indicated by the content control data D2 while synchronizing with the content video being played.

[0048] Note that since content playback may be affected by the load of the content control device 30 during playback, the playback position of the content being played back does not necessarily match the elapsed time from the start of content playback. For this reason, for example, the movement control unit 332 periodically acquires information indicating the playback position of the content being played back from the content playback unit 331 (hereinafter referred to as "playback position information") and monitors the playback position to generate a control signal in synchronization with the content video. For example, the playback position information may be represented by a specific frame in the content video or a count number of a clock signal. This enables the content control device 30 to accurately synchronize the content video with the operation of the omnidirectional vehicle 20, reducing the sense of incongruity caused by a discrepancy between movement in virtual space and actual movement, and providing content with a higher sense of realism.

[0049] In addition, the content control data D2 may define a movement mode, such as a movement speed, a movement amount, and a movement direction, in association with the control timing. In this case, the movement control unit 332 may be configured to generate a control signal for moving the omnidirectional vehicle 20 in the movement mode defined for the control timing, in accordance with the control timing indicated by the content control data D2.

[0050] 4 is a diagram illustrating the relationship between the moving direction of omnidirectional vehicle 20 and the moving direction of the user as perceived by the content video. In FIG. 4, the video of virtual space VS1 shows a situation in which a scene is being played in which the user is moving along road R1 from the front side of the page to the back side of the page (in the direction of the arrow in the figure) in the content video. In this situation, the movement control unit 332 generates a control signal in synchronization with the video of virtual space VS1, in real space RS1, for causing the omnidirectional vehicle 20 to travel along circuit route RT1 at a speed equal to or lower than a specified speed.

[0051] Here, the specified speed is the upper limit of the speed at which the user can perceive (have the illusion) the circular movement as a straight line movement. This utilizes the fact that the faster the movement speed is in a circular movement, the stronger the centrifugal force becomes, making it easier for the user to perceive the current movement as a circular movement by senses other than sight, while the slower the movement speed is, the weaker the centrifugal force becomes, making it easier for the user to have the illusion that the current movement is a straight line movement.

[0052] In addition, in circular movement, the larger the diameter of the circular route, the greater the centrifugal force, so the user can easily perceive the current movement as circular movement by senses other than vision, while the smaller the diameter of the circular route, the smaller the centrifugal force, so the user can easily mistake the current movement for a straight line movement. Therefore, the movement control unit 332 may be configured to generate a control signal that, in addition to satisfying the movement speed condition, causes the vehicle to travel on a circular route with as large a diameter as possible within an allowable range.

[0053] In this way, the movement control unit 332 controls the movement of the omnidirectional vehicle 20 in synchronization with the content image, so that it is possible to provide content in which movement in the virtual space is synchronized with actual movement, and it is possible to provide content with a higher sense of realism. Furthermore, the movement control unit 332 controls the omnidirectional vehicle 20 to travel along a circular route at a speed equal to or lower than a specified speed, so that it is possible to limit the range of real space required for using the content to the range of the circular route while preventing the user from feeling uncomfortable. This allows the user to use content with a higher sense of realism in a limited range of space. Therefore, according to the content providing system 1A of this embodiment, it is possible to improve the sense of realism of content that allows the user to experience an experience including movement in a virtual space.

[0054] In order to further improve the realism of the content, the magnitude of the image change in the content video may be varied depending on the area in the image. Specifically, a visual effect may be imparted to the content video such that the image change is greater in an area that is perceived as closer by the user and the image change is smaller in an area that is perceived as farther away by the user, depending on the user's movement in the virtual space. The content playback unit 331 may play content to which such visual effects have been imparted in advance, or may be configured to impart such visual effects to a video signal obtained by playing the content.

[0055] 5 is a flowchart showing an example of a process flow in which the content control device 30 of this embodiment controls the movement of the omnidirectional vehicle 20 in accordance with the reproduction of content. First, in the content control device 30, when the reproduction condition of the content is satisfied, the content reproduction unit 331 reproduces the designated content (step S101). Specifically, the content reproduction unit 331 acquires the content data D1 of the designated content from the storage unit 32, and executes a reproduction process on the acquired content data D1. When the content reproduction unit 331 starts reproduction of the content, it converts the time-series video signal acquired by the reproduction process into a VR signal, and outputs the converted time-series VR signal to the video projection device 10 in time series (step S102).

[0056] Next, the movement control unit 332 executes a synchronous control process (step S103). The synchronous control process is a process for controlling the movement of the omnidirectional vehicle 20 in synchronization with the content video, and is a process that is repeatedly executed at a predetermined cycle during the playback of the content. After executing one cycle of the synchronous control process (step S103), the movement control unit 332 determines whether the playback of the content has ended (step S104). If it is determined that the playback of the content has not ended, the movement control unit 332 returns to the process at step S103 and repeatedly executes the synchronous control process.

[0057] On the other hand, if it is determined in step S104 that the playback of the content has ended, the movement control unit 332 stops the movement of the omnidirectional vehicle 20 (step S105) and ends the output of the VR signal to the image projection device 10 (step S106).

[0058] FIG. 6 is a flowchart showing an example of the flow of the synchronization control process in this embodiment. First, the movement control unit 332 judges whether or not a first control timing has arrived for the movement control of the omnidirectional vehicle 20 in the content video being played back (step S201). Specifically, the movement control unit 332 refers to the content control data D2 stored in the storage unit 32 and judges whether or not the current playback time of the content video (here, this means the elapsed time from the beginning of the video) is defined as the first control timing. In this case, the movement control unit 332 can judge that the first control timing has arrived if the current playback time is defined as the first control timing, and can judge that the first control timing has not arrived if the current playback time is not defined as the first control timing.

[0059] If it is determined that the first control timing has arrived, the movement control unit 332 generates a control signal for controlling the omnidirectional vehicle 20 to travel along the circular route at a speed equal to or lower than the specified speed, and outputs the control signal to the omnidirectional vehicle 20 (step S202). On the other hand, if it is determined in step S201 that the first control timing has not arrived, the movement control unit 332 skips step S202 and proceeds to step S203.

[0060] Next, the movement control unit 332 determines whether or not a second control timing has arrived for the movement control of the omnidirectional vehicle 20 in the content image being played back (step S203). Here, the second control timing is also defined in the content control data D2, similar to the first control timing, and the arrival or non-arrival can be determined based on the content control data D2. Here, the second control timing is the timing at which a scene is played back in which the user reaches a virtual object (e.g., a wall, a cliff, a fence, etc.) set up in response to a movement limit in real space and changes the movement direction.

[0061] Here, when it is determined that the second control timing has arrived, the movement control unit 332 generates a control signal for changing the movement direction so as not to exceed the movement limit in the real space, and outputs it to the omnidirectional vehicle 20 (step S204). For example, FIG. 7 is a diagram showing an example of a situation in which the movement direction of the omnidirectional vehicle 20 is changed at the second control timing. In FIG. 7, the image of the virtual space VS2 represents a situation in which a scene is being played in which the user is moving on the road R2 from the front side of the paper to the back side of the paper in the content image. In addition, the wall WL1 located midway on the road R2 is a virtual object displayed in correspondence with the wall WL2 (movement limit) that limits the user's movement range in the real space RS2.

[0062] For example, such a virtual object can be displayed by running omnidirectional vehicle 20 in a specified running scenario (route and speed) in accordance with the playback of content configured to display the virtual object at a predetermined timing. In the example of Fig. 7, this can be said to be a method of playing a video in which the vehicle reaches wall WL1 five minutes after the start of playback as content, while running omnidirectional vehicle 20 in a running scenario in which the vehicle reaches wall WL2 five minutes after the start of playback. That is, in this case, the content and the running scenario are configured to be synchronized in advance.

[0063] Alternatively, when the content is not merely played back by playing back a video, but is realized by reproducing a virtual space by simulation, the content playback unit 331 may place a virtual object in the virtual space according to the movement status of the omnidirectional vehicle 20. In this case, the content playback unit 331 needs to sequentially grasp the positional relationship between the omnidirectional vehicle 20 and the movement limit. Therefore, in this case, the omnidirectional vehicle 20 may have a function of acquiring position information of the vehicle itself, and may be configured to periodically acquire and provide the position information to the content control device 30.

[0064] In either implementation method, when the movement limit in the real space and the virtual object in the virtual space are displayed in sync, the movement control unit 332 generates a control signal that is synchronized with the image of the virtual space VS2 and changes the movement direction of the omnidirectional vehicle 20 in the real space RS2 so as not to exceed the movement limit, i.e., so as not to come into contact with the movement limit WL2. Here, for example, in the example of Fig. 7, the content being played is configured in advance to display a scene in which the vehicle turns left toward road R3 just before wall WL1, and the movement control unit 332 changes the movement direction of the omnidirectional vehicle 20 in accordance with the playback timing of this scene.

[0065] In this way, an object corresponding to the movement limits in the real space is also displayed in the virtual space, and the direction of movement of the omnidirectional vehicle 20 is changed in accordance with the playback timing of the scene in the virtual space in which the object is avoided, allowing the user to have an experience that includes movement in the virtual space with a greater sense of realism.

[0066] According to the content providing system 1A of the first embodiment configured as described above, content is played back to allow the user to experience an experience including movement in a virtual space, a video signal obtained by playing back the content is displayed on the video projection device 10, and the omnidirectional vehicle 20 is controlled in synchronization with the video displayed on the video projection device 10, thereby making it possible to improve the realism of the content providing an experience including movement in a virtual space.

[0067] <Second embodiment> FIG. 8 is a diagram showing a configuration example of a content providing system 1B in the second embodiment. The content providing system 1B is different from the content providing system 1A in the first embodiment in that the content providing system 1B further includes a drive stand device 40 that drives the omnidirectional wheels 22 to cancel the drive so that the omnidirectional vehicle 20 does not move, and further includes a special effect generating device 50 that generates various special effects to enhance the realism of the experience including movement in a virtual space. The other configurations of the content providing system 1B are the same as those of the content providing system 1A. Therefore, in FIG. 8, the same reference numerals as those in FIG. 1 are used for the configurations similar to those in the first embodiment, and the description thereof will be omitted here.

[0068] The driving platform device 40 is a device used as a base on which the omnidirectional vehicle 20 is placed. The driving platform device 40 includes a driving unit 42 that comes into contact with the omnidirectional wheels 22 of the omnidirectional vehicle 20 and drives the omnidirectional wheels 22 to cancel out the driving of the omnidirectional wheels 22. For example, the driving unit 42 may be composed of one or more spheres or caterpillars that rotate by the driving of the omnidirectional wheels 22, or may be composed of a planar member with a small friction coefficient. The driving unit 42 may detect the driving of the omnidirectional wheels 22 by a sensor and drive to cancel it, or may not have an electrical mechanism and drive relatively with small resistance to the driving of the omnidirectional wheels 22.

[0069] The special effects generating device 50 is a device that generates special effects such as wind, mist, smell, sound, and vibration. The special effects generating device 50 generates special effects in synchronization with a content video under the control of the content control device 30. For example, when a scene in which wind blows in a virtual space is played back in a content video, the special effects generating device 50 inputs a control signal for outputting wind from the content control device 30 at the playback timing. This allows the special effects generating device 50 to generate actual wind in the real space in synchronization with the scene in which wind blows in the virtual space.

[0070] FIG. 9 is a diagram showing an example of the functional configuration of the content providing system 1B in the second embodiment. As described above, the content providing system 1B is different from the content providing system 1A in the first embodiment in that it further includes a drive stand device 40 and a special effect generating device 50. In addition, in the content providing system 1B, the content control device 30 is different from the content providing system 1A in the first embodiment in that it includes a content control unit 33B instead of the content control unit 33A. In addition, the content control unit 33B is different from the content control unit 33A in the first embodiment in that it further includes a performance control unit 333. The other configurations of the content providing system 1B are the same as those of the content providing system 1A. Therefore, in FIG. 9, the same reference numerals as those in FIG. 3 are used for the configurations similar to those in the first embodiment, and the description thereof will be omitted here.

[0071] First, the configuration of the drive base device 40 will be described. The drive base device 40 includes a communication unit 41, a drive unit 42, and a drive sensor 43. The communication unit 41 is, for example, a wireless LAN interface that connects to a LAN. The communication unit 41 communicates with the content control device 30 via the LAN. The communication unit 41 may be replaced with another communication interface depending on the communication method adopted between the drive base device 40 and the content control device 30.

[0072] 8, the drive unit 42 is a drive mechanism that comes into contact with the omnidirectional wheels 22 of the omnidirectional vehicle 20 and drives the omnidirectional wheels 22 to counteract the drive of the omnidirectional wheels 22. The drive state of the drive unit 42 is detected by a drive sensor 43 and notified to the content control device 30.

[0073] The drive sensor 43 is a sensor that detects the drive state of the drive unit 42. The drive sensor 43 may be anything that can at least detect whether the drive unit 42 is in drive or not. For example, the drive sensor 43 may be a rotation sensor that detects the rotation of a rotating part that rotates by the operation of the drive unit 42, or a sensor that detects the displacement of the drive unit 42. The drive sensor 43 transmits information indicating the detection result (hereinafter referred to as "detection information") to the content control device 30.

[0074] Next, the configuration of the special effect generating device 50 will be described. The special effect generating device 50 is a device that generates an event that is perceived by at least one of the five human senses as a special effect that produces the content. The special effect generating device 50 includes, for example, a communication unit 51, a special effect generating unit 52, and a special effect control unit 53. The communication unit 51 is, for example, a wireless LAN interface that connects to a LAN. The communication unit 51 communicates with the content control device 30 via the LAN. The communication unit 51 may be replaced with another communication interface depending on the communication method adopted between the special effect generating device 50 and the content control device 30.

[0075] As described above, the special effect generating unit 52 is a device such as a blower, a sprayer, an aroma device, a speaker, or a vibrator that generates special effects such as wind, mist, smell, sound, and vibration. The special effect generating device 50 may include a plurality of special effect generating units 52 that generate different special effects, or may include a single special effect generating unit 52. Furthermore, the content providing system 1B may be configured to generate special effects required for the presentation of the content by one special effect generating device 50, or may be configured to generate the effects by a plurality of special effect generating devices 50. The special effect generating unit 52 can control the presence or absence of output of the special effect, the intensity of the output, and the like by an electric signal, and is controlled based on a control signal input from the special effect control unit 53.

[0076] The special effect control unit 53 controls the output operation of the special effect by the special effect generation unit 52. Specifically, the special effect control unit 53 controls the operation of the special effect generation unit 52 based on a control signal corresponding to the driving state of the drive base unit 40, which is supplied from the content control device 30. For example, when the drive base unit 40 is being driven, that is, when the omnidirectional wheels 22 are rotating, the special effect control unit 53 inputs a control signal that generates vibrations from the content control device 30 to provide a more realistic feeling of movement to the user, and outputs the input control signal to the special effect generation unit 52, causing the special effect generation unit 52 to generate vibrations, which are then transmitted to the omnidirectional vehicle 20. This allows the user to experience a more realistic feeling of movement when moving in a virtual space.

[0077] Next, the performance control unit 333 of the content control device 30 will be described. The performance control unit 333 instructs the special effect generating device 50 to generate a special effect according to the driving state of the drive base device 40. The performance control unit 333 generates a control signal according to the driving state of the drive base device 40 and outputs it to the special effect generating device 50. For example, in the above vibration example, the performance control unit 333 may generate a control signal that generates a small vibration when the omnidirectional vehicle 20 is moving at a low speed, and generate a control signal that generates a large vibration when the omnidirectional vehicle 20 is moving at a high speed. By the performance control unit 333 outputting such a control signal, the special effect generating device 50 can perform a performance of movement according to the driving state of the omnidirectional vehicle 20 for the user in synchronization with the driving state of the omnidirectional vehicle 20.

[0078] Fig. 10 is a flowchart showing an example of the flow of the synchronization control process in the second embodiment. Here, the synchronization control process in the second embodiment differs from the synchronization control process in the first embodiment in that it further includes steps S301 and S302. Therefore, in Fig. 10, the same processes as those in the first embodiment are denoted by the same reference numerals as those in Fig. 6, and the description thereof will be omitted here.

[0079] For example, after the movement control unit 332 outputs a control signal to the omnidirectional vehicle 20 in step S204, the performance control unit 333 determines whether or not a condition for generating a special effect is satisfied (step S301). The condition for generating a special effect here is, for example, that the omnidirectional vehicle 20 is in motion. Since the drive of the omnidirectional wheels 22 is cancelled by the drive platform unit 40, the omnidirectional vehicle 20 does not actually move from above the drive platform unit 40. In this case, the performance control unit 333 can determine whether or not the omnidirectional vehicle 20 is in motion based on the detection information received from the drive platform unit 40.

[0080] If it is determined that the conditions for generating the special effect are satisfied, the performance control unit 333 instructs the special effect generating device 50 to output a special effect according to the driving state of the omnidirectional vehicle 20 (step S302). On the other hand, if it is determined in step S301 that the conditions for generating the special effect are not satisfied, the performance control unit 333 skips step S302 and ends the synchronization control process.

[0081] According to the content providing system 1B of the second embodiment configured as described above, content is played back to allow the user to experience an experience including movement in a virtual space, a video signal obtained by playing back the content is displayed on the video projection device 10, and the omnidirectional vehicle 20 is controlled in synchronization with the video displayed on the video projection device 10, thereby making it possible to improve the realism of the content providing an experience including movement in a virtual space.

[0082] Furthermore, according to the content providing system 1B of the second embodiment, the driving of the omnidirectional vehicle 20, which is controlled in synchronization with the content video, is cancelled by the driving platform device 40, so that the omnidirectional vehicle 20 performs the same operation as when moving, but does not move from above the driving platform device 40. Therefore, content that allows the user to experience an experience that includes movement in a virtual space can be provided with a higher sense of realism and in a smaller space.

[0083] Furthermore, according to the content providing system 1B of the second embodiment, the special effects generating device 50 generates special effects according to the driving state of the omnidirectional vehicle 20 controlled in synchronization with the content video, thereby enabling the content to be produced using physical phenomena in real space. Therefore, content that allows the user to experience an experience that includes movement in a virtual space can be provided to the user with a higher sense of realism.

[0084] The above-described embodiment can be expressed as follows. A storage device storing a program; a hardware processor; The hardware processor executes the program stored in the storage device, A computer that functions as a control device of a content providing system including a vehicle having omnidirectional wheels and a video projection device, Playing content that allows users to experience an experience that includes movement in a virtual space; A video signal obtained by playing the content is output to the video projection device; controlling the omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device; The content control device is configured to:

[0085] In each of the above embodiments, some or all of the functional units of the content control device 30 may be distributed and disposed in one or more of the image projection device 10, the omnidirectional vehicle 20, the drive platform device 40, and the special effects generation device 50.

[0086] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0087] 1A, 1B...content providing system, 10...image projection device, 11...communication unit, 12...display unit, 13...display control unit, 20...omnidirectional vehicle, 21...seat unit, 22...omnidirectional wheel, 22A...large diameter wheel, 22B...small diameter wheel, 22C...turning wheel, 23...communication unit, 24...wheel control unit, 30...content control device, 31...communication unit, 32...storage unit, 33A, 33B...content control unit, 331...content playback unit, 332...movement control unit, 333...performance control unit, 34...axis, 40...drive platform device, 41...communication unit, 42...drive unit, 43...drive sensor, 50...special effects generating device, 51...communication unit, 52...special effects generating unit, 53...special effects control unit

Claims

1. A control device for a content providing system including a vehicle equipped with omnidirectional wheels and a video projection device, a content playback unit that plays content that allows a user to have an experience including movement in a virtual space, and outputs a video signal obtained by playing the content to the video projection device; a movement control unit that controls omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device; Equipped with the movement control unit controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the straight-line movement of the user in the virtual space during the reproduction of the content. Content control device.

2. the movement control unit controls the omnidirectional wheels so that the vehicle travels along the circular route at a speed equal to or less than a specified speed. The content control device according to claim 1 .

3. A control device for a content providing system including a vehicle equipped with omnidirectional wheels and a video projection device, a content playback unit that plays content that allows a user to have an experience including movement in a virtual space, and outputs a video signal obtained by playing the content to the video projection device; a movement control unit that controls omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device; a drive platform device that acts as a platform on which the vehicle is placed and counteracts the movement of the vehicle caused by the omnidirectional wheels; A content control device comprising:

4. A production control unit is further provided that instructs a generating device that generates an event perceived by at least one of the five human senses as a special effect for producing the content to generate the event according to a driving state of the driving table device. The content control device according to claim 3 .

5. In the image of the virtual space obtained by playing the content, the virtual space is displayed so that an area that is recognized as being closer by the user changes more significantly in accordance with the user's movement in the virtual space, and an area that is recognized as being farther away by the user changes less significantly in accordance with the user's movement in the virtual space. The content control device according to claim 1 .

6. the movement control unit controls the omnidirectional wheels based on a position of an object displayed in the virtual space corresponding to the movement limit of the vehicle so that the user does not come into contact with the movement limit. The content control device according to claim 1 .

7. A computer that functions as a control device of a content providing system including a vehicle having omnidirectional wheels and a video projection device, a content reproduction process for reproducing content that allows a user to have an experience including movement in a virtual space, and outputting a video signal obtained by reproducing the content to the video projection device; a movement control process for controlling omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device; A content control method for performing the movement control process controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the user's straight-line movement in the virtual space during playback of the content; Content control methods.

8. A computer functioning as a control device for a content providing system including a vehicle equipped with omnidirectional wheels, a video projection device, and a base device for supporting said vehicle, said base device being a drive base device for canceling the movement of said vehicle caused by said omnidirectional wheels, a content reproduction process for reproducing content that allows a user to have an experience including movement in a virtual space, and outputting a video signal obtained by reproducing the content to the video projection device; a movement control process for controlling omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device; A content control method that performs

9. A computer that functions as a control device of a content providing system including a vehicle equipped with omnidirectional wheels and an image projection device, a content reproduction process for reproducing content that allows a user to have an experience including movement in a virtual space, and outputting a video signal obtained by reproducing the content to the video projection device; a movement control process for controlling omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device; A program for executing the movement control process controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the user's straight-line movement in the virtual space during playback of the content; program.

10. A computer functioning as a control device for a content providing system including a vehicle equipped with omnidirectional wheels, an image projection device, and a drive platform device that serves as a base for mounting the vehicle and counters the movement of the vehicle caused by the omnidirectional wheels, a content reproduction process for reproducing content that allows a user to have an experience including movement in a virtual space, and outputting a video signal obtained by reproducing the content to the video projection device; a movement control process for controlling omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device; A program for executing.

11. A vehicle equipped with omnidirectional wheels; A video projection device; a content playback unit that plays content that allows a user to have an experience including movement in a virtual space, and outputs a video signal obtained by playing the content to the video projection device; a movement control unit that controls omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device; Equipped with the movement control unit controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the straight-line movement of the user in the virtual space during the reproduction of the content. Content delivery system.

12. A vehicle equipped with omnidirectional wheels; A video projection device; a drive platform device that acts as a platform on which the vehicle is placed and counteracts the movement of the vehicle caused by the omnidirectional wheels; a content playback unit that plays content that allows a user to have an experience including movement in a virtual space, and outputs a video signal obtained by playing the content to the video projection device; a movement control unit that controls omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device; A content providing system comprising:

Images